Nameexact_genome_1512568488_41_5522_1
Workunit2598914
Created7 Dec 2017, 15:13:28 UTC
Sent7 Dec 2017, 15:17:35 UTC
Report deadline14 Dec 2017, 15:46:08 UTC
Received9 Dec 2017, 8:36:02 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID62426
Run time4 hours 42 min 3 sec
CPU time4 hours 24 min 44 sec
Validate stateValid
Credit1,754.96
Device peak FLOPS2.98 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size153.80 MB
Peak swap size152.16 MB
Peak disk usage1.69 MB

Stderr output

<core_client_version>7.6.22</core_client_version>
<![CDATA[
<stderr_txt>
10000 (96.35%), best:    9635/10000 (96.35%), error:      1259.91272, best error:      1259.91272 on epoch:    14, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 151.6016387939s, input_fired_time: 1.4126354456, output_fired_time: 1.5917352438, propagate_forward_time: 57.3375701904, propagate_backward_time: 87.9323120117, weight_update_time: 0.1780406982, other_time: 3.3273925781
epoch time: 12.7651805878s, input_fired_time: 0.1765931845, output_fired_time: 0.0000000000, propagate_forward_time: 11.9684257507, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6201620102
validation[          , genome  5522] predictions:    9633/  10000 (96.33%), best:    9635/10000 (96.35%), error:      1276.65015, best error:      1259.91272 on epoch:    14, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 153.1652526855s, input_fired_time: 1.4668599367, output_fired_time: 1.6455361843, propagate_forward_time: 58.1271171570, propagate_backward_time: 88.6590118408, weight_update_time: 0.1780321449, other_time: 3.2667236328
epoch time: 12.4812173843s, input_fired_time: 0.2209827155, output_fired_time: 0.0000000000, propagate_forward_time: 11.6351003647, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6251344681
validation[          , genome  5522] predictions:    9625/  10000 (96.25%), best:    9635/10000 (96.35%), error:      1336.16931, best error:      1259.91272 on epoch:    14, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 150.5388183594s, input_fired_time: 1.4319387674, output_fired_time: 1.5470445156, propagate_forward_time: 57.0476875305, propagate_backward_time: 87.2822952271, weight_update_time: 0.1760951877, other_time: 3.2298507690
epoch time: 10.0854187012s, input_fired_time: 0.1558186859, output_fired_time: 0.0000000000, propagate_forward_time: 9.3180389404, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6115608215
validation[          , genome  5522] predictions:    9560/  10000 (95.60%), best:    9635/10000 (96.35%), error:      1478.51331, best error:      1259.91272 on epoch:    14, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 130.8269042969s, input_fired_time: 1.3082381487, output_fired_time: 1.4030612707, propagate_forward_time: 48.5072708130, propagate_backward_time: 76.4150390625, weight_update_time: 0.1688665897, other_time: 3.1932907104
epoch time: 13.3569126129s, input_fired_time: 0.2208075374, output_fired_time: 0.0000000000, propagate_forward_time: 12.5300102234, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6060953140
validation[          , genome  5522] predictions:    9600/  10000 (96.00%), best:    9635/10000 (96.35%), error:      1342.52478, best error:      1259.91272 on epoch:    14, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 152.2732238770s, input_fired_time: 1.4052883387, output_fired_time: 1.5416144133, propagate_forward_time: 57.8228263855, propagate_backward_time: 88.1673812866, weight_update_time: 0.2223467231, other_time: 3.3361129761
epoch time: 12.3673124313s, input_fired_time: 0.1724553704, output_fired_time: 0.0000000000, propagate_forward_time: 11.6024780273, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5923786163
validation[          , genome  5522] predictions:    9570/  10000 (95.70%), best:    9635/10000 (96.35%), error:      1413.82263, best error:      1259.91272 on epoch:    14, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 146.9548187256s, input_fired_time: 1.3987075090, output_fired_time: 1.5289715528, propagate_forward_time: 55.8311653137, propagate_backward_time: 85.0571746826, weight_update_time: 0.1758072823, other_time: 3.1387939453
epoch time: 12.2521057129s, input_fired_time: 0.1750857085, output_fired_time: 0.0000000000, propagate_forward_time: 11.5092325211, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5677871704
validation[          , genome  5522] predictions:    9624/  10000 (96.24%), best:    9624/10000 (96.24%), error:      1244.65808, best error:      1244.65808 on epoch:    20, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 150.2472686768s, input_fired_time: 1.4040901661, output_fired_time: 1.6400802135, propagate_forward_time: 56.9660758972, propagate_backward_time: 87.0252761841, weight_update_time: 0.2232793123, other_time: 3.2117538452
epoch time: 16.3134899139s, input_fired_time: 0.2218904495, output_fired_time: 0.0000000000, propagate_forward_time: 15.3592853546, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7323131561
validation[          , genome  5522] predictions:    9625/  10000 (96.25%), best:    9624/10000 (96.24%), error:      1277.09546, best error:      1244.65808 on epoch:    20, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 162.2193603516s, input_fired_time: 1.5507117510, output_fired_time: 1.5492185354, propagate_forward_time: 57.3519630432, propagate_backward_time: 98.5822982788, weight_update_time: 0.1765498370, other_time: 3.1851730347
epoch time: 11.7712450027s, input_fired_time: 0.1739339083, output_fired_time: 0.0000000000, propagate_forward_time: 11.0370588303, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5602521896
validation[          , genome  5522] predictions:    9585/  10000 (95.85%), best:    9624/10000 (96.24%), error:      1337.25024, best error:      1244.65808 on epoch:    20, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 155.3123321533s, input_fired_time: 1.4699676037, output_fired_time: 1.5441515446, propagate_forward_time: 59.8538017273, propagate_backward_time: 88.6104583740, weight_update_time: 0.1768624038, other_time: 3.8339385986
epoch time: 18.8548393250s, input_fired_time: 0.2683726549, output_fired_time: 0.0000000000, propagate_forward_time: 17.7554740906, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8309917450
validation[          , genome  5522] predictions:    9640/  10000 (96.40%), best:    9624/10000 (96.24%), error:      1246.84668, best error:      1244.65808 on epoch:    20, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 146.4980926514s, input_fired_time: 1.4162017107, output_fired_time: 1.5489060879, propagate_forward_time: 55.5902976990, propagate_backward_time: 84.8118286133, weight_update_time: 0.1767858416, other_time: 3.1308593750
epoch time: 16.0432815552s, input_fired_time: 0.1788105369, output_fired_time: 0.0000000000, propagate_forward_time: 15.1560258865, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7084455490
validation[          , genome  5522] predictions:    9652/  10000 (96.52%), best:    9652/10000 (96.52%), error:      1180.96057, best error:      1180.96057 on epoch:    24, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 151.2448577881s, input_fired_time: 1.4237345457, output_fired_time: 1.6414293051, propagate_forward_time: 57.2469024658, propagate_backward_time: 87.6126251221, weight_update_time: 0.2154897153, other_time: 3.3201599121
epoch time: 18.3178386688s, input_fired_time: 0.2536723614, output_fired_time: 0.0000000000, propagate_forward_time: 17.1269855499, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9371814728
validation[          , genome  5522] predictions:    9614/  10000 (96.14%), best:    9652/10000 (96.52%), error:      1267.55859, best error:      1180.96057 on epoch:    24, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 147.8053436279s, input_fired_time: 1.4004501104, output_fired_time: 1.5399363041, propagate_forward_time: 56.0051651001, propagate_backward_time: 85.7724227905, weight_update_time: 0.1756308377, other_time: 3.0873718262
epoch time: 15.0074853897s, input_fired_time: 0.1765551269, output_fired_time: 0.0000000000, propagate_forward_time: 14.0291585922, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8017721176
validation[          , genome  5522] predictions:    9665/  10000 (96.65%), best:    9652/10000 (96.52%), error:      1187.60620, best error:      1180.96057 on epoch:    24, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 148.2543182373s, input_fired_time: 1.4348264933, output_fired_time: 1.5495623350, propagate_forward_time: 56.2868995667, propagate_backward_time: 85.7805252075, weight_update_time: 0.1774498373, other_time: 3.2025070190
epoch time: 13.8923206329s, input_fired_time: 0.2701830268, output_fired_time: 0.0000000000, propagate_forward_time: 12.9749336243, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6472043991
validation[          , genome  5522] predictions:    9643/  10000 (96.43%), best:    9652/10000 (96.52%), error:      1238.57495, best error:      1180.96057 on epoch:    24, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 152.9012908936s, input_fired_time: 1.5536422729, output_fired_time: 1.6419528723, propagate_forward_time: 57.7919273376, propagate_backward_time: 88.7121505737, weight_update_time: 0.1761834174, other_time: 3.2016220093
epoch time: 18.7908496857s, input_fired_time: 0.3128064275, output_fired_time: 0.0000000000, propagate_forward_time: 17.5968475342, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8811950684
validation[          , genome  5522] predictions:    9646/  10000 (96.46%), best:    9652/10000 (96.52%), error:      1228.91248, best error:      1180.96057 on epoch:    24, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 151.9930572510s, input_fired_time: 1.4320482016, output_fired_time: 1.6031734943, propagate_forward_time: 57.3560676575, propagate_backward_time: 88.4171218872, weight_update_time: 0.1748182625, other_time: 3.1846389771
epoch time: 12.1389989853s, input_fired_time: 0.1748708785, output_fired_time: 0.0000000000, propagate_forward_time: 11.3568048477, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6073236465
validation[          , genome  5522] predictions:    9662/  10000 (96.62%), best:    9662/10000 (96.62%), error:      1177.91858, best error:      1177.91858 on epoch:    29, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 148.2904052734s, input_fired_time: 1.4055302143, output_fired_time: 1.5840505362, propagate_forward_time: 56.2366561890, propagate_backward_time: 85.9738998413, weight_update_time: 0.1761706620, other_time: 3.0902709961
epoch time: 13.2461099625s, input_fired_time: 0.2238791734, output_fired_time: 0.0000000000, propagate_forward_time: 12.3152799606, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7069511414
validation[          , genome  5522] predictions:    9593/  10000 (95.93%), best:    9662/10000 (96.62%), error:      1363.48108, best error:      1177.91858 on epoch:    29, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 163.6178283691s, input_fired_time: 1.5991230011, output_fired_time: 1.6862535477, propagate_forward_time: 58.9242439270, propagate_backward_time: 98.1263046265, weight_update_time: 0.1765359789, other_time: 3.2819137573
epoch time: 16.0285072327s, input_fired_time: 0.3190384805, output_fired_time: 0.0000000000, propagate_forward_time: 15.0129327774, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6965360641
validation[          , genome  5522] predictions:    9660/  10000 (96.60%), best:    9660/10000 (96.60%), error:      1160.25623, best error:      1160.25623 on epoch:    31, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 155.3957672119s, input_fired_time: 1.5401055813, output_fired_time: 1.6022837162, propagate_forward_time: 58.1258659363, propagate_backward_time: 90.8461685181, weight_update_time: 0.1742565036, other_time: 3.2813491821
epoch time: 14.2001886368s, input_fired_time: 0.3049432933, output_fired_time: 0.0000000000, propagate_forward_time: 13.0930414200, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8022041321
validation[          , genome  5522] predictions:    9618/  10000 (96.18%), best:    9660/10000 (96.60%), error:      1313.10046, best error:      1160.25623 on epoch:    31, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 151.4755706787s, input_fired_time: 1.4224332571, output_fired_time: 1.5970866680, propagate_forward_time: 57.4970397949, propagate_backward_time: 87.7738494873, weight_update_time: 0.1762715727, other_time: 3.1851501465
epoch time: 15.0356588364s, input_fired_time: 0.1763491035, output_fired_time: 0.0000000000, propagate_forward_time: 14.1116838455, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7476263046
validation[          , genome  5522] predictions:    9651/  10000 (96.51%), best:    9660/10000 (96.60%), error:      1186.25940, best error:      1160.25623 on epoch:    31, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 156.0915222168s, input_fired_time: 1.5532766581, output_fired_time: 1.6576516628, propagate_forward_time: 59.1582679749, propagate_backward_time: 90.3931579590, weight_update_time: 0.1765009463, other_time: 3.3291625977
epoch time: 15.9437742233s, input_fired_time: 0.1759684086, output_fired_time: 0.0000000000, propagate_forward_time: 14.9643869400, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8034191132
validation[          , genome  5522] predictions:    9655/  10000 (96.55%), best:    9660/10000 (96.60%), error:      1203.88367, best error:      1160.25623 on epoch:    31, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 186.7039642334s, input_fired_time: 1.5971746445, output_fired_time: 1.7209808826, propagate_forward_time: 85.7832260132, propagate_backward_time: 94.0822143555, weight_update_time: 0.1768631190, other_time: 3.5203781128
epoch time: 11.6123399734s, input_fired_time: 0.1725681573, output_fired_time: 0.0000000000, propagate_forward_time: 10.8854036331, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5543680191
validation[          , genome  5522] predictions:    9661/  10000 (96.61%), best:    9660/10000 (96.60%), error:      1223.25781, best error:      1160.25623 on epoch:    31, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 157.5037841797s, input_fired_time: 1.5191047192, output_fired_time: 1.5974438190, propagate_forward_time: 59.8180618286, propagate_backward_time: 91.1711273193, weight_update_time: 0.1777019203, other_time: 3.3980484009
epoch time: 23.7863521576s, input_fired_time: 0.2228266895, output_fired_time: 0.0000000000, propagate_forward_time: 22.8689670563, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6945590973
validation[          , genome  5522] predictions:    9630/  10000 (96.30%), best:    9660/10000 (96.60%), error:      1262.77258, best error:      1160.25623 on epoch:    31, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 154.3553924561s, input_fired_time: 1.4570713043, output_fired_time: 1.5766357183, propagate_forward_time: 58.6363716125, propagate_backward_time: 89.3996887207, weight_update_time: 0.1777711958, other_time: 3.2856292725
epoch time: 11.9280767441s, input_fired_time: 0.1778230816, output_fired_time: 0.0000000000, propagate_forward_time: 11.1839618683, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5662918091
validation[          , genome  5522] predictions:    9616/  10000 (96.16%), best:    9660/10000 (96.60%), error:      1237.65332, best error:      1160.25623 on epoch:    31, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 149.3437805176s, input_fired_time: 1.4809416533, output_fired_time: 1.5527333021, propagate_forward_time: 56.5558776855, propagate_backward_time: 86.5455856323, weight_update_time: 0.1763066053, other_time: 3.2086410522
epoch time: 12.1932363510s, input_fired_time: 0.1755449325, output_fired_time: 0.0000000000, propagate_forward_time: 11.4554700851, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5622215271
validation[          , genome  5522] predictions:    9660/  10000 (96.60%), best:    9660/10000 (96.60%), error:      1136.96790, best error:      1136.96790 on epoch:    38, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 158.6790924072s, input_fired_time: 1.5168195963, output_fired_time: 1.6923950911, propagate_forward_time: 60.4063415527, propagate_backward_time: 91.7701644897, weight_update_time: 0.1779726595, other_time: 3.2933731079
epoch time: 18.2742023468s, input_fired_time: 0.2703390419, output_fired_time: 0.0000000000, propagate_forward_time: 17.0785388947, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9253234863
validation[          , genome  5522] predictions:    9630/  10000 (96.30%), best:    9660/10000 (96.60%), error:      1222.38562, best error:      1136.96790 on epoch:    38, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 161.6080017090s, input_fired_time: 1.3987934589, output_fired_time: 1.6359289885, propagate_forward_time: 67.1533203125, propagate_backward_time: 88.1826248169, weight_update_time: 0.1752720773, other_time: 3.2373428345
epoch time: 19.4671325684s, input_fired_time: 0.1740189940, output_fired_time: 0.0000000000, propagate_forward_time: 18.7310276031, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5620861053
validation[          , genome  5522] predictions:    9628/  10000 (96.28%), best:    9660/10000 (96.60%), error:      1230.93665, best error:      1136.96790 on epoch:    38, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 161.2474060059s, input_fired_time: 1.6084753275, output_fired_time: 1.7539337873, propagate_forward_time: 60.9850502014, propagate_backward_time: 93.3857574463, weight_update_time: 0.1777809560, other_time: 3.5141906738
epoch time: 12.2591238022s, input_fired_time: 0.1750695556, output_fired_time: 0.0000000000, propagate_forward_time: 11.5194311142, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5646228790
validation[          , genome  5522] predictions:    9632/  10000 (96.32%), best:    9660/10000 (96.60%), error:      1163.57739, best error:      1136.96790 on epoch:    38, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 145.0290374756s, input_fired_time: 1.4141210318, output_fired_time: 1.5408272743, propagate_forward_time: 54.9930458069, propagate_backward_time: 83.9730224609, weight_update_time: 0.1753317714, other_time: 3.1080169678
epoch time: 13.8599576950s, input_fired_time: 0.2243634015, output_fired_time: 0.0000000000, propagate_forward_time: 13.0248031616, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6107912064
validation[          , genome  5522] predictions:    9657/  10000 (96.57%), best:    9660/10000 (96.60%), error:      1198.83997, best error:      1136.96790 on epoch:    38, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 153.8888549805s, input_fired_time: 1.4707242250, output_fired_time: 1.5488114357, propagate_forward_time: 58.6040725708, propagate_backward_time: 89.1730194092, weight_update_time: 0.1781527698, other_time: 3.0922317505
epoch time: 14.4323730469s, input_fired_time: 0.2224240303, output_fired_time: 0.0000000000, propagate_forward_time: 13.4323463440, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7776031494
validation[          , genome  5522] predictions:    9650/  10000 (96.50%), best:    9660/10000 (96.60%), error:      1191.57434, best error:      1136.96790 on epoch:    38, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 151.3581085205s, input_fired_time: 1.5316798687, output_fired_time: 1.5531772375, propagate_forward_time: 57.4388198853, propagate_backward_time: 87.5101089478, weight_update_time: 0.1785100549, other_time: 3.3243255615
epoch time: 11.8320579529s, input_fired_time: 0.1762613356, output_fired_time: 0.0000000000, propagate_forward_time: 11.0948743820, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5609226227
validation[          , genome  5522] predictions:    9645/  10000 (96.45%), best:    9660/10000 (96.60%), error:      1190.77661, best error:      1136.96790 on epoch:    38, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 146.5309143066s, input_fired_time: 1.3956608772, output_fired_time: 1.5121593475, propagate_forward_time: 55.3575401306, propagate_backward_time: 85.1231689453, weight_update_time: 0.1755434871, other_time: 3.1423797607
epoch time: 15.5844030380s, input_fired_time: 0.2243803889, output_fired_time: 0.0000000000, propagate_forward_time: 14.6106452942, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7493772507
validation[          , genome  5522] predictions:    9668/  10000 (96.68%), best:    9660/10000 (96.60%), error:      1147.09680, best error:      1136.96790 on epoch:    38, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 148.4772949219s, input_fired_time: 1.5039948225, output_fired_time: 1.5681828260, propagate_forward_time: 56.3069000244, propagate_backward_time: 85.9050369263, weight_update_time: 0.1790669858, other_time: 3.1931838989
epoch time: 12.0190324783s, input_fired_time: 0.1737098694, output_fired_time: 0.0000000000, propagate_forward_time: 11.2364768982, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6088457108
validation[          , genome  5522] predictions:    9628/  10000 (96.28%), best:    9660/10000 (96.60%), error:      1259.46973, best error:      1136.96790 on epoch:    38, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 146.8689727783s, input_fired_time: 1.4300945997, output_fired_time: 1.5379772186, propagate_forward_time: 56.0675888062, propagate_backward_time: 84.7060241699, weight_update_time: 0.1762961149, other_time: 3.1272811890
epoch time: 12.9978752136s, input_fired_time: 0.1812515706, output_fired_time: 0.0000000000, propagate_forward_time: 12.1503381729, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6662855148
validation[          , genome  5522] predictions:    9549/  10000 (95.49%), best:    9660/10000 (96.60%), error:      1384.63135, best error:      1136.96790 on epoch:    38, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 141.3871917725s, input_fired_time: 1.4255779982, output_fired_time: 1.4797775745, propagate_forward_time: 52.1725234985, propagate_backward_time: 81.3623199463, weight_update_time: 0.1729119718, other_time: 4.9469833374
epoch time: 14.2020530701s, input_fired_time: 0.1779594570, output_fired_time: 0.0000000000, propagate_forward_time: 13.2718820572, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7522115707
validation[          , genome  5522] predictions:    9632/  10000 (96.32%), best:    9660/10000 (96.60%), error:      1206.33093, best error:      1136.96790 on epoch:    38, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 150.6131286621s, input_fired_time: 1.5085034370, output_fired_time: 1.6250269413, propagate_forward_time: 56.9740447998, propagate_backward_time: 87.3959884644, weight_update_time: 0.1771649718, other_time: 3.1095657349
epoch time: 11.8254661560s, input_fired_time: 0.1782854646, output_fired_time: 0.0000000000, propagate_forward_time: 11.0842857361, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5628948212
validation[          , genome  5522] predictions:    9653/  10000 (96.53%), best:    9660/10000 (96.60%), error:      1197.04431, best error:      1136.96790 on epoch:    38, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 161.8441619873s, input_fired_time: 1.4793300629, output_fired_time: 1.7359633446, propagate_forward_time: 65.6335983276, propagate_backward_time: 89.8330383301, weight_update_time: 0.1774809957, other_time: 3.1622390747
epoch time: 12.0495710373s, input_fired_time: 0.1780667901, output_fired_time: 0.0000000000, propagate_forward_time: 11.3091526031, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5623512268
validation[          , genome  5522] predictions:    9636/  10000 (96.36%), best:    9660/10000 (96.60%), error:      1202.53955, best error:      1136.96790 on epoch:    38, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 156.6844177246s, input_fired_time: 1.4216506481, output_fired_time: 1.5358831882, propagate_forward_time: 65.7963790894, propagate_backward_time: 84.8313140869, weight_update_time: 0.1758545339, other_time: 3.0991897583
epoch time: 16.9660167694s, input_fired_time: 0.2709414959, output_fired_time: 0.0000000000, propagate_forward_time: 15.9940118790, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7010641098
validation[          , genome  5522] predictions:    9619/  10000 (96.19%), best:    9660/10000 (96.60%), error:      1227.64307, best error:      1136.96790 on epoch:    38, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 146.9929962158s, input_fired_time: 1.4196692705, output_fired_time: 1.6218746901, propagate_forward_time: 55.6624450684, propagate_backward_time: 85.1588363647, weight_update_time: 0.1758003235, other_time: 3.1301803589
epoch time: 14.7403821945s, input_fired_time: 0.2217349708, output_fired_time: 0.0000000000, propagate_forward_time: 13.8873081207, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6313390732
validation[          , genome  5522] predictions:    9661/  10000 (96.61%), best:    9660/10000 (96.60%), error:      1192.30212, best error:      1136.96790 on epoch:    38, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 160.1814270020s, input_fired_time: 1.4876080751, output_fired_time: 1.7334789038, propagate_forward_time: 60.7083435059, propagate_backward_time: 92.8257827759, weight_update_time: 0.1764231622, other_time: 3.4262161255
epoch time: 11.8186655045s, input_fired_time: 0.1760192662, output_fired_time: 0.0000000000, propagate_forward_time: 11.0758867264, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5667591095
validation[          , genome  5522] predictions:    9600/  10000 (96.00%), best:    9660/10000 (96.60%), error:      1341.48938, best error:      1136.96790 on epoch:    38, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 151.8789672852s, input_fired_time: 1.4769852161, output_fired_time: 1.5411341190, propagate_forward_time: 57.6717567444, propagate_backward_time: 87.8881072998, weight_update_time: 0.1765960008, other_time: 3.3009796143
epoch time: 12.6467304230s, input_fired_time: 0.1790846586, output_fired_time: 0.0000000000, propagate_forward_time: 11.9027214050, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5649242401
validation[          , genome  5522] predictions:    9660/  10000 (96.60%), best:    9660/10000 (96.60%), error:      1149.86145, best error:      1136.96790 on epoch:    38, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 145.8705291748s, input_fired_time: 1.4109060764, output_fired_time: 1.5244174004, propagate_forward_time: 55.2618713379, propagate_backward_time: 84.5680160522, weight_update_time: 0.1756308675, other_time: 3.1053237915
epoch time: 12.3870086670s, input_fired_time: 0.1791450381, output_fired_time: 0.0000000000, propagate_forward_time: 11.6085300446, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5993337631
validation[          , genome  5522] predictions:    9698/  10000 (96.98%), best:    9698/10000 (96.98%), error:      1106.32642, best error:      1106.32642 on epoch:    55, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 136.4232025146s, input_fired_time: 1.3818700314, output_fired_time: 1.4715338945, propagate_forward_time: 50.7540817261, propagate_backward_time: 79.6279830933, weight_update_time: 0.1708104610, other_time: 3.1877441406
epoch time: 13.4848957062s, input_fired_time: 0.2102694213, output_fired_time: 0.0000000000, propagate_forward_time: 12.6487827301, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6258440018
validation[          , genome  5522] predictions:    9578/  10000 (95.78%), best:    9698/10000 (96.98%), error:      1425.38037, best error:      1106.32642 on epoch:    55, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 165.0484008789s, input_fired_time: 1.4376896620, output_fired_time: 1.5488978624, propagate_forward_time: 60.2514724731, propagate_backward_time: 98.6878662109, weight_update_time: 0.1765744239, other_time: 3.1224746704
epoch time: 15.1422157288s, input_fired_time: 0.1800601780, output_fired_time: 0.0000000000, propagate_forward_time: 14.2201757431, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7419795990
validation[          , genome  5522] predictions:    9553/  10000 (95.53%), best:    9698/10000 (96.98%), error:      1484.71521, best error:      1106.32642 on epoch:    55, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 163.0448760986s, input_fired_time: 1.5395003557, output_fired_time: 1.5776214600, propagate_forward_time: 67.7462005615, propagate_backward_time: 88.8629684448, weight_update_time: 0.2126492709, other_time: 3.3185806274
epoch time: 12.0743980408s, input_fired_time: 0.1782739013, output_fired_time: 0.0000000000, propagate_forward_time: 11.3191022873, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5770215988
validation[          , genome  5522] predictions:    9648/  10000 (96.48%), best:    9698/10000 (96.98%), error:      1201.43140, best error:      1106.32642 on epoch:    55, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 150.1608276367s, input_fired_time: 1.4455430508, output_fired_time: 1.5916150808, propagate_forward_time: 56.9133834839, propagate_backward_time: 87.0195159912, weight_update_time: 0.1767545938, other_time: 3.1907730103
epoch time: 12.3465700150s, input_fired_time: 0.1805005372, output_fired_time: 0.0000000000, propagate_forward_time: 11.5629568100, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6031122208
validation[          , genome  5522] predictions:    9658/  10000 (96.58%), best:    9698/10000 (96.98%), error:      1151.03003, best error:      1106.32642 on epoch:    55, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 153.5717620850s, input_fired_time: 1.4243313074, output_fired_time: 1.5474269390, propagate_forward_time: 62.8084182739, propagate_backward_time: 84.6968078613, weight_update_time: 0.1764655262, other_time: 3.0947799683
epoch time: 23.0054473877s, input_fired_time: 0.1795422733, output_fired_time: 0.0000000000, propagate_forward_time: 22.2256965637, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6002082825
validation[          , genome  5522] predictions:    9656/  10000 (96.56%), best:    9698/10000 (96.98%), error:      1120.63098, best error:      1106.32642 on epoch:    55, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 149.3917236328s, input_fired_time: 1.5217380524, output_fired_time: 1.5687525272, propagate_forward_time: 56.8344497681, propagate_backward_time: 86.2363433838, weight_update_time: 0.1764678657, other_time: 3.2304306030
epoch time: 17.8152542114s, input_fired_time: 0.2101047188, output_fired_time: 0.0000000000, propagate_forward_time: 16.9779872894, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6271629333
validation[          , genome  5522] predictions:    9649/  10000 (96.49%), best:    9698/10000 (96.98%), error:      1181.69421, best error:      1106.32642 on epoch:    55, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 146.1931304932s, input_fired_time: 1.4263623953, output_fired_time: 1.5431002378, propagate_forward_time: 55.4976348877, propagate_backward_time: 84.5926361084, weight_update_time: 0.1762938797, other_time: 3.1333923340
epoch time: 17.7316761017s, input_fired_time: 0.2440215200, output_fired_time: 0.0000000000, propagate_forward_time: 16.6039257050, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8837280273
validation[          , genome  5522] predictions:    9673/  10000 (96.73%), best:    9698/10000 (96.98%), error:      1113.91187, best error:      1106.32642 on epoch:    55, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 149.6881256104s, input_fired_time: 1.5404410362, output_fired_time: 1.5775233507, propagate_forward_time: 56.6237068176, propagate_backward_time: 86.6906356812, weight_update_time: 0.2090117186, other_time: 3.2558212280
epoch time: 19.4448032379s, input_fired_time: 0.3658835590, output_fired_time: 0.0000000000, propagate_forward_time: 18.1841983795, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8947219849
validation[          , genome  5522] predictions:    9585/  10000 (95.85%), best:    9698/10000 (96.98%), error:      1440.74463, best error:      1106.32642 on epoch:    55, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 153.4479827881s, input_fired_time: 1.4191652536, output_fired_time: 1.5343232155, propagate_forward_time: 57.7117958069, propagate_backward_time: 89.5040512085, weight_update_time: 0.1760262698, other_time: 3.2786636353
epoch time: 13.2666282654s, input_fired_time: 0.2114944160, output_fired_time: 0.0000000000, propagate_forward_time: 12.4242668152, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6308670044
validation[          , genome  5522] predictions:    9617/  10000 (96.17%), best:    9698/10000 (96.98%), error:      1297.97461, best error:      1106.32642 on epoch:    55, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 148.3659515381s, input_fired_time: 1.4389748573, output_fired_time: 1.5504574776, propagate_forward_time: 56.2458610535, propagate_backward_time: 85.8581619263, weight_update_time: 0.1766072512, other_time: 3.2724838257
epoch time: 12.2008724213s, input_fired_time: 0.1798460484, output_fired_time: 0.0000000000, propagate_forward_time: 11.4575662613, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5634603500
validation[          , genome  5522] predictions:    9635/  10000 (96.35%), best:    9698/10000 (96.98%), error:      1202.14478, best error:      1106.32642 on epoch:    55, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 147.9749450684s, input_fired_time: 1.4439748526, output_fired_time: 1.5483286381, propagate_forward_time: 56.2351875305, propagate_backward_time: 85.6081771851, weight_update_time: 0.1771091968, other_time: 3.1392898560
epoch time: 12.4682617188s, input_fired_time: 0.1797097772, output_fired_time: 0.0000000000, propagate_forward_time: 11.6902666092, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5982856750
validation[          , genome  5522] predictions:    9608/  10000 (96.08%), best:    9698/10000 (96.98%), error:      1302.88184, best error:      1106.32642 on epoch:    55, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 151.4327239990s, input_fired_time: 1.4784213305, output_fired_time: 1.5350624323, propagate_forward_time: 55.3960380554, propagate_backward_time: 89.8729400635, weight_update_time: 0.1764666438, other_time: 3.1502532959
epoch time: 11.8824148178s, input_fired_time: 0.1820488125, output_fired_time: 0.0000000000, propagate_forward_time: 11.1335439682, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5668220520
validation[          , genome  5522] predictions:    9658/  10000 (96.58%), best:    9698/10000 (96.98%), error:      1162.33240, best error:      1106.32642 on epoch:    55, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 148.1544647217s, input_fired_time: 1.4470719099, output_fired_time: 1.5477552414, propagate_forward_time: 55.5162429810, propagate_backward_time: 86.5067596436, weight_update_time: 0.1790640354, other_time: 3.1366348267
epoch time: 15.5219964981s, input_fired_time: 0.2126708329, output_fired_time: 0.0000000000, propagate_forward_time: 14.5793352127, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7299900055
validation[          , genome  5522] predictions:    9669/  10000 (96.69%), best:    9698/10000 (96.98%), error:      1111.88318, best error:      1106.32642 on epoch:    55, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 148.3856658936s, input_fired_time: 1.4378916025, output_fired_time: 1.5813540220, propagate_forward_time: 56.2901229858, propagate_backward_time: 85.9065475464, weight_update_time: 0.1768461615, other_time: 3.1697387695
epoch time: 13.4482088089s, input_fired_time: 0.1815457046, output_fired_time: 0.0000000000, propagate_forward_time: 12.5707664490, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6958971024
validation[          , genome  5522] predictions:    9605/  10000 (96.05%), best:    9698/10000 (96.98%), error:      1308.97681, best error:      1106.32642 on epoch:    55, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 151.7444915771s, input_fired_time: 1.5061895847, output_fired_time: 1.5446445942, propagate_forward_time: 57.4373397827, propagate_backward_time: 87.9641189575, weight_update_time: 0.1761175245, other_time: 3.2921905518
epoch time: 17.6367473602s, input_fired_time: 0.3067303002, output_fired_time: 0.0000000000, propagate_forward_time: 16.5418987274, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7881183624
validation[          , genome  5522] predictions:    9685/  10000 (96.85%), best:    9685/10000 (96.85%), error:      1067.12622, best error:      1067.12622 on epoch:    70, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 160.4661560059s, input_fired_time: 1.4209139347, output_fired_time: 1.6009895802, propagate_forward_time: 68.0585403442, propagate_backward_time: 86.2029342651, weight_update_time: 0.1760663837, other_time: 3.1827850342
epoch time: 12.0567321777s, input_fired_time: 0.1820418686, output_fired_time: 0.0000000000, propagate_forward_time: 11.3076667786, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5670232773
validation[          , genome  5522] predictions:    9607/  10000 (96.07%), best:    9685/10000 (96.85%), error:      1298.26550, best error:      1067.12622 on epoch:    70, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 151.8235015869s, input_fired_time: 1.6119017601, output_fired_time: 1.6207251549, propagate_forward_time: 57.6263198853, propagate_backward_time: 87.8033905029, weight_update_time: 0.1795990616, other_time: 3.1611557007
epoch time: 12.7655601501s, input_fired_time: 0.1806081980, output_fired_time: 0.0000000000, propagate_forward_time: 11.9537839890, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6311683655
validation[          , genome  5522] predictions:    9646/  10000 (96.46%), best:    9685/10000 (96.85%), error:      1194.03918, best error:      1067.12622 on epoch:    70, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 153.5711669922s, input_fired_time: 1.5895962715, output_fired_time: 1.5638216734, propagate_forward_time: 57.2095680237, propagate_backward_time: 89.9986038208, weight_update_time: 0.1754203439, other_time: 3.2095718384
epoch time: 14.0477867126s, input_fired_time: 0.2462589592, output_fired_time: 0.0000000000, propagate_forward_time: 13.1041955948, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6973323822
validation[          , genome  5522] predictions:    9668/  10000 (96.68%), best:    9685/10000 (96.85%), error:      1144.39014, best error:      1067.12622 on epoch:    70, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 150.9827880859s, input_fired_time: 1.4872571230, output_fired_time: 1.5921149254, propagate_forward_time: 57.3632278442, propagate_backward_time: 87.3014373779, weight_update_time: 0.2097301781, other_time: 3.2387466431
epoch time: 11.7002363205s, input_fired_time: 0.1819536686, output_fired_time: 0.0000000000, propagate_forward_time: 10.9564094543, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5618734360
validation[          , genome  5522] predictions:    9633/  10000 (96.33%), best:    9685/10000 (96.85%), error:      1224.84216, best error:      1067.12622 on epoch:    70, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 144.6194763184s, input_fired_time: 1.4181269407, output_fired_time: 1.5261764526, propagate_forward_time: 54.7912063599, propagate_backward_time: 83.8127365112, weight_update_time: 0.1753629595, other_time: 3.0712280273
epoch time: 11.6859884262s, input_fired_time: 0.1767991036, output_fired_time: 0.0000000000, propagate_forward_time: 10.9508132935, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5583763123
validation[          , genome  5522] predictions:    9643/  10000 (96.43%), best:    9685/10000 (96.85%), error:      1177.81079, best error:      1067.12622 on epoch:    70, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 146.9438171387s, input_fired_time: 1.4296292067, output_fired_time: 1.5729000568, propagate_forward_time: 55.6690979004, propagate_backward_time: 85.1390151978, weight_update_time: 0.1755742878, other_time: 3.1331710815
epoch time: 11.6998386383s, input_fired_time: 0.1779297590, output_fired_time: 0.0000000000, propagate_forward_time: 10.9578285217, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5640802383
validation[          , genome  5522] predictions:    9632/  10000 (96.32%), best:    9685/10000 (96.85%), error:      1228.37268, best error:      1067.12622 on epoch:    70, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 145.6220855713s, input_fired_time: 1.4388955832, output_fired_time: 1.5420943499, propagate_forward_time: 55.2388381958, propagate_backward_time: 84.2696151733, weight_update_time: 0.1770260632, other_time: 3.1326446533
epoch time: 11.7820072174s, input_fired_time: 0.1804496944, output_fired_time: 0.0000000000, propagate_forward_time: 11.0372695923, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5642881393
validation[          , genome  5522] predictions:    9649/  10000 (96.49%), best:    9685/10000 (96.85%), error:      1154.25867, best error:      1067.12622 on epoch:    70, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 146.8851776123s, input_fired_time: 1.4440351725, output_fired_time: 1.5729646683, propagate_forward_time: 55.6597175598, propagate_backward_time: 85.0791091919, weight_update_time: 0.1773685813, other_time: 3.1293563843
epoch time: 11.6594705582s, input_fired_time: 0.1785314530, output_fired_time: 0.0000000000, propagate_forward_time: 10.9152259827, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5657129288
validation[          , genome  5522] predictions:    9678/  10000 (96.78%), best:    9685/10000 (96.85%), error:      1094.75037, best error:      1067.12622 on epoch:    70, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 147.0501861572s, input_fired_time: 1.4459719658, output_fired_time: 1.5529541969, propagate_forward_time: 55.6564483643, propagate_backward_time: 85.2685546875, weight_update_time: 0.1898703873, other_time: 3.1262664795
epoch time: 11.7319898605s, input_fired_time: 0.1802186817, output_fired_time: 0.0000000000, propagate_forward_time: 10.9894685745, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5623025894
validation[          , genome  5522] predictions:    9661/  10000 (96.61%), best:    9685/10000 (96.85%), error:      1144.36475, best error:      1067.12622 on epoch:    70, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 144.6493530273s, input_fired_time: 1.4257826805, output_fired_time: 1.5261169672, propagate_forward_time: 54.7364349365, propagate_backward_time: 83.8689498901, weight_update_time: 0.1758298874, other_time: 3.0920639038
epoch time: 11.8871259689s, input_fired_time: 0.1825896651, output_fired_time: 0.0000000000, propagate_forward_time: 11.1397151947, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5648212433
validation[          , genome  5522] predictions:    9629/  10000 (96.29%), best:    9685/10000 (96.85%), error:      1217.90991, best error:      1067.12622 on epoch:    70, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 145.9177856445s, input_fired_time: 1.4437004328, output_fired_time: 1.5461088419, propagate_forward_time: 55.4093208313, propagate_backward_time: 84.3991622925, weight_update_time: 0.1761121452, other_time: 3.1194992065
epoch time: 11.9607944489s, input_fired_time: 0.1832044125, output_fired_time: 0.0000000000, propagate_forward_time: 11.2077636719, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5698261261
validation[          , genome  5522] predictions:    9660/  10000 (96.60%), best:    9685/10000 (96.85%), error:      1138.96045, best error:      1067.12622 on epoch:    70, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 161.6302185059s, input_fired_time: 1.5317693949, output_fired_time: 1.6038718224, propagate_forward_time: 60.9788169861, propagate_backward_time: 94.3028869629, weight_update_time: 0.2265430987, other_time: 3.2128753662
epoch time: 11.6176910400s, input_fired_time: 0.1775683016, output_fired_time: 0.0000000000, propagate_forward_time: 10.8811903000, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5589323044
validation[          , genome  5522] predictions:    9680/  10000 (96.80%), best:    9685/10000 (96.85%), error:      1085.03479, best error:      1067.12622 on epoch:    70, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 155.1522369385s, input_fired_time: 1.4679399729, output_fired_time: 1.5627118349, propagate_forward_time: 56.0771980286, propagate_backward_time: 92.8810424805, weight_update_time: 0.1783035547, other_time: 3.1633453369
epoch time: 14.3568983078s, input_fired_time: 0.2149724811, output_fired_time: 0.0000000000, propagate_forward_time: 13.4700021744, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6719236374
validation[          , genome  5522] predictions:    9675/  10000 (96.75%), best:    9685/10000 (96.85%), error:      1103.72827, best error:      1067.12622 on epoch:    70, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 148.2747039795s, input_fired_time: 1.4528394938, output_fired_time: 1.5672957897, propagate_forward_time: 58.3827552795, propagate_backward_time: 83.6016082764, weight_update_time: 0.1720606536, other_time: 3.2702178955
epoch time: 13.2334089279s, input_fired_time: 0.1839050204, output_fired_time: 0.0000000000, propagate_forward_time: 12.4513454437, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5981588364
validation[          , genome  5522] predictions:    9625/  10000 (96.25%), best:    9685/10000 (96.85%), error:      1283.47400, best error:      1067.12622 on epoch:    70, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 148.5703735352s, input_fired_time: 1.5394769907, output_fired_time: 1.5717011690, propagate_forward_time: 56.3513679504, propagate_backward_time: 85.8620376587, weight_update_time: 0.1791675985, other_time: 3.2457962036
epoch time: 12.8268232346s, input_fired_time: 0.2122134268, output_fired_time: 0.0000000000, propagate_forward_time: 11.9828834534, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6317262650
validation[          , genome  5522] predictions:    9601/  10000 (96.01%), best:    9685/10000 (96.85%), error:      1281.54089, best error:      1067.12622 on epoch:    70, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 154.6987609863s, input_fired_time: 1.5314570665, output_fired_time: 1.7041864395, propagate_forward_time: 58.5927352905, propagate_backward_time: 89.4586944580, weight_update_time: 0.1759631485, other_time: 3.4116744995
epoch time: 17.5239353180s, input_fired_time: 0.3090962470, output_fired_time: 0.0000000000, propagate_forward_time: 16.3305244446, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8843154907
validation[          , genome  5522] predictions:    9593/  10000 (95.93%), best:    9685/10000 (96.85%), error:      1347.55237, best error:      1067.12622 on epoch:    70, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 149.6693878174s, input_fired_time: 1.4905436039, output_fired_time: 1.6115928888, propagate_forward_time: 56.5487823486, propagate_backward_time: 86.8154144287, weight_update_time: 0.1768424213, other_time: 3.2030639648
epoch time: 13.1730384827s, input_fired_time: 0.1829657704, output_fired_time: 0.0000000000, propagate_forward_time: 12.3591241837, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6309480667
validation[          , genome  5522] predictions:    9638/  10000 (96.38%), best:    9685/10000 (96.85%), error:      1207.86438, best error:      1067.12622 on epoch:    70, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 150.3210449219s, input_fired_time: 1.4637995958, output_fired_time: 1.6195397377, propagate_forward_time: 56.7689704895, propagate_backward_time: 87.2285690308, weight_update_time: 0.1805718392, other_time: 3.2401657104
epoch time: 16.3081607819s, input_fired_time: 0.3109528720, output_fired_time: 0.0000000000, propagate_forward_time: 15.2008180618, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7963895798
validation[          , genome  5522] predictions:    9662/  10000 (96.62%), best:    9685/10000 (96.85%), error:      1147.46570, best error:      1067.12622 on epoch:    70, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 157.0600738525s, input_fired_time: 1.6277800798, output_fired_time: 1.7185486555, propagate_forward_time: 59.5448074341, propagate_backward_time: 90.8401184082, weight_update_time: 0.2089481950, other_time: 3.3288192749
epoch time: 12.1321249008s, input_fired_time: 0.2054078579, output_fired_time: 0.0000000000, propagate_forward_time: 11.3039417267, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6227750778
validation[          , genome  5522] predictions:    9644/  10000 (96.44%), best:    9685/10000 (96.85%), error:      1213.03174, best error:      1067.12622 on epoch:    70, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 151.6731414795s, input_fired_time: 1.5954736471, output_fired_time: 1.6312569380, propagate_forward_time: 57.4757003784, propagate_backward_time: 87.7509460449, weight_update_time: 0.1758872122, other_time: 3.2197647095
epoch time: 12.8122959137s, input_fired_time: 0.2136336416, output_fired_time: 0.0000000000, propagate_forward_time: 12.0376300812, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5610322952
validation[          , genome  5522] predictions:    9660/  10000 (96.60%), best:    9685/10000 (96.85%), error:      1146.98462, best error:      1067.12622 on epoch:    70, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 155.1153564453s, input_fired_time: 1.4854441881, output_fired_time: 1.6391814947, propagate_forward_time: 59.8750190735, propagate_backward_time: 88.8363418579, weight_update_time: 0.1765428334, other_time: 3.2793807983
epoch time: 17.6932830811s, input_fired_time: 0.2156145871, output_fired_time: 0.0000000000, propagate_forward_time: 16.6553459167, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8223228455
validation[          , genome  5522] predictions:    9631/  10000 (96.31%), best:    9685/10000 (96.85%), error:      1223.81689, best error:      1067.12622 on epoch:    70, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 149.1625518799s, input_fired_time: 1.5131524801, output_fired_time: 1.5773475170, propagate_forward_time: 56.5608062744, propagate_backward_time: 86.3380203247, weight_update_time: 0.2085465193, other_time: 3.1732254028
epoch time: 17.2226276398s, input_fired_time: 0.3087964356, output_fired_time: 0.0000000000, propagate_forward_time: 16.0912418365, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8225898743
validation[          , genome  5522] predictions:    9649/  10000 (96.49%), best:    9685/10000 (96.85%), error:      1164.41077, best error:      1067.12622 on epoch:    70, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 151.8473205566s, input_fired_time: 1.4677553177, output_fired_time: 1.7158995867, propagate_forward_time: 57.5801849365, propagate_backward_time: 87.7037124634, weight_update_time: 0.2100785673, other_time: 3.3797683716
epoch time: 10.6272525787s, input_fired_time: 0.1619848907, output_fired_time: 0.0000000000, propagate_forward_time: 9.9043359756, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5609321594
validation[          , genome  5522] predictions:    9664/  10000 (96.64%), best:    9685/10000 (96.85%), error:      1116.35962, best error:      1067.12622 on epoch:    70, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 152.1500396729s, input_fired_time: 1.6338719130, output_fired_time: 1.6224342585, propagate_forward_time: 57.2496223450, propagate_backward_time: 88.3625640869, weight_update_time: 0.1753730178, other_time: 3.2815551758
epoch time: 13.7325086594s, input_fired_time: 0.1811248958, output_fired_time: 0.0000000000, propagate_forward_time: 12.9211187363, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6302652359
validation[          , genome  5522] predictions:    9644/  10000 (96.44%), best:    9685/10000 (96.85%), error:      1226.01208, best error:      1067.12622 on epoch:    70, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 147.4612121582s, input_fired_time: 1.4768443108, output_fired_time: 1.5629951954, propagate_forward_time: 55.9874954224, propagate_backward_time: 85.2472152710, weight_update_time: 0.1762041003, other_time: 3.1866760254
epoch time: 15.5814104080s, input_fired_time: 0.2477858067, output_fired_time: 0.0000000000, propagate_forward_time: 14.7034721375, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6301527023
validation[          , genome  5522] predictions:    9637/  10000 (96.37%), best:    9685/10000 (96.85%), error:      1175.03247, best error:      1067.12622 on epoch:    70, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 149.4384307861s, input_fired_time: 1.4771125317, output_fired_time: 1.6361247301, propagate_forward_time: 56.6331939697, propagate_backward_time: 86.4816818237, weight_update_time: 0.2081005126, other_time: 3.2103195190
epoch time: 16.9806861877s, input_fired_time: 0.2462423295, output_fired_time: 0.0000000000, propagate_forward_time: 15.9422845840, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7921590805
validation[          , genome  5522] predictions:    9544/  10000 (95.44%), best:    9685/10000 (96.85%), error:      1475.40869, best error:      1067.12622 on epoch:    70, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 152.7904968262s, input_fired_time: 1.6398502588, output_fired_time: 1.6560541391, propagate_forward_time: 58.0504684448, propagate_backward_time: 88.2778244019, weight_update_time: 0.1773717254, other_time: 3.1663055420
epoch time: 13.7787990570s, input_fired_time: 0.2169673592, output_fired_time: 0.0000000000, propagate_forward_time: 12.9309043884, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6309270859
validation[          , genome  5522] predictions:    9542/  10000 (95.42%), best:    9685/10000 (96.85%), error:      1471.93396, best error:      1067.12622 on epoch:    70, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 149.2016601563s, input_fired_time: 1.4680130482, output_fired_time: 1.5480527878, propagate_forward_time: 56.6551132202, propagate_backward_time: 86.3870010376, weight_update_time: 0.1776223481, other_time: 3.1434783936
epoch time: 11.9923439026s, input_fired_time: 0.2141605765, output_fired_time: 0.0000000000, propagate_forward_time: 11.2100496292, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5681333542
validation[          , genome  5522] predictions:    9677/  10000 (96.77%), best:    9685/10000 (96.85%), error:      1088.19495, best error:      1067.12622 on epoch:    70, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 150.7306365967s, input_fired_time: 1.4821343422, output_fired_time: 1.6672822237, propagate_forward_time: 57.0154380798, propagate_backward_time: 87.3318939209, weight_update_time: 0.1761290282, other_time: 3.2338867188
epoch time: 16.9313259125s, input_fired_time: 0.2799265981, output_fired_time: 0.0000000000, propagate_forward_time: 15.8593902588, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7920093536
validation[          , genome  5522] predictions:    9684/  10000 (96.84%), best:    9684/10000 (96.84%), error:      1065.75208, best error:      1065.75208 on epoch:    99, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 156.1422119141s, input_fired_time: 1.6349637508, output_fired_time: 1.6018035412, propagate_forward_time: 58.7621765137, propagate_backward_time: 90.6990432739, weight_update_time: 0.2083049864, other_time: 3.4442214966
epoch time: 14.8357315063s, input_fired_time: 0.2165392339, output_fired_time: 0.0000000000, propagate_forward_time: 13.9235143661, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6956777573
validation[          , genome  5522] predictions:    9624/  10000 (96.24%), best:    9684/10000 (96.84%), error:      1243.77002, best error:      1065.75208 on epoch:    99, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 59.6730613708s, input_fired_time: 0.9184856415, output_fired_time: 0.0000000000, propagate_forward_time: 55.8563461304, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8982315063
best training[          , genome  5522] predictions:   49221/  50000 (98.44%), best:    9684/10000 (96.84%), error:      2874.94507, best error:      1065.75208 on epoch:    99, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 14.3061733246s, input_fired_time: 0.1818701625, output_fired_time: 0.0000000000, propagate_forward_time: 13.4695768356, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6547260284
   testing[          , genome  5522] predictions:    9724/  10000 (97.24%), best:    9684/10000 (96.84%), error:       990.94714, best error:      1065.75208 on epoch:    99, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
02:35:45 (7408): called boinc_finish(0)

</stderr_txt>
]]>