Nameexact_genome_1512568488_45_5033_1
Workunit2596400
Created7 Dec 2017, 12:58:47 UTC
Sent7 Dec 2017, 13:00:50 UTC
Report deadline15 Dec 2017, 6:31:37 UTC
Received7 Dec 2017, 21:09:38 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID55108
Run time4 hours 13 min 1 sec
CPU time4 hours 8 min 46 sec
Validate stateValid
Credit1,932.43
Device peak FLOPS2.57 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size154.38 MB
Peak swap size157.58 MB
Peak disk usage1.82 MB

Stderr output

<core_client_version>7.8.2</core_client_version>
<![CDATA[
<stderr_txt>
56/  10000 (96.56%), best:    9667/10000 (96.67%), error:      1160.46643, best error:      1059.23987 on epoch:    13, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 143.1545104980s, input_fired_time: 1.3547438383, output_fired_time: 1.1939733028, propagate_forward_time: 55.1002120972, propagate_backward_time: 82.2890396118, weight_update_time: 0.1520400047, other_time: 3.2165527344
epoch time: 10.7017593384s, input_fired_time: 0.1714152992, output_fired_time: 0.0000000000, propagate_forward_time: 9.9661760330, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5641679764
validation[          , genome  5033] predictions:    9697/  10000 (96.97%), best:    9697/10000 (96.97%), error:      1023.48651, best error:      1023.48651 on epoch:    15, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 142.4372711182s, input_fired_time: 1.3542102575, output_fired_time: 1.1865094900, propagate_forward_time: 51.7598953247, propagate_backward_time: 84.8760070801, weight_update_time: 0.1518563032, other_time: 3.2606430054
epoch time: 11.7952880859s, input_fired_time: 0.1729371250, output_fired_time: 0.0000000000, propagate_forward_time: 10.0402746201, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5820760727
validation[          , genome  5033] predictions:    9657/  10000 (96.57%), best:    9697/10000 (96.97%), error:      1151.13025, best error:      1023.48651 on epoch:    15, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 144.7348022461s, input_fired_time: 1.3567651510, output_fired_time: 1.2306885719, propagate_forward_time: 55.7711906433, propagate_backward_time: 82.0832977295, weight_update_time: 0.1586532593, other_time: 4.2928619385
epoch time: 12.0954771042s, input_fired_time: 0.1760432720, output_fired_time: 0.0000000000, propagate_forward_time: 11.3389444351, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5804891586
validation[          , genome  5033] predictions:    9655/  10000 (96.55%), best:    9697/10000 (96.97%), error:      1147.73730, best error:      1023.48651 on epoch:    15, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 154.5234832764s, input_fired_time: 1.4721610546, output_fired_time: 1.2765494585, propagate_forward_time: 59.8115959167, propagate_backward_time: 88.5109329224, weight_update_time: 0.1771856546, other_time: 3.4522323608
epoch time: 10.7627449036s, input_fired_time: 0.1698221862, output_fired_time: 0.0000000000, propagate_forward_time: 10.0274076462, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5655155182
validation[          , genome  5033] predictions:    9689/  10000 (96.89%), best:    9697/10000 (96.97%), error:      1069.29260, best error:      1023.48651 on epoch:    15, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 143.9714965820s, input_fired_time: 1.3605155945, output_fired_time: 1.2037279606, propagate_forward_time: 52.3812294006, propagate_backward_time: 85.8442687988, weight_update_time: 0.1518582851, other_time: 3.1817474365
epoch time: 12.0737857819s, input_fired_time: 0.1761996746, output_fired_time: 0.0000000000, propagate_forward_time: 11.3208808899, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5767049789
validation[          , genome  5033] predictions:    9687/  10000 (96.87%), best:    9697/10000 (96.97%), error:      1075.42419, best error:      1023.48651 on epoch:    15, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 142.7960052490s, input_fired_time: 1.3616830111, output_fired_time: 1.1928142309, propagate_forward_time: 53.0787849426, propagate_backward_time: 83.9402160645, weight_update_time: 0.1517189592, other_time: 3.2225189209
epoch time: 12.0949573517s, input_fired_time: 0.1774854064, output_fired_time: 0.0000000000, propagate_forward_time: 11.3084592819, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6090126038
validation[          , genome  5033] predictions:    9687/  10000 (96.87%), best:    9697/10000 (96.97%), error:      1032.24780, best error:      1023.48651 on epoch:    15, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 143.3053131104s, input_fired_time: 3.3842227459, output_fired_time: 1.1996632814, propagate_forward_time: 52.2142448425, propagate_backward_time: 83.2748565674, weight_update_time: 0.1522467583, other_time: 3.2323303223
epoch time: 12.1855964661s, input_fired_time: 0.1947876960, output_fired_time: 0.0000000000, propagate_forward_time: 11.4102582932, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5805501938
validation[          , genome  5033] predictions:    9635/  10000 (96.35%), best:    9697/10000 (96.97%), error:      1172.03870, best error:      1023.48651 on epoch:    15, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 145.5207519531s, input_fired_time: 1.3783063889, output_fired_time: 1.2065848112, propagate_forward_time: 54.9682998657, propagate_backward_time: 84.7002868652, weight_update_time: 0.1526294798, other_time: 3.2672653198
epoch time: 10.5436239243s, input_fired_time: 0.1714705825, output_fired_time: 0.0000000000, propagate_forward_time: 9.8137559891, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5583972931
validation[          , genome  5033] predictions:    9706/  10000 (97.06%), best:    9706/10000 (97.06%), error:       961.82153, best error:       961.82153 on epoch:    22, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 144.6582336426s, input_fired_time: 1.3856532574, output_fired_time: 2.2133786678, propagate_forward_time: 53.2909278870, propagate_backward_time: 83.5338134766, weight_update_time: 0.1525321454, other_time: 4.2344665527
epoch time: 10.8614425659s, input_fired_time: 0.1738499999, output_fired_time: 0.0000000000, propagate_forward_time: 10.1264209747, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5611715317
validation[          , genome  5033] predictions:    9703/  10000 (97.03%), best:    9706/10000 (97.06%), error:      1010.00580, best error:       961.82153 on epoch:    22, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 142.4664611816s, input_fired_time: 1.3587028980, output_fired_time: 1.1910127401, propagate_forward_time: 51.7726325989, propagate_backward_time: 84.9073638916, weight_update_time: 0.1512033194, other_time: 3.2367553711
epoch time: 12.0125389099s, input_fired_time: 0.1747648418, output_fired_time: 0.0000000000, propagate_forward_time: 11.2592630386, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5785112381
validation[          , genome  5033] predictions:    9692/  10000 (96.92%), best:    9706/10000 (97.06%), error:      1020.03815, best error:       961.82153 on epoch:    22, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 143.7095184326s, input_fired_time: 1.3618088961, output_fired_time: 1.1999313831, propagate_forward_time: 52.3580551147, propagate_backward_time: 84.5621643066, weight_update_time: 0.1533557177, other_time: 4.2275466919
epoch time: 12.0657405853s, input_fired_time: 0.1759978682, output_fired_time: 0.0000000000, propagate_forward_time: 11.3106307983, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5791120529
validation[          , genome  5033] predictions:    9659/  10000 (96.59%), best:    9706/10000 (97.06%), error:      1083.07397, best error:       961.82153 on epoch:    22, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 143.6148986816s, input_fired_time: 1.3685479164, output_fired_time: 1.2060756683, propagate_forward_time: 53.3907585144, propagate_backward_time: 84.4188537598, weight_update_time: 0.1517976224, other_time: 3.2306671143
epoch time: 11.8944797516s, input_fired_time: 0.1744032055, output_fired_time: 0.0000000000, propagate_forward_time: 11.1522226334, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5678539276
validation[          , genome  5033] predictions:    9709/  10000 (97.09%), best:    9706/10000 (97.06%), error:       965.43970, best error:       961.82153 on epoch:    22, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 142.6592559814s, input_fired_time: 2.3686397076, output_fired_time: 1.1930260658, propagate_forward_time: 52.8611183167, propagate_backward_time: 83.0239486694, weight_update_time: 0.1522388607, other_time: 3.2125320435
epoch time: 10.9099073410s, input_fired_time: 0.1734262854, output_fired_time: 0.0000000000, propagate_forward_time: 10.1648836136, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5715970993
validation[          , genome  5033] predictions:    9679/  10000 (96.79%), best:    9706/10000 (97.06%), error:      1056.68005, best error:       961.82153 on epoch:    22, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 151.3028106689s, input_fired_time: 2.3527975082, output_fired_time: 1.2518873215, propagate_forward_time: 55.9178390503, propagate_backward_time: 88.4119644165, weight_update_time: 0.1685464978, other_time: 3.3683166504
epoch time: 10.8204498291s, input_fired_time: 0.1721650064, output_fired_time: 0.0000000000, propagate_forward_time: 10.0846557617, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5636291504
validation[          , genome  5033] predictions:    9683/  10000 (96.83%), best:    9706/10000 (97.06%), error:      1088.36499, best error:       961.82153 on epoch:    22, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 145.1999969482s, input_fired_time: 1.3739103079, output_fired_time: 1.2109806538, propagate_forward_time: 57.5831527710, propagate_backward_time: 81.8086013794, weight_update_time: 0.1550914645, other_time: 3.2233428955
epoch time: 10.9399509430s, input_fired_time: 0.1725627333, output_fired_time: 0.0000000000, propagate_forward_time: 10.2045860291, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5628023148
validation[          , genome  5033] predictions:    9707/  10000 (97.07%), best:    9706/10000 (97.06%), error:       979.07990, best error:       961.82153 on epoch:    22, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 142.1753997803s, input_fired_time: 1.3650770187, output_fired_time: 1.2030699253, propagate_forward_time: 52.9948539734, propagate_backward_time: 83.4013977051, weight_update_time: 0.1511031389, other_time: 3.2109985352
epoch time: 11.9907550812s, input_fired_time: 0.1767313778, output_fired_time: 0.0000000000, propagate_forward_time: 11.2087078094, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6053161621
validation[          , genome  5033] predictions:    9689/  10000 (96.89%), best:    9706/10000 (97.06%), error:      1069.28235, best error:       961.82153 on epoch:    22, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 148.0409545898s, input_fired_time: 1.4217872620, output_fired_time: 1.2564411163, propagate_forward_time: 56.1608314514, propagate_backward_time: 85.8597946167, weight_update_time: 0.1528224647, other_time: 3.3421096802
epoch time: 12.2145977020s, input_fired_time: 0.1808569878, output_fired_time: 0.0000000000, propagate_forward_time: 11.4421997070, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5915412903
validation[          , genome  5033] predictions:    9725/  10000 (97.25%), best:    9725/10000 (97.25%), error:       947.24298, best error:       947.24298 on epoch:    31, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 148.2707061768s, input_fired_time: 1.4001441002, output_fired_time: 1.2381552458, propagate_forward_time: 54.1096420288, propagate_backward_time: 86.1929244995, weight_update_time: 1.0781309605, other_time: 5.3298339844
epoch time: 12.2460680008s, input_fired_time: 0.1796601266, output_fired_time: 0.0000000000, propagate_forward_time: 11.4781408310, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5882673264
validation[          , genome  5033] predictions:    9692/  10000 (96.92%), best:    9725/10000 (97.25%), error:      1007.61206, best error:       947.24298 on epoch:    31, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 145.1242675781s, input_fired_time: 1.3817384243, output_fired_time: 1.2037366629, propagate_forward_time: 56.0126190186, propagate_backward_time: 83.2590560913, weight_update_time: 0.1517517269, other_time: 3.2671127319
epoch time: 12.0947380066s, input_fired_time: 0.1771643460, output_fired_time: 0.0000000000, propagate_forward_time: 11.3433704376, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5742034912
validation[          , genome  5033] predictions:    9682/  10000 (96.82%), best:    9725/10000 (97.25%), error:      1071.81006, best error:       947.24298 on epoch:    31, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 143.2823791504s, input_fired_time: 1.3664900064, output_fired_time: 1.1947443485, propagate_forward_time: 56.1819992065, propagate_backward_time: 81.3212738037, weight_update_time: 0.1522433013, other_time: 3.2178726196
epoch time: 12.0265378952s, input_fired_time: 0.1765622646, output_fired_time: 0.0000000000, propagate_forward_time: 11.2714452744, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5785303116
validation[          , genome  5033] predictions:    9725/  10000 (97.25%), best:    9725/10000 (97.25%), error:       942.57959, best error:       942.57959 on epoch:    34, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 150.9415130615s, input_fired_time: 1.4158846140, output_fired_time: 1.2747008801, propagate_forward_time: 55.5055198669, propagate_backward_time: 89.3574142456, weight_update_time: 0.1616639644, other_time: 3.3879928589
epoch time: 12.3843784332s, input_fired_time: 0.1772861034, output_fired_time: 0.0000000000, propagate_forward_time: 11.6340236664, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5730686188
validation[          , genome  5033] predictions:    9695/  10000 (96.95%), best:    9725/10000 (97.25%), error:      1043.74243, best error:       942.57959 on epoch:    34, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 148.6358489990s, input_fired_time: 1.4092271328, output_fired_time: 1.2688755989, propagate_forward_time: 54.2402687073, propagate_backward_time: 87.4088668823, weight_update_time: 0.1525982022, other_time: 4.3086166382
epoch time: 12.0904464722s, input_fired_time: 0.1754260510, output_fired_time: 0.0000000000, propagate_forward_time: 11.3224878311, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5925321579
validation[          , genome  5033] predictions:    9683/  10000 (96.83%), best:    9725/10000 (97.25%), error:      1051.61316, best error:       942.57959 on epoch:    34, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 143.4380493164s, input_fired_time: 2.3806655407, output_fired_time: 1.2010375261, propagate_forward_time: 52.2106246948, propagate_backward_time: 83.3383178711, weight_update_time: 0.1527853459, other_time: 4.3074111938
epoch time: 12.0060091019s, input_fired_time: 0.1757344753, output_fired_time: 0.0000000000, propagate_forward_time: 11.2569713593, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5733032227
validation[          , genome  5033] predictions:    9656/  10000 (96.56%), best:    9725/10000 (97.25%), error:      1117.72278, best error:       942.57959 on epoch:    34, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 143.4517517090s, input_fired_time: 1.3713003397, output_fired_time: 1.1999249458, propagate_forward_time: 52.3465576172, propagate_backward_time: 85.2926101685, weight_update_time: 0.1523420066, other_time: 3.2413558960
epoch time: 11.6892166138s, input_fired_time: 0.1741085351, output_fired_time: 0.0000000000, propagate_forward_time: 10.9541749954, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5609331131
validation[          , genome  5033] predictions:    9726/  10000 (97.26%), best:    9726/10000 (97.26%), error:       938.47375, best error:       938.47375 on epoch:    38, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 145.2043914795s, input_fired_time: 1.4192487001, output_fired_time: 1.2199844122, propagate_forward_time: 54.9295158386, propagate_backward_time: 83.3412933350, weight_update_time: 0.1609640419, other_time: 4.2943420410
epoch time: 10.8373479843s, input_fired_time: 0.1763829291, output_fired_time: 0.0000000000, propagate_forward_time: 10.0873146057, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5736503601
validation[          , genome  5033] predictions:    9682/  10000 (96.82%), best:    9726/10000 (97.26%), error:      1014.96362, best error:       938.47375 on epoch:    38, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 144.7343292236s, input_fired_time: 1.3771319389, output_fired_time: 1.2022455931, propagate_forward_time: 54.4037628174, propagate_backward_time: 83.4979171753, weight_update_time: 0.1520639211, other_time: 4.2532730103
epoch time: 10.8485202789s, input_fired_time: 0.1761302352, output_fired_time: 0.0000000000, propagate_forward_time: 10.0974960327, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5748939514
validation[          , genome  5033] predictions:    9707/  10000 (97.07%), best:    9726/10000 (97.26%), error:       974.35779, best error:       938.47375 on epoch:    38, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 153.3715820313s, input_fired_time: 1.4901316166, output_fired_time: 1.2963697910, propagate_forward_time: 58.9853248596, propagate_backward_time: 88.1189041138, weight_update_time: 0.1746698767, other_time: 3.4808578491
epoch time: 10.6546564102s, input_fired_time: 0.1734458953, output_fired_time: 0.0000000000, propagate_forward_time: 9.9199438095, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5612668991
validation[          , genome  5033] predictions:    9713/  10000 (97.13%), best:    9713/10000 (97.13%), error:       921.80005, best error:       921.80005 on epoch:    41, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 143.9768676758s, input_fired_time: 1.3829010725, output_fired_time: 2.2027823925, propagate_forward_time: 50.9799652100, propagate_backward_time: 86.1918029785, weight_update_time: 0.1520082653, other_time: 3.2194061279
epoch time: 10.6108036041s, input_fired_time: 0.1721639931, output_fired_time: 0.0000000000, propagate_forward_time: 9.8751487732, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5634908676
validation[          , genome  5033] predictions:    9697/  10000 (96.97%), best:    9713/10000 (97.13%), error:      1037.72156, best error:       921.80005 on epoch:    41, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 144.1506042480s, input_fired_time: 1.3734166622, output_fired_time: 1.2055528164, propagate_forward_time: 53.5737609863, propagate_backward_time: 84.7948379517, weight_update_time: 0.1520527005, other_time: 3.2030410767
epoch time: 12.0348176956s, input_fired_time: 0.1765109748, output_fired_time: 0.0000000000, propagate_forward_time: 11.2866630554, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5716438293
validation[          , genome  5033] predictions:    9714/  10000 (97.14%), best:    9713/10000 (97.13%), error:       952.15167, best error:       921.80005 on epoch:    41, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 142.7896728516s, input_fired_time: 1.3768960238, output_fired_time: 1.2014708519, propagate_forward_time: 54.9771080017, propagate_backward_time: 82.0176467896, weight_update_time: 0.1520278156, other_time: 3.2165451050
epoch time: 12.0162630081s, input_fired_time: 0.1797568500, output_fired_time: 0.0000000000, propagate_forward_time: 11.2556581497, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5808477402
validation[          , genome  5033] predictions:    9710/  10000 (97.10%), best:    9713/10000 (97.13%), error:       948.58777, best error:       921.80005 on epoch:    41, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 143.1537170410s, input_fired_time: 1.3922649622, output_fired_time: 1.2054288387, propagate_forward_time: 52.0441665649, propagate_backward_time: 84.2798080444, weight_update_time: 0.1517331302, other_time: 4.2320556641
epoch time: 10.6993551254s, input_fired_time: 0.1742023528, output_fired_time: 0.0000000000, propagate_forward_time: 9.9691629410, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5559902191
validation[          , genome  5033] predictions:    9708/  10000 (97.08%), best:    9713/10000 (97.13%), error:       972.22235, best error:       921.80005 on epoch:    41, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 143.5024261475s, input_fired_time: 1.3791742325, output_fired_time: 1.2161705494, propagate_forward_time: 53.2547950745, propagate_backward_time: 84.4250869751, weight_update_time: 0.1528136879, other_time: 3.2271957397
epoch time: 10.5960340500s, input_fired_time: 0.1744785011, output_fired_time: 0.0000000000, propagate_forward_time: 9.8648481369, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5567073822
validation[          , genome  5033] predictions:    9613/  10000 (96.13%), best:    9713/10000 (97.13%), error:      1219.40356, best error:       921.80005 on epoch:    41, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 142.8081665039s, input_fired_time: 1.3824043274, output_fired_time: 1.1991398335, propagate_forward_time: 55.0196037292, propagate_backward_time: 81.9810104370, weight_update_time: 0.1529626995, other_time: 3.2260055542
epoch time: 12.1530494690s, input_fired_time: 0.1805847138, output_fired_time: 0.0000000000, propagate_forward_time: 11.3966197968, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5758447647
validation[          , genome  5033] predictions:    9758/  10000 (97.58%), best:    9758/10000 (97.58%), error:       857.11774, best error:       857.11774 on epoch:    47, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 153.1289520264s, input_fired_time: 1.4567579031, output_fired_time: 1.2703235149, propagate_forward_time: 58.3774871826, propagate_backward_time: 88.5922698975, weight_update_time: 0.1640438586, other_time: 3.4321136475
epoch time: 10.8039865494s, input_fired_time: 0.1761547774, output_fired_time: 0.0000000000, propagate_forward_time: 10.0596561432, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5681753159
validation[          , genome  5033] predictions:    9720/  10000 (97.20%), best:    9758/10000 (97.58%), error:       899.41931, best error:       857.11774 on epoch:    47, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 141.8313140869s, input_fired_time: 1.3770377636, output_fired_time: 1.1968652010, propagate_forward_time: 51.9259834290, propagate_backward_time: 83.0989532471, weight_update_time: 0.1518787593, other_time: 4.2324676514
epoch time: 11.9655294418s, input_fired_time: 0.1770074964, output_fired_time: 0.0000000000, propagate_forward_time: 11.2164850235, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5720367432
validation[          , genome  5033] predictions:    9671/  10000 (96.71%), best:    9758/10000 (97.58%), error:      1047.28809, best error:       857.11774 on epoch:    47, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 141.8333740234s, input_fired_time: 1.3717356920, output_fired_time: 1.6984432936, propagate_forward_time: 53.5661201477, propagate_backward_time: 81.9734954834, weight_update_time: 0.1513030678, other_time: 3.2235870361
epoch time: 12.1131744385s, input_fired_time: 0.1791475117, output_fired_time: 0.0000000000, propagate_forward_time: 11.3561162949, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5779104233
validation[          , genome  5033] predictions:    9741/  10000 (97.41%), best:    9758/10000 (97.58%), error:       889.45355, best error:       857.11774 on epoch:    47, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 145.0961303711s, input_fired_time: 1.4042725563, output_fired_time: 1.2076660395, propagate_forward_time: 53.9064369202, propagate_backward_time: 85.3589019775, weight_update_time: 0.1542860866, other_time: 3.2188568115
epoch time: 12.2292041779s, input_fired_time: 0.1815098822, output_fired_time: 0.0000000000, propagate_forward_time: 11.4679012299, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5797929764
validation[          , genome  5033] predictions:    9697/  10000 (96.97%), best:    9758/10000 (97.58%), error:      1014.49280, best error:       857.11774 on epoch:    47, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 142.8184356689s, input_fired_time: 1.3801082373, output_fired_time: 1.1963971853, propagate_forward_time: 52.9828796387, propagate_backward_time: 84.0518875122, weight_update_time: 0.1521279067, other_time: 3.2071609497
epoch time: 10.7523345947s, input_fired_time: 0.1763370335, output_fired_time: 0.0000000000, propagate_forward_time: 10.0142259598, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5617713928
validation[          , genome  5033] predictions:    9723/  10000 (97.23%), best:    9758/10000 (97.58%), error:       906.43799, best error:       857.11774 on epoch:    47, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 142.6328582764s, input_fired_time: 1.3719002008, output_fired_time: 1.1917477846, propagate_forward_time: 53.7634086609, propagate_backward_time: 82.0770034790, weight_update_time: 0.1516319364, other_time: 4.2287979126
epoch time: 12.1024122238s, input_fired_time: 0.1797842830, output_fired_time: 0.0000000000, propagate_forward_time: 11.3449068069, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5777215958
validation[          , genome  5033] predictions:    9739/  10000 (97.39%), best:    9739/10000 (97.39%), error:       841.80206, best error:       841.80206 on epoch:    53, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 144.2494201660s, input_fired_time: 1.3901745081, output_fired_time: 1.2038787603, propagate_forward_time: 51.7033805847, propagate_backward_time: 86.7437744141, weight_update_time: 0.1525307000, other_time: 3.2082214355
epoch time: 12.1439781189s, input_fired_time: 0.1825854182, output_fired_time: 0.0000000000, propagate_forward_time: 11.3720674515, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5893249512
validation[          , genome  5033] predictions:    9714/  10000 (97.14%), best:    9739/10000 (97.39%), error:       933.15692, best error:       841.80206 on epoch:    53, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 147.5087127686s, input_fired_time: 1.4304431677, output_fired_time: 1.2605072260, propagate_forward_time: 53.8740196228, propagate_backward_time: 86.6581192017, weight_update_time: 0.1523923874, other_time: 4.2856063843
epoch time: 12.1941175461s, input_fired_time: 0.1804713458, output_fired_time: 0.0000000000, propagate_forward_time: 11.4281749725, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5854711533
validation[          , genome  5033] predictions:    9703/  10000 (97.03%), best:    9739/10000 (97.39%), error:      1027.02527, best error:       841.80206 on epoch:    53, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 143.5110778809s, input_fired_time: 1.3800191879, output_fired_time: 1.1909952164, propagate_forward_time: 53.2943916321, propagate_backward_time: 84.4077529907, weight_update_time: 0.1520038843, other_time: 3.2379226685
epoch time: 12.1570014954s, input_fired_time: 0.1899374425, output_fired_time: 0.0000000000, propagate_forward_time: 11.3913116455, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5757522583
validation[          , genome  5033] predictions:    9717/  10000 (97.17%), best:    9739/10000 (97.39%), error:       950.71008, best error:       841.80206 on epoch:    53, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 142.7292480469s, input_fired_time: 1.3822187185, output_fired_time: 1.1927250624, propagate_forward_time: 54.8457756042, propagate_backward_time: 82.1032257080, weight_update_time: 0.1514520049, other_time: 3.2053070068
epoch time: 10.9110126495s, input_fired_time: 0.1765862405, output_fired_time: 0.0000000000, propagate_forward_time: 10.1543779373, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5800485611
validation[          , genome  5033] predictions:    9715/  10000 (97.15%), best:    9739/10000 (97.39%), error:       917.80853, best error:       841.80206 on epoch:    53, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 144.6836242676s, input_fired_time: 2.3987090588, output_fired_time: 1.2078639269, propagate_forward_time: 54.3617324829, propagate_backward_time: 83.4762573242, weight_update_time: 0.1526455432, other_time: 3.2390518188
epoch time: 11.2422885895s, input_fired_time: 0.1808642447, output_fired_time: 0.0000000000, propagate_forward_time: 10.4781007767, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5833234787
validation[          , genome  5033] predictions:    9691/  10000 (96.91%), best:    9739/10000 (97.39%), error:       963.91748, best error:       841.80206 on epoch:    53, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 144.6906738281s, input_fired_time: 1.4147900343, output_fired_time: 2.2148518562, propagate_forward_time: 55.8148994446, propagate_backward_time: 82.0330429077, weight_update_time: 0.1528308094, other_time: 3.2130813599
epoch time: 12.1756734848s, input_fired_time: 0.1805862188, output_fired_time: 0.0000000000, propagate_forward_time: 11.4103651047, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5847225189
validation[          , genome  5033] predictions:    9715/  10000 (97.15%), best:    9739/10000 (97.39%), error:       941.11835, best error:       841.80206 on epoch:    53, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 142.7279510498s, input_fired_time: 1.3829407692, output_fired_time: 1.1964967251, propagate_forward_time: 52.9043960571, propagate_backward_time: 84.0249023438, weight_update_time: 0.1517066360, other_time: 3.2192153931
epoch time: 12.2117967606s, input_fired_time: 0.1808086038, output_fired_time: 0.0000000000, propagate_forward_time: 11.4519081116, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5790796280
validation[          , genome  5033] predictions:    9713/  10000 (97.13%), best:    9739/10000 (97.39%), error:       895.84186, best error:       841.80206 on epoch:    53, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 145.1631927490s, input_fired_time: 1.4003756046, output_fired_time: 1.2255196571, propagate_forward_time: 55.9443435669, propagate_backward_time: 83.3226318359, weight_update_time: 0.1602009684, other_time: 3.2703170776
epoch time: 12.2272815704s, input_fired_time: 0.1844395995, output_fired_time: 0.0000000000, propagate_forward_time: 11.4430332184, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5998086929
validation[          , genome  5033] predictions:    9745/  10000 (97.45%), best:    9739/10000 (97.39%), error:       862.16180, best error:       841.80206 on epoch:    53, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 146.2688751221s, input_fired_time: 1.4150806665, output_fired_time: 1.2533398867, propagate_forward_time: 53.2871170044, propagate_backward_time: 87.0989151001, weight_update_time: 0.1522447765, other_time: 3.2144165039
epoch time: 12.1862449646s, input_fired_time: 0.1821597815, output_fired_time: 0.0000000000, propagate_forward_time: 11.4105453491, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5935401917
validation[          , genome  5033] predictions:    9731/  10000 (97.31%), best:    9739/10000 (97.39%), error:       903.71466, best error:       841.80206 on epoch:    53, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 143.2696380615s, input_fired_time: 1.3842784166, output_fired_time: 1.1990927458, propagate_forward_time: 56.1944503784, propagate_backward_time: 81.2480316162, weight_update_time: 0.1518005729, other_time: 3.2437820435
epoch time: 10.8715553284s, input_fired_time: 0.1763595343, output_fired_time: 0.0000000000, propagate_forward_time: 10.1230764389, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5721197128
validation[          , genome  5033] predictions:    9667/  10000 (96.67%), best:    9739/10000 (97.39%), error:      1101.26880, best error:       841.80206 on epoch:    53, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 145.6922149658s, input_fired_time: 1.3987498283, output_fired_time: 1.2169233561, propagate_forward_time: 54.7385787964, propagate_backward_time: 85.0717926025, weight_update_time: 0.1539440304, other_time: 3.2661819458
epoch time: 10.5954160690s, input_fired_time: 0.1742659211, output_fired_time: 0.0000000000, propagate_forward_time: 9.8575315475, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5636186600
validation[          , genome  5033] predictions:    9718/  10000 (97.18%), best:    9739/10000 (97.39%), error:       948.99048, best error:       841.80206 on epoch:    53, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 142.3467254639s, input_fired_time: 1.3851443529, output_fired_time: 1.1963067055, propagate_forward_time: 52.9106292725, propagate_backward_time: 82.5896530151, weight_update_time: 0.1517033726, other_time: 4.2649917603
epoch time: 12.0038127899s, input_fired_time: 0.1784486622, output_fired_time: 0.0000000000, propagate_forward_time: 11.2502117157, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5751523972
validation[          , genome  5033] predictions:    9724/  10000 (97.24%), best:    9739/10000 (97.39%), error:       889.28229, best error:       841.80206 on epoch:    53, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 144.1593933105s, input_fired_time: 1.3994642496, output_fired_time: 1.2043524981, propagate_forward_time: 52.5861587524, propagate_backward_time: 84.7554321289, weight_update_time: 0.1520591378, other_time: 4.2139968872
epoch time: 12.1476106644s, input_fired_time: 0.1840052009, output_fired_time: 0.0000000000, propagate_forward_time: 11.3803224564, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5832834244
validation[          , genome  5033] predictions:    9686/  10000 (96.86%), best:    9739/10000 (97.39%), error:      1023.09839, best error:       841.80206 on epoch:    53, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 143.3573913574s, input_fired_time: 1.3862707615, output_fired_time: 1.2016372681, propagate_forward_time: 53.1453552246, propagate_backward_time: 82.3772125244, weight_update_time: 0.1515157372, other_time: 5.2469024658
epoch time: 12.2205133438s, input_fired_time: 0.1834236234, output_fired_time: 0.0000000000, propagate_forward_time: 11.4549989700, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5820903778
validation[          , genome  5033] predictions:    9710/  10000 (97.10%), best:    9739/10000 (97.39%), error:       974.51495, best error:       841.80206 on epoch:    53, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 146.8514709473s, input_fired_time: 1.4582585096, output_fired_time: 1.2373938560, propagate_forward_time: 53.6484870911, propagate_backward_time: 87.1394348145, weight_update_time: 0.1522233635, other_time: 3.3679046631
epoch time: 11.8463964462s, input_fired_time: 0.1774439067, output_fired_time: 0.0000000000, propagate_forward_time: 11.1049795151, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5639734268
validation[          , genome  5033] predictions:    9627/  10000 (96.27%), best:    9739/10000 (97.39%), error:      1235.89453, best error:       841.80206 on epoch:    53, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 142.9339904785s, input_fired_time: 1.3885197639, output_fired_time: 1.1977939606, propagate_forward_time: 52.9494018555, propagate_backward_time: 84.1874847412, weight_update_time: 0.1521728486, other_time: 3.2107849121
epoch time: 10.7839746475s, input_fired_time: 0.1782311648, output_fired_time: 0.0000000000, propagate_forward_time: 10.0416469574, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5640964508
validation[          , genome  5033] predictions:    9695/  10000 (96.95%), best:    9739/10000 (97.39%), error:      1020.24408, best error:       841.80206 on epoch:    53, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 145.0711059570s, input_fired_time: 1.3922448158, output_fired_time: 1.2016073465, propagate_forward_time: 56.5236358643, propagate_backward_time: 82.7221221924, weight_update_time: 0.1528561115, other_time: 3.2314910889
epoch time: 11.0055580139s, input_fired_time: 0.1771755815, output_fired_time: 0.0000000000, propagate_forward_time: 10.2586307526, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5697517395
validation[          , genome  5033] predictions:    9743/  10000 (97.43%), best:    9739/10000 (97.39%), error:       876.16284, best error:       841.80206 on epoch:    53, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 143.0987548828s, input_fired_time: 1.3996381760, output_fired_time: 1.1995577812, propagate_forward_time: 54.0844383240, propagate_backward_time: 83.1911239624, weight_update_time: 0.1515835971, other_time: 3.2239913940
epoch time: 12.0643835068s, input_fired_time: 0.1834759414, output_fired_time: 0.0000000000, propagate_forward_time: 11.3089265823, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5719814301
validation[          , genome  5033] predictions:    9704/  10000 (97.04%), best:    9739/10000 (97.39%), error:       931.38599, best error:       841.80206 on epoch:    53, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 145.8980407715s, input_fired_time: 1.3952940702, output_fired_time: 1.2071719170, propagate_forward_time: 54.1844787598, propagate_backward_time: 84.7922897339, weight_update_time: 0.1519599110, other_time: 4.3188095093
epoch time: 12.1534194946s, input_fired_time: 0.1849400699, output_fired_time: 0.0000000000, propagate_forward_time: 11.3824834824, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5859956741
validation[          , genome  5033] predictions:    9723/  10000 (97.23%), best:    9739/10000 (97.39%), error:       886.21973, best error:       841.80206 on epoch:    53, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 143.3170928955s, input_fired_time: 1.3952773809, output_fired_time: 1.1976269484, propagate_forward_time: 54.2444381714, propagate_backward_time: 83.2538757324, weight_update_time: 0.1521983892, other_time: 3.2258682251
epoch time: 14.6572961807s, input_fired_time: 0.3238579929, output_fired_time: 0.0000000000, propagate_forward_time: 12.6757402420, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6576976776
validation[          , genome  5033] predictions:    9717/  10000 (97.17%), best:    9739/10000 (97.39%), error:       898.22009, best error:       841.80206 on epoch:    53, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 143.7936401367s, input_fired_time: 1.3927096128, output_fired_time: 1.2025873661, propagate_forward_time: 54.4692420959, propagate_backward_time: 83.5281906128, weight_update_time: 0.1515239328, other_time: 3.2009048462
epoch time: 11.9014415741s, input_fired_time: 0.1801620573, output_fired_time: 0.0000000000, propagate_forward_time: 11.1427850723, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5784940720
validation[          , genome  5033] predictions:    9739/  10000 (97.39%), best:    9739/10000 (97.39%), error:       880.39722, best error:       841.80206 on epoch:    53, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 147.7947387695s, input_fired_time: 1.4197658300, output_fired_time: 1.2450817823, propagate_forward_time: 54.1003952026, propagate_backward_time: 87.6908264160, weight_update_time: 0.1518406123, other_time: 3.3386611938
epoch time: 15.4748497009s, input_fired_time: 0.2171950787, output_fired_time: 0.0000000000, propagate_forward_time: 14.6457004547, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6119537354
validation[          , genome  5033] predictions:    9746/  10000 (97.46%), best:    9739/10000 (97.39%), error:       868.20752, best error:       841.80206 on epoch:    53, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 144.4854431152s, input_fired_time: 1.4109318256, output_fired_time: 1.2082393169, propagate_forward_time: 54.7345809937, propagate_backward_time: 83.8915634155, weight_update_time: 0.1525620371, other_time: 3.2401275635
epoch time: 12.1444616318s, input_fired_time: 0.1830713153, output_fired_time: 0.0000000000, propagate_forward_time: 11.3819370270, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5794534683
validation[          , genome  5033] predictions:    9732/  10000 (97.32%), best:    9739/10000 (97.39%), error:       914.11646, best error:       841.80206 on epoch:    53, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 149.1222991943s, input_fired_time: 1.4714407921, output_fired_time: 1.3103797436, propagate_forward_time: 55.6189002991, propagate_backward_time: 87.3353271484, weight_update_time: 0.1595109701, other_time: 3.3862609863
epoch time: 12.0249862671s, input_fired_time: 0.1818217188, output_fired_time: 0.0000000000, propagate_forward_time: 11.2661314011, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5770330429
validation[          , genome  5033] predictions:    9733/  10000 (97.33%), best:    9739/10000 (97.39%), error:       894.32263, best error:       841.80206 on epoch:    53, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 148.0356140137s, input_fired_time: 1.4067530632, output_fired_time: 1.2851108313, propagate_forward_time: 58.0072517395, propagate_backward_time: 83.9664459229, weight_update_time: 0.1590197682, other_time: 3.3700561523
epoch time: 17.5251102448s, input_fired_time: 0.1915882379, output_fired_time: 0.0000000000, propagate_forward_time: 16.5668487549, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7666740417
validation[          , genome  5033] predictions:    9703/  10000 (97.03%), best:    9739/10000 (97.39%), error:       993.65656, best error:       841.80206 on epoch:    53, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 148.3850250244s, input_fired_time: 1.4535369873, output_fired_time: 1.2500765324, propagate_forward_time: 55.9950752258, propagate_backward_time: 86.3099594116, weight_update_time: 0.1521397680, other_time: 3.3763809204
epoch time: 12.0485324860s, input_fired_time: 0.1884175688, output_fired_time: 0.0000000000, propagate_forward_time: 11.2821779251, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5779371262
validation[          , genome  5033] predictions:    9737/  10000 (97.37%), best:    9739/10000 (97.39%), error:       873.98676, best error:       841.80206 on epoch:    53, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 155.4796295166s, input_fired_time: 1.6055194139, output_fired_time: 1.2679620981, propagate_forward_time: 60.5465240479, propagate_backward_time: 88.5279312134, weight_update_time: 0.1622258723, other_time: 3.5317001343
epoch time: 10.8901672363s, input_fired_time: 0.1785738319, output_fired_time: 0.0000000000, propagate_forward_time: 10.1501131058, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5614805222
validation[          , genome  5033] predictions:    9745/  10000 (97.45%), best:    9739/10000 (97.39%), error:       872.14313, best error:       841.80206 on epoch:    53, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 145.2627258301s, input_fired_time: 1.4067041874, output_fired_time: 1.2013638020, propagate_forward_time: 53.5988693237, propagate_backward_time: 85.7966156006, weight_update_time: 0.1530667543, other_time: 3.2591629028
epoch time: 10.9251804352s, input_fired_time: 0.1793391407, output_fired_time: 0.0000000000, propagate_forward_time: 10.1736450195, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5721960068
validation[          , genome  5033] predictions:    9726/  10000 (97.26%), best:    9739/10000 (97.39%), error:       932.06354, best error:       841.80206 on epoch:    53, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 143.2024841309s, input_fired_time: 1.4004749060, output_fired_time: 2.2073113918, propagate_forward_time: 54.0963096619, propagate_backward_time: 81.2592468262, weight_update_time: 0.1515000314, other_time: 4.2391357422
epoch time: 12.1442728043s, input_fired_time: 0.1819878370, output_fired_time: 0.0000000000, propagate_forward_time: 11.3917264938, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5705585480
validation[          , genome  5033] predictions:    9693/  10000 (96.93%), best:    9739/10000 (97.39%), error:       980.51233, best error:       841.80206 on epoch:    53, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 143.6676025391s, input_fired_time: 1.3994385004, output_fired_time: 1.1954237223, propagate_forward_time: 52.3770256042, propagate_backward_time: 85.4548034668, weight_update_time: 0.1526524127, other_time: 3.2409057617
epoch time: 11.9008703232s, input_fired_time: 0.1844723374, output_fired_time: 0.0000000000, propagate_forward_time: 11.1427040100, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5736942291
validation[          , genome  5033] predictions:    9747/  10000 (97.47%), best:    9739/10000 (97.39%), error:       868.58545, best error:       841.80206 on epoch:    53, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 144.2876739502s, input_fired_time: 1.4043520689, output_fired_time: 1.2043533325, propagate_forward_time: 53.6696243286, propagate_backward_time: 84.7874450684, weight_update_time: 0.1528958082, other_time: 3.2218856812
epoch time: 12.1172809601s, input_fired_time: 0.1831127852, output_fired_time: 0.0000000000, propagate_forward_time: 11.3578720093, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5762958527
validation[          , genome  5033] predictions:    9717/  10000 (97.17%), best:    9739/10000 (97.39%), error:       961.52441, best error:       841.80206 on epoch:    53, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 143.1820220947s, input_fired_time: 1.3979612589, output_fired_time: 1.2053368092, propagate_forward_time: 53.6695747375, propagate_backward_time: 83.6936264038, weight_update_time: 0.1527628154, other_time: 3.2155227661
epoch time: 10.8320322037s, input_fired_time: 0.1806194931, output_fired_time: 0.0000000000, propagate_forward_time: 10.0822076797, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5692052841
validation[          , genome  5033] predictions:    9733/  10000 (97.33%), best:    9739/10000 (97.39%), error:       886.41638, best error:       841.80206 on epoch:    53, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 145.4883728027s, input_fired_time: 1.4067952633, output_fired_time: 1.2447755337, propagate_forward_time: 55.6167831421, propagate_backward_time: 83.9877319336, weight_update_time: 0.1528928578, other_time: 3.2322769165
epoch time: 10.9286117554s, input_fired_time: 0.1806351393, output_fired_time: 0.0000000000, propagate_forward_time: 10.1816320419, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5663442612
validation[          , genome  5033] predictions:    9658/  10000 (96.58%), best:    9739/10000 (97.39%), error:      1071.59900, best error:       841.80206 on epoch:    53, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 142.4838256836s, input_fired_time: 1.3985700607, output_fired_time: 1.1943684816, propagate_forward_time: 54.8478660583, propagate_backward_time: 81.8452987671, weight_update_time: 0.1505734026, other_time: 3.1977157593
epoch time: 12.1536216736s, input_fired_time: 0.1836088151, output_fired_time: 0.0000000000, propagate_forward_time: 11.3901357651, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5798768997
validation[          , genome  5033] predictions:    9737/  10000 (97.37%), best:    9739/10000 (97.39%), error:       931.31787, best error:       841.80206 on epoch:    53, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 148.1882171631s, input_fired_time: 1.4675687551, output_fired_time: 1.2727181911, propagate_forward_time: 56.4695816040, propagate_backward_time: 85.6884841919, weight_update_time: 0.1524837911, other_time: 3.2898559570
epoch time: 12.2484827042s, input_fired_time: 0.1876131743, output_fired_time: 0.0000000000, propagate_forward_time: 11.4745426178, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5863265991
validation[          , genome  5033] predictions:    9703/  10000 (97.03%), best:    9739/10000 (97.39%), error:      1000.46204, best error:       841.80206 on epoch:    53, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 144.4152374268s, input_fired_time: 2.4160499573, output_fired_time: 1.2114343643, propagate_forward_time: 54.5955276489, propagate_backward_time: 81.9677124023, weight_update_time: 0.1531054527, other_time: 4.2245101929
epoch time: 11.9811658859s, input_fired_time: 0.1833600849, output_fired_time: 0.0000000000, propagate_forward_time: 11.2229709625, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5748348236
validation[          , genome  5033] predictions:    9750/  10000 (97.50%), best:    9739/10000 (97.39%), error:       846.53619, best error:       841.80206 on epoch:    53, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 142.8430328369s, input_fired_time: 1.3975896835, output_fired_time: 1.1963500977, propagate_forward_time: 52.9375267029, propagate_backward_time: 84.1035308838, weight_update_time: 0.1524471492, other_time: 3.2080383301
epoch time: 12.0132904053s, input_fired_time: 0.1837637573, output_fired_time: 0.0000000000, propagate_forward_time: 11.2502737045, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5792531967
validation[          , genome  5033] predictions:    9585/  10000 (95.85%), best:    9739/10000 (97.39%), error:      1326.30139, best error:       841.80206 on epoch:    53, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 147.7625427246s, input_fired_time: 1.4328508377, output_fired_time: 1.2331416607, propagate_forward_time: 55.8781356812, propagate_backward_time: 84.9213790894, weight_update_time: 0.1692377925, other_time: 4.2970428467
epoch time: 12.1740312576s, input_fired_time: 0.1832989901, output_fired_time: 0.0000000000, propagate_forward_time: 10.4011478424, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5895843506
validation[          , genome  5033] predictions:    9678/  10000 (96.78%), best:    9739/10000 (97.39%), error:      1026.78918, best error:       841.80206 on epoch:    53, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 142.9034729004s, input_fired_time: 1.3989391327, output_fired_time: 1.1991862059, propagate_forward_time: 54.0601615906, propagate_backward_time: 82.9970092773, weight_update_time: 0.1524710804, other_time: 3.2481689453
epoch time: 10.6602754593s, input_fired_time: 0.1772044003, output_fired_time: 0.0000000000, propagate_forward_time: 9.9129076004, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5701637268
validation[          , genome  5033] predictions:    9731/  10000 (97.31%), best:    9739/10000 (97.39%), error:       905.66382, best error:       841.80206 on epoch:    53, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 144.1613616943s, input_fired_time: 1.4223785400, output_fired_time: 1.2009054422, propagate_forward_time: 54.1361389160, propagate_backward_time: 84.1666946411, weight_update_time: 0.1514164805, other_time: 3.2352371216
epoch time: 10.8720159531s, input_fired_time: 0.1806395054, output_fired_time: 0.0000000000, propagate_forward_time: 10.1234149933, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5679616928
validation[          , genome  5033] predictions:    9769/  10000 (97.69%), best:    9769/10000 (97.69%), error:       801.76868, best error:       801.76868 on epoch:    93, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 150.1234588623s, input_fired_time: 1.4748163223, output_fired_time: 1.2517026663, propagate_forward_time: 54.7124748230, propagate_backward_time: 88.3110885620, weight_update_time: 1.1785060167, other_time: 4.3733596802
epoch time: 10.8002367020s, input_fired_time: 0.1801132262, output_fired_time: 0.0000000000, propagate_forward_time: 10.0538187027, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5663051605
validation[          , genome  5033] predictions:    9752/  10000 (97.52%), best:    9769/10000 (97.69%), error:       869.74963, best error:       801.76868 on epoch:    93, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 144.0086212158s, input_fired_time: 1.4065965414, output_fired_time: 1.2084107399, propagate_forward_time: 53.4509086609, propagate_backward_time: 84.7031097412, weight_update_time: 0.1518239975, other_time: 3.2395935059
epoch time: 16.3578758240s, input_fired_time: 0.2740280628, output_fired_time: 0.0000000000, propagate_forward_time: 15.2584743500, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8253726959
validation[          , genome  5033] predictions:    9744/  10000 (97.44%), best:    9769/10000 (97.69%), error:       907.31384, best error:       801.76868 on epoch:    93, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 143.5627441406s, input_fired_time: 1.4060938358, output_fired_time: 1.2058603764, propagate_forward_time: 54.3675918579, propagate_backward_time: 83.3681411743, weight_update_time: 0.1523386985, other_time: 3.2150573730
epoch time: 12.0743274689s, input_fired_time: 0.1869310141, output_fired_time: 0.0000000000, propagate_forward_time: 11.3013906479, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5860061646
validation[          , genome  5033] predictions:    9726/  10000 (97.26%), best:    9769/10000 (97.69%), error:       908.13373, best error:       801.76868 on epoch:    93, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 142.2372741699s, input_fired_time: 2.4198167324, output_fired_time: 1.2093336582, propagate_forward_time: 51.4411201477, propagate_backward_time: 83.9292068481, weight_update_time: 0.1522643566, other_time: 3.2378005981
epoch time: 11.6398057938s, input_fired_time: 0.1796127409, output_fired_time: 0.0000000000, propagate_forward_time: 10.8961629868, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5640296936
validation[          , genome  5033] predictions:    9721/  10000 (97.21%), best:    9769/10000 (97.69%), error:       931.09418, best error:       801.76868 on epoch:    93, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 144.1732482910s, input_fired_time: 1.4077620506, output_fired_time: 1.2071803808, propagate_forward_time: 54.6303672791, propagate_backward_time: 82.6616439819, weight_update_time: 0.1517374963, other_time: 4.2662887573
epoch time: 12.1362028122s, input_fired_time: 0.1849615127, output_fired_time: 0.0000000000, propagate_forward_time: 11.3708715439, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5803699493
validation[          , genome  5033] predictions:    9735/  10000 (97.35%), best:    9769/10000 (97.69%), error:       953.86621, best error:       801.76868 on epoch:    93, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 144.1616058350s, input_fired_time: 1.4158906937, output_fired_time: 1.2077270746, propagate_forward_time: 52.4853782654, propagate_backward_time: 84.7804031372, weight_update_time: 0.1524373889, other_time: 4.2721939087
epoch time: 11.5507097244s, input_fired_time: 0.1832310557, output_fired_time: 0.0000000000, propagate_forward_time: 10.7087078094, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6587705612
validation[          , genome  5033] predictions:    9734/  10000 (97.34%), best:    9769/10000 (97.69%), error:       877.19092, best error:       801.76868 on epoch:    93, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 145.0890197754s, input_fired_time: 1.4342491627, output_fired_time: 1.2001261711, propagate_forward_time: 52.4761199951, propagate_backward_time: 86.6960678101, weight_update_time: 0.1526924372, other_time: 3.2824630737
epoch time: 10.9454917908s, input_fired_time: 0.1831440628, output_fired_time: 0.0000000000, propagate_forward_time: 10.1927328110, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5696153641
validation[          , genome  5033] predictions:    9645/  10000 (96.45%), best:    9769/10000 (97.69%), error:      1160.07910, best error:       801.76868 on epoch:    93, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 58.7188415527s, input_fired_time: 1.9245938063, output_fired_time: 0.0000000000, propagate_forward_time: 53.8063621521, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9878845215
best training[          , genome  5033] predictions:   49601/  50000 (99.20%), best:    9769/10000 (97.69%), error:      1640.60193, best error:       801.76868 on epoch:    93, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 12.2261714935s, input_fired_time: 0.1845158488, output_fired_time: 0.0000000000, propagate_forward_time: 11.4606027603, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5810527802
   testing[          , genome  5033] predictions:    9765/  10000 (97.65%), best:    9769/10000 (97.69%), error:       788.28235, best error:       801.76868 on epoch:    93, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
13:03:20 (12100): called boinc_finish(0)

</stderr_txt>
]]>