Nameexact_genome_1512568488_41_3510_2
Workunit2588822
Created7 Dec 2017, 6:16:19 UTC
Sent7 Dec 2017, 6:19:22 UTC
Report deadline12 Dec 2017, 17:51:02 UTC
Received7 Dec 2017, 17:37:58 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID55108
Run time3 hours 3 min 25 sec
CPU time2 hours 59 min 27 sec
Validate stateValid
Credit1,370.08
Device peak FLOPS2.57 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size153.80 MB
Peak swap size157.02 MB
Peak disk usage1.47 MB

Stderr output

<core_client_version>7.8.2</core_client_version>
<![CDATA[
<stderr_txt>
, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5225238800
validation[          , genome  3510] predictions:    9513/  10000 (95.13%), best:    9513/10000 (95.13%), error:      1638.79199, best error:      1638.79199 on epoch:    14, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 103.0129928589s, input_fired_time: 2.0732257366, output_fired_time: 0.8868809342, propagate_forward_time: 37.7567329407, propagate_backward_time: 59.4203681946, weight_update_time: 0.1177182123, other_time: 2.8757858276
epoch time: 7.8250541687s, input_fired_time: 0.1260925829, output_fired_time: 0.0000000000, propagate_forward_time: 7.1971755028, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5017862320
validation[          , genome  3510] predictions:    9516/  10000 (95.16%), best:    9513/10000 (95.13%), error:      1656.87451, best error:      1638.79199 on epoch:    14, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 106.8313064575s, input_fired_time: 1.0358815193, output_fired_time: 1.8205223083, propagate_forward_time: 39.8941497803, propagate_backward_time: 61.1374282837, weight_update_time: 0.1182851419, other_time: 2.9433212280
epoch time: 7.8405451775s, input_fired_time: 0.1269106865, output_fired_time: 0.0000000000, propagate_forward_time: 7.2118444443, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5017900467
validation[          , genome  3510] predictions:    9528/  10000 (95.28%), best:    9513/10000 (95.13%), error:      1659.13184, best error:      1638.79199 on epoch:    14, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 103.2443771362s, input_fired_time: 1.0132725239, output_fired_time: 0.8953250647, propagate_forward_time: 39.8721733093, propagate_backward_time: 58.6047172546, weight_update_time: 0.1166905165, other_time: 2.8588867188
epoch time: 9.2098798752s, input_fired_time: 0.1342123300, output_fired_time: 0.0000000000, propagate_forward_time: 8.5461645126, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5295028687
validation[          , genome  3510] predictions:    9552/  10000 (95.52%), best:    9552/10000 (95.52%), error:      1569.24451, best error:      1569.24451 on epoch:    17, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 102.9588775635s, input_fired_time: 1.0108071566, output_fired_time: 0.8842718601, propagate_forward_time: 38.6784820557, propagate_backward_time: 58.4917640686, weight_update_time: 0.1173262671, other_time: 3.8935508728
epoch time: 7.9281816483s, input_fired_time: 0.1287085712, output_fired_time: 0.0000000000, propagate_forward_time: 7.2965536118, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5029196739
validation[          , genome  3510] predictions:    9519/  10000 (95.19%), best:    9552/10000 (95.52%), error:      1640.73083, best error:      1569.24451 on epoch:    17, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 103.2187652588s, input_fired_time: 1.0151492357, output_fired_time: 0.8903724551, propagate_forward_time: 39.7880020142, propagate_backward_time: 57.6369667053, weight_update_time: 0.1169656664, other_time: 3.8882713318
epoch time: 9.0868625641s, input_fired_time: 0.1306531578, output_fired_time: 0.0000000000, propagate_forward_time: 7.4245839119, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5316252708
validation[          , genome  3510] predictions:    9507/  10000 (95.07%), best:    9552/10000 (95.52%), error:      1704.63843, best error:      1569.24451 on epoch:    17, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 102.3292160034s, input_fired_time: 1.0047363043, output_fired_time: 0.8803831339, propagate_forward_time: 36.3008728027, propagate_backward_time: 61.2781181335, weight_update_time: 0.1165771186, other_time: 2.8651008606
epoch time: 7.9700126648s, input_fired_time: 0.1275152415, output_fired_time: 0.0000000000, propagate_forward_time: 7.3296465874, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5128507614
validation[          , genome  3510] predictions:    9515/  10000 (95.15%), best:    9552/10000 (95.52%), error:      1610.29822, best error:      1569.24451 on epoch:    17, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 105.6456756592s, input_fired_time: 1.0410616398, output_fired_time: 0.8963646293, propagate_forward_time: 39.3572998047, propagate_backward_time: 60.4327926636, weight_update_time: 0.1189634353, other_time: 3.9181594849
epoch time: 8.0554704666s, input_fired_time: 0.1266140044, output_fired_time: 0.0000000000, propagate_forward_time: 7.4308285713, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4980278015
validation[          , genome  3510] predictions:    9515/  10000 (95.15%), best:    9552/10000 (95.52%), error:      1627.80005, best error:      1569.24451 on epoch:    17, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 106.1489791870s, input_fired_time: 1.0321652889, output_fired_time: 0.9009225368, propagate_forward_time: 39.9867172241, propagate_backward_time: 61.2574234009, weight_update_time: 0.1174397394, other_time: 2.9717483521
epoch time: 9.1214237213s, input_fired_time: 0.1341047734, output_fired_time: 0.0000000000, propagate_forward_time: 8.4564199448, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5308990479
validation[          , genome  3510] predictions:    9491/  10000 (94.91%), best:    9552/10000 (95.52%), error:      1738.35022, best error:      1569.24451 on epoch:    17, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 103.0716323853s, input_fired_time: 1.0128998756, output_fired_time: 0.8843752146, propagate_forward_time: 39.6723632813, propagate_backward_time: 58.6093750000, weight_update_time: 0.1173820570, other_time: 2.8926162720
epoch time: 8.0908632278s, input_fired_time: 0.1287775040, output_fired_time: 0.0000000000, propagate_forward_time: 7.4548711777, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5072145462
validation[          , genome  3510] predictions:    9471/  10000 (94.71%), best:    9552/10000 (95.52%), error:      1796.32092, best error:      1569.24451 on epoch:    17, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 104.8864517212s, input_fired_time: 1.0209228992, output_fired_time: 0.9435350895, propagate_forward_time: 38.5422515869, propagate_backward_time: 61.4678077698, weight_update_time: 0.1171293482, other_time: 2.9119377136
epoch time: 7.8883914948s, input_fired_time: 0.1274467558, output_fired_time: 0.0000000000, propagate_forward_time: 7.2526869774, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5082578659
validation[          , genome  3510] predictions:    9526/  10000 (95.26%), best:    9552/10000 (95.52%), error:      1613.83447, best error:      1569.24451 on epoch:    17, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 102.2685623169s, input_fired_time: 1.0041319132, output_fired_time: 0.8780410886, propagate_forward_time: 38.4020538330, propagate_backward_time: 59.1368446350, weight_update_time: 0.1161690056, other_time: 2.8474845886
epoch time: 9.2171640396s, input_fired_time: 0.1318616718, output_fired_time: 0.0000000000, propagate_forward_time: 8.5605316162, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5247707367
validation[          , genome  3510] predictions:    9514/  10000 (95.14%), best:    9552/10000 (95.52%), error:      1680.76855, best error:      1569.24451 on epoch:    17, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 102.9009857178s, input_fired_time: 1.0095702410, output_fired_time: 0.8861874342, propagate_forward_time: 38.7112388611, propagate_backward_time: 59.4353446960, weight_update_time: 0.1171616316, other_time: 2.8586502075
epoch time: 7.7964229584s, input_fired_time: 0.1271394193, output_fired_time: 0.0000000000, propagate_forward_time: 7.1384429932, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5308403969
validation[          , genome  3510] predictions:    9429/  10000 (94.29%), best:    9552/10000 (95.52%), error:      1818.03882, best error:      1569.24451 on epoch:    17, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 104.3089294434s, input_fired_time: 2.0227472782, output_fired_time: 0.8917661309, propagate_forward_time: 39.9691543579, propagate_backward_time: 58.5533447266, weight_update_time: 0.1171776801, other_time: 2.8719100952
epoch time: 8.3505182266s, input_fired_time: 0.1598117203, output_fired_time: 0.0000000000, propagate_forward_time: 7.6884527206, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5022535324
validation[          , genome  3510] predictions:    9539/  10000 (95.39%), best:    9552/10000 (95.52%), error:      1598.09119, best error:      1569.24451 on epoch:    17, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 107.9964675903s, input_fired_time: 1.0410392284, output_fired_time: 0.9652503729, propagate_forward_time: 40.6350822449, propagate_backward_time: 62.3076095581, weight_update_time: 0.1345065236, other_time: 3.0474929810
epoch time: 9.1464023590s, input_fired_time: 0.1319486946, output_fired_time: 0.0000000000, propagate_forward_time: 7.4900588989, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5243949890
validation[          , genome  3510] predictions:    9554/  10000 (95.54%), best:    9554/10000 (95.54%), error:      1513.37439, best error:      1513.37439 on epoch:    28, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 103.7916183472s, input_fired_time: 1.0115818977, output_fired_time: 0.8934838772, propagate_forward_time: 40.0618515015, propagate_backward_time: 58.9710960388, weight_update_time: 0.1170693114, other_time: 2.8536033630
epoch time: 8.8901901245s, input_fired_time: 0.1281900704, output_fired_time: 0.0000000000, propagate_forward_time: 7.2461838722, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5158162117
validation[          , genome  3510] predictions:    9540/  10000 (95.40%), best:    9554/10000 (95.54%), error:      1551.14661, best error:      1513.37439 on epoch:    28, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 103.4567718506s, input_fired_time: 1.0095956326, output_fired_time: 0.8951222897, propagate_forward_time: 38.8903617859, propagate_backward_time: 59.8036499023, weight_update_time: 0.1171161011, other_time: 2.8580436707
epoch time: 7.9036064148s, input_fired_time: 0.1269962043, output_fired_time: 0.0000000000, propagate_forward_time: 7.2704758644, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5061345100
validation[          , genome  3510] predictions:    9544/  10000 (95.44%), best:    9554/10000 (95.54%), error:      1567.49036, best error:      1513.37439 on epoch:    28, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 103.2067337036s, input_fired_time: 1.0119260550, output_fired_time: 0.8841729164, propagate_forward_time: 37.8421134949, propagate_backward_time: 60.5903396606, weight_update_time: 0.1175765991, other_time: 2.8781852722
epoch time: 8.2249364853s, input_fired_time: 0.1303960681, output_fired_time: 0.0000000000, propagate_forward_time: 7.5741114616, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5204291344
validation[          , genome  3510] predictions:    9556/  10000 (95.56%), best:    9554/10000 (95.54%), error:      1524.09387, best error:      1513.37439 on epoch:    28, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 103.4751892090s, input_fired_time: 1.0253485441, output_fired_time: 0.8884404898, propagate_forward_time: 36.8860549927, propagate_backward_time: 61.7968711853, weight_update_time: 0.1175848618, other_time: 2.8784751892
epoch time: 7.9073290825s, input_fired_time: 0.1266287565, output_fired_time: 0.0000000000, propagate_forward_time: 7.2787322998, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5019679070
validation[          , genome  3510] predictions:    9533/  10000 (95.33%), best:    9554/10000 (95.54%), error:      1558.99353, best error:      1513.37439 on epoch:    28, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 111.1719665527s, input_fired_time: 1.0658599138, output_fired_time: 0.9313760996, propagate_forward_time: 42.2931518555, propagate_backward_time: 62.7785606384, weight_update_time: 0.1179137006, other_time: 4.1030235291
epoch time: 8.4658212662s, input_fired_time: 0.1287198514, output_fired_time: 0.0000000000, propagate_forward_time: 7.8325448036, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5045561790
validation[          , genome  3510] predictions:    9537/  10000 (95.37%), best:    9554/10000 (95.54%), error:      1560.13550, best error:      1513.37439 on epoch:    28, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 102.8827362061s, input_fired_time: 1.0076072216, output_fired_time: 0.8951337337, propagate_forward_time: 37.7092285156, propagate_backward_time: 60.4001007080, weight_update_time: 0.1168141589, other_time: 2.8706665039
epoch time: 8.2346372604s, input_fired_time: 0.1337201446, output_fired_time: 0.0000000000, propagate_forward_time: 7.5732040405, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5277128220
validation[          , genome  3510] predictions:    9545/  10000 (95.45%), best:    9554/10000 (95.54%), error:      1547.31482, best error:      1513.37439 on epoch:    28, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 114.8781661987s, input_fired_time: 1.1065248251, output_fired_time: 0.9871054292, propagate_forward_time: 43.5189933777, propagate_backward_time: 66.0844573975, weight_update_time: 0.1361979097, other_time: 3.1810913086
epoch time: 7.8191003799s, input_fired_time: 0.1278792322, output_fired_time: 0.0000000000, propagate_forward_time: 7.1879215240, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5032997131
validation[          , genome  3510] predictions:    9558/  10000 (95.58%), best:    9558/10000 (95.58%), error:      1486.87256, best error:      1486.87256 on epoch:    35, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 103.2589569092s, input_fired_time: 1.0072026253, output_fired_time: 0.8870749474, propagate_forward_time: 38.7451934814, propagate_backward_time: 59.7434692383, weight_update_time: 0.1174059734, other_time: 2.8760147095
epoch time: 9.3858575821s, input_fired_time: 0.1643292755, output_fired_time: 0.0000000000, propagate_forward_time: 8.7055692673, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5159587860
validation[          , genome  3510] predictions:    9516/  10000 (95.16%), best:    9558/10000 (95.58%), error:      1692.66150, best error:      1486.87256 on epoch:    35, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 106.2719116211s, input_fired_time: 1.0562936068, output_fired_time: 0.9099050164, propagate_forward_time: 39.8439102173, propagate_backward_time: 61.4664115906, weight_update_time: 0.1183369383, other_time: 2.9953880310
epoch time: 9.0555791855s, input_fired_time: 0.1308607757, output_fired_time: 0.0000000000, propagate_forward_time: 8.4021463394, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5225725174
validation[          , genome  3510] predictions:    9502/  10000 (95.02%), best:    9558/10000 (95.58%), error:      1651.12732, best error:      1486.87256 on epoch:    35, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 102.5008544922s, input_fired_time: 1.0098398924, output_fired_time: 0.8843197823, propagate_forward_time: 37.4630851746, propagate_backward_time: 60.2628746033, weight_update_time: 0.1166791692, other_time: 2.8807296753
epoch time: 7.8122038841s, input_fired_time: 0.1270592064, output_fired_time: 0.0000000000, propagate_forward_time: 7.1838207245, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5013241768
validation[          , genome  3510] predictions:    9530/  10000 (95.30%), best:    9558/10000 (95.58%), error:      1585.04749, best error:      1486.87256 on epoch:    35, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 105.3402481079s, input_fired_time: 1.0370769501, output_fired_time: 0.9070567489, propagate_forward_time: 40.6181182861, propagate_backward_time: 59.8476181030, weight_update_time: 0.1169748977, other_time: 2.9303741455
epoch time: 10.3988637924s, input_fired_time: 0.1376477927, output_fired_time: 0.0000000000, propagate_forward_time: 9.6889152527, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5723009109
validation[          , genome  3510] predictions:    9567/  10000 (95.67%), best:    9558/10000 (95.58%), error:      1510.49585, best error:      1486.87256 on epoch:    35, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 103.1643524170s, input_fired_time: 1.0107337236, output_fired_time: 0.8880620003, propagate_forward_time: 37.8211021423, propagate_backward_time: 59.5904922485, weight_update_time: 0.1162349954, other_time: 3.8539619446
epoch time: 8.6288013458s, input_fired_time: 0.1248312593, output_fired_time: 0.0000000000, propagate_forward_time: 8.0080108643, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4959592819
validation[          , genome  3510] predictions:    9530/  10000 (95.30%), best:    9558/10000 (95.58%), error:      1537.69043, best error:      1486.87256 on epoch:    35, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 103.7901611328s, input_fired_time: 1.0280123949, output_fired_time: 0.8965434432, propagate_forward_time: 40.0077285767, propagate_backward_time: 58.9862213135, weight_update_time: 0.1172935367, other_time: 2.8716506958
epoch time: 7.8808851242s, input_fired_time: 0.1268280894, output_fired_time: 0.0000000000, propagate_forward_time: 7.2538323402, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5002245903
validation[          , genome  3510] predictions:    9585/  10000 (95.85%), best:    9585/10000 (95.85%), error:      1445.70923, best error:      1445.70923 on epoch:    41, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 102.8655471802s, input_fired_time: 1.0146658421, output_fired_time: 0.9025700688, propagate_forward_time: 38.6263923645, propagate_backward_time: 59.4587364197, weight_update_time: 0.1163870469, other_time: 2.8631820679
epoch time: 9.0744237900s, input_fired_time: 0.1323572695, output_fired_time: 0.0000000000, propagate_forward_time: 7.4110860825, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5309801102
validation[          , genome  3510] predictions:    9535/  10000 (95.35%), best:    9585/10000 (95.85%), error:      1565.09558, best error:      1445.70923 on epoch:    41, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 103.0308761597s, input_fired_time: 1.0160409212, output_fired_time: 0.8871841431, propagate_forward_time: 38.7078437805, propagate_backward_time: 59.5412521362, weight_update_time: 0.1179024652, other_time: 2.8785514832
epoch time: 7.8164277077s, input_fired_time: 0.1275303811, output_fired_time: 0.0000000000, propagate_forward_time: 7.1913208961, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4975762367
validation[          , genome  3510] predictions:    9557/  10000 (95.57%), best:    9585/10000 (95.85%), error:      1490.18005, best error:      1445.70923 on epoch:    41, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 105.0665359497s, input_fired_time: 1.0154621601, output_fired_time: 1.9133720398, propagate_forward_time: 38.1484947205, propagate_backward_time: 60.1420516968, weight_update_time: 0.1172734573, other_time: 3.8471488953
epoch time: 7.9194083214s, input_fired_time: 0.1312083006, output_fired_time: 0.0000000000, propagate_forward_time: 7.2834391594, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5047607422
validation[          , genome  3510] predictions:    9588/  10000 (95.88%), best:    9588/10000 (95.88%), error:      1439.22302, best error:      1439.22302 on epoch:    44, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 102.5929641724s, input_fired_time: 1.0141845942, output_fired_time: 0.8816494346, propagate_forward_time: 38.6107864380, propagate_backward_time: 59.2129287720, weight_update_time: 0.1172724962, other_time: 2.8734130859
epoch time: 8.8112783432s, input_fired_time: 0.1297031343, output_fired_time: 0.0000000000, propagate_forward_time: 8.1674327850, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5141420364
validation[          , genome  3510] predictions:    9543/  10000 (95.43%), best:    9588/10000 (95.88%), error:      1557.15601, best error:      1439.22302 on epoch:    44, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 102.3963851929s, input_fired_time: 1.0135762691, output_fired_time: 0.8823674917, propagate_forward_time: 38.5230827332, propagate_backward_time: 59.1184272766, weight_update_time: 0.1165140346, other_time: 2.8589324951
epoch time: 8.2165184021s, input_fired_time: 0.1286690384, output_fired_time: 0.0000000000, propagate_forward_time: 7.5896177292, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4982318878
validation[          , genome  3510] predictions:    9549/  10000 (95.49%), best:    9588/10000 (95.88%), error:      1467.35754, best error:      1439.22302 on epoch:    44, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 105.9667434692s, input_fired_time: 1.0515455008, output_fired_time: 0.9151260257, propagate_forward_time: 37.9752388000, propagate_backward_time: 62.1398315430, weight_update_time: 0.1166161820, other_time: 3.8850097656
epoch time: 9.3515958786s, input_fired_time: 0.1318303943, output_fired_time: 0.0000000000, propagate_forward_time: 8.7028102875, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5169553757
validation[          , genome  3510] predictions:    9541/  10000 (95.41%), best:    9588/10000 (95.88%), error:      1601.75098, best error:      1439.22302 on epoch:    44, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 105.3611755371s, input_fired_time: 1.0374777317, output_fired_time: 0.9176237583, propagate_forward_time: 38.4912757874, propagate_backward_time: 61.9767494202, weight_update_time: 0.1265897602, other_time: 2.9380455017
epoch time: 9.0914497375s, input_fired_time: 0.1339166909, output_fired_time: 0.0000000000, propagate_forward_time: 8.4374046326, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5201282501
validation[          , genome  3510] predictions:    9568/  10000 (95.68%), best:    9588/10000 (95.88%), error:      1498.03601, best error:      1439.22302 on epoch:    44, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 102.9931640625s, input_fired_time: 2.0269162655, output_fired_time: 0.8923733234, propagate_forward_time: 38.6051292419, propagate_backward_time: 58.6013183594, weight_update_time: 0.1172993854, other_time: 2.8674278259
epoch time: 7.9148516655s, input_fired_time: 0.1310949177, output_fired_time: 0.0000000000, propagate_forward_time: 7.2743687630, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5093879700
validation[          , genome  3510] predictions:    9503/  10000 (95.03%), best:    9588/10000 (95.88%), error:      1713.07495, best error:      1439.22302 on epoch:    44, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 102.6035156250s, input_fired_time: 1.0161080360, output_fired_time: 0.8944267631, propagate_forward_time: 39.5199432373, propagate_backward_time: 58.3000183105, weight_update_time: 0.1167334989, other_time: 2.8730239868
epoch time: 9.1501979828s, input_fired_time: 0.1344942898, output_fired_time: 0.0000000000, propagate_forward_time: 8.4911155701, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5245885849
validation[          , genome  3510] predictions:    9567/  10000 (95.67%), best:    9588/10000 (95.88%), error:      1490.23181, best error:      1439.22302 on epoch:    44, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 102.7535247803s, input_fired_time: 1.0192556381, output_fired_time: 0.8853262663, propagate_forward_time: 37.6450004578, propagate_backward_time: 60.3215713501, weight_update_time: 0.1169783920, other_time: 2.8823738098
epoch time: 8.0390138626s, input_fired_time: 0.1303471774, output_fired_time: 0.0000000000, propagate_forward_time: 7.3175196648, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5911469460
validation[          , genome  3510] predictions:    9552/  10000 (95.52%), best:    9588/10000 (95.88%), error:      1528.15735, best error:      1439.22302 on epoch:    44, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 105.2761535645s, input_fired_time: 1.0197597742, output_fired_time: 0.8948457837, propagate_forward_time: 40.1493606567, propagate_backward_time: 60.3757629395, weight_update_time: 0.1169118732, other_time: 2.8364257813
epoch time: 7.6671590805s, input_fired_time: 0.1274022758, output_fired_time: 0.0000000000, propagate_forward_time: 7.0379815102, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5017752647
validation[          , genome  3510] predictions:    9571/  10000 (95.71%), best:    9588/10000 (95.88%), error:      1477.58459, best error:      1439.22302 on epoch:    44, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 101.6605453491s, input_fired_time: 1.0253386497, output_fired_time: 0.8794286847, propagate_forward_time: 37.4854583740, propagate_backward_time: 59.1057395935, weight_update_time: 0.1168859601, other_time: 3.1645851135
epoch time: 9.0589790344s, input_fired_time: 0.1341424435, output_fired_time: 0.0000000000, propagate_forward_time: 8.3958301544, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5290060043
validation[          , genome  3510] predictions:    9566/  10000 (95.66%), best:    9588/10000 (95.88%), error:      1530.56848, best error:      1439.22302 on epoch:    44, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 102.7683410645s, input_fired_time: 1.0175964832, output_fired_time: 0.8872757554, propagate_forward_time: 39.6079216003, propagate_backward_time: 58.3985786438, weight_update_time: 0.1168742403, other_time: 2.8569717407
epoch time: 7.7916674614s, input_fired_time: 0.1288938522, output_fired_time: 0.0000000000, propagate_forward_time: 7.1560311317, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5067424774
validation[          , genome  3510] predictions:    9503/  10000 (95.03%), best:    9588/10000 (95.88%), error:      1659.01233, best error:      1439.22302 on epoch:    44, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 102.7440261841s, input_fired_time: 1.0178965330, output_fired_time: 0.8835832477, propagate_forward_time: 37.4706649780, propagate_backward_time: 59.4143600464, weight_update_time: 0.1167159453, other_time: 3.9575195313
epoch time: 9.1423912048s, input_fired_time: 0.1336073130, output_fired_time: 0.0000000000, propagate_forward_time: 8.4918107986, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5169734955
validation[          , genome  3510] predictions:    9559/  10000 (95.59%), best:    9588/10000 (95.88%), error:      1460.25012, best error:      1439.22302 on epoch:    44, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 107.1764526367s, input_fired_time: 2.0764884949, output_fired_time: 0.9078932405, propagate_forward_time: 39.2486419678, propagate_backward_time: 60.9999694824, weight_update_time: 0.1163103506, other_time: 3.9434585571
epoch time: 9.1904382706s, input_fired_time: 0.1344473362, output_fired_time: 0.0000000000, propagate_forward_time: 8.5318803787, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5241107941
validation[          , genome  3510] predictions:    9518/  10000 (95.18%), best:    9588/10000 (95.88%), error:      1655.99658, best error:      1439.22302 on epoch:    44, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 103.7075424194s, input_fired_time: 1.0247535706, output_fired_time: 0.8917477131, propagate_forward_time: 39.0404281616, propagate_backward_time: 59.8919754028, weight_update_time: 0.1171102896, other_time: 2.8586349487
epoch time: 8.3307752609s, input_fired_time: 0.1284392923, output_fired_time: 0.0000000000, propagate_forward_time: 7.7020025253, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5003337860
validation[          , genome  3510] predictions:    9588/  10000 (95.88%), best:    9588/10000 (95.88%), error:      1465.88281, best error:      1439.22302 on epoch:    44, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 103.0434494019s, input_fired_time: 2.0276875496, output_fired_time: 0.8916598558, propagate_forward_time: 38.6862716675, propagate_backward_time: 58.5802574158, weight_update_time: 0.1167408228, other_time: 2.8575706482
epoch time: 9.1882810593s, input_fired_time: 0.1365057528, output_fired_time: 0.0000000000, propagate_forward_time: 8.5291948318, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5225801468
validation[          , genome  3510] predictions:    9550/  10000 (95.50%), best:    9588/10000 (95.88%), error:      1493.37061, best error:      1439.22302 on epoch:    44, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 119.7045593262s, input_fired_time: 1.1459542513, output_fired_time: 0.9868266582, propagate_forward_time: 44.5727233887, propagate_backward_time: 68.6298446655, weight_update_time: 0.1289998442, other_time: 4.3692092896
epoch time: 7.8864965439s, input_fired_time: 0.1309531778, output_fired_time: 0.0000000000, propagate_forward_time: 7.2484207153, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5071225166
validation[          , genome  3510] predictions:    9570/  10000 (95.70%), best:    9570/10000 (95.70%), error:      1419.25623, best error:      1419.25623 on epoch:    59, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 103.1979598999s, input_fired_time: 1.0262918472, output_fired_time: 0.8893809319, propagate_forward_time: 38.7339553833, propagate_backward_time: 57.6487426758, weight_update_time: 0.1173834652, other_time: 4.8995895386
epoch time: 8.0826005936s, input_fired_time: 0.1323811561, output_fired_time: 0.0000000000, propagate_forward_time: 7.4363155365, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5139040947
validation[          , genome  3510] predictions:    9586/  10000 (95.86%), best:    9570/10000 (95.70%), error:      1427.61597, best error:      1419.25623 on epoch:    59, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 103.8128356934s, input_fired_time: 2.0316216946, output_fired_time: 0.8933618069, propagate_forward_time: 39.0840606689, propagate_backward_time: 58.9615783691, weight_update_time: 0.1171180680, other_time: 2.8422088623
epoch time: 9.1704101563s, input_fired_time: 0.1350020468, output_fired_time: 0.0000000000, propagate_forward_time: 8.5172042847, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5182037354
validation[          , genome  3510] predictions:    9568/  10000 (95.68%), best:    9570/10000 (95.70%), error:      1467.87976, best error:      1419.25623 on epoch:    59, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 103.2942504883s, input_fired_time: 1.0214928389, output_fired_time: 0.8921858072, propagate_forward_time: 39.7686271667, propagate_backward_time: 58.7361221313, weight_update_time: 0.1169998273, other_time: 2.8758201599
epoch time: 7.9443206787s, input_fired_time: 0.1307093501, output_fired_time: 0.0000000000, propagate_forward_time: 7.2988972664, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5147142410
validation[          , genome  3510] predictions:    9546/  10000 (95.46%), best:    9570/10000 (95.70%), error:      1458.44006, best error:      1419.25623 on epoch:    59, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 102.8914337158s, input_fired_time: 1.0227706432, output_fired_time: 0.8880389929, propagate_forward_time: 37.6831741333, propagate_backward_time: 60.4257888794, weight_update_time: 0.1170687377, other_time: 2.8716583252
epoch time: 9.5239849091s, input_fired_time: 0.1411097795, output_fired_time: 0.0000000000, propagate_forward_time: 8.8385553360, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5443201065
validation[          , genome  3510] predictions:    9574/  10000 (95.74%), best:    9570/10000 (95.70%), error:      1474.09448, best error:      1419.25623 on epoch:    59, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 102.9999923706s, input_fired_time: 1.0227177143, output_fired_time: 0.8833134174, propagate_forward_time: 38.7054367065, propagate_backward_time: 59.5078659058, weight_update_time: 0.1173013896, other_time: 2.8806533813
epoch time: 7.9475445747s, input_fired_time: 0.1299733669, output_fired_time: 0.0000000000, propagate_forward_time: 7.3136067390, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5039644241
validation[          , genome  3510] predictions:    9537/  10000 (95.37%), best:    9570/10000 (95.70%), error:      1545.26233, best error:      1419.25623 on epoch:    59, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 112.1852340698s, input_fired_time: 1.1319394112, output_fired_time: 1.0850614309, propagate_forward_time: 42.1101646423, propagate_backward_time: 64.7818222046, weight_update_time: 0.1190089062, other_time: 3.0762405396
epoch time: 7.9155168533s, input_fired_time: 0.1297920495, output_fired_time: 0.0000000000, propagate_forward_time: 7.2785363197, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5071883202
validation[          , genome  3510] predictions:    9569/  10000 (95.69%), best:    9570/10000 (95.70%), error:      1460.64587, best error:      1419.25623 on epoch:    59, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 105.4957809448s, input_fired_time: 1.0262098312, output_fired_time: 0.8930923939, propagate_forward_time: 41.3452491760, propagate_backward_time: 59.3949737549, weight_update_time: 0.1169700101, other_time: 2.8362617493
epoch time: 16.8209629059s, input_fired_time: 0.3305912316, output_fired_time: 0.0000000000, propagate_forward_time: 15.4667043686, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0236673355
validation[          , genome  3510] predictions:    9586/  10000 (95.86%), best:    9586/10000 (95.86%), error:      1406.99744, best error:      1406.99744 on epoch:    66, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 104.4555358887s, input_fired_time: 1.0792585611, output_fired_time: 0.8935343623, propagate_forward_time: 38.3183059692, propagate_backward_time: 61.3027915955, weight_update_time: 0.1176043078, other_time: 2.8616447449
epoch time: 15.4566602707s, input_fired_time: 0.1891745776, output_fired_time: 0.0000000000, propagate_forward_time: 14.3839960098, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8834896088
validation[          , genome  3510] predictions:    9526/  10000 (95.26%), best:    9586/10000 (95.86%), error:      1537.27673, best error:      1406.99744 on epoch:    66, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 103.9315719604s, input_fired_time: 2.0345909595, output_fired_time: 0.8913497925, propagate_forward_time: 39.0362281799, propagate_backward_time: 59.0943222046, weight_update_time: 0.1174347699, other_time: 2.8750801086
epoch time: 7.9465379715s, input_fired_time: 0.1309204251, output_fired_time: 0.0000000000, propagate_forward_time: 7.3158502579, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4997673035
validation[          , genome  3510] predictions:    9513/  10000 (95.13%), best:    9586/10000 (95.86%), error:      1610.94800, best error:      1406.99744 on epoch:    66, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 106.4940719604s, input_fired_time: 1.0708330870, output_fired_time: 0.9121754169, propagate_forward_time: 39.7986488342, propagate_backward_time: 60.7935981750, weight_update_time: 0.1176605746, other_time: 3.9188194275
epoch time: 10.7356405258s, input_fired_time: 0.1977805346, output_fired_time: 0.0000000000, propagate_forward_time: 9.8022308350, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7356290817
validation[          , genome  3510] predictions:    9578/  10000 (95.78%), best:    9586/10000 (95.86%), error:      1409.67102, best error:      1406.99744 on epoch:    66, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 104.5134582520s, input_fired_time: 1.0498015881, output_fired_time: 0.9456931353, propagate_forward_time: 40.3298301697, propagate_backward_time: 59.2532005310, weight_update_time: 0.1170027331, other_time: 2.9349288940
epoch time: 9.2489814758s, input_fired_time: 0.1369871497, output_fired_time: 0.0000000000, propagate_forward_time: 8.5824489594, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5295457840
validation[          , genome  3510] predictions:    9587/  10000 (95.87%), best:    9587/10000 (95.87%), error:      1395.73328, best error:      1395.73328 on epoch:    70, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 103.2444458008s, input_fired_time: 1.0264256001, output_fired_time: 0.8858846426, propagate_forward_time: 37.8357772827, propagate_backward_time: 60.6371688843, weight_update_time: 0.1171538085, other_time: 2.8591842651
epoch time: 7.9184536934s, input_fired_time: 0.1304019094, output_fired_time: 0.0000000000, propagate_forward_time: 7.2836699486, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5043816566
validation[          , genome  3510] predictions:    9572/  10000 (95.72%), best:    9587/10000 (95.87%), error:      1484.26013, best error:      1395.73328 on epoch:    70, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 104.4121856689s, input_fired_time: 1.0382524729, output_fired_time: 0.8904227018, propagate_forward_time: 37.8501091003, propagate_backward_time: 61.7630348206, weight_update_time: 0.1180353165, other_time: 2.8703727722
epoch time: 10.8561840057s, input_fired_time: 0.1961697787, output_fired_time: 0.0000000000, propagate_forward_time: 10.0003967285, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6596174240
validation[          , genome  3510] predictions:    9588/  10000 (95.88%), best:    9587/10000 (95.87%), error:      1412.53943, best error:      1395.73328 on epoch:    70, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 111.4206008911s, input_fired_time: 1.1438454390, output_fired_time: 0.9797298908, propagate_forward_time: 39.4162788391, propagate_backward_time: 66.8467559814, weight_update_time: 0.1308494359, other_time: 3.0339965820
epoch time: 7.9864954948s, input_fired_time: 0.1319765151, output_fired_time: 0.0000000000, propagate_forward_time: 7.3475461006, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5069727898
validation[          , genome  3510] predictions:    9582/  10000 (95.82%), best:    9587/10000 (95.87%), error:      1401.63428, best error:      1395.73328 on epoch:    70, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 102.5252990723s, input_fired_time: 1.0223332644, output_fired_time: 0.8841922283, propagate_forward_time: 40.3852348328, propagate_backward_time: 57.3704185486, weight_update_time: 0.1169656664, other_time: 2.8631210327
epoch time: 9.2277851105s, input_fired_time: 0.1365443766, output_fired_time: 0.0000000000, propagate_forward_time: 8.5650615692, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5261793137
validation[          , genome  3510] predictions:    9570/  10000 (95.70%), best:    9587/10000 (95.87%), error:      1446.25403, best error:      1395.73328 on epoch:    70, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 107.2289428711s, input_fired_time: 1.0268431902, output_fired_time: 0.9084285498, propagate_forward_time: 41.4521598816, propagate_backward_time: 60.9011726379, weight_update_time: 0.1169920415, other_time: 2.9403381348
epoch time: 9.2756109238s, input_fired_time: 0.1359501183, output_fired_time: 0.0000000000, propagate_forward_time: 8.6146469116, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5250139236
validation[          , genome  3510] predictions:    9595/  10000 (95.95%), best:    9595/10000 (95.95%), error:      1381.67285, best error:      1381.67285 on epoch:    75, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 102.9479980469s, input_fired_time: 2.0384054184, output_fired_time: 0.8891443610, propagate_forward_time: 38.7140846252, propagate_backward_time: 58.4427795410, weight_update_time: 0.1167794317, other_time: 2.8635826111
epoch time: 7.9352731705s, input_fired_time: 0.1308192909, output_fired_time: 0.0000000000, propagate_forward_time: 7.3011069298, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5033469200
validation[          , genome  3510] predictions:    9596/  10000 (95.96%), best:    9595/10000 (95.95%), error:      1394.00244, best error:      1381.67285 on epoch:    75, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 103.3682785034s, input_fired_time: 1.0279586315, output_fired_time: 0.8887427449, propagate_forward_time: 37.9152297974, propagate_backward_time: 60.6253128052, weight_update_time: 0.1170849130, other_time: 2.9110336304
epoch time: 9.2730264664s, input_fired_time: 0.1370599568, output_fired_time: 0.0000000000, propagate_forward_time: 8.6067066193, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5292596817
validation[          , genome  3510] predictions:    9560/  10000 (95.60%), best:    9595/10000 (95.95%), error:      1476.55823, best error:      1381.67285 on epoch:    75, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 109.3787765503s, input_fired_time: 1.0766195059, output_fired_time: 0.9237497449, propagate_forward_time: 40.8577880859, propagate_backward_time: 63.5162544250, weight_update_time: 0.1182240471, other_time: 3.0043601990
epoch time: 9.2146444321s, input_fired_time: 0.1350221187, output_fired_time: 0.0000000000, propagate_forward_time: 8.5592947006, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5203275681
validation[          , genome  3510] predictions:    9576/  10000 (95.76%), best:    9595/10000 (95.95%), error:      1410.49475, best error:      1381.67285 on epoch:    75, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 102.8419494629s, input_fired_time: 1.0311698914, output_fired_time: 0.8932836652, propagate_forward_time: 38.6631813049, propagate_backward_time: 59.3779563904, weight_update_time: 0.1168786287, other_time: 2.8763580322
epoch time: 7.8927655220s, input_fired_time: 0.1309878528, output_fired_time: 0.0000000000, propagate_forward_time: 7.2595200539, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5022578239
validation[          , genome  3510] predictions:    9547/  10000 (95.47%), best:    9595/10000 (95.95%), error:      1493.50610, best error:      1381.67285 on epoch:    75, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 104.7866973877s, input_fired_time: 1.0382066965, output_fired_time: 0.8931480050, propagate_forward_time: 38.0132293701, propagate_backward_time: 61.9515953064, weight_update_time: 0.1177655756, other_time: 2.8905143738
epoch time: 7.9185137749s, input_fired_time: 0.1330941170, output_fired_time: 0.0000000000, propagate_forward_time: 7.2708253860, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5145940781
validation[          , genome  3510] predictions:    9582/  10000 (95.82%), best:    9595/10000 (95.95%), error:      1416.69824, best error:      1381.67285 on epoch:    75, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 102.9307785034s, input_fired_time: 1.0331314802, output_fired_time: 0.8846068382, propagate_forward_time: 37.6530685425, propagate_backward_time: 60.4838333130, weight_update_time: 0.1173649132, other_time: 2.8761367798
epoch time: 9.0081233978s, input_fired_time: 0.1344727576, output_fired_time: 0.0000000000, propagate_forward_time: 8.3622045517, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5114459991
validation[          , genome  3510] predictions:    9585/  10000 (95.85%), best:    9595/10000 (95.95%), error:      1415.29639, best error:      1381.67285 on epoch:    75, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 104.8338775635s, input_fired_time: 1.0597480536, output_fired_time: 0.9115715623, propagate_forward_time: 39.3602371216, propagate_backward_time: 60.6306915283, weight_update_time: 0.1178164855, other_time: 2.8716278076
epoch time: 8.4246482849s, input_fired_time: 0.1311657429, output_fired_time: 0.0000000000, propagate_forward_time: 7.7960839272, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4973988533
validation[          , genome  3510] predictions:    9590/  10000 (95.90%), best:    9590/10000 (95.90%), error:      1379.10718, best error:      1379.10718 on epoch:    82, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 109.9512939453s, input_fired_time: 1.0585682392, output_fired_time: 0.9424886703, propagate_forward_time: 41.0963249207, propagate_backward_time: 63.8531074524, weight_update_time: 0.1219575629, other_time: 3.0008049011
epoch time: 7.7966384888s, input_fired_time: 0.1302670240, output_fired_time: 0.0000000000, propagate_forward_time: 7.1536407471, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5127305984
validation[          , genome  3510] predictions:    9577/  10000 (95.77%), best:    9590/10000 (95.90%), error:      1442.04407, best error:      1379.10718 on epoch:    82, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 103.3723373413s, input_fired_time: 1.0356173515, output_fired_time: 0.8881915808, propagate_forward_time: 37.8688354492, propagate_backward_time: 59.6727409363, weight_update_time: 0.1175124422, other_time: 3.9069557190
epoch time: 9.0392007828s, input_fired_time: 0.1342162341, output_fired_time: 0.0000000000, propagate_forward_time: 8.3841333389, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5208511353
validation[          , genome  3510] predictions:    9593/  10000 (95.93%), best:    9590/10000 (95.90%), error:      1388.28906, best error:      1379.10718 on epoch:    82, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 103.2688674927s, input_fired_time: 1.0351130962, output_fired_time: 0.8893203139, propagate_forward_time: 37.8542556763, propagate_backward_time: 60.6065330505, weight_update_time: 0.1173869446, other_time: 2.8836479187
epoch time: 7.9384126663s, input_fired_time: 0.1333507299, output_fired_time: 0.0000000000, propagate_forward_time: 7.2968516350, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5082101822
validation[          , genome  3510] predictions:    9570/  10000 (95.70%), best:    9590/10000 (95.90%), error:      1478.96338, best error:      1379.10718 on epoch:    82, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 104.8916473389s, input_fired_time: 1.0395680666, output_fired_time: 0.8997597098, propagate_forward_time: 40.0643539429, propagate_backward_time: 58.9976310730, weight_update_time: 0.1174318343, other_time: 3.8903388977
epoch time: 7.8718147278s, input_fired_time: 0.1318299025, output_fired_time: 0.0000000000, propagate_forward_time: 7.2313966751, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5085883141
validation[          , genome  3510] predictions:    9585/  10000 (95.85%), best:    9590/10000 (95.90%), error:      1423.53333, best error:      1379.10718 on epoch:    82, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 108.8513641357s, input_fired_time: 1.0967618227, output_fired_time: 0.9594075084, propagate_forward_time: 40.5258674622, propagate_backward_time: 63.2825355530, weight_update_time: 0.1175872162, other_time: 2.9867973328
epoch time: 13.2168464661s, input_fired_time: 0.3089199364, output_fired_time: 0.0000000000, propagate_forward_time: 12.0538778305, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8540487289
validation[          , genome  3510] predictions:    9578/  10000 (95.78%), best:    9590/10000 (95.90%), error:      1408.04114, best error:      1379.10718 on epoch:    82, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 107.3811569214s, input_fired_time: 1.0563640594, output_fired_time: 0.9097796082, propagate_forward_time: 41.1903266907, propagate_backward_time: 61.3090667725, weight_update_time: 0.1175217479, other_time: 2.9156188965
epoch time: 7.6874423027s, input_fired_time: 0.1307659894, output_fired_time: 0.0000000000, propagate_forward_time: 7.0531826019, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5034937859
validation[          , genome  3510] predictions:    9594/  10000 (95.94%), best:    9590/10000 (95.90%), error:      1384.21863, best error:      1379.10718 on epoch:    82, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 107.5877227783s, input_fired_time: 1.0711530447, output_fired_time: 0.9328352809, propagate_forward_time: 41.5721511841, propagate_backward_time: 60.9780273438, weight_update_time: 0.1249440834, other_time: 3.0335540771
epoch time: 9.1704225540s, input_fired_time: 0.1360082179, output_fired_time: 0.0000000000, propagate_forward_time: 8.5097141266, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5247001648
validation[          , genome  3510] predictions:    9568/  10000 (95.68%), best:    9590/10000 (95.90%), error:      1439.20691, best error:      1379.10718 on epoch:    82, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 104.2579345703s, input_fired_time: 1.0386128426, output_fired_time: 0.9002902508, propagate_forward_time: 37.1295242310, propagate_backward_time: 62.3382797241, weight_update_time: 0.1178722233, other_time: 2.8512268066
epoch time: 9.1829080582s, input_fired_time: 0.1356793940, output_fired_time: 0.0000000000, propagate_forward_time: 8.5261011124, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5211277008
validation[          , genome  3510] predictions:    9584/  10000 (95.84%), best:    9590/10000 (95.90%), error:      1401.60974, best error:      1379.10718 on epoch:    82, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 102.9812698364s, input_fired_time: 1.0489678383, output_fired_time: 0.8979340792, propagate_forward_time: 38.8847541809, propagate_backward_time: 59.2740478516, weight_update_time: 0.1174899787, other_time: 2.8755683899
epoch time: 7.9026756287s, input_fired_time: 0.1328454167, output_fired_time: 0.0000000000, propagate_forward_time: 7.2635545731, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5062756538
validation[          , genome  3510] predictions:    9576/  10000 (95.76%), best:    9590/10000 (95.90%), error:      1397.78381, best error:      1379.10718 on epoch:    82, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 104.2653579712s, input_fired_time: 1.0338406563, output_fired_time: 0.9252283573, propagate_forward_time: 39.3396263123, propagate_backward_time: 59.0859794617, weight_update_time: 0.1164866835, other_time: 3.8806762695
epoch time: 9.1816873550s, input_fired_time: 0.1367736012, output_fired_time: 0.0000000000, propagate_forward_time: 8.5235862732, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5213270187
validation[          , genome  3510] predictions:    9583/  10000 (95.83%), best:    9590/10000 (95.90%), error:      1396.13232, best error:      1379.10718 on epoch:    82, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 103.2756576538s, input_fired_time: 1.0389350653, output_fired_time: 0.8877052665, propagate_forward_time: 36.6941299438, propagate_backward_time: 61.7660255432, weight_update_time: 0.1176239029, other_time: 2.8888664246
epoch time: 8.0435447693s, input_fired_time: 0.1349145323, output_fired_time: 0.0000000000, propagate_forward_time: 7.4001083374, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5085220337
validation[          , genome  3510] predictions:    9597/  10000 (95.97%), best:    9590/10000 (95.90%), error:      1388.75330, best error:      1379.10718 on epoch:    82, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 103.7865524292s, input_fired_time: 1.0485620499, output_fired_time: 0.8832645416, propagate_forward_time: 40.6264114380, propagate_backward_time: 58.3674850464, weight_update_time: 0.1162101477, other_time: 2.8608322144
epoch time: 7.7902002335s, input_fired_time: 0.1322765648, output_fired_time: 0.0000000000, propagate_forward_time: 7.1530523300, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5048713684
validation[          , genome  3510] predictions:    9573/  10000 (95.73%), best:    9590/10000 (95.90%), error:      1457.85168, best error:      1379.10718 on epoch:    82, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 102.8936157227s, input_fired_time: 1.0390787125, output_fired_time: 0.8899891376, propagate_forward_time: 38.7359352112, propagate_backward_time: 59.3762359619, weight_update_time: 0.1167598888, other_time: 2.8523750305
epoch time: 9.2651033401s, input_fired_time: 0.1395322829, output_fired_time: 0.0000000000, propagate_forward_time: 8.5968151093, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5287561417
validation[          , genome  3510] predictions:    9596/  10000 (95.96%), best:    9590/10000 (95.90%), error:      1387.97681, best error:      1379.10718 on epoch:    82, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 105.7925262451s, input_fired_time: 1.0564835072, output_fired_time: 0.9198948145, propagate_forward_time: 38.8684577942, propagate_backward_time: 62.0121536255, weight_update_time: 0.1220505089, other_time: 2.9355392456
epoch time: 7.8407459259s, input_fired_time: 0.1329269707, output_fired_time: 0.0000000000, propagate_forward_time: 7.2077293396, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5000896454
validation[          , genome  3510] predictions:    9587/  10000 (95.87%), best:    9590/10000 (95.90%), error:      1394.78503, best error:      1379.10718 on epoch:    82, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 105.4547424316s, input_fired_time: 1.0451483727, output_fired_time: 0.8938739300, propagate_forward_time: 39.2412490845, propagate_backward_time: 61.4149665833, weight_update_time: 0.1192204952, other_time: 2.8595008850
epoch time: 7.9162554741s, input_fired_time: 0.1342723966, output_fired_time: 0.0000000000, propagate_forward_time: 7.2746090889, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5073738098
validation[          , genome  3510] predictions:    9580/  10000 (95.80%), best:    9590/10000 (95.90%), error:      1429.39014, best error:      1379.10718 on epoch:    82, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 104.0640182495s, input_fired_time: 1.0371313095, output_fired_time: 0.8962455392, propagate_forward_time: 41.2129402161, propagate_backward_time: 58.0830650330, weight_update_time: 0.1166743264, other_time: 2.8346328735
epoch time: 9.2520513535s, input_fired_time: 0.1389311552, output_fired_time: 0.0000000000, propagate_forward_time: 8.5879678726, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5251522064
validation[          , genome  3510] predictions:    9545/  10000 (95.45%), best:    9590/10000 (95.90%), error:      1555.81738, best error:      1379.10718 on epoch:    82, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 111.5551452637s, input_fired_time: 1.1457718611, output_fired_time: 0.9556319714, propagate_forward_time: 41.7742767334, propagate_backward_time: 64.6250610352, weight_update_time: 0.1255077422, other_time: 3.0543975830
epoch time: 9.1094779968s, input_fired_time: 0.1391808987, output_fired_time: 0.0000000000, propagate_forward_time: 8.4530420303, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5172548294
validation[          , genome  3510] predictions:    9575/  10000 (95.75%), best:    9590/10000 (95.90%), error:      1418.82031, best error:      1379.10718 on epoch:    82, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 102.4978942871s, input_fired_time: 1.0402560234, output_fired_time: 0.8806830049, propagate_forward_time: 38.5981178284, propagate_backward_time: 59.1183433533, weight_update_time: 0.1162834242, other_time: 2.8604965210
epoch time: 7.8143548965s, input_fired_time: 0.1338438392, output_fired_time: 0.0000000000, propagate_forward_time: 7.1777491570, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5027618408
validation[          , genome  3510] predictions:    9583/  10000 (95.83%), best:    9590/10000 (95.90%), error:      1479.98914, best error:      1379.10718 on epoch:    82, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 42.3462486267s, input_fired_time: 0.6735610962, output_fired_time: 0.0000000000, propagate_forward_time: 38.0498390198, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6228485107
best training[          , genome  3510] predictions:   48736/  50000 (97.47%), best:    9590/10000 (95.90%), error:      4722.55225, best error:      1379.10718 on epoch:    82, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 9.1548233032s, input_fired_time: 0.1369460672, output_fired_time: 0.0000000000, propagate_forward_time: 8.4886789322, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5291986465
   testing[          , genome  3510] predictions:    9640/  10000 (96.40%), best:    9590/10000 (95.90%), error:      1238.22131, best error:      1379.10718 on epoch:    82, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
09:32:40 (10504): called boinc_finish(0)

</stderr_txt>
]]>