Nameexact_genome_1512568488_42_6614_1
Workunit2604331
Created7 Dec 2017, 20:54:48 UTC
Sent7 Dec 2017, 21:00:52 UTC
Report deadline15 Dec 2017, 21:21:27 UTC
Received8 Dec 2017, 2:33:54 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID53799
Run time2 hours 14 min 5 sec
CPU time2 hours 13 min 37 sec
Validate stateValid
Credit2,003.58
Device peak FLOPS3.64 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.33

Stderr output

<core_client_version>7.2.42</core_client_version>
<![CDATA[
<stderr_txt>
rning_rate: 0.0064167744, weight_decay: 0.0002566710

epoch time: 72.5448913574s, input_fired_time: 1.2839218378, output_fired_time: 0.8718746901, propagate_forward_time: 28.1765594482, propagate_backward_time: 40.0601234436, weight_update_time: 0.0795100480, other_time: 2.1524162292
epoch time: 6.2300481796s, input_fired_time: 0.1466686130, output_fired_time: 0.0000000000, propagate_forward_time: 5.6948661804, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3885135651
validation[          , genome  6614] predictions:    9647/  10000 (96.47%), best:    9703/10000 (97.03%), error:      1128.67139, best error:      1037.44507 on epoch:    12, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 72.9500808716s, input_fired_time: 1.3084760904, output_fired_time: 0.8877780437, propagate_forward_time: 28.2957611084, propagate_backward_time: 40.3011703491, weight_update_time: 0.0797212049, other_time: 2.1568908691
epoch time: 6.2030320168s, input_fired_time: 0.1444217712, output_fired_time: 0.0000000000, propagate_forward_time: 5.6683135033, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3902969360
validation[          , genome  6614] predictions:    9668/  10000 (96.68%), best:    9703/10000 (97.03%), error:      1106.75452, best error:      1037.44507 on epoch:    12, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 72.6107788086s, input_fired_time: 1.2967290878, output_fired_time: 0.8708238602, propagate_forward_time: 28.1763381958, propagate_backward_time: 40.1296653748, weight_update_time: 0.0795977190, other_time: 2.1372184753
epoch time: 6.1267614365s, input_fired_time: 0.1404841393, output_fired_time: 0.0000000000, propagate_forward_time: 5.6077661514, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3785109520
validation[          , genome  6614] predictions:    9701/  10000 (97.01%), best:    9701/10000 (97.01%), error:      1026.94189, best error:      1026.94189 on epoch:    16, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 73.0753097534s, input_fired_time: 1.3022508621, output_fired_time: 0.8721935749, propagate_forward_time: 28.4144744873, propagate_backward_time: 40.3221778870, weight_update_time: 0.0799474269, other_time: 2.1642112732
epoch time: 6.2943329811s, input_fired_time: 0.1501713544, output_fired_time: 0.0000000000, propagate_forward_time: 5.7535223961, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3906393051
validation[          , genome  6614] predictions:    9719/  10000 (97.19%), best:    9719/10000 (97.19%), error:       990.96338, best error:       990.96338 on epoch:    17, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 72.9522552490s, input_fired_time: 1.2915811539, output_fired_time: 0.8722056150, propagate_forward_time: 28.2296810150, propagate_backward_time: 40.3985023499, weight_update_time: 0.0792326331, other_time: 2.1602821350
epoch time: 6.1806087494s, input_fired_time: 0.1403715461, output_fired_time: 0.0000000000, propagate_forward_time: 5.6548957825, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3853416443
validation[          , genome  6614] predictions:    9630/  10000 (96.30%), best:    9719/10000 (97.19%), error:      1270.36658, best error:       990.96338 on epoch:    17, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 73.2098617554s, input_fired_time: 1.3207584620, output_fired_time: 0.8713923693, propagate_forward_time: 28.4660015106, propagate_backward_time: 40.3883171082, weight_update_time: 0.0799198225, other_time: 2.1633949280
epoch time: 6.1915674210s, input_fired_time: 0.1408497542, output_fired_time: 0.0000000000, propagate_forward_time: 5.6614108086, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3893070221
validation[          , genome  6614] predictions:    9656/  10000 (96.56%), best:    9719/10000 (97.19%), error:      1146.78308, best error:       990.96338 on epoch:    17, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 72.7815856934s, input_fired_time: 1.2970546484, output_fired_time: 0.8995898962, propagate_forward_time: 28.2546215057, propagate_backward_time: 40.1449737549, weight_update_time: 0.0793983862, other_time: 2.1853408813
epoch time: 6.1313924789s, input_fired_time: 0.1407117546, output_fired_time: 0.0000000000, propagate_forward_time: 5.6108269691, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3798537254
validation[          , genome  6614] predictions:    9708/  10000 (97.08%), best:    9708/10000 (97.08%), error:       988.64935, best error:       988.64935 on epoch:    20, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 72.8418273926s, input_fired_time: 1.2913130522, output_fired_time: 0.8704223037, propagate_forward_time: 28.2599887848, propagate_backward_time: 40.2575531006, weight_update_time: 0.0797763914, other_time: 2.1625518799
epoch time: 6.1838235855s, input_fired_time: 0.1453008652, output_fired_time: 0.0000000000, propagate_forward_time: 5.6497845650, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3887381554
validation[          , genome  6614] predictions:    9643/  10000 (96.43%), best:    9708/10000 (97.08%), error:      1186.46545, best error:       988.64935 on epoch:    20, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 72.7635345459s, input_fired_time: 1.2947790623, output_fired_time: 0.8729587197, propagate_forward_time: 28.2281608582, propagate_backward_time: 40.2058029175, weight_update_time: 0.0796467736, other_time: 2.1618385315
epoch time: 6.1271691322s, input_fired_time: 0.1412234753, output_fired_time: 0.0000000000, propagate_forward_time: 5.6078920364, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3780536652
validation[          , genome  6614] predictions:    9686/  10000 (96.86%), best:    9708/10000 (97.08%), error:      1081.94751, best error:       988.64935 on epoch:    20, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 72.9533920288s, input_fired_time: 1.3179525137, output_fired_time: 0.8727629185, propagate_forward_time: 28.3003787994, propagate_backward_time: 40.2959175110, weight_update_time: 0.0807609186, other_time: 2.1663780212
epoch time: 6.2114081383s, input_fired_time: 0.1435166001, output_fired_time: 0.0000000000, propagate_forward_time: 5.6732335091, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3946580887
validation[          , genome  6614] predictions:    9697/  10000 (96.97%), best:    9708/10000 (97.08%), error:      1097.58350, best error:       988.64935 on epoch:    20, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 73.3348617554s, input_fired_time: 1.3026807308, output_fired_time: 0.8780044317, propagate_forward_time: 28.4281253815, propagate_backward_time: 40.5266151428, weight_update_time: 0.0802329779, other_time: 2.1994361877
epoch time: 6.1375274658s, input_fired_time: 0.1425548196, output_fired_time: 0.0000000000, propagate_forward_time: 5.6139001846, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3810725212
validation[          , genome  6614] predictions:    9695/  10000 (96.95%), best:    9695/10000 (96.95%), error:       985.54730, best error:       985.54730 on epoch:    24, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 73.1512527466s, input_fired_time: 1.3011279106, output_fired_time: 0.8736712337, propagate_forward_time: 28.3402671814, propagate_backward_time: 40.4322128296, weight_update_time: 0.0958399922, other_time: 2.2039756775
epoch time: 6.1323108673s, input_fired_time: 0.1450118124, output_fired_time: 0.0000000000, propagate_forward_time: 5.6078314781, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3794674873
validation[          , genome  6614] predictions:    9700/  10000 (97.00%), best:    9695/10000 (96.95%), error:      1024.50159, best error:       985.54730 on epoch:    24, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 72.4237060547s, input_fired_time: 1.2857811451, output_fired_time: 0.8694474101, propagate_forward_time: 28.0923538208, propagate_backward_time: 40.0173339844, weight_update_time: 0.0795376450, other_time: 2.1587905884
epoch time: 6.1276054382s, input_fired_time: 0.1438808888, output_fired_time: 0.0000000000, propagate_forward_time: 5.6039447784, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3797798157
validation[          , genome  6614] predictions:    9704/  10000 (97.04%), best:    9704/10000 (97.04%), error:       947.33698, best error:       947.33698 on epoch:    26, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 73.0227203369s, input_fired_time: 1.3001309633, output_fired_time: 0.8753041029, propagate_forward_time: 28.3204689026, propagate_backward_time: 40.2919158936, weight_update_time: 0.1011918634, other_time: 2.2348976135
epoch time: 6.3057155609s, input_fired_time: 0.1495577693, output_fired_time: 0.0000000000, propagate_forward_time: 5.7462916374, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4098663330
validation[          , genome  6614] predictions:    9693/  10000 (96.93%), best:    9704/10000 (97.04%), error:      1039.93652, best error:       947.33698 on epoch:    26, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 73.1611328125s, input_fired_time: 1.3208234310, output_fired_time: 0.8756223917, propagate_forward_time: 28.3812999725, propagate_backward_time: 40.3842811584, weight_update_time: 0.0803593099, other_time: 2.1991004944
epoch time: 6.1623926163s, input_fired_time: 0.1440045983, output_fired_time: 0.0000000000, propagate_forward_time: 5.6346092224, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3837785721
validation[          , genome  6614] predictions:    9686/  10000 (96.86%), best:    9704/10000 (97.04%), error:      1086.07605, best error:       947.33698 on epoch:    26, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 72.8572769165s, input_fired_time: 1.3108544350, output_fired_time: 0.8690752387, propagate_forward_time: 28.2904701233, propagate_backward_time: 40.2415809631, weight_update_time: 0.0795717761, other_time: 2.1453018188
epoch time: 6.1454224586s, input_fired_time: 0.1444668025, output_fired_time: 0.0000000000, propagate_forward_time: 5.6168723106, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3840832710
validation[          , genome  6614] predictions:    9679/  10000 (96.79%), best:    9704/10000 (97.04%), error:      1086.87524, best error:       947.33698 on epoch:    26, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 73.8483581543s, input_fired_time: 1.3262934685, output_fired_time: 0.8852694631, propagate_forward_time: 28.6117801666, propagate_backward_time: 40.7671432495, weight_update_time: 0.0806715712, other_time: 2.2578735352
epoch time: 6.3059616089s, input_fired_time: 0.1573051661, output_fired_time: 0.0000000000, propagate_forward_time: 5.7509632111, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3976931572
validation[          , genome  6614] predictions:    9708/  10000 (97.08%), best:    9704/10000 (97.04%), error:       982.96350, best error:       947.33698 on epoch:    26, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 73.4053878784s, input_fired_time: 1.3058972359, output_fired_time: 0.8840605617, propagate_forward_time: 28.4969100952, propagate_backward_time: 40.5334320068, weight_update_time: 0.0805022866, other_time: 2.1850814819
epoch time: 6.1671700478s, input_fired_time: 0.1449336112, output_fired_time: 0.0000000000, propagate_forward_time: 5.6386203766, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3836159706
validation[          , genome  6614] predictions:    9646/  10000 (96.46%), best:    9704/10000 (97.04%), error:      1204.53796, best error:       947.33698 on epoch:    26, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 72.3755035400s, input_fired_time: 1.2849838734, output_fired_time: 0.8677057028, propagate_forward_time: 28.0494689941, propagate_backward_time: 40.0344161987, weight_update_time: 0.0796760619, other_time: 2.1389312744
epoch time: 6.1503043175s, input_fired_time: 0.1434145421, output_fired_time: 0.0000000000, propagate_forward_time: 5.6252532005, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3816366196
validation[          , genome  6614] predictions:    9708/  10000 (97.08%), best:    9704/10000 (97.04%), error:      1005.24335, best error:       947.33698 on epoch:    26, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 72.7637405396s, input_fired_time: 1.2998024225, output_fired_time: 0.8797021508, propagate_forward_time: 28.2115688324, propagate_backward_time: 40.2124214172, weight_update_time: 0.0799747929, other_time: 2.1602439880
epoch time: 6.2199010849s, input_fired_time: 0.1548548043, output_fired_time: 0.0000000000, propagate_forward_time: 5.6780471802, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3869991302
validation[          , genome  6614] predictions:    9708/  10000 (97.08%), best:    9704/10000 (97.04%), error:       983.00110, best error:       947.33698 on epoch:    26, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 72.9192810059s, input_fired_time: 1.3032599688, output_fired_time: 0.8684195280, propagate_forward_time: 28.2734069824, propagate_backward_time: 40.3276329041, weight_update_time: 0.0786319748, other_time: 2.1465644836
epoch time: 6.1820478439s, input_fired_time: 0.1442293078, output_fired_time: 0.0000000000, propagate_forward_time: 5.6573266983, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3804917336
validation[          , genome  6614] predictions:    9733/  10000 (97.33%), best:    9733/10000 (97.33%), error:       899.07007, best error:       899.07007 on epoch:    34, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 73.0047531128s, input_fired_time: 1.3028854132, output_fired_time: 0.8741083145, propagate_forward_time: 28.3204078674, propagate_backward_time: 40.3484153748, weight_update_time: 0.0762504861, other_time: 2.1589355469
epoch time: 6.1209058762s, input_fired_time: 0.1445019245, output_fired_time: 0.0000000000, propagate_forward_time: 5.5993151665, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3770890236
validation[          , genome  6614] predictions:    9712/  10000 (97.12%), best:    9733/10000 (97.33%), error:       938.32184, best error:       899.07007 on epoch:    34, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 73.0397415161s, input_fired_time: 1.2942161560, output_fired_time: 0.8707129955, propagate_forward_time: 28.4033145905, propagate_backward_time: 40.3373603821, weight_update_time: 0.0771740824, other_time: 2.1341438293
epoch time: 6.2306590080s, input_fired_time: 0.1441591978, output_fired_time: 0.0000000000, propagate_forward_time: 5.7069311142, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3795685768
validation[          , genome  6614] predictions:    9720/  10000 (97.20%), best:    9733/10000 (97.33%), error:       905.36926, best error:       899.07007 on epoch:    34, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 72.5890197754s, input_fired_time: 1.3096594810, output_fired_time: 0.8689194918, propagate_forward_time: 28.1377315521, propagate_backward_time: 40.1070327759, weight_update_time: 0.0794317499, other_time: 2.1656723022
epoch time: 6.1434955597s, input_fired_time: 0.1449077278, output_fired_time: 0.0000000000, propagate_forward_time: 5.6196632385, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3789243698
validation[          , genome  6614] predictions:    9694/  10000 (96.94%), best:    9733/10000 (97.33%), error:      1077.56299, best error:       899.07007 on epoch:    34, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 72.9691085815s, input_fired_time: 1.3104968071, output_fired_time: 0.8694316745, propagate_forward_time: 28.2926540375, propagate_backward_time: 40.3449554443, weight_update_time: 0.0791136175, other_time: 2.1515731812
epoch time: 6.1152296066s, input_fired_time: 0.1421773434, output_fired_time: 0.0000000000, propagate_forward_time: 5.5980134010, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3750386238
validation[          , genome  6614] predictions:    9740/  10000 (97.40%), best:    9740/10000 (97.40%), error:       861.27118, best error:       861.27118 on epoch:    38, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 73.3061904907s, input_fired_time: 1.3058651686, output_fired_time: 0.8751010895, propagate_forward_time: 28.4555358887, propagate_backward_time: 40.5069046021, weight_update_time: 0.0781698823, other_time: 2.1627883911
epoch time: 6.1734113693s, input_fired_time: 0.1443375498, output_fired_time: 0.0000000000, propagate_forward_time: 5.6513586044, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3777151108
validation[          , genome  6614] predictions:    9706/  10000 (97.06%), best:    9740/10000 (97.40%), error:       986.50696, best error:       861.27118 on epoch:    38, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 73.0437240601s, input_fired_time: 1.3009533882, output_fired_time: 0.8700097799, propagate_forward_time: 28.3657321930, propagate_backward_time: 40.3745727539, weight_update_time: 0.0759247690, other_time: 2.1324539185
epoch time: 6.3219652176s, input_fired_time: 0.1465346366, output_fired_time: 0.0000000000, propagate_forward_time: 5.7893586159, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3860721588
validation[          , genome  6614] predictions:    9647/  10000 (96.47%), best:    9740/10000 (97.40%), error:      1092.49890, best error:       861.27118 on epoch:    38, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 72.6430053711s, input_fired_time: 1.2998105288, output_fired_time: 0.8706166148, propagate_forward_time: 28.1665954590, propagate_backward_time: 40.1791381836, weight_update_time: 0.0778270140, other_time: 2.1268463135
epoch time: 6.1584091187s, input_fired_time: 0.1469455659, output_fired_time: 0.0000000000, propagate_forward_time: 5.6298551559, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3816084862
validation[          , genome  6614] predictions:    9725/  10000 (97.25%), best:    9740/10000 (97.40%), error:       907.13409, best error:       861.27118 on epoch:    38, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 73.0376434326s, input_fired_time: 1.3049359322, output_fired_time: 0.8712291121, propagate_forward_time: 28.3544826508, propagate_backward_time: 40.3681640625, weight_update_time: 0.0781423375, other_time: 2.1388244629
epoch time: 6.1431612968s, input_fired_time: 0.1438166499, output_fired_time: 0.0000000000, propagate_forward_time: 5.6191072464, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3802375793
validation[          , genome  6614] predictions:    9657/  10000 (96.57%), best:    9740/10000 (97.40%), error:      1108.40002, best error:       861.27118 on epoch:    38, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 73.0486831665s, input_fired_time: 1.3384556770, output_fired_time: 0.8718242645, propagate_forward_time: 28.2694416046, propagate_backward_time: 40.4430541992, weight_update_time: 0.0770474598, other_time: 2.1259078979
epoch time: 6.1696467400s, input_fired_time: 0.1463795006, output_fired_time: 0.0000000000, propagate_forward_time: 5.6450338364, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3782334328
validation[          , genome  6614] predictions:    9663/  10000 (96.63%), best:    9740/10000 (97.40%), error:      1096.78027, best error:       861.27118 on epoch:    38, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 72.9787139893s, input_fired_time: 1.3149411678, output_fired_time: 0.8721919656, propagate_forward_time: 28.3090991974, propagate_backward_time: 40.3352203369, weight_update_time: 0.0781156793, other_time: 2.1472625732
epoch time: 6.2195777893s, input_fired_time: 0.1498358548, output_fired_time: 0.0000000000, propagate_forward_time: 5.6853466034, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3843951225
validation[          , genome  6614] predictions:    9723/  10000 (97.23%), best:    9740/10000 (97.40%), error:       916.83746, best error:       861.27118 on epoch:    38, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 73.1356964111s, input_fired_time: 1.2992002964, output_fired_time: 0.8706349730, propagate_forward_time: 28.3371772766, propagate_backward_time: 40.4376716614, weight_update_time: 0.0774784461, other_time: 2.1910095215
epoch time: 6.1956539154s, input_fired_time: 0.1456837058, output_fired_time: 0.0000000000, propagate_forward_time: 5.6695351601, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3804349899
validation[          , genome  6614] predictions:    9702/  10000 (97.02%), best:    9740/10000 (97.40%), error:       984.41431, best error:       861.27118 on epoch:    38, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 72.8214797974s, input_fired_time: 1.3131349087, output_fired_time: 0.8701257110, propagate_forward_time: 28.2378768921, propagate_backward_time: 40.2337532043, weight_update_time: 0.0796075985, other_time: 2.1665916443
epoch time: 6.2193970680s, input_fired_time: 0.1434549838, output_fired_time: 0.0000000000, propagate_forward_time: 5.6933050156, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3826370239
validation[          , genome  6614] predictions:    9702/  10000 (97.02%), best:    9740/10000 (97.40%), error:       983.81012, best error:       861.27118 on epoch:    38, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 73.0746612549s, input_fired_time: 1.2967330217, output_fired_time: 0.8711526394, propagate_forward_time: 28.3700942993, propagate_backward_time: 40.4044113159, weight_update_time: 0.0765389204, other_time: 2.1322708130
epoch time: 6.1306781769s, input_fired_time: 0.1414077580, output_fired_time: 0.0000000000, propagate_forward_time: 5.6111345291, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3781356812
validation[          , genome  6614] predictions:    8947/  10000 (89.47%), best:    9740/10000 (97.40%), error:      4183.18066, best error:       861.27118 on epoch:    38, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

resetting weights to those on epoch: 38
epoch time: 73.2862243652s, input_fired_time: 1.3287020922, output_fired_time: 0.8729140759, propagate_forward_time: 28.4385719299, propagate_backward_time: 40.4267311096, weight_update_time: 0.1088795736, other_time: 2.2192993164
epoch time: 6.2063984871s, input_fired_time: 0.1431677788, output_fired_time: 0.0000000000, propagate_forward_time: 5.6776585579, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3855719566
validation[          , genome  6614] predictions:    9705/  10000 (97.05%), best:    9740/10000 (97.40%), error:       964.13226, best error:       861.27118 on epoch:    38, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 73.3320541382s, input_fired_time: 1.3076717854, output_fired_time: 0.8738301396, propagate_forward_time: 28.4327564240, propagate_backward_time: 40.5541496277, weight_update_time: 0.0777909607, other_time: 2.1636466980
epoch time: 6.1769504547s, input_fired_time: 0.1464481503, output_fired_time: 0.0000000000, propagate_forward_time: 5.6466913223, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3838109970
validation[          , genome  6614] predictions:    9713/  10000 (97.13%), best:    9740/10000 (97.40%), error:       946.14697, best error:       861.27118 on epoch:    38, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 73.2908782959s, input_fired_time: 1.3350940943, output_fired_time: 0.8747499585, propagate_forward_time: 28.4443035126, propagate_backward_time: 40.4845695496, weight_update_time: 0.0771079138, other_time: 2.1521644592
epoch time: 6.1491470337s, input_fired_time: 0.1423999071, output_fired_time: 0.0000000000, propagate_forward_time: 5.6273307800, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3794164658
validation[          , genome  6614] predictions:    9732/  10000 (97.32%), best:    9740/10000 (97.40%), error:       912.40277, best error:       861.27118 on epoch:    38, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 72.8998184204s, input_fired_time: 1.2996425629, output_fired_time: 0.8693714738, propagate_forward_time: 28.2479438782, propagate_backward_time: 40.3364562988, weight_update_time: 0.0776230991, other_time: 2.1464042664
epoch time: 6.1247820854s, input_fired_time: 0.1428045928, output_fired_time: 0.0000000000, propagate_forward_time: 5.6034269333, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3785505295
validation[          , genome  6614] predictions:    9724/  10000 (97.24%), best:    9740/10000 (97.40%), error:       953.27271, best error:       861.27118 on epoch:    38, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 72.8918075562s, input_fired_time: 1.3577516079, output_fired_time: 0.8672213554, propagate_forward_time: 28.3659267426, propagate_backward_time: 40.1498107910, weight_update_time: 0.0794562846, other_time: 2.1511001587
epoch time: 6.1659665108s, input_fired_time: 0.1449306011, output_fired_time: 0.0000000000, propagate_forward_time: 5.6415772438, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3794589043
validation[          , genome  6614] predictions:    9723/  10000 (97.23%), best:    9740/10000 (97.40%), error:       900.64270, best error:       861.27118 on epoch:    38, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 73.3150558472s, input_fired_time: 1.3113981485, output_fired_time: 0.8710553646, propagate_forward_time: 28.4860706329, propagate_backward_time: 40.4874343872, weight_update_time: 0.0760927275, other_time: 2.1590957642
epoch time: 6.2289333344s, input_fired_time: 0.1779908240, output_fired_time: 0.0000000000, propagate_forward_time: 5.6731481552, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3777942657
validation[          , genome  6614] predictions:    9722/  10000 (97.22%), best:    9740/10000 (97.40%), error:       894.41321, best error:       861.27118 on epoch:    38, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 73.3169860840s, input_fired_time: 1.3167227507, output_fired_time: 0.8743953109, propagate_forward_time: 28.4566364288, propagate_backward_time: 40.5276794434, weight_update_time: 0.0762589425, other_time: 2.1415557861
epoch time: 6.1847763062s, input_fired_time: 0.1426508874, output_fired_time: 0.0000000000, propagate_forward_time: 5.6605358124, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3815894127
validation[          , genome  6614] predictions:    9669/  10000 (96.69%), best:    9740/10000 (97.40%), error:      1047.07227, best error:       861.27118 on epoch:    38, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 72.9384918213s, input_fired_time: 1.3055474758, output_fired_time: 0.8816564679, propagate_forward_time: 28.3469142914, propagate_backward_time: 40.2591133118, weight_update_time: 0.0780897290, other_time: 2.1452598572
epoch time: 6.1300201416s, input_fired_time: 0.1429777145, output_fired_time: 0.0000000000, propagate_forward_time: 5.6099710464, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3770713806
validation[          , genome  6614] predictions:    9751/  10000 (97.51%), best:    9751/10000 (97.51%), error:       842.18695, best error:       842.18695 on epoch:    55, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 72.9860763550s, input_fired_time: 1.2928149700, output_fired_time: 0.8783158660, propagate_forward_time: 28.3425407410, propagate_backward_time: 40.3514900208, weight_update_time: 0.0759570599, other_time: 2.1209106445
epoch time: 6.1673212051s, input_fired_time: 0.1451920569, output_fired_time: 0.0000000000, propagate_forward_time: 5.6453013420, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3768277168
validation[          , genome  6614] predictions:    9711/  10000 (97.11%), best:    9751/10000 (97.51%), error:       929.08228, best error:       842.18695 on epoch:    55, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 72.7902145386s, input_fired_time: 1.3200674057, output_fired_time: 0.8805307150, propagate_forward_time: 28.2417869568, propagate_backward_time: 40.1889343262, weight_update_time: 0.0799084380, other_time: 2.1588935852
epoch time: 6.1336355209s, input_fired_time: 0.1474820226, output_fired_time: 0.0000000000, propagate_forward_time: 5.6077198982, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3784337044
validation[          , genome  6614] predictions:    9736/  10000 (97.36%), best:    9751/10000 (97.51%), error:       898.56000, best error:       842.18695 on epoch:    55, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 72.8987197876s, input_fired_time: 1.3043824434, output_fired_time: 0.8787819743, propagate_forward_time: 28.2321929932, propagate_backward_time: 40.3274612427, weight_update_time: 0.0788591057, other_time: 2.1558990479
epoch time: 6.2219824791s, input_fired_time: 0.1442081332, output_fired_time: 0.0000000000, propagate_forward_time: 5.6665782928, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4111962318
validation[          , genome  6614] predictions:    9688/  10000 (96.88%), best:    9751/10000 (97.51%), error:      1013.61859, best error:       842.18695 on epoch:    55, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 72.9631271362s, input_fired_time: 1.2999200821, output_fired_time: 0.8721563816, propagate_forward_time: 28.3471736908, propagate_backward_time: 40.3109703064, weight_update_time: 0.0766030103, other_time: 2.1329078674
epoch time: 6.1722955704s, input_fired_time: 0.1447230875, output_fired_time: 0.0000000000, propagate_forward_time: 5.6476936340, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3798789978
validation[          , genome  6614] predictions:    9683/  10000 (96.83%), best:    9751/10000 (97.51%), error:      1075.93799, best error:       842.18695 on epoch:    55, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 73.1951599121s, input_fired_time: 1.3197499514, output_fired_time: 0.8812140822, propagate_forward_time: 28.4265270233, propagate_backward_time: 40.3944168091, weight_update_time: 0.0800371319, other_time: 2.1732559204
epoch time: 6.2770981789s, input_fired_time: 0.1454803795, output_fired_time: 0.0000000000, propagate_forward_time: 5.7377295494, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3938884735
validation[          , genome  6614] predictions:    9669/  10000 (96.69%), best:    9751/10000 (97.51%), error:      1054.32568, best error:       842.18695 on epoch:    55, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 72.9264144897s, input_fired_time: 1.2887187004, output_fired_time: 0.8701846004, propagate_forward_time: 28.2475433350, propagate_backward_time: 40.3937492371, weight_update_time: 0.0755228847, other_time: 2.1262168884
epoch time: 6.1534223557s, input_fired_time: 0.1433846653, output_fired_time: 0.0000000000, propagate_forward_time: 5.6349024773, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3751354218
validation[          , genome  6614] predictions:    9663/  10000 (96.63%), best:    9751/10000 (97.51%), error:      1088.58276, best error:       842.18695 on epoch:    55, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 72.8502807617s, input_fired_time: 1.3087946177, output_fired_time: 0.8683349490, propagate_forward_time: 28.1604671478, propagate_backward_time: 40.3541755676, weight_update_time: 0.0787601918, other_time: 2.1585121155
epoch time: 6.1861596107s, input_fired_time: 0.1472194493, output_fired_time: 0.0000000000, propagate_forward_time: 5.6514945030, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3874454498
validation[          , genome  6614] predictions:    9717/  10000 (97.17%), best:    9751/10000 (97.51%), error:       895.50073, best error:       842.18695 on epoch:    55, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 72.9207458496s, input_fired_time: 1.3227453232, output_fired_time: 0.8718562722, propagate_forward_time: 28.3214492798, propagate_backward_time: 40.2360916138, weight_update_time: 0.0800862163, other_time: 2.1686019897
epoch time: 6.1937437057s, input_fired_time: 0.1432491392, output_fired_time: 0.0000000000, propagate_forward_time: 5.6744670868, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3760275841
validation[          , genome  6614] predictions:    9724/  10000 (97.24%), best:    9751/10000 (97.51%), error:       902.83417, best error:       842.18695 on epoch:    55, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 72.8744354248s, input_fired_time: 1.2928942442, output_fired_time: 0.8698962927, propagate_forward_time: 28.2916011810, propagate_backward_time: 40.2588157654, weight_update_time: 0.0764518902, other_time: 2.1612281799
epoch time: 6.1530423164s, input_fired_time: 0.1427266449, output_fired_time: 0.0000000000, propagate_forward_time: 5.6351380348, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3751778603
validation[          , genome  6614] predictions:    9717/  10000 (97.17%), best:    9751/10000 (97.51%), error:       923.39362, best error:       842.18695 on epoch:    55, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 73.0238571167s, input_fired_time: 1.3027409315, output_fired_time: 0.8829160333, propagate_forward_time: 28.3206634521, propagate_backward_time: 40.3865089417, weight_update_time: 0.0764491186, other_time: 2.1310234070
epoch time: 6.1250414848s, input_fired_time: 0.1432687789, output_fired_time: 0.0000000000, propagate_forward_time: 5.6077389717, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3740339279
validation[          , genome  6614] predictions:    9706/  10000 (97.06%), best:    9751/10000 (97.51%), error:       941.25983, best error:       842.18695 on epoch:    55, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 73.0492630005s, input_fired_time: 1.3001288176, output_fired_time: 0.8723315001, propagate_forward_time: 28.3094615936, propagate_backward_time: 40.4109191895, weight_update_time: 0.0770214126, other_time: 2.1564254761
epoch time: 6.1875495911s, input_fired_time: 0.1472250521, output_fired_time: 0.0000000000, propagate_forward_time: 5.6516542435, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3886704445
validation[          , genome  6614] predictions:    9758/  10000 (97.58%), best:    9758/10000 (97.58%), error:       795.25671, best error:       795.25671 on epoch:    66, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 72.8154373169s, input_fired_time: 1.3098975420, output_fired_time: 0.8695370555, propagate_forward_time: 28.2642593384, propagate_backward_time: 40.2356605530, weight_update_time: 0.0782858357, other_time: 2.1360816956
epoch time: 6.1908459663s, input_fired_time: 0.1491112560, output_fired_time: 0.0000000000, propagate_forward_time: 5.6535835266, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3881511688
validation[          , genome  6614] predictions:    9698/  10000 (96.98%), best:    9758/10000 (97.58%), error:       936.94128, best error:       795.25671 on epoch:    66, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 73.4873046875s, input_fired_time: 1.3111705780, output_fired_time: 0.8764420152, propagate_forward_time: 28.4967708588, propagate_backward_time: 40.6390075684, weight_update_time: 0.0779763535, other_time: 2.1639099121
epoch time: 6.2370829582s, input_fired_time: 0.1465299875, output_fired_time: 0.0000000000, propagate_forward_time: 5.7013459206, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3892068863
validation[          , genome  6614] predictions:    9724/  10000 (97.24%), best:    9758/10000 (97.58%), error:       950.21631, best error:       795.25671 on epoch:    66, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 72.9596099854s, input_fired_time: 1.3234306574, output_fired_time: 0.8751133084, propagate_forward_time: 28.3319759369, propagate_backward_time: 40.2720565796, weight_update_time: 0.0789790303, other_time: 2.1570281982
epoch time: 6.1544737816s, input_fired_time: 0.1471974105, output_fired_time: 0.0000000000, propagate_forward_time: 5.6249074936, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3823690414
validation[          , genome  6614] predictions:    9727/  10000 (97.27%), best:    9758/10000 (97.58%), error:       872.60278, best error:       795.25671 on epoch:    66, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 72.7445449829s, input_fired_time: 1.3112183809, output_fired_time: 0.8711703420, propagate_forward_time: 28.1618156433, propagate_backward_time: 40.2479248047, weight_update_time: 0.0796903595, other_time: 2.1524162292
epoch time: 6.1523165703s, input_fired_time: 0.1451501846, output_fired_time: 0.0000000000, propagate_forward_time: 5.6270661354, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3801002502
validation[          , genome  6614] predictions:    9673/  10000 (96.73%), best:    9758/10000 (97.58%), error:      1093.04810, best error:       795.25671 on epoch:    66, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 73.0881271362s, input_fired_time: 1.3011838198, output_fired_time: 0.8747797012, propagate_forward_time: 28.3545093536, propagate_backward_time: 40.3964080811, weight_update_time: 0.0774464905, other_time: 2.1612472534
epoch time: 6.1753802299s, input_fired_time: 0.1518517733, output_fired_time: 0.0000000000, propagate_forward_time: 5.6491274834, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3744010925
validation[          , genome  6614] predictions:    9694/  10000 (96.94%), best:    9758/10000 (97.58%), error:      1012.18689, best error:       795.25671 on epoch:    66, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 73.5805435181s, input_fired_time: 1.3365931511, output_fired_time: 0.8730649352, propagate_forward_time: 28.5507469177, propagate_backward_time: 40.6535110474, weight_update_time: 0.0779749677, other_time: 2.1666297913
epoch time: 6.1204195023s, input_fired_time: 0.1463101208, output_fired_time: 0.0000000000, propagate_forward_time: 5.5983285904, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3757805824
validation[          , genome  6614] predictions:    9720/  10000 (97.20%), best:    9758/10000 (97.58%), error:       948.55933, best error:       795.25671 on epoch:    66, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 73.0032424927s, input_fired_time: 1.3086289167, output_fired_time: 0.8679143786, propagate_forward_time: 28.2904567719, propagate_backward_time: 40.3930320740, weight_update_time: 0.0783412308, other_time: 2.1432075500
epoch time: 6.2359795570s, input_fired_time: 0.1453175694, output_fired_time: 0.0000000000, propagate_forward_time: 5.7010984421, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3895635605
validation[          , genome  6614] predictions:    9754/  10000 (97.54%), best:    9758/10000 (97.58%), error:       831.68396, best error:       795.25671 on epoch:    66, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 72.9640197754s, input_fired_time: 1.2949564457, output_fired_time: 0.8697615266, propagate_forward_time: 28.2497863770, propagate_backward_time: 40.3962707520, weight_update_time: 0.0767675713, other_time: 2.1532440186
epoch time: 6.1733441353s, input_fired_time: 0.1413819641, output_fired_time: 0.0000000000, propagate_forward_time: 5.6562061310, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3757562637
validation[          , genome  6614] predictions:    9658/  10000 (96.58%), best:    9758/10000 (97.58%), error:      1104.84351, best error:       795.25671 on epoch:    66, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 73.6558151245s, input_fired_time: 1.3062222004, output_fired_time: 0.8892785907, propagate_forward_time: 28.5357780457, propagate_backward_time: 40.7210693359, weight_update_time: 0.0787628293, other_time: 2.2034645081
epoch time: 6.3138942719s, input_fired_time: 0.1471404880, output_fired_time: 0.0000000000, propagate_forward_time: 5.7736225128, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3931312561
validation[          , genome  6614] predictions:    9707/  10000 (97.07%), best:    9758/10000 (97.58%), error:       955.94989, best error:       795.25671 on epoch:    66, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 74.7899703979s, input_fired_time: 1.3205666542, output_fired_time: 0.8890098929, propagate_forward_time: 28.9136734009, propagate_backward_time: 41.4402961731, weight_update_time: 0.0774238408, other_time: 2.2264289856
epoch time: 6.1278619766s, input_fired_time: 0.1423550099, output_fired_time: 0.0000000000, propagate_forward_time: 5.6075854301, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3779215813
validation[          , genome  6614] predictions:    9729/  10000 (97.29%), best:    9758/10000 (97.58%), error:       853.44757, best error:       795.25671 on epoch:    66, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 73.0848159790s, input_fired_time: 1.3062108755, output_fired_time: 0.8754097819, propagate_forward_time: 28.3014297485, propagate_backward_time: 40.4348716736, weight_update_time: 0.0788333938, other_time: 2.1668891907
epoch time: 6.2208061218s, input_fired_time: 0.1449094415, output_fired_time: 0.0000000000, propagate_forward_time: 5.6903748512, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3855218887
validation[          , genome  6614] predictions:    9733/  10000 (97.33%), best:    9758/10000 (97.58%), error:       866.58569, best error:       795.25671 on epoch:    66, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 73.1971359253s, input_fired_time: 1.3087035418, output_fired_time: 0.9283452034, propagate_forward_time: 28.3910560608, propagate_backward_time: 40.4165344238, weight_update_time: 0.0777595565, other_time: 2.1525001526
epoch time: 6.1382412910s, input_fired_time: 0.1460216343, output_fired_time: 0.0000000000, propagate_forward_time: 5.6118268967, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3803925514
validation[          , genome  6614] predictions:    9747/  10000 (97.47%), best:    9758/10000 (97.58%), error:       869.21045, best error:       795.25671 on epoch:    66, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 73.2148895264s, input_fired_time: 1.3041411638, output_fired_time: 0.8700163364, propagate_forward_time: 28.3634681702, propagate_backward_time: 40.5281562805, weight_update_time: 0.0785216987, other_time: 2.1491088867
epoch time: 6.1635041237s, input_fired_time: 0.1458189189, output_fired_time: 0.0000000000, propagate_forward_time: 5.6385798454, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3791055679
validation[          , genome  6614] predictions:    9738/  10000 (97.38%), best:    9758/10000 (97.58%), error:       859.26013, best error:       795.25671 on epoch:    66, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 72.9897842407s, input_fired_time: 1.3055952787, output_fired_time: 0.8750258684, propagate_forward_time: 28.2958889008, propagate_backward_time: 40.3708114624, weight_update_time: 0.0783568099, other_time: 2.1424636841
epoch time: 6.2438120842s, input_fired_time: 0.1462124288, output_fired_time: 0.0000000000, propagate_forward_time: 5.7048783302, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3927211761
validation[          , genome  6614] predictions:    9722/  10000 (97.22%), best:    9758/10000 (97.58%), error:       951.78644, best error:       795.25671 on epoch:    66, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 73.0367736816s, input_fired_time: 1.2979729176, output_fired_time: 0.8724110723, propagate_forward_time: 28.3223571777, propagate_backward_time: 40.3812789917, weight_update_time: 0.0771013722, other_time: 2.1627502441
epoch time: 6.1210575104s, input_fired_time: 0.1435454041, output_fired_time: 0.0000000000, propagate_forward_time: 5.6015119553, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3759999275
validation[          , genome  6614] predictions:    9739/  10000 (97.39%), best:    9758/10000 (97.58%), error:       887.58972, best error:       795.25671 on epoch:    66, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 73.8135986328s, input_fired_time: 1.3319060802, output_fired_time: 0.8836147785, propagate_forward_time: 28.5812683105, propagate_backward_time: 40.7912635803, weight_update_time: 0.0792481229, other_time: 2.2255439758
epoch time: 6.1924519539s, input_fired_time: 0.1450145543, output_fired_time: 0.0000000000, propagate_forward_time: 5.6677613258, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3796758652
validation[          , genome  6614] predictions:    9731/  10000 (97.31%), best:    9758/10000 (97.58%), error:       858.43774, best error:       795.25671 on epoch:    66, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 73.1562652588s, input_fired_time: 1.3097815514, output_fired_time: 0.8840530515, propagate_forward_time: 28.3573665619, propagate_backward_time: 40.4118766785, weight_update_time: 0.0787027031, other_time: 2.1931800842
epoch time: 6.4967827797s, input_fired_time: 0.1471711993, output_fired_time: 0.0000000000, propagate_forward_time: 5.9177398682, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4318718910
validation[          , genome  6614] predictions:    9714/  10000 (97.14%), best:    9758/10000 (97.58%), error:       915.73370, best error:       795.25671 on epoch:    66, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 73.5757827759s, input_fired_time: 1.3072084188, output_fired_time: 0.8831239939, propagate_forward_time: 28.4716873169, propagate_backward_time: 40.7471122742, weight_update_time: 0.0760141462, other_time: 2.1666526794
epoch time: 6.1258063316s, input_fired_time: 0.1448171437, output_fired_time: 0.0000000000, propagate_forward_time: 5.6022362709, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3787527084
validation[          , genome  6614] predictions:    9710/  10000 (97.10%), best:    9758/10000 (97.58%), error:       916.37933, best error:       795.25671 on epoch:    66, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 73.5200500488s, input_fired_time: 1.3017423153, output_fired_time: 0.8751726151, propagate_forward_time: 28.4949645996, propagate_backward_time: 40.6434631348, weight_update_time: 0.0779666677, other_time: 2.2047042847
epoch time: 6.2036480904s, input_fired_time: 0.1420600861, output_fired_time: 0.0000000000, propagate_forward_time: 5.6819934845, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3795943260
validation[          , genome  6614] predictions:    9614/  10000 (96.14%), best:    9758/10000 (97.58%), error:      1432.34167, best error:       795.25671 on epoch:    66, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 73.2375259399s, input_fired_time: 1.3175091743, output_fired_time: 0.8830232620, propagate_forward_time: 28.4028320312, propagate_backward_time: 40.4754447937, weight_update_time: 0.0779406354, other_time: 2.1587104797
epoch time: 6.2867460251s, input_fired_time: 0.1475363225, output_fired_time: 0.0000000000, propagate_forward_time: 5.7328586578, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4063510895
validation[          , genome  6614] predictions:    9731/  10000 (97.31%), best:    9758/10000 (97.58%), error:       860.34216, best error:       795.25671 on epoch:    66, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 73.6650924683s, input_fired_time: 1.3094522953, output_fired_time: 0.8784644008, propagate_forward_time: 28.5452098846, propagate_backward_time: 40.7437477112, weight_update_time: 0.0761446729, other_time: 2.1882133484
epoch time: 6.3828454018s, input_fired_time: 0.1467035264, output_fired_time: 0.0000000000, propagate_forward_time: 5.8440184593, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3921232224
validation[          , genome  6614] predictions:    9714/  10000 (97.14%), best:    9758/10000 (97.58%), error:       905.30688, best error:       795.25671 on epoch:    66, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 74.3626556396s, input_fired_time: 1.3171836138, output_fired_time: 0.8835542202, propagate_forward_time: 28.8478240967, propagate_backward_time: 41.0974388123, weight_update_time: 0.0776951537, other_time: 2.2166557312
epoch time: 6.1236371994s, input_fired_time: 0.1445048898, output_fired_time: 0.0000000000, propagate_forward_time: 5.6000304222, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3791017532
validation[          , genome  6614] predictions:    9709/  10000 (97.09%), best:    9758/10000 (97.58%), error:      1019.53619, best error:       795.25671 on epoch:    66, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 73.2762298584s, input_fired_time: 1.3094246387, output_fired_time: 0.8723956347, propagate_forward_time: 28.4575195312, propagate_backward_time: 40.4645957947, weight_update_time: 0.0790273473, other_time: 2.1722908020
epoch time: 6.1204538345s, input_fired_time: 0.1447444111, output_fired_time: 0.0000000000, propagate_forward_time: 5.5996155739, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3760938644
validation[          , genome  6614] predictions:    9738/  10000 (97.38%), best:    9758/10000 (97.58%), error:       890.64221, best error:       795.25671 on epoch:    66, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 74.2984924316s, input_fired_time: 1.3186174631, output_fired_time: 0.8990163207, propagate_forward_time: 28.7916088104, propagate_backward_time: 41.0685653687, weight_update_time: 0.0767584294, other_time: 2.2206802368
epoch time: 6.1676416397s, input_fired_time: 0.1462685913, output_fired_time: 0.0000000000, propagate_forward_time: 5.6413941383, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3799791336
validation[          , genome  6614] predictions:    9742/  10000 (97.42%), best:    9758/10000 (97.58%), error:       879.75439, best error:       795.25671 on epoch:    66, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 73.6106643677s, input_fired_time: 1.3260190487, output_fired_time: 0.8799365759, propagate_forward_time: 28.4889373779, propagate_backward_time: 40.6975059509, weight_update_time: 0.0785180628, other_time: 2.2182655334
epoch time: 6.2442812920s, input_fired_time: 0.1493747383, output_fired_time: 0.0000000000, propagate_forward_time: 5.7010989189, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3938074112
validation[          , genome  6614] predictions:    9731/  10000 (97.31%), best:    9758/10000 (97.58%), error:       876.58032, best error:       795.25671 on epoch:    66, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 73.0443725586s, input_fired_time: 1.3143130541, output_fired_time: 0.8722835183, propagate_forward_time: 28.2666015625, propagate_backward_time: 40.4259185791, weight_update_time: 0.0794008747, other_time: 2.1652526855
epoch time: 6.2061209679s, input_fired_time: 0.1542496532, output_fired_time: 0.0000000000, propagate_forward_time: 5.6618556976, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3900156021
validation[          , genome  6614] predictions:    9726/  10000 (97.26%), best:    9758/10000 (97.58%), error:       942.10095, best error:       795.25671 on epoch:    66, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 73.0701904297s, input_fired_time: 1.3142396212, output_fired_time: 0.8727572560, propagate_forward_time: 28.3034458160, propagate_backward_time: 40.4360542297, weight_update_time: 0.0793597698, other_time: 2.1436958313
epoch time: 6.2502198219s, input_fired_time: 0.1445161104, output_fired_time: 0.0000000000, propagate_forward_time: 5.7053208351, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4003829956
validation[          , genome  6614] predictions:    9714/  10000 (97.14%), best:    9758/10000 (97.58%), error:       930.65729, best error:       795.25671 on epoch:    66, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 72.9798965454s, input_fired_time: 1.3088899851, output_fired_time: 0.8735286593, propagate_forward_time: 28.3109302521, propagate_backward_time: 40.3332710266, weight_update_time: 0.0784187391, other_time: 2.1532783508
epoch time: 6.1797671318s, input_fired_time: 0.1460423321, output_fired_time: 0.0000000000, propagate_forward_time: 5.6525120735, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3812127113
validation[          , genome  6614] predictions:    9748/  10000 (97.48%), best:    9758/10000 (97.58%), error:       853.85144, best error:       795.25671 on epoch:    66, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 73.2669601440s, input_fired_time: 1.3157725334, output_fired_time: 0.8743488789, propagate_forward_time: 28.4150390625, propagate_backward_time: 40.5141448975, weight_update_time: 0.0770118237, other_time: 2.1476516724
epoch time: 6.3012108803s, input_fired_time: 0.1522630751, output_fired_time: 0.0000000000, propagate_forward_time: 5.7512893677, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3976583481
validation[          , genome  6614] predictions:    9738/  10000 (97.38%), best:    9758/10000 (97.58%), error:       861.57086, best error:       795.25671 on epoch:    66, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 72.8424453735s, input_fired_time: 1.3230375051, output_fired_time: 0.8687318563, propagate_forward_time: 28.3141479492, propagate_backward_time: 40.1759071350, weight_update_time: 0.0873666629, other_time: 2.1606254578
epoch time: 6.1351809502s, input_fired_time: 0.1450109780, output_fired_time: 0.0000000000, propagate_forward_time: 5.6105413437, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3796286583
validation[          , genome  6614] predictions:    9718/  10000 (97.18%), best:    9758/10000 (97.58%), error:       971.34015, best error:       795.25671 on epoch:    66, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 72.8907012939s, input_fired_time: 1.3045614958, output_fired_time: 0.8682689667, propagate_forward_time: 28.3170871735, propagate_backward_time: 40.2812271118, weight_update_time: 0.0783770084, other_time: 2.1195602417
epoch time: 6.1576700211s, input_fired_time: 0.1465057135, output_fired_time: 0.0000000000, propagate_forward_time: 5.6339492798, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3772149086
validation[          , genome  6614] predictions:    9729/  10000 (97.29%), best:    9758/10000 (97.58%), error:       905.87476, best error:       795.25671 on epoch:    66, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 73.1082687378s, input_fired_time: 1.3066611290, output_fired_time: 0.8717892170, propagate_forward_time: 28.3555870056, propagate_backward_time: 40.4495582581, weight_update_time: 0.0773332268, other_time: 2.1246719360
epoch time: 6.1559128761s, input_fired_time: 0.1471146047, output_fired_time: 0.0000000000, propagate_forward_time: 5.6253504753, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3834476471
validation[          , genome  6614] predictions:    9705/  10000 (97.05%), best:    9758/10000 (97.58%), error:       914.17297, best error:       795.25671 on epoch:    66, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 72.9188995361s, input_fired_time: 1.3170129061, output_fired_time: 0.8744561672, propagate_forward_time: 28.3052024841, propagate_backward_time: 40.2725143433, weight_update_time: 0.0786555335, other_time: 2.1497077942
epoch time: 6.1735529900s, input_fired_time: 0.1588314325, output_fired_time: 0.0000000000, propagate_forward_time: 5.6349153519, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3798060417
validation[          , genome  6614] predictions:    9721/  10000 (97.21%), best:    9758/10000 (97.58%), error:       933.56799, best error:       795.25671 on epoch:    66, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 72.9625778198s, input_fired_time: 1.3220943213, output_fired_time: 0.8748168349, propagate_forward_time: 28.3159866333, propagate_backward_time: 40.2853240967, weight_update_time: 0.0793745071, other_time: 2.1643524170
epoch time: 6.1633195877s, input_fired_time: 0.1459473222, output_fired_time: 0.0000000000, propagate_forward_time: 5.6355113983, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3818607330
validation[          , genome  6614] predictions:    9718/  10000 (97.18%), best:    9758/10000 (97.58%), error:       936.51929, best error:       795.25671 on epoch:    66, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 31.0535469055s, input_fired_time: 0.7405027151, output_fired_time: 0.0000000000, propagate_forward_time: 28.3174343109, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9956092834
best training[          , genome  6614] predictions:   49520/  50000 (99.04%), best:    9758/10000 (97.58%), error:      1996.17920, best error:       795.25671 on epoch:    66, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 6.2005243301s, input_fired_time: 0.1446006447, output_fired_time: 0.0000000000, propagate_forward_time: 5.6454849243, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4104385376
   testing[          , genome  6614] predictions:    9791/  10000 (97.91%), best:    9758/10000 (97.58%), error:       710.96991, best error:       795.25671 on epoch:    66, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
01:36:05 (15724): called boinc_finish(0)

</stderr_txt>
]]>