Nameexact_genome_1512568488_41_6886_0
Workunit2605718
Created7 Dec 2017, 22:35:13 UTC
Sent7 Dec 2017, 22:42:51 UTC
Report deadline15 Dec 2017, 21:13:22 UTC
Received8 Dec 2017, 14:36:52 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID57373
Run time4 hours 10 min 23 sec
CPU time4 hours 9 min 18 sec
Validate stateValid
Credit1,984.47
Device peak FLOPS3.51 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size154.89 MB
Peak swap size158.30 MB
Peak disk usage1.78 MB

Stderr output

<core_client_version>7.6.33</core_client_version>
<![CDATA[
<stderr_txt>
1%), error:      1359.38684, best error:      1282.36646 on epoch:     1, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 136.5820007324s, input_fired_time: 1.6082568169, output_fired_time: 1.4425334930, propagate_forward_time: 51.0997314453, propagate_backward_time: 79.0927276611, weight_update_time: 0.1536706537, other_time: 3.3387451172
epoch time: 10.8207054138s, input_fired_time: 0.1961809546, output_fired_time: 0.0000000000, propagate_forward_time: 10.0647392273, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5597848892
validation[          , genome  6886] predictions:    9560/  10000 (95.60%), best:    9621/10000 (96.21%), error:      1381.49780, best error:      1282.36646 on epoch:     1, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 136.2222442627s, input_fired_time: 1.6065189838, output_fired_time: 1.4416073561, propagate_forward_time: 50.9902534485, propagate_backward_time: 78.8831024170, weight_update_time: 0.1482207775, other_time: 3.3007659912
epoch time: 11.0745344162s, input_fired_time: 0.1981290579, output_fired_time: 0.0000000000, propagate_forward_time: 10.3105649948, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5658407211
validation[          , genome  6886] predictions:    9615/  10000 (96.15%), best:    9621/10000 (96.21%), error:      1304.93054, best error:      1282.36646 on epoch:     1, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 136.6809997559s, input_fired_time: 1.6255241632, output_fired_time: 1.4514548779, propagate_forward_time: 51.2380599976, propagate_backward_time: 78.9767074585, weight_update_time: 0.1503655463, other_time: 3.3892517090
epoch time: 10.8604965210s, input_fired_time: 0.1974508613, output_fired_time: 0.0000000000, propagate_forward_time: 10.1042566299, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5587892532
validation[          , genome  6886] predictions:    9612/  10000 (96.12%), best:    9612/10000 (96.12%), error:      1270.89197, best error:      1270.89197 on epoch:    17, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 135.2543029785s, input_fired_time: 1.5899871588, output_fired_time: 1.4308192730, propagate_forward_time: 50.5405311584, propagate_backward_time: 78.4095306396, weight_update_time: 0.1463501006, other_time: 3.2834472656
epoch time: 10.9940958023s, input_fired_time: 0.2030855566, output_fired_time: 0.0000000000, propagate_forward_time: 10.2040767670, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5869331360
validation[          , genome  6886] predictions:    3900/  10000 (39.00%), best:    9612/10000 (96.12%), error:     33916.87109, best error:      1270.89197 on epoch:    17, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

resetting weights to those on epoch: 17
epoch time: 135.5493469238s, input_fired_time: 1.5987099409, output_fired_time: 1.4369202852, propagate_forward_time: 50.8081550598, propagate_backward_time: 78.5399627686, weight_update_time: 0.1454873979, other_time: 3.1656036377
epoch time: 11.1050205231s, input_fired_time: 0.2006800324, output_fired_time: 0.0000000000, propagate_forward_time: 10.3204460144, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5838947296
validation[          , genome  6886] predictions:    9495/  10000 (94.95%), best:    9612/10000 (96.12%), error:      1614.01831, best error:      1270.89197 on epoch:    17, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 137.0111846924s, input_fired_time: 1.6220313311, output_fired_time: 1.4420990944, propagate_forward_time: 51.2510261536, propagate_backward_time: 79.3795166016, weight_update_time: 0.1471565366, other_time: 3.3165283203
epoch time: 11.3358421326s, input_fired_time: 0.2002711445, output_fired_time: 0.0000000000, propagate_forward_time: 10.5663127899, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5692577362
validation[          , genome  6886] predictions:    9545/  10000 (95.45%), best:    9612/10000 (96.12%), error:      1441.23242, best error:      1270.89197 on epoch:    17, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 136.2169799805s, input_fired_time: 1.6051220894, output_fired_time: 1.4445222616, propagate_forward_time: 50.9855957031, propagate_backward_time: 78.8971557617, weight_update_time: 0.1486295015, other_time: 3.2845916748
epoch time: 10.8752508163s, input_fired_time: 0.2000058889, output_fired_time: 0.0000000000, propagate_forward_time: 10.1107206345, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5645246506
validation[          , genome  6886] predictions:    9629/  10000 (96.29%), best:    9629/10000 (96.29%), error:      1209.82764, best error:      1209.82764 on epoch:    21, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 135.9522247314s, input_fired_time: 1.6166058779, output_fired_time: 1.4440473318, propagate_forward_time: 50.8508949280, propagate_backward_time: 78.7855377197, weight_update_time: 0.1475727558, other_time: 3.2551422119
epoch time: 10.9969511032s, input_fired_time: 0.2033542991, output_fired_time: 0.0000000000, propagate_forward_time: 10.2192668915, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5743303299
validation[          , genome  6886] predictions:    9483/  10000 (94.83%), best:    9629/10000 (96.29%), error:      1632.65308, best error:      1209.82764 on epoch:    21, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 134.5342254639s, input_fired_time: 1.5755794048, output_fired_time: 1.4265204668, propagate_forward_time: 50.3929786682, propagate_backward_time: 78.0055618286, weight_update_time: 0.1448547393, other_time: 3.1335983276
epoch time: 10.9629049301s, input_fired_time: 0.2056729496, output_fired_time: 0.0000000000, propagate_forward_time: 10.1675634384, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5896682739
validation[          , genome  6886] predictions:    9657/  10000 (96.57%), best:    9657/10000 (96.57%), error:      1127.83447, best error:      1127.83447 on epoch:    23, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 135.4601135254s, input_fired_time: 1.5959997177, output_fired_time: 1.4197648764, propagate_forward_time: 50.6878128052, propagate_backward_time: 78.5748214722, weight_update_time: 0.1464502215, other_time: 3.1817169189
epoch time: 10.8217124939s, input_fired_time: 0.2042609304, output_fired_time: 0.0000000000, propagate_forward_time: 10.0283861160, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5890655518
validation[          , genome  6886] predictions:    9579/  10000 (95.79%), best:    9657/10000 (96.57%), error:      1360.64600, best error:      1127.83447 on epoch:    23, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 135.7175292969s, input_fired_time: 1.5909736156, output_fired_time: 1.4489094019, propagate_forward_time: 50.7875442505, propagate_backward_time: 78.6679229736, weight_update_time: 0.1474909931, other_time: 3.2221755981
epoch time: 10.9188013077s, input_fired_time: 0.2035948634, output_fired_time: 0.0000000000, propagate_forward_time: 10.1369380951, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5782680511
validation[          , genome  6886] predictions:    9539/  10000 (95.39%), best:    9657/10000 (96.57%), error:      1480.92993, best error:      1127.83447 on epoch:    23, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 137.5458068848s, input_fired_time: 1.6317225695, output_fired_time: 1.4493341446, propagate_forward_time: 51.4613418579, propagate_backward_time: 79.6257858276, weight_update_time: 0.1551909447, other_time: 3.3776092529
epoch time: 10.8840589523s, input_fired_time: 0.2004317343, output_fired_time: 0.0000000000, propagate_forward_time: 10.1190786362, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5645484924
validation[          , genome  6886] predictions:    9622/  10000 (96.22%), best:    9657/10000 (96.57%), error:      1226.04858, best error:      1127.83447 on epoch:    23, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 138.1372070313s, input_fired_time: 1.6498640776, output_fired_time: 1.4600777626, propagate_forward_time: 51.6796035767, propagate_backward_time: 79.9551086426, weight_update_time: 0.1498096436, other_time: 3.3925552368
epoch time: 10.8521976471s, input_fired_time: 0.2009582669, output_fired_time: 0.0000000000, propagate_forward_time: 10.0946445465, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5565948486
validation[          , genome  6886] predictions:    9655/  10000 (96.55%), best:    9657/10000 (96.57%), error:      1181.47852, best error:      1127.83447 on epoch:    23, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 135.3386383057s, input_fired_time: 1.5772984028, output_fired_time: 1.4246305227, propagate_forward_time: 50.6658935547, propagate_backward_time: 78.4303894043, weight_update_time: 0.1454383433, other_time: 3.2404174805
epoch time: 10.9796295166s, input_fired_time: 0.2099260688, output_fired_time: 0.0000000000, propagate_forward_time: 10.1914615631, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5782423019
validation[          , genome  6886] predictions:    9639/  10000 (96.39%), best:    9657/10000 (96.57%), error:      1225.94458, best error:      1127.83447 on epoch:    23, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 137.2751312256s, input_fired_time: 1.6468247175, output_fired_time: 1.4662852287, propagate_forward_time: 51.3105163574, propagate_backward_time: 79.5036392212, weight_update_time: 0.1560598314, other_time: 3.3478775024
epoch time: 11.0690841675s, input_fired_time: 0.2087635547, output_fired_time: 0.0000000000, propagate_forward_time: 10.2897596359, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5705614090
validation[          , genome  6886] predictions:    9676/  10000 (96.76%), best:    9676/10000 (96.76%), error:      1025.94019, best error:      1025.94019 on epoch:    29, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 135.2615509033s, input_fired_time: 1.5744295120, output_fired_time: 1.4207134247, propagate_forward_time: 50.6487884521, propagate_backward_time: 78.4278717041, weight_update_time: 0.1461198032, other_time: 3.1897430420
epoch time: 11.2309150696s, input_fired_time: 0.2077407390, output_fired_time: 0.0000000000, propagate_forward_time: 10.4024524689, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6207218170
validation[          , genome  6886] predictions:    9636/  10000 (96.36%), best:    9676/10000 (96.76%), error:      1196.93542, best error:      1025.94019 on epoch:    29, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 135.1779785156s, input_fired_time: 1.5928392410, output_fired_time: 1.4347460270, propagate_forward_time: 50.6381759644, propagate_backward_time: 78.3883972168, weight_update_time: 0.1454781145, other_time: 3.1238174438
epoch time: 10.9975862503s, input_fired_time: 0.2048395872, output_fired_time: 0.0000000000, propagate_forward_time: 10.2199773788, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5727691650
validation[          , genome  6886] predictions:    9541/  10000 (95.41%), best:    9676/10000 (96.76%), error:      1487.39844, best error:      1025.94019 on epoch:    29, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 136.5739593506s, input_fired_time: 1.6236972809, output_fired_time: 1.4406961203, propagate_forward_time: 51.1126937866, propagate_backward_time: 79.0417327881, weight_update_time: 0.1537108421, other_time: 3.3551406860
epoch time: 11.0341358185s, input_fired_time: 0.2132029086, output_fired_time: 0.0000000000, propagate_forward_time: 10.2248182297, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5961151123
validation[          , genome  6886] predictions:    9638/  10000 (96.38%), best:    9676/10000 (96.76%), error:      1185.85645, best error:      1025.94019 on epoch:    29, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 136.8925781250s, input_fired_time: 1.6459053755, output_fired_time: 1.4489837885, propagate_forward_time: 51.2242355347, propagate_backward_time: 79.1991958618, weight_update_time: 0.1504989564, other_time: 3.3742523193
epoch time: 10.8928356171s, input_fired_time: 0.2008482665, output_fired_time: 0.0000000000, propagate_forward_time: 10.1183156967, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5736713409
validation[          , genome  6886] predictions:    9528/  10000 (95.28%), best:    9676/10000 (96.76%), error:      1587.94482, best error:      1025.94019 on epoch:    29, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 137.0080871582s, input_fired_time: 1.6361722946, output_fired_time: 1.4502810240, propagate_forward_time: 51.3655357361, propagate_backward_time: 79.2747344971, weight_update_time: 0.1470597982, other_time: 3.2813568115
epoch time: 10.9534568787s, input_fired_time: 0.2004717439, output_fired_time: 0.0000000000, propagate_forward_time: 10.1920890808, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5608959198
validation[          , genome  6886] predictions:    9694/  10000 (96.94%), best:    9676/10000 (96.76%), error:      1048.18945, best error:      1025.94019 on epoch:    29, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 136.8366241455s, input_fired_time: 1.6196953058, output_fired_time: 1.4552303553, propagate_forward_time: 51.1033439636, propagate_backward_time: 79.3443450928, weight_update_time: 0.1478415430, other_time: 3.3140106201
epoch time: 11.3005094528s, input_fired_time: 0.2109266520, output_fired_time: 0.0000000000, propagate_forward_time: 10.4767141342, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6128683090
validation[          , genome  6886] predictions:    9703/  10000 (97.03%), best:    9703/10000 (97.03%), error:      1023.38715, best error:      1023.38715 on epoch:    35, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 134.6767730713s, input_fired_time: 1.5785222054, output_fired_time: 1.4195051193, propagate_forward_time: 50.4105339050, propagate_backward_time: 78.1430664063, weight_update_time: 0.1451291591, other_time: 3.1251373291
epoch time: 10.9231815338s, input_fired_time: 0.1999233365, output_fired_time: 0.0000000000, propagate_forward_time: 10.1640758514, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5591821671
validation[          , genome  6886] predictions:    9490/  10000 (94.90%), best:    9703/10000 (97.03%), error:      1596.36255, best error:      1023.38715 on epoch:    35, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 135.7569732666s, input_fired_time: 1.6047062874, output_fired_time: 1.4395748377, propagate_forward_time: 50.7914848328, propagate_backward_time: 78.7180404663, weight_update_time: 0.1465692520, other_time: 3.2031631470
epoch time: 10.8912401199s, input_fired_time: 0.2012624145, output_fired_time: 0.0000000000, propagate_forward_time: 10.1312112808, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5587663651
validation[          , genome  6886] predictions:    9381/  10000 (93.81%), best:    9703/10000 (97.03%), error:      2033.27356, best error:      1023.38715 on epoch:    35, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 136.2949676514s, input_fired_time: 1.6124283075, output_fired_time: 1.4327837229, propagate_forward_time: 51.0248718262, propagate_backward_time: 78.8923339844, weight_update_time: 0.1472907513, other_time: 3.3325500488
epoch time: 11.2249069214s, input_fired_time: 0.2132993937, output_fired_time: 0.0000000000, propagate_forward_time: 10.3756971359, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6359100342
validation[          , genome  6886] predictions:    9657/  10000 (96.57%), best:    9703/10000 (97.03%), error:      1092.25928, best error:      1023.38715 on epoch:    35, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 136.1327819824s, input_fired_time: 1.6206136942, output_fired_time: 1.4116135836, propagate_forward_time: 50.9246253967, propagate_backward_time: 78.8682250977, weight_update_time: 0.1469359547, other_time: 3.3076934814
epoch time: 10.9378032684s, input_fired_time: 0.2050520778, output_fired_time: 0.0000000000, propagate_forward_time: 10.1645240784, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5682268143
validation[          , genome  6886] predictions:    9620/  10000 (96.20%), best:    9703/10000 (97.03%), error:      1199.47498, best error:      1023.38715 on epoch:    35, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 136.0162200928s, input_fired_time: 1.6191437244, output_fired_time: 1.4339816570, propagate_forward_time: 50.8920326233, propagate_backward_time: 78.7934036255, weight_update_time: 0.1475556046, other_time: 3.2776718140
epoch time: 10.8728904724s, input_fired_time: 0.2033275366, output_fired_time: 0.0000000000, propagate_forward_time: 10.0951614380, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5744018555
validation[          , genome  6886] predictions:    9705/  10000 (97.05%), best:    9705/10000 (97.05%), error:       999.50293, best error:       999.50293 on epoch:    40, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 135.5428924561s, input_fired_time: 1.6018919945, output_fired_time: 1.4283519983, propagate_forward_time: 50.7903480530, propagate_backward_time: 78.5107192993, weight_update_time: 0.1474578828, other_time: 3.2115859985
epoch time: 10.7129726410s, input_fired_time: 0.1981722564, output_fired_time: 0.0000000000, propagate_forward_time: 9.9436388016, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5711612701
validation[          , genome  6886] predictions:    9650/  10000 (96.50%), best:    9705/10000 (97.05%), error:      1115.65454, best error:       999.50293 on epoch:    40, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 135.8951263428s, input_fired_time: 1.5965470076, output_fired_time: 1.4410630465, propagate_forward_time: 50.9630355835, propagate_backward_time: 78.6786651611, weight_update_time: 0.1466092914, other_time: 3.2158126831
epoch time: 10.9456701279s, input_fired_time: 0.2017870694, output_fired_time: 0.0000000000, propagate_forward_time: 10.1741580963, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5697250366
validation[          , genome  6886] predictions:    9708/  10000 (97.08%), best:    9708/10000 (97.08%), error:       967.17114, best error:       967.17114 on epoch:    42, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 136.9894409180s, input_fired_time: 1.6105238199, output_fired_time: 1.4629029036, propagate_forward_time: 51.1030044556, propagate_backward_time: 79.5102462769, weight_update_time: 0.1472846270, other_time: 3.3027648926
epoch time: 10.8171644211s, input_fired_time: 0.2040062398, output_fired_time: 0.0000000000, propagate_forward_time: 10.0319213867, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5812368393
validation[          , genome  6886] predictions:    9647/  10000 (96.47%), best:    9708/10000 (97.08%), error:      1153.25183, best error:       967.17114 on epoch:    42, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 136.0261688232s, input_fired_time: 1.6093139648, output_fired_time: 1.4417290688, propagate_forward_time: 50.8942871094, propagate_backward_time: 78.8480072021, weight_update_time: 0.1468328834, other_time: 3.2328338623
epoch time: 11.0527935028s, input_fired_time: 0.2069503218, output_fired_time: 0.0000000000, propagate_forward_time: 10.2550554276, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5907878876
validation[          , genome  6886] predictions:    9669/  10000 (96.69%), best:    9708/10000 (97.08%), error:      1083.53271, best error:       967.17114 on epoch:    42, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 135.2241668701s, input_fired_time: 1.5992656946, output_fired_time: 1.4319351912, propagate_forward_time: 50.6610908508, propagate_backward_time: 78.3591079712, weight_update_time: 0.1463049352, other_time: 3.1727828979
epoch time: 10.8022708893s, input_fired_time: 0.2012101710, output_fired_time: 0.0000000000, propagate_forward_time: 10.0442199707, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5568408966
validation[          , genome  6886] predictions:    9713/  10000 (97.13%), best:    9713/10000 (97.13%), error:       938.05170, best error:       938.05170 on epoch:    45, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 135.9069671631s, input_fired_time: 1.6244653463, output_fired_time: 1.4340561628, propagate_forward_time: 50.9042701721, propagate_backward_time: 78.6735916138, weight_update_time: 0.1475512534, other_time: 3.2705917358
epoch time: 11.1416492462s, input_fired_time: 0.2075492293, output_fired_time: 0.0000000000, propagate_forward_time: 10.3562469482, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5778532028
validation[          , genome  6886] predictions:    9621/  10000 (96.21%), best:    9713/10000 (97.13%), error:      1231.89014, best error:       938.05170 on epoch:    45, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 136.9105682373s, input_fired_time: 1.6293896437, output_fired_time: 1.4379539490, propagate_forward_time: 51.3538703918, propagate_backward_time: 79.2207489014, weight_update_time: 0.1476726085, other_time: 3.2686004639
epoch time: 10.8581714630s, input_fired_time: 0.2021548450, output_fired_time: 0.0000000000, propagate_forward_time: 10.0981159210, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5579004288
validation[          , genome  6886] predictions:    9692/  10000 (96.92%), best:    9713/10000 (97.13%), error:      1020.89709, best error:       938.05170 on epoch:    45, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 136.0870513916s, input_fired_time: 1.6275109053, output_fired_time: 1.4419707060, propagate_forward_time: 50.9108810425, propagate_backward_time: 78.7828063965, weight_update_time: 0.1528820246, other_time: 3.3238754272
epoch time: 11.0961656570s, input_fired_time: 0.2026779205, output_fired_time: 0.0000000000, propagate_forward_time: 10.3344345093, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5590534210
validation[          , genome  6886] predictions:    9647/  10000 (96.47%), best:    9713/10000 (97.13%), error:      1124.11792, best error:       938.05170 on epoch:    45, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 135.7173309326s, input_fired_time: 1.6152544022, output_fired_time: 1.4483151436, propagate_forward_time: 50.7962684631, propagate_backward_time: 78.6060409546, weight_update_time: 0.1474244893, other_time: 3.2514572144
epoch time: 10.8916053772s, input_fired_time: 0.2033463418, output_fired_time: 0.0000000000, propagate_forward_time: 10.1302671432, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5579919815
validation[          , genome  6886] predictions:    9694/  10000 (96.94%), best:    9713/10000 (97.13%), error:       983.68042, best error:       938.05170 on epoch:    45, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 136.1471252441s, input_fired_time: 1.6253176928, output_fired_time: 1.4603968859, propagate_forward_time: 50.9825973511, propagate_backward_time: 78.8567886353, weight_update_time: 0.1479930431, other_time: 3.2220153809
epoch time: 11.1793184280s, input_fired_time: 0.2168776393, output_fired_time: 0.0000000000, propagate_forward_time: 10.3265113831, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6359291077
validation[          , genome  6886] predictions:    9607/  10000 (96.07%), best:    9713/10000 (97.13%), error:      1292.55481, best error:       938.05170 on epoch:    45, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 138.5574951172s, input_fired_time: 1.6726902723, output_fired_time: 1.4819996357, propagate_forward_time: 51.7319679260, propagate_backward_time: 80.2230300903, weight_update_time: 0.1513991803, other_time: 3.4478225708
epoch time: 10.8677511215s, input_fired_time: 0.2038600743, output_fired_time: 0.0000000000, propagate_forward_time: 10.1005983353, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5632925034
validation[          , genome  6886] predictions:    9511/  10000 (95.11%), best:    9713/10000 (97.13%), error:      1698.03174, best error:       938.05170 on epoch:    45, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 136.6994018555s, input_fired_time: 1.6351203918, output_fired_time: 1.4401814938, propagate_forward_time: 51.1670494080, propagate_backward_time: 79.1378784180, weight_update_time: 0.1575214118, other_time: 3.3191680908
epoch time: 10.8784255981s, input_fired_time: 0.2150594592, output_fired_time: 0.0000000000, propagate_forward_time: 10.0639753342, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5993909836
validation[          , genome  6886] predictions:    9658/  10000 (96.58%), best:    9713/10000 (97.13%), error:      1097.36694, best error:       938.05170 on epoch:    45, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 136.3027191162s, input_fired_time: 1.6081906557, output_fired_time: 1.4431114197, propagate_forward_time: 50.9603843689, propagate_backward_time: 79.0422744751, weight_update_time: 0.1483676434, other_time: 3.2487564087
epoch time: 10.8912086487s, input_fired_time: 0.2042940855, output_fired_time: 0.0000000000, propagate_forward_time: 10.1139926910, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5729217529
validation[          , genome  6886] predictions:    9630/  10000 (96.30%), best:    9713/10000 (97.13%), error:      1172.14917, best error:       938.05170 on epoch:    45, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 135.6277313232s, input_fired_time: 1.6094717979, output_fired_time: 1.4239100218, propagate_forward_time: 50.8269119263, propagate_backward_time: 78.5481491089, weight_update_time: 0.1468842477, other_time: 3.2192993164
epoch time: 11.3099374771s, input_fired_time: 0.2172641456, output_fired_time: 0.0000000000, propagate_forward_time: 10.4710083008, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6216650009
validation[          , genome  6886] predictions:    9660/  10000 (96.60%), best:    9713/10000 (97.13%), error:      1088.15771, best error:       938.05170 on epoch:    45, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 137.7839202881s, input_fired_time: 1.6838642359, output_fired_time: 1.4820424318, propagate_forward_time: 51.4781494141, propagate_backward_time: 79.7521667480, weight_update_time: 0.1553776860, other_time: 3.3876953125
epoch time: 10.9150094986s, input_fired_time: 0.2062235475, output_fired_time: 0.0000000000, propagate_forward_time: 10.1236829758, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5851030350
validation[          , genome  6886] predictions:    9576/  10000 (95.76%), best:    9713/10000 (97.13%), error:      1402.40051, best error:       938.05170 on epoch:    45, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 135.9967956543s, input_fired_time: 1.6235355139, output_fired_time: 1.4360014200, propagate_forward_time: 50.8685531616, propagate_backward_time: 78.6993637085, weight_update_time: 0.1506760716, other_time: 3.3693389893
epoch time: 10.9604816437s, input_fired_time: 0.2081251442, output_fired_time: 0.0000000000, propagate_forward_time: 10.1740493774, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5783071518
validation[          , genome  6886] predictions:    9706/  10000 (97.06%), best:    9713/10000 (97.13%), error:       984.06744, best error:       938.05170 on epoch:    45, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 135.4365081787s, input_fired_time: 1.5977585316, output_fired_time: 1.4230680466, propagate_forward_time: 50.7246971130, propagate_backward_time: 78.4784545898, weight_update_time: 0.1461036950, other_time: 3.2125244141
epoch time: 11.0024576187s, input_fired_time: 0.2198915631, output_fired_time: 0.0000000000, propagate_forward_time: 10.2066936493, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5758724213
validation[          , genome  6886] predictions:    9563/  10000 (95.63%), best:    9713/10000 (97.13%), error:      1528.26587, best error:       938.05170 on epoch:    45, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 136.1958770752s, input_fired_time: 1.6143478155, output_fired_time: 1.4578342438, propagate_forward_time: 50.9365158081, propagate_backward_time: 78.9994201660, weight_update_time: 0.1483875215, other_time: 3.1877517700
epoch time: 10.8489570618s, input_fired_time: 0.2031877190, output_fired_time: 0.0000000000, propagate_forward_time: 10.0816345215, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5641345978
validation[          , genome  6886] predictions:    9736/  10000 (97.36%), best:    9736/10000 (97.36%), error:       874.34729, best error:       874.34729 on epoch:    58, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 138.0392303467s, input_fired_time: 1.6701735258, output_fired_time: 1.4683216810, propagate_forward_time: 51.6342048645, propagate_backward_time: 79.9070129395, weight_update_time: 0.1496385336, other_time: 3.3595275879
epoch time: 10.9890470505s, input_fired_time: 0.2058624476, output_fired_time: 0.0000000000, propagate_forward_time: 10.2090072632, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5741777420
validation[          , genome  6886] predictions:    9669/  10000 (96.69%), best:    9736/10000 (97.36%), error:      1073.48047, best error:       874.34729 on epoch:    58, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 136.5088958740s, input_fired_time: 1.6393544674, output_fired_time: 1.4566447735, propagate_forward_time: 51.0902404785, propagate_backward_time: 79.0039901733, weight_update_time: 0.1480924338, other_time: 3.3186569214
epoch time: 10.9483337402s, input_fired_time: 0.2097202688, output_fired_time: 0.0000000000, propagate_forward_time: 10.1785974503, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5600156784
validation[          , genome  6886] predictions:    9651/  10000 (96.51%), best:    9736/10000 (97.36%), error:      1084.32666, best error:       874.34729 on epoch:    58, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 135.8248443604s, input_fired_time: 1.6131011248, output_fired_time: 1.4527288675, propagate_forward_time: 50.8767013550, propagate_backward_time: 78.6492843628, weight_update_time: 0.1479402333, other_time: 3.2330322266
epoch time: 10.8348073959s, input_fired_time: 0.2020668536, output_fired_time: 0.0000000000, propagate_forward_time: 10.0740518570, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5586891174
validation[          , genome  6886] predictions:    9544/  10000 (95.44%), best:    9736/10000 (97.36%), error:      1498.61975, best error:       874.34729 on epoch:    58, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 136.3007354736s, input_fired_time: 1.6232068539, output_fired_time: 1.4498993158, propagate_forward_time: 50.9694595337, propagate_backward_time: 78.9687881470, weight_update_time: 0.1521943659, other_time: 3.2893829346
epoch time: 10.8518848419s, input_fired_time: 0.2033415139, output_fired_time: 0.0000000000, propagate_forward_time: 10.0900020599, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5585412979
validation[          , genome  6886] predictions:    9660/  10000 (96.60%), best:    9736/10000 (97.36%), error:      1077.78540, best error:       874.34729 on epoch:    58, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 138.8104400635s, input_fired_time: 1.6806468964, output_fired_time: 1.4971348047, propagate_forward_time: 51.9041442871, propagate_backward_time: 80.2013168335, weight_update_time: 0.1499825269, other_time: 3.5271987915
epoch time: 11.2779693604s, input_fired_time: 0.2157928348, output_fired_time: 0.0000000000, propagate_forward_time: 10.4550914764, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6070852280
validation[          , genome  6886] predictions:    9641/  10000 (96.41%), best:    9736/10000 (97.36%), error:      1175.23596, best error:       874.34729 on epoch:    58, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 134.9984283447s, input_fired_time: 1.5856263638, output_fired_time: 1.4295337200, propagate_forward_time: 50.6351699829, propagate_backward_time: 78.2119293213, weight_update_time: 0.1447884738, other_time: 3.1361618042
epoch time: 11.0892210007s, input_fired_time: 0.2095622420, output_fired_time: 0.0000000000, propagate_forward_time: 10.2978858948, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5817728043
validation[          , genome  6886] predictions:    9695/  10000 (96.95%), best:    9736/10000 (97.36%), error:       980.20844, best error:       874.34729 on epoch:    58, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 136.5450592041s, input_fired_time: 1.6408168077, output_fired_time: 1.4419311285, propagate_forward_time: 51.0921516418, propagate_backward_time: 79.0842208862, weight_update_time: 0.1480743438, other_time: 3.2859420776
epoch time: 10.8858432770s, input_fired_time: 0.2033764273, output_fired_time: 0.0000000000, propagate_forward_time: 10.1209440231, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5615224838
validation[          , genome  6886] predictions:    9702/  10000 (97.02%), best:    9736/10000 (97.36%), error:       986.90387, best error:       874.34729 on epoch:    58, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 136.2696838379s, input_fired_time: 1.6260904074, output_fired_time: 1.4383984804, propagate_forward_time: 50.9872932434, propagate_backward_time: 78.9252395630, weight_update_time: 0.1477148682, other_time: 3.2926712036
epoch time: 11.0159702301s, input_fired_time: 0.2093157768, output_fired_time: 0.0000000000, propagate_forward_time: 10.2146768570, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5919771194
validation[          , genome  6886] predictions:    9696/  10000 (96.96%), best:    9736/10000 (97.36%), error:       956.65582, best error:       874.34729 on epoch:    58, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 136.3489379883s, input_fired_time: 1.6250602007, output_fired_time: 1.4647444487, propagate_forward_time: 51.0718193054, propagate_backward_time: 78.9661941528, weight_update_time: 0.1469386071, other_time: 3.2211227417
epoch time: 10.8968200684s, input_fired_time: 0.2056937814, output_fired_time: 0.0000000000, propagate_forward_time: 10.1300220490, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5611038208
validation[          , genome  6886] predictions:    9720/  10000 (97.20%), best:    9736/10000 (97.36%), error:       944.36633, best error:       874.34729 on epoch:    58, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 136.5466766357s, input_fired_time: 1.6306258440, output_fired_time: 1.4570279121, propagate_forward_time: 51.0623016357, propagate_backward_time: 79.1340332031, weight_update_time: 0.1507925391, other_time: 3.2626800537
epoch time: 11.1100597382s, input_fired_time: 0.2082242817, output_fired_time: 0.0000000000, propagate_forward_time: 10.2964239120, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6054115295
validation[          , genome  6886] predictions:    9709/  10000 (97.09%), best:    9736/10000 (97.36%), error:       949.30902, best error:       874.34729 on epoch:    58, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 136.2932586670s, input_fired_time: 1.6310902834, output_fired_time: 1.4396675825, propagate_forward_time: 51.0699615479, propagate_backward_time: 78.8766098022, weight_update_time: 0.1471149772, other_time: 3.2759323120
epoch time: 11.0529050827s, input_fired_time: 0.2098496854, output_fired_time: 0.0000000000, propagate_forward_time: 10.2544355392, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5886201859
validation[          , genome  6886] predictions:    9711/  10000 (97.11%), best:    9736/10000 (97.36%), error:       931.91589, best error:       874.34729 on epoch:    58, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 136.2729492188s, input_fired_time: 1.6396296024, output_fired_time: 1.4596759081, propagate_forward_time: 51.0125427246, propagate_backward_time: 78.8520660400, weight_update_time: 0.1563718319, other_time: 3.3090362549
epoch time: 11.0121936798s, input_fired_time: 0.2089923322, output_fired_time: 0.0000000000, propagate_forward_time: 10.2341556549, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5690460205
validation[          , genome  6886] predictions:    9707/  10000 (97.07%), best:    9736/10000 (97.36%), error:       963.11426, best error:       874.34729 on epoch:    58, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 136.7269897461s, input_fired_time: 1.6226853132, output_fired_time: 1.4319999218, propagate_forward_time: 51.2652130127, propagate_backward_time: 79.1444931030, weight_update_time: 0.1464545131, other_time: 3.2625961304
epoch time: 10.9833536148s, input_fired_time: 0.2063706666, output_fired_time: 0.0000000000, propagate_forward_time: 10.1804056168, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5965776443
validation[          , genome  6886] predictions:    9681/  10000 (96.81%), best:    9736/10000 (97.36%), error:      1035.76794, best error:       874.34729 on epoch:    58, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 136.2736663818s, input_fired_time: 1.6474852562, output_fired_time: 1.4272884130, propagate_forward_time: 51.0422744751, propagate_backward_time: 78.8652496338, weight_update_time: 0.1525637954, other_time: 3.2913589478
epoch time: 11.1644716263s, input_fired_time: 0.2114816457, output_fired_time: 0.0000000000, propagate_forward_time: 10.3419971466, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6109924316
validation[          , genome  6886] predictions:    9616/  10000 (96.16%), best:    9736/10000 (97.36%), error:      1262.76257, best error:       874.34729 on epoch:    58, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 135.7288055420s, input_fired_time: 1.6159142256, output_fired_time: 1.4424206018, propagate_forward_time: 50.8385925293, propagate_backward_time: 78.6272735596, weight_update_time: 0.1463674158, other_time: 3.2046051025
epoch time: 10.9687118530s, input_fired_time: 0.2183876187, output_fired_time: 0.0000000000, propagate_forward_time: 10.1553392410, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5949850082
validation[          , genome  6886] predictions:    9582/  10000 (95.82%), best:    9736/10000 (97.36%), error:      1438.99646, best error:       874.34729 on epoch:    58, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 135.7715454102s, input_fired_time: 1.6141885519, output_fired_time: 1.4479007721, propagate_forward_time: 50.8061485291, propagate_backward_time: 78.6588287354, weight_update_time: 0.1473926753, other_time: 3.2444763184
epoch time: 10.8133726120s, input_fired_time: 0.2027687430, output_fired_time: 0.0000000000, propagate_forward_time: 10.0529794693, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5576248169
validation[          , genome  6886] predictions:    9719/  10000 (97.19%), best:    9736/10000 (97.36%), error:       928.07117, best error:       874.34729 on epoch:    58, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 135.6208343506s, input_fired_time: 1.6041254997, output_fired_time: 1.4513272047, propagate_forward_time: 50.8105735779, propagate_backward_time: 78.6024398804, weight_update_time: 0.1470171660, other_time: 3.1523666382
epoch time: 10.9324655533s, input_fired_time: 0.2077456415, output_fired_time: 0.0000000000, propagate_forward_time: 10.1526308060, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5720891953
validation[          , genome  6886] predictions:    9709/  10000 (97.09%), best:    9736/10000 (97.36%), error:       947.96570, best error:       874.34729 on epoch:    58, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 136.0519104004s, input_fired_time: 1.6167253256, output_fired_time: 1.4400988817, propagate_forward_time: 50.9338531494, propagate_backward_time: 78.8467102051, weight_update_time: 0.1462688595, other_time: 3.2145233154
epoch time: 10.9165830612s, input_fired_time: 0.2045130432, output_fired_time: 0.0000000000, propagate_forward_time: 10.1459951401, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5660753250
validation[          , genome  6886] predictions:    9669/  10000 (96.69%), best:    9736/10000 (97.36%), error:      1071.99084, best error:       874.34729 on epoch:    58, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 136.4932861328s, input_fired_time: 1.6344795227, output_fired_time: 1.4462330341, propagate_forward_time: 51.1251907349, propagate_backward_time: 79.0509262085, weight_update_time: 0.1470508277, other_time: 3.2364654541
epoch time: 10.9395246506s, input_fired_time: 0.2083344758, output_fired_time: 0.0000000000, propagate_forward_time: 10.1469373703, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5842523575
validation[          , genome  6886] predictions:    9713/  10000 (97.13%), best:    9736/10000 (97.36%), error:       931.31781, best error:       874.34729 on epoch:    58, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 136.3830871582s, input_fired_time: 1.6297063828, output_fired_time: 1.4449899197, propagate_forward_time: 51.0648956299, propagate_backward_time: 78.9084625244, weight_update_time: 0.1487339288, other_time: 3.3350372314
epoch time: 10.8738498688s, input_fired_time: 0.2062185556, output_fired_time: 0.0000000000, propagate_forward_time: 10.1093397141, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5582914352
validation[          , genome  6886] predictions:    9584/  10000 (95.84%), best:    9736/10000 (97.36%), error:      1495.91504, best error:       874.34729 on epoch:    58, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 137.2039947510s, input_fired_time: 1.6612271070, output_fired_time: 1.4439530373, propagate_forward_time: 51.3495063782, propagate_backward_time: 79.4487075806, weight_update_time: 0.1538963765, other_time: 3.3006057739
epoch time: 11.1779146194s, input_fired_time: 0.2185160518, output_fired_time: 0.0000000000, propagate_forward_time: 10.3794145584, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5799837112
validation[          , genome  6886] predictions:    9696/  10000 (96.96%), best:    9736/10000 (97.36%), error:       951.67029, best error:       874.34729 on epoch:    58, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 135.3811645508s, input_fired_time: 1.6066467762, output_fired_time: 1.4292565584, propagate_forward_time: 50.6473007202, propagate_backward_time: 78.5043258667, weight_update_time: 0.1469632536, other_time: 3.1936340332
epoch time: 11.0715684891s, input_fired_time: 0.2169760466, output_fired_time: 0.0000000000, propagate_forward_time: 10.2633485794, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5912437439
validation[          , genome  6886] predictions:    9690/  10000 (96.90%), best:    9736/10000 (97.36%), error:       993.51807, best error:       874.34729 on epoch:    58, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 135.5792083740s, input_fired_time: 1.6013075113, output_fired_time: 1.4248751402, propagate_forward_time: 50.8330841064, propagate_backward_time: 78.5777587891, weight_update_time: 0.1452183276, other_time: 3.1421813965
epoch time: 11.2229347229s, input_fired_time: 0.2209891379, output_fired_time: 0.0000000000, propagate_forward_time: 10.4121150970, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5898303986
validation[          , genome  6886] predictions:    9701/  10000 (97.01%), best:    9736/10000 (97.36%), error:       979.04370, best error:       874.34729 on epoch:    58, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 137.1742248535s, input_fired_time: 1.6454088688, output_fired_time: 1.4539927244, propagate_forward_time: 51.2432441711, propagate_backward_time: 79.4903182983, weight_update_time: 0.1487944424, other_time: 3.3412551880
epoch time: 10.9042797089s, input_fired_time: 0.2154829949, output_fired_time: 0.0000000000, propagate_forward_time: 10.1126327515, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5761642456
validation[          , genome  6886] predictions:    9658/  10000 (96.58%), best:    9736/10000 (97.36%), error:      1098.46106, best error:       874.34729 on epoch:    58, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 136.9424133301s, input_fired_time: 1.6384956837, output_fired_time: 1.4621865749, propagate_forward_time: 51.2611541748, propagate_backward_time: 79.3163299561, weight_update_time: 0.1467761844, other_time: 3.2642517090
epoch time: 11.0032854080s, input_fired_time: 0.2120026052, output_fired_time: 0.0000000000, propagate_forward_time: 10.2311935425, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5600891113
validation[          , genome  6886] predictions:    9640/  10000 (96.40%), best:    9736/10000 (97.36%), error:      1193.30017, best error:       874.34729 on epoch:    58, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 135.1941375732s, input_fired_time: 1.6167037487, output_fired_time: 1.4384506941, propagate_forward_time: 50.6074523926, propagate_backward_time: 78.4071731567, weight_update_time: 0.1449761242, other_time: 3.1243667603
epoch time: 10.8935031891s, input_fired_time: 0.2051765919, output_fired_time: 0.0000000000, propagate_forward_time: 10.1291122437, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5592145920
validation[          , genome  6886] predictions:    9705/  10000 (97.05%), best:    9736/10000 (97.36%), error:       937.20190, best error:       874.34729 on epoch:    58, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 136.4524383545s, input_fired_time: 1.6615676880, output_fired_time: 1.4491889477, propagate_forward_time: 50.9981231689, propagate_backward_time: 79.0488815308, weight_update_time: 0.1490233243, other_time: 3.2946701050
epoch time: 11.0109024048s, input_fired_time: 0.2102625966, output_fired_time: 0.0000000000, propagate_forward_time: 10.2210264206, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5796136856
validation[          , genome  6886] predictions:    9697/  10000 (96.97%), best:    9736/10000 (97.36%), error:       988.87366, best error:       874.34729 on epoch:    58, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 136.0592803955s, input_fired_time: 1.6322174072, output_fired_time: 1.4278025627, propagate_forward_time: 50.9365463257, propagate_backward_time: 78.8081130981, weight_update_time: 0.1473677605, other_time: 3.2546081543
epoch time: 11.2093143463s, input_fired_time: 0.2215945423, output_fired_time: 0.0000000000, propagate_forward_time: 10.4263334274, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5613861084
validation[          , genome  6886] predictions:    9711/  10000 (97.11%), best:    9736/10000 (97.36%), error:       921.74939, best error:       874.34729 on epoch:    58, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 136.4488525391s, input_fired_time: 1.6336656809, output_fired_time: 1.4339586496, propagate_forward_time: 51.0321235657, propagate_backward_time: 79.0961303711, weight_update_time: 0.1488600075, other_time: 3.2529754639
epoch time: 10.8771820068s, input_fired_time: 0.2040312588, output_fired_time: 0.0000000000, propagate_forward_time: 10.1154003143, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5577507019
validation[          , genome  6886] predictions:    9717/  10000 (97.17%), best:    9736/10000 (97.36%), error:       910.29199, best error:       874.34729 on epoch:    58, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 137.2700958252s, input_fired_time: 1.6506415606, output_fired_time: 1.4430522919, propagate_forward_time: 51.2698593140, propagate_backward_time: 79.5431060791, weight_update_time: 0.1484574378, other_time: 3.3634414673
epoch time: 11.0713376999s, input_fired_time: 0.2176294774, output_fired_time: 0.0000000000, propagate_forward_time: 10.2671689987, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5865392685
validation[          , genome  6886] predictions:    9713/  10000 (97.13%), best:    9736/10000 (97.36%), error:       911.59363, best error:       874.34729 on epoch:    58, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 136.8439788818s, input_fired_time: 1.6610051394, output_fired_time: 1.4465126991, propagate_forward_time: 51.2008895874, propagate_backward_time: 79.1796951294, weight_update_time: 0.1539551020, other_time: 3.3558654785
epoch time: 10.9646511078s, input_fired_time: 0.2105466872, output_fired_time: 0.0000000000, propagate_forward_time: 10.1690340042, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5850706100
validation[          , genome  6886] predictions:    9704/  10000 (97.04%), best:    9736/10000 (97.36%), error:       990.85059, best error:       874.34729 on epoch:    58, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 135.3249511719s, input_fired_time: 1.6023581028, output_fired_time: 1.4206218719, propagate_forward_time: 50.6619224548, propagate_backward_time: 78.4571838379, weight_update_time: 0.1464125812, other_time: 3.1828613281
epoch time: 10.9037914276s, input_fired_time: 0.2050260454, output_fired_time: 0.0000000000, propagate_forward_time: 10.1346864700, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5640792847
validation[          , genome  6886] predictions:    9708/  10000 (97.08%), best:    9736/10000 (97.36%), error:       931.55396, best error:       874.34729 on epoch:    58, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 137.8830108643s, input_fired_time: 1.6581598520, output_fired_time: 1.4568942785, propagate_forward_time: 51.5787506104, propagate_backward_time: 79.8233032227, weight_update_time: 0.1532027572, other_time: 3.3659057617
epoch time: 11.3321018219s, input_fired_time: 0.2235960513, output_fired_time: 0.0000000000, propagate_forward_time: 10.4964284897, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6120777130
validation[          , genome  6886] predictions:    9666/  10000 (96.66%), best:    9736/10000 (97.36%), error:      1062.14185, best error:       874.34729 on epoch:    58, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 136.6987762451s, input_fired_time: 1.6493045092, output_fired_time: 1.4456876516, propagate_forward_time: 51.2477684021, propagate_backward_time: 79.0348358154, weight_update_time: 0.1486183554, other_time: 3.3211669922
epoch time: 10.9768924713s, input_fired_time: 0.2103549391, output_fired_time: 0.0000000000, propagate_forward_time: 10.1714153290, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5951223373
validation[          , genome  6886] predictions:    9716/  10000 (97.16%), best:    9736/10000 (97.36%), error:       900.77344, best error:       874.34729 on epoch:    58, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 136.5351257324s, input_fired_time: 1.6404345036, output_fired_time: 1.4505814314, propagate_forward_time: 51.0544357300, propagate_backward_time: 79.0826797485, weight_update_time: 0.1493739933, other_time: 3.3069915771
epoch time: 10.8746128082s, input_fired_time: 0.2059806585, output_fired_time: 0.0000000000, propagate_forward_time: 10.0991096497, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5695228577
validation[          , genome  6886] predictions:    9711/  10000 (97.11%), best:    9736/10000 (97.36%), error:       928.51331, best error:       874.34729 on epoch:    58, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 136.2238006592s, input_fired_time: 1.6298255920, output_fired_time: 1.4484876394, propagate_forward_time: 51.0281448364, propagate_backward_time: 78.8535461426, weight_update_time: 0.1489678174, other_time: 3.2638015747
epoch time: 11.1283102036s, input_fired_time: 0.2135488838, output_fired_time: 0.0000000000, propagate_forward_time: 10.3093690872, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6053924561
validation[          , genome  6886] predictions:    9420/  10000 (94.20%), best:    9736/10000 (97.36%), error:      2112.07129, best error:       874.34729 on epoch:    58, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 137.9934234619s, input_fired_time: 1.6661471128, output_fired_time: 1.4638609886, propagate_forward_time: 51.5999641418, propagate_backward_time: 79.8068618774, weight_update_time: 0.1579108983, other_time: 3.4565811157
epoch time: 10.8520460129s, input_fired_time: 0.2045011967, output_fired_time: 0.0000000000, propagate_forward_time: 10.0882425308, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5593023300
validation[          , genome  6886] predictions:    9670/  10000 (96.70%), best:    9736/10000 (97.36%), error:      1052.57874, best error:       874.34729 on epoch:    58, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 137.5772552490s, input_fired_time: 1.6373742819, output_fired_time: 1.4562422037, propagate_forward_time: 51.5131416321, propagate_backward_time: 79.6717910767, weight_update_time: 0.1509300619, other_time: 3.2987136841
epoch time: 10.7138051987s, input_fired_time: 0.2041733712, output_fired_time: 0.0000000000, propagate_forward_time: 9.9499006271, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5597314835
validation[          , genome  6886] predictions:    9723/  10000 (97.23%), best:    9736/10000 (97.36%), error:       924.61078, best error:       874.34729 on epoch:    58, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 136.2057037354s, input_fired_time: 1.6382905245, output_fired_time: 1.4335430861, propagate_forward_time: 50.9844627380, propagate_backward_time: 78.8350143433, weight_update_time: 0.1537013650, other_time: 3.3143844604
epoch time: 10.9492187500s, input_fired_time: 0.2095923126, output_fired_time: 0.0000000000, propagate_forward_time: 10.1560630798, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5835638046
validation[          , genome  6886] predictions:    9639/  10000 (96.39%), best:    9736/10000 (97.36%), error:      1186.19055, best error:       874.34729 on epoch:    58, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 135.7352752686s, input_fired_time: 1.6508227587, output_fired_time: 1.4392980337, propagate_forward_time: 50.7689666748, propagate_backward_time: 78.6048202515, weight_update_time: 0.1476132572, other_time: 3.2713699341
epoch time: 10.8815612793s, input_fired_time: 0.2046320736, output_fired_time: 0.0000000000, propagate_forward_time: 10.1169204712, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5600090027
validation[          , genome  6886] predictions:    9658/  10000 (96.58%), best:    9736/10000 (97.36%), error:      1130.28918, best error:       874.34729 on epoch:    58, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 137.0595245361s, input_fired_time: 1.6518692970, output_fired_time: 1.4308367968, propagate_forward_time: 51.2637100220, propagate_backward_time: 79.3299942017, weight_update_time: 0.1466906518, other_time: 3.3831176758
epoch time: 11.2823276520s, input_fired_time: 0.2116778344, output_fired_time: 0.0000000000, propagate_forward_time: 10.4611625671, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6094875336
validation[          , genome  6886] predictions:    9711/  10000 (97.11%), best:    9736/10000 (97.36%), error:       916.16193, best error:       874.34729 on epoch:    58, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 136.6813049316s, input_fired_time: 1.6377675533, output_fired_time: 1.4539488554, propagate_forward_time: 51.1358795166, propagate_backward_time: 79.1406860352, weight_update_time: 0.1472160816, other_time: 3.3130187988
epoch time: 11.0492210388s, input_fired_time: 0.2098934650, output_fired_time: 0.0000000000, propagate_forward_time: 10.2565269470, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5828008652
validation[          , genome  6886] predictions:    9721/  10000 (97.21%), best:    9736/10000 (97.36%), error:       938.25623, best error:       874.34729 on epoch:    58, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 55.2911148071s, input_fired_time: 1.0692543983, output_fired_time: 0.0000000000, propagate_forward_time: 51.1744079590, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0474510193
best training[          , genome  6886] predictions:   49248/  50000 (98.50%), best:    9736/10000 (97.36%), error:      2663.50732, best error:       874.34729 on epoch:    58, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 10.9196214676s, input_fired_time: 0.2024603188, output_fired_time: 0.0000000000, propagate_forward_time: 10.1568117142, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5603494644
   testing[          , genome  6886] predictions:    9751/  10000 (97.51%), best:    9736/10000 (97.36%), error:       783.48370, best error:       874.34729 on epoch:    58, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
22:11:03 (4632): called boinc_finish(0)

</stderr_txt>
]]>