Nameexact_genome_1512568488_44_6991_1
Workunit2606279
Created7 Dec 2017, 23:07:22 UTC
Sent7 Dec 2017, 23:17:46 UTC
Report deadline24 Dec 2017, 9:43:24 UTC
Received8 Dec 2017, 14:11:20 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID57657
Run time10 hours 33 min 54 sec
CPU time8 hours 14 min 16 sec
Validate stateValid
Credit4,108.62
Device peak FLOPS2.65 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size158.40 MB
Peak swap size163.16 MB
Peak disk usage2.63 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
438374

epoch time: 399.8911132813s, input_fired_time: 5.9155607224, output_fired_time: 5.4382276535, propagate_forward_time: 149.7489624023, propagate_backward_time: 230.6371765137, weight_update_time: 0.5052530169, other_time: 8.1511840820
epoch time: 32.2798080444s, input_fired_time: 0.4935802817, output_fired_time: 0.0000000000, propagate_forward_time: 29.9213657379, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8648624420
validation[          , genome  6991] predictions:    9771/  10000 (97.71%), best:    9792/10000 (97.92%), error:       787.90857, best error:       732.85565 on epoch:     4, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 390.0522155762s, input_fired_time: 6.0889458656, output_fired_time: 4.8378138542, propagate_forward_time: 144.7236022949, propagate_backward_time: 226.8527679443, weight_update_time: 0.2514246702, other_time: 7.5490875244
epoch time: 29.5612716675s, input_fired_time: 0.4714406729, output_fired_time: 0.0000000000, propagate_forward_time: 27.8321781158, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2576522827
validation[          , genome  6991] predictions:    9772/  10000 (97.72%), best:    9792/10000 (97.92%), error:       808.53845, best error:       732.85565 on epoch:     4, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 370.4309692383s, input_fired_time: 5.3331527710, output_fired_time: 4.7795505524, propagate_forward_time: 136.6793212891, propagate_backward_time: 215.6156311035, weight_update_time: 0.4922591150, other_time: 8.0233154297
epoch time: 29.6820468903s, input_fired_time: 0.4626041949, output_fired_time: 0.0000000000, propagate_forward_time: 27.9939670563, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2254753113
validation[          , genome  6991] predictions:    9765/  10000 (97.65%), best:    9792/10000 (97.92%), error:       778.60919, best error:       732.85565 on epoch:     4, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 289.4099731445s, input_fired_time: 3.6288280487, output_fired_time: 3.7190611362, propagate_forward_time: 108.1652679443, propagate_backward_time: 168.3941650391, weight_update_time: 0.4755242169, other_time: 5.5026702881
epoch time: 19.1325168610s, input_fired_time: 0.4156160653, output_fired_time: 0.0000000000, propagate_forward_time: 17.8152217865, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9016780853
validation[          , genome  6991] predictions:    9757/  10000 (97.57%), best:    9792/10000 (97.92%), error:       773.52533, best error:       732.85565 on epoch:     4, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 240.6695556641s, input_fired_time: 3.4500722885, output_fired_time: 3.2242088318, propagate_forward_time: 89.3877258301, propagate_backward_time: 139.8371582031, weight_update_time: 0.2146700472, other_time: 4.7703857422
epoch time: 19.0529937744s, input_fired_time: 0.4053167999, output_fired_time: 0.0000000000, propagate_forward_time: 17.7809696198, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8667068481
validation[          , genome  6991] predictions:    9753/  10000 (97.53%), best:    9792/10000 (97.92%), error:       791.94879, best error:       732.85565 on epoch:     4, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 238.4631042480s, input_fired_time: 3.4030232430, output_fired_time: 3.1828684807, propagate_forward_time: 88.1131820679, propagate_backward_time: 139.0795593262, weight_update_time: 0.2077548802, other_time: 4.6844787598
epoch time: 19.1947364807s, input_fired_time: 0.4117755592, output_fired_time: 0.0000000000, propagate_forward_time: 17.9047431946, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8782176971
validation[          , genome  6991] predictions:    9797/  10000 (97.97%), best:    9797/10000 (97.97%), error:       642.77185, best error:       642.77185 on epoch:    20, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 237.2718505859s, input_fired_time: 3.3934967518, output_fired_time: 3.1717338562, propagate_forward_time: 87.5553588867, propagate_backward_time: 138.4747772217, weight_update_time: 0.2078861296, other_time: 4.6764831543
epoch time: 18.6898727417s, input_fired_time: 0.4023806453, output_fired_time: 0.0000000000, propagate_forward_time: 17.4161663055, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8713264465
validation[          , genome  6991] predictions:    9782/  10000 (97.82%), best:    9797/10000 (97.97%), error:       702.05017, best error:       642.77185 on epoch:    20, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 239.4367218018s, input_fired_time: 3.4236335754, output_fired_time: 3.1901736259, propagate_forward_time: 88.7270355225, propagate_backward_time: 139.3862609863, weight_update_time: 0.2090803981, other_time: 4.7096252441
epoch time: 18.9165420532s, input_fired_time: 0.4059953392, output_fired_time: 0.0000000000, propagate_forward_time: 17.6320304871, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8785171509
validation[          , genome  6991] predictions:    9763/  10000 (97.63%), best:    9797/10000 (97.97%), error:       780.79279, best error:       642.77185 on epoch:    20, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 238.0706787109s, input_fired_time: 3.4119906425, output_fired_time: 3.1606440544, propagate_forward_time: 88.3342590332, propagate_backward_time: 138.4369201660, weight_update_time: 0.2093549520, other_time: 4.7268676758
epoch time: 19.1460647583s, input_fired_time: 0.4086451828, output_fired_time: 0.0000000000, propagate_forward_time: 17.8641204834, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8732986450
validation[          , genome  6991] predictions:    9809/  10000 (98.09%), best:    9797/10000 (97.97%), error:       666.83539, best error:       642.77185 on epoch:    20, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 238.8208160400s, input_fired_time: 3.4205057621, output_fired_time: 3.1601045132, propagate_forward_time: 88.6201477051, propagate_backward_time: 138.9057464600, weight_update_time: 0.2100390941, other_time: 4.7143096924
epoch time: 18.9560222626s, input_fired_time: 0.4062954485, output_fired_time: 0.0000000000, propagate_forward_time: 17.6724929810, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8772335052
validation[          , genome  6991] predictions:    9788/  10000 (97.88%), best:    9797/10000 (97.97%), error:       699.76904, best error:       642.77185 on epoch:    20, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 238.3084716797s, input_fired_time: 3.4223833084, output_fired_time: 3.1730494499, propagate_forward_time: 88.6139373779, propagate_backward_time: 138.4150085449, weight_update_time: 0.2086308450, other_time: 4.6840972900
epoch time: 18.8327026367s, input_fired_time: 0.4039134383, output_fired_time: 0.0000000000, propagate_forward_time: 17.5568218231, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8719673157
validation[          , genome  6991] predictions:    9734/  10000 (97.34%), best:    9797/10000 (97.97%), error:       836.54816, best error:       642.77185 on epoch:    20, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 238.9816589355s, input_fired_time: 3.4229414463, output_fired_time: 3.1846044064, propagate_forward_time: 88.6649093628, propagate_backward_time: 138.9860534668, weight_update_time: 0.2092208117, other_time: 4.7231445313
epoch time: 19.0523548126s, input_fired_time: 0.4112141132, output_fired_time: 0.0000000000, propagate_forward_time: 17.7650203705, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8761196136
validation[          , genome  6991] predictions:    9766/  10000 (97.66%), best:    9797/10000 (97.97%), error:       747.43750, best error:       642.77185 on epoch:    20, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 239.2783050537s, input_fired_time: 3.4176275730, output_fired_time: 3.1922147274, propagate_forward_time: 88.6138687134, propagate_backward_time: 139.3536987305, weight_update_time: 0.2085585892, other_time: 4.7008972168
epoch time: 19.0254077911s, input_fired_time: 0.4071549773, output_fired_time: 0.0000000000, propagate_forward_time: 17.7385616302, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8796920776
validation[          , genome  6991] predictions:    9783/  10000 (97.83%), best:    9797/10000 (97.97%), error:       688.09845, best error:       642.77185 on epoch:    20, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 238.1715240479s, input_fired_time: 3.4117436409, output_fired_time: 3.1719295979, propagate_forward_time: 88.1683578491, propagate_backward_time: 138.7148284912, weight_update_time: 0.2088719904, other_time: 4.7046661377
epoch time: 18.8348464966s, input_fired_time: 0.4047355056, output_fired_time: 0.0000000000, propagate_forward_time: 17.5563716888, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8737392426
validation[          , genome  6991] predictions:    9753/  10000 (97.53%), best:    9797/10000 (97.97%), error:       809.29449, best error:       642.77185 on epoch:    20, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 239.6147460938s, input_fired_time: 3.4316494465, output_fired_time: 3.1962904930, propagate_forward_time: 88.8707809448, propagate_backward_time: 139.3825225830, weight_update_time: 0.2118245512, other_time: 4.7335052490
epoch time: 19.5809650421s, input_fired_time: 0.4151750505, output_fired_time: 0.0000000000, propagate_forward_time: 18.2817420959, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8840484619
validation[          , genome  6991] predictions:    9757/  10000 (97.57%), best:    9797/10000 (97.97%), error:       764.37543, best error:       642.77185 on epoch:    20, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 246.2408447266s, input_fired_time: 3.5062854290, output_fired_time: 3.2802982330, propagate_forward_time: 92.0829391479, propagate_backward_time: 142.6458129883, weight_update_time: 0.2115376741, other_time: 4.7254943848
epoch time: 19.5245056152s, input_fired_time: 0.4135110974, output_fired_time: 0.0000000000, propagate_forward_time: 18.2219219208, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8890724182
validation[          , genome  6991] predictions:    9793/  10000 (97.93%), best:    9797/10000 (97.97%), error:       667.05060, best error:       642.77185 on epoch:    20, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 245.3412933350s, input_fired_time: 3.4917721748, output_fired_time: 3.2485656738, propagate_forward_time: 91.8701477051, propagate_backward_time: 141.9696350098, weight_update_time: 0.2157174349, other_time: 4.7611694336
epoch time: 19.5652370453s, input_fired_time: 0.4159289598, output_fired_time: 0.0000000000, propagate_forward_time: 18.2564449310, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8928623199
validation[          , genome  6991] predictions:    9772/  10000 (97.72%), best:    9797/10000 (97.97%), error:       720.85193, best error:       642.77185 on epoch:    20, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 245.0496063232s, input_fired_time: 3.4903070927, output_fired_time: 3.2717196941, propagate_forward_time: 91.2942962646, propagate_backward_time: 142.2589569092, weight_update_time: 0.2114147693, other_time: 4.7343292236
epoch time: 19.3927288055s, input_fired_time: 0.4150377512, output_fired_time: 0.0000000000, propagate_forward_time: 18.1037750244, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8739166260
validation[          , genome  6991] predictions:    9782/  10000 (97.82%), best:    9797/10000 (97.97%), error:       721.23096, best error:       642.77185 on epoch:    20, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 245.7667999268s, input_fired_time: 3.4965031147, output_fired_time: 3.2783303261, propagate_forward_time: 91.7427139282, propagate_backward_time: 142.5120086670, weight_update_time: 0.2128206640, other_time: 4.7372283936
epoch time: 19.5159721375s, input_fired_time: 0.4275480509, output_fired_time: 0.0000000000, propagate_forward_time: 18.2130355835, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8753890991
validation[          , genome  6991] predictions:    9814/  10000 (98.14%), best:    9814/10000 (98.14%), error:       614.29657, best error:       614.29657 on epoch:    33, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 245.5756225586s, input_fired_time: 3.4958012104, output_fired_time: 3.2459659576, propagate_forward_time: 92.1975860596, propagate_backward_time: 141.8736877441, weight_update_time: 0.2135658562, other_time: 4.7625732422
epoch time: 19.5784797668s, input_fired_time: 0.4202116132, output_fired_time: 0.0000000000, propagate_forward_time: 18.2690792084, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8891887665
validation[          , genome  6991] predictions:    9798/  10000 (97.98%), best:    9814/10000 (98.14%), error:       644.17291, best error:       614.29657 on epoch:    33, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 245.4517211914s, input_fired_time: 3.4873106480, output_fired_time: 3.2756719589, propagate_forward_time: 91.7919998169, propagate_backward_time: 142.1520996094, weight_update_time: 0.2115427852, other_time: 4.7446594238
epoch time: 18.9233894348s, input_fired_time: 0.4062843025, output_fired_time: 0.0000000000, propagate_forward_time: 17.6574268341, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8596782684
validation[          , genome  6991] predictions:    9790/  10000 (97.90%), best:    9814/10000 (98.14%), error:       649.44830, best error:       614.29657 on epoch:    33, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 245.0580139160s, input_fired_time: 3.5113770962, output_fired_time: 3.2395114899, propagate_forward_time: 91.4847335815, propagate_backward_time: 142.0507202148, weight_update_time: 0.2146002948, other_time: 4.7716674805
epoch time: 19.2404994965s, input_fired_time: 0.4129210711, output_fired_time: 0.0000000000, propagate_forward_time: 17.9657783508, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8617992401
validation[          , genome  6991] predictions:    9788/  10000 (97.88%), best:    9814/10000 (98.14%), error:       665.58124, best error:       614.29657 on epoch:    33, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 347.9764404297s, input_fired_time: 4.7774858475, output_fired_time: 4.6509976387, propagate_forward_time: 131.3081665039, propagate_backward_time: 201.4054718018, weight_update_time: 0.2349942029, other_time: 5.8343048096
epoch time: 30.9947872162s, input_fired_time: 0.7312771678, output_fired_time: 0.0000000000, propagate_forward_time: 28.7957687378, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4677410126
validation[          , genome  6991] predictions:    9637/  10000 (96.37%), best:    9814/10000 (98.14%), error:      1181.37012, best error:       614.29657 on epoch:    33, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 384.7169799805s, input_fired_time: 6.1151590347, output_fired_time: 4.7925314903, propagate_forward_time: 142.3100738525, propagate_backward_time: 223.0347290039, weight_update_time: 0.2398590147, other_time: 8.4644622803
epoch time: 30.7249870300s, input_fired_time: 0.4753452837, output_fired_time: 0.0000000000, propagate_forward_time: 28.7750473022, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4745941162
validation[          , genome  6991] predictions:    9806/  10000 (98.06%), best:    9814/10000 (98.14%), error:       628.30762, best error:       614.29657 on epoch:    33, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 384.9544372559s, input_fired_time: 5.1537322998, output_fired_time: 5.2929363251, propagate_forward_time: 145.7897033691, propagate_backward_time: 221.7477264404, weight_update_time: 0.2405174971, other_time: 6.9703521729
epoch time: 30.8227081299s, input_fired_time: 0.4698657691, output_fired_time: 0.0000000000, propagate_forward_time: 28.8857822418, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4670600891
validation[          , genome  6991] predictions:    9810/  10000 (98.10%), best:    9810/10000 (98.10%), error:       594.08496, best error:       594.08496 on epoch:    39, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 381.5479431152s, input_fired_time: 5.3419170380, output_fired_time: 4.0195474625, propagate_forward_time: 143.2223663330, propagate_backward_time: 221.7879638672, weight_update_time: 0.4895603657, other_time: 7.1761322021
epoch time: 30.5687046051s, input_fired_time: 0.4730994701, output_fired_time: 0.0000000000, propagate_forward_time: 29.1207580566, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9748477936
validation[          , genome  6991] predictions:    9821/  10000 (98.21%), best:    9821/10000 (98.21%), error:       566.17755, best error:       566.17755 on epoch:    40, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 383.0901489258s, input_fired_time: 4.6064190865, output_fired_time: 5.0377492905, propagate_forward_time: 143.7569885254, propagate_backward_time: 221.2382354736, weight_update_time: 0.2403164506, other_time: 8.4507598877
epoch time: 30.9443264008s, input_fired_time: 0.4748198092, output_fired_time: 0.0000000000, propagate_forward_time: 29.2433032990, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2262039185
validation[          , genome  6991] predictions:    9806/  10000 (98.06%), best:    9821/10000 (98.21%), error:       642.03052, best error:       566.17755 on epoch:    40, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 383.0821838379s, input_fired_time: 4.8644928932, output_fired_time: 4.7767953873, propagate_forward_time: 145.8160095215, propagate_backward_time: 220.1811676025, weight_update_time: 0.4919165075, other_time: 7.4437103271
epoch time: 30.8271408081s, input_fired_time: 0.7263759375, output_fired_time: 0.0000000000, propagate_forward_time: 29.1350078583, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9657573700
validation[          , genome  6991] predictions:    9781/  10000 (97.81%), best:    9821/10000 (98.21%), error:       659.09082, best error:       566.17755 on epoch:    40, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 384.0521850586s, input_fired_time: 5.3764395714, output_fired_time: 4.7954092026, propagate_forward_time: 144.1573638916, propagate_backward_time: 222.0345611572, weight_update_time: 0.4901084006, other_time: 7.6884155273
epoch time: 31.1621303558s, input_fired_time: 0.4797588885, output_fired_time: 0.0000000000, propagate_forward_time: 29.4578037262, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2245674133
validation[          , genome  6991] predictions:    9826/  10000 (98.26%), best:    9821/10000 (98.21%), error:       606.25079, best error:       566.17755 on epoch:    40, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 366.1236877441s, input_fired_time: 4.9931898117, output_fired_time: 3.8759503365, propagate_forward_time: 136.8577880859, propagate_backward_time: 213.5915069580, weight_update_time: 0.4817615151, other_time: 6.8052520752
epoch time: 29.2628288269s, input_fired_time: 0.9565975666, output_fired_time: 0.0000000000, propagate_forward_time: 27.1165695190, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1896610260
validation[          , genome  6991] predictions:    9784/  10000 (97.84%), best:    9821/10000 (98.21%), error:       665.48657, best error:       566.17755 on epoch:    40, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 364.0109252930s, input_fired_time: 5.4651288986, output_fired_time: 5.1134128571, propagate_forward_time: 136.8533935547, propagate_backward_time: 209.7705078125, weight_update_time: 0.2314535826, other_time: 6.8085021973
epoch time: 29.0691909790s, input_fired_time: 0.7026648521, output_fired_time: 0.0000000000, propagate_forward_time: 27.4333076477, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9332180023
validation[          , genome  6991] predictions:    9818/  10000 (98.18%), best:    9821/10000 (98.21%), error:       584.46167, best error:       566.17755 on epoch:    40, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 365.3024291992s, input_fired_time: 4.2319021225, output_fired_time: 4.1180586815, propagate_forward_time: 137.4437561035, propagate_backward_time: 213.9514160156, weight_update_time: 0.2318951190, other_time: 5.5572814941
epoch time: 29.3771057129s, input_fired_time: 0.7093937993, output_fired_time: 0.0000000000, propagate_forward_time: 27.2217903137, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4459209442
validation[          , genome  6991] predictions:    9018/  10000 (90.18%), best:    9821/10000 (98.21%), error:      3291.64331, best error:       566.17755 on epoch:    40, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

resetting weights to those on epoch: 40
epoch time: 366.6388244629s, input_fired_time: 4.7388353348, output_fired_time: 5.3781390190, propagate_forward_time: 137.3860015869, propagate_backward_time: 212.0645751953, weight_update_time: 0.2324236631, other_time: 7.0712738037
epoch time: 29.3305568695s, input_fired_time: 0.7077005506, output_fired_time: 0.0000000000, propagate_forward_time: 27.4343929291, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1884632111
validation[          , genome  6991] predictions:    9796/  10000 (97.96%), best:    9821/10000 (98.21%), error:       619.09656, best error:       566.17755 on epoch:    40, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 367.9075622559s, input_fired_time: 4.7520303726, output_fired_time: 5.1640429497, propagate_forward_time: 138.8962554932, propagate_backward_time: 212.0054473877, weight_update_time: 0.2340891361, other_time: 7.0897827148
epoch time: 29.3076744080s, input_fired_time: 0.4572869241, output_fired_time: 0.0000000000, propagate_forward_time: 27.9005966187, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9497909546
validation[          , genome  6991] predictions:    9830/  10000 (98.30%), best:    9830/10000 (98.30%), error:       542.20038, best error:       542.20038 on epoch:    48, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 365.2794189453s, input_fired_time: 4.7381577492, output_fired_time: 5.6072559357, propagate_forward_time: 135.5609741211, propagate_backward_time: 213.0437927246, weight_update_time: 0.2337597758, other_time: 6.3292236328
epoch time: 29.2403945923s, input_fired_time: 0.9587270617, output_fired_time: 0.0000000000, propagate_forward_time: 26.8404579163, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4412097931
validation[          , genome  6991] predictions:    9817/  10000 (98.17%), best:    9830/10000 (98.30%), error:       613.35724, best error:       542.20038 on epoch:    48, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 366.7099609375s, input_fired_time: 5.4989781380, output_fired_time: 5.1305923462, propagate_forward_time: 136.2089080811, propagate_backward_time: 212.8031158447, weight_update_time: 0.2352312654, other_time: 7.0683593750
epoch time: 29.6073722839s, input_fired_time: 0.4587901831, output_fired_time: 0.0000000000, propagate_forward_time: 27.2022018433, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9463806152
validation[          , genome  6991] predictions:    9810/  10000 (98.10%), best:    9830/10000 (98.30%), error:       588.66412, best error:       542.20038 on epoch:    48, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 365.0102539063s, input_fired_time: 4.4869480133, output_fired_time: 4.8770265579, propagate_forward_time: 135.1178741455, propagate_backward_time: 214.7197875977, weight_update_time: 0.2328077555, other_time: 5.8086395264
epoch time: 29.4453697205s, input_fired_time: 0.4553976953, output_fired_time: 0.0000000000, propagate_forward_time: 28.0532455444, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9367256165
validation[          , genome  6991] predictions:    9816/  10000 (98.16%), best:    9830/10000 (98.30%), error:       633.51459, best error:       542.20038 on epoch:    48, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 366.7078857422s, input_fired_time: 4.7577948570, output_fired_time: 4.1322946548, propagate_forward_time: 137.7200622559, propagate_backward_time: 213.7602233887, weight_update_time: 0.2334315330, other_time: 6.3375244141
epoch time: 29.6920814514s, input_fired_time: 0.7062387466, output_fired_time: 0.0000000000, propagate_forward_time: 27.7921772003, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1936664581
validation[          , genome  6991] predictions:    9742/  10000 (97.42%), best:    9830/10000 (98.30%), error:       840.87079, best error:       542.20038 on epoch:    48, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 375.2582397461s, input_fired_time: 4.0661296844, output_fired_time: 4.4611401558, propagate_forward_time: 141.3182525635, propagate_backward_time: 218.7827606201, weight_update_time: 0.2378935367, other_time: 6.6299438477
epoch time: 30.6315326691s, input_fired_time: 0.4780827761, output_fired_time: 0.0000000000, propagate_forward_time: 28.1747455597, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9787044525
validation[          , genome  6991] predictions:    9742/  10000 (97.42%), best:    9830/10000 (98.30%), error:       848.17798, best error:       542.20038 on epoch:    48, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 385.8078002930s, input_fired_time: 5.6389884949, output_fired_time: 6.3076267242, propagate_forward_time: 146.0212707520, propagate_backward_time: 221.1123352051, weight_update_time: 0.2429667413, other_time: 6.7276000977
epoch time: 31.0044822693s, input_fired_time: 0.7299994230, output_fired_time: 0.0000000000, propagate_forward_time: 28.8027496338, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4717330933
validation[          , genome  6991] predictions:    9782/  10000 (97.82%), best:    9830/10000 (98.30%), error:       680.10162, best error:       542.20038 on epoch:    48, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 385.1882324219s, input_fired_time: 6.1302928925, output_fired_time: 5.7934780121, propagate_forward_time: 144.0964050293, propagate_backward_time: 222.9325103760, weight_update_time: 0.2411153764, other_time: 6.2355499268
epoch time: 30.9564304352s, input_fired_time: 0.4782588482, output_fired_time: 0.0000000000, propagate_forward_time: 29.2560844421, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2220878601
validation[          , genome  6991] predictions:    9790/  10000 (97.90%), best:    9830/10000 (98.30%), error:       686.53595, best error:       542.20038 on epoch:    48, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 386.3099975586s, input_fired_time: 4.8918719292, output_fired_time: 4.8345584869, propagate_forward_time: 145.5848236084, propagate_backward_time: 223.7405242920, weight_update_time: 0.2422988862, other_time: 7.2582092285
epoch time: 30.8603420258s, input_fired_time: 0.9713332653, output_fired_time: 0.0000000000, propagate_forward_time: 28.1685657501, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7204437256
validation[          , genome  6991] predictions:    9811/  10000 (98.11%), best:    9830/10000 (98.30%), error:       611.79895, best error:       542.20038 on epoch:    48, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 384.5280151367s, input_fired_time: 5.1361217499, output_fired_time: 4.2979683876, propagate_forward_time: 144.7728118896, propagate_backward_time: 223.1050262451, weight_update_time: 0.2422292978, other_time: 7.2160949707
epoch time: 31.1808509827s, input_fired_time: 0.7414582968, output_fired_time: 0.0000000000, propagate_forward_time: 29.4654502869, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9739418030
validation[          , genome  6991] predictions:    9831/  10000 (98.31%), best:    9830/10000 (98.30%), error:       596.52258, best error:       542.20038 on epoch:    48, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 384.2339172363s, input_fired_time: 5.1398630142, output_fired_time: 4.3013448715, propagate_forward_time: 143.9343719482, propagate_backward_time: 223.3612060547, weight_update_time: 0.2401760221, other_time: 7.4971466064
epoch time: 31.0195751190s, input_fired_time: 0.4780324101, output_fired_time: 0.0000000000, propagate_forward_time: 29.5672836304, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9742584229
validation[          , genome  6991] predictions:    9812/  10000 (98.12%), best:    9830/10000 (98.30%), error:       642.07587, best error:       542.20038 on epoch:    48, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 386.3793640137s, input_fired_time: 5.6462988853, output_fired_time: 4.5796537399, propagate_forward_time: 145.5182342529, propagate_backward_time: 223.9218597412, weight_update_time: 0.2410145253, other_time: 6.7133178711
epoch time: 30.8907070160s, input_fired_time: 0.4730708897, output_fired_time: 0.0000000000, propagate_forward_time: 28.9473514557, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4702854156
validation[          , genome  6991] predictions:    9809/  10000 (98.09%), best:    9830/10000 (98.30%), error:       649.63391, best error:       542.20038 on epoch:    48, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 384.3239440918s, input_fired_time: 4.6291246414, output_fired_time: 5.7935996056, propagate_forward_time: 145.2669830322, propagate_backward_time: 222.1867675781, weight_update_time: 0.2388545871, other_time: 6.4474639893
epoch time: 30.9703464508s, input_fired_time: 0.7284702063, output_fired_time: 0.0000000000, propagate_forward_time: 29.0199813843, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2218952179
validation[          , genome  6991] predictions:    9839/  10000 (98.39%), best:    9830/10000 (98.30%), error:       560.36420, best error:       542.20038 on epoch:    48, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 374.2900390625s, input_fired_time: 5.3060708046, output_fired_time: 4.2004261017, propagate_forward_time: 140.8834533691, propagate_backward_time: 216.5246734619, weight_update_time: 0.4863071442, other_time: 7.3754119873
epoch time: 29.4717826843s, input_fired_time: 0.4585503638, output_fired_time: 0.0000000000, propagate_forward_time: 27.5663051605, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4469280243
validation[          , genome  6991] predictions:    9777/  10000 (97.77%), best:    9830/10000 (98.30%), error:       736.81317, best error:       542.20038 on epoch:    48, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 365.0149536133s, input_fired_time: 5.9897379875, output_fired_time: 4.5949082375, propagate_forward_time: 135.4819488525, propagate_backward_time: 212.3809814453, weight_update_time: 0.2332927883, other_time: 6.5673675537
epoch time: 29.7112255096s, input_fired_time: 0.4591465294, output_fired_time: 0.0000000000, propagate_forward_time: 28.0534954071, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1985836029
validation[          , genome  6991] predictions:    9801/  10000 (98.01%), best:    9830/10000 (98.30%), error:       655.98694, best error:       542.20038 on epoch:    48, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 363.4409484863s, input_fired_time: 4.9746484756, output_fired_time: 4.5907163620, propagate_forward_time: 135.8066253662, propagate_backward_time: 211.7767791748, weight_update_time: 0.2317297012, other_time: 6.2921752930
epoch time: 29.3333911896s, input_fired_time: 0.4702909887, output_fired_time: 0.0000000000, propagate_forward_time: 27.9157543182, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9473457336
validation[          , genome  6991] predictions:    9730/  10000 (97.30%), best:    9830/10000 (98.30%), error:       907.25970, best error:       542.20038 on epoch:    48, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 366.3358764648s, input_fired_time: 4.5029749870, output_fired_time: 4.8911328316, propagate_forward_time: 136.8062744141, propagate_backward_time: 213.0711517334, weight_update_time: 0.4824929237, other_time: 7.0643463135
epoch time: 29.6270027161s, input_fired_time: 0.9584944248, output_fired_time: 0.0000000000, propagate_forward_time: 27.2192783356, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4492301941
validation[          , genome  6991] predictions:    9789/  10000 (97.89%), best:    9830/10000 (98.30%), error:       649.71985, best error:       542.20038 on epoch:    48, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 365.5180664063s, input_fired_time: 4.7556629181, output_fired_time: 5.6012392044, propagate_forward_time: 136.0208740234, propagate_backward_time: 212.3391418457, weight_update_time: 0.2320246845, other_time: 6.8011474609
epoch time: 28.9720935822s, input_fired_time: 0.4584152699, output_fired_time: 0.0000000000, propagate_forward_time: 27.3338909149, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1797866821
validation[          , genome  6991] predictions:    9788/  10000 (97.88%), best:    9830/10000 (98.30%), error:       721.40125, best error:       542.20038 on epoch:    48, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 364.0365600586s, input_fired_time: 5.4921040535, output_fired_time: 4.1236844063, propagate_forward_time: 136.2350463867, propagate_backward_time: 210.8919830322, weight_update_time: 0.2309608757, other_time: 7.2937469482
epoch time: 28.9327754974s, input_fired_time: 0.9559681416, output_fired_time: 0.0000000000, propagate_forward_time: 26.5435924530, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4332141876
validation[          , genome  6991] predictions:    9801/  10000 (98.01%), best:    9830/10000 (98.30%), error:       608.26007, best error:       542.20038 on epoch:    48, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 366.1978149414s, input_fired_time: 5.2484903336, output_fired_time: 4.1081976891, propagate_forward_time: 136.4112548828, propagate_backward_time: 212.8691558838, weight_update_time: 0.4837081134, other_time: 7.5607147217
epoch time: 29.0391139984s, input_fired_time: 0.9551612735, output_fired_time: 0.0000000000, propagate_forward_time: 26.9010753632, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1828765869
validation[          , genome  6991] predictions:    9793/  10000 (97.93%), best:    9830/10000 (98.30%), error:       619.14514, best error:       542.20038 on epoch:    48, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 365.9032592773s, input_fired_time: 5.2480401993, output_fired_time: 4.3715677261, propagate_forward_time: 137.2267150879, propagate_backward_time: 212.2327575684, weight_update_time: 0.2329880595, other_time: 6.8241577148
epoch time: 29.2081165314s, input_fired_time: 0.4576085508, output_fired_time: 0.0000000000, propagate_forward_time: 27.3110771179, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4394302368
validation[          , genome  6991] predictions:    9826/  10000 (98.26%), best:    9830/10000 (98.30%), error:       595.84753, best error:       542.20038 on epoch:    48, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 366.1011047363s, input_fired_time: 4.7536005974, output_fired_time: 4.3900732994, propagate_forward_time: 137.0651550293, propagate_backward_time: 212.8398132324, weight_update_time: 0.4841130078, other_time: 7.0524597168
epoch time: 29.1517295837s, input_fired_time: 0.7061181068, output_fired_time: 0.0000000000, propagate_forward_time: 27.2566967010, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1889152527
validation[          , genome  6991] predictions:    9786/  10000 (97.86%), best:    9830/10000 (98.30%), error:       720.14648, best error:       542.20038 on epoch:    48, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 369.2600708008s, input_fired_time: 4.7719416618, output_fired_time: 3.6478662491, propagate_forward_time: 138.4972229004, propagate_backward_time: 215.7708282471, weight_update_time: 0.4841361940, other_time: 6.5722198486
epoch time: 30.3341140747s, input_fired_time: 0.7204381824, output_fired_time: 0.0000000000, propagate_forward_time: 28.6513595581, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9623165131
validation[          , genome  6991] predictions:    9805/  10000 (98.05%), best:    9830/10000 (98.30%), error:       625.20825, best error:       542.20038 on epoch:    48, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 384.9841918945s, input_fired_time: 5.6256122589, output_fired_time: 5.5529580116, propagate_forward_time: 143.7747192383, propagate_backward_time: 222.7887573242, weight_update_time: 0.2411624789, other_time: 7.2421569824
epoch time: 30.9038238525s, input_fired_time: 1.2246693373, output_fired_time: 0.0000000000, propagate_forward_time: 28.2021846771, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4769706726
validation[          , genome  6991] predictions:    9776/  10000 (97.76%), best:    9830/10000 (98.30%), error:       713.45709, best error:       542.20038 on epoch:    48, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 384.5838012695s, input_fired_time: 5.8851346970, output_fired_time: 5.8145365715, propagate_forward_time: 143.2034912109, propagate_backward_time: 222.4698333740, weight_update_time: 0.2405314147, other_time: 7.2108001709
epoch time: 30.9019813538s, input_fired_time: 0.7281047106, output_fired_time: 0.0000000000, propagate_forward_time: 28.7065792084, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4672966003
validation[          , genome  6991] predictions:    9775/  10000 (97.75%), best:    9830/10000 (98.30%), error:       759.57043, best error:       542.20038 on epoch:    48, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 385.3698120117s, input_fired_time: 4.8839788437, output_fired_time: 5.0424771309, propagate_forward_time: 145.1622467041, propagate_backward_time: 223.5451965332, weight_update_time: 0.2446424961, other_time: 6.7359161377
epoch time: 31.0534229279s, input_fired_time: 0.9763566256, output_fired_time: 0.0000000000, propagate_forward_time: 28.8555393219, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2215270996
validation[          , genome  6991] predictions:    9778/  10000 (97.78%), best:    9830/10000 (98.30%), error:       702.71808, best error:       542.20038 on epoch:    48, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 384.5869140625s, input_fired_time: 4.8819637299, output_fired_time: 4.8008604050, propagate_forward_time: 143.6148834229, propagate_backward_time: 223.8181457520, weight_update_time: 0.2395568639, other_time: 7.4710540771
epoch time: 30.3580188751s, input_fired_time: 0.4693122208, output_fired_time: 0.0000000000, propagate_forward_time: 28.9247646332, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9639415741
validation[          , genome  6991] predictions:    9808/  10000 (98.08%), best:    9830/10000 (98.30%), error:       655.93182, best error:       542.20038 on epoch:    48, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 384.1726074219s, input_fired_time: 6.1230525970, output_fired_time: 5.2964792252, propagate_forward_time: 144.4209899902, propagate_backward_time: 221.6212005615, weight_update_time: 0.2416085452, other_time: 6.7108917236
epoch time: 30.7830600739s, input_fired_time: 0.4754498005, output_fired_time: 0.0000000000, propagate_forward_time: 29.3192863464, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9883232117
validation[          , genome  6991] predictions:    9828/  10000 (98.28%), best:    9830/10000 (98.30%), error:       578.46655, best error:       542.20038 on epoch:    48, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 384.1342163086s, input_fired_time: 4.6256928444, output_fired_time: 4.7963018417, propagate_forward_time: 145.1351013184, propagate_backward_time: 222.8822479248, weight_update_time: 0.2392763048, other_time: 6.6948699951
epoch time: 30.9623165131s, input_fired_time: 0.7290333509, output_fired_time: 0.0000000000, propagate_forward_time: 28.7615737915, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4717102051
validation[          , genome  6991] predictions:    9797/  10000 (97.97%), best:    9830/10000 (98.30%), error:       647.44702, best error:       542.20038 on epoch:    48, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 382.1333007813s, input_fired_time: 5.1517238617, output_fired_time: 5.0278635025, propagate_forward_time: 144.6095428467, propagate_backward_time: 220.6474456787, weight_update_time: 0.2399490923, other_time: 6.6967163086
epoch time: 31.0230350494s, input_fired_time: 0.4746553898, output_fired_time: 0.0000000000, propagate_forward_time: 29.5912799835, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9570999146
validation[          , genome  6991] predictions:    9786/  10000 (97.86%), best:    9830/10000 (98.30%), error:       722.09967, best error:       542.20038 on epoch:    48, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 384.8752746582s, input_fired_time: 5.3797855377, output_fired_time: 5.3119578362, propagate_forward_time: 145.8675384521, propagate_backward_time: 221.3584747314, weight_update_time: 0.2403470576, other_time: 6.9575195313
epoch time: 30.8586597443s, input_fired_time: 0.4809190035, output_fired_time: 0.0000000000, propagate_forward_time: 29.4137229919, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9640178680
validation[          , genome  6991] predictions:    9826/  10000 (98.26%), best:    9830/10000 (98.30%), error:       580.71802, best error:       542.20038 on epoch:    48, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 367.8169250488s, input_fired_time: 5.0010700226, output_fired_time: 4.9033689499, propagate_forward_time: 140.0507354736, propagate_backward_time: 210.5357360840, weight_update_time: 0.2333972454, other_time: 7.3260040283
epoch time: 29.1179523468s, input_fired_time: 0.4564700127, output_fired_time: 0.0000000000, propagate_forward_time: 27.4705448151, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1909370422
validation[          , genome  6991] predictions:    9793/  10000 (97.93%), best:    9830/10000 (98.30%), error:       684.19220, best error:       542.20038 on epoch:    48, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 364.1368713379s, input_fired_time: 4.4724330902, output_fired_time: 4.6026754379, propagate_forward_time: 137.2271575928, propagate_backward_time: 212.2775878906, weight_update_time: 0.2315709144, other_time: 5.5570220947
epoch time: 29.2887763977s, input_fired_time: 0.9632673264, output_fired_time: 0.0000000000, propagate_forward_time: 27.3823795319, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9431285858
validation[          , genome  6991] predictions:    9779/  10000 (97.79%), best:    9830/10000 (98.30%), error:       738.32910, best error:       542.20038 on epoch:    48, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 364.4206237793s, input_fired_time: 5.2387466431, output_fired_time: 5.1247038841, propagate_forward_time: 135.0439605713, propagate_backward_time: 212.4835510254, weight_update_time: 0.2313220352, other_time: 6.5296783447
epoch time: 29.3442363739s, input_fired_time: 0.7058522105, output_fired_time: 0.0000000000, propagate_forward_time: 27.7022323608, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9361515045
validation[          , genome  6991] predictions:    9823/  10000 (98.23%), best:    9830/10000 (98.30%), error:       608.63208, best error:       542.20038 on epoch:    48, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 366.0307617188s, input_fired_time: 5.5095677376, output_fired_time: 4.6016354561, propagate_forward_time: 136.7492675781, propagate_backward_time: 212.0773620605, weight_update_time: 0.2345183045, other_time: 7.0929260254
epoch time: 29.2188301086s, input_fired_time: 0.7042577267, output_fired_time: 0.0000000000, propagate_forward_time: 27.5753211975, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9392509460
validation[          , genome  6991] predictions:    9776/  10000 (97.76%), best:    9830/10000 (98.30%), error:       723.50983, best error:       542.20038 on epoch:    48, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 364.4835815430s, input_fired_time: 4.4906959534, output_fired_time: 4.3768577576, propagate_forward_time: 137.6725158691, propagate_backward_time: 211.8985290527, weight_update_time: 0.2319484502, other_time: 6.0449829102
epoch time: 29.1584243774s, input_fired_time: 0.7064532638, output_fired_time: 0.0000000000, propagate_forward_time: 26.7622737885, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6896972656
validation[          , genome  6991] predictions:    9783/  10000 (97.83%), best:    9830/10000 (98.30%), error:       675.46661, best error:       542.20038 on epoch:    48, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 365.0939331055s, input_fired_time: 6.0041131973, output_fired_time: 3.8761873245, propagate_forward_time: 135.6746063232, propagate_backward_time: 213.2359161377, weight_update_time: 0.2323038280, other_time: 6.3031005859
epoch time: 29.5409240723s, input_fired_time: 0.4582876265, output_fired_time: 0.0000000000, propagate_forward_time: 27.6320629120, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4505729675
validation[          , genome  6991] predictions:    9744/  10000 (97.44%), best:    9830/10000 (98.30%), error:       817.21198, best error:       542.20038 on epoch:    48, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 365.1957092285s, input_fired_time: 5.7507266998, output_fired_time: 5.3424248695, propagate_forward_time: 134.5868072510, propagate_backward_time: 212.9367523193, weight_update_time: 0.2314439118, other_time: 6.5789794922
epoch time: 29.2710933685s, input_fired_time: 0.7082471848, output_fired_time: 0.0000000000, propagate_forward_time: 27.6221122742, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9407348633
validation[          , genome  6991] predictions:    9823/  10000 (98.23%), best:    9830/10000 (98.30%), error:       610.46881, best error:       542.20038 on epoch:    48, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 364.4679565430s, input_fired_time: 5.0002212524, output_fired_time: 4.1168460846, propagate_forward_time: 137.1995849609, propagate_backward_time: 211.1063385010, weight_update_time: 0.7331431508, other_time: 7.0449676514
epoch time: 28.9948062897s, input_fired_time: 0.7068934441, output_fired_time: 0.0000000000, propagate_forward_time: 27.1039009094, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1840114594
validation[          , genome  6991] predictions:    9797/  10000 (97.97%), best:    9830/10000 (98.30%), error:       685.35028, best error:       542.20038 on epoch:    48, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 363.7824401855s, input_fired_time: 5.4824810028, output_fired_time: 4.8630471230, propagate_forward_time: 135.1568450928, propagate_backward_time: 211.7434692383, weight_update_time: 0.4810385406, other_time: 6.5366058350
epoch time: 29.2720012665s, input_fired_time: 0.4598236382, output_fired_time: 0.0000000000, propagate_forward_time: 27.6176815033, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1944961548
validation[          , genome  6991] predictions:    9708/  10000 (97.08%), best:    9830/10000 (98.30%), error:       955.67548, best error:       542.20038 on epoch:    48, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 374.4083862305s, input_fired_time: 5.0608782768, output_fired_time: 4.9516577721, propagate_forward_time: 141.0314025879, propagate_backward_time: 215.2314453125, weight_update_time: 0.7363367081, other_time: 8.1329956055
epoch time: 30.9451541901s, input_fired_time: 0.4778655767, output_fired_time: 0.0000000000, propagate_forward_time: 29.4959964752, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9712924957
validation[          , genome  6991] predictions:    9792/  10000 (97.92%), best:    9830/10000 (98.30%), error:       653.51337, best error:       542.20038 on epoch:    48, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 382.4112548828s, input_fired_time: 4.8728594780, output_fired_time: 5.7883605957, propagate_forward_time: 144.0502777100, propagate_backward_time: 220.7784118652, weight_update_time: 0.2399656177, other_time: 6.9213409424
epoch time: 30.5462265015s, input_fired_time: 0.7305852771, output_fired_time: 0.0000000000, propagate_forward_time: 28.8416500092, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9739913940
validation[          , genome  6991] predictions:    9818/  10000 (98.18%), best:    9830/10000 (98.30%), error:       604.73248, best error:       542.20038 on epoch:    48, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 384.3009033203s, input_fired_time: 4.8963475227, output_fired_time: 5.5507020950, propagate_forward_time: 144.6848907471, propagate_backward_time: 222.9682464600, weight_update_time: 0.2398800552, other_time: 6.2007141113
epoch time: 30.3830223083s, input_fired_time: 0.4731209278, output_fired_time: 0.0000000000, propagate_forward_time: 28.9497089386, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9601917267
validation[          , genome  6991] predictions:    9808/  10000 (98.08%), best:    9830/10000 (98.30%), error:       657.64111, best error:       542.20038 on epoch:    48, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 383.0511779785s, input_fired_time: 4.8698120117, output_fired_time: 5.2931098938, propagate_forward_time: 144.9020996094, propagate_backward_time: 221.8086700439, weight_update_time: 0.2401679009, other_time: 6.1774749756
epoch time: 31.0518512726s, input_fired_time: 0.7303395271, output_fired_time: 0.0000000000, propagate_forward_time: 28.8472175598, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4742946625
validation[          , genome  6991] predictions:    9807/  10000 (98.07%), best:    9830/10000 (98.30%), error:       637.91528, best error:       542.20038 on epoch:    48, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 382.3178710938s, input_fired_time: 4.3694343567, output_fired_time: 6.0195002556, propagate_forward_time: 143.6720275879, propagate_backward_time: 221.0710906982, weight_update_time: 0.2425417304, other_time: 7.1858062744
epoch time: 30.4932422638s, input_fired_time: 0.7262812257, output_fired_time: 0.0000000000, propagate_forward_time: 28.0487442017, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7182159424
validation[          , genome  6991] predictions:    9811/  10000 (98.11%), best:    9830/10000 (98.30%), error:       606.31110, best error:       542.20038 on epoch:    48, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 381.8902282715s, input_fired_time: 5.6174993515, output_fired_time: 4.0370192528, propagate_forward_time: 143.6800537109, propagate_backward_time: 220.1403198242, weight_update_time: 0.7396140695, other_time: 8.4153442383
epoch time: 30.6284809113s, input_fired_time: 0.4818955958, output_fired_time: 0.0000000000, propagate_forward_time: 29.1799488068, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9666366577
validation[          , genome  6991] predictions:    9815/  10000 (98.15%), best:    9830/10000 (98.30%), error:       623.48676, best error:       542.20038 on epoch:    48, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 382.2139282227s, input_fired_time: 4.3714818954, output_fired_time: 5.0265827179, propagate_forward_time: 144.9111022949, propagate_backward_time: 221.7226867676, weight_update_time: 0.2391286045, other_time: 6.1820678711
epoch time: 30.4238281250s, input_fired_time: 0.4731116593, output_fired_time: 0.0000000000, propagate_forward_time: 28.7399063110, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2108097076
validation[          , genome  6991] predictions:    9813/  10000 (98.13%), best:    9830/10000 (98.30%), error:       622.56384, best error:       542.20038 on epoch:    48, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 383.7918701172s, input_fired_time: 5.1247253418, output_fired_time: 5.0433773994, propagate_forward_time: 145.6826019287, propagate_backward_time: 221.2427368164, weight_update_time: 0.4897526801, other_time: 6.6984405518
epoch time: 30.9778251648s, input_fired_time: 0.7285165787, output_fired_time: 0.0000000000, propagate_forward_time: 29.0310726166, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2182369232
validation[          , genome  6991] predictions:    9801/  10000 (98.01%), best:    9830/10000 (98.30%), error:       630.45081, best error:       542.20038 on epoch:    48, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 381.4553527832s, input_fired_time: 4.1028652191, output_fired_time: 5.0072627068, propagate_forward_time: 145.5407562256, propagate_backward_time: 220.6265716553, weight_update_time: 0.2398513407, other_time: 6.1778869629
epoch time: 28.9748096466s, input_fired_time: 0.4565555751, output_fired_time: 0.0000000000, propagate_forward_time: 27.3397159576, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1785373688
validation[          , genome  6991] predictions:    9821/  10000 (98.21%), best:    9830/10000 (98.30%), error:       601.34985, best error:       542.20038 on epoch:    48, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 363.1329650879s, input_fired_time: 4.9854426384, output_fired_time: 5.3362083435, propagate_forward_time: 135.4832458496, propagate_backward_time: 208.5437469482, weight_update_time: 0.4805167615, other_time: 8.7843170166
epoch time: 29.3551731110s, input_fired_time: 0.4568982720, output_fired_time: 0.0000000000, propagate_forward_time: 27.9606513977, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9376239777
validation[          , genome  6991] predictions:    9800/  10000 (98.00%), best:    9830/10000 (98.30%), error:       651.94867, best error:       542.20038 on epoch:    48, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 362.1681823730s, input_fired_time: 3.9696083069, output_fired_time: 5.0753693581, propagate_forward_time: 135.0639953613, propagate_backward_time: 210.5491027832, weight_update_time: 0.4797320366, other_time: 7.5101013184
epoch time: 28.6147212982s, input_fired_time: 0.4534935057, output_fired_time: 0.0000000000, propagate_forward_time: 27.2277011871, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9335269928
validation[          , genome  6991] predictions:    9804/  10000 (98.04%), best:    9830/10000 (98.30%), error:       626.27881, best error:       542.20038 on epoch:    48, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 361.2956848145s, input_fired_time: 5.2164583206, output_fired_time: 4.5842065811, propagate_forward_time: 135.8380126953, propagate_backward_time: 209.8791656494, weight_update_time: 0.2311351448, other_time: 5.7778472900
epoch time: 28.3771305084s, input_fired_time: 0.6995183229, output_fired_time: 0.0000000000, propagate_forward_time: 26.5004692078, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1771430969
validation[          , genome  6991] predictions:    9805/  10000 (98.05%), best:    9830/10000 (98.30%), error:       623.53339, best error:       542.20038 on epoch:    48, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 361.5224609375s, input_fired_time: 4.9778079987, output_fired_time: 5.3316011429, propagate_forward_time: 134.6692657471, propagate_backward_time: 209.5236358643, weight_update_time: 0.2300358862, other_time: 7.0201416016
epoch time: 28.9249706268s, input_fired_time: 0.4571281075, output_fired_time: 0.0000000000, propagate_forward_time: 27.5353355408, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9325065613
validation[          , genome  6991] predictions:    9807/  10000 (98.07%), best:    9830/10000 (98.30%), error:       630.46820, best error:       542.20038 on epoch:    48, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 143.2428131104s, input_fired_time: 2.7511637211, output_fired_time: 0.0000000000, propagate_forward_time: 133.7560729980, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.7355804443
best training[          , genome  6991] predictions:   49743/  50000 (99.49%), best:    9830/10000 (98.30%), error:      1010.94421, best error:       542.20038 on epoch:    48, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 28.7791461945s, input_fired_time: 0.9480313063, output_fired_time: 0.0000000000, propagate_forward_time: 26.8969078064, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9342079163
   testing[          , genome  6991] predictions:    9837/  10000 (98.37%), best:    9830/10000 (98.30%), error:       498.51584, best error:       542.20038 on epoch:    48, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
14:12:32 (5632): called boinc_finish(0)

</stderr_txt>
]]>