Nameexact_genome_1512568488_42_5361_0
Workunit2598038
Created7 Dec 2017, 14:27:17 UTC
Sent7 Dec 2017, 14:31:21 UTC
Report deadline12 Dec 2017, 10:53:08 UTC
Received8 Dec 2017, 22:35:09 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID52320
Run time2 hours 32 min 10 sec
CPU time2 hours 32 min 6 sec
Validate stateValid
Credit1,212.12
Device peak FLOPS2.93 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size156.14 MB
Peak swap size154.60 MB
Peak disk usage2.06 MB

Stderr output

<core_client_version>7.8.2</core_client_version>
<![CDATA[
<stderr_txt>
e: 6.2284817696, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4603590965
validation[          , genome  5361] predictions:    9673/  10000 (96.73%), best:    9685/10000 (96.85%), error:      1107.37866, best error:      1094.45850 on epoch:     4, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 82.7112884521s, input_fired_time: 1.0320246220, output_fired_time: 0.9740635753, propagate_forward_time: 31.3646430969, propagate_backward_time: 46.8539543152, weight_update_time: 0.1370597333, other_time: 2.4866027832
epoch time: 6.8533248901s, input_fired_time: 0.1272444874, output_fired_time: 0.0000000000, propagate_forward_time: 6.2771935463, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4488868713
validation[          , genome  5361] predictions:    9674/  10000 (96.74%), best:    9685/10000 (96.85%), error:      1110.19775, best error:      1094.45850 on epoch:     4, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 83.0799636841s, input_fired_time: 1.0596468449, output_fired_time: 0.9794386625, propagate_forward_time: 31.4321556091, propagate_backward_time: 47.0430946350, weight_update_time: 0.1408951283, other_time: 2.5656280518
epoch time: 6.8909034729s, input_fired_time: 0.1305587888, output_fired_time: 0.0000000000, propagate_forward_time: 6.2979497910, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4623947144
validation[          , genome  5361] predictions:    9642/  10000 (96.42%), best:    9685/10000 (96.85%), error:      1132.63123, best error:      1094.45850 on epoch:     4, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 82.9795913696s, input_fired_time: 1.0391225815, output_fired_time: 0.9763211608, propagate_forward_time: 31.4415302277, propagate_backward_time: 47.0338401794, weight_update_time: 0.1372365803, other_time: 2.4887809753
epoch time: 6.8590631485s, input_fired_time: 0.1338495761, output_fired_time: 0.0000000000, propagate_forward_time: 6.2647075653, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4605059624
validation[          , genome  5361] predictions:    9669/  10000 (96.69%), best:    9669/10000 (96.69%), error:      1089.49951, best error:      1089.49951 on epoch:    17, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 82.8348312378s, input_fired_time: 1.0441015959, output_fired_time: 0.9731406569, propagate_forward_time: 31.4665222168, propagate_backward_time: 46.8750343323, weight_update_time: 0.1357991397, other_time: 2.4760398865
epoch time: 6.8456683159s, input_fired_time: 0.1326296180, output_fired_time: 0.0000000000, propagate_forward_time: 6.2614755630, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4515633583
validation[          , genome  5361] predictions:    9609/  10000 (96.09%), best:    9669/10000 (96.69%), error:      1272.02441, best error:      1089.49951 on epoch:    17, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 82.3565368652s, input_fired_time: 1.0331257582, output_fired_time: 0.9645678997, propagate_forward_time: 31.2329196930, propagate_backward_time: 46.6622657776, weight_update_time: 0.1366992295, other_time: 2.4636573792
epoch time: 6.8278632164s, input_fired_time: 0.1267259419, output_fired_time: 0.0000000000, propagate_forward_time: 6.2546229362, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4465141296
validation[          , genome  5361] predictions:    9685/  10000 (96.85%), best:    9685/10000 (96.85%), error:      1071.24060, best error:      1071.24060 on epoch:    19, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 82.8793334961s, input_fired_time: 1.0385671854, output_fired_time: 0.9788135290, propagate_forward_time: 31.3828048706, propagate_backward_time: 46.9866790771, weight_update_time: 0.1375060827, other_time: 2.4924697876
epoch time: 6.8301773071s, input_fired_time: 0.1324207336, output_fired_time: 0.0000000000, propagate_forward_time: 6.2465720177, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4511847496
validation[          , genome  5361] predictions:    9154/  10000 (91.54%), best:    9685/10000 (96.85%), error:      2847.26978, best error:      1071.24060 on epoch:    19, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

resetting weights to those on epoch: 19
epoch time: 82.9580612183s, input_fired_time: 1.0460406542, output_fired_time: 0.9766716957, propagate_forward_time: 31.4301414490, propagate_backward_time: 47.0274658203, weight_update_time: 0.1368969530, other_time: 2.4777412415
epoch time: 6.8418321609s, input_fired_time: 0.1287049055, output_fired_time: 0.0000000000, propagate_forward_time: 6.2633886337, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4497385025
validation[          , genome  5361] predictions:    9691/  10000 (96.91%), best:    9691/10000 (96.91%), error:      1039.70886, best error:      1039.70886 on epoch:    21, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 82.9903564453s, input_fired_time: 1.0529651642, output_fired_time: 0.9731069803, propagate_forward_time: 31.5051250458, propagate_backward_time: 46.9958267212, weight_update_time: 0.1364954412, other_time: 2.4633331299
epoch time: 6.8761253357s, input_fired_time: 0.1317927986, output_fired_time: 0.0000000000, propagate_forward_time: 6.2934451103, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4508872032
validation[          , genome  5361] predictions:    9664/  10000 (96.64%), best:    9691/10000 (96.91%), error:      1104.22693, best error:      1039.70886 on epoch:    21, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 82.9262008667s, input_fired_time: 1.0629359484, output_fired_time: 0.9737862349, propagate_forward_time: 31.3779659271, propagate_backward_time: 46.9544677734, weight_update_time: 0.1395551264, other_time: 2.5570449829
epoch time: 6.8811249733s, input_fired_time: 0.1310956776, output_fired_time: 0.0000000000, propagate_forward_time: 6.2897071838, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4603219032
validation[          , genome  5361] predictions:    9654/  10000 (96.54%), best:    9691/10000 (96.91%), error:      1059.21252, best error:      1039.70886 on epoch:    21, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 83.1835327148s, input_fired_time: 1.0624604225, output_fired_time: 0.9815225601, propagate_forward_time: 31.4372673035, propagate_backward_time: 47.1388244629, weight_update_time: 0.1410172284, other_time: 2.5634574890
epoch time: 6.8767209053s, input_fired_time: 0.1295191497, output_fired_time: 0.0000000000, propagate_forward_time: 6.2887649536, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4584369659
validation[          , genome  5361] predictions:    9664/  10000 (96.64%), best:    9691/10000 (96.91%), error:      1138.77710, best error:      1039.70886 on epoch:    21, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 82.4477996826s, input_fired_time: 1.0611906052, output_fired_time: 0.9707332850, propagate_forward_time: 31.2371616364, propagate_backward_time: 46.6100540161, weight_update_time: 0.1404081285, other_time: 2.5686645508
epoch time: 6.8718671799s, input_fired_time: 0.1333566010, output_fired_time: 0.0000000000, propagate_forward_time: 6.2763190269, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4621915817
validation[          , genome  5361] predictions:    9682/  10000 (96.82%), best:    9691/10000 (96.91%), error:      1112.30273, best error:      1039.70886 on epoch:    21, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 83.1139221191s, input_fired_time: 1.0646040440, output_fired_time: 0.9737156630, propagate_forward_time: 31.4835605621, propagate_backward_time: 47.0395011902, weight_update_time: 0.1397034526, other_time: 2.5525398254
epoch time: 6.8820524216s, input_fired_time: 0.1303989887, output_fired_time: 0.0000000000, propagate_forward_time: 6.2900919914, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4615616798
validation[          , genome  5361] predictions:    9664/  10000 (96.64%), best:    9691/10000 (96.91%), error:      1141.29443, best error:      1039.70886 on epoch:    21, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 82.5333786011s, input_fired_time: 1.0471469164, output_fired_time: 0.9689156413, propagate_forward_time: 31.2789783478, propagate_backward_time: 46.7610893250, weight_update_time: 0.1370165646, other_time: 2.4772453308
epoch time: 6.8715949059s, input_fired_time: 0.1327825189, output_fired_time: 0.0000000000, propagate_forward_time: 6.2889094353, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4499030113
validation[          , genome  5361] predictions:    9664/  10000 (96.64%), best:    9691/10000 (96.91%), error:      1103.71948, best error:      1039.70886 on epoch:    21, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 82.5842361450s, input_fired_time: 1.0495100021, output_fired_time: 0.9747269154, propagate_forward_time: 31.2825355530, propagate_backward_time: 46.7977905273, weight_update_time: 0.1363899708, other_time: 2.4796791077
epoch time: 6.8584856987s, input_fired_time: 0.1341528594, output_fired_time: 0.0000000000, propagate_forward_time: 6.2711615562, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4531712532
validation[          , genome  5361] predictions:    9636/  10000 (96.36%), best:    9691/10000 (96.91%), error:      1174.79114, best error:      1039.70886 on epoch:    21, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 83.0863952637s, input_fired_time: 1.0679863691, output_fired_time: 0.9745486379, propagate_forward_time: 31.4497776031, propagate_backward_time: 47.0403442383, weight_update_time: 0.1391382664, other_time: 2.5537414551
epoch time: 6.8579993248s, input_fired_time: 0.1335834265, output_fired_time: 0.0000000000, propagate_forward_time: 6.2649259567, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4594898224
validation[          , genome  5361] predictions:    9672/  10000 (96.72%), best:    9672/10000 (96.72%), error:      1000.37164, best error:      1000.37164 on epoch:    29, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 83.0727005005s, input_fired_time: 1.0553611517, output_fired_time: 0.9790002108, propagate_forward_time: 31.4801006317, propagate_backward_time: 47.0781173706, weight_update_time: 0.1388934553, other_time: 2.4801177979
epoch time: 6.8854794502s, input_fired_time: 0.1291581690, output_fired_time: 0.0000000000, propagate_forward_time: 6.3059067726, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4504146576
validation[          , genome  5361] predictions:    9674/  10000 (96.74%), best:    9672/10000 (96.72%), error:      1038.25000, best error:      1000.37164 on epoch:    29, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 82.8039321899s, input_fired_time: 1.0555273294, output_fired_time: 0.9771360159, propagate_forward_time: 31.3527126312, propagate_backward_time: 46.9047279358, weight_update_time: 0.1375683993, other_time: 2.5138282776
epoch time: 6.8557033539s, input_fired_time: 0.1348528713, output_fired_time: 0.0000000000, propagate_forward_time: 6.2724032402, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4484472275
validation[          , genome  5361] predictions:    9628/  10000 (96.28%), best:    9672/10000 (96.72%), error:      1211.00330, best error:      1000.37164 on epoch:    29, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 82.5105895996s, input_fired_time: 1.0596153736, output_fired_time: 0.9666116834, propagate_forward_time: 31.2722892761, propagate_backward_time: 46.6619758606, weight_update_time: 0.1372450143, other_time: 2.5500946045
epoch time: 6.8706727028s, input_fired_time: 0.1317082196, output_fired_time: 0.0000000000, propagate_forward_time: 6.2790846825, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4598798752
validation[          , genome  5361] predictions:    9655/  10000 (96.55%), best:    9672/10000 (96.72%), error:      1101.17493, best error:      1000.37164 on epoch:    29, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 83.0197143555s, input_fired_time: 1.0609502792, output_fired_time: 0.9801535010, propagate_forward_time: 31.3944950104, propagate_backward_time: 47.0315856934, weight_update_time: 0.1398626715, other_time: 2.5525283813
epoch time: 6.8194236755s, input_fired_time: 0.1346196979, output_fired_time: 0.0000000000, propagate_forward_time: 6.2235493660, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4612545967
validation[          , genome  5361] predictions:    9695/  10000 (96.95%), best:    9695/10000 (96.95%), error:       968.28607, best error:       968.28607 on epoch:    33, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 82.8091583252s, input_fired_time: 1.0545355082, output_fired_time: 0.9709811807, propagate_forward_time: 31.3617267609, propagate_backward_time: 46.9391784668, weight_update_time: 0.1371772140, other_time: 2.4827423096
epoch time: 6.8892030716s, input_fired_time: 0.1299659759, output_fired_time: 0.0000000000, propagate_forward_time: 6.3107886314, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4484486580
validation[          , genome  5361] predictions:    9688/  10000 (96.88%), best:    9695/10000 (96.95%), error:      1035.13672, best error:       968.28607 on epoch:    33, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 83.0107727051s, input_fired_time: 1.0705411434, output_fired_time: 0.9781595469, propagate_forward_time: 31.3594532013, propagate_backward_time: 47.0435485840, weight_update_time: 0.1418087333, other_time: 2.5590744019
epoch time: 6.8609952927s, input_fired_time: 0.1325548738, output_fired_time: 0.0000000000, propagate_forward_time: 6.2710475922, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4573926926
validation[          , genome  5361] predictions:    9703/  10000 (97.03%), best:    9695/10000 (96.95%), error:       991.11578, best error:       968.28607 on epoch:    33, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 82.8812332153s, input_fired_time: 1.0493433475, output_fired_time: 0.9718451500, propagate_forward_time: 31.4093418121, propagate_backward_time: 46.9644012451, weight_update_time: 0.1368488073, other_time: 2.4862976074
epoch time: 6.8826651573s, input_fired_time: 0.1337218434, output_fired_time: 0.0000000000, propagate_forward_time: 6.2987203598, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4502229691
validation[          , genome  5361] predictions:    9661/  10000 (96.61%), best:    9695/10000 (96.95%), error:      1076.60205, best error:       968.28607 on epoch:    33, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 82.5462799072s, input_fired_time: 1.0710262060, output_fired_time: 0.9656939507, propagate_forward_time: 31.2871570587, propagate_backward_time: 46.6669349670, weight_update_time: 0.1376309246, other_time: 2.5554695129
epoch time: 6.8761014938s, input_fired_time: 0.1346337944, output_fired_time: 0.0000000000, propagate_forward_time: 6.2792305946, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4622368813
validation[          , genome  5361] predictions:    9683/  10000 (96.83%), best:    9695/10000 (96.95%), error:      1089.37170, best error:       968.28607 on epoch:    33, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 82.7337799072s, input_fired_time: 1.0693215132, output_fired_time: 0.9699630141, propagate_forward_time: 31.3237648010, propagate_backward_time: 46.8176841736, weight_update_time: 0.1382317990, other_time: 2.5530471802
epoch time: 6.8735241890s, input_fired_time: 0.1329119653, output_fired_time: 0.0000000000, propagate_forward_time: 6.2813754082, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4592366219
validation[          , genome  5361] predictions:    9701/  10000 (97.01%), best:    9701/10000 (97.01%), error:       955.73492, best error:       955.73492 on epoch:    38, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 83.0569152832s, input_fired_time: 1.0702431202, output_fired_time: 0.9705128670, propagate_forward_time: 31.4515800476, propagate_backward_time: 47.0004463196, weight_update_time: 0.1393965930, other_time: 2.5641326904
epoch time: 6.8686771393s, input_fired_time: 0.1318585724, output_fired_time: 0.0000000000, propagate_forward_time: 6.2768950462, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4599237442
validation[          , genome  5361] predictions:    9680/  10000 (96.80%), best:    9701/10000 (97.01%), error:      1041.86499, best error:       955.73492 on epoch:    38, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 82.8428573608s, input_fired_time: 1.0705152750, output_fired_time: 0.9738804102, propagate_forward_time: 31.3450374603, propagate_backward_time: 46.8814163208, weight_update_time: 0.1399977058, other_time: 2.5720062256
epoch time: 6.8717041016s, input_fired_time: 0.1354077905, output_fired_time: 0.0000000000, propagate_forward_time: 6.2756795883, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4606165886
validation[          , genome  5361] predictions:    9710/  10000 (97.10%), best:    9701/10000 (97.01%), error:       962.05469, best error:       955.73492 on epoch:    38, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 82.8659744263s, input_fired_time: 1.0643647909, output_fired_time: 0.9761548638, propagate_forward_time: 31.3665409088, propagate_backward_time: 46.9566535950, weight_update_time: 0.1380233318, other_time: 2.5022621155
epoch time: 6.8336606026s, input_fired_time: 0.1309752613, output_fired_time: 0.0000000000, propagate_forward_time: 6.2429099083, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4597754478
validation[          , genome  5361] predictions:    9662/  10000 (96.62%), best:    9701/10000 (97.01%), error:      1127.18005, best error:       955.73492 on epoch:    38, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 82.7788848877s, input_fired_time: 1.0580670834, output_fired_time: 0.9768726826, propagate_forward_time: 31.3034744263, propagate_backward_time: 46.9630279541, weight_update_time: 0.1370054930, other_time: 2.4774398804
epoch time: 6.8114295006s, input_fired_time: 0.1332665235, output_fired_time: 0.0000000000, propagate_forward_time: 6.2302045822, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4479584694
validation[          , genome  5361] predictions:    9721/  10000 (97.21%), best:    9701/10000 (97.01%), error:       958.61212, best error:       955.73492 on epoch:    38, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 83.1489334106s, input_fired_time: 1.0709650517, output_fired_time: 0.9796072245, propagate_forward_time: 31.4587154388, propagate_backward_time: 47.0815963745, weight_update_time: 0.1396913826, other_time: 2.5580444336
epoch time: 6.8352484703s, input_fired_time: 0.1347602457, output_fired_time: 0.0000000000, propagate_forward_time: 6.2381486893, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4623394012
validation[          , genome  5361] predictions:    9694/  10000 (96.94%), best:    9701/10000 (97.01%), error:      1092.90356, best error:       955.73492 on epoch:    38, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 83.3210372925s, input_fired_time: 1.0615549088, output_fired_time: 0.9836484194, propagate_forward_time: 31.5180072784, propagate_backward_time: 47.2599487305, weight_update_time: 0.1384987682, other_time: 2.4978790283
epoch time: 6.8699612617s, input_fired_time: 0.1358738095, output_fired_time: 0.0000000000, propagate_forward_time: 6.2739667892, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4601206779
validation[          , genome  5361] predictions:    9684/  10000 (96.84%), best:    9701/10000 (97.01%), error:      1001.31152, best error:       955.73492 on epoch:    38, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 82.7458267212s, input_fired_time: 1.0582305193, output_fired_time: 0.9723922014, propagate_forward_time: 31.3354415894, propagate_backward_time: 46.8838729858, weight_update_time: 0.1386043876, other_time: 2.4958953857
epoch time: 6.8514428139s, input_fired_time: 0.1321127862, output_fired_time: 0.0000000000, propagate_forward_time: 6.2581839561, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4611458778
validation[          , genome  5361] predictions:    9672/  10000 (96.72%), best:    9701/10000 (97.01%), error:      1123.43188, best error:       955.73492 on epoch:    38, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 83.1245422363s, input_fired_time: 1.0554299355, output_fired_time: 0.9778124690, propagate_forward_time: 31.4533863068, propagate_backward_time: 47.1591453552, weight_update_time: 0.1376055628, other_time: 2.4787712097
epoch time: 6.8772139549s, input_fired_time: 0.1311452687, output_fired_time: 0.0000000000, propagate_forward_time: 6.2946057320, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4514627457
validation[          , genome  5361] predictions:    9673/  10000 (96.73%), best:    9701/10000 (97.01%), error:      1011.30383, best error:       955.73492 on epoch:    38, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 82.9296722412s, input_fired_time: 1.0745118856, output_fired_time: 0.9761917591, propagate_forward_time: 31.3572883606, propagate_backward_time: 46.9478454590, weight_update_time: 0.1409754902, other_time: 2.5738410950
epoch time: 6.8841824532s, input_fired_time: 0.1378951520, output_fired_time: 0.0000000000, propagate_forward_time: 6.2845849991, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4617023468
validation[          , genome  5361] predictions:    9638/  10000 (96.38%), best:    9701/10000 (97.01%), error:      1171.54724, best error:       955.73492 on epoch:    38, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 82.7851791382s, input_fired_time: 1.0656985044, output_fired_time: 0.9714983702, propagate_forward_time: 31.3049201965, propagate_backward_time: 46.8704681396, weight_update_time: 0.1411296129, other_time: 2.5725975037
epoch time: 6.8648943901s, input_fired_time: 0.1344266534, output_fired_time: 0.0000000000, propagate_forward_time: 6.2716102600, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4588575363
validation[          , genome  5361] predictions:    9654/  10000 (96.54%), best:    9701/10000 (97.01%), error:      1139.01697, best error:       955.73492 on epoch:    38, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 82.6772079468s, input_fired_time: 1.0631471872, output_fired_time: 0.9748591185, propagate_forward_time: 31.2539501190, propagate_backward_time: 46.9022712708, weight_update_time: 0.1369888037, other_time: 2.4829750061
epoch time: 6.8929624557s, input_fired_time: 0.1349673718, output_fired_time: 0.0000000000, propagate_forward_time: 6.3068885803, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4511065483
validation[          , genome  5361] predictions:    9693/  10000 (96.93%), best:    9701/10000 (97.01%), error:      1040.94897, best error:       955.73492 on epoch:    38, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 83.0541839600s, input_fired_time: 1.0777627230, output_fired_time: 0.9760168195, propagate_forward_time: 31.4153366089, propagate_backward_time: 47.0153846741, weight_update_time: 0.1396302581, other_time: 2.5696830750
epoch time: 6.8732981682s, input_fired_time: 0.1333916932, output_fired_time: 0.0000000000, propagate_forward_time: 6.2791552544, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4607510567
validation[          , genome  5361] predictions:    9720/  10000 (97.20%), best:    9701/10000 (97.01%), error:       960.26312, best error:       955.73492 on epoch:    38, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 83.0937652588s, input_fired_time: 1.0619646311, output_fired_time: 0.9802429676, propagate_forward_time: 31.4257354736, propagate_backward_time: 47.1469955444, weight_update_time: 0.1366927922, other_time: 2.4788284302
epoch time: 6.8802585602s, input_fired_time: 0.1329786628, output_fired_time: 0.0000000000, propagate_forward_time: 6.2967815399, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4504985809
validation[          , genome  5361] predictions:    9667/  10000 (96.67%), best:    9701/10000 (97.01%), error:      1077.79578, best error:       955.73492 on epoch:    38, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 82.7305450439s, input_fired_time: 1.0779294968, output_fired_time: 0.9674180746, propagate_forward_time: 31.3358097076, propagate_backward_time: 46.7911682129, weight_update_time: 0.1393795758, other_time: 2.5582275391
epoch time: 6.8728599548s, input_fired_time: 0.1363838315, output_fired_time: 0.0000000000, propagate_forward_time: 6.2770433426, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4594326019
validation[          , genome  5361] predictions:    9662/  10000 (96.62%), best:    9701/10000 (97.01%), error:      1197.45911, best error:       955.73492 on epoch:    38, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 83.2448272705s, input_fired_time: 1.0655984879, output_fired_time: 0.9796797633, propagate_forward_time: 31.4888687134, propagate_backward_time: 47.2253265381, weight_update_time: 0.1384705752, other_time: 2.4853515625
epoch time: 6.8768429756s, input_fired_time: 0.1345918924, output_fired_time: 0.0000000000, propagate_forward_time: 6.2937731743, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4484777451
validation[          , genome  5361] predictions:    9694/  10000 (96.94%), best:    9701/10000 (97.01%), error:      1002.22443, best error:       955.73492 on epoch:    38, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 83.2813873291s, input_fired_time: 1.0870782137, output_fired_time: 0.9808399677, propagate_forward_time: 31.4410438538, propagate_backward_time: 47.1968612671, weight_update_time: 0.1399434507, other_time: 2.5755577087
epoch time: 6.8168921471s, input_fired_time: 0.1328483522, output_fired_time: 0.0000000000, propagate_forward_time: 6.2289052010, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4551386833
validation[          , genome  5361] predictions:    9695/  10000 (96.95%), best:    9701/10000 (97.01%), error:       985.89136, best error:       955.73492 on epoch:    38, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 83.1002273560s, input_fired_time: 1.0700068474, output_fired_time: 0.9709866047, propagate_forward_time: 31.4307441711, propagate_backward_time: 47.1429176331, weight_update_time: 0.1374262422, other_time: 2.4855728149
epoch time: 6.8647336960s, input_fired_time: 0.1313280463, output_fired_time: 0.0000000000, propagate_forward_time: 6.2888965607, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4445090294
validation[          , genome  5361] predictions:    9685/  10000 (96.85%), best:    9701/10000 (97.01%), error:      1043.54688, best error:       955.73492 on epoch:    38, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 82.3687667847s, input_fired_time: 1.0760074854, output_fired_time: 0.9677183628, propagate_forward_time: 31.1220207214, propagate_backward_time: 46.6319274902, weight_update_time: 0.1391750127, other_time: 2.5710945129
epoch time: 6.8532838821s, input_fired_time: 0.1360357404, output_fired_time: 0.0000000000, propagate_forward_time: 6.2709507942, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4462971687
validation[          , genome  5361] predictions:    9629/  10000 (96.29%), best:    9701/10000 (97.01%), error:      1249.50146, best error:       955.73492 on epoch:    38, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 83.0227584839s, input_fired_time: 1.0656683445, output_fired_time: 0.9731529951, propagate_forward_time: 31.4699535370, propagate_backward_time: 47.0226325989, weight_update_time: 0.1385736167, other_time: 2.4913520813
epoch time: 6.8911447525s, input_fired_time: 0.1354910731, output_fired_time: 0.0000000000, propagate_forward_time: 6.3037977219, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4518561363
validation[          , genome  5361] predictions:    9727/  10000 (97.27%), best:    9727/10000 (97.27%), error:       928.90204, best error:       928.90204 on epoch:    57, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 82.6423187256s, input_fired_time: 1.0663248301, output_fired_time: 0.9681066275, propagate_forward_time: 31.2822265625, propagate_backward_time: 46.8472366333, weight_update_time: 0.1361546218, other_time: 2.4784240723
epoch time: 6.8650650978s, input_fired_time: 0.1334202737, output_fired_time: 0.0000000000, propagate_forward_time: 6.2816257477, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4500188828
validation[          , genome  5361] predictions:    9671/  10000 (96.71%), best:    9727/10000 (97.27%), error:      1069.83838, best error:       928.90204 on epoch:    57, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 83.0974426270s, input_fired_time: 1.0867450237, output_fired_time: 0.9729848504, propagate_forward_time: 31.4385070801, propagate_backward_time: 47.0468711853, weight_update_time: 0.1403937191, other_time: 2.5523338318
epoch time: 6.8734102249s, input_fired_time: 0.1372078359, output_fired_time: 0.0000000000, propagate_forward_time: 6.2766947746, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4595074654
validation[          , genome  5361] predictions:    9556/  10000 (95.56%), best:    9727/10000 (97.27%), error:      1451.72742, best error:       928.90204 on epoch:    57, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 83.0145416260s, input_fired_time: 1.0799994469, output_fired_time: 0.9759417772, propagate_forward_time: 31.4211654663, propagate_backward_time: 47.0777778625, weight_update_time: 0.1368431598, other_time: 2.4596519470
epoch time: 6.5899586678s, input_fired_time: 0.1326159090, output_fired_time: 0.0000000000, propagate_forward_time: 6.0201358795, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4372067451
validation[          , genome  5361] predictions:    9695/  10000 (96.95%), best:    9727/10000 (97.27%), error:       980.49475, best error:       928.90204 on epoch:    57, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 82.6574172974s, input_fired_time: 1.0751528740, output_fired_time: 0.9705547690, propagate_forward_time: 31.2858581543, propagate_backward_time: 46.8127670288, weight_update_time: 0.1379863322, other_time: 2.5130844116
epoch time: 6.8993377686s, input_fired_time: 0.1388268024, output_fired_time: 0.0000000000, propagate_forward_time: 6.2982516289, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4622592926
validation[          , genome  5361] predictions:    9683/  10000 (96.83%), best:    9727/10000 (97.27%), error:      1134.69275, best error:       928.90204 on epoch:    57, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 83.1579971313s, input_fired_time: 1.0923264027, output_fired_time: 0.9776926637, propagate_forward_time: 31.3523387909, propagate_backward_time: 47.1653976440, weight_update_time: 0.1420971006, other_time: 2.5702438354
epoch time: 6.8538045883s, input_fired_time: 0.1349755228, output_fired_time: 0.0000000000, propagate_forward_time: 6.2690000534, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4498291016
validation[          , genome  5361] predictions:    9710/  10000 (97.10%), best:    9727/10000 (97.27%), error:       970.57068, best error:       928.90204 on epoch:    57, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 82.8104324341s, input_fired_time: 1.0751172304, output_fired_time: 0.9685413241, propagate_forward_time: 31.3235187531, propagate_backward_time: 46.9775161743, weight_update_time: 0.1365361065, other_time: 2.4657363892
epoch time: 6.8723731041s, input_fired_time: 0.1336654872, output_fired_time: 0.0000000000, propagate_forward_time: 6.2900629044, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4486446381
validation[          , genome  5361] predictions:    9712/  10000 (97.12%), best:    9727/10000 (97.27%), error:       992.35211, best error:       928.90204 on epoch:    57, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 82.9863815308s, input_fired_time: 1.0811591148, output_fired_time: 0.9744294882, propagate_forward_time: 31.3315830231, propagate_backward_time: 47.0408821106, weight_update_time: 0.1386701316, other_time: 2.5583305359
epoch time: 6.8439402580s, input_fired_time: 0.1373112202, output_fired_time: 0.0000000000, propagate_forward_time: 6.2470121384, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4596166611
validation[          , genome  5361] predictions:    9686/  10000 (96.86%), best:    9727/10000 (97.27%), error:      1045.20300, best error:       928.90204 on epoch:    57, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 82.9371032715s, input_fired_time: 1.0740103722, output_fired_time: 0.9692540169, propagate_forward_time: 31.4444522858, propagate_backward_time: 46.9778251648, weight_update_time: 0.1366386563, other_time: 2.4715614319
epoch time: 6.8672418594s, input_fired_time: 0.1369592398, output_fired_time: 0.0000000000, propagate_forward_time: 6.2779607773, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4523220062
validation[          , genome  5361] predictions:    9718/  10000 (97.18%), best:    9727/10000 (97.27%), error:       978.29614, best error:       928.90204 on epoch:    57, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 82.8255996704s, input_fired_time: 1.0901311636, output_fired_time: 0.9785028696, propagate_forward_time: 31.2738342285, propagate_backward_time: 46.9187393188, weight_update_time: 0.1406444758, other_time: 2.5643920898
epoch time: 6.8491058350s, input_fired_time: 0.1359024495, output_fired_time: 0.0000000000, propagate_forward_time: 6.2528586388, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4603447914
validation[          , genome  5361] predictions:    9705/  10000 (97.05%), best:    9727/10000 (97.27%), error:       986.83081, best error:       928.90204 on epoch:    57, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 82.9700241089s, input_fired_time: 1.0825266838, output_fired_time: 0.9776609540, propagate_forward_time: 31.2991428375, propagate_backward_time: 47.0613784790, weight_update_time: 0.1386056840, other_time: 2.5493164063
epoch time: 6.8451123238s, input_fired_time: 0.1392615885, output_fired_time: 0.0000000000, propagate_forward_time: 6.2471261024, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4587244987
validation[          , genome  5361] predictions:    9718/  10000 (97.18%), best:    9727/10000 (97.27%), error:       942.03680, best error:       928.90204 on epoch:    57, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 83.1605682373s, input_fired_time: 1.0899646282, output_fired_time: 0.9789884090, propagate_forward_time: 31.3642711639, propagate_backward_time: 47.1590080261, weight_update_time: 0.1403889656, other_time: 2.5683326721
epoch time: 6.8836088181s, input_fired_time: 0.1376956552, output_fired_time: 0.0000000000, propagate_forward_time: 6.2874360085, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4584770203
validation[          , genome  5361] predictions:    9711/  10000 (97.11%), best:    9727/10000 (97.27%), error:       972.84680, best error:       928.90204 on epoch:    57, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 83.0889587402s, input_fired_time: 1.0694981813, output_fired_time: 0.9795030951, propagate_forward_time: 31.4111766815, propagate_backward_time: 47.1429710388, weight_update_time: 0.1382249892, other_time: 2.4858131409
epoch time: 6.8400821686s, input_fired_time: 0.1348094195, output_fired_time: 0.0000000000, propagate_forward_time: 6.2555818558, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4496908188
validation[          , genome  5361] predictions:    9722/  10000 (97.22%), best:    9727/10000 (97.27%), error:       932.98785, best error:       928.90204 on epoch:    57, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 83.1244888306s, input_fired_time: 1.0836893320, output_fired_time: 0.9753092527, propagate_forward_time: 31.4338130951, propagate_backward_time: 47.0966873169, weight_update_time: 0.1384651363, other_time: 2.5349884033
epoch time: 6.8642745018s, input_fired_time: 0.1358375549, output_fired_time: 0.0000000000, propagate_forward_time: 6.2686972618, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4597396851
validation[          , genome  5361] predictions:    9675/  10000 (96.75%), best:    9727/10000 (97.27%), error:      1065.40723, best error:       928.90204 on epoch:    57, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 83.2566909790s, input_fired_time: 1.0867196321, output_fired_time: 0.9804331660, propagate_forward_time: 31.4666252136, propagate_backward_time: 47.1934623718, weight_update_time: 0.1387564242, other_time: 2.5294494629
epoch time: 6.8746657372s, input_fired_time: 0.1397121698, output_fired_time: 0.0000000000, propagate_forward_time: 6.2746191025, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4603343010
validation[          , genome  5361] predictions:    9543/  10000 (95.43%), best:    9727/10000 (97.27%), error:      1544.19568, best error:       928.90204 on epoch:    57, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 82.9470367432s, input_fired_time: 1.0787112713, output_fired_time: 0.9748325348, propagate_forward_time: 31.3896675110, propagate_backward_time: 47.0276184082, weight_update_time: 0.1377342045, other_time: 2.4762077332
epoch time: 6.8903002739s, input_fired_time: 0.1338244081, output_fired_time: 0.0000000000, propagate_forward_time: 6.3058924675, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4505834579
validation[          , genome  5361] predictions:    9718/  10000 (97.18%), best:    9727/10000 (97.27%), error:       996.39581, best error:       928.90204 on epoch:    57, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 83.1356964111s, input_fired_time: 1.0925103426, output_fired_time: 0.9788821936, propagate_forward_time: 31.3659915924, propagate_backward_time: 47.1375808716, weight_update_time: 0.1402933002, other_time: 2.5607299805
epoch time: 6.9103136063s, input_fired_time: 0.1369660944, output_fired_time: 0.0000000000, propagate_forward_time: 6.3109722137, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4623751640
validation[          , genome  5361] predictions:    9689/  10000 (96.89%), best:    9727/10000 (97.27%), error:      1027.17261, best error:       928.90204 on epoch:    57, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 83.0104675293s, input_fired_time: 1.0767647028, output_fired_time: 0.9766208529, propagate_forward_time: 31.3993129730, propagate_backward_time: 47.0696220398, weight_update_time: 0.1365752369, other_time: 2.4881401062
epoch time: 6.8813858032s, input_fired_time: 0.1318141222, output_fired_time: 0.0000000000, propagate_forward_time: 6.2973275185, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4522442818
validation[          , genome  5361] predictions:    9706/  10000 (97.06%), best:    9727/10000 (97.27%), error:      1015.14606, best error:       928.90204 on epoch:    57, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 82.9469604492s, input_fired_time: 1.0799925327, output_fired_time: 0.9717925787, propagate_forward_time: 31.3862934113, propagate_backward_time: 46.9527397156, weight_update_time: 0.1381904781, other_time: 2.5561408997
epoch time: 6.8661680222s, input_fired_time: 0.1363710314, output_fired_time: 0.0000000000, propagate_forward_time: 6.2696118355, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4601850510
validation[          , genome  5361] predictions:    9694/  10000 (96.94%), best:    9727/10000 (97.27%), error:      1027.60376, best error:       928.90204 on epoch:    57, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 83.2566223145s, input_fired_time: 1.0897518396, output_fired_time: 0.9793151021, propagate_forward_time: 31.4694976807, propagate_backward_time: 47.1453742981, weight_update_time: 0.1408558339, other_time: 2.5726814270
epoch time: 6.8781213760s, input_fired_time: 0.1389924884, output_fired_time: 0.0000000000, propagate_forward_time: 6.2774038315, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4617252350
validation[          , genome  5361] predictions:    9680/  10000 (96.80%), best:    9727/10000 (97.27%), error:      1072.44019, best error:       928.90204 on epoch:    57, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 82.9056091309s, input_fired_time: 1.0728813410, output_fired_time: 0.9732660055, propagate_forward_time: 31.3814659119, propagate_backward_time: 46.9918937683, weight_update_time: 0.1371587962, other_time: 2.4860992432
epoch time: 6.8847613335s, input_fired_time: 0.1325625330, output_fired_time: 0.0000000000, propagate_forward_time: 6.3027505875, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4494481087
validation[          , genome  5361] predictions:    9662/  10000 (96.62%), best:    9727/10000 (97.27%), error:      1099.14490, best error:       928.90204 on epoch:    57, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 82.9656295776s, input_fired_time: 1.0745146275, output_fired_time: 0.9737004042, propagate_forward_time: 31.4091453552, propagate_backward_time: 47.0338821411, weight_update_time: 0.1364899129, other_time: 2.4743843079
epoch time: 6.8494420052s, input_fired_time: 0.1373436600, output_fired_time: 0.0000000000, propagate_forward_time: 6.2633213997, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4487767220
validation[          , genome  5361] predictions:    9696/  10000 (96.96%), best:    9727/10000 (97.27%), error:      1013.21130, best error:       928.90204 on epoch:    57, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 83.4728088379s, input_fired_time: 1.1002322435, output_fired_time: 0.9761812687, propagate_forward_time: 31.5341606140, propagate_backward_time: 47.3109397888, weight_update_time: 0.1385082603, other_time: 2.5512924194
epoch time: 6.9157552719s, input_fired_time: 0.1388527751, output_fired_time: 0.0000000000, propagate_forward_time: 6.3161273003, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4607753754
validation[          , genome  5361] predictions:    9679/  10000 (96.79%), best:    9727/10000 (97.27%), error:      1024.21594, best error:       928.90204 on epoch:    57, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 83.2692947388s, input_fired_time: 1.0961068869, output_fired_time: 0.9780302644, propagate_forward_time: 31.4450016022, propagate_backward_time: 47.1972961426, weight_update_time: 0.1410706937, other_time: 2.5528640747
epoch time: 6.8440060616s, input_fired_time: 0.1378840804, output_fired_time: 0.0000000000, propagate_forward_time: 6.2431449890, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4629769325
validation[          , genome  5361] predictions:    9691/  10000 (96.91%), best:    9727/10000 (97.27%), error:      1113.69531, best error:       928.90204 on epoch:    57, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 83.1838760376s, input_fired_time: 1.0758517981, output_fired_time: 0.9794116020, propagate_forward_time: 31.4594078064, propagate_backward_time: 47.1884460449, weight_update_time: 0.1386466622, other_time: 2.4807624817
epoch time: 6.8716182709s, input_fired_time: 0.1377733946, output_fired_time: 0.0000000000, propagate_forward_time: 6.2819314003, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4519133568
validation[          , genome  5361] predictions:    9529/  10000 (95.29%), best:    9727/10000 (97.27%), error:      1622.78687, best error:       928.90204 on epoch:    57, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 82.4586944580s, input_fired_time: 1.0703462362, output_fired_time: 0.9642492533, propagate_forward_time: 31.1984748840, propagate_backward_time: 46.7534408569, weight_update_time: 0.1367260516, other_time: 2.4721870422
epoch time: 6.8396162987s, input_fired_time: 0.1361856610, output_fired_time: 0.0000000000, propagate_forward_time: 6.2545552254, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4488754272
validation[          , genome  5361] predictions:    9692/  10000 (96.92%), best:    9727/10000 (97.27%), error:      1057.00378, best error:       928.90204 on epoch:    57, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 83.2535629272s, input_fired_time: 1.0911793709, output_fired_time: 0.9788092375, propagate_forward_time: 31.4302654266, propagate_backward_time: 47.1817359924, weight_update_time: 0.1401830316, other_time: 2.5715751648
epoch time: 6.8878107071s, input_fired_time: 0.1361831874, output_fired_time: 0.0000000000, propagate_forward_time: 6.2926774025, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4589500427
validation[          , genome  5361] predictions:    9713/  10000 (97.13%), best:    9727/10000 (97.27%), error:       965.23901, best error:       928.90204 on epoch:    57, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 82.7891845703s, input_fired_time: 1.0909626484, output_fired_time: 0.9712710977, propagate_forward_time: 31.2473163605, propagate_backward_time: 46.9083633423, weight_update_time: 0.1399041712, other_time: 2.5712738037
epoch time: 6.8468260765s, input_fired_time: 0.1382740289, output_fired_time: 0.0000000000, propagate_forward_time: 6.2464809418, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4620709419
validation[          , genome  5361] predictions:    9681/  10000 (96.81%), best:    9727/10000 (97.27%), error:      1081.24097, best error:       928.90204 on epoch:    57, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 83.2410278320s, input_fired_time: 1.0966230631, output_fired_time: 0.9797612429, propagate_forward_time: 31.4173755646, propagate_backward_time: 47.1699981689, weight_update_time: 0.1403518021, other_time: 2.5772705078
epoch time: 6.8860597610s, input_fired_time: 0.1379215568, output_fired_time: 0.0000000000, propagate_forward_time: 6.2851214409, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4630169868
validation[          , genome  5361] predictions:    9679/  10000 (96.79%), best:    9727/10000 (97.27%), error:      1099.60913, best error:       928.90204 on epoch:    57, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 83.2048339844s, input_fired_time: 1.0794758797, output_fired_time: 0.9779502749, propagate_forward_time: 31.4347839355, propagate_backward_time: 47.2213172913, weight_update_time: 0.1388358027, other_time: 2.4913063049
epoch time: 6.8966131210s, input_fired_time: 0.1369297206, output_fired_time: 0.0000000000, propagate_forward_time: 6.3101263046, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4495573044
validation[          , genome  5361] predictions:    9694/  10000 (96.94%), best:    9727/10000 (97.27%), error:       988.66418, best error:       928.90204 on epoch:    57, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 83.1724853516s, input_fired_time: 1.0810726881, output_fired_time: 0.9761953950, propagate_forward_time: 31.5038585663, propagate_backward_time: 47.1236648560, weight_update_time: 0.1379887462, other_time: 2.4876937866
epoch time: 6.8810629845s, input_fired_time: 0.1406489164, output_fired_time: 0.0000000000, propagate_forward_time: 6.2899279594, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4504861832
validation[          , genome  5361] predictions:    9665/  10000 (96.65%), best:    9727/10000 (97.27%), error:      1116.78210, best error:       928.90204 on epoch:    57, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 82.9562530518s, input_fired_time: 1.0963143110, output_fired_time: 0.9724729061, propagate_forward_time: 31.3703880310, propagate_backward_time: 46.9447975159, weight_update_time: 0.1411978751, other_time: 2.5722808838
epoch time: 6.9024643898s, input_fired_time: 0.1364795119, output_fired_time: 0.0000000000, propagate_forward_time: 6.3133163452, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4526686668
validation[          , genome  5361] predictions:    9699/  10000 (96.99%), best:    9727/10000 (97.27%), error:      1050.34558, best error:       928.90204 on epoch:    57, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 82.5493392944s, input_fired_time: 1.0799310207, output_fired_time: 0.9689415097, propagate_forward_time: 31.1983070374, propagate_backward_time: 46.8237648010, weight_update_time: 0.1360435337, other_time: 2.4783935547
epoch time: 6.8407602310s, input_fired_time: 0.1354680657, output_fired_time: 0.0000000000, propagate_forward_time: 6.2543325424, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4509596825
validation[          , genome  5361] predictions:    9436/  10000 (94.36%), best:    9727/10000 (97.27%), error:      1947.05432, best error:       928.90204 on epoch:    57, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 83.3773193359s, input_fired_time: 1.0788742304, output_fired_time: 0.9740749598, propagate_forward_time: 31.5199165344, propagate_backward_time: 47.2807617188, weight_update_time: 0.1388631910, other_time: 2.5236930847
epoch time: 6.8850030899s, input_fired_time: 0.1344950199, output_fired_time: 0.0000000000, propagate_forward_time: 6.2872161865, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4632921219
validation[          , genome  5361] predictions:    9685/  10000 (96.85%), best:    9727/10000 (97.27%), error:      1041.14197, best error:       928.90204 on epoch:    57, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 83.3021392822s, input_fired_time: 1.0831195116, output_fired_time: 0.9779828191, propagate_forward_time: 31.4942283630, propagate_backward_time: 47.2687873840, weight_update_time: 0.1369922161, other_time: 2.4780197144
epoch time: 6.8627591133s, input_fired_time: 0.1381416321, output_fired_time: 0.0000000000, propagate_forward_time: 6.2745137215, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4501037598
validation[          , genome  5361] predictions:    9640/  10000 (96.40%), best:    9727/10000 (97.27%), error:      1291.30896, best error:       928.90204 on epoch:    57, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 82.9044723511s, input_fired_time: 1.0794010162, output_fired_time: 0.9740779400, propagate_forward_time: 31.3698596954, propagate_backward_time: 46.9914207458, weight_update_time: 0.1375328898, other_time: 2.4897193909
epoch time: 6.8279719353s, input_fired_time: 0.1359865665, output_fired_time: 0.0000000000, propagate_forward_time: 6.2451915741, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4467935562
validation[          , genome  5361] predictions:    9684/  10000 (96.84%), best:    9727/10000 (97.27%), error:      1081.27429, best error:       928.90204 on epoch:    57, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 83.6227493286s, input_fired_time: 1.0960772038, output_fired_time: 0.9859201908, propagate_forward_time: 31.5565700531, propagate_backward_time: 47.4184761047, weight_update_time: 0.1404614896, other_time: 2.5657005310
epoch time: 6.9074912071s, input_fired_time: 0.1371434033, output_fired_time: 0.0000000000, propagate_forward_time: 6.3079404831, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4624071121
validation[          , genome  5361] predictions:    9658/  10000 (96.58%), best:    9727/10000 (97.27%), error:      1180.29211, best error:       928.90204 on epoch:    57, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 82.7918930054s, input_fired_time: 1.0759801865, output_fired_time: 0.9801021814, propagate_forward_time: 31.2866497040, propagate_backward_time: 46.9668312073, weight_update_time: 0.1365612596, other_time: 2.4823265076
epoch time: 6.8210773468s, input_fired_time: 0.1349072307, output_fired_time: 0.0000000000, propagate_forward_time: 6.2384638786, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4477062225
validation[          , genome  5361] predictions:    9685/  10000 (96.85%), best:    9727/10000 (97.27%), error:      1013.57770, best error:       928.90204 on epoch:    57, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 83.1303405762s, input_fired_time: 1.0888636112, output_fired_time: 0.9797547460, propagate_forward_time: 31.4320678711, propagate_backward_time: 47.1113777161, weight_update_time: 0.1383758336, other_time: 2.5182762146
epoch time: 6.9500565529s, input_fired_time: 0.1407096684, output_fired_time: 0.0000000000, propagate_forward_time: 6.3486170769, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4607295990
validation[          , genome  5361] predictions:    9710/  10000 (97.10%), best:    9727/10000 (97.27%), error:      1065.36206, best error:       928.90204 on epoch:    57, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 83.4625701904s, input_fired_time: 1.0968130827, output_fired_time: 0.9824605584, propagate_forward_time: 31.4805850983, propagate_backward_time: 47.3309593201, weight_update_time: 0.1408400536, other_time: 2.5717582703
epoch time: 6.8921551704s, input_fired_time: 0.1333540678, output_fired_time: 0.0000000000, propagate_forward_time: 6.3066592216, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4521417618
validation[          , genome  5361] predictions:    7151/  10000 (71.51%), best:    9727/10000 (97.27%), error:     17780.39453, best error:       928.90204 on epoch:    57, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

resetting weights to those on epoch: 57
epoch time: 83.1695785522s, input_fired_time: 1.0908726454, output_fired_time: 0.9813846350, propagate_forward_time: 31.3834266663, propagate_backward_time: 47.1550674438, weight_update_time: 0.1395218968, other_time: 2.5588264465
epoch time: 6.8612818718s, input_fired_time: 0.1368272603, output_fired_time: 0.0000000000, propagate_forward_time: 6.2650818825, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4593725204
validation[          , genome  5361] predictions:    9748/  10000 (97.48%), best:    9748/10000 (97.48%), error:       864.25085, best error:       864.25085 on epoch:    97, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 83.2681427002s, input_fired_time: 1.0852789879, output_fired_time: 0.9813972712, propagate_forward_time: 31.4650802612, propagate_backward_time: 47.1934661865, weight_update_time: 0.1384176314, other_time: 2.5429153442
epoch time: 6.8768453598s, input_fired_time: 0.1356320232, output_fired_time: 0.0000000000, propagate_forward_time: 6.2867074013, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4545059204
validation[          , genome  5361] predictions:    9742/  10000 (97.42%), best:    9748/10000 (97.48%), error:       870.10590, best error:       864.25085 on epoch:    97, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 83.1552505493s, input_fired_time: 1.0763655901, output_fired_time: 0.9776865840, propagate_forward_time: 31.4919319153, propagate_backward_time: 47.1286735535, weight_update_time: 0.1378661543, other_time: 2.4805984497
epoch time: 6.8918800354s, input_fired_time: 0.1368789077, output_fired_time: 0.0000000000, propagate_forward_time: 6.3037505150, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4512505531
validation[          , genome  5361] predictions:    9746/  10000 (97.46%), best:    9748/10000 (97.48%), error:       874.35284, best error:       864.25085 on epoch:    97, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 83.0101242065s, input_fired_time: 1.0833450556, output_fired_time: 0.9754240513, propagate_forward_time: 31.4036636353, propagate_backward_time: 47.0520896912, weight_update_time: 0.1380151808, other_time: 2.4956016541
epoch time: 6.8690485954s, input_fired_time: 0.1389356703, output_fired_time: 0.0000000000, propagate_forward_time: 6.2702150345, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4598979950
validation[          , genome  5361] predictions:    9725/  10000 (97.25%), best:    9748/10000 (97.48%), error:       888.75085, best error:       864.25085 on epoch:    97, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 34.3587760925s, input_fired_time: 0.6819741130, output_fired_time: 0.0000000000, propagate_forward_time: 31.3430747986, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3337287903
best training[          , genome  5361] predictions:   49579/  50000 (99.16%), best:    9748/10000 (97.48%), error:      1768.00195, best error:       864.25085 on epoch:    97, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 6.8715581894s, input_fired_time: 0.1362847239, output_fired_time: 0.0000000000, propagate_forward_time: 6.2798485756, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4554247856
   testing[          , genome  5361] predictions:    9787/  10000 (97.87%), best:    9748/10000 (97.48%), error:       741.59863, best error:       864.25085 on epoch:    97, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
06:34:42 (3984): called boinc_finish(0)

</stderr_txt>
]]>