Nameexact_genome_1512568488_42_6540_0
Workunit2603937
Created7 Dec 2017, 20:22:37 UTC
Sent7 Dec 2017, 20:26:42 UTC
Report deadline13 Dec 2017, 4:48:37 UTC
Received8 Dec 2017, 0:53:24 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID8187
Run time2 hours 31 min 25 sec
CPU time2 hours 27 min 45 sec
Validate stateValid
Credit1,337.14
Device peak FLOPS3.72 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size154.86 MB
Peak swap size153.22 MB
Peak disk usage2.23 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
t_fired_time: 0.0814890563, output_fired_time: 0.0000000000, propagate_forward_time: 6.8732972145, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3507566452
validation[          , genome  6540] predictions:    9680/  10000 (96.80%), best:    9678/10000 (96.78%), error:      1092.49231, best error:      1062.88623 on epoch:    11, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 92.4971466064s, input_fired_time: 0.6477839351, output_fired_time: 0.6784622669, propagate_forward_time: 36.4924812317, propagate_backward_time: 52.6823196411, weight_update_time: 0.1453464329, other_time: 1.9961051941
epoch time: 7.9082393646s, input_fired_time: 0.0829207525, output_fired_time: 0.0000000000, propagate_forward_time: 7.4660282135, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3592905998
validation[          , genome  6540] predictions:    9699/  10000 (96.99%), best:    9678/10000 (96.78%), error:      1065.96484, best error:      1062.88623 on epoch:    11, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 92.1908721924s, input_fired_time: 0.6453230381, output_fired_time: 0.6777440310, propagate_forward_time: 32.7301063538, propagate_backward_time: 56.1415901184, weight_update_time: 0.1453271210, other_time: 1.9961090088
epoch time: 7.8854374886s, input_fired_time: 0.0832528323, output_fired_time: 0.0000000000, propagate_forward_time: 7.4420466423, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3601379395
validation[          , genome  6540] predictions:    9664/  10000 (96.64%), best:    9678/10000 (96.78%), error:      1123.63721, best error:      1062.88623 on epoch:    11, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 92.3656311035s, input_fired_time: 0.6464753151, output_fired_time: 0.6762481928, propagate_forward_time: 37.2637100220, propagate_backward_time: 51.7849197388, weight_update_time: 0.1450294107, other_time: 1.9942779541
epoch time: 7.9311203957s, input_fired_time: 0.0833741501, output_fired_time: 0.0000000000, propagate_forward_time: 6.3948149681, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4529314041
validation[          , genome  6540] predictions:    9655/  10000 (96.55%), best:    9678/10000 (96.78%), error:      1134.84863, best error:      1062.88623 on epoch:    11, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 93.1148223877s, input_fired_time: 0.6489019990, output_fired_time: 0.6790001988, propagate_forward_time: 33.8413085938, propagate_backward_time: 54.9670944214, weight_update_time: 0.1452795565, other_time: 2.9785156250
epoch time: 7.7679824829s, input_fired_time: 0.0829736292, output_fired_time: 0.0000000000, propagate_forward_time: 7.3271627426, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3578462601
validation[          , genome  6540] predictions:    9613/  10000 (96.13%), best:    9678/10000 (96.78%), error:      1284.57434, best error:      1062.88623 on epoch:    11, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 92.9602355957s, input_fired_time: 0.6450791359, output_fired_time: 0.6753600240, propagate_forward_time: 40.3394508362, propagate_backward_time: 49.1861190796, weight_update_time: 0.1441561282, other_time: 2.1142234802
epoch time: 6.8021306992s, input_fired_time: 0.0835957229, output_fired_time: 0.0000000000, propagate_forward_time: 6.3581600189, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3603749275
validation[          , genome  6540] predictions:    9663/  10000 (96.63%), best:    9678/10000 (96.78%), error:      1140.62732, best error:      1062.88623 on epoch:    11, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 92.4027023315s, input_fired_time: 0.6411883235, output_fired_time: 0.6715674400, propagate_forward_time: 32.7150306702, propagate_backward_time: 56.3967247009, weight_update_time: 0.1435554624, other_time: 1.9781875610
epoch time: 6.8447604179s, input_fired_time: 0.0830593482, output_fired_time: 0.0000000000, propagate_forward_time: 6.4022946358, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3594064713
validation[          , genome  6540] predictions:    9700/  10000 (97.00%), best:    9700/10000 (97.00%), error:      1012.19159, best error:      1012.19159 on epoch:    20, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 93.6947708130s, input_fired_time: 0.6934567690, output_fired_time: 0.6784735322, propagate_forward_time: 32.0738334656, propagate_backward_time: 58.2589530945, weight_update_time: 0.1449377686, other_time: 1.9900512695
epoch time: 6.4546365738s, input_fired_time: 0.0835169181, output_fired_time: 0.0000000000, propagate_forward_time: 6.0146074295, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3565120697
validation[          , genome  6540] predictions:    9704/  10000 (97.04%), best:    9700/10000 (97.00%), error:      1021.98822, best error:      1012.19159 on epoch:    20, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 91.7578964233s, input_fired_time: 0.6443328857, output_fired_time: 0.7224720120, propagate_forward_time: 33.7420845032, propagate_backward_time: 54.6592445374, weight_update_time: 0.1448986828, other_time: 1.9897613525
epoch time: 7.9284853935s, input_fired_time: 0.0837919340, output_fired_time: 0.0000000000, propagate_forward_time: 7.4834051132, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3612885475
validation[          , genome  6540] predictions:    9677/  10000 (96.77%), best:    9700/10000 (97.00%), error:      1096.89697, best error:      1012.19159 on epoch:    20, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 92.2369995117s, input_fired_time: 0.6485496163, output_fired_time: 0.6767218709, propagate_forward_time: 36.0990066528, propagate_backward_time: 52.7624740601, weight_update_time: 0.1444759369, other_time: 2.0502471924
epoch time: 7.3940358162s, input_fired_time: 0.0823641345, output_fired_time: 0.0000000000, propagate_forward_time: 6.9269461632, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3847255707
validation[          , genome  6540] predictions:    9702/  10000 (97.02%), best:    9702/10000 (97.02%), error:       991.99146, best error:       991.99146 on epoch:    23, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 92.5445327759s, input_fired_time: 0.6480882168, output_fired_time: 0.6780572534, propagate_forward_time: 33.1357307434, propagate_backward_time: 52.8881378174, weight_update_time: 1.2525982857, other_time: 5.1945228577
epoch time: 7.3799257278s, input_fired_time: 0.0820517093, output_fired_time: 0.0000000000, propagate_forward_time: 6.9436507225, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3542232513
validation[          , genome  6540] predictions:    9712/  10000 (97.12%), best:    9712/10000 (97.12%), error:       979.79718, best error:       979.79718 on epoch:    24, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 91.6705856323s, input_fired_time: 0.6422035694, output_fired_time: 0.6751909852, propagate_forward_time: 35.7811584473, propagate_backward_time: 52.5895233154, weight_update_time: 0.1444144100, other_time: 1.9825057983
epoch time: 7.8366003036s, input_fired_time: 0.0833107531, output_fired_time: 0.0000000000, propagate_forward_time: 7.3938369751, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3594527245
validation[          , genome  6540] predictions:    9687/  10000 (96.87%), best:    9712/10000 (97.12%), error:      1005.67603, best error:       979.79718 on epoch:    24, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 92.0470504761s, input_fired_time: 0.6429912448, output_fired_time: 0.6879810095, propagate_forward_time: 33.8600387573, propagate_backward_time: 54.7739448547, weight_update_time: 0.1449156255, other_time: 2.0820960999
epoch time: 7.8065104485s, input_fired_time: 0.0912740752, output_fired_time: 0.0000000000, propagate_forward_time: 7.3583154678, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3569207191
validation[          , genome  6540] predictions:    9685/  10000 (96.85%), best:    9712/10000 (97.12%), error:       996.25928, best error:       979.79718 on epoch:    24, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 91.9374389648s, input_fired_time: 0.6441569328, output_fired_time: 0.6739700437, propagate_forward_time: 33.8535118103, propagate_backward_time: 54.7838745117, weight_update_time: 0.1438376904, other_time: 1.9819221497
epoch time: 7.4934024811s, input_fired_time: 0.0825651437, output_fired_time: 0.0000000000, propagate_forward_time: 7.0575981140, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3532390594
validation[          , genome  6540] predictions:    9705/  10000 (97.05%), best:    9712/10000 (97.12%), error:       990.19373, best error:       979.79718 on epoch:    24, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 91.9184112549s, input_fired_time: 0.6450129151, output_fired_time: 1.7879259586, propagate_forward_time: 31.7007408142, propagate_backward_time: 55.7708282471, weight_update_time: 0.1439276338, other_time: 2.0139045715
epoch time: 7.0437150002s, input_fired_time: 0.0818193108, output_fired_time: 0.0000000000, propagate_forward_time: 6.6090569496, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3528385162
validation[          , genome  6540] predictions:    9716/  10000 (97.16%), best:    9716/10000 (97.16%), error:       957.14001, best error:       957.14001 on epoch:    28, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 90.1338424683s, input_fired_time: 0.6384201646, output_fired_time: 0.6699151993, propagate_forward_time: 32.9723663330, propagate_backward_time: 52.8918418884, weight_update_time: 0.1488838345, other_time: 2.9612998962
epoch time: 6.3822989464s, input_fired_time: 0.0828429088, output_fired_time: 0.0000000000, propagate_forward_time: 5.9445533752, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3549027443
validation[          , genome  6540] predictions:    9648/  10000 (96.48%), best:    9716/10000 (97.16%), error:      1148.18909, best error:       957.14001 on epoch:    28, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 88.1123046875s, input_fired_time: 0.6391290426, output_fired_time: 0.6679575443, propagate_forward_time: 32.2194328308, propagate_backward_time: 52.6197166443, weight_update_time: 0.1428418756, other_time: 1.9660644531
epoch time: 7.4576454163s, input_fired_time: 0.0803652406, output_fired_time: 0.0000000000, propagate_forward_time: 7.0300769806, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3472032547
validation[          , genome  6540] predictions:    9682/  10000 (96.82%), best:    9716/10000 (97.16%), error:      1054.57178, best error:       957.14001 on epoch:    28, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 91.5020294189s, input_fired_time: 0.6436292529, output_fired_time: 0.6701243520, propagate_forward_time: 32.6437416077, propagate_backward_time: 54.5829162598, weight_update_time: 0.1435291767, other_time: 2.9616127014
epoch time: 7.9484434128s, input_fired_time: 0.0837503076, output_fired_time: 0.0000000000, propagate_forward_time: 7.5074906349, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3572025299
validation[          , genome  6540] predictions:    9703/  10000 (97.03%), best:    9716/10000 (97.16%), error:       992.61444, best error:       957.14001 on epoch:    28, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 89.8162384033s, input_fired_time: 0.6402789950, output_fired_time: 0.6706025004, propagate_forward_time: 34.1316184998, propagate_backward_time: 52.3863410950, weight_update_time: 0.1431160122, other_time: 1.9873962402
epoch time: 7.5355887413s, input_fired_time: 0.0820668042, output_fired_time: 0.0000000000, propagate_forward_time: 7.1026725769, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3508491516
validation[          , genome  6540] predictions:    9733/  10000 (97.33%), best:    9733/10000 (97.33%), error:       874.65552, best error:       874.65552 on epoch:    32, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 91.7308578491s, input_fired_time: 0.6429516077, output_fired_time: 0.6994070411, propagate_forward_time: 33.8503761292, propagate_backward_time: 54.5111427307, weight_update_time: 0.1432239264, other_time: 2.0269775391
epoch time: 7.9009609222s, input_fired_time: 0.0852725357, output_fired_time: 0.0000000000, propagate_forward_time: 7.4362301826, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3794584274
validation[          , genome  6540] predictions:    9676/  10000 (96.76%), best:    9733/10000 (97.33%), error:      1055.65784, best error:       874.65552 on epoch:    32, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 91.0728530884s, input_fired_time: 0.6887182593, output_fired_time: 0.6714520454, propagate_forward_time: 35.5970535278, propagate_backward_time: 51.1495018005, weight_update_time: 0.1433988810, other_time: 2.9661216736
epoch time: 7.3402552605s, input_fired_time: 0.0815999061, output_fired_time: 0.0000000000, propagate_forward_time: 6.9116816521, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3469738960
validation[          , genome  6540] predictions:    9705/  10000 (97.05%), best:    9733/10000 (97.33%), error:       966.97327, best error:       874.65552 on epoch:    32, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 90.0658416748s, input_fired_time: 0.6479457021, output_fired_time: 0.6819354892, propagate_forward_time: 32.3861808777, propagate_backward_time: 53.3780632019, weight_update_time: 0.1451276094, other_time: 2.9717102051
epoch time: 7.8383922577s, input_fired_time: 0.0826340988, output_fired_time: 0.0000000000, propagate_forward_time: 7.4005904198, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3551678658
validation[          , genome  6540] predictions:    9671/  10000 (96.71%), best:    9733/10000 (97.33%), error:      1096.41431, best error:       874.65552 on epoch:    32, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 90.6824035645s, input_fired_time: 0.6485532522, output_fired_time: 0.6811267138, propagate_forward_time: 34.3903083801, propagate_backward_time: 51.3281860352, weight_update_time: 0.6907833219, other_time: 3.6342277527
epoch time: 7.7155671120s, input_fired_time: 0.0858008415, output_fired_time: 0.0000000000, propagate_forward_time: 7.2695436478, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3602228165
validation[          , genome  6540] predictions:    9673/  10000 (96.73%), best:    9733/10000 (97.33%), error:      1041.33643, best error:       874.65552 on epoch:    32, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 91.2048950195s, input_fired_time: 0.6446931958, output_fired_time: 0.6744648814, propagate_forward_time: 33.4844017029, propagate_backward_time: 53.4420356750, weight_update_time: 0.1436998248, other_time: 2.9593048096
epoch time: 7.7564234734s, input_fired_time: 0.0831897482, output_fired_time: 0.0000000000, propagate_forward_time: 7.3154115677, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3578219414
validation[          , genome  6540] predictions:    9685/  10000 (96.85%), best:    9733/10000 (97.33%), error:      1044.91223, best error:       874.65552 on epoch:    32, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 90.7639846802s, input_fired_time: 0.6453627348, output_fired_time: 0.6804779768, propagate_forward_time: 32.1517066956, propagate_backward_time: 55.2400817871, weight_update_time: 0.1438554376, other_time: 2.0463523865
epoch time: 6.8451056480s, input_fired_time: 0.0839672983, output_fired_time: 0.0000000000, propagate_forward_time: 6.4025435448, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3585948944
validation[          , genome  6540] predictions:    9667/  10000 (96.67%), best:    9733/10000 (97.33%), error:      1042.39758, best error:       874.65552 on epoch:    32, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 89.0427398682s, input_fired_time: 0.6910040975, output_fired_time: 0.6884567738, propagate_forward_time: 33.0070304871, propagate_backward_time: 52.6809730530, weight_update_time: 0.1439703554, other_time: 1.9752807617
epoch time: 7.9824619293s, input_fired_time: 0.0838441476, output_fired_time: 0.0000000000, propagate_forward_time: 7.5429797173, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3556380272
validation[          , genome  6540] predictions:    9696/  10000 (96.96%), best:    9733/10000 (97.33%), error:       963.20605, best error:       874.65552 on epoch:    32, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 90.5159912109s, input_fired_time: 0.6389922500, output_fired_time: 0.6626546979, propagate_forward_time: 34.3057975769, propagate_backward_time: 52.9386940002, weight_update_time: 0.1423284560, other_time: 1.9698562622
epoch time: 7.3717832565s, input_fired_time: 0.0825162753, output_fired_time: 0.0000000000, propagate_forward_time: 6.9055352211, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3837318420
validation[          , genome  6540] predictions:    9701/  10000 (97.01%), best:    9733/10000 (97.33%), error:       993.57281, best error:       874.65552 on epoch:    32, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 89.9298324585s, input_fired_time: 0.6392412186, output_fired_time: 0.6660227180, propagate_forward_time: 32.6806144714, propagate_backward_time: 52.8859634399, weight_update_time: 0.1430711299, other_time: 3.0579872131
epoch time: 7.4937477112s, input_fired_time: 0.0820448175, output_fired_time: 0.0000000000, propagate_forward_time: 7.0622706413, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3494324684
validation[          , genome  6540] predictions:    9720/  10000 (97.20%), best:    9733/10000 (97.33%), error:       913.03644, best error:       874.65552 on epoch:    32, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 90.4330444336s, input_fired_time: 0.6421929598, output_fired_time: 0.6674768925, propagate_forward_time: 32.2246284485, propagate_backward_time: 54.9327850342, weight_update_time: 0.1426567584, other_time: 1.9659538269
epoch time: 7.9154162407s, input_fired_time: 0.0832344443, output_fired_time: 0.0000000000, propagate_forward_time: 7.4769601822, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3552217484
validation[          , genome  6540] predictions:    9724/  10000 (97.24%), best:    9733/10000 (97.33%), error:       920.14459, best error:       874.65552 on epoch:    32, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 90.0334167480s, input_fired_time: 0.6449387074, output_fired_time: 0.6702623367, propagate_forward_time: 35.6780128479, propagate_backward_time: 51.0618705750, weight_update_time: 0.1436348110, other_time: 1.9783325195
epoch time: 7.2234663963s, input_fired_time: 0.0823146626, output_fired_time: 0.0000000000, propagate_forward_time: 6.7923278809, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3488240242
validation[          , genome  6540] predictions:    9707/  10000 (97.07%), best:    9733/10000 (97.33%), error:       928.65405, best error:       874.65552 on epoch:    32, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 90.4972610474s, input_fired_time: 0.6432846785, output_fired_time: 0.6664761901, propagate_forward_time: 35.1378173828, propagate_backward_time: 52.0814399719, weight_update_time: 0.1428990066, other_time: 1.9682426453
epoch time: 6.9180464745s, input_fired_time: 0.0844005421, output_fired_time: 0.0000000000, propagate_forward_time: 6.4736919403, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3599538803
validation[          , genome  6540] predictions:    9725/  10000 (97.25%), best:    9733/10000 (97.33%), error:       927.25317, best error:       874.65552 on epoch:    32, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 91.9162445068s, input_fired_time: 0.6562640071, output_fired_time: 0.6732955575, propagate_forward_time: 35.1422309875, propagate_backward_time: 53.4657440186, weight_update_time: 0.1441630721, other_time: 1.9787101746
epoch time: 6.8347864151s, input_fired_time: 0.0850637257, output_fired_time: 0.0000000000, propagate_forward_time: 6.3872666359, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3624558449
validation[          , genome  6540] predictions:    9699/  10000 (96.99%), best:    9733/10000 (97.33%), error:       994.66962, best error:       874.65552 on epoch:    32, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 88.5120391846s, input_fired_time: 0.6386265755, output_fired_time: 0.6591731310, propagate_forward_time: 31.9831466675, propagate_backward_time: 52.2761039734, weight_update_time: 0.1419028938, other_time: 2.9549903870
epoch time: 7.6143579483s, input_fired_time: 0.0819620490, output_fired_time: 0.0000000000, propagate_forward_time: 6.1837511063, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3486447334
validation[          , genome  6540] predictions:    9711/  10000 (97.11%), best:    9733/10000 (97.33%), error:       965.64325, best error:       874.65552 on epoch:    32, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 90.7923507690s, input_fired_time: 0.6987773180, output_fired_time: 0.6724014282, propagate_forward_time: 33.7073516846, propagate_backward_time: 53.7176628113, weight_update_time: 0.1447483003, other_time: 1.9961585999
epoch time: 7.9504194260s, input_fired_time: 0.0847425014, output_fired_time: 0.0000000000, propagate_forward_time: 7.5071163177, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3585605621
validation[          , genome  6540] predictions:    9718/  10000 (97.18%), best:    9733/10000 (97.33%), error:       936.80304, best error:       874.65552 on epoch:    32, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 92.1604156494s, input_fired_time: 0.6562051773, output_fired_time: 0.6822230220, propagate_forward_time: 32.9339408875, propagate_backward_time: 55.9023475647, weight_update_time: 0.1442306340, other_time: 1.9857025146
epoch time: 7.1433434486s, input_fired_time: 0.0817203149, output_fired_time: 0.0000000000, propagate_forward_time: 6.7169928551, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3446302414
validation[          , genome  6540] predictions:    9723/  10000 (97.23%), best:    9733/10000 (97.33%), error:       902.05170, best error:       874.65552 on epoch:    32, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 98.1683044434s, input_fired_time: 0.6539638638, output_fired_time: 0.6889393926, propagate_forward_time: 37.6032028198, propagate_backward_time: 57.1091461182, weight_update_time: 0.1442586929, other_time: 2.1130523682
epoch time: 7.8019204140s, input_fired_time: 0.0838173106, output_fired_time: 0.0000000000, propagate_forward_time: 7.3344702721, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3836326599
validation[          , genome  6540] predictions:    9718/  10000 (97.18%), best:    9733/10000 (97.33%), error:       917.55530, best error:       874.65552 on epoch:    32, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 96.7673110962s, input_fired_time: 0.6735943556, output_fired_time: 0.6812684536, propagate_forward_time: 33.1674194336, propagate_backward_time: 59.1721534729, weight_update_time: 1.1461614370, other_time: 3.0728797913
epoch time: 8.6057910919s, input_fired_time: 0.0976379067, output_fired_time: 0.0000000000, propagate_forward_time: 8.1342325211, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3739204407
validation[          , genome  6540] predictions:    9703/  10000 (97.03%), best:    9733/10000 (97.33%), error:       954.07086, best error:       874.65552 on epoch:    32, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 92.5057983398s, input_fired_time: 0.6552559733, output_fired_time: 0.6829205155, propagate_forward_time: 34.0444450378, propagate_backward_time: 55.1228256226, weight_update_time: 0.1445537955, other_time: 2.0003471375
epoch time: 7.9237422943s, input_fired_time: 0.0904005244, output_fired_time: 0.0000000000, propagate_forward_time: 7.4594817162, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3738598824
validation[          , genome  6540] predictions:    9683/  10000 (96.83%), best:    9733/10000 (97.33%), error:      1040.09229, best error:       874.65552 on epoch:    32, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 92.1168060303s, input_fired_time: 0.6562595367, output_fired_time: 0.6755545139, propagate_forward_time: 33.9757575989, propagate_backward_time: 53.7967720032, weight_update_time: 0.1454112083, other_time: 3.0124664307
epoch time: 7.8029637337s, input_fired_time: 0.0848405883, output_fired_time: 0.0000000000, propagate_forward_time: 7.3535537720, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3645691872
validation[          , genome  6540] predictions:    9700/  10000 (97.00%), best:    9733/10000 (97.33%), error:       962.67010, best error:       874.65552 on epoch:    32, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 92.7099533081s, input_fired_time: 0.6536360383, output_fired_time: 0.7241918445, propagate_forward_time: 38.3327980042, propagate_backward_time: 50.9837341309, weight_update_time: 0.1451462954, other_time: 2.0155982971
epoch time: 8.4450054169s, input_fired_time: 0.0855550990, output_fired_time: 0.0000000000, propagate_forward_time: 7.9731264114, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3863239288
validation[          , genome  6540] predictions:    9727/  10000 (97.27%), best:    9733/10000 (97.33%), error:       912.89313, best error:       874.65552 on epoch:    32, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 90.7707901001s, input_fired_time: 0.6463158131, output_fired_time: 1.6905143261, propagate_forward_time: 35.2629699707, propagate_backward_time: 51.1501655579, weight_update_time: 0.1436859369, other_time: 2.0208244324
epoch time: 7.9108529091s, input_fired_time: 0.0852160826, output_fired_time: 0.0000000000, propagate_forward_time: 7.4641046524, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3615322113
validation[          , genome  6540] predictions:    9720/  10000 (97.20%), best:    9733/10000 (97.33%), error:       918.45325, best error:       874.65552 on epoch:    32, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 92.2263183594s, input_fired_time: 0.6550029516, output_fired_time: 0.7157859206, propagate_forward_time: 32.9426612854, propagate_backward_time: 55.9117088318, weight_update_time: 0.1448506564, other_time: 2.0011596680
epoch time: 7.7090635300s, input_fired_time: 0.0833699778, output_fired_time: 0.0000000000, propagate_forward_time: 7.2717576027, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3539357185
validation[          , genome  6540] predictions:    9736/  10000 (97.36%), best:    9736/10000 (97.36%), error:       870.57684, best error:       870.57684 on epoch:    55, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 90.5394592285s, input_fired_time: 0.6458956599, output_fired_time: 0.6754065752, propagate_forward_time: 36.2715873718, propagate_backward_time: 50.9682693481, weight_update_time: 0.1430690885, other_time: 1.9782981873
epoch time: 7.7715706825s, input_fired_time: 0.0834813416, output_fired_time: 0.0000000000, propagate_forward_time: 7.3338775635, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3542118073
validation[          , genome  6540] predictions:    9711/  10000 (97.11%), best:    9736/10000 (97.36%), error:       934.03345, best error:       870.57684 on epoch:    55, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 91.2491760254s, input_fired_time: 0.6485978365, output_fired_time: 0.6722313166, propagate_forward_time: 34.7134246826, propagate_backward_time: 53.2286872864, weight_update_time: 0.1437344402, other_time: 1.9862327576
epoch time: 7.7348389626s, input_fired_time: 0.0834245682, output_fired_time: 0.0000000000, propagate_forward_time: 6.2946233749, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3567910194
validation[          , genome  6540] predictions:    9657/  10000 (96.57%), best:    9736/10000 (97.36%), error:      1087.49658, best error:       870.57684 on epoch:    55, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 91.8122177124s, input_fired_time: 0.6532143354, output_fired_time: 0.6756370664, propagate_forward_time: 32.8743057251, propagate_backward_time: 55.6129913330, weight_update_time: 0.1450726986, other_time: 1.9960708618
epoch time: 7.7232851982s, input_fired_time: 0.0837472826, output_fired_time: 0.0000000000, propagate_forward_time: 7.2861642838, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3533735275
validation[          , genome  6540] predictions:    9723/  10000 (97.23%), best:    9736/10000 (97.36%), error:       914.65753, best error:       870.57684 on epoch:    55, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 91.6981277466s, input_fired_time: 0.6491603851, output_fired_time: 0.6731205583, propagate_forward_time: 33.8176879883, propagate_backward_time: 54.4976310730, weight_update_time: 0.1440463811, other_time: 2.0605278015
epoch time: 7.6493368149s, input_fired_time: 0.0839102641, output_fired_time: 0.0000000000, propagate_forward_time: 7.2095952034, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3558311462
validation[          , genome  6540] predictions:    9728/  10000 (97.28%), best:    9736/10000 (97.36%), error:       895.40771, best error:       870.57684 on epoch:    55, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 91.2700119019s, input_fired_time: 1.6516925097, output_fired_time: 0.6721704006, propagate_forward_time: 33.5898361206, propagate_backward_time: 53.3292961121, weight_update_time: 0.1841264069, other_time: 2.0270118713
epoch time: 7.7648200989s, input_fired_time: 0.0840430632, output_fired_time: 0.0000000000, propagate_forward_time: 7.3220248222, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3587522507
validation[          , genome  6540] predictions:    9689/  10000 (96.89%), best:    9736/10000 (97.36%), error:      1007.90112, best error:       870.57684 on epoch:    55, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 90.6382141113s, input_fired_time: 0.6467470527, output_fired_time: 0.6666128039, propagate_forward_time: 34.3665809631, propagate_backward_time: 52.9828109741, weight_update_time: 0.1433956623, other_time: 1.9754676819
epoch time: 7.4513316154s, input_fired_time: 0.0836150348, output_fired_time: 0.0000000000, propagate_forward_time: 7.0140023232, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3537144661
validation[          , genome  6540] predictions:    9695/  10000 (96.95%), best:    9736/10000 (97.36%), error:       989.02954, best error:       870.57684 on epoch:    55, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 92.3228759766s, input_fired_time: 0.6546071172, output_fired_time: 0.6756175756, propagate_forward_time: 35.0252571106, propagate_backward_time: 52.9037055969, weight_update_time: 0.1508833021, other_time: 3.0636825562
epoch time: 7.3056254387s, input_fired_time: 0.0830388293, output_fired_time: 0.0000000000, propagate_forward_time: 6.8341188431, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3884677887
validation[          , genome  6540] predictions:    9737/  10000 (97.37%), best:    9736/10000 (97.36%), error:       938.12103, best error:       870.57684 on epoch:    55, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 90.7410202026s, input_fired_time: 0.6584711671, output_fired_time: 0.6829013228, propagate_forward_time: 34.6784896851, propagate_backward_time: 51.7969589233, weight_update_time: 0.1466461718, other_time: 2.9242019653
epoch time: 7.9732146263s, input_fired_time: 0.0937498882, output_fired_time: 0.0000000000, propagate_forward_time: 7.4990010262, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3804636002
validation[          , genome  6540] predictions:    9732/  10000 (97.32%), best:    9736/10000 (97.36%), error:       904.79645, best error:       870.57684 on epoch:    55, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 95.0067138672s, input_fired_time: 0.6622153521, output_fired_time: 0.7399241328, propagate_forward_time: 35.8321914673, propagate_backward_time: 55.7615623474, weight_update_time: 0.1461125165, other_time: 2.0108222961
epoch time: 7.0923848152s, input_fired_time: 0.0918116793, output_fired_time: 0.0000000000, propagate_forward_time: 6.6079730988, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3926000595
validation[          , genome  6540] predictions:    9712/  10000 (97.12%), best:    9736/10000 (97.36%), error:       928.54333, best error:       870.57684 on epoch:    55, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 91.7973251343s, input_fired_time: 0.6557844281, output_fired_time: 0.6768727303, propagate_forward_time: 35.7555809021, propagate_backward_time: 52.6646423340, weight_update_time: 0.1475217491, other_time: 2.0444450378
epoch time: 8.1611003876s, input_fired_time: 0.0840808377, output_fired_time: 0.0000000000, propagate_forward_time: 7.6904134750, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3866062164
validation[          , genome  6540] predictions:    9688/  10000 (96.88%), best:    9736/10000 (97.36%), error:       962.52667, best error:       870.57684 on epoch:    55, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 91.9259109497s, input_fired_time: 0.6525925398, output_fired_time: 1.6991416216, propagate_forward_time: 32.7957878113, propagate_backward_time: 54.7865715027, weight_update_time: 0.1445126235, other_time: 1.9918136597
epoch time: 7.7374153137s, input_fired_time: 0.0854267925, output_fired_time: 0.0000000000, propagate_forward_time: 7.2950339317, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3569545746
validation[          , genome  6540] predictions:    9720/  10000 (97.20%), best:    9736/10000 (97.36%), error:       936.41138, best error:       870.57684 on epoch:    55, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 92.5266571045s, input_fired_time: 0.6543715000, output_fired_time: 0.6775650978, propagate_forward_time: 36.1207275391, propagate_backward_time: 53.0373611450, weight_update_time: 0.1457857043, other_time: 2.0366287231
epoch time: 7.8587570190s, input_fired_time: 0.0849761590, output_fired_time: 0.0000000000, propagate_forward_time: 7.4121279716, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3616528511
validation[          , genome  6540] predictions:    9667/  10000 (96.67%), best:    9736/10000 (97.36%), error:      1117.27148, best error:       870.57684 on epoch:    55, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 91.2396621704s, input_fired_time: 0.6603003144, output_fired_time: 0.6713007689, propagate_forward_time: 34.4933166504, propagate_backward_time: 53.4093322754, weight_update_time: 0.1446166784, other_time: 2.0054092407
epoch time: 8.0893802643s, input_fired_time: 0.0881936774, output_fired_time: 0.0000000000, propagate_forward_time: 7.6207847595, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3804016113
validation[          , genome  6540] predictions:    9693/  10000 (96.93%), best:    9736/10000 (97.36%), error:      1006.00702, best error:       870.57684 on epoch:    55, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 91.2120056152s, input_fired_time: 0.6552603841, output_fired_time: 0.6708937883, propagate_forward_time: 33.4707527161, propagate_backward_time: 54.4271430969, weight_update_time: 0.1436172277, other_time: 1.9879608154
epoch time: 7.4529023170s, input_fired_time: 0.1302781254, output_fired_time: 0.0000000000, propagate_forward_time: 6.9653472900, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3572769165
validation[          , genome  6540] predictions:    9715/  10000 (97.15%), best:    9736/10000 (97.36%), error:       951.56903, best error:       870.57684 on epoch:    55, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 92.8844757080s, input_fired_time: 0.6574668288, output_fired_time: 0.7190361619, propagate_forward_time: 32.2585906982, propagate_backward_time: 57.2325172424, weight_update_time: 0.1449017376, other_time: 2.0168647766
epoch time: 7.8154654503s, input_fired_time: 0.0876841471, output_fired_time: 0.0000000000, propagate_forward_time: 7.3562655449, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3715157509
validation[          , genome  6540] predictions:    9627/  10000 (96.27%), best:    9736/10000 (97.36%), error:      1234.09399, best error:       870.57684 on epoch:    55, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 93.0873489380s, input_fired_time: 0.7021932006, output_fired_time: 1.8791905642, propagate_forward_time: 32.1057052612, propagate_backward_time: 56.3255653381, weight_update_time: 0.1501290351, other_time: 2.0746955872
epoch time: 7.9259033203s, input_fired_time: 0.0924933106, output_fired_time: 0.0000000000, propagate_forward_time: 7.4569344521, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3764753342
validation[          , genome  6540] predictions:    9730/  10000 (97.30%), best:    9736/10000 (97.36%), error:       885.60968, best error:       870.57684 on epoch:    55, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 91.5913314819s, input_fired_time: 0.6498799920, output_fired_time: 0.6709147692, propagate_forward_time: 35.8711891174, propagate_backward_time: 52.4213600159, weight_update_time: 0.1440177858, other_time: 1.9779891968
epoch time: 7.3775000572s, input_fired_time: 0.0841143504, output_fired_time: 0.0000000000, propagate_forward_time: 6.9320120811, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3613734245
validation[          , genome  6540] predictions:    9735/  10000 (97.35%), best:    9736/10000 (97.36%), error:       913.74377, best error:       870.57684 on epoch:    55, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 91.0014495850s, input_fired_time: 0.6573998332, output_fired_time: 0.6805584431, propagate_forward_time: 34.9129714966, propagate_backward_time: 52.7459983826, weight_update_time: 0.1447226703, other_time: 2.0045204163
epoch time: 7.8109970093s, input_fired_time: 0.0872572958, output_fired_time: 0.0000000000, propagate_forward_time: 7.3522243500, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3715152740
validation[          , genome  6540] predictions:    9741/  10000 (97.41%), best:    9736/10000 (97.36%), error:       878.10767, best error:       870.57684 on epoch:    55, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 91.9629821777s, input_fired_time: 0.6562185287, output_fired_time: 0.6783123016, propagate_forward_time: 32.6509590149, propagate_backward_time: 55.9812583923, weight_update_time: 0.1455129236, other_time: 1.9962310791
epoch time: 7.8567004204s, input_fired_time: 0.0868573710, output_fired_time: 0.0000000000, propagate_forward_time: 7.4036669731, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3661761284
validation[          , genome  6540] predictions:    9712/  10000 (97.12%), best:    9736/10000 (97.36%), error:       947.88373, best error:       870.57684 on epoch:    55, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 92.2325592041s, input_fired_time: 0.6660789847, output_fired_time: 0.6842364669, propagate_forward_time: 34.6211585999, propagate_backward_time: 54.2307548523, weight_update_time: 0.1477103978, other_time: 2.0303344727
epoch time: 7.7862210274s, input_fired_time: 0.0887596533, output_fired_time: 0.0000000000, propagate_forward_time: 7.3260269165, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3714346886
validation[          , genome  6540] predictions:    9726/  10000 (97.26%), best:    9736/10000 (97.36%), error:       897.00122, best error:       870.57684 on epoch:    55, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 94.7572784424s, input_fired_time: 0.6662238836, output_fired_time: 0.6844661832, propagate_forward_time: 35.5466117859, propagate_backward_time: 55.8508262634, weight_update_time: 0.1445439458, other_time: 2.0091552734
epoch time: 6.9602570534s, input_fired_time: 0.0871531442, output_fired_time: 0.0000000000, propagate_forward_time: 6.4909834862, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3821206093
validation[          , genome  6540] predictions:    9736/  10000 (97.36%), best:    9736/10000 (97.36%), error:       915.51410, best error:       870.57684 on epoch:    55, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 90.6241683960s, input_fired_time: 0.6632350683, output_fired_time: 0.7088643312, propagate_forward_time: 34.2444763184, propagate_backward_time: 51.9227523804, weight_update_time: 0.1446579695, other_time: 3.0848388672
epoch time: 7.4009594917s, input_fired_time: 0.0883834884, output_fired_time: 0.0000000000, propagate_forward_time: 6.9114298820, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4011459351
validation[          , genome  6540] predictions:    9716/  10000 (97.16%), best:    9736/10000 (97.36%), error:       932.39954, best error:       870.57684 on epoch:    55, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 94.1392288208s, input_fired_time: 1.6465134621, output_fired_time: 0.6894064546, propagate_forward_time: 35.3609275818, propagate_backward_time: 54.3542366028, weight_update_time: 0.1468945146, other_time: 2.0881423950
epoch time: 8.4005975723s, input_fired_time: 0.0900811702, output_fired_time: 0.0000000000, propagate_forward_time: 6.9447736740, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3657426834
validation[          , genome  6540] predictions:    9696/  10000 (96.96%), best:    9736/10000 (97.36%), error:       976.45898, best error:       870.57684 on epoch:    55, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 90.8089904785s, input_fired_time: 0.6557461023, output_fired_time: 0.6701667309, propagate_forward_time: 33.3129959106, propagate_backward_time: 54.1896705627, weight_update_time: 0.1434313506, other_time: 1.9804115295
epoch time: 7.9471693039s, input_fired_time: 0.0859463289, output_fired_time: 0.0000000000, propagate_forward_time: 7.5045537949, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3566689491
validation[          , genome  6540] predictions:    9690/  10000 (96.90%), best:    9736/10000 (97.36%), error:      1020.83746, best error:       870.57684 on epoch:    55, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 91.9310989380s, input_fired_time: 0.6547190547, output_fired_time: 0.6719161272, propagate_forward_time: 36.8072509766, propagate_backward_time: 51.8120994568, weight_update_time: 0.1437707394, other_time: 1.9851188660
epoch time: 8.0463027954s, input_fired_time: 0.0914404616, output_fired_time: 0.0000000000, propagate_forward_time: 7.5752158165, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3796463013
validation[          , genome  6540] predictions:    9701/  10000 (97.01%), best:    9736/10000 (97.36%), error:       981.79858, best error:       870.57684 on epoch:    55, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 91.7856521606s, input_fired_time: 0.6657415628, output_fired_time: 1.6564921141, propagate_forward_time: 33.9682960510, propagate_backward_time: 52.4803962708, weight_update_time: 0.1438042074, other_time: 3.0147247314
epoch time: 7.7772769928s, input_fired_time: 0.0868569911, output_fired_time: 0.0000000000, propagate_forward_time: 7.3276815414, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3627386093
validation[          , genome  6540] predictions:    9703/  10000 (97.03%), best:    9736/10000 (97.36%), error:       964.37775, best error:       870.57684 on epoch:    55, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 92.1324996948s, input_fired_time: 0.6560106277, output_fired_time: 0.6728759408, propagate_forward_time: 33.8878517151, propagate_backward_time: 52.9538459778, weight_update_time: 0.1466764957, other_time: 3.9619140625
epoch time: 8.0489997864s, input_fired_time: 0.0861614719, output_fired_time: 0.0000000000, propagate_forward_time: 7.6023530960, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3604850769
validation[          , genome  6540] predictions:    9676/  10000 (96.76%), best:    9736/10000 (97.36%), error:      1046.52893, best error:       870.57684 on epoch:    55, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 93.1047439575s, input_fired_time: 0.6627769470, output_fired_time: 0.6836819649, propagate_forward_time: 36.3614387512, propagate_backward_time: 53.3895149231, weight_update_time: 0.1453474462, other_time: 2.0073318481
epoch time: 7.6552824974s, input_fired_time: 0.0848424435, output_fired_time: 0.0000000000, propagate_forward_time: 7.2174263000, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3530139923
validation[          , genome  6540] predictions:    9735/  10000 (97.35%), best:    9736/10000 (97.36%), error:       906.19153, best error:       870.57684 on epoch:    55, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 89.1876068115s, input_fired_time: 0.6445956826, output_fired_time: 0.6526694894, propagate_forward_time: 34.8204383850, propagate_backward_time: 51.1232681274, weight_update_time: 0.1407834291, other_time: 1.9466362000
epoch time: 7.2436556816s, input_fired_time: 0.0831782743, output_fired_time: 0.0000000000, propagate_forward_time: 6.8093619347, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3511157036
validation[          , genome  6540] predictions:    9721/  10000 (97.21%), best:    9736/10000 (97.36%), error:       904.26331, best error:       870.57684 on epoch:    55, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 92.3181076050s, input_fired_time: 0.7467918992, output_fired_time: 0.6810700893, propagate_forward_time: 33.9276847839, propagate_backward_time: 54.9285278320, weight_update_time: 0.1781574786, other_time: 2.0340309143
epoch time: 7.7103495598s, input_fired_time: 0.0950672776, output_fired_time: 0.0000000000, propagate_forward_time: 7.2414832115, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3737988472
validation[          , genome  6540] predictions:    9720/  10000 (97.20%), best:    9736/10000 (97.36%), error:       922.92084, best error:       870.57684 on epoch:    55, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 92.7387542725s, input_fired_time: 0.6655976176, output_fired_time: 0.7197422385, propagate_forward_time: 33.3784332275, propagate_backward_time: 55.9794273376, weight_update_time: 0.1450484246, other_time: 1.9955558777
epoch time: 7.8983426094s, input_fired_time: 0.0915164873, output_fired_time: 0.0000000000, propagate_forward_time: 7.4447636604, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3620624542
validation[          , genome  6540] predictions:    9686/  10000 (96.86%), best:    9736/10000 (97.36%), error:      1026.48181, best error:       870.57684 on epoch:    55, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 91.7247543335s, input_fired_time: 0.6550965905, output_fired_time: 0.6798679233, propagate_forward_time: 33.6313667297, propagate_backward_time: 54.7624473572, weight_update_time: 0.1442599297, other_time: 1.9959716797
epoch time: 7.5548019409s, input_fired_time: 0.0840316340, output_fired_time: 0.0000000000, propagate_forward_time: 7.1193952560, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3513751030
validation[          , genome  6540] predictions:    9726/  10000 (97.26%), best:    9736/10000 (97.36%), error:       897.24347, best error:       870.57684 on epoch:    55, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 91.8903808594s, input_fired_time: 0.6573821306, output_fired_time: 0.6729753017, propagate_forward_time: 36.1080474854, propagate_backward_time: 52.4401779175, weight_update_time: 0.1442228407, other_time: 2.0118026733
epoch time: 7.8424344063s, input_fired_time: 0.0882845297, output_fired_time: 0.0000000000, propagate_forward_time: 7.3941307068, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3600192070
validation[          , genome  6540] predictions:    9724/  10000 (97.24%), best:    9736/10000 (97.36%), error:       890.42108, best error:       870.57684 on epoch:    55, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 93.1901321411s, input_fired_time: 1.6466127634, output_fired_time: 0.6811201572, propagate_forward_time: 33.5368080139, propagate_backward_time: 55.2794761658, weight_update_time: 0.1478998214, other_time: 2.0461120605
epoch time: 8.0814781189s, input_fired_time: 0.0859628618, output_fired_time: 0.0000000000, propagate_forward_time: 7.6340699196, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3614454269
validation[          , genome  6540] predictions:    9718/  10000 (97.18%), best:    9736/10000 (97.36%), error:       939.31897, best error:       870.57684 on epoch:    55, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 90.9135437012s, input_fired_time: 0.6545545459, output_fired_time: 0.6674619317, propagate_forward_time: 33.5387573242, propagate_backward_time: 54.0786590576, weight_update_time: 0.1435041428, other_time: 1.9741058350
epoch time: 7.7521858215s, input_fired_time: 0.0891758874, output_fired_time: 0.0000000000, propagate_forward_time: 7.2965192795, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3664908409
validation[          , genome  6540] predictions:    9699/  10000 (96.99%), best:    9736/10000 (97.36%), error:       997.48157, best error:       870.57684 on epoch:    55, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 90.3730621338s, input_fired_time: 0.6567347646, output_fired_time: 0.6737095118, propagate_forward_time: 31.0811977386, propagate_backward_time: 54.0231552124, weight_update_time: 0.1426220834, other_time: 3.9382629395
epoch time: 8.0406646729s, input_fired_time: 0.0864920616, output_fired_time: 0.0000000000, propagate_forward_time: 7.5809941292, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3731784821
validation[          , genome  6540] predictions:    9720/  10000 (97.20%), best:    9736/10000 (97.36%), error:       931.40424, best error:       870.57684 on epoch:    55, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 92.6820449829s, input_fired_time: 0.6665868759, output_fired_time: 0.6760388017, propagate_forward_time: 36.3020820618, propagate_backward_time: 53.0227432251, weight_update_time: 0.1485694796, other_time: 2.0145912170
epoch time: 7.2240271568s, input_fired_time: 0.0850184113, output_fired_time: 0.0000000000, propagate_forward_time: 6.7895617485, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3494467735
validation[          , genome  6540] predictions:    9650/  10000 (96.50%), best:    9736/10000 (97.36%), error:      1136.64893, best error:       870.57684 on epoch:    55, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 92.8295593262s, input_fired_time: 0.6644851565, output_fired_time: 0.6877782941, propagate_forward_time: 33.9986534119, propagate_backward_time: 54.2697639465, weight_update_time: 0.1484150738, other_time: 3.2088851929
epoch time: 7.5221772194s, input_fired_time: 0.0847584680, output_fired_time: 0.0000000000, propagate_forward_time: 7.0864243507, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3509945869
validation[          , genome  6540] predictions:    9707/  10000 (97.07%), best:    9736/10000 (97.36%), error:       951.57764, best error:       870.57684 on epoch:    55, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 91.3063354492s, input_fired_time: 0.6547806263, output_fired_time: 0.6711603999, propagate_forward_time: 34.5129241943, propagate_backward_time: 53.4848976135, weight_update_time: 0.1432948411, other_time: 1.9825782776
epoch time: 7.7708287239s, input_fired_time: 0.0857510492, output_fired_time: 0.0000000000, propagate_forward_time: 7.3260216713, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3590559959
validation[          , genome  6540] predictions:    9718/  10000 (97.18%), best:    9736/10000 (97.36%), error:       973.50659, best error:       870.57684 on epoch:    55, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 93.5691299438s, input_fired_time: 1.6442775726, output_fired_time: 0.6823647618, propagate_forward_time: 35.1411399841, propagate_backward_time: 52.9689445496, weight_update_time: 0.1511839926, other_time: 3.1324005127
epoch time: 6.3352861404s, input_fired_time: 0.0852680281, output_fired_time: 0.0000000000, propagate_forward_time: 5.8990240097, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3509941101
validation[          , genome  6540] predictions:    9701/  10000 (97.01%), best:    9736/10000 (97.36%), error:      1011.59479, best error:       870.57684 on epoch:    55, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 91.4358520508s, input_fired_time: 0.6578493118, output_fired_time: 0.6753723621, propagate_forward_time: 34.5412025452, propagate_backward_time: 52.5844650269, weight_update_time: 0.1460767984, other_time: 2.9769630432
epoch time: 7.2925238609s, input_fired_time: 0.0831525996, output_fired_time: 0.0000000000, propagate_forward_time: 6.8604984283, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3488726616
validation[          , genome  6540] predictions:    9726/  10000 (97.26%), best:    9736/10000 (97.36%), error:       929.49078, best error:       870.57684 on epoch:    55, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 91.9967803955s, input_fired_time: 0.6729242206, output_fired_time: 0.6776016355, propagate_forward_time: 33.7822151184, propagate_backward_time: 54.8246269226, weight_update_time: 0.1522869468, other_time: 2.0394058228
epoch time: 7.3590927124s, input_fired_time: 0.0849160776, output_fired_time: 0.0000000000, propagate_forward_time: 6.9261155128, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3480610847
validation[          , genome  6540] predictions:    9725/  10000 (97.25%), best:    9736/10000 (97.36%), error:       910.22290, best error:       870.57684 on epoch:    55, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 93.5295181274s, input_fired_time: 0.6653461456, output_fired_time: 1.7731193304, propagate_forward_time: 33.8790626526, propagate_backward_time: 55.1678543091, weight_update_time: 0.1451344192, other_time: 2.0441398621
epoch time: 6.8785638809s, input_fired_time: 0.0941822156, output_fired_time: 0.0000000000, propagate_forward_time: 6.4144077301, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3699741364
validation[          , genome  6540] predictions:    9712/  10000 (97.12%), best:    9736/10000 (97.36%), error:       945.11377, best error:       870.57684 on epoch:    55, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 93.1612167358s, input_fired_time: 0.6631606221, output_fired_time: 0.6773383021, propagate_forward_time: 35.4714660645, propagate_backward_time: 54.3241081238, weight_update_time: 0.1470974386, other_time: 2.0251426697
epoch time: 6.9475460052s, input_fired_time: 0.0892148241, output_fired_time: 0.0000000000, propagate_forward_time: 6.4868640900, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3714671135
validation[          , genome  6540] predictions:    9721/  10000 (97.21%), best:    9736/10000 (97.36%), error:       913.36249, best error:       870.57684 on epoch:    55, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 93.2916641235s, input_fired_time: 0.6678236127, output_fired_time: 0.6795353889, propagate_forward_time: 33.8052597046, propagate_backward_time: 56.1168594360, weight_update_time: 0.1452395022, other_time: 2.0221862793
epoch time: 7.3582534790s, input_fired_time: 0.0838664845, output_fired_time: 0.0000000000, propagate_forward_time: 6.9212756157, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3531112671
validation[          , genome  6540] predictions:    9695/  10000 (96.95%), best:    9736/10000 (97.36%), error:      1001.00659, best error:       870.57684 on epoch:    55, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 37.8989982605s, input_fired_time: 0.4266710877, output_fired_time: 0.0000000000, propagate_forward_time: 34.4876213074, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9847068787
best training[          , genome  6540] predictions:   49377/  50000 (98.75%), best:    9736/10000 (97.36%), error:      2229.38086, best error:       870.57684 on epoch:    55, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 7.4121203423s, input_fired_time: 0.0834844038, output_fired_time: 0.0000000000, propagate_forward_time: 6.9712820053, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3573541641
   testing[          , genome  6540] predictions:    9785/  10000 (97.85%), best:    9736/10000 (97.36%), error:       742.16956, best error:       870.57684 on epoch:    55, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
19:19:41 (4432): called boinc_finish(0)

</stderr_txt>
]]>