Nameexact_genome_1512568488_43_6918_0
Workunit2605864
Created7 Dec 2017, 22:45:13 UTC
Sent7 Dec 2017, 22:51:49 UTC
Report deadline14 Dec 2017, 20:15:02 UTC
Received8 Dec 2017, 14:32:13 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID64142
Run time4 hours 30 min 43 sec
CPU time3 hours 32 min 44 sec
Validate stateValid
Credit1,722.78
Device peak FLOPS3.08 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size154.24 MB
Peak swap size157.26 MB
Peak disk usage1.79 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
9
validation[          , genome  6918] predictions:    9704/  10000 (97.04%), best:    9704/10000 (97.04%), error:       991.49719, best error:       991.49719 on epoch:    14, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 110.8075485229s, input_fired_time: 0.9735464454, output_fired_time: 0.9191096425, propagate_forward_time: 41.8092384338, propagate_backward_time: 64.5865173340, weight_update_time: 0.1311507076, other_time: 2.5191345215
epoch time: 10.1572618484s, input_fired_time: 0.2248256058, output_fired_time: 0.0000000000, propagate_forward_time: 9.3418064117, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5906295776
validation[          , genome  6918] predictions:    9684/  10000 (96.84%), best:    9704/10000 (97.04%), error:      1127.38293, best error:       991.49719 on epoch:    14, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 112.8887557983s, input_fired_time: 1.0335857868, output_fired_time: 0.8512092829, propagate_forward_time: 42.7842483521, propagate_backward_time: 65.6579360962, weight_update_time: 0.1307979226, other_time: 2.5617752075
epoch time: 9.1093301773s, input_fired_time: 0.1235863194, output_fired_time: 0.0000000000, propagate_forward_time: 8.5183334351, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4674100876
validation[          , genome  6918] predictions:    9641/  10000 (96.41%), best:    9704/10000 (97.04%), error:      1158.88086, best error:       991.49719 on epoch:    14, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 110.8999099731s, input_fired_time: 1.0077073574, output_fired_time: 0.8866878152, propagate_forward_time: 42.1002769470, propagate_backward_time: 64.3253021240, weight_update_time: 0.1296449155, other_time: 2.5799407959
epoch time: 9.1407012939s, input_fired_time: 0.1691432148, output_fired_time: 0.0000000000, propagate_forward_time: 8.5132207870, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4583368301
validation[          , genome  6918] predictions:    9685/  10000 (96.85%), best:    9704/10000 (97.04%), error:      1071.27539, best error:       991.49719 on epoch:    14, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 110.1875305176s, input_fired_time: 0.9726801515, output_fired_time: 0.8545998335, propagate_forward_time: 41.7190971375, propagate_backward_time: 64.0423812866, weight_update_time: 0.1318732202, other_time: 2.5987777710
epoch time: 9.5039930344s, input_fired_time: 0.1148627549, output_fired_time: 0.0000000000, propagate_forward_time: 8.8575153351, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5316152573
validation[          , genome  6918] predictions:    9700/  10000 (97.00%), best:    9704/10000 (97.04%), error:      1027.12866, best error:       991.49719 on epoch:    14, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 112.9214630127s, input_fired_time: 1.0736359358, output_fired_time: 0.8625935316, propagate_forward_time: 42.5670585632, propagate_backward_time: 65.7957458496, weight_update_time: 0.1321640462, other_time: 2.6224212646
epoch time: 8.7224988937s, input_fired_time: 0.1184386536, output_fired_time: 0.0000000000, propagate_forward_time: 8.1582708359, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4457893372
validation[          , genome  6918] predictions:    9448/  10000 (94.48%), best:    9704/10000 (97.04%), error:      1596.16785, best error:       991.49719 on epoch:    14, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 116.2436370850s, input_fired_time: 0.9729833603, output_fired_time: 0.8698472977, propagate_forward_time: 43.8756637573, propagate_backward_time: 67.8849639893, weight_update_time: 0.2113035470, other_time: 2.6401748657
epoch time: 8.7117824554s, input_fired_time: 0.1204631180, output_fired_time: 0.0000000000, propagate_forward_time: 8.1381015778, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4532175064
validation[          , genome  6918] predictions:    9567/  10000 (95.67%), best:    9704/10000 (97.04%), error:      1413.09033, best error:       991.49719 on epoch:    14, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 109.0691070557s, input_fired_time: 1.0265678167, output_fired_time: 0.8587473035, propagate_forward_time: 41.2452812195, propagate_backward_time: 63.3628730774, weight_update_time: 0.1320114285, other_time: 2.5756340027
epoch time: 9.1799869537s, input_fired_time: 0.1626346111, output_fired_time: 0.0000000000, propagate_forward_time: 8.5808973312, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4364547729
validation[          , genome  6918] predictions:    9469/  10000 (94.69%), best:    9704/10000 (97.04%), error:      1697.47229, best error:       991.49719 on epoch:    14, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 107.5510864258s, input_fired_time: 0.9822857380, output_fired_time: 0.8603794575, propagate_forward_time: 40.4872894287, propagate_backward_time: 62.7311248779, weight_update_time: 0.1299736202, other_time: 2.4900054932
epoch time: 8.5864830017s, input_fired_time: 0.1195742413, output_fired_time: 0.0000000000, propagate_forward_time: 8.0155687332, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4513397217
validation[          , genome  6918] predictions:    9713/  10000 (97.13%), best:    9713/10000 (97.13%), error:       977.76483, best error:       977.76483 on epoch:    22, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 109.5070114136s, input_fired_time: 1.0110663176, output_fired_time: 0.8366761208, propagate_forward_time: 41.3096160889, propagate_backward_time: 63.7301902771, weight_update_time: 0.1292988062, other_time: 2.6194648743
epoch time: 8.2473573685s, input_fired_time: 0.1168365330, output_fired_time: 0.0000000000, propagate_forward_time: 7.6947498322, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4357709885
validation[          , genome  6918] predictions:    9713/  10000 (97.13%), best:    9713/10000 (97.13%), error:       976.89368, best error:       976.89368 on epoch:    23, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 110.1757583618s, input_fired_time: 0.9798498154, output_fired_time: 0.8578760028, propagate_forward_time: 41.7231903076, propagate_backward_time: 64.0438003540, weight_update_time: 0.1316714734, other_time: 2.5710372925
epoch time: 8.7943172455s, input_fired_time: 0.1162528843, output_fired_time: 0.0000000000, propagate_forward_time: 8.2426900864, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4353742599
validation[          , genome  6918] predictions:    9698/  10000 (96.98%), best:    9713/10000 (97.13%), error:      1023.15320, best error:       976.89368 on epoch:    23, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 136.2066040039s, input_fired_time: 1.0571702719, output_fired_time: 1.1523916721, propagate_forward_time: 56.7899894714, propagate_backward_time: 74.0469589233, weight_update_time: 0.1378563941, other_time: 3.1600875854
epoch time: 15.2172594070s, input_fired_time: 0.1376834661, output_fired_time: 0.0000000000, propagate_forward_time: 14.3184156418, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7611598969
validation[          , genome  6918] predictions:    9690/  10000 (96.90%), best:    9713/10000 (97.13%), error:      1022.86945, best error:       976.89368 on epoch:    23, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 179.4200286865s, input_fired_time: 1.4309620857, output_fired_time: 1.3273817301, propagate_forward_time: 64.9321975708, propagate_backward_time: 107.4275894165, weight_update_time: 0.1489740908, other_time: 4.3018951416
epoch time: 15.2697830200s, input_fired_time: 0.1369774342, output_fired_time: 0.0000000000, propagate_forward_time: 14.5745363235, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5582695007
validation[          , genome  6918] predictions:    9719/  10000 (97.19%), best:    9719/10000 (97.19%), error:       965.70135, best error:       965.70135 on epoch:    26, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 203.5163116455s, input_fired_time: 1.7467539310, output_fired_time: 1.8875812292, propagate_forward_time: 81.2026977539, propagate_backward_time: 113.5336456299, weight_update_time: 0.1957250088, other_time: 5.1456298828
epoch time: 17.3986663818s, input_fired_time: 0.1362078935, output_fired_time: 0.0000000000, propagate_forward_time: 16.4698066711, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7926521301
validation[          , genome  6918] predictions:    9716/  10000 (97.16%), best:    9719/10000 (97.19%), error:       971.86060, best error:       965.70135 on epoch:    26, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 208.0106506348s, input_fired_time: 1.7293751240, output_fired_time: 1.4178519249, propagate_forward_time: 82.8908004761, propagate_backward_time: 117.9984130859, weight_update_time: 0.4459768832, other_time: 3.9742202759
epoch time: 15.9186153412s, input_fired_time: 0.4330382049, output_fired_time: 0.0000000000, propagate_forward_time: 14.9746570587, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5109205246
validation[          , genome  6918] predictions:    9700/  10000 (97.00%), best:    9700/10000 (97.00%), error:       956.92218, best error:       956.92218 on epoch:    28, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 195.5829315186s, input_fired_time: 1.7721621990, output_fired_time: 1.8899557590, propagate_forward_time: 67.3371734619, propagate_backward_time: 121.1830825806, weight_update_time: 0.2423725128, other_time: 3.4005661011
epoch time: 16.9125499725s, input_fired_time: 0.1364991665, output_fired_time: 0.0000000000, propagate_forward_time: 16.2179985046, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5580520630
validation[          , genome  6918] predictions:    9698/  10000 (96.98%), best:    9700/10000 (97.00%), error:       974.10364, best error:       956.92218 on epoch:    28, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 196.5848236084s, input_fired_time: 1.6550348997, output_fired_time: 1.9161999226, propagate_forward_time: 67.4845733643, propagate_backward_time: 121.9530334473, weight_update_time: 0.1489438415, other_time: 3.5759887695
epoch time: 15.8071794510s, input_fired_time: 0.1366947740, output_fired_time: 0.0000000000, propagate_forward_time: 14.9091959000, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7612886429
validation[          , genome  6918] predictions:    9717/  10000 (97.17%), best:    9700/10000 (97.00%), error:       991.77313, best error:       956.92218 on epoch:    28, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 196.3556976318s, input_fired_time: 1.6385824680, output_fired_time: 1.4083412886, propagate_forward_time: 69.1189727783, propagate_backward_time: 120.2894058228, weight_update_time: 0.1490698904, other_time: 3.9003982544
epoch time: 18.7421226501s, input_fired_time: 0.1371039003, output_fired_time: 0.0000000000, propagate_forward_time: 17.7191314697, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8858871460
validation[          , genome  6918] predictions:    9711/  10000 (97.11%), best:    9700/10000 (97.00%), error:       960.39569, best error:       956.92218 on epoch:    28, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 205.2749176025s, input_fired_time: 1.8247756958, output_fired_time: 1.4381238222, propagate_forward_time: 81.3014221191, propagate_backward_time: 115.1159973145, weight_update_time: 0.2427013367, other_time: 5.5945892334
epoch time: 19.3766975403s, input_fired_time: 0.1993536800, output_fired_time: 0.0000000000, propagate_forward_time: 18.5420761108, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6352672577
validation[          , genome  6918] predictions:    9684/  10000 (96.84%), best:    9700/10000 (97.00%), error:      1050.06079, best error:       956.92218 on epoch:    28, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 216.1984863281s, input_fired_time: 1.8555337191, output_fired_time: 2.4659895897, propagate_forward_time: 81.9857940674, propagate_backward_time: 124.3822250366, weight_update_time: 0.2977344990, other_time: 5.5089492798
epoch time: 16.6753139496s, input_fired_time: 0.5122750401, output_fired_time: 0.0000000000, propagate_forward_time: 15.2448558807, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9181823730
validation[          , genome  6918] predictions:    9695/  10000 (96.95%), best:    9700/10000 (97.00%), error:      1031.45251, best error:       956.92218 on epoch:    28, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 221.6886444092s, input_fired_time: 1.7498440742, output_fired_time: 2.1553344727, propagate_forward_time: 87.5832977295, propagate_backward_time: 126.0013961792, weight_update_time: 0.1491400450, other_time: 4.1987686157
epoch time: 15.1585922241s, input_fired_time: 0.1368309855, output_fired_time: 0.0000000000, propagate_forward_time: 14.5118360519, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5099248886
validation[          , genome  6918] predictions:    9709/  10000 (97.09%), best:    9700/10000 (97.00%), error:       987.44696, best error:       956.92218 on epoch:    28, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 204.4484252930s, input_fired_time: 2.2191159725, output_fired_time: 1.6086937189, propagate_forward_time: 81.8575286865, propagate_backward_time: 113.8888626099, weight_update_time: 0.1959443986, other_time: 4.8742294312
epoch time: 14.3844366074s, input_fired_time: 0.1363512427, output_fired_time: 0.0000000000, propagate_forward_time: 12.9858951569, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2621898651
validation[          , genome  6918] predictions:    9635/  10000 (96.35%), best:    9700/10000 (97.00%), error:      1245.04199, best error:       956.92218 on epoch:    28, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 191.2068939209s, input_fired_time: 1.3743573427, output_fired_time: 2.0151605606, propagate_forward_time: 80.3382110596, propagate_backward_time: 103.6565170288, weight_update_time: 0.1959987581, other_time: 3.8226394653
epoch time: 16.2603492737s, input_fired_time: 0.1528250426, output_fired_time: 0.0000000000, propagate_forward_time: 15.4560127258, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6515121460
validation[          , genome  6918] predictions:    9705/  10000 (97.05%), best:    9700/10000 (97.00%), error:      1002.93451, best error:       956.92218 on epoch:    28, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 192.9806213379s, input_fired_time: 1.7644798756, output_fired_time: 1.5477087498, propagate_forward_time: 70.9778976440, propagate_backward_time: 114.9895324707, weight_update_time: 0.1802608669, other_time: 3.7009963989
epoch time: 16.3597583771s, input_fired_time: 0.1377607584, output_fired_time: 0.0000000000, propagate_forward_time: 15.5209207535, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7010774612
validation[          , genome  6918] predictions:    9683/  10000 (96.83%), best:    9700/10000 (97.00%), error:      1062.73657, best error:       956.92218 on epoch:    28, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 190.7153015137s, input_fired_time: 1.4199662209, output_fired_time: 1.3285695314, propagate_forward_time: 66.2970123291, propagate_backward_time: 117.1313095093, weight_update_time: 0.1489521414, other_time: 4.5384445190
epoch time: 17.0428066254s, input_fired_time: 0.1371985972, output_fired_time: 0.0000000000, propagate_forward_time: 15.8947277069, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0108795166
validation[          , genome  6918] predictions:    9676/  10000 (96.76%), best:    9700/10000 (97.00%), error:      1041.63062, best error:       956.92218 on epoch:    28, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 117.4923858643s, input_fired_time: 1.0823791027, output_fired_time: 0.8833195567, propagate_forward_time: 44.9764785767, propagate_backward_time: 67.8821105957, weight_update_time: 0.1356932372, other_time: 2.6680984497
epoch time: 8.9466495514s, input_fired_time: 0.1253697127, output_fired_time: 0.0000000000, propagate_forward_time: 8.3566942215, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4645853043
validation[          , genome  6918] predictions:    9719/  10000 (97.19%), best:    9719/10000 (97.19%), error:       947.77942, best error:       947.77942 on epoch:    39, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 109.3096618652s, input_fired_time: 1.0472506285, output_fired_time: 0.8639106750, propagate_forward_time: 41.3140182495, propagate_backward_time: 63.5013847351, weight_update_time: 0.1320170164, other_time: 2.5830955505
epoch time: 8.7214536667s, input_fired_time: 0.1225260124, output_fired_time: 0.0000000000, propagate_forward_time: 8.1451902390, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4537372589
validation[          , genome  6918] predictions:    9706/  10000 (97.06%), best:    9719/10000 (97.19%), error:      1054.78113, best error:       947.77942 on epoch:    39, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 114.5101776123s, input_fired_time: 1.0013674498, output_fired_time: 0.8815228939, propagate_forward_time: 43.5217399597, propagate_backward_time: 66.4610214233, weight_update_time: 0.1355524659, other_time: 2.6445236206
epoch time: 9.0900783539s, input_fired_time: 0.1265708506, output_fired_time: 0.0000000000, propagate_forward_time: 8.4966945648, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4668130875
validation[          , genome  6918] predictions:    9708/  10000 (97.08%), best:    9719/10000 (97.19%), error:       983.91840, best error:       947.77942 on epoch:    39, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 113.3790283203s, input_fired_time: 0.9918944836, output_fired_time: 1.0099790096, propagate_forward_time: 42.8479652405, propagate_backward_time: 65.9608001709, weight_update_time: 0.1333077997, other_time: 2.5683898926
epoch time: 8.8246192932s, input_fired_time: 0.1233979687, output_fired_time: 0.0000000000, propagate_forward_time: 8.2460594177, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4551620483
validation[          , genome  6918] predictions:    9708/  10000 (97.08%), best:    9708/10000 (97.08%), error:       943.68176, best error:       943.68176 on epoch:    42, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 115.7491607666s, input_fired_time: 0.9953662157, output_fired_time: 0.8732117414, propagate_forward_time: 43.7763710022, propagate_backward_time: 67.4049148560, weight_update_time: 0.1336396039, other_time: 2.6992874146
epoch time: 10.7553596497s, input_fired_time: 0.1818846017, output_fired_time: 0.0000000000, propagate_forward_time: 9.9451885223, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6282863617
validation[          , genome  6918] predictions:    9675/  10000 (96.75%), best:    9708/10000 (97.08%), error:      1105.10303, best error:       943.68176 on epoch:    42, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 116.2229309082s, input_fired_time: 1.0031653643, output_fired_time: 1.0061124563, propagate_forward_time: 43.9980239868, propagate_backward_time: 67.5606918335, weight_update_time: 0.1348888576, other_time: 2.6549377441
epoch time: 8.6528091431s, input_fired_time: 0.1221184433, output_fired_time: 0.0000000000, propagate_forward_time: 8.0804128647, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4502782822
validation[          , genome  6918] predictions:    9670/  10000 (96.70%), best:    9708/10000 (97.08%), error:      1095.53796, best error:       943.68176 on epoch:    42, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 118.9287719727s, input_fired_time: 1.0195963383, output_fired_time: 0.9080663323, propagate_forward_time: 45.2655220032, propagate_backward_time: 68.9934539795, weight_update_time: 0.1386756748, other_time: 2.7421264648
epoch time: 8.5300102234s, input_fired_time: 0.1200207397, output_fired_time: 0.0000000000, propagate_forward_time: 7.9618496895, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4481396675
validation[          , genome  6918] predictions:    9716/  10000 (97.16%), best:    9708/10000 (97.08%), error:       958.31433, best error:       943.68176 on epoch:    42, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 119.5369873047s, input_fired_time: 1.0525860786, output_fired_time: 0.9490312338, propagate_forward_time: 45.5550231934, propagate_backward_time: 69.2058181763, weight_update_time: 0.1542595178, other_time: 2.7745285034
epoch time: 9.2522630692s, input_fired_time: 0.1228941232, output_fired_time: 0.0000000000, propagate_forward_time: 8.6265697479, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5027990341
validation[          , genome  6918] predictions:    9717/  10000 (97.17%), best:    9717/10000 (97.17%), error:       924.71936, best error:       924.71936 on epoch:    46, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 110.6525878906s, input_fired_time: 1.0430641174, output_fired_time: 0.8779519200, propagate_forward_time: 41.7874794006, propagate_backward_time: 64.3766174316, weight_update_time: 0.1341910213, other_time: 2.5674743652
epoch time: 8.8149309158s, input_fired_time: 0.1200872883, output_fired_time: 0.0000000000, propagate_forward_time: 8.2529630661, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4418802261
validation[          , genome  6918] predictions:    9726/  10000 (97.26%), best:    9717/10000 (97.17%), error:       957.85669, best error:       924.71936 on epoch:    46, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 113.0389633179s, input_fired_time: 1.0521512032, output_fired_time: 0.8663609028, propagate_forward_time: 42.8460922241, propagate_backward_time: 65.6762847900, weight_update_time: 0.1326376051, other_time: 2.5980682373
epoch time: 9.0688400269s, input_fired_time: 0.1227922589, output_fired_time: 0.0000000000, propagate_forward_time: 8.4896888733, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4563589096
validation[          , genome  6918] predictions:    9724/  10000 (97.24%), best:    9717/10000 (97.17%), error:       931.66010, best error:       924.71936 on epoch:    46, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 113.0131149292s, input_fired_time: 0.9930005074, output_fired_time: 0.9826765060, propagate_forward_time: 42.9570388794, propagate_backward_time: 65.5365753174, weight_update_time: 0.1331491321, other_time: 2.5438232422
epoch time: 10.3554754257s, input_fired_time: 0.1313079745, output_fired_time: 0.0000000000, propagate_forward_time: 9.7364015579, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4877662659
validation[          , genome  6918] predictions:    9727/  10000 (97.27%), best:    9727/10000 (97.27%), error:       893.26221, best error:       893.26221 on epoch:    49, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 134.2345275879s, input_fired_time: 1.0049023628, output_fired_time: 0.9910886288, propagate_forward_time: 50.6505088806, propagate_backward_time: 78.8940963745, weight_update_time: 0.1351080388, other_time: 2.6939315796
epoch time: 15.7607517242s, input_fired_time: 0.1377930641, output_fired_time: 0.0000000000, propagate_forward_time: 14.7532491684, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8697099686
validation[          , genome  6918] predictions:    9714/  10000 (97.14%), best:    9727/10000 (97.27%), error:       953.67560, best error:       893.26221 on epoch:    49, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 198.5620117188s, input_fired_time: 1.4246420860, output_fired_time: 1.8253339529, propagate_forward_time: 78.6651611328, propagate_backward_time: 112.3138504028, weight_update_time: 0.2425290495, other_time: 4.3330307007
epoch time: 16.5705909729s, input_fired_time: 0.3890587986, output_fired_time: 0.0000000000, propagate_forward_time: 14.8260288239, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3555030823
validation[          , genome  6918] predictions:    9695/  10000 (96.95%), best:    9727/10000 (97.27%), error:       968.79529, best error:       893.26221 on epoch:    49, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 187.8474731445s, input_fired_time: 1.3316482306, output_fired_time: 1.6413096189, propagate_forward_time: 71.6900482178, propagate_backward_time: 108.2210617065, weight_update_time: 0.4771768153, other_time: 4.9634017944
epoch time: 14.9284849167s, input_fired_time: 0.3882102668, output_fired_time: 0.0000000000, propagate_forward_time: 13.9040575027, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6362171173
validation[          , genome  6918] predictions:    9753/  10000 (97.53%), best:    9753/10000 (97.53%), error:       842.06097, best error:       842.06097 on epoch:    52, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 187.6911926270s, input_fired_time: 1.8769772053, output_fired_time: 1.6625552177, propagate_forward_time: 72.4107055664, propagate_backward_time: 107.9200744629, weight_update_time: 0.6491494179, other_time: 3.8208770752
epoch time: 17.4791774750s, input_fired_time: 0.2314607352, output_fired_time: 0.0000000000, propagate_forward_time: 16.6559219360, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5917949677
validation[          , genome  6918] predictions:    9756/  10000 (97.56%), best:    9756/10000 (97.56%), error:       830.79272, best error:       830.79272 on epoch:    53, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 180.6366882324s, input_fired_time: 2.3296270370, output_fired_time: 1.2500311136, propagate_forward_time: 70.7832870483, propagate_backward_time: 101.7849578857, weight_update_time: 0.1596059352, other_time: 4.4887924194
epoch time: 15.7990655899s, input_fired_time: 0.1382302642, output_fired_time: 0.0000000000, propagate_forward_time: 14.6189308167, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0419044495
validation[          , genome  6918] predictions:    9717/  10000 (97.17%), best:    9756/10000 (97.56%), error:       924.17712, best error:       830.79272 on epoch:    53, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 179.6492767334s, input_fired_time: 1.8934689760, output_fired_time: 1.5000767708, propagate_forward_time: 67.3388671875, propagate_backward_time: 105.1339492798, weight_update_time: 0.5236843824, other_time: 3.7829208374
epoch time: 15.1917428970s, input_fired_time: 0.1391134858, output_fired_time: 0.0000000000, propagate_forward_time: 14.2451210022, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8075084686
validation[          , genome  6918] predictions:    9599/  10000 (95.99%), best:    9756/10000 (97.56%), error:      1262.20544, best error:       830.79272 on epoch:    53, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 121.3025817871s, input_fired_time: 1.0428508520, output_fired_time: 0.9922450185, propagate_forward_time: 45.4885520935, propagate_backward_time: 70.9053726196, weight_update_time: 0.1329539865, other_time: 2.8735580444
epoch time: 8.8257837296s, input_fired_time: 0.1234235540, output_fired_time: 0.0000000000, propagate_forward_time: 8.2516365051, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4507236481
validation[          , genome  6918] predictions:    9683/  10000 (96.83%), best:    9756/10000 (97.56%), error:       999.05878, best error:       830.79272 on epoch:    53, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 114.9018859863s, input_fired_time: 1.1056947708, output_fired_time: 0.9863706827, propagate_forward_time: 43.7917785645, propagate_backward_time: 66.2344512939, weight_update_time: 0.1295880228, other_time: 2.7835845947
epoch time: 8.7540798187s, input_fired_time: 0.1198282391, output_fired_time: 0.0000000000, propagate_forward_time: 8.1931838989, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4410676956
validation[          , genome  6918] predictions:    9703/  10000 (97.03%), best:    9756/10000 (97.56%), error:       987.17615, best error:       830.79272 on epoch:    53, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 108.9005279541s, input_fired_time: 0.9867910147, output_fired_time: 0.8531529307, propagate_forward_time: 41.1900711060, propagate_backward_time: 63.3130378723, weight_update_time: 0.1309546083, other_time: 2.5574760437
epoch time: 8.9654626846s, input_fired_time: 0.1224302500, output_fired_time: 0.0000000000, propagate_forward_time: 8.3960218430, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4470109940
validation[          , genome  6918] predictions:    9731/  10000 (97.31%), best:    9756/10000 (97.56%), error:       921.68182, best error:       830.79272 on epoch:    53, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 111.5810623169s, input_fired_time: 0.9873907566, output_fired_time: 0.8849099874, propagate_forward_time: 42.3013534546, propagate_backward_time: 64.8310394287, weight_update_time: 0.1310493350, other_time: 2.5763702393
epoch time: 8.8138256073s, input_fired_time: 0.1246124357, output_fired_time: 0.0000000000, propagate_forward_time: 8.2338027954, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4554100037
validation[          , genome  6918] predictions:    9749/  10000 (97.49%), best:    9749/10000 (97.49%), error:       822.84589, best error:       822.84589 on epoch:    59, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 114.1656112671s, input_fired_time: 1.0132700205, output_fired_time: 0.8884631991, propagate_forward_time: 43.2923011780, propagate_backward_time: 66.3296279907, weight_update_time: 0.1357930601, other_time: 2.6419448853
epoch time: 9.9126701355s, input_fired_time: 0.1350798905, output_fired_time: 0.0000000000, propagate_forward_time: 9.2793474197, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4982423782
validation[          , genome  6918] predictions:    9726/  10000 (97.26%), best:    9749/10000 (97.49%), error:       914.49548, best error:       822.84589 on epoch:    59, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 116.5807037354s, input_fired_time: 1.0239291191, output_fired_time: 0.9093563557, propagate_forward_time: 44.3132209778, propagate_backward_time: 67.7019729614, weight_update_time: 0.1381954551, other_time: 2.6322250366
epoch time: 10.3202524185s, input_fired_time: 0.1254582852, output_fired_time: 0.0000000000, propagate_forward_time: 9.6885194778, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5062742233
validation[          , genome  6918] predictions:    9723/  10000 (97.23%), best:    9749/10000 (97.49%), error:       888.10638, best error:       822.84589 on epoch:    59, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 112.4112777710s, input_fired_time: 1.0106703043, output_fired_time: 0.8868455887, propagate_forward_time: 42.6788673401, propagate_backward_time: 65.2406616211, weight_update_time: 0.1354049593, other_time: 2.5942230225
epoch time: 8.7722139359s, input_fired_time: 0.1246354654, output_fired_time: 0.0000000000, propagate_forward_time: 8.1912412643, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4563369751
validation[          , genome  6918] predictions:    9724/  10000 (97.24%), best:    9749/10000 (97.49%), error:       896.22150, best error:       822.84589 on epoch:    59, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 117.4084243774s, input_fired_time: 1.0632096529, output_fired_time: 1.0269385576, propagate_forward_time: 44.4793739319, propagate_backward_time: 68.1392517090, weight_update_time: 0.1359062195, other_time: 2.6996459961
epoch time: 10.2311801910s, input_fired_time: 0.1384084672, output_fired_time: 0.0000000000, propagate_forward_time: 9.5836429596, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5091285706
validation[          , genome  6918] predictions:    9745/  10000 (97.45%), best:    9749/10000 (97.49%), error:       839.11230, best error:       822.84589 on epoch:    59, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 115.6236572266s, input_fired_time: 1.0170570612, output_fired_time: 1.0154081583, propagate_forward_time: 44.0531921387, propagate_backward_time: 66.8954467773, weight_update_time: 0.1357485354, other_time: 2.6425476074
epoch time: 9.7443332672s, input_fired_time: 0.1334896088, output_fired_time: 0.0000000000, propagate_forward_time: 9.1223497391, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4884939194
validation[          , genome  6918] predictions:    9737/  10000 (97.37%), best:    9749/10000 (97.49%), error:       888.00330, best error:       822.84589 on epoch:    59, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 114.9357986450s, input_fired_time: 1.0202952623, output_fired_time: 0.8930319548, propagate_forward_time: 43.6368484497, propagate_backward_time: 66.7051925659, weight_update_time: 0.1682282686, other_time: 2.6804351807
epoch time: 9.7652616501s, input_fired_time: 0.1512700915, output_fired_time: 0.0000000000, propagate_forward_time: 9.0508651733, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5631265640
validation[          , genome  6918] predictions:    9664/  10000 (96.64%), best:    9749/10000 (97.49%), error:      1102.19580, best error:       822.84589 on epoch:    59, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 118.1334991455s, input_fired_time: 1.0759497881, output_fired_time: 0.9042392969, propagate_forward_time: 44.9961166382, propagate_backward_time: 68.4988098145, weight_update_time: 0.1379301995, other_time: 2.6583862305
epoch time: 10.0051078796s, input_fired_time: 0.1302757859, output_fired_time: 0.0000000000, propagate_forward_time: 9.3973169327, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4775152206
validation[          , genome  6918] predictions:    9740/  10000 (97.40%), best:    9749/10000 (97.49%), error:       860.80664, best error:       822.84589 on epoch:    59, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 116.5956420898s, input_fired_time: 1.0167030096, output_fired_time: 0.8876454234, propagate_forward_time: 44.3257675171, propagate_backward_time: 67.6669387817, weight_update_time: 0.1362646520, other_time: 2.6985931396
epoch time: 9.3780822754s, input_fired_time: 0.1206285134, output_fired_time: 0.0000000000, propagate_forward_time: 8.7328004837, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5246534348
validation[          , genome  6918] predictions:    9711/  10000 (97.11%), best:    9749/10000 (97.49%), error:       965.46027, best error:       822.84589 on epoch:    59, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 115.0583267212s, input_fired_time: 1.0100302696, output_fired_time: 0.9144359827, propagate_forward_time: 43.7711906433, propagate_backward_time: 66.7731323242, weight_update_time: 0.1346850842, other_time: 2.5895385742
epoch time: 9.9979572296s, input_fired_time: 0.1664977223, output_fired_time: 0.0000000000, propagate_forward_time: 9.3248815536, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5065774918
validation[          , genome  6918] predictions:    9713/  10000 (97.13%), best:    9749/10000 (97.49%), error:       938.53424, best error:       822.84589 on epoch:    59, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 110.9561309814s, input_fired_time: 1.0313358307, output_fired_time: 0.8640385270, propagate_forward_time: 41.9049339294, propagate_backward_time: 64.5882034302, weight_update_time: 0.1329949498, other_time: 2.5676193237
epoch time: 9.7164936066s, input_fired_time: 0.1371494234, output_fired_time: 0.0000000000, propagate_forward_time: 9.0749645233, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5043792725
validation[          , genome  6918] predictions:    9751/  10000 (97.51%), best:    9751/10000 (97.51%), error:       803.83417, best error:       803.83417 on epoch:    69, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 115.5868682861s, input_fired_time: 1.0904802084, output_fired_time: 0.9178191423, propagate_forward_time: 43.6197357178, propagate_backward_time: 67.2465515137, weight_update_time: 0.1666215956, other_time: 2.7122879028
epoch time: 8.6363515854s, input_fired_time: 0.1683588624, output_fired_time: 0.0000000000, propagate_forward_time: 7.9938797951, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4741129875
validation[          , genome  6918] predictions:    9732/  10000 (97.32%), best:    9751/10000 (97.51%), error:       840.19214, best error:       803.83417 on epoch:    69, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 110.1489868164s, input_fired_time: 1.0005440712, output_fired_time: 0.8666156530, propagate_forward_time: 41.7137107849, propagate_backward_time: 63.9859695435, weight_update_time: 0.1325853169, other_time: 2.5821456909
epoch time: 9.4549541473s, input_fired_time: 0.1234343201, output_fired_time: 0.0000000000, propagate_forward_time: 8.8243865967, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5071334839
validation[          , genome  6918] predictions:    9689/  10000 (96.89%), best:    9751/10000 (97.51%), error:      1041.53528, best error:       803.83417 on epoch:    69, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 117.5750427246s, input_fired_time: 1.0581535101, output_fired_time: 0.9500222802, propagate_forward_time: 44.4926376343, propagate_backward_time: 68.3330078125, weight_update_time: 0.1383981854, other_time: 2.7412261963
epoch time: 10.0571460724s, input_fired_time: 0.1293905079, output_fired_time: 0.0000000000, propagate_forward_time: 9.3924865723, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5352687836
validation[          , genome  6918] predictions:    9754/  10000 (97.54%), best:    9751/10000 (97.51%), error:       827.49927, best error:       803.83417 on epoch:    69, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 113.5462188721s, input_fired_time: 1.0160542727, output_fired_time: 0.8847516775, propagate_forward_time: 42.9840545654, propagate_backward_time: 66.0571136475, weight_update_time: 0.1357378066, other_time: 2.6042480469
epoch time: 9.9331293106s, input_fired_time: 0.1729340702, output_fired_time: 0.0000000000, propagate_forward_time: 9.2060050964, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5541896820
validation[          , genome  6918] predictions:    9726/  10000 (97.26%), best:    9751/10000 (97.51%), error:       906.47192, best error:       803.83417 on epoch:    69, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 110.3530426025s, input_fired_time: 1.0164796114, output_fired_time: 0.8823059797, propagate_forward_time: 41.8943481445, propagate_backward_time: 64.0161666870, weight_update_time: 0.1327236295, other_time: 2.5437393188
epoch time: 9.8495121002s, input_fired_time: 0.1581658274, output_fired_time: 0.0000000000, propagate_forward_time: 9.1815319061, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5098142624
validation[          , genome  6918] predictions:    9738/  10000 (97.38%), best:    9751/10000 (97.51%), error:       862.31989, best error:       803.83417 on epoch:    69, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 118.6345748901s, input_fired_time: 1.0744458437, output_fired_time: 0.9394471049, propagate_forward_time: 45.1658630371, propagate_backward_time: 68.7815017700, weight_update_time: 0.1406188160, other_time: 2.6733169556
epoch time: 10.1455039978s, input_fired_time: 0.1386030465, output_fired_time: 0.0000000000, propagate_forward_time: 9.5005149841, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5063858032
validation[          , genome  6918] predictions:    9733/  10000 (97.33%), best:    9751/10000 (97.51%), error:       888.35535, best error:       803.83417 on epoch:    69, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 116.4670333862s, input_fired_time: 1.0328016281, output_fired_time: 0.9686509371, propagate_forward_time: 44.2420539856, propagate_backward_time: 67.5768661499, weight_update_time: 0.1389127374, other_time: 2.6466598511
epoch time: 9.6224155426s, input_fired_time: 0.1343692392, output_fired_time: 0.0000000000, propagate_forward_time: 9.0009536743, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4870929718
validation[          , genome  6918] predictions:    9732/  10000 (97.32%), best:    9751/10000 (97.51%), error:       873.50488, best error:       803.83417 on epoch:    69, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 120.9920349121s, input_fired_time: 1.0857069492, output_fired_time: 1.0112391710, propagate_forward_time: 45.8942031860, propagate_backward_time: 70.2593536377, weight_update_time: 0.1395419687, other_time: 2.7415313721
epoch time: 10.0569086075s, input_fired_time: 0.1381765455, output_fired_time: 0.0000000000, propagate_forward_time: 9.4154882431, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5032434464
validation[          , genome  6918] predictions:    9749/  10000 (97.49%), best:    9751/10000 (97.51%), error:       856.73523, best error:       803.83417 on epoch:    69, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 127.5885391235s, input_fired_time: 1.0451087952, output_fired_time: 0.9669017792, propagate_forward_time: 47.9654312134, propagate_backward_time: 74.8133850098, weight_update_time: 0.1409761012, other_time: 2.7977066040
epoch time: 19.1693782806s, input_fired_time: 0.1401927769, output_fired_time: 0.0000000000, propagate_forward_time: 18.1658725739, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8633136749
validation[          , genome  6918] predictions:    9750/  10000 (97.50%), best:    9751/10000 (97.51%), error:       824.86932, best error:       803.83417 on epoch:    69, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 233.3310852051s, input_fired_time: 1.8436170816, output_fired_time: 1.7642560005, propagate_forward_time: 90.9160232544, propagate_backward_time: 133.9469604492, weight_update_time: 0.1488927007, other_time: 4.8602294922
epoch time: 20.9588584900s, input_fired_time: 0.6408107877, output_fired_time: 0.0000000000, propagate_forward_time: 19.5719356537, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7461128235
validation[          , genome  6918] predictions:    9706/  10000 (97.06%), best:    9751/10000 (97.51%), error:      1032.80798, best error:       803.83417 on epoch:    69, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 238.8177185059s, input_fired_time: 2.1705322266, output_fired_time: 1.4666109085, propagate_forward_time: 96.1475753784, propagate_backward_time: 133.6333160400, weight_update_time: 0.3986700773, other_time: 5.3996734619
epoch time: 20.7007484436s, input_fired_time: 0.1395297796, output_fired_time: 0.0000000000, propagate_forward_time: 19.5567436218, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0044746399
validation[          , genome  6918] predictions:    9752/  10000 (97.52%), best:    9751/10000 (97.51%), error:       808.28638, best error:       803.83417 on epoch:    69, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 226.5552978516s, input_fired_time: 1.7342318296, output_fired_time: 1.3904576302, propagate_forward_time: 87.1040115356, propagate_backward_time: 132.1200561523, weight_update_time: 0.1489653885, other_time: 4.2065429688
epoch time: 16.6590480804s, input_fired_time: 0.1411805153, output_fired_time: 0.0000000000, propagate_forward_time: 15.9608516693, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5570163727
validation[          , genome  6918] predictions:    9745/  10000 (97.45%), best:    9751/10000 (97.51%), error:       852.56726, best error:       803.83417 on epoch:    69, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 230.3788299561s, input_fired_time: 1.6862205267, output_fired_time: 1.9652533531, propagate_forward_time: 87.8194885254, propagate_backward_time: 133.5872497559, weight_update_time: 0.1957354099, other_time: 5.3206176758
epoch time: 23.6316547394s, input_fired_time: 0.2033960819, output_fired_time: 0.0000000000, propagate_forward_time: 22.0493297577, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3789291382
validation[          , genome  6918] predictions:    9761/  10000 (97.61%), best:    9761/10000 (97.61%), error:       800.47546, best error:       800.47546 on epoch:    82, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 231.2903137207s, input_fired_time: 2.0884335041, output_fired_time: 2.1233139038, propagate_forward_time: 92.7706146240, propagate_backward_time: 130.2371673584, weight_update_time: 0.2115257382, other_time: 4.0707702637
epoch time: 20.8409500122s, input_fired_time: 0.4377954304, output_fired_time: 0.0000000000, propagate_forward_time: 19.4344100952, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9687442780
validation[          , genome  6918] predictions:    9591/  10000 (95.91%), best:    9761/10000 (97.61%), error:      1292.28711, best error:       800.47546 on epoch:    82, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 232.3584136963s, input_fired_time: 1.8622609377, output_fired_time: 1.7795906067, propagate_forward_time: 88.2843017578, propagate_backward_time: 134.6889343262, weight_update_time: 0.2113804072, other_time: 5.7433319092
epoch time: 18.7069339752s, input_fired_time: 0.1874721050, output_fired_time: 0.0000000000, propagate_forward_time: 17.5229091644, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9965534210
validation[          , genome  6918] predictions:    9730/  10000 (97.30%), best:    9761/10000 (97.61%), error:       865.94983, best error:       800.47546 on epoch:    82, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 217.2209930420s, input_fired_time: 2.1564409733, output_fired_time: 1.6073042154, propagate_forward_time: 86.4092712402, propagate_backward_time: 122.5401611328, weight_update_time: 0.3988869786, other_time: 4.5078125000
epoch time: 15.8840579987s, input_fired_time: 0.1886579692, output_fired_time: 0.0000000000, propagate_forward_time: 14.6379432678, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0574569702
validation[          , genome  6918] predictions:    9704/  10000 (97.04%), best:    9761/10000 (97.61%), error:       979.64270, best error:       800.47546 on epoch:    82, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 184.6501159668s, input_fired_time: 1.4379379749, output_fired_time: 2.1232738495, propagate_forward_time: 68.0255737305, propagate_backward_time: 109.4515075684, weight_update_time: 0.1489285231, other_time: 3.6118164063
epoch time: 16.7129821777s, input_fired_time: 0.1431568265, output_fired_time: 0.0000000000, propagate_forward_time: 15.7304916382, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8393344879
validation[          , genome  6918] predictions:    9744/  10000 (97.44%), best:    9761/10000 (97.61%), error:       846.41565, best error:       800.47546 on epoch:    82, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 196.0967407227s, input_fired_time: 1.2499812841, output_fired_time: 1.3586899042, propagate_forward_time: 76.5019836426, propagate_backward_time: 111.8715057373, weight_update_time: 0.1489653736, other_time: 5.1145782471
epoch time: 14.5064249039s, input_fired_time: 0.1419838518, output_fired_time: 0.0000000000, propagate_forward_time: 13.5054359436, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8590049744
validation[          , genome  6918] predictions:    9754/  10000 (97.54%), best:    9761/10000 (97.61%), error:       800.92493, best error:       800.47546 on epoch:    82, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 191.0075531006s, input_fired_time: 1.4537544250, output_fired_time: 1.2487363815, propagate_forward_time: 71.4344177246, propagate_backward_time: 112.4237060547, weight_update_time: 0.2425958216, other_time: 4.4469451904
epoch time: 15.2562932968s, input_fired_time: 0.4837774932, output_fired_time: 0.0000000000, propagate_forward_time: 14.0122060776, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7603101730
validation[          , genome  6918] predictions:    9707/  10000 (97.07%), best:    9761/10000 (97.61%), error:       990.45660, best error:       800.47546 on epoch:    82, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 193.5291595459s, input_fired_time: 1.3418146372, output_fired_time: 1.3577696085, propagate_forward_time: 70.7243423462, propagate_backward_time: 116.0404129028, weight_update_time: 0.1487124264, other_time: 4.0648193359
epoch time: 15.8853025436s, input_fired_time: 0.1427016258, output_fired_time: 0.0000000000, propagate_forward_time: 15.2324342728, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5101671219
validation[          , genome  6918] predictions:    9743/  10000 (97.43%), best:    9761/10000 (97.61%), error:       812.78516, best error:       800.47546 on epoch:    82, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 182.3190307617s, input_fired_time: 1.5200064182, output_fired_time: 2.1386940479, propagate_forward_time: 70.0925598145, propagate_backward_time: 104.0353012085, weight_update_time: 0.4441122711, other_time: 4.5324783325
epoch time: 9.1459360123s, input_fired_time: 0.1305496544, output_fired_time: 0.0000000000, propagate_forward_time: 8.5455436707, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4698429108
validation[          , genome  6918] predictions:    9744/  10000 (97.44%), best:    9761/10000 (97.61%), error:       844.29364, best error:       800.47546 on epoch:    82, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 117.2633209229s, input_fired_time: 1.0075913668, output_fired_time: 1.0228589773, propagate_forward_time: 44.5693359375, propagate_backward_time: 68.1194915771, weight_update_time: 0.1329479069, other_time: 2.5440444946
epoch time: 8.5177993774s, input_fired_time: 0.1218051016, output_fired_time: 0.0000000000, propagate_forward_time: 7.9553432465, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4406509399
validation[          , genome  6918] predictions:    9712/  10000 (97.12%), best:    9761/10000 (97.61%), error:       923.67505, best error:       800.47546 on epoch:    82, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 112.3583602905s, input_fired_time: 1.0058338642, output_fired_time: 0.8644592762, propagate_forward_time: 42.5716323853, propagate_backward_time: 65.3727645874, weight_update_time: 0.1332452595, other_time: 2.5436706543
epoch time: 9.3165788651s, input_fired_time: 0.1313329786, output_fired_time: 0.0000000000, propagate_forward_time: 8.7160568237, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4691886902
validation[          , genome  6918] predictions:    9742/  10000 (97.42%), best:    9761/10000 (97.61%), error:       845.32776, best error:       800.47546 on epoch:    82, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 119.7609100342s, input_fired_time: 1.1282643080, output_fired_time: 0.9007372856, propagate_forward_time: 45.3127326965, propagate_backward_time: 69.6724090576, weight_update_time: 0.1378262192, other_time: 2.7467651367
epoch time: 9.0978431702s, input_fired_time: 0.1253292263, output_fired_time: 0.0000000000, propagate_forward_time: 8.4310655594, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5414485931
validation[          , genome  6918] predictions:    9697/  10000 (96.97%), best:    9761/10000 (97.61%), error:       943.29828, best error:       800.47546 on epoch:    82, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 120.0577926636s, input_fired_time: 1.0295362473, output_fired_time: 0.8958428502, propagate_forward_time: 45.4645957947, propagate_backward_time: 69.9318008423, weight_update_time: 0.1366972625, other_time: 2.7360153198
epoch time: 8.5646257401s, input_fired_time: 0.1233600602, output_fired_time: 0.0000000000, propagate_forward_time: 7.9993185997, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4419474602
validation[          , genome  6918] predictions:    9760/  10000 (97.60%), best:    9761/10000 (97.61%), error:       809.55420, best error:       800.47546 on epoch:    82, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 119.6853485107s, input_fired_time: 1.2184031010, output_fired_time: 0.8711574078, propagate_forward_time: 45.0205802917, propagate_backward_time: 69.9151840210, weight_update_time: 0.1338586956, other_time: 2.6600265503
epoch time: 9.6167755127s, input_fired_time: 0.1294621527, output_fired_time: 0.0000000000, propagate_forward_time: 9.0205974579, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4667158127
validation[          , genome  6918] predictions:    9700/  10000 (97.00%), best:    9761/10000 (97.61%), error:       947.20477, best error:       800.47546 on epoch:    82, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 118.9383010864s, input_fired_time: 1.0383598804, output_fired_time: 0.9149550796, propagate_forward_time: 45.1866874695, propagate_backward_time: 68.8923339844, weight_update_time: 0.1382466406, other_time: 2.9059600830
epoch time: 9.4352617264s, input_fired_time: 0.1331316829, output_fired_time: 0.0000000000, propagate_forward_time: 8.8230609894, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4790687561
validation[          , genome  6918] predictions:    9722/  10000 (97.22%), best:    9761/10000 (97.61%), error:       906.48022, best error:       800.47546 on epoch:    82, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 116.7293548584s, input_fired_time: 1.0253995657, output_fired_time: 0.8892313242, propagate_forward_time: 44.1081199646, propagate_backward_time: 68.1088104248, weight_update_time: 0.1359358877, other_time: 2.5977935791
epoch time: 10.3409528732s, input_fired_time: 0.1282287091, output_fired_time: 0.0000000000, propagate_forward_time: 9.7533273697, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4593963623
validation[          , genome  6918] predictions:    9713/  10000 (97.13%), best:    9761/10000 (97.61%), error:       925.08557, best error:       800.47546 on epoch:    82, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 116.0830383301s, input_fired_time: 1.0286228657, output_fired_time: 0.8904552460, propagate_forward_time: 43.8457794189, propagate_backward_time: 67.6195144653, weight_update_time: 0.1361795962, other_time: 2.6986618042
epoch time: 10.9183378220s, input_fired_time: 0.1290837824, output_fired_time: 0.0000000000, propagate_forward_time: 10.2016649246, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5875892639
validation[          , genome  6918] predictions:    9740/  10000 (97.40%), best:    9761/10000 (97.61%), error:       873.53912, best error:       800.47546 on epoch:    82, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 119.0471572876s, input_fired_time: 1.0511108637, output_fired_time: 0.9171356559, propagate_forward_time: 45.4654617310, propagate_backward_time: 68.9555587769, weight_update_time: 0.1395742446, other_time: 2.6578903198
epoch time: 9.8966121674s, input_fired_time: 0.1283915788, output_fired_time: 0.0000000000, propagate_forward_time: 9.3086357117, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4595851898
validation[          , genome  6918] predictions:    9746/  10000 (97.46%), best:    9761/10000 (97.61%), error:       832.12036, best error:       800.47546 on epoch:    82, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 119.5491180420s, input_fired_time: 1.0360440016, output_fired_time: 0.9010245800, propagate_forward_time: 45.1411437988, propagate_backward_time: 69.6413955688, weight_update_time: 0.1373546422, other_time: 2.8295135498
epoch time: 11.2375841141s, input_fired_time: 0.1302430034, output_fired_time: 0.0000000000, propagate_forward_time: 10.3916416168, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7156991959
validation[          , genome  6918] predictions:    9743/  10000 (97.43%), best:    9761/10000 (97.61%), error:       836.15070, best error:       800.47546 on epoch:    82, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 49.4394760132s, input_fired_time: 0.7614076734, output_fired_time: 0.0000000000, propagate_forward_time: 46.0063095093, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6717605591
best training[          , genome  6918] predictions:   49536/  50000 (99.07%), best:    9761/10000 (97.61%), error:      1946.06531, best error:       800.47546 on epoch:    82, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 9.3674411774s, input_fired_time: 0.1309633851, output_fired_time: 0.0000000000, propagate_forward_time: 8.7635087967, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4729690552
   testing[          , genome  6918] predictions:    9771/  10000 (97.71%), best:    9761/10000 (97.61%), error:       791.33685, best error:       800.47546 on epoch:    82, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
15:13:20 (11180): called boinc_finish(0)

</stderr_txt>
]]>