Nameexact_genome_1512568488_41_5632_0
Workunit2599424
Created7 Dec 2017, 15:44:55 UTC
Sent7 Dec 2017, 15:49:37 UTC
Report deadline17 Dec 2017, 9:28:30 UTC
Received8 Dec 2017, 0:08:31 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID67174
Run time2 hours 44 min 18 sec
CPU time2 hours 44 min 16 sec
Validate stateValid
Credit2,433.84
Device peak FLOPS4.03 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.33
Peak working set size152.83 MB
Peak swap size153.84 MB
Peak disk usage1.20 MB

Stderr output

<core_client_version>7.6.31</core_client_version>
<![CDATA[
<stderr_txt>
 0.0002566710

epoch time: 90.8690109253s, input_fired_time: 1.2638827562, output_fired_time: 0.7856063247, propagate_forward_time: 34.3289871216, propagate_backward_time: 52.3204879761, weight_update_time: 0.0853347182, other_time: 2.1700439453
epoch time: 7.7203807831s, input_fired_time: 0.1391716599, output_fired_time: 0.0000000000, propagate_forward_time: 7.1917600632, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3894491196
validation[          , genome  5632] predictions:    9677/  10000 (96.77%), best:    9677/10000 (96.77%), error:      1040.81079, best error:      1040.81079 on epoch:    14, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 92.6733016968s, input_fired_time: 1.2691749334, output_fired_time: 0.7938063741, propagate_forward_time: 35.1206321716, propagate_backward_time: 53.3225173950, weight_update_time: 0.0863181949, other_time: 2.1671714783
epoch time: 7.5460662842s, input_fired_time: 0.1318650395, output_fired_time: 0.0000000000, propagate_forward_time: 7.0420236588, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3721776009
validation[          , genome  5632] predictions:    9594/  10000 (95.94%), best:    9677/10000 (96.77%), error:      1345.36694, best error:      1040.81079 on epoch:    14, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 90.3016815186s, input_fired_time: 1.2694815397, output_fired_time: 0.7773242593, propagate_forward_time: 34.1352844238, propagate_backward_time: 51.9491729736, weight_update_time: 0.0878846273, other_time: 2.1704254150
epoch time: 7.0909533501s, input_fired_time: 0.1323497146, output_fired_time: 0.0000000000, propagate_forward_time: 6.5911016464, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3675022125
validation[          , genome  5632] predictions:    9579/  10000 (95.79%), best:    9677/10000 (96.77%), error:      1347.22803, best error:      1040.81079 on epoch:    14, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 87.8862686157s, input_fired_time: 1.2474201918, output_fired_time: 0.7594836354, propagate_forward_time: 33.2616424561, propagate_backward_time: 50.5179519653, weight_update_time: 0.0850337222, other_time: 2.0997695923
epoch time: 7.2219882011s, input_fired_time: 0.1284882277, output_fired_time: 0.0000000000, propagate_forward_time: 6.7349715233, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3585286140
validation[          , genome  5632] predictions:    9701/  10000 (97.01%), best:    9701/10000 (97.01%), error:      1039.22156, best error:      1039.22156 on epoch:    17, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 90.7819137573s, input_fired_time: 1.2650295496, output_fired_time: 0.7863633037, propagate_forward_time: 34.4483795166, propagate_backward_time: 52.1516265869, weight_update_time: 0.0862328336, other_time: 2.1305160522
epoch time: 7.4108242989s, input_fired_time: 0.1351229399, output_fired_time: 0.0000000000, propagate_forward_time: 6.9031953812, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3725061417
validation[          , genome  5632] predictions:    9672/  10000 (96.72%), best:    9701/10000 (97.01%), error:      1105.68372, best error:      1039.22156 on epoch:    17, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 89.8115768433s, input_fired_time: 1.2645153999, output_fired_time: 0.7836406231, propagate_forward_time: 34.0044517517, propagate_backward_time: 51.6278648376, weight_update_time: 0.0870142207, other_time: 2.1311035156
epoch time: 7.1395483017s, input_fired_time: 0.1333315074, output_fired_time: 0.0000000000, propagate_forward_time: 6.6440906525, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3621263504
validation[          , genome  5632] predictions:    9654/  10000 (96.54%), best:    9701/10000 (97.01%), error:      1128.04272, best error:      1039.22156 on epoch:    17, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 90.2724151611s, input_fired_time: 1.2672885656, output_fired_time: 0.7844508290, propagate_forward_time: 34.0653610229, propagate_backward_time: 52.0233726501, weight_update_time: 0.0878297463, other_time: 2.1319389343
epoch time: 7.3910446167s, input_fired_time: 0.1364630163, output_fired_time: 0.0000000000, propagate_forward_time: 6.8840789795, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3705024719
validation[          , genome  5632] predictions:    9614/  10000 (96.14%), best:    9701/10000 (97.01%), error:      1220.05701, best error:      1039.22156 on epoch:    17, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 90.6482162476s, input_fired_time: 1.2727375031, output_fired_time: 0.7864797115, propagate_forward_time: 34.3165893555, propagate_backward_time: 52.1431427002, weight_update_time: 0.0884367675, other_time: 2.1292724609
epoch time: 7.3079218864s, input_fired_time: 0.1365698725, output_fired_time: 0.0000000000, propagate_forward_time: 6.8044619560, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3668899536
validation[          , genome  5632] predictions:    9692/  10000 (96.92%), best:    9692/10000 (96.92%), error:       998.13177, best error:       998.13177 on epoch:    21, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 90.9209136963s, input_fired_time: 1.2817569971, output_fired_time: 0.7934241295, propagate_forward_time: 34.5281143188, propagate_backward_time: 52.1725616455, weight_update_time: 0.0879127979, other_time: 2.1450576782
epoch time: 7.3680200577s, input_fired_time: 0.1374452263, output_fired_time: 0.0000000000, propagate_forward_time: 6.8560934067, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3744812012
validation[          , genome  5632] predictions:    9603/  10000 (96.03%), best:    9692/10000 (96.92%), error:      1304.60193, best error:       998.13177 on epoch:    21, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 89.6508331299s, input_fired_time: 1.2734209299, output_fired_time: 0.7823827863, propagate_forward_time: 33.8664245605, propagate_backward_time: 51.5825691223, weight_update_time: 0.0883772373, other_time: 2.1460380554
epoch time: 7.1750240326s, input_fired_time: 0.1347591728, output_fired_time: 0.0000000000, propagate_forward_time: 6.6717171669, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3685479164
validation[          , genome  5632] predictions:    9634/  10000 (96.34%), best:    9692/10000 (96.92%), error:      1135.30164, best error:       998.13177 on epoch:    21, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 88.9751815796s, input_fired_time: 1.2728316784, output_fired_time: 0.7753153443, propagate_forward_time: 33.6196784973, propagate_backward_time: 51.1604537964, weight_update_time: 0.0877317265, other_time: 2.1469001770
epoch time: 7.4630594254s, input_fired_time: 0.1367879063, output_fired_time: 0.0000000000, propagate_forward_time: 6.9530558586, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3732156754
validation[          , genome  5632] predictions:    9670/  10000 (96.70%), best:    9692/10000 (96.92%), error:      1080.23071, best error:       998.13177 on epoch:    21, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 90.0514068604s, input_fired_time: 1.2726373672, output_fired_time: 0.7806108594, propagate_forward_time: 34.0321426392, propagate_backward_time: 51.8094596863, weight_update_time: 0.0879762173, other_time: 2.1565589905
epoch time: 7.1066880226s, input_fired_time: 0.1336202472, output_fired_time: 0.0000000000, propagate_forward_time: 6.6097321510, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3633356094
validation[          , genome  5632] predictions:    9625/  10000 (96.25%), best:    9692/10000 (96.92%), error:      1127.89441, best error:       998.13177 on epoch:    21, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 91.0689849854s, input_fired_time: 1.2774220705, output_fired_time: 0.7883622050, propagate_forward_time: 34.6158256531, propagate_backward_time: 52.2278404236, weight_update_time: 0.0879112557, other_time: 2.1595382690
epoch time: 7.4481105804s, input_fired_time: 0.1371591091, output_fired_time: 0.0000000000, propagate_forward_time: 6.9398646355, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3710865974
validation[          , genome  5632] predictions:    9701/  10000 (97.01%), best:    9701/10000 (97.01%), error:       988.63794, best error:       988.63794 on epoch:    26, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 89.8650360107s, input_fired_time: 1.2626270056, output_fired_time: 0.7740800977, propagate_forward_time: 34.0158233643, propagate_backward_time: 51.7099151611, weight_update_time: 0.0876706764, other_time: 2.1025924683
epoch time: 7.0824790001s, input_fired_time: 0.1292572170, output_fired_time: 0.0000000000, propagate_forward_time: 6.5951843262, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3580374718
validation[          , genome  5632] predictions:    9664/  10000 (96.64%), best:    9701/10000 (97.01%), error:      1083.73071, best error:       988.63794 on epoch:    26, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 93.1719589233s, input_fired_time: 1.2827749252, output_fired_time: 0.7903469205, propagate_forward_time: 35.3615684509, propagate_backward_time: 53.5965957642, weight_update_time: 0.0867290422, other_time: 2.1406745911
epoch time: 7.4385013580s, input_fired_time: 0.1352096498, output_fired_time: 0.0000000000, propagate_forward_time: 6.9263782501, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3769135475
validation[          , genome  5632] predictions:    9670/  10000 (96.70%), best:    9701/10000 (97.01%), error:      1110.52856, best error:       988.63794 on epoch:    26, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 94.0946426392s, input_fired_time: 1.2879220247, output_fired_time: 0.7995780110, propagate_forward_time: 35.7566871643, propagate_backward_time: 54.1083183289, weight_update_time: 0.0888765976, other_time: 2.1421356201
epoch time: 7.1938409805s, input_fired_time: 0.1322640926, output_fired_time: 0.0000000000, propagate_forward_time: 6.7032437325, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3583331108
validation[          , genome  5632] predictions:    9641/  10000 (96.41%), best:    9701/10000 (97.01%), error:      1177.73352, best error:       988.63794 on epoch:    26, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 89.9183959961s, input_fired_time: 1.2547941208, output_fired_time: 0.7665203214, propagate_forward_time: 34.0967903137, propagate_backward_time: 51.7208251953, weight_update_time: 0.0812692717, other_time: 2.0794715881
epoch time: 7.0921692848s, input_fired_time: 0.1312358528, output_fired_time: 0.0000000000, propagate_forward_time: 6.6025948524, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3583383560
validation[          , genome  5632] predictions:    9693/  10000 (96.93%), best:    9693/10000 (96.93%), error:       974.67603, best error:       974.67603 on epoch:    30, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 92.3783340454s, input_fired_time: 1.2809166908, output_fired_time: 0.7869595885, propagate_forward_time: 35.1100463867, propagate_backward_time: 53.0630302429, weight_update_time: 0.0871410742, other_time: 2.1373863220
epoch time: 8.7860851288s, input_fired_time: 0.1496434808, output_fired_time: 0.0000000000, propagate_forward_time: 8.2235040665, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4129371643
validation[          , genome  5632] predictions:    9708/  10000 (97.08%), best:    9708/10000 (97.08%), error:       968.61243, best error:       968.61243 on epoch:    31, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 96.7524108887s, input_fired_time: 1.3104227781, output_fired_time: 0.8190895319, propagate_forward_time: 36.7978019714, propagate_backward_time: 55.6277923584, weight_update_time: 0.0894433483, other_time: 2.1972999573
epoch time: 7.1151747704s, input_fired_time: 0.1340569258, output_fired_time: 0.0000000000, propagate_forward_time: 6.6200547218, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3610630035
validation[          , genome  5632] predictions:    9706/  10000 (97.06%), best:    9708/10000 (97.08%), error:       973.47748, best error:       968.61243 on epoch:    31, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 95.8934020996s, input_fired_time: 1.3123128414, output_fired_time: 0.8108444810, propagate_forward_time: 36.3886299133, propagate_backward_time: 55.1658172607, weight_update_time: 0.0903773308, other_time: 2.2158012390
epoch time: 9.1173524857s, input_fired_time: 0.1518894136, output_fired_time: 0.0000000000, propagate_forward_time: 8.5438375473, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4216251373
validation[          , genome  5632] predictions:    9617/  10000 (96.17%), best:    9708/10000 (97.08%), error:      1311.46973, best error:       968.61243 on epoch:    31, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 93.2549362183s, input_fired_time: 1.2696470022, output_fired_time: 0.7961401939, propagate_forward_time: 35.4014739990, propagate_backward_time: 53.7080955505, weight_update_time: 0.0849693418, other_time: 2.0795783997
epoch time: 7.2766189575s, input_fired_time: 0.1399580538, output_fired_time: 0.0000000000, propagate_forward_time: 6.7617759705, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3748850822
validation[          , genome  5632] predictions:    9697/  10000 (96.97%), best:    9708/10000 (97.08%), error:       999.38153, best error:       968.61243 on epoch:    31, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 98.1346893311s, input_fired_time: 1.3313674927, output_fired_time: 0.8251022696, propagate_forward_time: 37.4085693359, propagate_backward_time: 56.2782135010, weight_update_time: 0.0918687731, other_time: 2.2914352417
epoch time: 7.5123305321s, input_fired_time: 0.1378776282, output_fired_time: 0.0000000000, propagate_forward_time: 6.9924926758, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3819603920
validation[          , genome  5632] predictions:    9657/  10000 (96.57%), best:    9708/10000 (97.08%), error:      1088.86450, best error:       968.61243 on epoch:    31, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 88.4377899170s, input_fired_time: 1.2281416655, output_fired_time: 0.7602210045, propagate_forward_time: 33.5919609070, propagate_backward_time: 50.8604583740, weight_update_time: 0.0799776614, other_time: 1.9970054626
epoch time: 7.1998376846s, input_fired_time: 0.1307981610, output_fired_time: 0.0000000000, propagate_forward_time: 6.7156915665, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3533477783
validation[          , genome  5632] predictions:    9709/  10000 (97.09%), best:    9709/10000 (97.09%), error:       949.62567, best error:       949.62567 on epoch:    36, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 88.0728912354s, input_fired_time: 1.2267185450, output_fired_time: 0.7651008964, propagate_forward_time: 33.3525466919, propagate_backward_time: 50.7324981689, weight_update_time: 0.0801608264, other_time: 1.9960327148
epoch time: 7.2766280174s, input_fired_time: 0.1304425150, output_fired_time: 0.0000000000, propagate_forward_time: 6.7884230614, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3577623367
validation[          , genome  5632] predictions:    9686/  10000 (96.86%), best:    9709/10000 (97.09%), error:       997.03424, best error:       949.62567 on epoch:    36, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 93.6678237915s, input_fired_time: 1.2805165052, output_fired_time: 0.7955834270, propagate_forward_time: 35.6418800354, propagate_backward_time: 53.8182449341, weight_update_time: 0.0856378824, other_time: 2.1315956116
epoch time: 7.1752820015s, input_fired_time: 0.1319232583, output_fired_time: 0.0000000000, propagate_forward_time: 6.6813135147, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3620452881
validation[          , genome  5632] predictions:    9521/  10000 (95.21%), best:    9709/10000 (97.09%), error:      1571.86487, best error:       949.62567 on epoch:    36, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 91.7203369141s, input_fired_time: 1.2766028643, output_fired_time: 0.7803144455, propagate_forward_time: 34.8189544678, propagate_backward_time: 52.7041206360, weight_update_time: 0.0855456963, other_time: 2.1403465271
epoch time: 7.3778276443s, input_fired_time: 0.1377247423, output_fired_time: 0.0000000000, propagate_forward_time: 6.8685145378, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3715882301
validation[          , genome  5632] predictions:    9622/  10000 (96.22%), best:    9709/10000 (97.09%), error:      1229.37231, best error:       949.62567 on epoch:    36, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 96.2708587646s, input_fired_time: 1.3031589985, output_fired_time: 0.8158044219, propagate_forward_time: 36.5516777039, propagate_backward_time: 55.4131050110, weight_update_time: 0.0884491727, other_time: 2.1871109009
epoch time: 8.4099102020s, input_fired_time: 0.1457590461, output_fired_time: 0.0000000000, propagate_forward_time: 7.8578457832, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4063057899
validation[          , genome  5632] predictions:    9669/  10000 (96.69%), best:    9709/10000 (97.09%), error:      1082.91858, best error:       949.62567 on epoch:    36, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 91.0540771484s, input_fired_time: 1.2680761814, output_fired_time: 0.7773173451, propagate_forward_time: 34.5552520752, propagate_backward_time: 52.3272476196, weight_update_time: 0.0858426392, other_time: 2.1261825562
epoch time: 7.4183802605s, input_fired_time: 0.1374581903, output_fired_time: 0.0000000000, propagate_forward_time: 6.9043498039, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3765721321
validation[          , genome  5632] predictions:    9641/  10000 (96.41%), best:    9709/10000 (97.09%), error:      1198.34485, best error:       949.62567 on epoch:    36, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 91.5208740234s, input_fired_time: 1.2733739614, output_fired_time: 0.7790654898, propagate_forward_time: 34.5994300842, propagate_backward_time: 52.7269134521, weight_update_time: 0.0863752440, other_time: 2.1420860291
epoch time: 7.0821013451s, input_fired_time: 0.1336857229, output_fired_time: 0.0000000000, propagate_forward_time: 6.5891070366, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3593087196
validation[          , genome  5632] predictions:    9720/  10000 (97.20%), best:    9709/10000 (97.09%), error:       957.10809, best error:       949.62567 on epoch:    36, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 90.8054122925s, input_fired_time: 1.2560054064, output_fired_time: 0.7739060521, propagate_forward_time: 34.3756904602, propagate_backward_time: 52.3536071777, weight_update_time: 0.0828587562, other_time: 2.0462074280
epoch time: 7.5934815407s, input_fired_time: 0.1357134879, output_fired_time: 0.0000000000, propagate_forward_time: 7.0852746964, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3724932671
validation[          , genome  5632] predictions:    9683/  10000 (96.83%), best:    9709/10000 (97.09%), error:      1098.00122, best error:       949.62567 on epoch:    36, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 93.0921859741s, input_fired_time: 1.2712726593, output_fired_time: 0.7929735184, propagate_forward_time: 35.3387031555, propagate_backward_time: 53.5703964233, weight_update_time: 0.0850849822, other_time: 2.1188392639
epoch time: 7.2695960999s, input_fired_time: 0.1370058805, output_fired_time: 0.0000000000, propagate_forward_time: 6.7633223534, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3692679405
validation[          , genome  5632] predictions:    9661/  10000 (96.61%), best:    9709/10000 (97.09%), error:      1117.61475, best error:       949.62567 on epoch:    36, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 91.4976501465s, input_fired_time: 1.2897809744, output_fired_time: 0.7766988277, propagate_forward_time: 34.7192459106, propagate_backward_time: 52.5318374634, weight_update_time: 0.0875774771, other_time: 2.1800918579
epoch time: 7.0994429588s, input_fired_time: 0.1358668953, output_fired_time: 0.0000000000, propagate_forward_time: 6.5990161896, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3645596504
validation[          , genome  5632] predictions:    9656/  10000 (96.56%), best:    9709/10000 (97.09%), error:      1095.11133, best error:       949.62567 on epoch:    36, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 92.8885574341s, input_fired_time: 1.3042171001, output_fired_time: 0.7876161933, propagate_forward_time: 35.2369537354, propagate_backward_time: 53.3654747009, weight_update_time: 0.0890469700, other_time: 2.1943016052
epoch time: 7.1003227234s, input_fired_time: 0.1364366859, output_fired_time: 0.0000000000, propagate_forward_time: 6.5991888046, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3646974564
validation[          , genome  5632] predictions:    9717/  10000 (97.17%), best:    9709/10000 (97.09%), error:       994.62238, best error:       949.62567 on epoch:    36, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 88.3363265991s, input_fired_time: 1.2639464140, output_fired_time: 0.7603540421, propagate_forward_time: 33.4115715027, propagate_backward_time: 50.8304138184, weight_update_time: 0.0837431923, other_time: 2.0700416565
epoch time: 7.8221917152s, input_fired_time: 0.1474220753, output_fired_time: 0.0000000000, propagate_forward_time: 7.2821931839, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3925762177
validation[          , genome  5632] predictions:    9712/  10000 (97.12%), best:    9712/10000 (97.12%), error:       929.69775, best error:       929.69775 on epoch:    47, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 91.8483428955s, input_fired_time: 1.2938982248, output_fired_time: 0.7781189680, propagate_forward_time: 34.8734741211, propagate_backward_time: 52.7389221191, weight_update_time: 0.0886419639, other_time: 2.1639251709
epoch time: 8.6217441559s, input_fired_time: 0.1534483284, output_fired_time: 0.0000000000, propagate_forward_time: 8.0577630997, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4105329514
validation[          , genome  5632] predictions:    9645/  10000 (96.45%), best:    9712/10000 (97.12%), error:      1158.44836, best error:       929.69775 on epoch:    47, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 90.3003692627s, input_fired_time: 1.2832596302, output_fired_time: 0.7701140046, propagate_forward_time: 34.1629638672, propagate_backward_time: 51.9723014832, weight_update_time: 0.0877655149, other_time: 2.1117362976
epoch time: 7.0805215836s, input_fired_time: 0.1337567419, output_fired_time: 0.0000000000, propagate_forward_time: 6.5894021988, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3573627472
validation[          , genome  5632] predictions:    9538/  10000 (95.38%), best:    9712/10000 (97.12%), error:      1486.67139, best error:       929.69775 on epoch:    47, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 92.4003067017s, input_fired_time: 1.2930027246, output_fired_time: 0.7869208455, propagate_forward_time: 35.0889129639, propagate_backward_time: 53.1253967285, weight_update_time: 0.0864645913, other_time: 2.1060791016
epoch time: 8.6723518372s, input_fired_time: 0.1550157070, output_fired_time: 0.0000000000, propagate_forward_time: 8.1088047028, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4085311890
validation[          , genome  5632] predictions:    9733/  10000 (97.33%), best:    9733/10000 (97.33%), error:       915.18036, best error:       915.18036 on epoch:    50, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 91.0867767334s, input_fired_time: 1.2811070681, output_fired_time: 0.7756391168, propagate_forward_time: 34.5426826477, propagate_backward_time: 52.3546295166, weight_update_time: 0.0850264579, other_time: 2.1327171326
epoch time: 7.2958211899s, input_fired_time: 0.1367746890, output_fired_time: 0.0000000000, propagate_forward_time: 6.7924432755, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3666033745
validation[          , genome  5632] predictions:    9705/  10000 (97.05%), best:    9733/10000 (97.33%), error:       954.22174, best error:       915.18036 on epoch:    50, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 91.6158294678s, input_fired_time: 1.2783981562, output_fired_time: 0.7790055871, propagate_forward_time: 34.7143135071, propagate_backward_time: 52.7249183655, weight_update_time: 0.0829982162, other_time: 2.1191940308
epoch time: 7.0675525665s, input_fired_time: 0.1304633617, output_fired_time: 0.0000000000, propagate_forward_time: 6.5870637894, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3500251770
validation[          , genome  5632] predictions:    9672/  10000 (96.72%), best:    9733/10000 (97.33%), error:      1103.54785, best error:       915.18036 on epoch:    50, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 88.3013534546s, input_fired_time: 1.2510018349, output_fired_time: 0.7552410960, propagate_forward_time: 33.3986129761, propagate_backward_time: 50.8563652039, weight_update_time: 0.0800757483, other_time: 2.0401344299
epoch time: 7.0808773041s, input_fired_time: 0.1304553747, output_fired_time: 0.0000000000, propagate_forward_time: 6.6002736092, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3501482010
validation[          , genome  5632] predictions:    9684/  10000 (96.84%), best:    9733/10000 (97.33%), error:      1019.82794, best error:       915.18036 on epoch:    50, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 87.1043701172s, input_fired_time: 1.2360804081, output_fired_time: 0.7442241907, propagate_forward_time: 32.9882354736, propagate_backward_time: 50.1623191833, weight_update_time: 0.0790633336, other_time: 1.9735069275
epoch time: 7.0804362297s, input_fired_time: 0.1343749315, output_fired_time: 0.0000000000, propagate_forward_time: 6.5926442146, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3534169197
validation[          , genome  5632] predictions:    9666/  10000 (96.66%), best:    9733/10000 (97.33%), error:      1059.91968, best error:       915.18036 on epoch:    50, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 88.6730346680s, input_fired_time: 1.2545393705, output_fired_time: 0.7558882833, propagate_forward_time: 33.6269111633, propagate_backward_time: 51.0125007629, weight_update_time: 0.0800355524, other_time: 2.0231933594
epoch time: 7.0798950195s, input_fired_time: 0.1327711642, output_fired_time: 0.0000000000, propagate_forward_time: 6.5917115211, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3554124832
validation[          , genome  5632] predictions:    9664/  10000 (96.64%), best:    9733/10000 (97.33%), error:      1029.60083, best error:       915.18036 on epoch:    50, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 87.1569824219s, input_fired_time: 1.2429831028, output_fired_time: 0.7445015311, propagate_forward_time: 33.0012855530, propagate_backward_time: 50.1958961487, weight_update_time: 0.0791394040, other_time: 1.9723205566
epoch time: 7.0697579384s, input_fired_time: 0.1317441911, output_fired_time: 0.0000000000, propagate_forward_time: 6.5890784264, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3489351273
validation[          , genome  5632] predictions:    9718/  10000 (97.18%), best:    9733/10000 (97.33%), error:       967.73871, best error:       915.18036 on epoch:    50, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 88.1096801758s, input_fired_time: 1.2504909039, output_fired_time: 0.7520052791, propagate_forward_time: 33.3391532898, propagate_backward_time: 50.7708740234, weight_update_time: 0.0803946927, other_time: 1.9971580505
epoch time: 7.0633273125s, input_fired_time: 0.1293508857, output_fired_time: 0.0000000000, propagate_forward_time: 6.5867238045, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3472528458
validation[          , genome  5632] predictions:    9731/  10000 (97.31%), best:    9731/10000 (97.31%), error:       882.51794, best error:       882.51794 on epoch:    57, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 98.5095748901s, input_fired_time: 1.3428202868, output_fired_time: 0.8266010284, propagate_forward_time: 37.4844932556, propagate_backward_time: 56.6058425903, weight_update_time: 0.0914957672, other_time: 2.2498207092
epoch time: 8.1459684372s, input_fired_time: 0.1485679448, output_fired_time: 0.0000000000, propagate_forward_time: 7.6021842957, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3952159882
validation[          , genome  5632] predictions:    9705/  10000 (97.05%), best:    9731/10000 (97.31%), error:       988.10767, best error:       882.51794 on epoch:    57, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 89.0081787109s, input_fired_time: 1.2565532923, output_fired_time: 0.7582144141, propagate_forward_time: 33.7228736877, propagate_backward_time: 51.2396430969, weight_update_time: 0.0813285336, other_time: 2.0308914185
epoch time: 7.1359677315s, input_fired_time: 0.1332312524, output_fired_time: 0.0000000000, propagate_forward_time: 6.6505131721, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3522233963
validation[          , genome  5632] predictions:    9695/  10000 (96.95%), best:    9731/10000 (97.31%), error:       961.60480, best error:       882.51794 on epoch:    57, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 88.5845565796s, input_fired_time: 1.2562664747, output_fired_time: 0.7559244633, propagate_forward_time: 33.5828056335, propagate_backward_time: 50.9625205994, weight_update_time: 0.0808624849, other_time: 2.0270385742
epoch time: 7.0927753448s, input_fired_time: 0.1323880851, output_fired_time: 0.0000000000, propagate_forward_time: 6.6108527184, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3495345116
validation[          , genome  5632] predictions:    9637/  10000 (96.37%), best:    9731/10000 (97.31%), error:      1126.52673, best error:       882.51794 on epoch:    57, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 89.4535522461s, input_fired_time: 1.2689248323, output_fired_time: 0.7614563107, propagate_forward_time: 33.9025840759, propagate_backward_time: 51.5205078125, weight_update_time: 0.0811820924, other_time: 2.0000724792
epoch time: 7.0662808418s, input_fired_time: 0.1321706772, output_fired_time: 0.0000000000, propagate_forward_time: 6.5873904228, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3467197418
validation[          , genome  5632] predictions:    9702/  10000 (97.02%), best:    9731/10000 (97.31%), error:       995.68640, best error:       882.51794 on epoch:    57, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 88.6106262207s, input_fired_time: 1.2530580759, output_fired_time: 0.7559908628, propagate_forward_time: 33.5923500061, propagate_backward_time: 50.9900436401, weight_update_time: 0.0807105303, other_time: 2.0191841125
epoch time: 7.1044516563s, input_fired_time: 0.1303458810, output_fired_time: 0.0000000000, propagate_forward_time: 6.6243934631, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3497123718
validation[          , genome  5632] predictions:    9646/  10000 (96.46%), best:    9731/10000 (97.31%), error:      1133.38489, best error:       882.51794 on epoch:    57, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 88.9540634155s, input_fired_time: 1.2538356781, output_fired_time: 0.7576422691, propagate_forward_time: 33.7020034790, propagate_backward_time: 51.2332420349, weight_update_time: 0.0809895694, other_time: 2.0073356628
epoch time: 7.1338987350s, input_fired_time: 0.1379045993, output_fired_time: 0.0000000000, propagate_forward_time: 6.6370954514, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3588986397
validation[          , genome  5632] predictions:    9725/  10000 (97.25%), best:    9731/10000 (97.31%), error:       906.21960, best error:       882.51794 on epoch:    57, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 89.5098648071s, input_fired_time: 1.2623740435, output_fired_time: 0.7619433403, propagate_forward_time: 33.9252815247, propagate_backward_time: 51.5367355347, weight_update_time: 0.0814723969, other_time: 2.0235328674
epoch time: 7.3053674698s, input_fired_time: 0.1361617893, output_fired_time: 0.0000000000, propagate_forward_time: 6.8094644547, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3597412109
validation[          , genome  5632] predictions:    9740/  10000 (97.40%), best:    9740/10000 (97.40%), error:       880.55487, best error:       880.55487 on epoch:    64, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 91.1429824829s, input_fired_time: 1.2766672373, output_fired_time: 0.7729679346, propagate_forward_time: 34.5990715027, propagate_backward_time: 52.4165344238, weight_update_time: 0.0828623548, other_time: 2.0777473450
epoch time: 7.0720777512s, input_fired_time: 0.1333850175, output_fired_time: 0.0000000000, propagate_forward_time: 6.5892381668, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3494544029
validation[          , genome  5632] predictions:    9701/  10000 (97.01%), best:    9740/10000 (97.40%), error:       970.54498, best error:       880.55487 on epoch:    64, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 87.4140167236s, input_fired_time: 1.2463493347, output_fired_time: 0.7453166842, propagate_forward_time: 33.1179656982, propagate_backward_time: 50.3265304565, weight_update_time: 0.0794936344, other_time: 1.9778518677
epoch time: 7.0715932846s, input_fired_time: 0.1326331198, output_fired_time: 0.0000000000, propagate_forward_time: 6.5906753540, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3482847214
validation[          , genome  5632] predictions:    8301/  10000 (83.01%), best:    9740/10000 (97.40%), error:      5758.93359, best error:       880.55487 on epoch:    64, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

resetting weights to those on epoch: 64
epoch time: 87.4241333008s, input_fired_time: 1.2438710928, output_fired_time: 0.7460958958, propagate_forward_time: 33.1155548096, propagate_backward_time: 50.3477859497, weight_update_time: 0.0792721733, other_time: 1.9708251953
epoch time: 7.0681676865s, input_fired_time: 0.1318417341, output_fired_time: 0.0000000000, propagate_forward_time: 6.5891938210, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3471322060
validation[          , genome  5632] predictions:    9698/  10000 (96.98%), best:    9740/10000 (97.40%), error:       986.54669, best error:       880.55487 on epoch:    64, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 86.9771881104s, input_fired_time: 1.2429716587, output_fired_time: 0.7427644730, propagate_forward_time: 32.9444999695, propagate_backward_time: 50.0953102112, weight_update_time: 0.0789741650, other_time: 1.9516372681
epoch time: 7.0787329674s, input_fired_time: 0.1360539943, output_fired_time: 0.0000000000, propagate_forward_time: 6.5883550644, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3543238640
validation[          , genome  5632] predictions:    9730/  10000 (97.30%), best:    9740/10000 (97.40%), error:       901.25824, best error:       880.55487 on epoch:    64, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 87.1251449585s, input_fired_time: 1.2460186481, output_fired_time: 0.7435420156, propagate_forward_time: 32.9986801147, propagate_backward_time: 50.1612625122, weight_update_time: 0.0793472156, other_time: 1.9756393433
epoch time: 7.1233158112s, input_fired_time: 0.1373963207, output_fired_time: 0.0000000000, propagate_forward_time: 6.6331949234, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3527245522
validation[          , genome  5632] predictions:    9720/  10000 (97.20%), best:    9740/10000 (97.40%), error:       939.30475, best error:       880.55487 on epoch:    64, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 87.3145675659s, input_fired_time: 1.2489725351, output_fired_time: 0.7458435893, propagate_forward_time: 33.0584907532, propagate_backward_time: 50.3060836792, weight_update_time: 0.0794656649, other_time: 1.9551811218
epoch time: 7.0685567856s, input_fired_time: 0.1335955411, output_fired_time: 0.0000000000, propagate_forward_time: 6.5879988670, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3469624519
validation[          , genome  5632] predictions:    9743/  10000 (97.43%), best:    9743/10000 (97.43%), error:       874.51080, best error:       874.51080 on epoch:    70, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 87.1077880859s, input_fired_time: 1.2475554943, output_fired_time: 0.7441684008, propagate_forward_time: 32.9970169067, propagate_backward_time: 50.1548538208, weight_update_time: 0.0789702460, other_time: 1.9641876221
epoch time: 7.0766043663s, input_fired_time: 0.1343006790, output_fired_time: 0.0000000000, propagate_forward_time: 6.5928802490, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3494234085
validation[          , genome  5632] predictions:    9753/  10000 (97.53%), best:    9753/10000 (97.53%), error:       855.40027, best error:       855.40027 on epoch:    71, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 87.6855926514s, input_fired_time: 1.2592486143, output_fired_time: 0.7490845323, propagate_forward_time: 33.2084312439, propagate_backward_time: 50.4577445984, weight_update_time: 0.0796501115, other_time: 2.0110855103
epoch time: 7.0782856941s, input_fired_time: 0.1338799596, output_fired_time: 0.0000000000, propagate_forward_time: 6.5920758247, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3523297310
validation[          , genome  5632] predictions:    9710/  10000 (97.10%), best:    9753/10000 (97.53%), error:       907.57245, best error:       855.40027 on epoch:    71, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 88.1444091797s, input_fired_time: 1.2576639652, output_fired_time: 0.7532626987, propagate_forward_time: 33.4299278259, propagate_backward_time: 50.7059783936, weight_update_time: 0.0798912719, other_time: 1.9975700378
epoch time: 7.0754179955s, input_fired_time: 0.1346853524, output_fired_time: 0.0000000000, propagate_forward_time: 6.5920338631, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3486986160
validation[          , genome  5632] predictions:    9357/  10000 (93.57%), best:    9753/10000 (97.53%), error:      2158.63257, best error:       855.40027 on epoch:    71, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

resetting weights to those on epoch: 71
epoch time: 87.3097229004s, input_fired_time: 1.2555038929, output_fired_time: 0.7466036081, propagate_forward_time: 33.0717658997, propagate_backward_time: 50.2443161011, weight_update_time: 0.0795203522, other_time: 1.9915351868
epoch time: 7.0789403915s, input_fired_time: 0.1341995001, output_fired_time: 0.0000000000, propagate_forward_time: 6.5943298340, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3504109383
validation[          , genome  5632] predictions:    9717/  10000 (97.17%), best:    9753/10000 (97.53%), error:       911.80408, best error:       855.40027 on epoch:    71, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 87.1031188965s, input_fired_time: 1.2536157370, output_fired_time: 0.7458426356, propagate_forward_time: 32.9807167053, propagate_backward_time: 50.1404495239, weight_update_time: 0.0794363245, other_time: 1.9824943542
epoch time: 7.1166019440s, input_fired_time: 0.1388376653, output_fired_time: 0.0000000000, propagate_forward_time: 6.6168761253, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3608880043
validation[          , genome  5632] predictions:    9712/  10000 (97.12%), best:    9753/10000 (97.53%), error:       951.92358, best error:       855.40027 on epoch:    71, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 89.5308380127s, input_fired_time: 1.2714506388, output_fired_time: 0.7611746788, propagate_forward_time: 33.9734115601, propagate_backward_time: 51.5006713867, weight_update_time: 0.0810036957, other_time: 2.0241241455
epoch time: 7.0676951408s, input_fired_time: 0.1342102140, output_fired_time: 0.0000000000, propagate_forward_time: 6.5866055489, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3468794823
validation[          , genome  5632] predictions:    9708/  10000 (97.08%), best:    9753/10000 (97.53%), error:       925.03278, best error:       855.40027 on epoch:    71, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 87.0487594604s, input_fired_time: 1.2478615046, output_fired_time: 0.7446042895, propagate_forward_time: 32.9550628662, propagate_backward_time: 50.1543579102, weight_update_time: 0.0789346993, other_time: 1.9468688965
epoch time: 7.0651307106s, input_fired_time: 0.1335753798, output_fired_time: 0.0000000000, propagate_forward_time: 6.5860023499, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3455529213
validation[          , genome  5632] predictions:    9731/  10000 (97.31%), best:    9753/10000 (97.53%), error:       901.84674, best error:       855.40027 on epoch:    71, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 87.0998764038s, input_fired_time: 1.2511540651, output_fired_time: 0.7432246804, propagate_forward_time: 32.9915580750, propagate_backward_time: 50.1516647339, weight_update_time: 0.0793825015, other_time: 1.9622764587
epoch time: 7.0655736923s, input_fired_time: 0.1334555149, output_fired_time: 0.0000000000, propagate_forward_time: 6.5862255096, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3458929062
validation[          , genome  5632] predictions:    9733/  10000 (97.33%), best:    9753/10000 (97.53%), error:       876.50757, best error:       855.40027 on epoch:    71, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 88.7849349976s, input_fired_time: 1.2654445171, output_fired_time: 0.7546534538, propagate_forward_time: 33.6390991211, propagate_backward_time: 51.1106109619, weight_update_time: 0.0804417506, other_time: 2.0151290894
epoch time: 7.0817604065s, input_fired_time: 0.1337309331, output_fired_time: 0.0000000000, propagate_forward_time: 6.5964484215, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3515810966
validation[          , genome  5632] predictions:    9726/  10000 (97.26%), best:    9753/10000 (97.53%), error:       924.86328, best error:       855.40027 on epoch:    71, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 90.4161834717s, input_fired_time: 1.2846820354, output_fired_time: 0.7669166923, propagate_forward_time: 34.3211517334, propagate_backward_time: 51.9824943542, weight_update_time: 0.0819289684, other_time: 2.0609397888
epoch time: 7.0923800468s, input_fired_time: 0.1375427097, output_fired_time: 0.0000000000, propagate_forward_time: 6.5969882011, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3578491211
validation[          , genome  5632] predictions:    9716/  10000 (97.16%), best:    9753/10000 (97.53%), error:       891.20453, best error:       855.40027 on epoch:    71, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 87.2535400391s, input_fired_time: 1.2565144300, output_fired_time: 0.7484428883, propagate_forward_time: 33.0298156738, propagate_backward_time: 50.2408065796, weight_update_time: 0.0791743547, other_time: 1.9779586792
epoch time: 7.4783306122s, input_fired_time: 0.1416189224, output_fired_time: 0.0000000000, propagate_forward_time: 6.9700689316, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3666429520
validation[          , genome  5632] predictions:    9724/  10000 (97.24%), best:    9753/10000 (97.53%), error:       928.45996, best error:       855.40027 on epoch:    71, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 87.8066635132s, input_fired_time: 1.2615985870, output_fired_time: 0.7497318387, propagate_forward_time: 33.2578582764, propagate_backward_time: 50.5555419922, weight_update_time: 0.0799338073, other_time: 1.9819335938
epoch time: 7.0782709122s, input_fired_time: 0.1339707822, output_fired_time: 0.0000000000, propagate_forward_time: 6.5920085907, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3522915840
validation[          , genome  5632] predictions:    9714/  10000 (97.14%), best:    9753/10000 (97.53%), error:       941.03754, best error:       855.40027 on epoch:    71, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 87.7314453125s, input_fired_time: 1.2578505278, output_fired_time: 0.7491202354, propagate_forward_time: 33.2276268005, propagate_backward_time: 50.4922676086, weight_update_time: 0.0796813145, other_time: 2.0045776367
epoch time: 7.0817275047s, input_fired_time: 0.1337449998, output_fired_time: 0.0000000000, propagate_forward_time: 6.5972666740, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3507156372
validation[          , genome  5632] predictions:    9702/  10000 (97.02%), best:    9753/10000 (97.53%), error:       975.78577, best error:       855.40027 on epoch:    71, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 87.2118759155s, input_fired_time: 1.2563298941, output_fired_time: 0.7452222109, propagate_forward_time: 33.0176582336, propagate_backward_time: 50.2227935791, weight_update_time: 0.0791506842, other_time: 1.9698677063
epoch time: 7.0795683861s, input_fired_time: 0.1348792017, output_fired_time: 0.0000000000, propagate_forward_time: 6.5958580971, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3488311768
validation[          , genome  5632] predictions:    9728/  10000 (97.28%), best:    9753/10000 (97.53%), error:       904.92108, best error:       855.40027 on epoch:    71, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 89.4458465576s, input_fired_time: 1.2759743929, output_fired_time: 0.7626889348, propagate_forward_time: 33.8913993835, propagate_backward_time: 51.4971389771, weight_update_time: 0.0816848800, other_time: 2.0186424255
epoch time: 7.0683059692s, input_fired_time: 0.1349255145, output_fired_time: 0.0000000000, propagate_forward_time: 6.5873966217, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3459839821
validation[          , genome  5632] predictions:    9746/  10000 (97.46%), best:    9753/10000 (97.53%), error:       881.07599, best error:       855.40027 on epoch:    71, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 89.1024932861s, input_fired_time: 1.2706480026, output_fired_time: 0.7595255375, propagate_forward_time: 33.7498703003, propagate_backward_time: 51.3057174683, weight_update_time: 0.0808133408, other_time: 2.0167312622
epoch time: 7.0797700882s, input_fired_time: 0.1382446587, output_fired_time: 0.0000000000, propagate_forward_time: 6.5880303383, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3534951210
validation[          , genome  5632] predictions:    9739/  10000 (97.39%), best:    9753/10000 (97.53%), error:       902.07379, best error:       855.40027 on epoch:    71, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 87.1045227051s, input_fired_time: 1.2529190779, output_fired_time: 0.7436994910, propagate_forward_time: 32.9875717163, propagate_backward_time: 50.1488533020, weight_update_time: 0.0790252537, other_time: 1.9714775085
epoch time: 7.0766196251s, input_fired_time: 0.1363762468, output_fired_time: 0.0000000000, propagate_forward_time: 6.5906667709, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3495764732
validation[          , genome  5632] predictions:    9639/  10000 (96.39%), best:    9753/10000 (97.53%), error:      1259.59875, best error:       855.40027 on epoch:    71, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 87.9348907471s, input_fired_time: 1.2619667053, output_fired_time: 0.7493018508, propagate_forward_time: 33.3131828308, propagate_backward_time: 50.6217536926, weight_update_time: 0.0798473656, other_time: 1.9886932373
epoch time: 7.0771145821s, input_fired_time: 0.1336469501, output_fired_time: 0.0000000000, propagate_forward_time: 6.5941009521, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3493666649
validation[          , genome  5632] predictions:    9724/  10000 (97.24%), best:    9753/10000 (97.53%), error:       916.60181, best error:       855.40027 on epoch:    71, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 87.4355697632s, input_fired_time: 1.2582854033, output_fired_time: 0.7454013228, propagate_forward_time: 33.1133766174, propagate_backward_time: 50.3432998657, weight_update_time: 0.0792873874, other_time: 1.9752082825
epoch time: 7.0798382759s, input_fired_time: 0.1346972883, output_fired_time: 0.0000000000, propagate_forward_time: 6.5921616554, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3529791832
validation[          , genome  5632] predictions:    9732/  10000 (97.32%), best:    9753/10000 (97.53%), error:       910.55951, best error:       855.40027 on epoch:    71, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 88.3898620605s, input_fired_time: 1.2671570778, output_fired_time: 0.7530950904, propagate_forward_time: 33.4928207397, propagate_backward_time: 50.8669967651, weight_update_time: 0.0803044960, other_time: 2.0097885132
epoch time: 7.0756473541s, input_fired_time: 0.1358474940, output_fired_time: 0.0000000000, propagate_forward_time: 6.5900750160, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3497247696
validation[          , genome  5632] predictions:    9734/  10000 (97.34%), best:    9753/10000 (97.53%), error:       886.79059, best error:       855.40027 on epoch:    71, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 87.4113540649s, input_fired_time: 1.2604823112, output_fired_time: 0.7489573956, propagate_forward_time: 33.0604209900, propagate_backward_time: 50.3579139709, weight_update_time: 0.0796001256, other_time: 1.9835815430
epoch time: 7.0696253777s, input_fired_time: 0.1340254843, output_fired_time: 0.0000000000, propagate_forward_time: 6.5879955292, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3476042747
validation[          , genome  5632] predictions:    9738/  10000 (97.38%), best:    9753/10000 (97.53%), error:       905.34363, best error:       855.40027 on epoch:    71, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 88.8756942749s, input_fired_time: 1.2725321054, output_fired_time: 0.7565286160, propagate_forward_time: 33.6576690674, propagate_backward_time: 51.1732177734, weight_update_time: 0.0805073157, other_time: 2.0157470703
epoch time: 7.1049194336s, input_fired_time: 0.1399351656, output_fired_time: 0.0000000000, propagate_forward_time: 6.6081852913, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3567991257
validation[          , genome  5632] predictions:    9714/  10000 (97.14%), best:    9753/10000 (97.53%), error:       941.55725, best error:       855.40027 on epoch:    71, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 88.9205322266s, input_fired_time: 1.2730016708, output_fired_time: 0.7564306259, propagate_forward_time: 33.6733055115, propagate_backward_time: 51.2074317932, weight_update_time: 0.0804460943, other_time: 2.0103607178
epoch time: 7.0800037384s, input_fired_time: 0.1363106370, output_fired_time: 0.0000000000, propagate_forward_time: 6.5934600830, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3502330780
validation[          , genome  5632] predictions:    9743/  10000 (97.43%), best:    9753/10000 (97.53%), error:       906.72223, best error:       855.40027 on epoch:    71, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 87.9146575928s, input_fired_time: 1.2693113089, output_fired_time: 0.7509228587, propagate_forward_time: 33.2894592285, propagate_backward_time: 50.6042442322, weight_update_time: 0.0798018202, other_time: 2.0007209778
epoch time: 7.0775980949s, input_fired_time: 0.1369384825, output_fired_time: 0.0000000000, propagate_forward_time: 6.5916571617, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3490023613
validation[          , genome  5632] predictions:    9538/  10000 (95.38%), best:    9753/10000 (97.53%), error:      1422.81897, best error:       855.40027 on epoch:    71, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 87.4688034058s, input_fired_time: 1.2641083002, output_fired_time: 0.7464664578, propagate_forward_time: 33.1196556091, propagate_backward_time: 50.3672409058, weight_update_time: 0.0792457983, other_time: 1.9713325500
epoch time: 7.4670038223s, input_fired_time: 0.1401036531, output_fired_time: 0.0000000000, propagate_forward_time: 6.9660544395, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3608455658
validation[          , genome  5632] predictions:    9739/  10000 (97.39%), best:    9753/10000 (97.53%), error:       899.70752, best error:       855.40027 on epoch:    71, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 87.5921249390s, input_fired_time: 1.2669235468, output_fired_time: 0.7478217483, propagate_forward_time: 33.1696281433, propagate_backward_time: 50.4048233032, weight_update_time: 0.0795174986, other_time: 2.0029335022
epoch time: 7.1360969543s, input_fired_time: 0.1359535307, output_fired_time: 0.0000000000, propagate_forward_time: 6.6455531120, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3545904160
validation[          , genome  5632] predictions:    9706/  10000 (97.06%), best:    9753/10000 (97.53%), error:       961.77759, best error:       855.40027 on epoch:    71, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 87.7555694580s, input_fired_time: 1.2718454599, output_fired_time: 0.7546163201, propagate_forward_time: 33.2523193359, propagate_backward_time: 50.4749298096, weight_update_time: 0.0796893090, other_time: 2.0018615723
epoch time: 7.0743694305s, input_fired_time: 0.1366865188, output_fired_time: 0.0000000000, propagate_forward_time: 6.5895066261, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3481764793
validation[          , genome  5632] predictions:    9728/  10000 (97.28%), best:    9753/10000 (97.53%), error:       942.26447, best error:       855.40027 on epoch:    71, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 87.4453811646s, input_fired_time: 1.2676403522, output_fired_time: 0.7495072484, propagate_forward_time: 33.0676994324, propagate_backward_time: 50.3934707642, weight_update_time: 0.0792270303, other_time: 1.9670677185
epoch time: 7.0972466469s, input_fired_time: 0.1409219652, output_fired_time: 0.0000000000, propagate_forward_time: 6.6023726463, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3539519310
validation[          , genome  5632] predictions:    9711/  10000 (97.11%), best:    9753/10000 (97.53%), error:       957.06726, best error:       855.40027 on epoch:    71, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 87.8935089111s, input_fired_time: 1.2713084221, output_fired_time: 0.7495260239, propagate_forward_time: 33.3062171936, propagate_backward_time: 50.5787200928, weight_update_time: 0.0795682222, other_time: 1.9877357483
epoch time: 7.0800614357s, input_fired_time: 0.1376772076, output_fired_time: 0.0000000000, propagate_forward_time: 6.5909557343, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3514285088
validation[          , genome  5632] predictions:    9714/  10000 (97.14%), best:    9753/10000 (97.53%), error:       927.99951, best error:       855.40027 on epoch:    71, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 87.7177658081s, input_fired_time: 1.2689584494, output_fired_time: 0.7483087778, propagate_forward_time: 33.2168922424, propagate_backward_time: 50.4874801636, weight_update_time: 0.0793373436, other_time: 1.9961280823
epoch time: 7.0789098740s, input_fired_time: 0.1368108392, output_fired_time: 0.0000000000, propagate_forward_time: 6.5931453705, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3489537239
validation[          , genome  5632] predictions:    9705/  10000 (97.05%), best:    9753/10000 (97.53%), error:       950.74316, best error:       855.40027 on epoch:    71, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 35.4696121216s, input_fired_time: 0.6816331148, output_fired_time: 0.0000000000, propagate_forward_time: 32.9877281189, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8002510071
best training[          , genome  5632] predictions:   49473/  50000 (98.95%), best:    9753/10000 (97.53%), error:      1944.79773, best error:       855.40027 on epoch:    71, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 7.0857858658s, input_fired_time: 0.1317731738, output_fired_time: 0.0000000000, propagate_forward_time: 6.5952773094, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3587355614
   testing[          , genome  5632] predictions:    9757/  10000 (97.57%), best:    9753/10000 (97.53%), error:       793.42572, best error:       855.40027 on epoch:    71, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
00:08:19 (5551): called boinc_finish(0)

</stderr_txt>
]]>