Nameexact_genome_1512568488_44_5976_0
Workunit2601184
Created7 Dec 2017, 17:22:21 UTC
Sent7 Dec 2017, 17:28:49 UTC
Report deadline14 Dec 2017, 6:04:19 UTC
Received9 Dec 2017, 9:13:22 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID62426
Run time4 hours 22 min 19 sec
CPU time4 hours 4 min 50 sec
Validate stateValid
Credit1,631.17
Device peak FLOPS2.98 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size154.36 MB
Peak swap size152.70 MB
Peak disk usage1.83 MB

Stderr output

<core_client_version>7.6.22</core_client_version>
<![CDATA[
<stderr_txt>
%), error:      1175.40125, best error:      1135.04248 on epoch:    13, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 140.8466491699s, input_fired_time: 1.4682027102, output_fired_time: 1.6142750978, propagate_forward_time: 52.9773941040, propagate_backward_time: 81.6171569824, weight_update_time: 0.1839608550, other_time: 3.1696243286
epoch time: 10.1510019302s, input_fired_time: 0.1560735404, output_fired_time: 0.0000000000, propagate_forward_time: 9.3983669281, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5965614319
validation[          , genome  5976] predictions:    9461/  10000 (94.61%), best:    9664/10000 (96.64%), error:      1887.05457, best error:      1135.04248 on epoch:    13, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 138.2459259033s, input_fired_time: 1.4043711424, output_fired_time: 1.5014792681, propagate_forward_time: 52.2535514832, propagate_backward_time: 79.9883651733, weight_update_time: 0.1831496805, other_time: 3.0981521606
epoch time: 12.2546806335s, input_fired_time: 0.1698715091, output_fired_time: 0.0000000000, propagate_forward_time: 11.5377388000, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5470705032
validation[          , genome  5976] predictions:    9670/  10000 (96.70%), best:    9664/10000 (96.64%), error:      1169.35925, best error:      1135.04248 on epoch:    13, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 135.6525115967s, input_fired_time: 1.3466089964, output_fired_time: 1.4892843962, propagate_forward_time: 51.1063842773, propagate_backward_time: 78.6799850464, weight_update_time: 0.2287411541, other_time: 3.0302505493
epoch time: 11.0780496597s, input_fired_time: 0.1713709086, output_fired_time: 0.0000000000, propagate_forward_time: 10.3572902679, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5493888855
validation[          , genome  5976] predictions:    9621/  10000 (96.21%), best:    9664/10000 (96.64%), error:      1249.29993, best error:      1135.04248 on epoch:    13, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 133.7933044434s, input_fired_time: 1.3472750187, output_fired_time: 1.4931619167, propagate_forward_time: 50.3959236145, propagate_backward_time: 77.5711593628, weight_update_time: 0.1822150797, other_time: 2.9857864380
epoch time: 10.7494812012s, input_fired_time: 0.1663560420, output_fired_time: 0.0000000000, propagate_forward_time: 10.0414381027, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5416870117
validation[          , genome  5976] predictions:    9682/  10000 (96.82%), best:    9682/10000 (96.82%), error:      1103.97961, best error:      1103.97961 on epoch:    18, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 141.9893798828s, input_fired_time: 1.5074919462, output_fired_time: 1.5832675695, propagate_forward_time: 53.5694427490, propagate_backward_time: 82.1220474243, weight_update_time: 0.1834842265, other_time: 3.2071304321
epoch time: 11.0463685989s, input_fired_time: 0.1690195650, output_fired_time: 0.0000000000, propagate_forward_time: 10.3360986710, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5412502289
validation[          , genome  5976] predictions:    9663/  10000 (96.63%), best:    9682/10000 (96.82%), error:      1129.08093, best error:      1103.97961 on epoch:    18, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 135.0170440674s, input_fired_time: 1.3930414915, output_fired_time: 1.5076804161, propagate_forward_time: 50.8065185547, propagate_backward_time: 78.2659378052, weight_update_time: 0.2297812700, other_time: 3.0438766479
epoch time: 13.0749816895s, input_fired_time: 0.2624482214, output_fired_time: 0.0000000000, propagate_forward_time: 12.1255578995, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6869754791
validation[          , genome  5976] predictions:    9630/  10000 (96.30%), best:    9682/10000 (96.82%), error:      1190.69348, best error:      1103.97961 on epoch:    18, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 137.0772247314s, input_fired_time: 1.4047359228, output_fired_time: 1.5042866468, propagate_forward_time: 51.6531753540, propagate_backward_time: 79.4725112915, weight_update_time: 0.1826122850, other_time: 3.0425109863
epoch time: 12.7075910568s, input_fired_time: 0.1676572561, output_fired_time: 0.0000000000, propagate_forward_time: 11.9037389755, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6361951828
validation[          , genome  5976] predictions:    9650/  10000 (96.50%), best:    9682/10000 (96.82%), error:      1206.70203, best error:      1103.97961 on epoch:    18, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 134.3163299561s, input_fired_time: 1.3578889370, output_fired_time: 1.4928876162, propagate_forward_time: 50.4725608826, propagate_backward_time: 77.9246063232, weight_update_time: 0.1836591065, other_time: 3.0683746338
epoch time: 21.8336353302s, input_fired_time: 0.3566717505, output_fired_time: 0.0000000000, propagate_forward_time: 20.3254032135, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1515598297
validation[          , genome  5976] predictions:    9664/  10000 (96.64%), best:    9682/10000 (96.82%), error:      1204.01428, best error:      1103.97961 on epoch:    18, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 136.2785644531s, input_fired_time: 1.3887170553, output_fired_time: 1.4903219938, propagate_forward_time: 51.3729476929, propagate_backward_time: 78.9195556641, weight_update_time: 0.1826058328, other_time: 3.1070175171
epoch time: 11.0634860992s, input_fired_time: 0.1672522426, output_fired_time: 0.0000000000, propagate_forward_time: 10.3578023911, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5384311676
validation[          , genome  5976] predictions:    9641/  10000 (96.41%), best:    9682/10000 (96.82%), error:      1191.78516, best error:      1103.97961 on epoch:    18, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 139.8134460449s, input_fired_time: 1.4270149469, output_fired_time: 1.5349059105, propagate_forward_time: 52.0996932983, propagate_backward_time: 81.6601486206, weight_update_time: 0.1850606650, other_time: 3.0916748047
epoch time: 13.3634471893s, input_fired_time: 0.1686488539, output_fired_time: 0.0000000000, propagate_forward_time: 12.5189104080, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6758880615
validation[          , genome  5976] predictions:    9684/  10000 (96.84%), best:    9684/10000 (96.84%), error:      1023.02936, best error:      1023.02936 on epoch:    24, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 136.5453948975s, input_fired_time: 1.3666366339, output_fired_time: 1.5356330872, propagate_forward_time: 51.4156455994, propagate_backward_time: 79.1023635864, weight_update_time: 0.1842884421, other_time: 3.1251144409
epoch time: 12.4582777023s, input_fired_time: 0.1689199060, output_fired_time: 0.0000000000, propagate_forward_time: 11.7413578033, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5480003357
validation[          , genome  5976] predictions:    9634/  10000 (96.34%), best:    9684/10000 (96.84%), error:      1196.36011, best error:      1023.02936 on epoch:    24, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 142.9016571045s, input_fired_time: 1.3695311546, output_fired_time: 1.5136728287, propagate_forward_time: 55.1844062805, propagate_backward_time: 81.6313476563, weight_update_time: 0.1837865263, other_time: 3.2026977539
epoch time: 12.1527738571s, input_fired_time: 0.1692193449, output_fired_time: 0.0000000000, propagate_forward_time: 11.3051967621, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6783580780
validation[          , genome  5976] predictions:    9651/  10000 (96.51%), best:    9684/10000 (96.84%), error:      1124.99792, best error:      1023.02936 on epoch:    24, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 136.6870422363s, input_fired_time: 1.3530501127, output_fired_time: 1.5368180275, propagate_forward_time: 51.2559242249, propagate_backward_time: 79.4552536011, weight_update_time: 0.1836643964, other_time: 3.0860061646
epoch time: 11.1797456741s, input_fired_time: 0.1692540050, output_fired_time: 0.0000000000, propagate_forward_time: 10.4648609161, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5456304550
validation[          , genome  5976] predictions:    9676/  10000 (96.76%), best:    9684/10000 (96.84%), error:      1094.05347, best error:      1023.02936 on epoch:    24, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 138.0656738281s, input_fired_time: 1.3998596668, output_fired_time: 1.5959082842, propagate_forward_time: 51.8955574036, propagate_backward_time: 80.0796813965, weight_update_time: 0.1833768636, other_time: 3.0946807861
epoch time: 17.6529140472s, input_fired_time: 0.3102399707, output_fired_time: 0.0000000000, propagate_forward_time: 16.6173095703, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7253646851
validation[          , genome  5976] predictions:    9612/  10000 (96.12%), best:    9684/10000 (96.84%), error:      1228.33313, best error:      1023.02936 on epoch:    24, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 143.5038452148s, input_fired_time: 1.3725206852, output_fired_time: 1.6367944479, propagate_forward_time: 53.8378181458, propagate_backward_time: 83.4621200562, weight_update_time: 0.1833587587, other_time: 3.1945877075
epoch time: 18.3480663300s, input_fired_time: 0.2154458910, output_fired_time: 0.0000000000, propagate_forward_time: 17.5026569366, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6299629211
validation[          , genome  5976] predictions:    9690/  10000 (96.90%), best:    9684/10000 (96.84%), error:      1133.96191, best error:      1023.02936 on epoch:    24, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 153.4644165039s, input_fired_time: 1.6164497137, output_fired_time: 1.6420400143, propagate_forward_time: 57.7286949158, propagate_backward_time: 89.1726989746, weight_update_time: 0.1842589080, other_time: 3.3045196533
epoch time: 11.7320976257s, input_fired_time: 0.1711006612, output_fired_time: 0.0000000000, propagate_forward_time: 11.0171070099, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5438899994
validation[          , genome  5976] predictions:    9660/  10000 (96.60%), best:    9684/10000 (96.84%), error:      1157.29663, best error:      1023.02936 on epoch:    24, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 140.0390625000s, input_fired_time: 1.3987385035, output_fired_time: 1.5258117914, propagate_forward_time: 52.7855720520, propagate_backward_time: 81.1610794067, weight_update_time: 0.1855557561, other_time: 3.1678543091
epoch time: 10.9113912582s, input_fired_time: 0.1698521972, output_fired_time: 0.0000000000, propagate_forward_time: 10.1996498108, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5418891907
validation[          , genome  5976] predictions:    9535/  10000 (95.35%), best:    9684/10000 (96.84%), error:      1628.14551, best error:      1023.02936 on epoch:    24, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 138.1504821777s, input_fired_time: 1.4261229038, output_fired_time: 1.6477568150, propagate_forward_time: 51.7664833069, propagate_backward_time: 80.0994262695, weight_update_time: 0.1836798787, other_time: 3.2107086182
epoch time: 11.5806674957s, input_fired_time: 0.1722620130, output_fired_time: 0.0000000000, propagate_forward_time: 10.8084535599, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5999517441
validation[          , genome  5976] predictions:    9715/  10000 (97.15%), best:    9715/10000 (97.15%), error:       988.16547, best error:       988.16547 on epoch:    32, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 137.0749511719s, input_fired_time: 1.3822389841, output_fired_time: 1.5163949728, propagate_forward_time: 51.6175651550, propagate_backward_time: 79.4285049438, weight_update_time: 0.1851818711, other_time: 3.1302566528
epoch time: 10.9054851532s, input_fired_time: 0.1686573774, output_fired_time: 0.0000000000, propagate_forward_time: 10.1936845779, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5431432724
validation[          , genome  5976] predictions:    9673/  10000 (96.73%), best:    9715/10000 (97.15%), error:      1098.64270, best error:       988.16547 on epoch:    32, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 134.9790344238s, input_fired_time: 1.3967549801, output_fired_time: 1.5042202473, propagate_forward_time: 50.6506538391, propagate_backward_time: 78.3633728027, weight_update_time: 0.2293169349, other_time: 3.0640258789
epoch time: 10.9241924286s, input_fired_time: 0.1715657115, output_fired_time: 0.0000000000, propagate_forward_time: 10.2059793472, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5466470718
validation[          , genome  5976] predictions:    8843/  10000 (88.43%), best:    9715/10000 (97.15%), error:      4496.97168, best error:       988.16547 on epoch:    32, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

resetting weights to those on epoch: 32
epoch time: 146.4162139893s, input_fired_time: 1.4085283279, output_fired_time: 1.5390408039, propagate_forward_time: 52.1219100952, propagate_backward_time: 88.2155609131, weight_update_time: 0.1833950132, other_time: 3.1311721802
epoch time: 13.3137397766s, input_fired_time: 0.1694357395, output_fired_time: 0.0000000000, propagate_forward_time: 12.5036058426, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6406984329
validation[          , genome  5976] predictions:    9693/  10000 (96.93%), best:    9715/10000 (97.15%), error:      1062.05957, best error:       988.16547 on epoch:    32, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 147.0795745850s, input_fired_time: 1.4456160069, output_fired_time: 1.5306910276, propagate_forward_time: 59.8053131104, propagate_backward_time: 81.1602401733, weight_update_time: 0.1840652078, other_time: 3.1377182007
epoch time: 14.9903831482s, input_fired_time: 0.2006155849, output_fired_time: 0.0000000000, propagate_forward_time: 14.0834856033, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7062816620
validation[          , genome  5976] predictions:    9705/  10000 (97.05%), best:    9715/10000 (97.15%), error:       995.75177, best error:       988.16547 on epoch:    32, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 195.0111999512s, input_fired_time: 15.4916248322, output_fired_time: 1.5230618715, propagate_forward_time: 83.6021041870, propagate_backward_time: 91.3186798096, weight_update_time: 0.1842738539, other_time: 3.0757369995
epoch time: 11.8369274139s, input_fired_time: 0.1704805195, output_fired_time: 0.0000000000, propagate_forward_time: 11.0831918716, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5832548141
validation[          , genome  5976] predictions:    9668/  10000 (96.68%), best:    9715/10000 (97.15%), error:      1120.65479, best error:       988.16547 on epoch:    32, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 157.8616943359s, input_fired_time: 1.4067013264, output_fired_time: 2.6439280510, propagate_forward_time: 69.6532363892, propagate_backward_time: 80.9908218384, weight_update_time: 0.1850253642, other_time: 3.1670074463
epoch time: 25.2920875549s, input_fired_time: 0.1683620512, output_fired_time: 0.0000000000, propagate_forward_time: 24.5742950439, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5494308472
validation[          , genome  5976] predictions:    9683/  10000 (96.83%), best:    9715/10000 (97.15%), error:      1097.33179, best error:       988.16547 on epoch:    32, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 139.1887207031s, input_fired_time: 1.3876842260, output_fired_time: 1.5272290707, propagate_forward_time: 52.5352096558, propagate_backward_time: 80.6131362915, weight_update_time: 0.2176353782, other_time: 3.1254730225
epoch time: 13.2936248779s, input_fired_time: 0.2352338135, output_fired_time: 0.0000000000, propagate_forward_time: 12.4480762482, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6103143692
validation[          , genome  5976] predictions:    9653/  10000 (96.53%), best:    9715/10000 (97.15%), error:      1099.80286, best error:       988.16547 on epoch:    32, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 139.5119934082s, input_fired_time: 1.4100627899, output_fired_time: 1.6329714060, propagate_forward_time: 52.5148735046, propagate_backward_time: 80.9385604858, weight_update_time: 0.1839974672, other_time: 3.0155258179
epoch time: 13.2549753189s, input_fired_time: 0.1741741300, output_fired_time: 0.0000000000, propagate_forward_time: 12.4265203476, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6542806625
validation[          , genome  5976] predictions:    9686/  10000 (96.86%), best:    9715/10000 (97.15%), error:      1063.26758, best error:       988.16547 on epoch:    32, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 174.9933776855s, input_fired_time: 1.4832055569, output_fired_time: 1.6802533865, propagate_forward_time: 62.2428092957, propagate_backward_time: 106.0958938599, weight_update_time: 0.2160823196, other_time: 3.4912185669
epoch time: 10.9227943420s, input_fired_time: 0.1718351394, output_fired_time: 0.0000000000, propagate_forward_time: 10.2015609741, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5493984222
validation[          , genome  5976] predictions:    9707/  10000 (97.07%), best:    9707/10000 (97.07%), error:       969.13116, best error:       969.13116 on epoch:    41, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 144.3019409180s, input_fired_time: 1.4095239639, output_fired_time: 1.6195549965, propagate_forward_time: 52.6682662964, propagate_backward_time: 85.3871994019, weight_update_time: 0.1829703301, other_time: 3.2173919678
epoch time: 16.6826801300s, input_fired_time: 0.1734176874, output_fired_time: 0.0000000000, propagate_forward_time: 15.9553842545, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5538778305
validation[          , genome  5976] predictions:    9724/  10000 (97.24%), best:    9724/10000 (97.24%), error:       922.75916, best error:       922.75916 on epoch:    42, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 135.7068939209s, input_fired_time: 1.3974663019, output_fired_time: 1.5179781914, propagate_forward_time: 51.1084976196, propagate_backward_time: 78.6032485962, weight_update_time: 0.1851088405, other_time: 3.0797119141
epoch time: 10.8575067520s, input_fired_time: 0.1694784462, output_fired_time: 0.0000000000, propagate_forward_time: 10.1406393051, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5473890305
validation[          , genome  5976] predictions:    9676/  10000 (96.76%), best:    9724/10000 (97.24%), error:      1062.93213, best error:       922.75916 on epoch:    42, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 134.5143890381s, input_fired_time: 1.3703100681, output_fired_time: 1.4988740683, propagate_forward_time: 51.0344047546, propagate_backward_time: 77.5704269409, weight_update_time: 0.1830819398, other_time: 3.0403671265
epoch time: 10.9375162125s, input_fired_time: 0.1731093377, output_fired_time: 0.0000000000, propagate_forward_time: 10.2169437408, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5474634171
validation[          , genome  5976] predictions:    9714/  10000 (97.14%), best:    9724/10000 (97.24%), error:       985.77240, best error:       922.75916 on epoch:    42, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 146.7812347412s, input_fired_time: 1.4406578541, output_fired_time: 1.6358811855, propagate_forward_time: 52.4494285583, propagate_backward_time: 88.1292724609, weight_update_time: 0.2478407323, other_time: 3.1259918213
epoch time: 17.5838165283s, input_fired_time: 0.3331228793, output_fired_time: 0.0000000000, propagate_forward_time: 16.4790916443, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7716026306
validation[          , genome  5976] predictions:    9680/  10000 (96.80%), best:    9724/10000 (97.24%), error:      1042.42505, best error:       922.75916 on epoch:    42, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 149.7458343506s, input_fired_time: 1.4719495773, output_fired_time: 1.7664018869, propagate_forward_time: 56.5656509399, propagate_backward_time: 86.4549026489, weight_update_time: 0.2543121576, other_time: 3.4869232178
epoch time: 11.2325391769s, input_fired_time: 0.1711753160, output_fired_time: 0.0000000000, propagate_forward_time: 10.4808235168, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5805406570
validation[          , genome  5976] predictions:    9681/  10000 (96.81%), best:    9724/10000 (97.24%), error:      1125.89966, best error:       922.75916 on epoch:    42, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 135.3407592773s, input_fired_time: 1.4112805128, output_fired_time: 1.5477815866, propagate_forward_time: 51.0555419922, propagate_backward_time: 78.2920684814, weight_update_time: 0.1834573001, other_time: 3.0340881348
epoch time: 11.1043014526s, input_fired_time: 0.1727221161, output_fired_time: 0.0000000000, propagate_forward_time: 10.3812608719, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5503187180
validation[          , genome  5976] predictions:    9727/  10000 (97.27%), best:    9724/10000 (97.24%), error:       964.79205, best error:       922.75916 on epoch:    42, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 141.3847198486s, input_fired_time: 1.3897253275, output_fired_time: 1.6539403200, propagate_forward_time: 53.5550575256, propagate_backward_time: 81.6284713745, weight_update_time: 0.1838419437, other_time: 3.1575241089
epoch time: 14.2039279938s, input_fired_time: 0.2674857378, output_fired_time: 0.0000000000, propagate_forward_time: 13.2618122101, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6746301651
validation[          , genome  5976] predictions:    9692/  10000 (96.92%), best:    9724/10000 (97.24%), error:       992.91174, best error:       922.75916 on epoch:    42, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 137.8952789307s, input_fired_time: 1.3795202971, output_fired_time: 1.5144844055, propagate_forward_time: 51.9955635071, propagate_backward_time: 79.8928451538, weight_update_time: 0.1832936853, other_time: 3.1128768921
epoch time: 18.2048187256s, input_fired_time: 3.9226713181, output_fired_time: 0.0000000000, propagate_forward_time: 13.5145807266, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7675666809
validation[          , genome  5976] predictions:    9709/  10000 (97.09%), best:    9724/10000 (97.24%), error:      1005.11426, best error:       922.75916 on epoch:    42, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 137.0161590576s, input_fired_time: 1.4232881069, output_fired_time: 1.5177018642, propagate_forward_time: 51.6408920288, propagate_backward_time: 79.3135299683, weight_update_time: 0.1840158701, other_time: 3.1207427979
epoch time: 10.9524230957s, input_fired_time: 0.1723113209, output_fired_time: 0.0000000000, propagate_forward_time: 10.2316112518, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5485000610
validation[          , genome  5976] predictions:    9707/  10000 (97.07%), best:    9724/10000 (97.24%), error:       966.96228, best error:       922.75916 on epoch:    42, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 140.5316619873s, input_fired_time: 1.4124335051, output_fired_time: 1.6681119204, propagate_forward_time: 53.0402030945, propagate_backward_time: 81.1987915039, weight_update_time: 0.2157773674, other_time: 3.2121276855
epoch time: 11.1537570953s, input_fired_time: 0.1720807701, output_fired_time: 0.0000000000, propagate_forward_time: 10.4319219589, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5497541428
validation[          , genome  5976] predictions:    9718/  10000 (97.18%), best:    9724/10000 (97.24%), error:       971.08533, best error:       922.75916 on epoch:    42, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 136.3121032715s, input_fired_time: 1.3806416988, output_fired_time: 1.5062572956, propagate_forward_time: 51.2754631042, propagate_backward_time: 79.0712966919, weight_update_time: 0.1847627014, other_time: 3.0784378052
epoch time: 12.7856569290s, input_fired_time: 0.1741840690, output_fired_time: 0.0000000000, propagate_forward_time: 11.9634075165, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6480655670
validation[          , genome  5976] predictions:    9704/  10000 (97.04%), best:    9724/10000 (97.24%), error:       971.44324, best error:       922.75916 on epoch:    42, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 125.6450424194s, input_fired_time: 1.3431106806, output_fired_time: 1.5795042515, propagate_forward_time: 46.0985221863, propagate_backward_time: 73.4977264404, weight_update_time: 0.1764057428, other_time: 3.1261749268
epoch time: 12.2012395859s, input_fired_time: 0.2032972127, output_fired_time: 0.0000000000, propagate_forward_time: 11.4181442261, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5797977448
validation[          , genome  5976] predictions:    9683/  10000 (96.83%), best:    9724/10000 (97.24%), error:      1057.51343, best error:       922.75916 on epoch:    42, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 145.5756530762s, input_fired_time: 1.3863141537, output_fired_time: 1.5778278112, propagate_forward_time: 53.6862297058, propagate_backward_time: 85.5616302490, weight_update_time: 0.1840267032, other_time: 3.3636474609
epoch time: 10.9729423523s, input_fired_time: 0.1735878289, output_fired_time: 0.0000000000, propagate_forward_time: 10.2483577728, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5509967804
validation[          , genome  5976] predictions:    9717/  10000 (97.17%), best:    9724/10000 (97.24%), error:       967.33551, best error:       922.75916 on epoch:    42, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 139.5194244385s, input_fired_time: 1.4074200392, output_fired_time: 1.5366425514, propagate_forward_time: 53.6171989441, propagate_backward_time: 79.8597259521, weight_update_time: 0.1843665540, other_time: 3.0984344482
epoch time: 11.3852186203s, input_fired_time: 0.1705547869, output_fired_time: 0.0000000000, propagate_forward_time: 10.6561346054, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5585289001
validation[          , genome  5976] predictions:    9712/  10000 (97.12%), best:    9724/10000 (97.24%), error:       968.82593, best error:       922.75916 on epoch:    42, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 137.3369750977s, input_fired_time: 1.4566739798, output_fired_time: 1.5277241468, propagate_forward_time: 51.6059036255, propagate_backward_time: 79.6355133057, weight_update_time: 0.1814844012, other_time: 3.1111526489
epoch time: 12.5297679901s, input_fired_time: 0.1711318642, output_fired_time: 0.0000000000, propagate_forward_time: 11.7205801010, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6380558014
validation[          , genome  5976] predictions:    9721/  10000 (97.21%), best:    9724/10000 (97.24%), error:       963.72925, best error:       922.75916 on epoch:    42, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 137.3710174561s, input_fired_time: 1.3994898796, output_fired_time: 1.5265519619, propagate_forward_time: 52.7786903381, propagate_backward_time: 78.5945968628, weight_update_time: 0.1855469495, other_time: 3.0716934204
epoch time: 42.5315818787s, input_fired_time: 0.2664148211, output_fired_time: 0.0000000000, propagate_forward_time: 41.4979858398, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7671813965
validation[          , genome  5976] predictions:    9722/  10000 (97.22%), best:    9724/10000 (97.24%), error:       952.99042, best error:       922.75916 on epoch:    42, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 144.2552642822s, input_fired_time: 1.5409276485, output_fired_time: 1.7382582426, propagate_forward_time: 54.1572914124, propagate_backward_time: 83.5587539673, weight_update_time: 0.1852315366, other_time: 3.2600479126
epoch time: 10.7567234039s, input_fired_time: 0.1691739410, output_fired_time: 0.0000000000, propagate_forward_time: 10.0470790863, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5404701233
validation[          , genome  5976] predictions:    9724/  10000 (97.24%), best:    9724/10000 (97.24%), error:       929.88721, best error:       922.75916 on epoch:    42, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 135.7443542480s, input_fired_time: 1.4083697796, output_fired_time: 1.5187784433, propagate_forward_time: 51.2439079285, propagate_backward_time: 78.4724197388, weight_update_time: 0.1860373169, other_time: 3.1008682251
epoch time: 10.9490852356s, input_fired_time: 0.1729630232, output_fired_time: 0.0000000000, propagate_forward_time: 10.2309026718, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5452194214
validation[          , genome  5976] predictions:    9721/  10000 (97.21%), best:    9721/10000 (97.21%), error:       922.64246, best error:       922.64246 on epoch:    59, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 134.1460266113s, input_fired_time: 1.3860793114, output_fired_time: 1.5064612627, propagate_forward_time: 50.4908828735, propagate_backward_time: 77.7037200928, weight_update_time: 0.1836337745, other_time: 3.0588912964
epoch time: 10.8307609558s, input_fired_time: 0.1725099087, output_fired_time: 0.0000000000, propagate_forward_time: 10.1081924438, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5500583649
validation[          , genome  5976] predictions:    9691/  10000 (96.91%), best:    9721/10000 (97.21%), error:      1011.57617, best error:       922.64246 on epoch:    59, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 135.0356140137s, input_fired_time: 1.3941727877, output_fired_time: 1.5122406483, propagate_forward_time: 51.0584640503, propagate_backward_time: 78.0209579468, weight_update_time: 0.1845822334, other_time: 3.0497741699
epoch time: 11.7192296982s, input_fired_time: 0.1798544973, output_fired_time: 0.0000000000, propagate_forward_time: 10.9736375809, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5657377243
validation[          , genome  5976] predictions:    9700/  10000 (97.00%), best:    9721/10000 (97.21%), error:      1031.97717, best error:       922.64246 on epoch:    59, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 135.9104614258s, input_fired_time: 1.4065581560, output_fired_time: 1.5235797167, propagate_forward_time: 51.1957511902, propagate_backward_time: 78.7313537598, weight_update_time: 0.1832871288, other_time: 3.0532226563
epoch time: 10.7369108200s, input_fired_time: 0.1688995212, output_fired_time: 0.0000000000, propagate_forward_time: 10.0240230560, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5439882278
validation[          , genome  5976] predictions:    9705/  10000 (97.05%), best:    9721/10000 (97.21%), error:      1013.60974, best error:       922.64246 on epoch:    59, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 135.5611267090s, input_fired_time: 1.3912837505, output_fired_time: 1.5134011507, propagate_forward_time: 50.8470191956, propagate_backward_time: 78.7641143799, weight_update_time: 0.1843777150, other_time: 3.0453186035
epoch time: 10.9158086777s, input_fired_time: 0.1726435274, output_fired_time: 0.0000000000, propagate_forward_time: 10.1946229935, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5485420227
validation[          , genome  5976] predictions:    9704/  10000 (97.04%), best:    9721/10000 (97.21%), error:      1032.46252, best error:       922.64246 on epoch:    59, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 136.1206970215s, input_fired_time: 1.4095222950, output_fired_time: 1.5284520388, propagate_forward_time: 51.3306083679, propagate_backward_time: 78.7850189209, weight_update_time: 0.1835708767, other_time: 3.0670928955
epoch time: 10.8406000137s, input_fired_time: 0.1706271321, output_fired_time: 0.0000000000, propagate_forward_time: 10.1267509460, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5432214737
validation[          , genome  5976] predictions:    9705/  10000 (97.05%), best:    9721/10000 (97.21%), error:       980.81763, best error:       922.64246 on epoch:    59, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 134.5391082764s, input_fired_time: 1.3784533739, output_fired_time: 1.5105233192, propagate_forward_time: 50.5875473022, propagate_backward_time: 78.0545272827, weight_update_time: 0.1830781102, other_time: 3.0080566406
epoch time: 11.0944070816s, input_fired_time: 0.1724675894, output_fired_time: 0.0000000000, propagate_forward_time: 10.3731002808, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5488395691
validation[          , genome  5976] predictions:    9689/  10000 (96.89%), best:    9721/10000 (97.21%), error:      1066.20557, best error:       922.64246 on epoch:    59, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 136.2085113525s, input_fired_time: 1.3914732933, output_fired_time: 1.5201672316, propagate_forward_time: 51.4885864258, propagate_backward_time: 78.7636260986, weight_update_time: 0.1846361756, other_time: 3.0446472168
epoch time: 12.9324054718s, input_fired_time: 0.2038668990, output_fired_time: 0.0000000000, propagate_forward_time: 12.1533336639, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5752048492
validation[          , genome  5976] predictions:    9731/  10000 (97.31%), best:    9721/10000 (97.21%), error:       953.15656, best error:       922.64246 on epoch:    59, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 134.7119598389s, input_fired_time: 1.3767346144, output_fired_time: 1.4989608526, propagate_forward_time: 50.7248001099, propagate_backward_time: 78.0477371216, weight_update_time: 0.1831035912, other_time: 3.0637207031
epoch time: 10.7662096024s, input_fired_time: 0.1707325876, output_fired_time: 0.0000000000, propagate_forward_time: 10.0534830093, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5419940948
validation[          , genome  5976] predictions:    9721/  10000 (97.21%), best:    9721/10000 (97.21%), error:       962.25354, best error:       922.64246 on epoch:    59, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 136.8905792236s, input_fired_time: 1.3901207447, output_fired_time: 1.5792188644, propagate_forward_time: 51.7071380615, propagate_backward_time: 79.1583709717, weight_update_time: 0.1835089624, other_time: 3.0557250977
epoch time: 15.6219949722s, input_fired_time: 0.1755291969, output_fired_time: 0.0000000000, propagate_forward_time: 14.8300991058, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6163663864
validation[          , genome  5976] predictions:    9659/  10000 (96.59%), best:    9721/10000 (97.21%), error:      1158.87170, best error:       922.64246 on epoch:    59, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 139.9647979736s, input_fired_time: 1.4249067307, output_fired_time: 1.5106613636, propagate_forward_time: 52.7673454285, propagate_backward_time: 81.0824890137, weight_update_time: 0.1839343160, other_time: 3.1793823242
epoch time: 20.3092880249s, input_fired_time: 0.1708108336, output_fired_time: 0.0000000000, propagate_forward_time: 19.5948162079, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5436611176
validation[          , genome  5976] predictions:    9611/  10000 (96.11%), best:    9721/10000 (97.21%), error:      1231.49121, best error:       922.64246 on epoch:    59, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 140.2740173340s, input_fired_time: 1.4153184891, output_fired_time: 1.5660752058, propagate_forward_time: 52.5676345825, propagate_backward_time: 81.3950424194, weight_update_time: 0.2147382647, other_time: 3.3299560547
epoch time: 17.6963253021s, input_fired_time: 0.2694936693, output_fired_time: 0.0000000000, propagate_forward_time: 16.3867168427, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0401153564
validation[          , genome  5976] predictions:    9725/  10000 (97.25%), best:    9721/10000 (97.21%), error:       928.67297, best error:       922.64246 on epoch:    59, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 139.0559082031s, input_fired_time: 1.5194987059, output_fired_time: 1.5316112041, propagate_forward_time: 52.6949996948, propagate_backward_time: 80.1125564575, weight_update_time: 0.2187075913, other_time: 3.1972351074
epoch time: 10.7322416306s, input_fired_time: 0.1569746584, output_fired_time: 0.0000000000, propagate_forward_time: 9.9719762802, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6032905579
validation[          , genome  5976] predictions:    9705/  10000 (97.05%), best:    9721/10000 (97.21%), error:       951.79810, best error:       922.64246 on epoch:    59, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 140.7157745361s, input_fired_time: 1.4328869581, output_fired_time: 1.5261875391, propagate_forward_time: 55.6004066467, propagate_backward_time: 79.0805511475, weight_update_time: 0.1842538565, other_time: 3.0757446289
epoch time: 11.0183868408s, input_fired_time: 0.1749251783, output_fired_time: 0.0000000000, propagate_forward_time: 10.3006858826, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5427761078
validation[          , genome  5976] predictions:    9712/  10000 (97.12%), best:    9721/10000 (97.21%), error:       978.52545, best error:       922.64246 on epoch:    59, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 147.7626342773s, input_fired_time: 1.6098421812, output_fired_time: 1.6931880713, propagate_forward_time: 55.1258163452, propagate_backward_time: 85.9087905884, weight_update_time: 0.1814397126, other_time: 3.4249877930
epoch time: 10.7710084915s, input_fired_time: 0.1706036776, output_fired_time: 0.0000000000, propagate_forward_time: 10.0564088821, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5439958572
validation[          , genome  5976] predictions:    9736/  10000 (97.36%), best:    9736/10000 (97.36%), error:       901.62561, best error:       901.62561 on epoch:    73, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 143.2604217529s, input_fired_time: 1.4216665030, output_fired_time: 1.5414878130, propagate_forward_time: 51.7283134460, propagate_backward_time: 85.4213485718, weight_update_time: 0.1847930700, other_time: 3.1476058960
epoch time: 18.2448387146s, input_fired_time: 0.2066308707, output_fired_time: 0.0000000000, propagate_forward_time: 17.4077148438, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6304931641
validation[          , genome  5976] predictions:    9732/  10000 (97.32%), best:    9736/10000 (97.36%), error:       915.60364, best error:       901.62561 on epoch:    73, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 136.7811889648s, input_fired_time: 1.4225426912, output_fired_time: 1.5167840719, propagate_forward_time: 51.5941696167, propagate_backward_time: 79.2020339966, weight_update_time: 0.1830612272, other_time: 3.0456542969
epoch time: 17.6485309601s, input_fired_time: 0.2371146381, output_fired_time: 0.0000000000, propagate_forward_time: 16.7406730652, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6707439423
validation[          , genome  5976] predictions:    9725/  10000 (97.25%), best:    9736/10000 (97.36%), error:       907.77985, best error:       901.62561 on epoch:    73, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 146.9709930420s, input_fired_time: 1.4323610067, output_fired_time: 1.5873519182, propagate_forward_time: 56.4007415771, propagate_backward_time: 84.3326339722, weight_update_time: 0.1866632700, other_time: 3.2179031372
epoch time: 20.7712154388s, input_fired_time: 0.3367041349, output_fired_time: 0.0000000000, propagate_forward_time: 19.5628223419, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8716888428
validation[          , genome  5976] predictions:    9697/  10000 (96.97%), best:    9736/10000 (97.36%), error:      1012.36548, best error:       901.62561 on epoch:    73, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 142.1631774902s, input_fired_time: 3.6461851597, output_fired_time: 1.5433207750, propagate_forward_time: 51.9462928772, propagate_backward_time: 81.8803100586, weight_update_time: 0.1873604804, other_time: 3.1470794678
epoch time: 12.4939861298s, input_fired_time: 0.2054937333, output_fired_time: 0.0000000000, propagate_forward_time: 11.6169719696, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6715202332
validation[          , genome  5976] predictions:    9713/  10000 (97.13%), best:    9736/10000 (97.36%), error:       931.97559, best error:       901.62561 on epoch:    73, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 133.8193054199s, input_fired_time: 1.5418418646, output_fired_time: 1.5744132996, propagate_forward_time: 49.3782386780, propagate_backward_time: 77.9379959106, weight_update_time: 0.1781155169, other_time: 3.3868179321
epoch time: 17.9490604401s, input_fired_time: 0.2049420625, output_fired_time: 0.0000000000, propagate_forward_time: 17.0078182220, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7362995148
validation[          , genome  5976] predictions:    9647/  10000 (96.47%), best:    9736/10000 (97.36%), error:      1133.46851, best error:       901.62561 on epoch:    73, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 139.9311523438s, input_fired_time: 1.5913878679, output_fired_time: 1.5900397301, propagate_forward_time: 52.5718536377, propagate_backward_time: 81.0026855469, weight_update_time: 0.1848223954, other_time: 3.1751861572
epoch time: 16.2238368988s, input_fired_time: 0.3036538064, output_fired_time: 0.0000000000, propagate_forward_time: 14.9884929657, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9316902161
validation[          , genome  5976] predictions:    9734/  10000 (97.34%), best:    9736/10000 (97.36%), error:       902.20398, best error:       901.62561 on epoch:    73, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 140.6549377441s, input_fired_time: 1.4571074247, output_fired_time: 1.6098438501, propagate_forward_time: 52.9703178406, propagate_backward_time: 81.3999328613, weight_update_time: 0.1843200624, other_time: 3.2177276611
epoch time: 16.0555191040s, input_fired_time: 0.3345294297, output_fired_time: 0.0000000000, propagate_forward_time: 14.9166545868, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8043346405
validation[          , genome  5976] predictions:    9611/  10000 (96.11%), best:    9736/10000 (97.36%), error:      1304.52917, best error:       901.62561 on epoch:    73, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 139.0493316650s, input_fired_time: 1.4598013163, output_fired_time: 1.9165142775, propagate_forward_time: 52.3032379150, propagate_backward_time: 80.1928405762, weight_update_time: 0.1838426739, other_time: 3.1769256592
epoch time: 16.3594169617s, input_fired_time: 0.2060854137, output_fired_time: 0.0000000000, propagate_forward_time: 15.3760881424, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7772436142
validation[          , genome  5976] predictions:    9728/  10000 (97.28%), best:    9736/10000 (97.36%), error:       931.57935, best error:       901.62561 on epoch:    73, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 139.4825592041s, input_fired_time: 1.4213066101, output_fired_time: 1.5687299967, propagate_forward_time: 52.5600891113, propagate_backward_time: 80.7715148926, weight_update_time: 0.2146592736, other_time: 3.1609191895
epoch time: 25.5514984131s, input_fired_time: 0.2054097801, output_fired_time: 0.0000000000, propagate_forward_time: 24.4424190521, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9036693573
validation[          , genome  5976] predictions:    9733/  10000 (97.33%), best:    9736/10000 (97.36%), error:       941.68793, best error:       901.62561 on epoch:    73, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 136.5739135742s, input_fired_time: 1.4585673809, output_fired_time: 1.5407410860, propagate_forward_time: 51.3766746521, propagate_backward_time: 79.0127105713, weight_update_time: 0.1837371737, other_time: 3.1852111816
epoch time: 18.3628292084s, input_fired_time: 0.2710376680, output_fired_time: 0.0000000000, propagate_forward_time: 17.1867275238, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9050636292
validation[          , genome  5976] predictions:    9736/  10000 (97.36%), best:    9736/10000 (97.36%), error:       924.26093, best error:       901.62561 on epoch:    73, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 124.1302032471s, input_fired_time: 1.2808008194, output_fired_time: 1.3650504351, propagate_forward_time: 45.4121932983, propagate_backward_time: 72.9392929077, weight_update_time: 0.2394692302, other_time: 3.1328659058
epoch time: 10.8594083786s, input_fired_time: 0.1750918627, output_fired_time: 0.0000000000, propagate_forward_time: 10.1398277283, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5444889069
validation[          , genome  5976] predictions:    9736/  10000 (97.36%), best:    9736/10000 (97.36%), error:       921.27899, best error:       901.62561 on epoch:    73, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 143.4192047119s, input_fired_time: 1.5494290590, output_fired_time: 1.5624835491, propagate_forward_time: 54.2236366272, propagate_backward_time: 82.7442550659, weight_update_time: 0.1831259578, other_time: 3.3394088745
epoch time: 21.4975070953s, input_fired_time: 0.2712360024, output_fired_time: 0.0000000000, propagate_forward_time: 20.2901630402, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9361076355
validation[          , genome  5976] predictions:    9712/  10000 (97.12%), best:    9736/10000 (97.36%), error:      1006.08826, best error:       901.62561 on epoch:    73, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 142.4395751953s, input_fired_time: 1.4833202362, output_fired_time: 1.6855523586, propagate_forward_time: 53.5641975403, propagate_backward_time: 82.4796447754, weight_update_time: 0.1826404631, other_time: 3.2268676758
epoch time: 15.2076711655s, input_fired_time: 0.3089704216, output_fired_time: 0.0000000000, propagate_forward_time: 14.1600131989, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7386875153
validation[          , genome  5976] predictions:    9702/  10000 (97.02%), best:    9736/10000 (97.36%), error:      1024.06592, best error:       901.62561 on epoch:    73, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 139.3693084717s, input_fired_time: 1.4806880951, output_fired_time: 1.6046772003, propagate_forward_time: 52.3486099243, propagate_backward_time: 80.6529312134, weight_update_time: 0.1834489107, other_time: 3.2824096680
epoch time: 13.5261983871s, input_fired_time: 0.2380828261, output_fired_time: 0.0000000000, propagate_forward_time: 12.6730737686, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6150417328
validation[          , genome  5976] predictions:    9737/  10000 (97.37%), best:    9736/10000 (97.36%), error:       926.14655, best error:       901.62561 on epoch:    73, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 143.4359130859s, input_fired_time: 1.4052139521, output_fired_time: 1.5470740795, propagate_forward_time: 57.6982841492, propagate_backward_time: 79.7080230713, weight_update_time: 0.1843062788, other_time: 3.0773162842
epoch time: 11.7653274536s, input_fired_time: 0.1737302691, output_fired_time: 0.0000000000, propagate_forward_time: 10.9858694077, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6057281494
validation[          , genome  5976] predictions:    9742/  10000 (97.42%), best:    9736/10000 (97.36%), error:       913.63336, best error:       901.62561 on epoch:    73, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 135.7318420410s, input_fired_time: 1.4015921354, output_fired_time: 1.5056203604, propagate_forward_time: 50.5226249695, propagate_backward_time: 79.2168350220, weight_update_time: 0.1842071861, other_time: 3.0851669312
epoch time: 11.0619287491s, input_fired_time: 0.1768186986, output_fired_time: 0.0000000000, propagate_forward_time: 10.3304719925, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5546379089
validation[          , genome  5976] predictions:    9667/  10000 (96.67%), best:    9736/10000 (97.36%), error:      1114.76697, best error:       901.62561 on epoch:    73, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 137.9001464844s, input_fired_time: 1.4476532936, output_fired_time: 1.5202358961, propagate_forward_time: 51.8595466614, propagate_backward_time: 79.9158477783, weight_update_time: 0.1849830449, other_time: 3.1568756104
epoch time: 13.8854608536s, input_fired_time: 0.2084031850, output_fired_time: 0.0000000000, propagate_forward_time: 12.9646368027, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7124204636
validation[          , genome  5976] predictions:    9743/  10000 (97.43%), best:    9736/10000 (97.36%), error:       934.18268, best error:       901.62561 on epoch:    73, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 146.2382507324s, input_fired_time: 1.4904847145, output_fired_time: 1.6472637653, propagate_forward_time: 55.2286758423, propagate_backward_time: 84.6261367798, weight_update_time: 0.1845613122, other_time: 3.2456970215
epoch time: 11.2165002823s, input_fired_time: 0.1741487086, output_fired_time: 0.0000000000, propagate_forward_time: 10.4906654358, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5516862869
validation[          , genome  5976] predictions:    9624/  10000 (96.24%), best:    9736/10000 (97.36%), error:      1233.16956, best error:       901.62561 on epoch:    73, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 148.6714477539s, input_fired_time: 1.5593538284, output_fired_time: 1.5423257351, propagate_forward_time: 56.6093368530, propagate_backward_time: 85.7449264526, weight_update_time: 0.1834726781, other_time: 3.2154998779
epoch time: 11.3950519562s, input_fired_time: 0.1747843027, output_fired_time: 0.0000000000, propagate_forward_time: 10.6694440842, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5508232117
validation[          , genome  5976] predictions:    9713/  10000 (97.13%), best:    9736/10000 (97.36%), error:       982.84735, best error:       901.62561 on epoch:    73, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 142.2550201416s, input_fired_time: 1.3937568665, output_fired_time: 1.5068292618, propagate_forward_time: 54.6938285828, propagate_backward_time: 81.6428527832, weight_update_time: 0.1832362711, other_time: 3.0177459717
epoch time: 12.7768087387s, input_fired_time: 0.1818312407, output_fired_time: 0.0000000000, propagate_forward_time: 11.9421100616, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6528673172
validation[          , genome  5976] predictions:    9751/  10000 (97.51%), best:    9736/10000 (97.36%), error:       913.62933, best error:       901.62561 on epoch:    73, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 143.3752593994s, input_fired_time: 1.5386544466, output_fired_time: 1.6177892685, propagate_forward_time: 54.1969947815, propagate_backward_time: 82.7148971558, weight_update_time: 0.2163892388, other_time: 3.3069381714
epoch time: 14.0469951630s, input_fired_time: 0.2069442123, output_fired_time: 0.0000000000, propagate_forward_time: 13.1973705292, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6426801682
validation[          , genome  5976] predictions:    9699/  10000 (96.99%), best:    9736/10000 (97.36%), error:      1008.59247, best error:       901.62561 on epoch:    73, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 140.9278717041s, input_fired_time: 1.5065056086, output_fired_time: 1.5933619738, propagate_forward_time: 53.2007446289, propagate_backward_time: 81.4319992065, weight_update_time: 0.2181683630, other_time: 3.1952590942
epoch time: 10.9450092316s, input_fired_time: 0.1761693358, output_fired_time: 0.0000000000, propagate_forward_time: 10.2210092545, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5478305817
validation[          , genome  5976] predictions:    9737/  10000 (97.37%), best:    9736/10000 (97.36%), error:       926.92700, best error:       901.62561 on epoch:    73, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 147.2567443848s, input_fired_time: 1.6017620564, output_fired_time: 1.7774819136, propagate_forward_time: 55.3770446777, propagate_backward_time: 85.0948715210, weight_update_time: 0.1839920282, other_time: 3.4055862427
epoch time: 17.2452507019s, input_fired_time: 0.3691311181, output_fired_time: 0.0000000000, propagate_forward_time: 15.9397993088, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9363203049
validation[          , genome  5976] predictions:    9726/  10000 (97.26%), best:    9736/10000 (97.36%), error:       963.76880, best error:       901.62561 on epoch:    73, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 134.2965087891s, input_fired_time: 1.3930749893, output_fired_time: 1.5054953098, propagate_forward_time: 50.6489257813, propagate_backward_time: 77.7418212891, weight_update_time: 0.1829530597, other_time: 3.0071868896
epoch time: 15.1886730194s, input_fired_time: 0.2074631602, output_fired_time: 0.0000000000, propagate_forward_time: 14.3021497726, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6790599823
validation[          , genome  5976] predictions:    9704/  10000 (97.04%), best:    9736/10000 (97.36%), error:      1023.02399, best error:       901.62561 on epoch:    73, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 135.9492797852s, input_fired_time: 1.4337288141, output_fired_time: 1.4991490841, propagate_forward_time: 51.2389411926, propagate_backward_time: 78.7259979248, weight_update_time: 0.1845016629, other_time: 3.0514678955
epoch time: 12.3519735336s, input_fired_time: 0.2057511508, output_fired_time: 0.0000000000, propagate_forward_time: 11.6005201340, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5457019806
validation[          , genome  5976] predictions:    9714/  10000 (97.14%), best:    9736/10000 (97.36%), error:       969.95990, best error:       901.62561 on epoch:    73, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 135.9704895020s, input_fired_time: 1.4249569178, output_fired_time: 1.5251216888, propagate_forward_time: 51.2519073486, propagate_backward_time: 78.7012023926, weight_update_time: 0.1851781160, other_time: 3.0673065186
epoch time: 11.4736289978s, input_fired_time: 0.1745016873, output_fired_time: 0.0000000000, propagate_forward_time: 10.7254047394, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5737228394
validation[          , genome  5976] predictions:    9724/  10000 (97.24%), best:    9736/10000 (97.36%), error:       951.42877, best error:       901.62561 on epoch:    73, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 142.2009124756s, input_fired_time: 1.3978146315, output_fired_time: 1.5823119879, propagate_forward_time: 51.7652168274, propagate_backward_time: 84.3985900879, weight_update_time: 0.1831659079, other_time: 3.0569915771
epoch time: 14.0024623871s, input_fired_time: 0.1750918627, output_fired_time: 0.0000000000, propagate_forward_time: 13.0503320694, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7770385742
validation[          , genome  5976] predictions:    9712/  10000 (97.12%), best:    9736/10000 (97.36%), error:       998.01245, best error:       901.62561 on epoch:    73, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 60.9591827393s, input_fired_time: 0.9940773845, output_fired_time: 0.0000000000, propagate_forward_time: 56.9496574402, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0154495239
best training[          , genome  5976] predictions:   49362/  50000 (98.72%), best:    9736/10000 (97.36%), error:      2295.94727, best error:       901.62561 on epoch:    73, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 15.6242151260s, input_fired_time: 0.3636695147, output_fired_time: 0.0000000000, propagate_forward_time: 14.5546531677, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7058925629
   testing[          , genome  5976] predictions:    9742/  10000 (97.42%), best:    9736/10000 (97.36%), error:       867.41992, best error:       901.62561 on epoch:    73, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
03:13:09 (252): called boinc_finish(0)

</stderr_txt>
]]>