Nameexact_genome_1512568488_44_465_1
Workunit2573593
Created6 Dec 2017, 15:50:45 UTC
Sent6 Dec 2017, 15:52:13 UTC
Report deadline10 Dec 2017, 11:13:50 UTC
Received6 Dec 2017, 21:55:54 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID57938
Run time2 hours 9 min 56 sec
CPU time2 hours 5 min 38 sec
Validate stateValid
Credit951.67
Device peak FLOPS2.90 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size151.11 MB
Peak swap size155.93 MB
Peak disk usage1.40 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4335360527
validation[          , genome   465] predictions:    9171/  10000 (91.71%), best:    9221/10000 (92.21%), error:      2770.75024, best error:      2729.26196 on epoch:    19, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 67.6070098877s, input_fired_time: 0.6176066995, output_fired_time: 0.6143741608, propagate_forward_time: 26.1306724548, propagate_backward_time: 37.7508316040, weight_update_time: 0.1308859438, other_time: 2.4935264587
epoch time: 5.8307652473s, input_fired_time: 0.0805889219, output_fired_time: 0.0000000000, propagate_forward_time: 5.3007750511, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4494013786
validation[          , genome   465] predictions:    9193/  10000 (91.93%), best:    9221/10000 (92.21%), error:      2745.27271, best error:      2729.26196 on epoch:    19, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 67.8231887817s, input_fired_time: 0.6236051917, output_fired_time: 0.6164325476, propagate_forward_time: 26.1685695648, propagate_backward_time: 37.9335975647, weight_update_time: 0.1315087229, other_time: 2.4809837341
epoch time: 6.2252430916s, input_fired_time: 0.0912937522, output_fired_time: 0.0000000000, propagate_forward_time: 5.6572093964, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4767398834
validation[          , genome   465] predictions:    9217/  10000 (92.17%), best:    9217/10000 (92.17%), error:      2681.70142, best error:      2681.70142 on epoch:    22, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 68.0696487427s, input_fired_time: 0.6204044223, output_fired_time: 0.6177410483, propagate_forward_time: 26.3127231598, propagate_backward_time: 38.0440483093, weight_update_time: 0.1318157613, other_time: 2.4747276306
epoch time: 5.8313536644s, input_fired_time: 0.0794186294, output_fired_time: 0.0000000000, propagate_forward_time: 5.3135600090, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4383749962
validation[          , genome   465] predictions:    9220/  10000 (92.20%), best:    9220/10000 (92.20%), error:      2679.56885, best error:      2679.56885 on epoch:    23, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 66.8430557251s, input_fired_time: 0.6227959394, output_fired_time: 0.6129657030, propagate_forward_time: 25.7243938446, propagate_backward_time: 37.3341026306, weight_update_time: 0.1310569644, other_time: 2.5487937927
epoch time: 5.6629519463s, input_fired_time: 0.0789057687, output_fired_time: 0.0000000000, propagate_forward_time: 5.1474056244, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4366407394
validation[          , genome   465] predictions:    9195/  10000 (91.95%), best:    9220/10000 (92.20%), error:      2742.64819, best error:      2679.56885 on epoch:    23, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 67.5558776855s, input_fired_time: 0.6214671135, output_fired_time: 0.6162695885, propagate_forward_time: 25.9804935455, propagate_backward_time: 37.8192138672, weight_update_time: 0.1313077509, other_time: 2.5184326172
epoch time: 5.8019413948s, input_fired_time: 0.0780890062, output_fired_time: 0.0000000000, propagate_forward_time: 5.2895407677, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4343113899
validation[          , genome   465] predictions:    9175/  10000 (91.75%), best:    9220/10000 (92.20%), error:      2776.05298, best error:      2679.56885 on epoch:    23, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 67.7310180664s, input_fired_time: 0.6167178154, output_fired_time: 0.6167799234, propagate_forward_time: 26.2062873840, propagate_backward_time: 37.8625030518, weight_update_time: 0.1315072328, other_time: 2.4287300110
epoch time: 6.0188665390s, input_fired_time: 0.0837890953, output_fired_time: 0.0000000000, propagate_forward_time: 5.4597144127, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4753632545
validation[          , genome   465] predictions:    9198/  10000 (91.98%), best:    9220/10000 (92.20%), error:      2711.04346, best error:      2679.56885 on epoch:    23, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 67.2198486328s, input_fired_time: 0.6156518459, output_fired_time: 0.6100280285, propagate_forward_time: 25.9280281067, propagate_backward_time: 37.6164779663, weight_update_time: 0.1314939409, other_time: 2.4496574402
epoch time: 5.7443704605s, input_fired_time: 0.0783308968, output_fired_time: 0.0000000000, propagate_forward_time: 5.2178015709, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4482378960
validation[          , genome   465] predictions:    9208/  10000 (92.08%), best:    9220/10000 (92.20%), error:      2735.15381, best error:      2679.56885 on epoch:    23, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 67.7118530273s, input_fired_time: 0.6197448969, output_fired_time: 0.6190779209, propagate_forward_time: 26.0192031860, propagate_backward_time: 37.9328346252, weight_update_time: 0.1329177320, other_time: 2.5209922791
epoch time: 6.1711401939s, input_fired_time: 0.0855476633, output_fired_time: 0.0000000000, propagate_forward_time: 5.6061511040, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4794416428
validation[          , genome   465] predictions:    9192/  10000 (91.92%), best:    9220/10000 (92.20%), error:      2685.27466, best error:      2679.56885 on epoch:    23, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 67.0831146240s, input_fired_time: 0.6224774718, output_fired_time: 0.6147314906, propagate_forward_time: 25.8750114441, propagate_backward_time: 37.4471549988, weight_update_time: 0.1316613257, other_time: 2.5237426758
epoch time: 5.7936272621s, input_fired_time: 0.0803845450, output_fired_time: 0.0000000000, propagate_forward_time: 5.2783818245, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4348607063
validation[          , genome   465] predictions:    9151/  10000 (91.51%), best:    9220/10000 (92.20%), error:      2911.81616, best error:      2679.56885 on epoch:    23, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 66.8523864746s, input_fired_time: 0.6203808188, output_fired_time: 0.6085172892, propagate_forward_time: 25.7693748474, propagate_backward_time: 37.3681411743, weight_update_time: 0.1303460002, other_time: 2.4859657288
epoch time: 5.7848386765s, input_fired_time: 0.0808352754, output_fired_time: 0.0000000000, propagate_forward_time: 5.2551894188, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4488139153
validation[          , genome   465] predictions:    9202/  10000 (92.02%), best:    9220/10000 (92.20%), error:      2708.07129, best error:      2679.56885 on epoch:    23, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 68.2289428711s, input_fired_time: 0.6237319112, output_fired_time: 0.6178069711, propagate_forward_time: 26.3142585754, propagate_backward_time: 38.2132530212, weight_update_time: 0.1329369545, other_time: 2.4598922729
epoch time: 6.0603590012s, input_fired_time: 0.0832431987, output_fired_time: 0.0000000000, propagate_forward_time: 5.5115704536, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4655451775
validation[          , genome   465] predictions:    9172/  10000 (91.72%), best:    9220/10000 (92.20%), error:      2749.85596, best error:      2679.56885 on epoch:    23, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 66.9822158813s, input_fired_time: 0.6189852357, output_fired_time: 0.6165072918, propagate_forward_time: 25.6377868652, propagate_backward_time: 37.5226478577, weight_update_time: 0.1330431402, other_time: 2.5862846375
epoch time: 5.8410344124s, input_fired_time: 0.0804085508, output_fired_time: 0.0000000000, propagate_forward_time: 5.3133835793, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4472422600
validation[          , genome   465] predictions:    9204/  10000 (92.04%), best:    9220/10000 (92.20%), error:      2716.40405, best error:      2679.56885 on epoch:    23, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 67.7890014648s, input_fired_time: 0.6217495203, output_fired_time: 0.6181706190, propagate_forward_time: 26.1466083527, propagate_backward_time: 37.9284133911, weight_update_time: 0.1314751655, other_time: 2.4740600586
epoch time: 5.7721767426s, input_fired_time: 0.0785036534, output_fired_time: 0.0000000000, propagate_forward_time: 5.2543644905, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4393086433
validation[          , genome   465] predictions:    9216/  10000 (92.16%), best:    9220/10000 (92.20%), error:      2725.22827, best error:      2679.56885 on epoch:    23, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 67.7052536011s, input_fired_time: 0.6179698110, output_fired_time: 0.6109081507, propagate_forward_time: 26.2003707886, propagate_backward_time: 37.8547973633, weight_update_time: 0.1313123256, other_time: 2.4212036133
epoch time: 5.5087437630s, input_fired_time: 0.0767799169, output_fired_time: 0.0000000000, propagate_forward_time: 4.9943871498, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4375767708
validation[          , genome   465] predictions:    9217/  10000 (92.17%), best:    9217/10000 (92.17%), error:      2653.89551, best error:      2653.89551 on epoch:    34, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 67.2749099731s, input_fired_time: 0.6240417361, output_fired_time: 0.6110746861, propagate_forward_time: 25.8997440338, propagate_backward_time: 37.6156158447, weight_update_time: 0.1321339458, other_time: 2.5244369507
epoch time: 5.7915396690s, input_fired_time: 0.0806205869, output_fired_time: 0.0000000000, propagate_forward_time: 5.2667698860, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4441490173
validation[          , genome   465] predictions:    9229/  10000 (92.29%), best:    9229/10000 (92.29%), error:      2635.47314, best error:      2635.47314 on epoch:    35, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 67.3220520020s, input_fired_time: 0.6182608008, output_fired_time: 0.6132488847, propagate_forward_time: 25.9605598450, propagate_backward_time: 37.6871452332, weight_update_time: 0.1303687841, other_time: 2.4428329468
epoch time: 5.6065039635s, input_fired_time: 0.0783170685, output_fired_time: 0.0000000000, propagate_forward_time: 5.0834326744, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4447541237
validation[          , genome   465] predictions:    9180/  10000 (91.80%), best:    9229/10000 (92.29%), error:      2788.94556, best error:      2635.47314 on epoch:    35, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 67.6033401489s, input_fired_time: 0.6170676351, output_fired_time: 0.6144118905, propagate_forward_time: 26.1516227722, propagate_backward_time: 37.7676887512, weight_update_time: 0.1311739385, other_time: 2.4525527954
epoch time: 5.7659864426s, input_fired_time: 0.0785946921, output_fired_time: 0.0000000000, propagate_forward_time: 5.2543931007, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4329986572
validation[          , genome   465] predictions:    9226/  10000 (92.26%), best:    9226/10000 (92.26%), error:      2627.72168, best error:      2627.72168 on epoch:    37, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 67.0378723145s, input_fired_time: 0.6173964143, output_fired_time: 0.6083419323, propagate_forward_time: 25.8654384613, propagate_backward_time: 37.5085601807, weight_update_time: 0.1293735057, other_time: 2.4381332397
epoch time: 5.8322024345s, input_fired_time: 0.0803072751, output_fired_time: 0.0000000000, propagate_forward_time: 5.3174548149, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4344401360
validation[          , genome   465] predictions:    9208/  10000 (92.08%), best:    9226/10000 (92.26%), error:      2628.68970, best error:      2627.72168 on epoch:    37, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 68.0431518555s, input_fired_time: 0.6277382970, output_fired_time: 0.6166339517, propagate_forward_time: 26.2758846283, propagate_backward_time: 37.9991645813, weight_update_time: 0.1323411316, other_time: 2.5237312317
epoch time: 5.9524273872s, input_fired_time: 0.0849245787, output_fired_time: 0.0000000000, propagate_forward_time: 5.4024810791, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4650216103
validation[          , genome   465] predictions:    9206/  10000 (92.06%), best:    9226/10000 (92.26%), error:      2637.04126, best error:      2627.72168 on epoch:    37, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 68.5503005981s, input_fired_time: 0.6338644028, output_fired_time: 0.6207337976, propagate_forward_time: 26.4975967407, propagate_backward_time: 38.3033981323, weight_update_time: 0.1328008175, other_time: 2.4947052002
epoch time: 5.7728905678s, input_fired_time: 0.0802711472, output_fired_time: 0.0000000000, propagate_forward_time: 5.2311968803, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4614224434
validation[          , genome   465] predictions:    9245/  10000 (92.45%), best:    9245/10000 (92.45%), error:      2592.43970, best error:      2592.43970 on epoch:    40, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 69.3084182739s, input_fired_time: 0.6329764724, output_fired_time: 0.6273518205, propagate_forward_time: 26.8231105804, propagate_backward_time: 38.7528953552, weight_update_time: 0.1322473884, other_time: 2.4720878601
epoch time: 5.7069692612s, input_fired_time: 0.0799051374, output_fired_time: 0.0000000000, propagate_forward_time: 5.1907863617, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4362778664
validation[          , genome   465] predictions:    9211/  10000 (92.11%), best:    9245/10000 (92.45%), error:      2616.91846, best error:      2592.43970 on epoch:    40, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 67.6527328491s, input_fired_time: 0.6223122478, output_fired_time: 0.6195639372, propagate_forward_time: 26.0020599365, propagate_backward_time: 37.9072990417, weight_update_time: 0.1330337822, other_time: 2.5014991760
epoch time: 5.8835825920s, input_fired_time: 0.0798613802, output_fired_time: 0.0000000000, propagate_forward_time: 5.3591485023, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4445729256
validation[          , genome   465] predictions:    9223/  10000 (92.23%), best:    9245/10000 (92.45%), error:      2643.76465, best error:      2592.43970 on epoch:    40, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 66.9400100708s, input_fired_time: 0.6215910912, output_fired_time: 0.6090892553, propagate_forward_time: 25.7920074463, propagate_backward_time: 37.4188156128, weight_update_time: 0.1307401061, other_time: 2.4985046387
epoch time: 5.9736824036s, input_fired_time: 0.0824974403, output_fired_time: 0.0000000000, propagate_forward_time: 5.4410758018, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4501090050
validation[          , genome   465] predictions:    9219/  10000 (92.19%), best:    9245/10000 (92.45%), error:      2633.27344, best error:      2592.43970 on epoch:    40, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 65.7703781128s, input_fired_time: 0.6165657640, output_fired_time: 0.6000931263, propagate_forward_time: 25.3454399109, propagate_backward_time: 36.7322502136, weight_update_time: 0.1289124042, other_time: 2.4760284424
epoch time: 5.9188652039s, input_fired_time: 0.0837605596, output_fired_time: 0.0000000000, propagate_forward_time: 5.3759512901, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4591531754
validation[          , genome   465] predictions:    9221/  10000 (92.21%), best:    9245/10000 (92.45%), error:      2710.49780, best error:      2592.43970 on epoch:    40, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 66.8160705566s, input_fired_time: 0.6183750629, output_fired_time: 0.6101684570, propagate_forward_time: 25.7356128693, propagate_backward_time: 37.3815422058, weight_update_time: 0.1310377717, other_time: 2.4703712463
epoch time: 5.8879361153s, input_fired_time: 0.0822796449, output_fired_time: 0.0000000000, propagate_forward_time: 5.3520483971, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4536080360
validation[          , genome   465] predictions:    9206/  10000 (92.06%), best:    9245/10000 (92.45%), error:      2661.83594, best error:      2592.43970 on epoch:    40, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 67.9637451172s, input_fired_time: 0.6245498061, output_fired_time: 0.6224252582, propagate_forward_time: 26.2363452911, propagate_backward_time: 38.0102386475, weight_update_time: 0.1321117431, other_time: 2.4701843262
epoch time: 5.8440818787s, input_fired_time: 0.0822599456, output_fired_time: 0.0000000000, propagate_forward_time: 5.3042368889, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4575848579
validation[          , genome   465] predictions:    9247/  10000 (92.47%), best:    9247/10000 (92.47%), error:      2579.92212, best error:      2579.92212 on epoch:    46, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 67.7908401489s, input_fired_time: 0.6324270964, output_fired_time: 0.6161964536, propagate_forward_time: 26.0600166321, propagate_backward_time: 37.9427108765, weight_update_time: 0.1307964027, other_time: 2.5394935608
epoch time: 5.9642763138s, input_fired_time: 0.0831735954, output_fired_time: 0.0000000000, propagate_forward_time: 5.4160957336, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4650068283
validation[          , genome   465] predictions:    9246/  10000 (92.46%), best:    9247/10000 (92.47%), error:      2585.93726, best error:      2579.92212 on epoch:    46, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 68.0868988037s, input_fired_time: 0.6267494559, output_fired_time: 0.6184979677, propagate_forward_time: 26.3271274567, propagate_backward_time: 38.0489616394, weight_update_time: 0.1333028823, other_time: 2.4655647278
epoch time: 5.6872644424s, input_fired_time: 0.0790794268, output_fired_time: 0.0000000000, propagate_forward_time: 5.1789803505, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4292044640
validation[          , genome   465] predictions:    9215/  10000 (92.15%), best:    9247/10000 (92.47%), error:      2638.83960, best error:      2579.92212 on epoch:    46, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 68.5221557617s, input_fired_time: 0.6258782744, output_fired_time: 0.6218739748, propagate_forward_time: 26.4396915436, propagate_backward_time: 38.3302650452, weight_update_time: 0.1327460259, other_time: 2.5044517517
epoch time: 5.7721915245s, input_fired_time: 0.0798881501, output_fired_time: 0.0000000000, propagate_forward_time: 5.2479519844, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4443511963
validation[          , genome   465] predictions:    9238/  10000 (92.38%), best:    9247/10000 (92.47%), error:      2582.45947, best error:      2579.92212 on epoch:    46, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 67.0529327393s, input_fired_time: 0.6165866852, output_fired_time: 0.6128634214, propagate_forward_time: 25.7840270996, propagate_backward_time: 37.5846481323, weight_update_time: 0.1308306754, other_time: 2.4548110962
epoch time: 5.8413958549s, input_fired_time: 0.0827214792, output_fired_time: 0.0000000000, propagate_forward_time: 5.3101549149, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4485192299
validation[          , genome   465] predictions:    9253/  10000 (92.53%), best:    9247/10000 (92.47%), error:      2591.31226, best error:      2579.92212 on epoch:    46, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 68.6864318848s, input_fired_time: 0.6292483807, output_fired_time: 0.6241049767, propagate_forward_time: 26.5330028534, propagate_backward_time: 38.4110984802, weight_update_time: 0.1346500218, other_time: 2.4889717102
epoch time: 5.4294686317s, input_fired_time: 0.0803474635, output_fired_time: 0.0000000000, propagate_forward_time: 4.8700199127, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4791011810
validation[          , genome   465] predictions:    9227/  10000 (92.27%), best:    9247/10000 (92.47%), error:      2591.92090, best error:      2579.92212 on epoch:    46, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 68.7339248657s, input_fired_time: 0.6310150623, output_fired_time: 0.6242420673, propagate_forward_time: 26.5401611328, propagate_backward_time: 38.4192886353, weight_update_time: 0.1330797523, other_time: 2.5192184448
epoch time: 5.7760124207s, input_fired_time: 0.0820493177, output_fired_time: 0.0000000000, propagate_forward_time: 5.2425808907, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4513821602
validation[          , genome   465] predictions:    9233/  10000 (92.33%), best:    9247/10000 (92.47%), error:      2596.38013, best error:      2579.92212 on epoch:    46, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 67.0330810547s, input_fired_time: 0.6188367009, output_fired_time: 0.6156063080, propagate_forward_time: 25.7473907471, propagate_backward_time: 37.6017417908, weight_update_time: 0.1314305663, other_time: 2.4495048523
epoch time: 5.3577289581s, input_fired_time: 0.0784571990, output_fired_time: 0.0000000000, propagate_forward_time: 4.8143062592, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4649653435
validation[          , genome   465] predictions:    9229/  10000 (92.29%), best:    9247/10000 (92.47%), error:      2625.25000, best error:      2579.92212 on epoch:    46, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 68.0420684814s, input_fired_time: 0.6251115799, output_fired_time: 0.6177949905, propagate_forward_time: 26.2855987549, propagate_backward_time: 38.0455856323, weight_update_time: 0.1316372454, other_time: 2.4679718018
epoch time: 5.6634840965s, input_fired_time: 0.0791079551, output_fired_time: 0.0000000000, propagate_forward_time: 5.1473650932, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4370112419
validation[          , genome   465] predictions:    9242/  10000 (92.42%), best:    9247/10000 (92.47%), error:      2588.13721, best error:      2579.92212 on epoch:    46, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 66.7640609741s, input_fired_time: 0.6236449480, output_fired_time: 0.6151264310, propagate_forward_time: 25.5524406433, propagate_backward_time: 37.3580741882, weight_update_time: 0.1329887360, other_time: 2.6147766113
epoch time: 5.8757452965s, input_fired_time: 0.0810142606, output_fired_time: 0.0000000000, propagate_forward_time: 5.3625946045, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4321365356
validation[          , genome   465] predictions:    9244/  10000 (92.44%), best:    9247/10000 (92.47%), error:      2615.27271, best error:      2579.92212 on epoch:    46, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 68.5469665527s, input_fired_time: 0.6401734948, output_fired_time: 0.6252143383, propagate_forward_time: 26.4472446442, propagate_backward_time: 38.3008766174, weight_update_time: 0.1337653548, other_time: 2.5334587097
epoch time: 5.8208613396s, input_fired_time: 0.0820533335, output_fired_time: 0.0000000000, propagate_forward_time: 5.3038940430, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4349141121
validation[          , genome   465] predictions:    9237/  10000 (92.37%), best:    9247/10000 (92.47%), error:      2603.77490, best error:      2579.92212 on epoch:    46, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 67.4954528809s, input_fired_time: 0.6289132237, output_fired_time: 0.6146079302, propagate_forward_time: 26.0687465668, propagate_backward_time: 37.7260513306, weight_update_time: 0.1321880221, other_time: 2.4571304321
epoch time: 5.8220624924s, input_fired_time: 0.0812673867, output_fired_time: 0.0000000000, propagate_forward_time: 5.3048563004, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4359388351
validation[          , genome   465] predictions:    9218/  10000 (92.18%), best:    9247/10000 (92.47%), error:      2629.57153, best error:      2579.92212 on epoch:    46, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 68.0737991333s, input_fired_time: 0.6312010884, output_fired_time: 0.6190664768, propagate_forward_time: 26.3051872253, propagate_backward_time: 38.0643882751, weight_update_time: 0.1306124777, other_time: 2.4539566040
epoch time: 5.9874010086s, input_fired_time: 0.0837458447, output_fired_time: 0.0000000000, propagate_forward_time: 5.4533576965, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4502973557
validation[          , genome   465] predictions:    9236/  10000 (92.36%), best:    9247/10000 (92.47%), error:      2604.61792, best error:      2579.92212 on epoch:    46, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/mnist_training_50k.bin'
boincified validation filename: '../../projects/csgrid.org_csg/mnist_validation_10k.bin'
boincified testing filename: '../../projects/csgrid.org_csg/mnist_testing_new.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1512568488_44_465.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1512568488_44_465_1_r437945370_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.966238
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.000606181
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 2.42472e-05
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 59
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 46
read number_validation_images: 10000
read best_validation_predictions: 9247
read best_validation_error: 2579.92
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 465
read normal distribution: '1 0 0'
generator_str: '1570750720'
read generator: 1570750720
read generated_by_map:
1 crossover 1
reading 15 nodes.
reading 19 edges.
number input nodes: 1
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 4923 images.
reading image set with 5742 images.
reading image set with 4958 images.
reading image set with 5131 images.
reading image set with 4842 images.
reading image set with 4421 images.
reading image set with 4918 images.
reading image set with 5265 images.
reading image set with 4851 images.
reading image set with 4949 images.
image_size: 1x28x28 = 784
read 50000 images.
    class    0: 4923
    class    1: 5742
    class    2: 4958
    class    3: 5131
    class    4: 4842
    class    5: 4421
    class    6: 4918
    class    7: 5265
    class    8: 4851
    class    9: 4949
calculating averages and standard deviations for images
average pixel value for channel 0: 0.130530551075935
pixel variance for channel 0: 0.0948646068572998
pixel standard deviation for channel 0: 0.308000981807709
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 1x28x28 = 784
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 980 images.
reading image set with 1135 images.
reading image set with 1032 images.
reading image set with 1010 images.
reading image set with 982 images.
reading image set with 892 images.
reading image set with 958 images.
reading image set with 1028 images.
reading image set with 974 images.
reading image set with 1009 images.
image_size: 1x28x28 = 784
read 10000 images.
    class    0: 980
    class    1: 1135
    class    2: 1032
    class    3: 1010
    class    4: 982
    class    5: 892
    class    6: 958
    class    7: 1028
    class    8: 974
    class    9: 1009
loaded images
starting backpropagation!
epoch time: 67.6798706054688s, input_fired_time: 0.616125106811523, output_fired_time: 0.604802131652832, propagate_forward_time: 24.4967651367188, propagate_backward_time: 39.4847373962402, weight_update_time: 0.130073636770248, other_time: 2.47743606567383
epoch time: 5.82824468612671s, input_fired_time: 0.0821434929966927, output_fired_time: 0, propagate_forward_time: 5.29588174819946, propagate_backward_time: 0, weight_update_time: 0, other_time: 0.450219631195068
validation[          , genome   465] predictions:    9250/  10000 (92.50%), best:    9250/10000 (92.50%), error:      2572.66846, best error:      2572.66846 on epoch:    59, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 69.9570083618s, input_fired_time: 0.6292179227, output_fired_time: 0.6116598248, propagate_forward_time: 25.6538963318, propagate_backward_time: 40.5910224915, weight_update_time: 0.1317104548, other_time: 2.4712142944
epoch time: 5.6813664436s, input_fired_time: 0.0797702968, output_fired_time: 0.0000000000, propagate_forward_time: 5.1464309692, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4551653862
validation[          , genome   465] predictions:    9242/  10000 (92.42%), best:    9250/10000 (92.50%), error:      2612.59644, best error:      2572.66846 on epoch:    59, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 69.7680282593s, input_fired_time: 0.6251209974, output_fired_time: 0.6115676165, propagate_forward_time: 25.5787029266, propagate_backward_time: 40.4786605835, weight_update_time: 0.1305625588, other_time: 2.4739761353
epoch time: 5.3309850693s, input_fired_time: 0.0787870586, output_fired_time: 0.0000000000, propagate_forward_time: 4.8010883331, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4511098862
validation[          , genome   465] predictions:    9243/  10000 (92.43%), best:    9250/10000 (92.50%), error:      2586.95117, best error:      2572.66846 on epoch:    59, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 71.5431747437s, input_fired_time: 0.6462817192, output_fired_time: 0.6230511069, propagate_forward_time: 26.4557018280, propagate_backward_time: 41.2793159485, weight_update_time: 0.1339997202, other_time: 2.5388221741
epoch time: 5.7678093910s, input_fired_time: 0.0807875022, output_fired_time: 0.0000000000, propagate_forward_time: 5.2420139313, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4450078011
validation[          , genome   465] predictions:    9254/  10000 (92.54%), best:    9254/10000 (92.54%), error:      2568.02222, best error:      2568.02222 on epoch:    62, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 70.4942398071s, input_fired_time: 0.6357690096, output_fired_time: 0.6185669899, propagate_forward_time: 25.9791545868, propagate_backward_time: 40.7497482300, weight_update_time: 0.1388415992, other_time: 2.5109939575
epoch time: 5.6892104149s, input_fired_time: 0.0800189152, output_fired_time: 0.0000000000, propagate_forward_time: 5.1763482094, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4328432083
validation[          , genome   465] predictions:    9249/  10000 (92.49%), best:    9254/10000 (92.54%), error:      2582.61816, best error:      2568.02222 on epoch:    62, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 70.5318298340s, input_fired_time: 0.6338873506, output_fired_time: 0.6149961948, propagate_forward_time: 25.9275989532, propagate_backward_time: 40.8183937073, weight_update_time: 0.1341344714, other_time: 2.5369529724
epoch time: 5.8668127060s, input_fired_time: 0.0823050216, output_fired_time: 0.0000000000, propagate_forward_time: 5.3442654610, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4402422905
validation[          , genome   465] predictions:    9243/  10000 (92.43%), best:    9254/10000 (92.54%), error:      2573.61133, best error:      2568.02222 on epoch:    62, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 70.8061752319s, input_fired_time: 0.6347315311, output_fired_time: 0.6141374707, propagate_forward_time: 26.2010498047, propagate_backward_time: 40.8940849304, weight_update_time: 0.1320970356, other_time: 2.4621696472
epoch time: 5.9803571701s, input_fired_time: 0.0865871757, output_fired_time: 0.0000000000, propagate_forward_time: 5.4260311127, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4677391052
validation[          , genome   465] predictions:    9242/  10000 (92.42%), best:    9254/10000 (92.54%), error:      2597.74951, best error:      2568.02222 on epoch:    62, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 70.9558563232s, input_fired_time: 0.6393898129, output_fired_time: 0.6205200553, propagate_forward_time: 26.1443138123, propagate_backward_time: 41.0670776367, weight_update_time: 0.1318978816, other_time: 2.4845542908
epoch time: 5.9027814865s, input_fired_time: 0.0835320204, output_fired_time: 0.0000000000, propagate_forward_time: 5.3725681305, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4466814995
validation[          , genome   465] predictions:    9247/  10000 (92.47%), best:    9254/10000 (92.54%), error:      2628.03394, best error:      2568.02222 on epoch:    62, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 71.2484970093s, input_fired_time: 0.6407228708, output_fired_time: 0.6185779572, propagate_forward_time: 26.3469085693, propagate_backward_time: 41.1716537476, weight_update_time: 0.1329186708, other_time: 2.4706344604
epoch time: 5.6945819855s, input_fired_time: 0.0813976750, output_fired_time: 0.0000000000, propagate_forward_time: 5.1705465317, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4426379204
validation[          , genome   465] predictions:    9242/  10000 (92.42%), best:    9254/10000 (92.54%), error:      2616.28540, best error:      2568.02222 on epoch:    62, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 70.8803482056s, input_fired_time: 0.6370498538, output_fired_time: 0.6201432943, propagate_forward_time: 26.1542091370, propagate_backward_time: 41.0186309814, weight_update_time: 0.1322571486, other_time: 2.4503211975
epoch time: 5.9454360008s, input_fired_time: 0.0836440697, output_fired_time: 0.0000000000, propagate_forward_time: 5.4097175598, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4520745277
validation[          , genome   465] predictions:    9259/  10000 (92.59%), best:    9259/10000 (92.59%), error:      2561.55322, best error:      2561.55322 on epoch:    68, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 69.1638641357s, input_fired_time: 0.6307567358, output_fired_time: 0.6020286679, propagate_forward_time: 25.4385318756, propagate_backward_time: 40.0111503601, weight_update_time: 0.1297934502, other_time: 2.4813957214
epoch time: 6.0104422569s, input_fired_time: 0.0850990638, output_fired_time: 0.0000000000, propagate_forward_time: 5.4464368820, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4789061546
validation[          , genome   465] predictions:    9241/  10000 (92.41%), best:    9259/10000 (92.59%), error:      2599.29199, best error:      2561.55322 on epoch:    68, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 68.1127319336s, input_fired_time: 0.6241445541, output_fired_time: 0.6008651853, propagate_forward_time: 24.7828693390, propagate_backward_time: 39.6064109802, weight_update_time: 0.1308954060, other_time: 2.4984397888
epoch time: 5.7868819237s, input_fired_time: 0.0819765255, output_fired_time: 0.0000000000, propagate_forward_time: 5.2619271278, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4429783821
validation[          , genome   465] predictions:    9224/  10000 (92.24%), best:    9259/10000 (92.59%), error:      2612.93823, best error:      2561.55322 on epoch:    68, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 69.8149185181s, input_fired_time: 0.6314922571, output_fired_time: 0.6163042188, propagate_forward_time: 25.4968929291, propagate_backward_time: 40.5514068604, weight_update_time: 0.1316863447, other_time: 2.5188217163
epoch time: 5.7649364471s, input_fired_time: 0.0828589350, output_fired_time: 0.0000000000, propagate_forward_time: 5.2416968346, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4403805733
validation[          , genome   465] predictions:    9257/  10000 (92.57%), best:    9257/10000 (92.57%), error:      2549.01147, best error:      2549.01147 on epoch:    71, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 71.0305786133s, input_fired_time: 0.6361474991, output_fired_time: 0.6181664467, propagate_forward_time: 26.1689510345, propagate_backward_time: 41.1205444336, weight_update_time: 0.1324148029, other_time: 2.4867706299
epoch time: 6.0286073685s, input_fired_time: 0.0877538919, output_fired_time: 0.0000000000, propagate_forward_time: 5.4681358337, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4727177620
validation[          , genome   465] predictions:    9227/  10000 (92.27%), best:    9257/10000 (92.57%), error:      2585.77148, best error:      2549.01147 on epoch:    71, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 70.6497192383s, input_fired_time: 0.6360008717, output_fired_time: 0.6164247990, propagate_forward_time: 26.0169029236, propagate_backward_time: 40.9017105103, weight_update_time: 0.1322924644, other_time: 2.4786796570
epoch time: 5.8190379143s, input_fired_time: 0.0811878443, output_fired_time: 0.0000000000, propagate_forward_time: 5.3008646965, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4369854927
validation[          , genome   465] predictions:    9234/  10000 (92.34%), best:    9257/10000 (92.57%), error:      2579.78687, best error:      2549.01147 on epoch:    71, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 68.8724288940s, input_fired_time: 0.6219367385, output_fired_time: 0.6028422713, propagate_forward_time: 25.3673248291, propagate_backward_time: 39.8485717773, weight_update_time: 0.1270976514, other_time: 2.4317550659
epoch time: 5.4471759796s, input_fired_time: 0.0781478956, output_fired_time: 0.0000000000, propagate_forward_time: 4.9278564453, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4411716461
validation[          , genome   465] predictions:    9255/  10000 (92.55%), best:    9257/10000 (92.57%), error:      2554.86206, best error:      2549.01147 on epoch:    71, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 71.3111495972s, input_fired_time: 0.6380290389, output_fired_time: 0.6202477217, propagate_forward_time: 26.3686122894, propagate_backward_time: 41.1695289612, weight_update_time: 0.1347531378, other_time: 2.5147285461
epoch time: 5.8241128922s, input_fired_time: 0.0814878196, output_fired_time: 0.0000000000, propagate_forward_time: 5.3051648140, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4374604225
validation[          , genome   465] predictions:    9231/  10000 (92.31%), best:    9257/10000 (92.57%), error:      2615.99023, best error:      2549.01147 on epoch:    71, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 70.2835235596s, input_fired_time: 0.6361346245, output_fired_time: 0.6162487864, propagate_forward_time: 25.7848262787, propagate_backward_time: 40.7336044312, weight_update_time: 0.1319996715, other_time: 2.5127105713
epoch time: 5.8944969177s, input_fired_time: 0.0822581798, output_fired_time: 0.0000000000, propagate_forward_time: 5.3558902740, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4563484192
validation[          , genome   465] predictions:    9255/  10000 (92.55%), best:    9257/10000 (92.57%), error:      2572.06567, best error:      2549.01147 on epoch:    71, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 71.3300628662s, input_fired_time: 0.6411972642, output_fired_time: 0.6228590012, propagate_forward_time: 26.3720130920, propagate_backward_time: 41.2272338867, weight_update_time: 0.1336921901, other_time: 2.4667625427
epoch time: 5.6324038506s, input_fired_time: 0.0813320577, output_fired_time: 0.0000000000, propagate_forward_time: 5.1147513390, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4363203049
validation[          , genome   465] predictions:    9243/  10000 (92.43%), best:    9257/10000 (92.57%), error:      2592.14673, best error:      2549.01147 on epoch:    71, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 70.5606155396s, input_fired_time: 0.6367217898, output_fired_time: 0.6160236597, propagate_forward_time: 26.0024833679, propagate_backward_time: 40.8092384338, weight_update_time: 0.1301849335, other_time: 2.4961547852
epoch time: 5.5821805000s, input_fired_time: 0.0797275007, output_fired_time: 0.0000000000, propagate_forward_time: 5.0707287788, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4317240715
validation[          , genome   465] predictions:    9237/  10000 (92.37%), best:    9257/10000 (92.57%), error:      2583.68140, best error:      2549.01147 on epoch:    71, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 70.2948226929s, input_fired_time: 0.6432742476, output_fired_time: 0.6160159707, propagate_forward_time: 25.8884830475, propagate_backward_time: 40.6159439087, weight_update_time: 0.1323834956, other_time: 2.5311126709
epoch time: 5.3759455681s, input_fired_time: 0.0787004456, output_fired_time: 0.0000000000, propagate_forward_time: 4.8593311310, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4379138947
validation[          , genome   465] predictions:    9242/  10000 (92.42%), best:    9257/10000 (92.57%), error:      2599.10645, best error:      2549.01147 on epoch:    71, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 70.3176727295s, input_fired_time: 0.6301286817, output_fired_time: 0.6179212332, propagate_forward_time: 25.8571777344, propagate_backward_time: 40.7497062683, weight_update_time: 0.1315358877, other_time: 2.4627418518
epoch time: 5.6782650948s, input_fired_time: 0.0803889632, output_fired_time: 0.0000000000, propagate_forward_time: 5.1601939201, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4376821518
validation[          , genome   465] predictions:    9243/  10000 (92.43%), best:    9257/10000 (92.57%), error:      2554.96387, best error:      2549.01147 on epoch:    71, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 70.4435806274s, input_fired_time: 0.6356288195, output_fired_time: 0.6169264317, propagate_forward_time: 25.9906845093, propagate_backward_time: 40.7466354370, weight_update_time: 0.1299091280, other_time: 2.4537048340
epoch time: 5.5055932999s, input_fired_time: 0.0791436732, output_fired_time: 0.0000000000, propagate_forward_time: 4.9912424088, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4352073669
validation[          , genome   465] predictions:    9245/  10000 (92.45%), best:    9257/10000 (92.57%), error:      2577.39307, best error:      2549.01147 on epoch:    71, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 69.0447235107s, input_fired_time: 0.6345978975, output_fired_time: 0.6063002348, propagate_forward_time: 25.3534393311, propagate_backward_time: 39.9683151245, weight_update_time: 0.1305611581, other_time: 2.4820709229
epoch time: 5.7494173050s, input_fired_time: 0.0820278972, output_fired_time: 0.0000000000, propagate_forward_time: 5.2311859131, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4362034798
validation[          , genome   465] predictions:    9250/  10000 (92.50%), best:    9257/10000 (92.57%), error:      2564.96826, best error:      2549.01147 on epoch:    71, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 70.0847244263s, input_fired_time: 0.6367986798, output_fired_time: 0.6161591411, propagate_forward_time: 25.7061634064, propagate_backward_time: 40.6281204224, weight_update_time: 0.1335373223, other_time: 2.4974899292
epoch time: 5.8952531815s, input_fired_time: 0.0828285590, output_fired_time: 0.0000000000, propagate_forward_time: 5.3712072372, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4412174225
validation[          , genome   465] predictions:    9265/  10000 (92.65%), best:    9265/10000 (92.65%), error:      2542.36621, best error:      2542.36621 on epoch:    83, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 69.5054779053s, input_fired_time: 0.6313429475, output_fired_time: 0.6130607724, propagate_forward_time: 25.4039573669, propagate_backward_time: 40.3873214722, weight_update_time: 0.1299390048, other_time: 2.4697990417
epoch time: 5.6556391716s, input_fired_time: 0.0818971395, output_fired_time: 0.0000000000, propagate_forward_time: 5.1317172050, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4420247078
validation[          , genome   465] predictions:    9259/  10000 (92.59%), best:    9265/10000 (92.65%), error:      2558.59814, best error:      2542.36621 on epoch:    83, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 69.5084533691s, input_fired_time: 0.6328279376, output_fired_time: 0.6123527884, propagate_forward_time: 25.4122486115, propagate_backward_time: 40.3942909241, weight_update_time: 0.1309909672, other_time: 2.4567375183
epoch time: 5.6942172050s, input_fired_time: 0.0807362422, output_fired_time: 0.0000000000, propagate_forward_time: 5.1820292473, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4314517975
validation[          , genome   465] predictions:    9257/  10000 (92.57%), best:    9265/10000 (92.65%), error:      2558.03125, best error:      2542.36621 on epoch:    83, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 69.9621429443s, input_fired_time: 0.6322389245, output_fired_time: 0.6145452857, propagate_forward_time: 25.6792449951, propagate_backward_time: 40.5546379089, weight_update_time: 0.1292427033, other_time: 2.4814720154
epoch time: 5.5648918152s, input_fired_time: 0.0807585418, output_fired_time: 0.0000000000, propagate_forward_time: 5.0559186935, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4282145500
validation[          , genome   465] predictions:    9251/  10000 (92.51%), best:    9265/10000 (92.65%), error:      2560.25464, best error:      2542.36621 on epoch:    83, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 70.5365753174s, input_fired_time: 0.6375059485, output_fired_time: 0.6102800965, propagate_forward_time: 25.9915409088, propagate_backward_time: 40.8273391724, weight_update_time: 0.1308704615, other_time: 2.4699096680
epoch time: 5.6813302040s, input_fired_time: 0.0813865066, output_fired_time: 0.0000000000, propagate_forward_time: 5.1612625122, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4386811256
validation[          , genome   465] predictions:    9198/  10000 (91.98%), best:    9265/10000 (92.65%), error:      2733.49219, best error:      2542.36621 on epoch:    83, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 70.6038284302s, input_fired_time: 0.6412658095, output_fired_time: 0.6167466044, propagate_forward_time: 25.9899463654, propagate_backward_time: 40.8739471436, weight_update_time: 0.1318005919, other_time: 2.4819259644
epoch time: 6.2240095139s, input_fired_time: 0.0897659659, output_fired_time: 0.0000000000, propagate_forward_time: 5.6535930634, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4806504250
validation[          , genome   465] predictions:    9262/  10000 (92.62%), best:    9262/10000 (92.62%), error:      2537.51294, best error:      2537.51294 on epoch:    88, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 68.6224136353s, input_fired_time: 0.6320775151, output_fired_time: 0.6060507298, propagate_forward_time: 24.8713188171, propagate_backward_time: 39.9932022095, weight_update_time: 0.1303062290, other_time: 2.5197639465
epoch time: 5.7277903557s, input_fired_time: 0.0812762305, output_fired_time: 0.0000000000, propagate_forward_time: 5.2098088264, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4367051125
validation[          , genome   465] predictions:    9252/  10000 (92.52%), best:    9262/10000 (92.62%), error:      2571.01855, best error:      2537.51294 on epoch:    88, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 70.6698760986s, input_fired_time: 0.6463748813, output_fired_time: 0.6132662892, propagate_forward_time: 26.0593929291, propagate_backward_time: 40.8137016296, weight_update_time: 0.1328379512, other_time: 2.5371360779
epoch time: 5.7728247643s, input_fired_time: 0.0818109736, output_fired_time: 0.0000000000, propagate_forward_time: 5.2548236847, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4361901283
validation[          , genome   465] predictions:    9266/  10000 (92.66%), best:    9262/10000 (92.62%), error:      2542.35815, best error:      2537.51294 on epoch:    88, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 71.4183197021s, input_fired_time: 0.6479737163, output_fired_time: 0.6234731674, propagate_forward_time: 26.3235855103, propagate_backward_time: 41.2558135986, weight_update_time: 0.1342528313, other_time: 2.5674743652
epoch time: 5.8879637718s, input_fired_time: 0.0859127343, output_fired_time: 0.0000000000, propagate_forward_time: 5.3470563889, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4549946785
validation[          , genome   465] predictions:    9263/  10000 (92.63%), best:    9262/10000 (92.62%), error:      2554.42480, best error:      2537.51294 on epoch:    88, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 68.9206466675s, input_fired_time: 0.6286898851, output_fired_time: 0.6120257378, propagate_forward_time: 24.9977378845, propagate_backward_time: 40.2024040222, weight_update_time: 0.1317020059, other_time: 2.4797897339
epoch time: 5.6988358498s, input_fired_time: 0.0850776583, output_fired_time: 0.0000000000, propagate_forward_time: 5.1572108269, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4565472603
validation[          , genome   465] predictions:    9255/  10000 (92.55%), best:    9262/10000 (92.62%), error:      2543.35107, best error:      2537.51294 on epoch:    88, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 70.8189239502s, input_fired_time: 0.6449757218, output_fired_time: 0.6150055528, propagate_forward_time: 26.1681575775, propagate_backward_time: 40.9253692627, weight_update_time: 0.1313989162, other_time: 2.4654159546
epoch time: 5.7212562561s, input_fired_time: 0.0854293630, output_fired_time: 0.0000000000, propagate_forward_time: 5.1640295982, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4717974663
validation[          , genome   465] predictions:    9257/  10000 (92.57%), best:    9262/10000 (92.62%), error:      2580.54126, best error:      2537.51294 on epoch:    88, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 69.5046081543s, input_fired_time: 0.6403433681, output_fired_time: 0.6129115224, propagate_forward_time: 25.4279460907, propagate_backward_time: 40.3126602173, weight_update_time: 0.1304656267, other_time: 2.5107421875
epoch time: 5.4495806694s, input_fired_time: 0.0809178278, output_fired_time: 0.0000000000, propagate_forward_time: 4.9198641777, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4487986565
validation[          , genome   465] predictions:    9259/  10000 (92.59%), best:    9262/10000 (92.62%), error:      2546.28589, best error:      2537.51294 on epoch:    88, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 70.9454193115s, input_fired_time: 0.6409403086, output_fired_time: 0.6175905466, propagate_forward_time: 26.1819190979, propagate_backward_time: 41.0509414673, weight_update_time: 0.1322010010, other_time: 2.4540290833
epoch time: 5.8851208687s, input_fired_time: 0.0840140730, output_fired_time: 0.0000000000, propagate_forward_time: 5.3411698341, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4599370956
validation[          , genome   465] predictions:    9256/  10000 (92.56%), best:    9262/10000 (92.62%), error:      2549.28784, best error:      2537.51294 on epoch:    88, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 70.4434432983s, input_fired_time: 0.6480583549, output_fired_time: 0.6170527935, propagate_forward_time: 25.9398975372, propagate_backward_time: 40.7678565979, weight_update_time: 0.1316376925, other_time: 2.4705848694
epoch time: 5.3576054573s, input_fired_time: 0.0809963942, output_fired_time: 0.0000000000, propagate_forward_time: 4.8274435997, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4491653442
validation[          , genome   465] predictions:    9257/  10000 (92.57%), best:    9262/10000 (92.62%), error:      2561.62085, best error:      2537.51294 on epoch:    88, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 71.1941680908s, input_fired_time: 0.6452559233, output_fired_time: 0.6193563938, propagate_forward_time: 26.3120193481, propagate_backward_time: 41.1367416382, weight_update_time: 0.1314847022, other_time: 2.4807968140
epoch time: 6.1145534515s, input_fired_time: 0.0893080011, output_fired_time: 0.0000000000, propagate_forward_time: 5.5472812653, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4779644012
validation[          , genome   465] predictions:    9259/  10000 (92.59%), best:    9262/10000 (92.62%), error:      2539.68896, best error:      2537.51294 on epoch:    88, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 70.0053100586s, input_fired_time: 0.6472413540, output_fired_time: 0.6140100956, propagate_forward_time: 25.7566356659, propagate_backward_time: 40.4866561890, weight_update_time: 0.1323027760, other_time: 2.5007629395
epoch time: 5.5206675529s, input_fired_time: 0.0819216669, output_fired_time: 0.0000000000, propagate_forward_time: 4.9911708832, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4475750923
validation[          , genome   465] predictions:    9246/  10000 (92.46%), best:    9262/10000 (92.62%), error:      2585.78394, best error:      2537.51294 on epoch:    88, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 68.5774917603s, input_fired_time: 0.6350635886, output_fired_time: 0.5962865353, propagate_forward_time: 25.2933483124, propagate_backward_time: 39.5899124146, weight_update_time: 0.1278702766, other_time: 2.4628829956
epoch time: 5.7400822639s, input_fired_time: 0.0862318799, output_fired_time: 0.0000000000, propagate_forward_time: 5.2001876831, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4536628723
validation[          , genome   465] predictions:    9242/  10000 (92.42%), best:    9262/10000 (92.62%), error:      2581.23413, best error:      2537.51294 on epoch:    88, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 70.7462844849s, input_fired_time: 0.6439599395, output_fired_time: 0.6165103912, propagate_forward_time: 26.1133403778, propagate_backward_time: 40.8897666931, weight_update_time: 0.1332664192, other_time: 2.4827079773
epoch time: 6.1554312706s, input_fired_time: 0.0902671590, output_fired_time: 0.0000000000, propagate_forward_time: 5.5841135979, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4810504913
validation[          , genome   465] predictions:    9233/  10000 (92.33%), best:    9262/10000 (92.62%), error:      2598.15234, best error:      2537.51294 on epoch:    88, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 29.2939071655s, input_fired_time: 0.4180019796, output_fired_time: 0.0000000000, propagate_forward_time: 26.5309715271, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3449344635
best training[          , genome   465] predictions:   46992/  50000 (93.98%), best:    9262/10000 (92.62%), error:     10836.89551, best error:      2537.51294 on epoch:    88, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 5.7725143433s, input_fired_time: 0.0824242532, output_fired_time: 0.0000000000, propagate_forward_time: 5.2464208603, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4436693192
   testing[          , genome   465] predictions:    9292/  10000 (92.92%), best:    9262/10000 (92.62%), error:      2465.35840, best error:      2537.51294 on epoch:    88, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
05:55:32 (36): called boinc_finish(0)

</stderr_txt>
]]>