Nameexact_genome_1512568488_45_7093_1
Workunit2606700
Created7 Dec 2017, 23:49:15 UTC
Sent7 Dec 2017, 23:52:36 UTC
Report deadline16 Dec 2017, 22:25:09 UTC
Received8 Dec 2017, 16:16:48 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID64142
Run time5 hours 24 min 1 sec
CPU time4 hours 25 min 5 sec
Validate stateValid
Credit2,234.82
Device peak FLOPS3.08 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size155.91 MB
Peak swap size158.98 MB
Peak disk usage2.20 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
000 (97.42%), error:       899.65662, best error:       887.61548 on epoch:    10, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 137.9145965576s, input_fired_time: 1.4642529488, output_fired_time: 1.2462037802, propagate_forward_time: 51.7232666016, propagate_backward_time: 80.5722198486, weight_update_time: 0.1579008549, other_time: 2.9086608887
epoch time: 13.1199960709s, input_fired_time: 0.3416698575, output_fired_time: 0.0000000000, propagate_forward_time: 12.1461801529, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6321458817
validation[          , genome  7093] predictions:    9720/  10000 (97.20%), best:    9742/10000 (97.42%), error:       972.18860, best error:       887.61548 on epoch:    10, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 139.0166778564s, input_fired_time: 1.4228296280, output_fired_time: 1.2550320625, propagate_forward_time: 52.3096580505, propagate_backward_time: 81.1490859985, weight_update_time: 0.1590149105, other_time: 2.8800582886
epoch time: 11.5146636963s, input_fired_time: 0.1783803850, output_fired_time: 0.0000000000, propagate_forward_time: 10.8220901489, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5141935349
validation[          , genome  7093] predictions:    9717/  10000 (97.17%), best:    9742/10000 (97.42%), error:       898.49255, best error:       887.61548 on epoch:    10, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 143.7918395996s, input_fired_time: 1.4415879250, output_fired_time: 1.3267177343, propagate_forward_time: 53.8664360046, propagate_backward_time: 84.2019348145, weight_update_time: 0.2079313397, other_time: 2.9551544189
epoch time: 10.2966909409s, input_fired_time: 0.1692897379, output_fired_time: 0.0000000000, propagate_forward_time: 9.6390810013, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4883203506
validation[          , genome  7093] predictions:    9730/  10000 (97.30%), best:    9742/10000 (97.42%), error:       904.69916, best error:       887.61548 on epoch:    10, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 142.9022674561s, input_fired_time: 1.5894166231, output_fired_time: 1.3067266941, propagate_forward_time: 53.5704116821, propagate_backward_time: 83.4864501953, weight_update_time: 0.1594629586, other_time: 2.9492568970
epoch time: 11.1718664169s, input_fired_time: 0.1778351068, output_fired_time: 0.0000000000, propagate_forward_time: 10.4819765091, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5120544434
validation[          , genome  7093] predictions:    9721/  10000 (97.21%), best:    9742/10000 (97.42%), error:       933.22589, best error:       887.61548 on epoch:    10, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 143.4334411621s, input_fired_time: 1.4673460722, output_fired_time: 1.3835309744, propagate_forward_time: 53.9318733215, propagate_backward_time: 83.6965789795, weight_update_time: 0.1575777680, other_time: 2.9541168213
epoch time: 11.3823423386s, input_fired_time: 0.1801729053, output_fired_time: 0.0000000000, propagate_forward_time: 10.6847209930, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5174484253
validation[          , genome  7093] predictions:    9638/  10000 (96.38%), best:    9742/10000 (97.42%), error:      1134.03955, best error:       887.61548 on epoch:    10, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 147.0077514648s, input_fired_time: 1.5376284122, output_fired_time: 1.2782489061, propagate_forward_time: 55.0860900879, propagate_backward_time: 86.0961685181, weight_update_time: 0.1611505002, other_time: 3.0096206665
epoch time: 10.6889610291s, input_fired_time: 0.1727621406, output_fired_time: 0.0000000000, propagate_forward_time: 9.9855976105, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5306015015
validation[          , genome  7093] predictions:    9745/  10000 (97.45%), best:    9742/10000 (97.42%), error:       894.92950, best error:       887.61548 on epoch:    10, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 145.3542480469s, input_fired_time: 1.4254009724, output_fired_time: 1.2582269907, propagate_forward_time: 54.4742698669, propagate_backward_time: 85.3192520142, weight_update_time: 0.1586453319, other_time: 2.8770980835
epoch time: 10.4788341522s, input_fired_time: 0.1703997999, output_fired_time: 0.0000000000, propagate_forward_time: 9.8157758713, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4926586151
validation[          , genome  7093] predictions:    9704/  10000 (97.04%), best:    9742/10000 (97.42%), error:       929.58508, best error:       887.61548 on epoch:    10, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 143.8134002686s, input_fired_time: 1.5364472866, output_fired_time: 1.2726771832, propagate_forward_time: 54.2353210449, propagate_backward_time: 83.9113464355, weight_update_time: 0.1610865444, other_time: 2.8576049805
epoch time: 13.1517429352s, input_fired_time: 0.2666694820, output_fired_time: 0.0000000000, propagate_forward_time: 12.2487373352, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6363363266
validation[          , genome  7093] predictions:    9728/  10000 (97.28%), best:    9742/10000 (97.42%), error:       892.02271, best error:       887.61548 on epoch:    10, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 147.0080718994s, input_fired_time: 1.6851210594, output_fired_time: 1.3333151340, propagate_forward_time: 55.1610260010, propagate_backward_time: 85.7619934082, weight_update_time: 0.1625871211, other_time: 3.0666198730
epoch time: 11.8645467758s, input_fired_time: 0.1699256152, output_fired_time: 0.0000000000, propagate_forward_time: 11.1568841934, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5377368927
validation[          , genome  7093] predictions:    9752/  10000 (97.52%), best:    9752/10000 (97.52%), error:       867.63214, best error:       867.63214 on epoch:    23, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 144.1455688477s, input_fired_time: 1.4214292765, output_fired_time: 1.3561794758, propagate_forward_time: 54.2597579956, propagate_backward_time: 84.1943206787, weight_update_time: 0.2047256976, other_time: 2.9138717651
epoch time: 11.9985733032s, input_fired_time: 0.1757394969, output_fired_time: 0.0000000000, propagate_forward_time: 11.3212776184, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5015563965
validation[          , genome  7093] predictions:    9745/  10000 (97.45%), best:    9752/10000 (97.52%), error:       901.34363, best error:       867.63214 on epoch:    23, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 138.4671936035s, input_fired_time: 1.4045609236, output_fired_time: 1.2665175200, propagate_forward_time: 51.8741531372, propagate_backward_time: 81.0452499390, weight_update_time: 0.1549947411, other_time: 2.8767242432
epoch time: 12.0700216293s, input_fired_time: 0.1755766571, output_fired_time: 0.0000000000, propagate_forward_time: 11.3129949570, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5814504623
validation[          , genome  7093] predictions:    9712/  10000 (97.12%), best:    9752/10000 (97.52%), error:       964.15289, best error:       867.63214 on epoch:    23, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 144.8507995605s, input_fired_time: 1.5602252483, output_fired_time: 1.3325057030, propagate_forward_time: 54.5848388672, propagate_backward_time: 84.4528884888, weight_update_time: 0.1595188230, other_time: 2.9203414917
epoch time: 10.6924152374s, input_fired_time: 0.1739193350, output_fired_time: 0.0000000000, propagate_forward_time: 10.0191488266, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4993467331
validation[          , genome  7093] predictions:    9723/  10000 (97.23%), best:    9752/10000 (97.52%), error:       916.16583, best error:       867.63214 on epoch:    23, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 144.7516784668s, input_fired_time: 1.5455226898, output_fired_time: 1.3747593164, propagate_forward_time: 54.6033592224, propagate_backward_time: 84.3072357178, weight_update_time: 0.1621063948, other_time: 2.9208068848
epoch time: 11.2101144791s, input_fired_time: 0.1742811948, output_fired_time: 0.0000000000, propagate_forward_time: 10.4597864151, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5760469437
validation[          , genome  7093] predictions:    9731/  10000 (97.31%), best:    9752/10000 (97.52%), error:       884.81757, best error:       867.63214 on epoch:    23, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 141.2549438477s, input_fired_time: 1.4646220207, output_fired_time: 1.2355221510, propagate_forward_time: 52.9079246521, propagate_backward_time: 82.8508682251, weight_update_time: 0.1564605683, other_time: 2.7960128784
epoch time: 11.7438125610s, input_fired_time: 0.1787300706, output_fired_time: 0.0000000000, propagate_forward_time: 10.9898490906, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5752334595
validation[          , genome  7093] predictions:    9719/  10000 (97.19%), best:    9752/10000 (97.52%), error:       901.57904, best error:       867.63214 on epoch:    23, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 144.2453613281s, input_fired_time: 1.4700801373, output_fired_time: 1.3235155344, propagate_forward_time: 54.3240165710, propagate_backward_time: 84.1812438965, weight_update_time: 0.1573535651, other_time: 2.9465026855
epoch time: 11.2951955795s, input_fired_time: 0.1820473969, output_fired_time: 0.0000000000, propagate_forward_time: 10.5949764252, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5181713104
validation[          , genome  7093] predictions:    9740/  10000 (97.40%), best:    9740/10000 (97.40%), error:       831.35760, best error:       831.35760 on epoch:    29, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 219.1395721436s, input_fired_time: 3.1108202934, output_fired_time: 1.7216531038, propagate_forward_time: 82.6630020142, propagate_backward_time: 126.8405609131, weight_update_time: 0.1780383885, other_time: 4.8035430908
epoch time: 18.8616046906s, input_fired_time: 0.1991643161, output_fired_time: 0.0000000000, propagate_forward_time: 18.0178146362, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6446266174
validation[          , genome  7093] predictions:    9768/  10000 (97.68%), best:    9768/10000 (97.68%), error:       796.12354, best error:       796.12354 on epoch:    30, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 227.8310852051s, input_fired_time: 1.9946382046, output_fired_time: 2.2415938377, propagate_forward_time: 87.1444091797, propagate_backward_time: 131.9246520996, weight_update_time: 0.4904207289, other_time: 4.5257873535
epoch time: 19.0756797791s, input_fired_time: 0.2447340190, output_fired_time: 0.0000000000, propagate_forward_time: 17.5183353424, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3126106262
validation[          , genome  7093] predictions:    9735/  10000 (97.35%), best:    9768/10000 (97.68%), error:       918.18549, best error:       796.12354 on epoch:    30, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 234.2043609619s, input_fired_time: 1.9249615669, output_fired_time: 2.4917049408, propagate_forward_time: 86.0827865601, propagate_backward_time: 138.7567138672, weight_update_time: 0.1782934964, other_time: 4.9482116699
epoch time: 21.2569637299s, input_fired_time: 0.1995831579, output_fired_time: 0.0000000000, propagate_forward_time: 20.3696899414, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6876907349
validation[          , genome  7093] predictions:    9692/  10000 (96.92%), best:    9768/10000 (97.68%), error:       993.49744, best error:       796.12354 on epoch:    30, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 244.0276794434s, input_fired_time: 2.9845585823, output_fired_time: 2.1174328327, propagate_forward_time: 90.3339996338, propagate_backward_time: 144.3957061768, weight_update_time: 0.1787208766, other_time: 4.1959838867
epoch time: 19.5418510437s, input_fired_time: 0.2004177570, output_fired_time: 0.0000000000, propagate_forward_time: 18.7328090668, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6086235046
validation[          , genome  7093] predictions:    9773/  10000 (97.73%), best:    9773/10000 (97.73%), error:       780.45227, best error:       780.45227 on epoch:    33, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 249.7482604980s, input_fired_time: 3.3789479733, output_fired_time: 2.6796598434, propagate_forward_time: 89.1348266602, propagate_backward_time: 150.1085662842, weight_update_time: 0.1784306318, other_time: 4.4462585449
epoch time: 22.1282081604s, input_fired_time: 0.2465531677, output_fired_time: 0.0000000000, propagate_forward_time: 21.1630077362, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7186470032
validation[          , genome  7093] predictions:    9681/  10000 (96.81%), best:    9773/10000 (97.73%), error:      1025.95520, best error:       780.45227 on epoch:    33, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 300.6463317871s, input_fired_time: 2.3842506409, output_fired_time: 2.6424260139, propagate_forward_time: 115.1294326782, propagate_backward_time: 174.7581634521, weight_update_time: 0.1799589843, other_time: 5.7320709229
epoch time: 20.3827362061s, input_fired_time: 0.3235037923, output_fired_time: 0.0000000000, propagate_forward_time: 19.3084259033, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7508068085
validation[          , genome  7093] predictions:    9760/  10000 (97.60%), best:    9773/10000 (97.73%), error:       800.03650, best error:       780.45227 on epoch:    33, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 208.1983642578s, input_fired_time: 1.9998624325, output_fired_time: 1.4275759459, propagate_forward_time: 78.8354187012, propagate_backward_time: 121.5608367920, weight_update_time: 0.1680021286, other_time: 4.3746643066
epoch time: 10.4341850281s, input_fired_time: 0.1721999347, output_fired_time: 0.0000000000, propagate_forward_time: 9.7703123093, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4916725159
validation[          , genome  7093] predictions:    9764/  10000 (97.64%), best:    9764/10000 (97.64%), error:       768.22308, best error:       768.22308 on epoch:    36, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 144.4883117676s, input_fired_time: 1.4957633018, output_fired_time: 1.3372133970, propagate_forward_time: 54.3149375916, propagate_backward_time: 84.4062347412, weight_update_time: 0.1622621715, other_time: 2.9341583252
epoch time: 12.0037832260s, input_fired_time: 0.1896010190, output_fired_time: 0.0000000000, propagate_forward_time: 11.2725410461, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5416412354
validation[          , genome  7093] predictions:    9761/  10000 (97.61%), best:    9764/10000 (97.64%), error:       813.62860, best error:       768.22308 on epoch:    36, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 148.3307952881s, input_fired_time: 1.7092189789, output_fired_time: 1.2891154289, propagate_forward_time: 55.6363449097, propagate_backward_time: 86.6308517456, weight_update_time: 0.1623562574, other_time: 3.0652770996
epoch time: 11.6310272217s, input_fired_time: 0.2641391456, output_fired_time: 0.0000000000, propagate_forward_time: 10.8800373077, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4868507385
validation[          , genome  7093] predictions:    9733/  10000 (97.33%), best:    9764/10000 (97.64%), error:       865.52228, best error:       768.22308 on epoch:    36, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 143.1457519531s, input_fired_time: 1.5184575319, output_fired_time: 1.3730096817, propagate_forward_time: 53.7040977478, propagate_backward_time: 83.5070343018, weight_update_time: 0.1617008895, other_time: 3.0431365967
epoch time: 13.3901748657s, input_fired_time: 0.2739614248, output_fired_time: 0.0000000000, propagate_forward_time: 12.4316110611, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6846027374
validation[          , genome  7093] predictions:    9772/  10000 (97.72%), best:    9772/10000 (97.72%), error:       709.39685, best error:       709.39685 on epoch:    39, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 206.3533630371s, input_fired_time: 2.3364815712, output_fired_time: 1.4257494211, propagate_forward_time: 77.9284439087, propagate_backward_time: 120.2992324829, weight_update_time: 0.1727940142, other_time: 4.3634490967
epoch time: 17.2292041779s, input_fired_time: 0.2018862069, output_fired_time: 0.0000000000, propagate_forward_time: 16.2125129700, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8148040771
validation[          , genome  7093] predictions:    9792/  10000 (97.92%), best:    9772/10000 (97.72%), error:       717.99042, best error:       709.39685 on epoch:    39, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 225.3407440186s, input_fired_time: 2.2226271629, output_fired_time: 1.8470950127, propagate_forward_time: 84.8362121582, propagate_backward_time: 132.3972167969, weight_update_time: 0.2563427091, other_time: 4.0375976563
epoch time: 17.9920444489s, input_fired_time: 0.1991084814, output_fired_time: 0.0000000000, propagate_forward_time: 16.9798088074, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8131275177
validation[          , genome  7093] predictions:    9738/  10000 (97.38%), best:    9772/10000 (97.72%), error:       849.01178, best error:       709.39685 on epoch:    39, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 226.4537200928s, input_fired_time: 2.1128485203, output_fired_time: 1.7235178947, propagate_forward_time: 84.8539810181, propagate_backward_time: 133.0986022949, weight_update_time: 0.1784761846, other_time: 4.6647644043
epoch time: 18.5740756989s, input_fired_time: 0.1995472610, output_fired_time: 0.0000000000, propagate_forward_time: 17.8122005463, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5623283386
validation[          , genome  7093] predictions:    9736/  10000 (97.36%), best:    9772/10000 (97.72%), error:       856.94012, best error:       709.39685 on epoch:    39, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 229.4757537842s, input_fired_time: 2.2378516197, output_fired_time: 2.0738689899, propagate_forward_time: 86.7110290527, propagate_backward_time: 133.5861206055, weight_update_time: 0.1783815175, other_time: 4.8668823242
epoch time: 19.7941875458s, input_fired_time: 0.1997152567, output_fired_time: 0.0000000000, propagate_forward_time: 18.6870765686, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9073963165
validation[          , genome  7093] predictions:    9727/  10000 (97.27%), best:    9772/10000 (97.72%), error:       863.55408, best error:       709.39685 on epoch:    39, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 220.2346038818s, input_fired_time: 1.6304576397, output_fired_time: 2.4268054962, propagate_forward_time: 82.7420425415, propagate_backward_time: 129.5682067871, weight_update_time: 0.1779918969, other_time: 3.8670959473
epoch time: 19.0352973938s, input_fired_time: 0.5130810738, output_fired_time: 0.0000000000, propagate_forward_time: 17.8511981964, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6710186005
validation[          , genome  7093] predictions:    9776/  10000 (97.76%), best:    9772/10000 (97.72%), error:       759.63403, best error:       709.39685 on epoch:    39, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 231.7107696533s, input_fired_time: 2.2301208973, output_fired_time: 2.2799565792, propagate_forward_time: 88.4030075073, propagate_backward_time: 134.1514129639, weight_update_time: 0.1779795736, other_time: 4.6462860107
epoch time: 18.2131500244s, input_fired_time: 0.2001699358, output_fired_time: 0.0000000000, propagate_forward_time: 17.4522132874, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5607662201
validation[          , genome  7093] predictions:    9751/  10000 (97.51%), best:    9772/10000 (97.72%), error:       812.75800, best error:       709.39685 on epoch:    39, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 226.8819732666s, input_fired_time: 1.8727020025, output_fired_time: 1.7700217962, propagate_forward_time: 86.6883468628, propagate_backward_time: 132.1678619385, weight_update_time: 0.6782794595, other_time: 4.3830413818
epoch time: 19.1816349030s, input_fired_time: 0.2012462020, output_fired_time: 0.0000000000, propagate_forward_time: 18.2773704529, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7030181885
validation[          , genome  7093] predictions:    9764/  10000 (97.64%), best:    9772/10000 (97.72%), error:       766.82861, best error:       709.39685 on epoch:    39, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 250.2483062744s, input_fired_time: 2.1830472946, output_fired_time: 2.0204637051, propagate_forward_time: 95.3382949829, propagate_backward_time: 145.6978149414, weight_update_time: 0.4439983666, other_time: 5.0086975098
epoch time: 17.9513416290s, input_fired_time: 0.4509686828, output_fired_time: 0.0000000000, propagate_forward_time: 16.9064998627, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5938739777
validation[          , genome  7093] predictions:    9769/  10000 (97.69%), best:    9772/10000 (97.72%), error:       782.04126, best error:       709.39685 on epoch:    39, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 217.1089172363s, input_fired_time: 2.5903923512, output_fired_time: 2.2562220097, propagate_forward_time: 82.5377120972, propagate_backward_time: 125.5778732300, weight_update_time: 0.1783666462, other_time: 4.1467056274
epoch time: 17.1101531982s, input_fired_time: 0.2016153336, output_fired_time: 0.0000000000, propagate_forward_time: 16.3457508087, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5627880096
validation[          , genome  7093] predictions:    9762/  10000 (97.62%), best:    9772/10000 (97.72%), error:       746.97919, best error:       709.39685 on epoch:    39, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 218.1102447510s, input_fired_time: 2.3223400116, output_fired_time: 1.4434481859, propagate_forward_time: 83.5940780640, propagate_backward_time: 126.5980758667, weight_update_time: 0.1785756052, other_time: 4.1522903442
epoch time: 18.3441352844s, input_fired_time: 0.4515339434, output_fired_time: 0.0000000000, propagate_forward_time: 17.2832851410, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6093158722
validation[          , genome  7093] predictions:    9733/  10000 (97.33%), best:    9772/10000 (97.72%), error:       840.61627, best error:       709.39685 on epoch:    39, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 220.0438537598s, input_fired_time: 2.1785030365, output_fired_time: 1.7555166483, propagate_forward_time: 82.4340896606, propagate_backward_time: 129.7926330566, weight_update_time: 0.4280176759, other_time: 3.8831176758
epoch time: 18.2284927368s, input_fired_time: 0.2244053334, output_fired_time: 0.0000000000, propagate_forward_time: 17.4092788696, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5948085785
validation[          , genome  7093] predictions:    9718/  10000 (97.18%), best:    9772/10000 (97.72%), error:       944.03369, best error:       709.39685 on epoch:    39, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 183.4038543701s, input_fired_time: 2.1474578381, output_fired_time: 1.6916695833, propagate_forward_time: 69.3577041626, propagate_backward_time: 106.8348388672, weight_update_time: 0.4230495989, other_time: 3.3721847534
epoch time: 11.4550333023s, input_fired_time: 0.1863441765, output_fired_time: 0.0000000000, propagate_forward_time: 10.7464885712, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5222005844
validation[          , genome  7093] predictions:    9727/  10000 (97.27%), best:    9772/10000 (97.72%), error:       902.95349, best error:       709.39685 on epoch:    39, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 141.8687591553s, input_fired_time: 1.4689357281, output_fired_time: 1.3279517889, propagate_forward_time: 53.3740234375, propagate_backward_time: 82.8324279785, weight_update_time: 0.1611617506, other_time: 2.8654174805
epoch time: 10.7300252914s, input_fired_time: 0.1780302078, output_fired_time: 0.0000000000, propagate_forward_time: 10.0500431061, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5019521713
validation[          , genome  7093] predictions:    9741/  10000 (97.41%), best:    9772/10000 (97.72%), error:       850.62726, best error:       709.39685 on epoch:    39, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 142.3274993896s, input_fired_time: 1.5012724400, output_fired_time: 1.2927529812, propagate_forward_time: 53.4597625732, propagate_backward_time: 83.1526565552, weight_update_time: 0.1616010219, other_time: 2.9210586548
epoch time: 14.5872735977s, input_fired_time: 0.2689540088, output_fired_time: 0.0000000000, propagate_forward_time: 13.7047872543, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6135320663
validation[          , genome  7093] predictions:    9716/  10000 (97.16%), best:    9772/10000 (97.72%), error:       963.03278, best error:       709.39685 on epoch:    39, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 152.0863952637s, input_fired_time: 1.5143227577, output_fired_time: 1.3769547939, propagate_forward_time: 57.5327529907, propagate_backward_time: 88.5753936768, weight_update_time: 0.1692023128, other_time: 3.0869674683
epoch time: 11.9428606033s, input_fired_time: 0.1948675662, output_fired_time: 0.0000000000, propagate_forward_time: 11.2112426758, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5367507935
validation[          , genome  7093] predictions:    9769/  10000 (97.69%), best:    9772/10000 (97.72%), error:       793.20410, best error:       709.39685 on epoch:    39, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 150.7889556885s, input_fired_time: 1.5091149807, output_fired_time: 1.3866442442, propagate_forward_time: 56.8172416687, propagate_backward_time: 88.0163192749, weight_update_time: 0.1686646491, other_time: 3.0596389771
epoch time: 12.4778146744s, input_fired_time: 0.1937713176, output_fired_time: 0.0000000000, propagate_forward_time: 11.6955890656, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5884542465
validation[          , genome  7093] predictions:    9701/  10000 (97.01%), best:    9772/10000 (97.72%), error:       993.03510, best error:       709.39685 on epoch:    39, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 143.7544708252s, input_fired_time: 1.5595653057, output_fired_time: 1.2797558308, propagate_forward_time: 54.0717124939, propagate_backward_time: 83.8519210815, weight_update_time: 0.1612815708, other_time: 2.9915084839
epoch time: 11.4351739883s, input_fired_time: 0.1863283068, output_fired_time: 0.0000000000, propagate_forward_time: 10.7278594971, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5209865570
validation[          , genome  7093] predictions:    9789/  10000 (97.89%), best:    9772/10000 (97.72%), error:       720.83502, best error:       709.39685 on epoch:    39, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 145.5846710205s, input_fired_time: 1.4726212025, output_fired_time: 1.2879040241, propagate_forward_time: 54.6650848389, propagate_backward_time: 85.1444015503, weight_update_time: 0.1628226936, other_time: 3.0146560669
epoch time: 11.8608770370s, input_fired_time: 0.1865576655, output_fired_time: 0.0000000000, propagate_forward_time: 11.1524963379, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5218229294
validation[          , genome  7093] predictions:    9781/  10000 (97.81%), best:    9772/10000 (97.72%), error:       721.48987, best error:       709.39685 on epoch:    39, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 150.5281524658s, input_fired_time: 1.5153304338, output_fired_time: 1.3474708796, propagate_forward_time: 56.7677459717, propagate_backward_time: 87.8917846680, weight_update_time: 0.1691865027, other_time: 3.0058135986
epoch time: 12.8044281006s, input_fired_time: 0.2784958184, output_fired_time: 0.0000000000, propagate_forward_time: 11.9678030014, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5581293106
validation[          , genome  7093] predictions:    9791/  10000 (97.91%), best:    9772/10000 (97.72%), error:       736.94495, best error:       709.39685 on epoch:    39, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 150.4980163574s, input_fired_time: 1.4999943972, output_fired_time: 1.4347964525, propagate_forward_time: 56.7396354675, propagate_backward_time: 87.6352539063, weight_update_time: 0.1666038930, other_time: 3.1883239746
epoch time: 12.2882156372s, input_fired_time: 0.1921396106, output_fired_time: 0.0000000000, propagate_forward_time: 11.5609416962, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5351343155
validation[          , genome  7093] predictions:    9787/  10000 (97.87%), best:    9772/10000 (97.72%), error:       756.91345, best error:       709.39685 on epoch:    39, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 151.0845031738s, input_fired_time: 1.4901514053, output_fired_time: 1.4663574696, propagate_forward_time: 57.0409393311, propagate_backward_time: 88.0585861206, weight_update_time: 0.1653274894, other_time: 3.0284652710
epoch time: 12.9052572250s, input_fired_time: 0.1925338358, output_fired_time: 0.0000000000, propagate_forward_time: 12.1278018951, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5849218369
validation[          , genome  7093] predictions:    9741/  10000 (97.41%), best:    9772/10000 (97.72%), error:       853.37903, best error:       709.39685 on epoch:    39, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 152.2428436279s, input_fired_time: 1.5119706392, output_fired_time: 1.2949231863, propagate_forward_time: 57.4370880127, propagate_backward_time: 88.9948425293, weight_update_time: 0.1641380489, other_time: 3.0040130615
epoch time: 13.3228216171s, input_fired_time: 0.2394101322, output_fired_time: 0.0000000000, propagate_forward_time: 12.5450248718, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5383863449
validation[          , genome  7093] predictions:    9748/  10000 (97.48%), best:    9772/10000 (97.72%), error:       807.82794, best error:       709.39685 on epoch:    39, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 150.2736968994s, input_fired_time: 1.6494358778, output_fired_time: 1.3959805965, propagate_forward_time: 56.5092506409, propagate_backward_time: 87.6909790039, weight_update_time: 0.1652066857, other_time: 3.0280609131
epoch time: 11.2426185608s, input_fired_time: 0.1803752035, output_fired_time: 0.0000000000, propagate_forward_time: 10.5592775345, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5029659271
validation[          , genome  7093] predictions:    9745/  10000 (97.45%), best:    9772/10000 (97.72%), error:       842.46118, best error:       709.39685 on epoch:    39, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 148.4869842529s, input_fired_time: 1.5875713825, output_fired_time: 1.3069491386, propagate_forward_time: 55.9753189087, propagate_backward_time: 86.7007675171, weight_update_time: 0.1652327180, other_time: 2.9163818359
epoch time: 13.3214683533s, input_fired_time: 0.2739429772, output_fired_time: 0.0000000000, propagate_forward_time: 12.5056266785, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5418987274
validation[          , genome  7093] predictions:    9779/  10000 (97.79%), best:    9772/10000 (97.72%), error:       740.31763, best error:       709.39685 on epoch:    39, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 148.3782501221s, input_fired_time: 1.6607484818, output_fired_time: 1.3010178804, propagate_forward_time: 55.8714408875, propagate_backward_time: 86.5731277466, weight_update_time: 0.1693708152, other_time: 2.9719009399
epoch time: 11.7465000153s, input_fired_time: 0.1863436252, output_fired_time: 0.0000000000, propagate_forward_time: 10.9924440384, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5677127838
validation[          , genome  7093] predictions:    9773/  10000 (97.73%), best:    9773/10000 (97.73%), error:       706.12384, best error:       706.12384 on epoch:    64, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 150.2361602783s, input_fired_time: 1.5438177586, output_fired_time: 1.3872774839, propagate_forward_time: 56.7251548767, propagate_backward_time: 87.4788665771, weight_update_time: 0.1657426655, other_time: 3.1010284424
epoch time: 12.6984548569s, input_fired_time: 0.2341236919, output_fired_time: 0.0000000000, propagate_forward_time: 11.9415760040, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5227556229
validation[          , genome  7093] predictions:    9764/  10000 (97.64%), best:    9773/10000 (97.73%), error:       774.13403, best error:       706.12384 on epoch:    64, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 148.6242370605s, input_fired_time: 1.5498189926, output_fired_time: 1.3045636415, propagate_forward_time: 56.0027770996, propagate_backward_time: 86.7912750244, weight_update_time: 0.1638436764, other_time: 2.9757995605
epoch time: 11.1497497559s, input_fired_time: 0.1845449507, output_fired_time: 0.0000000000, propagate_forward_time: 10.4504203796, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5147848129
validation[          , genome  7093] predictions:    9770/  10000 (97.70%), best:    9773/10000 (97.73%), error:       762.25323, best error:       706.12384 on epoch:    64, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 145.8711395264s, input_fired_time: 1.4705841541, output_fired_time: 1.4349495173, propagate_forward_time: 54.7970809937, propagate_backward_time: 85.1494369507, weight_update_time: 0.1609585583, other_time: 3.0190887451
epoch time: 11.6809635162s, input_fired_time: 0.1904668212, output_fired_time: 0.0000000000, propagate_forward_time: 10.9621744156, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5283222198
validation[          , genome  7093] predictions:    9763/  10000 (97.63%), best:    9773/10000 (97.73%), error:       776.33832, best error:       706.12384 on epoch:    64, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 150.5782775879s, input_fired_time: 1.4591243267, output_fired_time: 1.4174455404, propagate_forward_time: 56.7570075989, propagate_backward_time: 87.8496322632, weight_update_time: 0.1591838449, other_time: 3.0950698853
epoch time: 12.2574615479s, input_fired_time: 0.1916900873, output_fired_time: 0.0000000000, propagate_forward_time: 11.5316114426, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5341596603
validation[          , genome  7093] predictions:    9653/  10000 (96.53%), best:    9773/10000 (97.73%), error:      1140.41541, best error:       706.12384 on epoch:    64, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 142.4581604004s, input_fired_time: 1.4616405964, output_fired_time: 1.4456154108, propagate_forward_time: 53.6102561951, propagate_backward_time: 83.0926513672, weight_update_time: 0.1600123793, other_time: 2.8479919434
epoch time: 12.7271041870s, input_fired_time: 0.2437335998, output_fired_time: 0.0000000000, propagate_forward_time: 11.9765415192, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5068292618
validation[          , genome  7093] predictions:    9786/  10000 (97.86%), best:    9773/10000 (97.73%), error:       751.06659, best error:       706.12384 on epoch:    64, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 147.1754455566s, input_fired_time: 1.4644521475, output_fired_time: 1.2627747059, propagate_forward_time: 55.7069549561, propagate_backward_time: 85.6215667725, weight_update_time: 0.1595090032, other_time: 3.1197052002
epoch time: 11.1169385910s, input_fired_time: 0.1844840348, output_fired_time: 0.0000000000, propagate_forward_time: 10.4219112396, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5105428696
validation[          , genome  7093] predictions:    9784/  10000 (97.84%), best:    9773/10000 (97.73%), error:       751.43140, best error:       706.12384 on epoch:    64, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 233.4586486816s, input_fired_time: 2.6272501945, output_fired_time: 2.3825592995, propagate_forward_time: 88.4410324097, propagate_backward_time: 135.5535125732, weight_update_time: 0.1769601554, other_time: 4.4542999268
epoch time: 18.8760299683s, input_fired_time: 0.2030668557, output_fired_time: 0.0000000000, propagate_forward_time: 17.5333099365, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1396522522
validation[          , genome  7093] predictions:    9712/  10000 (97.12%), best:    9773/10000 (97.73%), error:       882.02362, best error:       706.12384 on epoch:    64, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 244.2519531250s, input_fired_time: 3.4300494194, output_fired_time: 2.0165433884, propagate_forward_time: 93.0048294067, propagate_backward_time: 140.3259429932, weight_update_time: 0.4284480512, other_time: 5.4745941162
epoch time: 20.0375118256s, input_fired_time: 0.3437240720, output_fired_time: 0.0000000000, propagate_forward_time: 19.1301345825, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5636539459
validation[          , genome  7093] predictions:    9785/  10000 (97.85%), best:    9773/10000 (97.73%), error:       726.75006, best error:       706.12384 on epoch:    64, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 256.9706115723s, input_fired_time: 2.3007485867, output_fired_time: 1.9063922167, propagate_forward_time: 100.6494827271, propagate_backward_time: 146.8058776855, weight_update_time: 0.3029441237, other_time: 5.3081054688
epoch time: 18.1862602234s, input_fired_time: 0.2042096257, output_fired_time: 0.0000000000, propagate_forward_time: 17.1712207794, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8108291626
validation[          , genome  7093] predictions:    9752/  10000 (97.52%), best:    9773/10000 (97.73%), error:       776.41284, best error:       706.12384 on epoch:    64, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 302.4295349121s, input_fired_time: 2.5647027493, output_fired_time: 2.4895670414, propagate_forward_time: 117.2233810425, propagate_backward_time: 173.4534912109, weight_update_time: 0.3031001687, other_time: 6.6983947754
epoch time: 22.6106586456s, input_fired_time: 0.2053847015, output_fired_time: 0.0000000000, propagate_forward_time: 21.4671630859, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9381103516
validation[          , genome  7093] predictions:    9705/  10000 (97.05%), best:    9773/10000 (97.73%), error:       970.12952, best error:       706.12384 on epoch:    64, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 315.3941650391s, input_fired_time: 3.6558752060, output_fired_time: 3.2247133255, propagate_forward_time: 116.9923019409, propagate_backward_time: 184.6978454590, weight_update_time: 0.4278521538, other_time: 6.8234252930
epoch time: 27.9031505585s, input_fired_time: 0.2035097033, output_fired_time: 0.0000000000, propagate_forward_time: 26.0264606476, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6731796265
validation[          , genome  7093] predictions:    9782/  10000 (97.82%), best:    9773/10000 (97.73%), error:       733.24390, best error:       706.12384 on epoch:    64, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 323.6942443848s, input_fired_time: 2.7769696712, output_fired_time: 2.3554406166, propagate_forward_time: 124.6878814697, propagate_backward_time: 187.8530120850, weight_update_time: 0.1780138761, other_time: 6.0209350586
epoch time: 23.9616489410s, input_fired_time: 0.8278241158, output_fired_time: 0.0000000000, propagate_forward_time: 22.2121429443, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9216823578
validation[          , genome  7093] predictions:    9724/  10000 (97.24%), best:    9773/10000 (97.73%), error:       904.06244, best error:       706.12384 on epoch:    64, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 243.6854553223s, input_fired_time: 3.1815207005, output_fired_time: 2.0186645985, propagate_forward_time: 93.1762771606, propagate_backward_time: 140.3777465820, weight_update_time: 0.4284826219, other_time: 4.9312438965
epoch time: 18.6269359589s, input_fired_time: 0.4071858525, output_fired_time: 0.0000000000, propagate_forward_time: 17.6596832275, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5600662231
validation[          , genome  7093] predictions:    9677/  10000 (96.77%), best:    9773/10000 (97.73%), error:      1102.91187, best error:       706.12384 on epoch:    64, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 228.9470214844s, input_fired_time: 1.9480640888, output_fired_time: 1.6841255426, propagate_forward_time: 87.3963394165, propagate_backward_time: 132.9765167236, weight_update_time: 0.3030207753, other_time: 4.9419708252
epoch time: 19.5430736542s, input_fired_time: 0.3134987056, output_fired_time: 0.0000000000, propagate_forward_time: 18.4186458588, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8109283447
validation[          , genome  7093] predictions:    9768/  10000 (97.68%), best:    9773/10000 (97.73%), error:       784.27710, best error:       706.12384 on epoch:    64, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 226.9840850830s, input_fired_time: 2.1386294365, output_fired_time: 1.6963932514, propagate_forward_time: 85.9131851196, propagate_backward_time: 132.7568511963, weight_update_time: 0.8292422891, other_time: 4.4790191650
epoch time: 11.7343883514s, input_fired_time: 0.1885519028, output_fired_time: 0.0000000000, propagate_forward_time: 11.0137805939, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5320558548
validation[          , genome  7093] predictions:    9771/  10000 (97.71%), best:    9773/10000 (97.73%), error:       735.48163, best error:       706.12384 on epoch:    64, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 153.7088470459s, input_fired_time: 1.5088307858, output_fired_time: 1.3126629591, propagate_forward_time: 58.2875633240, propagate_backward_time: 89.6575622559, weight_update_time: 0.1663703918, other_time: 2.9422149658
epoch time: 12.4714174271s, input_fired_time: 0.1996358484, output_fired_time: 0.0000000000, propagate_forward_time: 11.7214479446, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5503339767
validation[          , genome  7093] predictions:    9729/  10000 (97.29%), best:    9773/10000 (97.73%), error:       887.18292, best error:       706.12384 on epoch:    64, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 147.4779052734s, input_fired_time: 1.5074111223, output_fired_time: 1.3175894022, propagate_forward_time: 55.7221069336, propagate_backward_time: 85.8557128906, weight_update_time: 0.1661994010, other_time: 3.0750732422
epoch time: 12.3102245331s, input_fired_time: 0.1808759123, output_fired_time: 0.0000000000, propagate_forward_time: 11.3988971710, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7304515839
validation[          , genome  7093] predictions:    9717/  10000 (97.17%), best:    9773/10000 (97.73%), error:       922.82349, best error:       706.12384 on epoch:    64, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 156.4381561279s, input_fired_time: 1.5236350298, output_fired_time: 1.4992184639, propagate_forward_time: 59.5501213074, propagate_backward_time: 90.7472152710, weight_update_time: 0.1707475930, other_time: 3.1179580688
epoch time: 11.2712545395s, input_fired_time: 0.1847876310, output_fired_time: 0.0000000000, propagate_forward_time: 10.5700025558, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5164642334
validation[          , genome  7093] predictions:    9748/  10000 (97.48%), best:    9773/10000 (97.73%), error:       779.02234, best error:       706.12384 on epoch:    64, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 152.0915679932s, input_fired_time: 1.6278232336, output_fired_time: 1.3414075375, propagate_forward_time: 57.6220283508, propagate_backward_time: 88.6217269897, weight_update_time: 0.1623301655, other_time: 2.8785934448
epoch time: 11.5499582291s, input_fired_time: 0.1846791059, output_fired_time: 0.0000000000, propagate_forward_time: 10.8488159180, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5164632797
validation[          , genome  7093] predictions:    9729/  10000 (97.29%), best:    9773/10000 (97.73%), error:       886.43097, best error:       706.12384 on epoch:    64, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 145.5554962158s, input_fired_time: 1.4660930634, output_fired_time: 1.2745295763, propagate_forward_time: 54.4565925598, propagate_backward_time: 85.5001449585, weight_update_time: 0.1611203551, other_time: 2.8581314087
epoch time: 12.3590431213s, input_fired_time: 0.1808882207, output_fired_time: 0.0000000000, propagate_forward_time: 11.6713438034, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5068111420
validation[          , genome  7093] predictions:    9776/  10000 (97.76%), best:    9773/10000 (97.73%), error:       760.40668, best error:       706.12384 on epoch:    64, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 147.0494995117s, input_fired_time: 1.4775853157, output_fired_time: 1.2915046215, propagate_forward_time: 54.9582366943, propagate_backward_time: 86.4371414185, weight_update_time: 0.1625580192, other_time: 2.8850326538
epoch time: 11.1909523010s, input_fired_time: 0.1795370281, output_fired_time: 0.0000000000, propagate_forward_time: 10.5040855408, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5073299408
validation[          , genome  7093] predictions:    9787/  10000 (97.87%), best:    9773/10000 (97.73%), error:       760.82861, best error:       706.12384 on epoch:    64, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 151.0563354492s, input_fired_time: 1.6329619884, output_fired_time: 1.2987514734, propagate_forward_time: 57.0914459229, propagate_backward_time: 87.9981765747, weight_update_time: 0.1644201875, other_time: 3.0349960327
epoch time: 13.5528707504s, input_fired_time: 0.1962514669, output_fired_time: 0.0000000000, propagate_forward_time: 12.8162555695, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5403633118
validation[          , genome  7093] predictions:    9778/  10000 (97.78%), best:    9773/10000 (97.73%), error:       722.97766, best error:       706.12384 on epoch:    64, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 140.4119110107s, input_fired_time: 1.4366782904, output_fired_time: 1.2269504070, propagate_forward_time: 52.8004112244, propagate_backward_time: 82.1779937744, weight_update_time: 0.1545559466, other_time: 2.7698822021
epoch time: 11.7011880875s, input_fired_time: 0.1843437552, output_fired_time: 0.0000000000, propagate_forward_time: 11.0049457550, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5118989944
validation[          , genome  7093] predictions:    9776/  10000 (97.76%), best:    9773/10000 (97.73%), error:       744.92383, best error:       706.12384 on epoch:    64, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 145.4429473877s, input_fired_time: 1.6197899580, output_fired_time: 1.4039055109, propagate_forward_time: 54.7649688721, propagate_backward_time: 84.7513351440, weight_update_time: 0.1634258479, other_time: 2.9029464722
epoch time: 11.4879980087s, input_fired_time: 0.1749463081, output_fired_time: 0.0000000000, propagate_forward_time: 10.8250904083, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4879608154
validation[          , genome  7093] predictions:    9778/  10000 (97.78%), best:    9773/10000 (97.73%), error:       739.86047, best error:       706.12384 on epoch:    64, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 149.2956542969s, input_fired_time: 1.5721884966, output_fired_time: 1.2707922459, propagate_forward_time: 56.6788444519, propagate_backward_time: 86.7371368408, weight_update_time: 0.1584337950, other_time: 3.0366821289
epoch time: 11.5046577454s, input_fired_time: 0.2880064845, output_fired_time: 0.0000000000, propagate_forward_time: 10.7243871689, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4922637939
validation[          , genome  7093] predictions:    9741/  10000 (97.41%), best:    9773/10000 (97.73%), error:       850.72443, best error:       706.12384 on epoch:    64, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 143.4049987793s, input_fired_time: 1.4843031168, output_fired_time: 1.3900332451, propagate_forward_time: 53.9240150452, propagate_backward_time: 83.6317291260, weight_update_time: 0.1609375328, other_time: 2.9749298096
epoch time: 13.3028097153s, input_fired_time: 0.2759966552, output_fired_time: 0.0000000000, propagate_forward_time: 12.2977151871, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7290983200
validation[          , genome  7093] predictions:    9779/  10000 (97.79%), best:    9773/10000 (97.73%), error:       744.79254, best error:       706.12384 on epoch:    64, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 146.6157684326s, input_fired_time: 1.7947340012, output_fired_time: 1.3616789579, propagate_forward_time: 55.2525291443, propagate_backward_time: 85.2392196655, weight_update_time: 0.1606180370, other_time: 2.9675979614
epoch time: 10.8338155746s, input_fired_time: 0.1833104491, output_fired_time: 0.0000000000, propagate_forward_time: 10.1457481384, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5047569275
validation[          , genome  7093] predictions:    9749/  10000 (97.49%), best:    9773/10000 (97.73%), error:       813.92596, best error:       706.12384 on epoch:    64, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 142.7212677002s, input_fired_time: 1.4848138094, output_fired_time: 1.3475776911, propagate_forward_time: 53.5070800781, propagate_backward_time: 83.4079895020, weight_update_time: 0.1601403207, other_time: 2.9738006592
epoch time: 12.6665897369s, input_fired_time: 0.2896534801, output_fired_time: 0.0000000000, propagate_forward_time: 11.8425416946, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5343942642
validation[          , genome  7093] predictions:    9754/  10000 (97.54%), best:    9773/10000 (97.73%), error:       826.72809, best error:       706.12384 on epoch:    64, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 144.8791961670s, input_fired_time: 1.4983582497, output_fired_time: 1.3776872158, propagate_forward_time: 54.3996238708, propagate_backward_time: 84.6359252930, weight_update_time: 0.2554155588, other_time: 2.9676055908
epoch time: 10.8005561829s, input_fired_time: 0.1788063943, output_fired_time: 0.0000000000, propagate_forward_time: 10.0484895706, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5732603073
validation[          , genome  7093] predictions:    9762/  10000 (97.62%), best:    9773/10000 (97.73%), error:       822.83130, best error:       706.12384 on epoch:    64, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 142.5244903564s, input_fired_time: 1.4724326134, output_fired_time: 1.3533496857, propagate_forward_time: 53.8224143982, propagate_backward_time: 83.0417938232, weight_update_time: 0.1585781723, other_time: 2.8345031738
epoch time: 11.3867607117s, input_fired_time: 0.1867639720, output_fired_time: 0.0000000000, propagate_forward_time: 10.6868019104, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5131950378
validation[          , genome  7093] predictions:    9778/  10000 (97.78%), best:    9773/10000 (97.73%), error:       755.88873, best error:       706.12384 on epoch:    64, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 144.4980621338s, input_fired_time: 1.5447512865, output_fired_time: 1.2273629904, propagate_forward_time: 53.5092773438, propagate_backward_time: 85.1999588013, weight_update_time: 0.1555011123, other_time: 3.0167160034
epoch time: 11.8363170624s, input_fired_time: 0.1898145527, output_fired_time: 0.0000000000, propagate_forward_time: 11.1285715103, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5179309845
validation[          , genome  7093] predictions:    9781/  10000 (97.81%), best:    9773/10000 (97.73%), error:       790.75238, best error:       706.12384 on epoch:    64, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 143.9538726807s, input_fired_time: 1.5845869780, output_fired_time: 1.2499608994, propagate_forward_time: 53.7347564697, propagate_backward_time: 84.4714813232, weight_update_time: 0.1578568369, other_time: 2.9131011963
epoch time: 13.4400396347s, input_fired_time: 0.2861436307, output_fired_time: 0.0000000000, propagate_forward_time: 12.6648626328, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4890336990
validation[          , genome  7093] predictions:    9743/  10000 (97.43%), best:    9773/10000 (97.73%), error:       862.56177, best error:       706.12384 on epoch:    64, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 143.3571166992s, input_fired_time: 1.5619902611, output_fired_time: 1.3340926170, propagate_forward_time: 53.9100456238, propagate_backward_time: 83.6115188599, weight_update_time: 0.1580099016, other_time: 2.9394607544
epoch time: 13.9053058624s, input_fired_time: 0.2936410010, output_fired_time: 0.0000000000, propagate_forward_time: 12.9983177185, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6133470535
validation[          , genome  7093] predictions:    9767/  10000 (97.67%), best:    9773/10000 (97.73%), error:       802.97491, best error:       706.12384 on epoch:    64, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 145.3433074951s, input_fired_time: 1.4729866982, output_fired_time: 1.3365896940, propagate_forward_time: 54.1089859009, propagate_backward_time: 85.3944015503, weight_update_time: 0.1575977653, other_time: 3.0303344727
epoch time: 11.5678052902s, input_fired_time: 0.1897182763, output_fired_time: 0.0000000000, propagate_forward_time: 10.8612747192, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5168123245
validation[          , genome  7093] predictions:    9737/  10000 (97.37%), best:    9773/10000 (97.73%), error:       823.89215, best error:       706.12384 on epoch:    64, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 148.1908569336s, input_fired_time: 1.5807455778, output_fired_time: 1.3597894907, propagate_forward_time: 55.6988716125, propagate_backward_time: 86.3755264282, weight_update_time: 0.1595443636, other_time: 3.1759262085
epoch time: 12.3357772827s, input_fired_time: 0.1795277894, output_fired_time: 0.0000000000, propagate_forward_time: 11.6603355408, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4959135056
validation[          , genome  7093] predictions:    9770/  10000 (97.70%), best:    9773/10000 (97.73%), error:       726.97479, best error:       706.12384 on epoch:    64, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 145.9406738281s, input_fired_time: 1.4918525219, output_fired_time: 1.2728421688, propagate_forward_time: 55.0487289429, propagate_backward_time: 85.1365585327, weight_update_time: 0.1615447253, other_time: 2.9906921387
epoch time: 11.0923910141s, input_fired_time: 0.1812194139, output_fired_time: 0.0000000000, propagate_forward_time: 10.4104604721, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5007114410
validation[          , genome  7093] predictions:    9775/  10000 (97.75%), best:    9773/10000 (97.73%), error:       762.80774, best error:       706.12384 on epoch:    64, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 58.5782699585s, input_fired_time: 1.0061291456, output_fired_time: 0.0000000000, propagate_forward_time: 54.7919158936, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7802238464
best training[          , genome  7093] predictions:   49672/  50000 (99.34%), best:    9773/10000 (97.73%), error:      1410.58423, best error:       706.12384 on epoch:    64, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 11.0432634354s, input_fired_time: 0.2539599538, output_fired_time: 0.0000000000, propagate_forward_time: 10.2920875549, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4972162247
   testing[          , genome  7093] predictions:    9802/  10000 (98.02%), best:    9773/10000 (97.73%), error:       657.23676, best error:       706.12384 on epoch:    64, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
16:21:52 (10148): called boinc_finish(0)

</stderr_txt>
]]>