Nameexact_genome_1512568488_43_3427_1
Workunit2588453
Created7 Dec 2017, 4:47:27 UTC
Sent7 Dec 2017, 4:53:54 UTC
Report deadline13 Dec 2017, 11:41:42 UTC
Received7 Dec 2017, 16:27:02 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID55108
Run time3 hours 35 min 16 sec
CPU time3 hours 29 min 27 sec
Validate stateValid
Credit1,570.80
Device peak FLOPS2.57 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size154.29 MB
Peak swap size157.53 MB
Peak disk usage1.88 MB

Stderr output

<core_client_version>7.8.2</core_client_version>
<![CDATA[
<stderr_txt>
update_time: 0.0000000000, other_time: 0.5860919952
validation[          , genome  3427] predictions:    9616/  10000 (96.16%), best:    9690/10000 (96.90%), error:      1249.84070, best error:      1117.44263 on epoch:    12, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 134.6523437500s, input_fired_time: 1.4722068310, output_fired_time: 2.2748293877, propagate_forward_time: 50.5419616699, propagate_backward_time: 76.7283630371, weight_update_time: 0.1777522713, other_time: 3.6349792480
epoch time: 10.5841541290s, input_fired_time: 0.1647802591, output_fired_time: 0.0000000000, propagate_forward_time: 9.8281183243, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5912551880
validation[          , genome  3427] predictions:    9640/  10000 (96.40%), best:    9690/10000 (96.90%), error:      1213.12061, best error:      1117.44263 on epoch:    12, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 134.3272399902s, input_fired_time: 1.4275658131, output_fired_time: 1.2785460949, propagate_forward_time: 51.4145240784, propagate_backward_time: 76.6381759644, weight_update_time: 0.1819327772, other_time: 3.5684280396
epoch time: 13.7706222534s, input_fired_time: 0.1953365803, output_fired_time: 0.0000000000, propagate_forward_time: 12.7774887085, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7977972031
validation[          , genome  3427] predictions:    9639/  10000 (96.39%), best:    9690/10000 (96.90%), error:      1185.29858, best error:      1117.44263 on epoch:    12, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 118.7195892334s, input_fired_time: 1.2960475683, output_fired_time: 1.1688983440, propagate_forward_time: 45.8063697815, propagate_backward_time: 67.1966629028, weight_update_time: 0.1611625999, other_time: 3.2516098022
epoch time: 10.3969678879s, input_fired_time: 0.1610877067, output_fired_time: 0.0000000000, propagate_forward_time: 9.6608018875, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5750780106
validation[          , genome  3427] predictions:    9682/  10000 (96.82%), best:    9682/10000 (96.82%), error:      1113.23499, best error:      1113.23499 on epoch:    17, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 119.6494674683s, input_fired_time: 1.2817597389, output_fired_time: 1.1569821835, propagate_forward_time: 47.6639747620, propagate_backward_time: 66.3292846680, weight_update_time: 0.1627088934, other_time: 3.2174682617
epoch time: 9.2649192810s, input_fired_time: 0.1608848870, output_fired_time: 0.0000000000, propagate_forward_time: 8.5213098526, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5827245712
validation[          , genome  3427] predictions:    9610/  10000 (96.10%), best:    9682/10000 (96.82%), error:      1249.29077, best error:      1113.23499 on epoch:    17, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 123.9262084961s, input_fired_time: 1.3379020691, output_fired_time: 2.2057585716, propagate_forward_time: 45.5414352417, propagate_backward_time: 71.5566329956, weight_update_time: 0.1715879589, other_time: 3.2844772339
epoch time: 9.3754453659s, input_fired_time: 0.1609186083, output_fired_time: 0.0000000000, propagate_forward_time: 8.6353797913, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5791473389
validation[          , genome  3427] predictions:    9625/  10000 (96.25%), best:    9682/10000 (96.82%), error:      1223.60559, best error:      1113.23499 on epoch:    17, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 120.7450103760s, input_fired_time: 1.2978396416, output_fired_time: 2.1865901947, propagate_forward_time: 46.4556922913, propagate_backward_time: 67.4502334595, weight_update_time: 0.1642795056, other_time: 3.3546524048
epoch time: 10.4513978958s, input_fired_time: 0.1621990055, output_fired_time: 0.0000000000, propagate_forward_time: 9.7062587738, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5829401016
validation[          , genome  3427] predictions:    9587/  10000 (95.87%), best:    9682/10000 (96.82%), error:      1362.44067, best error:      1113.23499 on epoch:    17, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 120.3193511963s, input_fired_time: 1.2845900059, output_fired_time: 1.1727316380, propagate_forward_time: 47.1851654053, propagate_backward_time: 66.9501113892, weight_update_time: 0.1618873179, other_time: 3.7267532349
epoch time: 8.9651584625s, input_fired_time: 0.1566171050, output_fired_time: 0.0000000000, propagate_forward_time: 8.2615709305, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5469703674
validation[          , genome  3427] predictions:    9498/  10000 (94.98%), best:    9682/10000 (96.82%), error:      1552.30701, best error:      1113.23499 on epoch:    17, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 119.7682495117s, input_fired_time: 1.2927738428, output_fired_time: 1.1529537439, propagate_forward_time: 46.8183441162, propagate_backward_time: 67.2857055664, weight_update_time: 0.1614596844, other_time: 3.2184753418
epoch time: 10.4941005707s, input_fired_time: 0.1639597416, output_fired_time: 0.0000000000, propagate_forward_time: 9.7451286316, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5850124359
validation[          , genome  3427] predictions:    9671/  10000 (96.71%), best:    9671/10000 (96.71%), error:      1085.94739, best error:      1085.94739 on epoch:    22, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 130.1828155518s, input_fired_time: 1.3875519037, output_fired_time: 1.2852385044, propagate_forward_time: 47.7447967529, propagate_backward_time: 76.2793579102, weight_update_time: 0.1853326410, other_time: 3.4858627319
epoch time: 10.2049026489s, input_fired_time: 0.1596617699, output_fired_time: 0.0000000000, propagate_forward_time: 9.4724378586, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5728025436
validation[          , genome  3427] predictions:    9645/  10000 (96.45%), best:    9671/10000 (96.71%), error:      1166.84790, best error:      1085.94739 on epoch:    22, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 120.2460174561s, input_fired_time: 1.2822057009, output_fired_time: 1.1613339186, propagate_forward_time: 42.9066734314, propagate_backward_time: 71.6772842407, weight_update_time: 0.1628310680, other_time: 3.2185287476
epoch time: 9.0506353378s, input_fired_time: 0.1578754932, output_fired_time: 0.0000000000, propagate_forward_time: 8.3249187469, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5678415298
validation[          , genome  3427] predictions:    9636/  10000 (96.36%), best:    9671/10000 (96.71%), error:      1205.30945, best error:      1085.94739 on epoch:    22, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 119.9933166504s, input_fired_time: 1.2853707075, output_fired_time: 1.1604024172, propagate_forward_time: 44.8967094421, propagate_backward_time: 69.4237289429, weight_update_time: 0.1623844057, other_time: 3.2271041870
epoch time: 11.9359626770s, input_fired_time: 0.1699453741, output_fired_time: 0.0000000000, propagate_forward_time: 11.1124744415, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6535425186
validation[          , genome  3427] predictions:    9695/  10000 (96.95%), best:    9695/10000 (96.95%), error:      1047.22217, best error:      1047.22217 on epoch:    25, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 122.2429733276s, input_fired_time: 1.3364703655, output_fired_time: 2.1722931862, propagate_forward_time: 45.8621444702, propagate_backward_time: 69.6356964111, weight_update_time: 0.1621986032, other_time: 3.2363662720
epoch time: 12.3047761917s, input_fired_time: 0.1811266989, output_fired_time: 0.0000000000, propagate_forward_time: 11.4268865585, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6967630386
validation[          , genome  3427] predictions:    9625/  10000 (96.25%), best:    9695/10000 (96.95%), error:      1226.31433, best error:      1047.22217 on epoch:    25, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 122.7461166382s, input_fired_time: 2.3150403500, output_fired_time: 1.1910183430, propagate_forward_time: 44.8962516785, propagate_backward_time: 71.0784683228, weight_update_time: 0.1712060273, other_time: 3.2653427124
epoch time: 9.2156333923s, input_fired_time: 0.1584340334, output_fired_time: 0.0000000000, propagate_forward_time: 8.4981307983, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5590686798
validation[          , genome  3427] predictions:    9608/  10000 (96.08%), best:    9695/10000 (96.95%), error:      1249.10400, best error:      1047.22217 on epoch:    25, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 124.4671020508s, input_fired_time: 1.2997028828, output_fired_time: 1.1844699383, propagate_forward_time: 45.1965141296, propagate_backward_time: 71.4875411987, weight_update_time: 0.1633270085, other_time: 5.2988662720
epoch time: 9.3022127151s, input_fired_time: 0.1608594209, output_fired_time: 0.0000000000, propagate_forward_time: 8.5707807541, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5705728531
validation[          , genome  3427] predictions:    9672/  10000 (96.72%), best:    9695/10000 (96.95%), error:      1097.93640, best error:      1047.22217 on epoch:    25, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 120.3029022217s, input_fired_time: 1.3051106930, output_fired_time: 1.1618899107, propagate_forward_time: 46.0138740540, propagate_backward_time: 68.6284866333, weight_update_time: 0.1621146798, other_time: 3.1935501099
epoch time: 10.2363271713s, input_fired_time: 0.1615476012, output_fired_time: 0.0000000000, propagate_forward_time: 9.5020799637, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5726995468
validation[          , genome  3427] predictions:    9632/  10000 (96.32%), best:    9695/10000 (96.95%), error:      1172.74927, best error:      1047.22217 on epoch:    25, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 120.3672637939s, input_fired_time: 1.3002330065, output_fired_time: 1.1600383520, propagate_forward_time: 45.1256561279, propagate_backward_time: 69.5830688477, weight_update_time: 0.1616898030, other_time: 3.1982650757
epoch time: 9.0917587280s, input_fired_time: 0.1592843831, output_fired_time: 0.0000000000, propagate_forward_time: 8.3716077805, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5608663559
validation[          , genome  3427] predictions:    9662/  10000 (96.62%), best:    9695/10000 (96.95%), error:      1116.42102, best error:      1047.22217 on epoch:    25, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 120.8061676025s, input_fired_time: 1.2856389284, output_fired_time: 1.1688642502, propagate_forward_time: 46.2816467285, propagate_backward_time: 67.8258972168, weight_update_time: 0.1620988995, other_time: 4.2441253662
epoch time: 10.3537855148s, input_fired_time: 0.1613775343, output_fired_time: 0.0000000000, propagate_forward_time: 9.6176662445, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5747413635
validation[          , genome  3427] predictions:    9650/  10000 (96.50%), best:    9695/10000 (96.95%), error:      1150.37427, best error:      1047.22217 on epoch:    25, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 120.7055358887s, input_fired_time: 1.2873070240, output_fired_time: 1.1596839428, propagate_forward_time: 46.0947837830, propagate_backward_time: 68.8690948486, weight_update_time: 0.1628533751, other_time: 3.2946624756
epoch time: 9.1091957092s, input_fired_time: 0.1575241238, output_fired_time: 0.0000000000, propagate_forward_time: 8.3923301697, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5593414307
validation[          , genome  3427] predictions:    9673/  10000 (96.73%), best:    9695/10000 (96.95%), error:      1073.95642, best error:      1047.22217 on epoch:    25, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 133.7923736572s, input_fired_time: 1.4676421881, output_fired_time: 1.2691509724, propagate_forward_time: 49.5934066772, propagate_backward_time: 77.8907775879, weight_update_time: 0.1786795259, other_time: 3.5714035034
epoch time: 9.2791595459s, input_fired_time: 0.1587111801, output_fired_time: 0.0000000000, propagate_forward_time: 8.5577030182, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5627450943
validation[          , genome  3427] predictions:    9676/  10000 (96.76%), best:    9695/10000 (96.95%), error:      1104.58447, best error:      1047.22217 on epoch:    25, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 119.4519348145s, input_fired_time: 1.2827485800, output_fired_time: 1.1602785587, propagate_forward_time: 45.1332740784, propagate_backward_time: 68.6775817871, weight_update_time: 0.1617735475, other_time: 3.1980590820
epoch time: 12.7632808685s, input_fired_time: 0.1691477746, output_fired_time: 0.0000000000, propagate_forward_time: 11.9060659409, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6880674362
validation[          , genome  3427] predictions:    9648/  10000 (96.48%), best:    9695/10000 (96.95%), error:      1211.47229, best error:      1047.22217 on epoch:    25, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 126.1329498291s, input_fired_time: 2.3507244587, output_fired_time: 1.2277841568, propagate_forward_time: 47.4502220154, propagate_backward_time: 71.7855148315, weight_update_time: 0.1708275974, other_time: 3.3187026978
epoch time: 10.4609889984s, input_fired_time: 0.1636690199, output_fired_time: 0.0000000000, propagate_forward_time: 9.7165937424, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5807266235
validation[          , genome  3427] predictions:    9688/  10000 (96.88%), best:    9688/10000 (96.88%), error:      1020.12573, best error:      1020.12573 on epoch:    35, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 131.6239166260s, input_fired_time: 1.4419559240, output_fired_time: 1.2958384752, propagate_forward_time: 49.7890739441, propagate_backward_time: 75.6692199707, weight_update_time: 0.1698696762, other_time: 3.4278259277
epoch time: 9.4129705429s, input_fired_time: 0.1646063328, output_fired_time: 0.0000000000, propagate_forward_time: 8.6606636047, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5877008438
validation[          , genome  3427] predictions:    9653/  10000 (96.53%), best:    9688/10000 (96.88%), error:      1113.22168, best error:      1020.12573 on epoch:    35, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 124.0039443970s, input_fired_time: 2.3212378025, output_fired_time: 1.2007368803, propagate_forward_time: 47.2966232300, propagate_backward_time: 69.8742752075, weight_update_time: 0.1801650077, other_time: 3.3110733032
epoch time: 10.4461460114s, input_fired_time: 0.1655378342, output_fired_time: 0.0000000000, propagate_forward_time: 9.6923961639, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5882120132
validation[          , genome  3427] predictions:    9684/  10000 (96.84%), best:    9688/10000 (96.88%), error:      1071.54688, best error:      1020.12573 on epoch:    35, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 124.7164916992s, input_fired_time: 1.3636065722, output_fired_time: 1.2092776299, propagate_forward_time: 48.7436790466, propagate_backward_time: 70.0067749023, weight_update_time: 0.1633465290, other_time: 3.3931579590
epoch time: 9.0760097504s, input_fired_time: 0.1602236629, output_fired_time: 0.0000000000, propagate_forward_time: 8.3564195633, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5593662262
validation[          , genome  3427] predictions:    9680/  10000 (96.80%), best:    9688/10000 (96.88%), error:      1059.85364, best error:      1020.12573 on epoch:    35, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 118.8976898193s, input_fired_time: 1.2839102745, output_fired_time: 1.1580386162, propagate_forward_time: 43.7868232727, propagate_backward_time: 69.4863815308, weight_update_time: 0.1609025598, other_time: 3.1825332642
epoch time: 9.5902614594s, input_fired_time: 0.1648218334, output_fired_time: 0.0000000000, propagate_forward_time: 8.8327589035, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5926809311
validation[          , genome  3427] predictions:    9699/  10000 (96.99%), best:    9699/10000 (96.99%), error:      1006.73065, best error:      1006.73065 on epoch:    39, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 120.5436630249s, input_fired_time: 1.2952972651, output_fired_time: 1.1620475054, propagate_forward_time: 45.1902885437, propagate_backward_time: 68.7053298950, weight_update_time: 0.1612207443, other_time: 4.1906967163
epoch time: 10.5929479599s, input_fired_time: 0.1682901233, output_fired_time: 0.0000000000, propagate_forward_time: 9.8323392868, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5923185349
validation[          , genome  3427] predictions:    9693/  10000 (96.93%), best:    9699/10000 (96.99%), error:      1029.98608, best error:      1006.73065 on epoch:    39, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 130.8390045166s, input_fired_time: 1.3839011192, output_fired_time: 1.2818617821, propagate_forward_time: 51.1316413879, propagate_backward_time: 73.5755538940, weight_update_time: 0.1608875692, other_time: 3.4660568237
epoch time: 11.6359405518s, input_fired_time: 0.1872329861, output_fired_time: 0.0000000000, propagate_forward_time: 10.7687110901, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6799964905
validation[          , genome  3427] predictions:    9694/  10000 (96.94%), best:    9699/10000 (96.99%), error:      1053.39636, best error:      1006.73065 on epoch:    39, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 127.0663299561s, input_fired_time: 1.3485081196, output_fired_time: 1.2713778019, propagate_forward_time: 48.4976730347, propagate_backward_time: 72.5069961548, weight_update_time: 0.1627876163, other_time: 3.4417724609
epoch time: 9.8360786438s, input_fired_time: 0.1654752493, output_fired_time: 0.0000000000, propagate_forward_time: 9.0901622772, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5804414749
validation[          , genome  3427] predictions:    9613/  10000 (96.13%), best:    9699/10000 (96.99%), error:      1202.75439, best error:      1006.73065 on epoch:    39, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 132.6004943848s, input_fired_time: 1.3802881241, output_fired_time: 1.2666181326, propagate_forward_time: 50.6148376465, propagate_backward_time: 75.8673477173, weight_update_time: 0.1605097353, other_time: 3.4713973999
epoch time: 10.5545644760s, input_fired_time: 0.1659493148, output_fired_time: 0.0000000000, propagate_forward_time: 9.8019838333, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5866317749
validation[          , genome  3427] predictions:    9406/  10000 (94.06%), best:    9699/10000 (96.99%), error:      2082.83838, best error:      1006.73065 on epoch:    39, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 126.7939453125s, input_fired_time: 1.3506577015, output_fired_time: 1.2559796572, propagate_forward_time: 49.4932250977, propagate_backward_time: 71.3210220337, weight_update_time: 0.1631257534, other_time: 3.3730621338
epoch time: 11.3756294250s, input_fired_time: 0.1983685046, output_fired_time: 0.0000000000, propagate_forward_time: 10.5282945633, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6489667892
validation[          , genome  3427] predictions:    9686/  10000 (96.86%), best:    9699/10000 (96.99%), error:      1041.83655, best error:      1006.73065 on epoch:    39, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 121.1719970703s, input_fired_time: 1.2952609062, output_fired_time: 1.2071430683, propagate_forward_time: 44.4228630066, propagate_backward_time: 71.0304870605, weight_update_time: 0.1615202874, other_time: 3.2162475586
epoch time: 9.2436027527s, input_fired_time: 0.1620572656, output_fired_time: 0.0000000000, propagate_forward_time: 8.5176877975, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5638580322
validation[          , genome  3427] predictions:    9669/  10000 (96.69%), best:    9699/10000 (96.99%), error:      1080.73987, best error:      1006.73065 on epoch:    39, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 120.4611206055s, input_fired_time: 1.2950892448, output_fired_time: 1.1554759741, propagate_forward_time: 45.0931892395, propagate_backward_time: 69.7026367188, weight_update_time: 0.1623970866, other_time: 3.2147216797
epoch time: 10.6133575439s, input_fired_time: 0.1684576869, output_fired_time: 0.0000000000, propagate_forward_time: 9.8556280136, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5892715454
validation[          , genome  3427] predictions:    9681/  10000 (96.81%), best:    9699/10000 (96.99%), error:      1074.57129, best error:      1006.73065 on epoch:    39, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 120.4120635986s, input_fired_time: 1.2907376289, output_fired_time: 1.1610778570, propagate_forward_time: 44.0336837769, propagate_backward_time: 70.7376785278, weight_update_time: 0.1619151235, other_time: 3.1888809204
epoch time: 9.0973482132s, input_fired_time: 0.1590733677, output_fired_time: 0.0000000000, propagate_forward_time: 8.3761463165, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5621280670
validation[          , genome  3427] predictions:    9632/  10000 (96.32%), best:    9699/10000 (96.99%), error:      1187.35229, best error:      1006.73065 on epoch:    39, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 126.9175567627s, input_fired_time: 1.3672096729, output_fired_time: 1.2279686928, propagate_forward_time: 47.7210159302, propagate_backward_time: 73.2221755981, weight_update_time: 0.1615349948, other_time: 3.3791885376
epoch time: 9.1366481781s, input_fired_time: 0.1612303555, output_fired_time: 0.0000000000, propagate_forward_time: 8.4019260406, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5734920502
validation[          , genome  3427] predictions:    9630/  10000 (96.30%), best:    9699/10000 (96.99%), error:      1186.70825, best error:      1006.73065 on epoch:    39, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 127.2348861694s, input_fired_time: 1.3503288031, output_fired_time: 1.2447148561, propagate_forward_time: 48.1467247009, propagate_backward_time: 73.1681289673, weight_update_time: 0.1727643907, other_time: 3.3249893188
epoch time: 10.7440557480s, input_fired_time: 0.2055161446, output_fired_time: 0.0000000000, propagate_forward_time: 9.8744392395, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6641006470
validation[          , genome  3427] predictions:    9684/  10000 (96.84%), best:    9699/10000 (96.99%), error:      1056.39758, best error:      1006.73065 on epoch:    39, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 120.4670104980s, input_fired_time: 1.2910029888, output_fired_time: 1.1637924910, propagate_forward_time: 48.1076202393, propagate_backward_time: 66.7124252319, weight_update_time: 0.1619112790, other_time: 3.1921691895
epoch time: 10.4456672668s, input_fired_time: 0.1635262668, output_fired_time: 0.0000000000, propagate_forward_time: 9.7028255463, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5793151855
validation[          , genome  3427] predictions:    9657/  10000 (96.57%), best:    9699/10000 (96.99%), error:      1176.63696, best error:      1006.73065 on epoch:    39, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 132.7894897461s, input_fired_time: 1.4336872101, output_fired_time: 1.2817121744, propagate_forward_time: 50.6956634521, propagate_backward_time: 75.8478622437, weight_update_time: 0.1843311787, other_time: 3.5305709839
epoch time: 14.1953449249s, input_fired_time: 0.2209824175, output_fired_time: 0.0000000000, propagate_forward_time: 13.2175664902, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7567958832
validation[          , genome  3427] predictions:    9703/  10000 (97.03%), best:    9699/10000 (96.99%), error:      1024.89221, best error:      1006.73065 on epoch:    39, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 121.1552429199s, input_fired_time: 1.3053939342, output_fired_time: 1.1669906378, propagate_forward_time: 45.4729957581, propagate_backward_time: 69.9806594849, weight_update_time: 0.1630759239, other_time: 3.2291946411
epoch time: 10.2737197876s, input_fired_time: 0.1647089869, output_fired_time: 0.0000000000, propagate_forward_time: 8.6224098206, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4866008759
validation[          , genome  3427] predictions:    9696/  10000 (96.96%), best:    9699/10000 (96.99%), error:      1020.93536, best error:      1006.73065 on epoch:    39, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 120.7793579102s, input_fired_time: 1.3002243042, output_fired_time: 1.1620403528, propagate_forward_time: 45.0439834595, propagate_backward_time: 69.0543670654, weight_update_time: 0.1627768874, other_time: 4.2187423706
epoch time: 11.1903953552s, input_fired_time: 0.1752652824, output_fired_time: 0.0000000000, propagate_forward_time: 10.3164815903, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6986484528
validation[          , genome  3427] predictions:    9710/  10000 (97.10%), best:    9710/10000 (97.10%), error:      1003.09515, best error:      1003.09515 on epoch:    53, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 122.7231597900s, input_fired_time: 1.3189617395, output_fired_time: 1.1884244680, propagate_forward_time: 46.2532806396, propagate_backward_time: 68.6215972900, weight_update_time: 0.1705077589, other_time: 5.3408966064
epoch time: 9.4850473404s, input_fired_time: 0.1656624675, output_fired_time: 0.0000000000, propagate_forward_time: 8.7347602844, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5846242905
validation[          , genome  3427] predictions:    9692/  10000 (96.92%), best:    9710/10000 (97.10%), error:      1039.28979, best error:      1003.09515 on epoch:    53, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 120.3120574951s, input_fired_time: 1.3010449409, output_fired_time: 1.1624411345, propagate_forward_time: 43.9665565491, propagate_backward_time: 69.6502990723, weight_update_time: 0.1623286307, other_time: 4.2317199707
epoch time: 10.5427379608s, input_fired_time: 0.1747648418, output_fired_time: 0.0000000000, propagate_forward_time: 9.7861766815, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5817966461
validation[          , genome  3427] predictions:    9662/  10000 (96.62%), best:    9710/10000 (97.10%), error:      1096.21228, best error:      1003.09515 on epoch:    53, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 120.3226928711s, input_fired_time: 1.2982777357, output_fired_time: 1.1599023342, propagate_forward_time: 44.0066452026, propagate_backward_time: 70.6498489380, weight_update_time: 0.1619571745, other_time: 3.2080154419
epoch time: 9.2513017654s, input_fired_time: 0.1651277393, output_fired_time: 0.0000000000, propagate_forward_time: 8.5159473419, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5702266693
validation[          , genome  3427] predictions:    9694/  10000 (96.94%), best:    9710/10000 (97.10%), error:      1027.25134, best error:      1003.09515 on epoch:    53, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 119.7513656616s, input_fired_time: 1.3007425070, output_fired_time: 2.0734558105, propagate_forward_time: 44.1684455872, propagate_backward_time: 69.0220947266, weight_update_time: 0.1620105356, other_time: 3.1866302490
epoch time: 10.4977731705s, input_fired_time: 0.1660073847, output_fired_time: 0.0000000000, propagate_forward_time: 9.7458047867, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5859613419
validation[          , genome  3427] predictions:    9714/  10000 (97.14%), best:    9714/10000 (97.14%), error:      1000.54541, best error:      1000.54541 on epoch:    57, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 120.3906250000s, input_fired_time: 1.3022159338, output_fired_time: 1.1613909006, propagate_forward_time: 45.1597518921, propagate_backward_time: 69.5444793701, weight_update_time: 0.1637046933, other_time: 3.2227859497
epoch time: 9.1193952560s, input_fired_time: 0.1605408639, output_fired_time: 0.0000000000, propagate_forward_time: 8.3938016891, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5650529861
validation[          , genome  3427] predictions:    9701/  10000 (97.01%), best:    9714/10000 (97.14%), error:      1001.24701, best error:      1000.54541 on epoch:    57, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 120.6699981689s, input_fired_time: 1.2970926762, output_fired_time: 2.1805074215, propagate_forward_time: 44.1780662537, propagate_backward_time: 69.8068237305, weight_update_time: 0.1621658951, other_time: 3.2075042725
epoch time: 10.3170709610s, input_fired_time: 0.1627161354, output_fired_time: 0.0000000000, propagate_forward_time: 9.5773153305, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5770397186
validation[          , genome  3427] predictions:    9679/  10000 (96.79%), best:    9714/10000 (97.14%), error:      1083.45898, best error:      1000.54541 on epoch:    57, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 123.7032623291s, input_fired_time: 1.3362919092, output_fired_time: 1.2171717882, propagate_forward_time: 47.1832275391, propagate_backward_time: 70.6975784302, weight_update_time: 0.1725121737, other_time: 3.2689971924
epoch time: 9.2291421890s, input_fired_time: 0.1628352851, output_fired_time: 0.0000000000, propagate_forward_time: 8.4966630936, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5696439743
validation[          , genome  3427] predictions:    9688/  10000 (96.88%), best:    9714/10000 (97.14%), error:      1048.19116, best error:      1000.54541 on epoch:    57, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 120.7520675659s, input_fired_time: 1.2992479801, output_fired_time: 1.1655983925, propagate_forward_time: 45.1571388245, propagate_backward_time: 69.9098129272, weight_update_time: 0.1628974378, other_time: 3.2202682495
epoch time: 10.5954809189s, input_fired_time: 0.1696858257, output_fired_time: 0.0000000000, propagate_forward_time: 9.7982988358, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6274967194
validation[          , genome  3427] predictions:    9671/  10000 (96.71%), best:    9714/10000 (97.14%), error:      1117.67004, best error:      1000.54541 on epoch:    57, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 120.8392791748s, input_fired_time: 1.2990882397, output_fired_time: 1.1624835730, propagate_forward_time: 45.2394371033, propagate_backward_time: 68.9306716919, weight_update_time: 0.1630764157, other_time: 4.2076034546
epoch time: 9.1066446304s, input_fired_time: 0.1611610353, output_fired_time: 0.0000000000, propagate_forward_time: 8.3880958557, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5573873520
validation[          , genome  3427] predictions:    9615/  10000 (96.15%), best:    9714/10000 (97.14%), error:      1215.53992, best error:      1000.54541 on epoch:    57, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 120.6039199829s, input_fired_time: 1.3024854660, output_fired_time: 1.1635825634, propagate_forward_time: 44.9676322937, propagate_backward_time: 69.9461746216, weight_update_time: 0.1625881493, other_time: 3.2240524292
epoch time: 9.3402938843s, input_fired_time: 0.1633709520, output_fired_time: 0.0000000000, propagate_forward_time: 8.6132831573, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5636396408
validation[          , genome  3427] predictions:    9670/  10000 (96.70%), best:    9714/10000 (97.14%), error:      1104.61340, best error:      1000.54541 on epoch:    57, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 120.2962570190s, input_fired_time: 2.3066668510, output_fired_time: 1.1627019644, propagate_forward_time: 45.0919227600, propagate_backward_time: 68.5330352783, weight_update_time: 0.1613248885, other_time: 3.2019348145
epoch time: 10.4686708450s, input_fired_time: 0.1687138677, output_fired_time: 0.0000000000, propagate_forward_time: 9.6937065125, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6062507629
validation[          , genome  3427] predictions:    9703/  10000 (97.03%), best:    9714/10000 (97.14%), error:      1038.23340, best error:      1000.54541 on epoch:    57, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 122.8055725098s, input_fired_time: 1.3026677370, output_fired_time: 1.1705390215, propagate_forward_time: 47.1027793884, propagate_backward_time: 70.0248260498, weight_update_time: 0.1622657031, other_time: 3.2047576904
epoch time: 9.3180379868s, input_fired_time: 0.1640672684, output_fired_time: 0.0000000000, propagate_forward_time: 8.5804481506, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5735225677
validation[          , genome  3427] predictions:    9683/  10000 (96.83%), best:    9714/10000 (97.14%), error:      1036.43945, best error:      1000.54541 on epoch:    57, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 120.0839004517s, input_fired_time: 1.2994916439, output_fired_time: 1.1619676352, propagate_forward_time: 45.8807830811, propagate_backward_time: 68.5287322998, weight_update_time: 0.1625529081, other_time: 3.2129287720
epoch time: 10.4942779541s, input_fired_time: 0.1668513566, output_fired_time: 0.0000000000, propagate_forward_time: 9.7432107925, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5842161179
validation[          , genome  3427] predictions:    9690/  10000 (96.90%), best:    9714/10000 (97.14%), error:      1173.43738, best error:      1000.54541 on epoch:    57, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 124.3196868896s, input_fired_time: 1.3191407919, output_fired_time: 1.1886750460, propagate_forward_time: 44.4414558411, propagate_backward_time: 73.0437774658, weight_update_time: 0.1713647544, other_time: 4.3266448975
epoch time: 10.2876367569s, input_fired_time: 0.1619463563, output_fired_time: 0.0000000000, propagate_forward_time: 9.5644855499, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5612049103
validation[          , genome  3427] predictions:    9689/  10000 (96.89%), best:    9714/10000 (97.14%), error:      1071.69434, best error:      1000.54541 on epoch:    57, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 120.6949615479s, input_fired_time: 1.3020440340, output_fired_time: 1.1622893810, propagate_forward_time: 46.1555252075, propagate_backward_time: 68.8948211670, weight_update_time: 0.1616176069, other_time: 3.1802749634
epoch time: 9.0938186646s, input_fired_time: 0.1642882526, output_fired_time: 0.0000000000, propagate_forward_time: 8.3639450073, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5655851364
validation[          , genome  3427] predictions:    9672/  10000 (96.72%), best:    9714/10000 (97.14%), error:      1112.37146, best error:      1000.54541 on epoch:    57, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 120.6291351318s, input_fired_time: 1.3056774139, output_fired_time: 1.1705479622, propagate_forward_time: 46.0853729248, propagate_backward_time: 68.8511123657, weight_update_time: 0.1638338417, other_time: 3.2164230347
epoch time: 10.4260416031s, input_fired_time: 0.1661852598, output_fired_time: 0.0000000000, propagate_forward_time: 9.6815147400, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5783414841
validation[          , genome  3427] predictions:    9709/  10000 (97.09%), best:    9714/10000 (97.14%), error:      1005.52087, best error:      1000.54541 on epoch:    57, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 126.3975753784s, input_fired_time: 1.3671174049, output_fired_time: 1.1726479530, propagate_forward_time: 47.5302429199, propagate_backward_time: 72.8849334717, weight_update_time: 0.1764190197, other_time: 3.4426345825
epoch time: 9.3253993988s, input_fired_time: 0.1644983143, output_fired_time: 0.0000000000, propagate_forward_time: 8.5807476044, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5801534653
validation[          , genome  3427] predictions:    9694/  10000 (96.94%), best:    9714/10000 (97.14%), error:      1027.16589, best error:      1000.54541 on epoch:    57, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 122.7205200195s, input_fired_time: 1.3189196587, output_fired_time: 1.1723785400, propagate_forward_time: 44.5420455933, propagate_backward_time: 72.4126968384, weight_update_time: 0.1646205783, other_time: 3.2744827271
epoch time: 9.1781797409s, input_fired_time: 0.1648047566, output_fired_time: 0.0000000000, propagate_forward_time: 8.4333620071, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5800132751
validation[          , genome  3427] predictions:    9702/  10000 (97.02%), best:    9714/10000 (97.14%), error:      1025.91443, best error:      1000.54541 on epoch:    57, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 119.7060699463s, input_fired_time: 1.3016690016, output_fired_time: 1.1609648466, propagate_forward_time: 45.6553115845, propagate_backward_time: 68.3796615601, weight_update_time: 0.1635655165, other_time: 3.2084655762
epoch time: 10.3179569244s, input_fired_time: 0.1657264978, output_fired_time: 0.0000000000, propagate_forward_time: 9.5794553757, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5727748871
validation[          , genome  3427] predictions:    9678/  10000 (96.78%), best:    9714/10000 (97.14%), error:      1077.50793, best error:      1000.54541 on epoch:    57, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 119.7646560669s, input_fired_time: 1.3204274178, output_fired_time: 1.1656308174, propagate_forward_time: 45.0325393677, propagate_backward_time: 69.0381088257, weight_update_time: 0.1614646018, other_time: 3.2079467773
epoch time: 9.2270469666s, input_fired_time: 0.1622361243, output_fired_time: 0.0000000000, propagate_forward_time: 8.4975175858, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5672931671
validation[          , genome  3427] predictions:    9691/  10000 (96.91%), best:    9714/10000 (97.14%), error:      1035.24219, best error:      1000.54541 on epoch:    57, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 120.3907241821s, input_fired_time: 1.3179601431, output_fired_time: 2.1694989204, propagate_forward_time: 44.9384193420, propagate_backward_time: 68.7561035156, weight_update_time: 0.1624337733, other_time: 3.2087402344
epoch time: 10.6418714523s, input_fired_time: 0.1705493778, output_fired_time: 0.0000000000, propagate_forward_time: 9.8782768250, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5930452347
validation[          , genome  3427] predictions:    9681/  10000 (96.81%), best:    9714/10000 (97.14%), error:      1050.76355, best error:      1000.54541 on epoch:    57, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 124.5871658325s, input_fired_time: 1.3147377968, output_fired_time: 1.1758403778, propagate_forward_time: 45.6938400269, propagate_backward_time: 73.0475006104, weight_update_time: 0.1783744842, other_time: 3.3552474976
epoch time: 9.1417989731s, input_fired_time: 0.1621916294, output_fired_time: 0.0000000000, propagate_forward_time: 8.4181957245, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5614118576
validation[          , genome  3427] predictions:    9692/  10000 (96.92%), best:    9714/10000 (97.14%), error:      1060.55566, best error:      1000.54541 on epoch:    57, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 125.5211334229s, input_fired_time: 1.3778038025, output_fired_time: 1.1994329691, propagate_forward_time: 45.5512542725, propagate_backward_time: 74.1441650391, weight_update_time: 0.1630250514, other_time: 3.2484741211
epoch time: 11.0960884094s, input_fired_time: 0.1983484179, output_fired_time: 0.0000000000, propagate_forward_time: 10.2425413132, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6551990509
validation[          , genome  3427] predictions:    9711/  10000 (97.11%), best:    9714/10000 (97.14%), error:      1003.51208, best error:      1000.54541 on epoch:    57, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 121.5940093994s, input_fired_time: 2.3523061275, output_fired_time: 1.1828365326, propagate_forward_time: 47.6006469727, propagate_backward_time: 67.2229003906, weight_update_time: 0.1634946465, other_time: 3.2353210449
epoch time: 10.5551395416s, input_fired_time: 0.1702023894, output_fired_time: 0.0000000000, propagate_forward_time: 9.7935056686, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5914316177
validation[          , genome  3427] predictions:    9666/  10000 (96.66%), best:    9714/10000 (97.14%), error:      1096.22070, best error:      1000.54541 on epoch:    57, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 125.3816833496s, input_fired_time: 1.3724144697, output_fired_time: 1.1943593025, propagate_forward_time: 50.2579650879, propagate_backward_time: 69.2204437256, weight_update_time: 0.1625046581, other_time: 3.3365020752
epoch time: 10.3927135468s, input_fired_time: 0.1654649824, output_fired_time: 0.0000000000, propagate_forward_time: 8.6443281174, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5829200745
validation[          , genome  3427] predictions:    9675/  10000 (96.75%), best:    9714/10000 (97.14%), error:      1046.58472, best error:      1000.54541 on epoch:    57, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 119.9549789429s, input_fired_time: 1.3092277050, output_fired_time: 2.0690402985, propagate_forward_time: 44.0555038452, propagate_backward_time: 69.3229904175, weight_update_time: 0.1612954736, other_time: 3.1982192993
epoch time: 9.2031316757s, input_fired_time: 0.1643712223, output_fired_time: 0.0000000000, propagate_forward_time: 8.4638748169, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5748853683
validation[          , genome  3427] predictions:    9673/  10000 (96.73%), best:    9714/10000 (97.14%), error:      1056.61719, best error:      1000.54541 on epoch:    57, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 128.4928741455s, input_fired_time: 1.3617490530, output_fired_time: 1.2294740677, propagate_forward_time: 50.5376129150, propagate_backward_time: 71.9776229858, weight_update_time: 0.1783969551, other_time: 3.3864135742
epoch time: 9.5584859848s, input_fired_time: 0.1710024029, output_fired_time: 0.0000000000, propagate_forward_time: 8.8058614731, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5816221237
validation[          , genome  3427] predictions:    9702/  10000 (97.02%), best:    9714/10000 (97.14%), error:      1012.70343, best error:      1000.54541 on epoch:    57, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 120.5319824219s, input_fired_time: 1.3138173819, output_fired_time: 1.1682590246, propagate_forward_time: 44.0390014648, propagate_backward_time: 70.7609481812, weight_update_time: 0.1630793065, other_time: 3.2499542236
epoch time: 10.4852390289s, input_fired_time: 0.1664457768, output_fired_time: 0.0000000000, propagate_forward_time: 9.7450733185, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5737199783
validation[          , genome  3427] predictions:    9614/  10000 (96.14%), best:    9714/10000 (97.14%), error:      1251.87598, best error:      1000.54541 on epoch:    57, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 120.1139144897s, input_fired_time: 1.3066275120, output_fired_time: 1.1642142534, propagate_forward_time: 45.9132957458, propagate_backward_time: 68.5189437866, weight_update_time: 0.1624014080, other_time: 3.2108383179
epoch time: 9.1447343826s, input_fired_time: 0.1633200943, output_fired_time: 0.0000000000, propagate_forward_time: 8.4090490341, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5723648071
validation[          , genome  3427] predictions:    9710/  10000 (97.10%), best:    9710/10000 (97.10%), error:       995.43457, best error:       995.43457 on epoch:    82, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 120.7005233765s, input_fired_time: 2.3198204041, output_fired_time: 1.1657412052, propagate_forward_time: 44.1510047913, propagate_backward_time: 69.8706054688, weight_update_time: 0.1644437313, other_time: 3.1933593750
epoch time: 10.4035634995s, input_fired_time: 0.1674300134, output_fired_time: 0.0000000000, propagate_forward_time: 9.6672124863, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5689210892
validation[          , genome  3427] predictions:    9646/  10000 (96.46%), best:    9710/10000 (97.10%), error:      1108.18433, best error:       995.43457 on epoch:    82, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 125.6813812256s, input_fired_time: 1.3381873369, output_fired_time: 1.2159395218, propagate_forward_time: 49.9238967896, propagate_backward_time: 69.8523101807, weight_update_time: 0.1703116149, other_time: 3.3510437012
epoch time: 9.2499141693s, input_fired_time: 0.1643922478, output_fired_time: 0.0000000000, propagate_forward_time: 8.5196313858, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5658903122
validation[          , genome  3427] predictions:    9683/  10000 (96.83%), best:    9710/10000 (97.10%), error:      1085.24170, best error:       995.43457 on epoch:    82, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 120.0505142212s, input_fired_time: 1.3084387779, output_fired_time: 1.1617989540, propagate_forward_time: 44.0068702698, propagate_backward_time: 70.3725585938, weight_update_time: 0.1630763561, other_time: 3.2008514404
epoch time: 10.5256319046s, input_fired_time: 0.1697274148, output_fired_time: 0.0000000000, propagate_forward_time: 9.7639274597, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5919771194
validation[          , genome  3427] predictions:    9639/  10000 (96.39%), best:    9710/10000 (97.10%), error:      1176.39453, best error:       995.43457 on epoch:    82, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 123.3780136108s, input_fired_time: 1.3223354816, output_fired_time: 1.2096829414, propagate_forward_time: 46.2439727783, propagate_backward_time: 71.3421249390, weight_update_time: 0.1652075052, other_time: 3.2598953247
epoch time: 18.6622161865s, input_fired_time: 0.3214511275, output_fired_time: 0.0000000000, propagate_forward_time: 17.2881126404, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0526523590
validation[          , genome  3427] predictions:    9688/  10000 (96.88%), best:    9710/10000 (97.10%), error:      1059.85498, best error:       995.43457 on epoch:    82, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 131.9215393066s, input_fired_time: 1.4104430676, output_fired_time: 2.2479212284, propagate_forward_time: 47.8345298767, propagate_backward_time: 76.9576492310, weight_update_time: 0.1788156331, other_time: 3.4709854126
epoch time: 9.2797069550s, input_fired_time: 0.1650041640, output_fired_time: 0.0000000000, propagate_forward_time: 8.5503444672, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5643587112
validation[          , genome  3427] predictions:    9645/  10000 (96.45%), best:    9710/10000 (97.10%), error:      1142.84277, best error:       995.43457 on epoch:    82, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 120.2351379395s, input_fired_time: 1.3101247549, output_fired_time: 1.1688715219, propagate_forward_time: 42.9637145996, propagate_backward_time: 71.6109161377, weight_update_time: 0.1635156721, other_time: 3.1815109253
epoch time: 10.4889221191s, input_fired_time: 0.1677730531, output_fired_time: 0.0000000000, propagate_forward_time: 9.7412309647, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5799179077
validation[          , genome  3427] predictions:    9698/  10000 (96.98%), best:    9710/10000 (97.10%), error:      1046.29871, best error:       995.43457 on epoch:    82, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 120.2873535156s, input_fired_time: 1.3055856228, output_fired_time: 2.1729745865, propagate_forward_time: 45.8886718750, propagate_backward_time: 67.7348175049, weight_update_time: 0.1636696607, other_time: 3.1853027344
epoch time: 9.1497859955s, input_fired_time: 0.1629838347, output_fired_time: 0.0000000000, propagate_forward_time: 8.4340019226, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5528001785
validation[          , genome  3427] predictions:    9632/  10000 (96.32%), best:    9710/10000 (97.10%), error:      1196.13855, best error:       995.43457 on epoch:    82, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 120.3623886108s, input_fired_time: 1.3226913214, output_fired_time: 2.1725647449, propagate_forward_time: 44.9981803894, propagate_backward_time: 68.6762847900, weight_update_time: 0.1616581231, other_time: 3.1926727295
epoch time: 10.5144615173s, input_fired_time: 0.1702111512, output_fired_time: 0.0000000000, propagate_forward_time: 9.7658605576, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5783901215
validation[          , genome  3427] predictions:    9703/  10000 (97.03%), best:    9703/10000 (97.03%), error:       994.36377, best error:       994.36377 on epoch:    90, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 121.5065460205s, input_fired_time: 1.3195245266, output_fired_time: 1.1701005697, propagate_forward_time: 45.4320182800, propagate_backward_time: 70.3613967896, weight_update_time: 0.1628524214, other_time: 3.2235031128
epoch time: 9.2589673996s, input_fired_time: 0.1633508354, output_fired_time: 0.0000000000, propagate_forward_time: 8.5369768143, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5586395264
validation[          , genome  3427] predictions:    9591/  10000 (95.91%), best:    9703/10000 (97.03%), error:      1443.47083, best error:       994.36377 on epoch:    90, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 119.9350891113s, input_fired_time: 1.3115642071, output_fired_time: 1.1696153879, propagate_forward_time: 45.0094909668, propagate_backward_time: 69.2408676147, weight_update_time: 0.1618482322, other_time: 3.2035522461
epoch time: 10.5167732239s, input_fired_time: 0.1702913642, output_fired_time: 0.0000000000, propagate_forward_time: 9.7589578629, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5875244141
validation[          , genome  3427] predictions:    9655/  10000 (96.55%), best:    9703/10000 (97.03%), error:      1195.63586, best error:       994.36377 on epoch:    90, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 120.4304733276s, input_fired_time: 1.3108872175, output_fired_time: 1.1612874269, propagate_forward_time: 42.9254112244, propagate_backward_time: 71.8404541016, weight_update_time: 0.1617871970, other_time: 3.1924285889
epoch time: 9.2555894852s, input_fired_time: 0.1765178144, output_fired_time: 0.0000000000, propagate_forward_time: 8.5093708038, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5697011948
validation[          , genome  3427] predictions:    9698/  10000 (96.98%), best:    9703/10000 (97.03%), error:      1035.49829, best error:       994.36377 on epoch:    90, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 132.9422302246s, input_fired_time: 2.4191753864, output_fired_time: 1.2674701214, propagate_forward_time: 50.4652748108, propagate_backward_time: 75.3141098022, weight_update_time: 0.1627727598, other_time: 3.4762039185
epoch time: 10.4813337326s, input_fired_time: 0.1687543988, output_fired_time: 0.0000000000, propagate_forward_time: 9.7358303070, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5767488480
validation[          , genome  3427] predictions:    9672/  10000 (96.72%), best:    9703/10000 (97.03%), error:      1069.01013, best error:       994.36377 on epoch:    90, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 125.5083770752s, input_fired_time: 1.3686341047, output_fired_time: 1.2462502718, propagate_forward_time: 46.6127128601, propagate_backward_time: 73.0003662109, weight_update_time: 0.1643200666, other_time: 3.2804107666
epoch time: 14.3688106537s, input_fired_time: 0.2542865872, output_fired_time: 0.0000000000, propagate_forward_time: 13.2689447403, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8455791473
validation[          , genome  3427] predictions:    9679/  10000 (96.79%), best:    9703/10000 (97.03%), error:      1079.30249, best error:       994.36377 on epoch:    90, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 120.9454345703s, input_fired_time: 2.3253231049, output_fired_time: 1.1651253700, propagate_forward_time: 45.2851638794, propagate_backward_time: 68.9659194946, weight_update_time: 0.1634194702, other_time: 3.2039031982
epoch time: 9.2391233444s, input_fired_time: 0.1650745571, output_fired_time: 0.0000000000, propagate_forward_time: 8.5059385300, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5681104660
validation[          , genome  3427] predictions:    9697/  10000 (96.97%), best:    9703/10000 (97.03%), error:      1002.64966, best error:       994.36377 on epoch:    90, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 130.4547576904s, input_fired_time: 2.4499561787, output_fired_time: 1.2677309513, propagate_forward_time: 48.4248313904, propagate_backward_time: 74.8851394653, weight_update_time: 0.1675109267, other_time: 3.4271011353
epoch time: 9.2112598419s, input_fired_time: 0.1668025255, output_fired_time: 0.0000000000, propagate_forward_time: 8.4743995667, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5700578690
validation[          , genome  3427] predictions:    9706/  10000 (97.06%), best:    9703/10000 (97.03%), error:      1025.21753, best error:       994.36377 on epoch:    90, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 120.7662277222s, input_fired_time: 1.3122898340, output_fired_time: 1.1673028469, propagate_forward_time: 45.1947784424, propagate_backward_time: 69.8979949951, weight_update_time: 0.1622919738, other_time: 3.1938629150
epoch time: 10.6445550919s, input_fired_time: 0.1729542166, output_fired_time: 0.0000000000, propagate_forward_time: 9.8792581558, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5923423767
validation[          , genome  3427] predictions:    9700/  10000 (97.00%), best:    9703/10000 (97.03%), error:      1034.70898, best error:       994.36377 on epoch:    90, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 125.7341079712s, input_fired_time: 1.3448544741, output_fired_time: 1.2031744719, propagate_forward_time: 47.3671951294, propagate_backward_time: 72.4908676147, weight_update_time: 0.1683589220, other_time: 3.3280181885
epoch time: 10.2615652084s, input_fired_time: 0.1677007675, output_fired_time: 0.0000000000, propagate_forward_time: 9.5204248428, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5734395981
validation[          , genome  3427] predictions:    9660/  10000 (96.60%), best:    9703/10000 (97.03%), error:      1116.55359, best error:       994.36377 on epoch:    90, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 120.7244720459s, input_fired_time: 3.3342521191, output_fired_time: 1.1717511415, propagate_forward_time: 46.1587944031, propagate_backward_time: 66.8610839844, weight_update_time: 0.1623291522, other_time: 3.1985931396
epoch time: 9.2779150009s, input_fired_time: 0.1672296226, output_fired_time: 0.0000000000, propagate_forward_time: 8.5429477692, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5677375793
validation[          , genome  3427] predictions:    9654/  10000 (96.54%), best:    9703/10000 (97.03%), error:      1148.46021, best error:       994.36377 on epoch:    90, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 50.6407089233s, input_fired_time: 0.8666476607, output_fired_time: 0.0000000000, propagate_forward_time: 46.7445755005, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0294876099
best training[          , genome  3427] predictions:   49334/  50000 (98.67%), best:    9703/10000 (97.03%), error:      2506.03223, best error:       994.36377 on epoch:    90, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 9.3356666565s, input_fired_time: 0.1659668833, output_fired_time: 0.0000000000, propagate_forward_time: 8.6053190231, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5643806458
   testing[          , genome  3427] predictions:    9707/  10000 (97.07%), best:    9703/10000 (97.03%), error:       959.26050, best error:       994.36377 on epoch:    90, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
08:21:44 (11248): called boinc_finish(0)

</stderr_txt>
]]>