Nameexact_genome_1512568488_44_6904_0
Workunit2605872
Created7 Dec 2017, 22:45:13 UTC
Sent7 Dec 2017, 22:51:49 UTC
Report deadline22 Dec 2017, 8:21:35 UTC
Received8 Dec 2017, 19:21:41 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID64142
Run time9 hours 25 min 55 sec
CPU time7 hours 17 min 22 sec
Validate stateValid
Credit3,598.92
Device peak FLOPS3.08 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size160.27 MB
Peak swap size163.28 MB
Peak disk usage2.65 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
decay: 0.0002438374

epoch time: 433.6585388184s, input_fired_time: 5.1547040939, output_fired_time: 3.6134560108, propagate_forward_time: 165.6502075195, propagate_backward_time: 251.2153778076, weight_update_time: 0.2544555962, other_time: 8.0247955322
epoch time: 39.3259582520s, input_fired_time: 0.5265710354, output_fired_time: 0.0000000000, propagate_forward_time: 37.8645362854, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9348526001
validation[          , genome  6904] predictions:    9745/  10000 (97.45%), best:    9791/10000 (97.91%), error:       855.33270, best error:       722.33490 on epoch:    14, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 467.0132446289s, input_fired_time: 5.6765189171, output_fired_time: 6.5382657051, propagate_forward_time: 168.9179077148, propagate_backward_time: 276.2762451172, weight_update_time: 0.2540721595, other_time: 9.6043090820
epoch time: 39.5770149231s, input_fired_time: 0.8082404137, output_fired_time: 0.0000000000, propagate_forward_time: 37.3817749023, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3870010376
validation[          , genome  6904] predictions:    9678/  10000 (96.78%), best:    9791/10000 (97.91%), error:      1042.83728, best error:       722.33490 on epoch:    14, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 410.4817199707s, input_fired_time: 5.5072145462, output_fired_time: 3.8556993008, propagate_forward_time: 155.4096832275, propagate_backward_time: 238.4286956787, weight_update_time: 0.6453429461, other_time: 7.2804260254
epoch time: 29.5477848053s, input_fired_time: 0.4056503475, output_fired_time: 0.0000000000, propagate_forward_time: 27.0703830719, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0717506409
validation[          , genome  6904] predictions:    9799/  10000 (97.99%), best:    9791/10000 (97.91%), error:       727.81616, best error:       722.33490 on epoch:    14, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 336.1245727539s, input_fired_time: 3.4663555622, output_fired_time: 4.0257353783, propagate_forward_time: 123.6283645630, propagate_backward_time: 199.6797637939, weight_update_time: 0.2034968734, other_time: 5.3243560791
epoch time: 19.3523502350s, input_fired_time: 0.4115158617, output_fired_time: 0.0000000000, propagate_forward_time: 18.1596488953, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7811851501
validation[          , genome  6904] predictions:    9788/  10000 (97.88%), best:    9788/10000 (97.88%), error:       675.34955, best error:       675.34955 on epoch:    18, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 231.2417755127s, input_fired_time: 2.9454948902, output_fired_time: 2.7002251148, propagate_forward_time: 86.4380874634, propagate_backward_time: 134.9271850586, weight_update_time: 0.1858593374, other_time: 4.2307739258
epoch time: 19.2749233246s, input_fired_time: 0.5110952854, output_fired_time: 0.0000000000, propagate_forward_time: 17.9136600494, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8501682281
validation[          , genome  6904] predictions:    9752/  10000 (97.52%), best:    9788/10000 (97.88%), error:       852.24219, best error:       675.34955 on epoch:    18, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 238.2147979736s, input_fired_time: 3.2461562157, output_fired_time: 2.6894183159, propagate_forward_time: 88.9141235352, propagate_backward_time: 139.3332214355, weight_update_time: 0.1895980090, other_time: 4.0318756104
epoch time: 21.1615543365s, input_fired_time: 0.3375426233, output_fired_time: 0.0000000000, propagate_forward_time: 20.0404987335, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7835121155
validation[          , genome  6904] predictions:    9796/  10000 (97.96%), best:    9788/10000 (97.88%), error:       738.49951, best error:       675.34955 on epoch:    18, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 237.0171813965s, input_fired_time: 3.0751307011, output_fired_time: 2.5860905647, propagate_forward_time: 88.7953414917, propagate_backward_time: 138.4326629639, weight_update_time: 0.1849469095, other_time: 4.1279449463
epoch time: 17.3708209991s, input_fired_time: 0.3438740671, output_fired_time: 0.0000000000, propagate_forward_time: 16.3190917969, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7078552246
validation[          , genome  6904] predictions:    9813/  10000 (98.13%), best:    9813/10000 (98.13%), error:       617.74115, best error:       617.74115 on epoch:    21, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 238.3183898926s, input_fired_time: 3.0716826916, output_fired_time: 2.7720084190, propagate_forward_time: 88.7807159424, propagate_backward_time: 139.6828613281, weight_update_time: 0.1891596466, other_time: 4.0111236572
epoch time: 20.2441692352s, input_fired_time: 0.4934062660, output_fired_time: 0.0000000000, propagate_forward_time: 19.0105915070, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7401714325
validation[          , genome  6904] predictions:    9776/  10000 (97.76%), best:    9813/10000 (98.13%), error:       747.47668, best error:       617.74115 on epoch:    21, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 229.7341766357s, input_fired_time: 2.9413046837, output_fired_time: 2.6584432125, propagate_forward_time: 85.6490020752, propagate_backward_time: 134.4625244141, weight_update_time: 0.1885985881, other_time: 4.0229034424
epoch time: 19.7649497986s, input_fired_time: 0.3763532043, output_fired_time: 0.0000000000, propagate_forward_time: 18.6317024231, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7568950653
validation[          , genome  6904] predictions:    9744/  10000 (97.44%), best:    9813/10000 (98.13%), error:       805.81805, best error:       617.74115 on epoch:    21, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 265.3931884766s, input_fired_time: 3.2214856148, output_fired_time: 3.0251388550, propagate_forward_time: 102.6121292114, propagate_backward_time: 152.2171936035, weight_update_time: 0.1924784034, other_time: 4.3172302246
epoch time: 33.4902992249s, input_fired_time: 0.7291061878, output_fired_time: 0.0000000000, propagate_forward_time: 31.5155010223, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2456912994
validation[          , genome  6904] predictions:    9763/  10000 (97.63%), best:    9813/10000 (98.13%), error:       793.77557, best error:       617.74115 on epoch:    21, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 385.9978027344s, input_fired_time: 4.9329829216, output_fired_time: 3.9382593632, propagate_forward_time: 143.1443786621, propagate_backward_time: 226.3053283691, weight_update_time: 0.2074884176, other_time: 7.6768493652
epoch time: 31.3108100891s, input_fired_time: 0.3870009780, output_fired_time: 0.0000000000, propagate_forward_time: 29.5532741547, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3705348969
validation[          , genome  6904] predictions:    9782/  10000 (97.82%), best:    9813/10000 (98.13%), error:       754.26727, best error:       617.74115 on epoch:    21, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 228.0431823730s, input_fired_time: 2.8279392719, output_fired_time: 2.6935572624, propagate_forward_time: 85.3007125854, propagate_backward_time: 133.2966461182, weight_update_time: 0.1846254021, other_time: 3.9243316650
epoch time: 17.5896873474s, input_fired_time: 0.3458688259, output_fired_time: 0.0000000000, propagate_forward_time: 16.5406723022, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7031459808
validation[          , genome  6904] predictions:    9447/  10000 (94.47%), best:    9813/10000 (98.13%), error:      1695.87805, best error:       617.74115 on epoch:    21, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

resetting weights to those on epoch: 21
epoch time: 227.3180084229s, input_fired_time: 2.9968769550, output_fired_time: 2.6734690666, propagate_forward_time: 84.5083541870, propagate_backward_time: 133.2487640381, weight_update_time: 0.1835440248, other_time: 3.8905487061
epoch time: 18.2777118683s, input_fired_time: 0.3755618334, output_fired_time: 0.0000000000, propagate_forward_time: 17.0515670776, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8505821228
validation[          , genome  6904] predictions:    9783/  10000 (97.83%), best:    9813/10000 (98.13%), error:       714.00342, best error:       617.74115 on epoch:    21, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 226.0671386719s, input_fired_time: 2.9792716503, output_fired_time: 2.5631637573, propagate_forward_time: 83.9789352417, propagate_backward_time: 132.5724945068, weight_update_time: 0.1826040149, other_time: 3.9732513428
epoch time: 17.0903644562s, input_fired_time: 0.3362804651, output_fired_time: 0.0000000000, propagate_forward_time: 16.0666313171, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6874523163
validation[          , genome  6904] predictions:    9607/  10000 (96.07%), best:    9813/10000 (98.13%), error:      1232.92615, best error:       617.74115 on epoch:    21, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 225.6331481934s, input_fired_time: 2.8699285984, output_fired_time: 2.6261434555, propagate_forward_time: 84.5413742065, propagate_backward_time: 131.6638183594, weight_update_time: 0.1818027049, other_time: 3.9318847656
epoch time: 17.4472503662s, input_fired_time: 0.3394749463, output_fired_time: 0.0000000000, propagate_forward_time: 16.4132690430, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6945056915
validation[          , genome  6904] predictions:    9786/  10000 (97.86%), best:    9813/10000 (98.13%), error:       686.65332, best error:       617.74115 on epoch:    21, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 228.9139709473s, input_fired_time: 2.8920507431, output_fired_time: 2.6880369186, propagate_forward_time: 85.0490188599, propagate_backward_time: 134.2281646729, weight_update_time: 0.1846382022, other_time: 4.0567169189
epoch time: 19.1878166199s, input_fired_time: 0.4329285920, output_fired_time: 0.0000000000, propagate_forward_time: 18.0137577057, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7411308289
validation[          , genome  6904] predictions:    9737/  10000 (97.37%), best:    9813/10000 (98.13%), error:       837.26685, best error:       617.74115 on epoch:    21, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 230.2899322510s, input_fired_time: 2.8495090008, output_fired_time: 2.6512615681, propagate_forward_time: 85.8268432617, propagate_backward_time: 134.8572998047, weight_update_time: 0.1850549579, other_time: 4.1050262451
epoch time: 18.6620655060s, input_fired_time: 0.3450481594, output_fired_time: 0.0000000000, propagate_forward_time: 17.6178512573, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6991653442
validation[          , genome  6904] predictions:    9798/  10000 (97.98%), best:    9813/10000 (98.13%), error:       681.73663, best error:       617.74115 on epoch:    21, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 229.0460662842s, input_fired_time: 2.8387057781, output_fired_time: 2.5961415768, propagate_forward_time: 85.3027114868, propagate_backward_time: 134.2973175049, weight_update_time: 0.1852004230, other_time: 4.0111846924
epoch time: 19.8597354889s, input_fired_time: 0.3608926833, output_fired_time: 0.0000000000, propagate_forward_time: 18.6688556671, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8299865723
validation[          , genome  6904] predictions:    9780/  10000 (97.80%), best:    9813/10000 (98.13%), error:       759.15192, best error:       617.74115 on epoch:    21, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 239.7761840820s, input_fired_time: 3.0058720112, output_fired_time: 2.7348144054, propagate_forward_time: 90.0365982056, propagate_backward_time: 139.9432830811, weight_update_time: 0.1934860945, other_time: 4.0556182861
epoch time: 20.6261234283s, input_fired_time: 0.3975217044, output_fired_time: 0.0000000000, propagate_forward_time: 19.3983325958, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8302688599
validation[          , genome  6904] predictions:    9764/  10000 (97.64%), best:    9813/10000 (98.13%), error:       745.04181, best error:       617.74115 on epoch:    21, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 229.6511535645s, input_fired_time: 2.9664945602, output_fired_time: 2.6665258408, propagate_forward_time: 85.8267364502, propagate_backward_time: 134.1907958984, weight_update_time: 0.1879641414, other_time: 4.0006103516
epoch time: 18.7972621918s, input_fired_time: 0.3833709061, output_fired_time: 0.0000000000, propagate_forward_time: 17.5912456512, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8226451874
validation[          , genome  6904] predictions:    9765/  10000 (97.65%), best:    9813/10000 (98.13%), error:       768.15192, best error:       617.74115 on epoch:    21, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 221.1266937256s, input_fired_time: 2.8289375305, output_fired_time: 2.5428941250, propagate_forward_time: 82.2563476563, propagate_backward_time: 129.6128997803, weight_update_time: 0.1837816238, other_time: 3.8856201172
epoch time: 20.2042465210s, input_fired_time: 0.3821482062, output_fired_time: 0.0000000000, propagate_forward_time: 19.0113162994, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8107814789
validation[          , genome  6904] predictions:    9785/  10000 (97.85%), best:    9813/10000 (98.13%), error:       715.04266, best error:       617.74115 on epoch:    21, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 262.8082275391s, input_fired_time: 3.2805454731, output_fired_time: 2.8418390751, propagate_forward_time: 95.6072387695, propagate_backward_time: 156.5708770752, weight_update_time: 0.2213581651, other_time: 4.5077362061
epoch time: 33.0448036194s, input_fired_time: 0.4309096932, output_fired_time: 0.0000000000, propagate_forward_time: 30.6943073273, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9195880890
validation[          , genome  6904] predictions:    9742/  10000 (97.42%), best:    9813/10000 (98.13%), error:       832.21173, best error:       617.74115 on epoch:    21, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 408.9560852051s, input_fired_time: 4.8237113953, output_fired_time: 5.1404962540, propagate_forward_time: 147.3389892578, propagate_backward_time: 243.4647979736, weight_update_time: 0.2231166363, other_time: 8.1880950928
epoch time: 35.3743515015s, input_fired_time: 0.8741711974, output_fired_time: 0.0000000000, propagate_forward_time: 32.7370338440, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7631454468
validation[          , genome  6904] predictions:    9793/  10000 (97.93%), best:    9813/10000 (98.13%), error:       710.58557, best error:       617.74115 on epoch:    21, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 399.1908264160s, input_fired_time: 4.8648262024, output_fired_time: 4.8797717094, propagate_forward_time: 155.3766479492, propagate_backward_time: 228.4005126953, weight_update_time: 0.2069783509, other_time: 5.6690673828
epoch time: 31.6507816315s, input_fired_time: 0.4359433055, output_fired_time: 0.0000000000, propagate_forward_time: 30.0775108337, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1373271942
validation[          , genome  6904] predictions:    9825/  10000 (98.25%), best:    9813/10000 (98.13%), error:       636.96179, best error:       617.74115 on epoch:    21, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 353.2302551270s, input_fired_time: 3.6605472565, output_fired_time: 5.0442962646, propagate_forward_time: 140.9323730469, propagate_backward_time: 198.4580841064, weight_update_time: 0.2850233316, other_time: 5.1349334717
epoch time: 27.9199409485s, input_fired_time: 0.3882835209, output_fired_time: 0.0000000000, propagate_forward_time: 26.7405872345, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7910709381
validation[          , genome  6904] predictions:    9782/  10000 (97.82%), best:    9813/10000 (98.13%), error:       710.71271, best error:       617.74115 on epoch:    21, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 354.7611389160s, input_fired_time: 3.4290142059, output_fired_time: 3.8063271046, propagate_forward_time: 123.1401748657, propagate_backward_time: 218.6144561768, weight_update_time: 0.2178792208, other_time: 5.7711639404
epoch time: 28.1378612518s, input_fired_time: 0.9208087921, output_fired_time: 0.0000000000, propagate_forward_time: 26.3747005463, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8423519135
validation[          , genome  6904] predictions:    9778/  10000 (97.78%), best:    9813/10000 (98.13%), error:       740.49426, best error:       617.74115 on epoch:    21, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 354.8419494629s, input_fired_time: 4.6034173965, output_fired_time: 3.1984710693, propagate_forward_time: 133.0600433350, propagate_backward_time: 208.2950744629, weight_update_time: 0.2096992880, other_time: 5.6849212646
epoch time: 28.9310970306s, input_fired_time: 0.6408277750, output_fired_time: 0.0000000000, propagate_forward_time: 27.1550121307, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1352577209
validation[          , genome  6904] predictions:    9731/  10000 (97.31%), best:    9813/10000 (98.13%), error:       850.95520, best error:       617.74115 on epoch:    21, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 352.4646301270s, input_fired_time: 4.6617259979, output_fired_time: 3.9527451992, propagate_forward_time: 135.0213165283, propagate_backward_time: 203.1635131836, weight_update_time: 0.4566875994, other_time: 5.6653289795
epoch time: 29.9147968292s, input_fired_time: 0.4660165012, output_fired_time: 0.0000000000, propagate_forward_time: 27.5137462616, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9350337982
validation[          , genome  6904] predictions:    9687/  10000 (96.87%), best:    9813/10000 (98.13%), error:       964.52020, best error:       617.74115 on epoch:    21, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 391.9237670898s, input_fired_time: 4.2650499344, output_fired_time: 3.9101982117, propagate_forward_time: 154.5238342285, propagate_backward_time: 222.0280151367, weight_update_time: 0.2070715874, other_time: 7.1966857910
epoch time: 38.9896583557s, input_fired_time: 1.0618180037, output_fired_time: 0.0000000000, propagate_forward_time: 36.4173965454, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5104446411
validation[          , genome  6904] predictions:    9798/  10000 (97.98%), best:    9813/10000 (98.13%), error:       665.12280, best error:       617.74115 on epoch:    21, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 399.2054443359s, input_fired_time: 4.1780982018, output_fired_time: 4.4973011017, propagate_forward_time: 154.7601165771, propagate_backward_time: 228.9463500977, weight_update_time: 0.5205869079, other_time: 6.8235626221
epoch time: 32.2950363159s, input_fired_time: 0.7021381855, output_fired_time: 0.0000000000, propagate_forward_time: 30.5510826111, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0418148041
validation[          , genome  6904] predictions:    9751/  10000 (97.51%), best:    9813/10000 (98.13%), error:       850.60260, best error:       617.74115 on epoch:    21, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 334.4101562500s, input_fired_time: 4.3089923859, output_fired_time: 4.0664224625, propagate_forward_time: 126.7628555298, propagate_backward_time: 193.9392395020, weight_update_time: 0.1998067796, other_time: 5.3326416016
epoch time: 18.6132793427s, input_fired_time: 0.4284910262, output_fired_time: 0.0000000000, propagate_forward_time: 17.5018730164, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6829147339
validation[          , genome  6904] predictions:    9809/  10000 (98.09%), best:    9809/10000 (98.09%), error:       611.71649, best error:       611.71649 on epoch:    45, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 229.1461486816s, input_fired_time: 2.9675457478, output_fired_time: 2.6391654015, propagate_forward_time: 85.3690567017, propagate_backward_time: 134.1914672852, weight_update_time: 0.1858219206, other_time: 3.9789123535
epoch time: 20.2665386200s, input_fired_time: 0.3686557114, output_fired_time: 0.0000000000, propagate_forward_time: 19.1616516113, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7362308502
validation[          , genome  6904] predictions:    9791/  10000 (97.91%), best:    9809/10000 (98.09%), error:       683.55841, best error:       611.71649 on epoch:    45, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 243.1237182617s, input_fired_time: 3.1018011570, output_fired_time: 2.8166675568, propagate_forward_time: 90.7758712769, propagate_backward_time: 142.0712127686, weight_update_time: 0.3132693768, other_time: 4.3581695557
epoch time: 21.4656791687s, input_fired_time: 0.4633592367, output_fired_time: 0.0000000000, propagate_forward_time: 20.1889762878, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8133430481
validation[          , genome  6904] predictions:    9801/  10000 (98.01%), best:    9809/10000 (98.09%), error:       672.46783, best error:       611.71649 on epoch:    45, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 238.7714996338s, input_fired_time: 3.0228154659, output_fired_time: 2.7406320572, propagate_forward_time: 89.2545547485, propagate_backward_time: 139.7778778076, weight_update_time: 0.1916050464, other_time: 3.9756317139
epoch time: 19.2117004395s, input_fired_time: 0.3621588349, output_fired_time: 0.0000000000, propagate_forward_time: 18.1210575104, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7284832001
validation[          , genome  6904] predictions:    9779/  10000 (97.79%), best:    9809/10000 (98.09%), error:       789.92505, best error:       611.71649 on epoch:    45, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 241.7284393311s, input_fired_time: 3.0293092728, output_fired_time: 2.9864389896, propagate_forward_time: 89.8726882935, propagate_backward_time: 141.7186431885, weight_update_time: 0.1916295737, other_time: 4.1213531494
epoch time: 18.4494895935s, input_fired_time: 0.4535292685, output_fired_time: 0.0000000000, propagate_forward_time: 17.2675590515, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7284011841
validation[          , genome  6904] predictions:    9802/  10000 (98.02%), best:    9809/10000 (98.09%), error:       675.56689, best error:       611.71649 on epoch:    45, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 237.8822326660s, input_fired_time: 2.9232416153, output_fired_time: 2.6501376629, propagate_forward_time: 89.1678695679, propagate_backward_time: 139.1577606201, weight_update_time: 0.1913464218, other_time: 3.9832305908
epoch time: 18.4019222260s, input_fired_time: 0.4420406818, output_fired_time: 0.0000000000, propagate_forward_time: 17.2533702850, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7065105438
validation[          , genome  6904] predictions:    9722/  10000 (97.22%), best:    9809/10000 (98.09%), error:       910.36072, best error:       611.71649 on epoch:    45, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 242.3762817383s, input_fired_time: 2.9938855171, output_fired_time: 2.7178497314, propagate_forward_time: 90.5896530151, propagate_backward_time: 141.9928741455, weight_update_time: 0.1899548620, other_time: 4.0820159912
epoch time: 20.0910739899s, input_fired_time: 0.3795753717, output_fired_time: 0.0000000000, propagate_forward_time: 18.8573989868, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8540992737
validation[          , genome  6904] predictions:    9746/  10000 (97.46%), best:    9809/10000 (98.09%), error:       834.10089, best error:       611.71649 on epoch:    45, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 237.8882598877s, input_fired_time: 2.9009168148, output_fired_time: 2.8166580200, propagate_forward_time: 89.5739517212, propagate_backward_time: 138.5359802246, weight_update_time: 0.1899624616, other_time: 4.0607604980
epoch time: 18.5235614777s, input_fired_time: 0.3641418815, output_fired_time: 0.0000000000, propagate_forward_time: 17.4258518219, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7335681915
validation[          , genome  6904] predictions:    9802/  10000 (98.02%), best:    9809/10000 (98.09%), error:       647.83716, best error:       611.71649 on epoch:    45, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 241.5239715576s, input_fired_time: 3.0896778107, output_fired_time: 2.7052540779, propagate_forward_time: 90.6329193115, propagate_backward_time: 140.8511962891, weight_update_time: 0.1944317520, other_time: 4.2449188232
epoch time: 19.7091999054s, input_fired_time: 0.3690305650, output_fired_time: 0.0000000000, propagate_forward_time: 18.6008968353, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7392730713
validation[          , genome  6904] predictions:    9813/  10000 (98.13%), best:    9809/10000 (98.09%), error:       634.63892, best error:       611.71649 on epoch:    45, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 245.4694671631s, input_fired_time: 3.1471965313, output_fired_time: 2.8485486507, propagate_forward_time: 91.1595230103, propagate_backward_time: 144.2496490479, weight_update_time: 0.2997381985, other_time: 4.0645599365
epoch time: 19.7325572968s, input_fired_time: 0.3598983884, output_fired_time: 0.0000000000, propagate_forward_time: 18.6519126892, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7207469940
validation[          , genome  6904] predictions:    9788/  10000 (97.88%), best:    9809/10000 (98.09%), error:       724.53314, best error:       611.71649 on epoch:    45, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 243.0840606689s, input_fired_time: 3.0412948132, output_fired_time: 2.8728854656, propagate_forward_time: 91.3083801270, propagate_backward_time: 141.8527984619, weight_update_time: 0.1933104694, other_time: 4.0087127686
epoch time: 19.9950218201s, input_fired_time: 0.3821154535, output_fired_time: 0.0000000000, propagate_forward_time: 18.8538036346, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7591018677
validation[          , genome  6904] predictions:    9799/  10000 (97.99%), best:    9809/10000 (98.09%), error:       640.45892, best error:       611.71649 on epoch:    45, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 239.6607208252s, input_fired_time: 3.0268583298, output_fired_time: 2.6269752979, propagate_forward_time: 89.6485290527, propagate_backward_time: 140.1745758057, weight_update_time: 0.1899814606, other_time: 4.1837921143
epoch time: 18.1001720428s, input_fired_time: 0.3456200659, output_fired_time: 0.0000000000, propagate_forward_time: 16.9288730621, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8256797791
validation[          , genome  6904] predictions:    9785/  10000 (97.85%), best:    9809/10000 (98.09%), error:       711.36896, best error:       611.71649 on epoch:    45, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 235.0514068604s, input_fired_time: 2.9963328838, output_fired_time: 2.5904238224, propagate_forward_time: 87.4691619873, propagate_backward_time: 137.9664306641, weight_update_time: 0.1883441061, other_time: 4.0290527344
epoch time: 17.6844234467s, input_fired_time: 0.3469849825, output_fired_time: 0.0000000000, propagate_forward_time: 16.6410903931, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6963481903
validation[          , genome  6904] predictions:    9714/  10000 (97.14%), best:    9809/10000 (98.09%), error:       926.49310, best error:       611.71649 on epoch:    45, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 231.2677154541s, input_fired_time: 2.9708287716, output_fired_time: 2.6365864277, propagate_forward_time: 85.7483444214, propagate_backward_time: 136.0459289551, weight_update_time: 0.1841753274, other_time: 3.8660278320
epoch time: 17.9471378326s, input_fired_time: 0.3422330618, output_fired_time: 0.0000000000, propagate_forward_time: 16.9172401428, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6876640320
validation[          , genome  6904] predictions:    9797/  10000 (97.97%), best:    9809/10000 (98.09%), error:       704.69830, best error:       611.71649 on epoch:    45, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 231.1064300537s, input_fired_time: 3.2046670914, output_fired_time: 2.6713922024, propagate_forward_time: 85.9770355225, propagate_backward_time: 135.3717803955, weight_update_time: 0.1847989112, other_time: 3.8815612793
epoch time: 17.6989917755s, input_fired_time: 0.3509347439, output_fired_time: 0.0000000000, propagate_forward_time: 16.6455497742, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7025070190
validation[          , genome  6904] predictions:    9803/  10000 (98.03%), best:    9809/10000 (98.09%), error:       704.55438, best error:       611.71649 on epoch:    45, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 236.5814361572s, input_fired_time: 3.1859221458, output_fired_time: 3.0991735458, propagate_forward_time: 87.9143600464, propagate_backward_time: 138.0181579590, weight_update_time: 0.3026884198, other_time: 4.3638305664
epoch time: 20.5933265686s, input_fired_time: 0.3834614456, output_fired_time: 0.0000000000, propagate_forward_time: 19.4478569031, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7620086670
validation[          , genome  6904] predictions:    9828/  10000 (98.28%), best:    9809/10000 (98.09%), error:       638.88031, best error:       611.71649 on epoch:    45, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 372.7745361328s, input_fired_time: 4.6274614334, output_fired_time: 4.2235336304, propagate_forward_time: 136.8249053955, propagate_backward_time: 220.8721923828, weight_update_time: 0.2053287476, other_time: 6.2264251709
epoch time: 29.0588302612s, input_fired_time: 0.3941450715, output_fired_time: 0.0000000000, propagate_forward_time: 27.8884925842, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7761917114
validation[          , genome  6904] predictions:    9776/  10000 (97.76%), best:    9809/10000 (98.09%), error:       749.46582, best error:       611.71649 on epoch:    45, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 392.2552795410s, input_fired_time: 5.3971910477, output_fired_time: 5.4037485123, propagate_forward_time: 143.9933319092, propagate_backward_time: 230.7900695801, weight_update_time: 0.3325230777, other_time: 6.6709442139
epoch time: 29.4666519165s, input_fired_time: 0.5192773938, output_fired_time: 0.0000000000, propagate_forward_time: 27.4176940918, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5296802521
validation[          , genome  6904] predictions:    9818/  10000 (98.18%), best:    9809/10000 (98.09%), error:       657.77283, best error:       611.71649 on epoch:    45, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 370.6420593262s, input_fired_time: 6.2538361549, output_fired_time: 4.4750494957, propagate_forward_time: 149.4452667236, propagate_backward_time: 204.1245269775, weight_update_time: 0.2073900700, other_time: 6.3433837891
epoch time: 29.1190948486s, input_fired_time: 0.6438061595, output_fired_time: 0.0000000000, propagate_forward_time: 27.6338901520, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8413982391
validation[          , genome  6904] predictions:    9785/  10000 (97.85%), best:    9809/10000 (98.09%), error:       739.65106, best error:       611.71649 on epoch:    45, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 381.3453063965s, input_fired_time: 4.8057594299, output_fired_time: 4.1860494614, propagate_forward_time: 142.8824615479, propagate_backward_time: 223.2447967529, weight_update_time: 0.2852021456, other_time: 6.2262573242
epoch time: 29.8269748688s, input_fired_time: 0.3918768764, output_fired_time: 0.0000000000, propagate_forward_time: 28.3130741119, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1220245361
validation[          , genome  6904] predictions:    9811/  10000 (98.11%), best:    9809/10000 (98.09%), error:       638.07635, best error:       611.71649 on epoch:    45, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 360.7172851563s, input_fired_time: 3.9937062263, output_fired_time: 4.8083977699, propagate_forward_time: 132.2574768066, propagate_backward_time: 214.1958923340, weight_update_time: 0.2073665261, other_time: 5.4617919922
epoch time: 28.8163623810s, input_fired_time: 0.6432688832, output_fired_time: 0.0000000000, propagate_forward_time: 27.3322048187, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8408889771
validation[          , genome  6904] predictions:    9804/  10000 (98.04%), best:    9809/10000 (98.09%), error:       652.09827, best error:       611.71649 on epoch:    45, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 364.0171813965s, input_fired_time: 3.5821349621, output_fired_time: 4.7903275490, propagate_forward_time: 132.8044281006, propagate_backward_time: 216.0109863281, weight_update_time: 0.2071130276, other_time: 6.8293304443
epoch time: 28.7556419373s, input_fired_time: 0.3961085677, output_fired_time: 0.0000000000, propagate_forward_time: 27.5369815826, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8225517273
validation[          , genome  6904] predictions:    9613/  10000 (96.13%), best:    9809/10000 (98.09%), error:      1275.49866, best error:       611.71649 on epoch:    45, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 359.5640869141s, input_fired_time: 4.2143516541, output_fired_time: 4.5811548233, propagate_forward_time: 137.2555236816, propagate_backward_time: 208.1456451416, weight_update_time: 0.2070705891, other_time: 5.3674163818
epoch time: 29.0841197968s, input_fired_time: 0.4849194288, output_fired_time: 0.0000000000, propagate_forward_time: 27.5404052734, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0587959290
validation[          , genome  6904] predictions:    9818/  10000 (98.18%), best:    9809/10000 (98.09%), error:       637.34064, best error:       611.71649 on epoch:    45, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 351.1203613281s, input_fired_time: 4.7680530548, output_fired_time: 4.0611329079, propagate_forward_time: 126.7122421265, propagate_backward_time: 209.8779907227, weight_update_time: 0.2072078139, other_time: 5.7009277344
epoch time: 29.6914749146s, input_fired_time: 0.3957409561, output_fired_time: 0.0000000000, propagate_forward_time: 28.4366264343, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8591079712
validation[          , genome  6904] predictions:    9625/  10000 (96.25%), best:    9809/10000 (98.09%), error:      1207.48206, best error:       611.71649 on epoch:    45, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 355.1633911133s, input_fired_time: 4.6048994064, output_fired_time: 3.6380829811, propagate_forward_time: 141.1141052246, propagate_backward_time: 200.3770141602, weight_update_time: 0.2070987523, other_time: 5.4292907715
epoch time: 28.4744396210s, input_fired_time: 0.3923238814, output_fired_time: 0.0000000000, propagate_forward_time: 26.4906387329, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5914764404
validation[          , genome  6904] predictions:    9819/  10000 (98.19%), best:    9819/10000 (98.19%), error:       602.62988, best error:       602.62988 on epoch:    69, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 357.4376831055s, input_fired_time: 4.3160429001, output_fired_time: 4.0604472160, propagate_forward_time: 137.8499755859, propagate_backward_time: 205.6528778076, weight_update_time: 0.2076193988, other_time: 5.5583343506
epoch time: 28.7083835602s, input_fired_time: 0.6453208327, output_fired_time: 0.0000000000, propagate_forward_time: 27.2374248505, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8256378174
validation[          , genome  6904] predictions:    9808/  10000 (98.08%), best:    9819/10000 (98.19%), error:       640.17834, best error:       602.62988 on epoch:    69, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 352.2796630859s, input_fired_time: 3.7093420029, output_fired_time: 3.7965099812, propagate_forward_time: 120.9530944824, propagate_backward_time: 219.2449188232, weight_update_time: 0.2070854008, other_time: 4.5757904053
epoch time: 28.0016670227s, input_fired_time: 0.9256500006, output_fired_time: 0.0000000000, propagate_forward_time: 26.0134220123, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0625953674
validation[          , genome  6904] predictions:    9816/  10000 (98.16%), best:    9819/10000 (98.19%), error:       643.74036, best error:       602.62988 on epoch:    69, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 355.8254089355s, input_fired_time: 5.4704208374, output_fired_time: 3.7797293663, propagate_forward_time: 130.0401916504, propagate_backward_time: 211.6285400391, weight_update_time: 0.2076993287, other_time: 4.9065246582
epoch time: 27.7575531006s, input_fired_time: 0.3933390379, output_fired_time: 0.0000000000, propagate_forward_time: 26.0863876343, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2778263092
validation[          , genome  6904] predictions:    9798/  10000 (97.98%), best:    9819/10000 (98.19%), error:       700.59790, best error:       602.62988 on epoch:    69, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 365.8760986328s, input_fired_time: 4.7971072197, output_fired_time: 4.3626604080, propagate_forward_time: 139.8132476807, propagate_backward_time: 210.7801208496, weight_update_time: 0.2074463516, other_time: 6.1229400635
epoch time: 27.8308219910s, input_fired_time: 0.6462842226, output_fired_time: 0.0000000000, propagate_forward_time: 25.8931064606, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2914314270
validation[          , genome  6904] predictions:    9819/  10000 (98.19%), best:    9819/10000 (98.19%), error:       606.10669, best error:       602.62988 on epoch:    69, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 365.1449890137s, input_fired_time: 5.3361954689, output_fired_time: 4.2934026718, propagate_forward_time: 140.9163055420, propagate_backward_time: 208.5622406006, weight_update_time: 0.4727765620, other_time: 6.0368652344
epoch time: 28.1083717346s, input_fired_time: 0.6470787525, output_fired_time: 0.0000000000, propagate_forward_time: 26.4334602356, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0278320313
validation[          , genome  6904] predictions:    9752/  10000 (97.52%), best:    9819/10000 (98.19%), error:       781.09595, best error:       602.62988 on epoch:    69, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 350.1208801270s, input_fired_time: 4.8282756805, output_fired_time: 3.7549612522, propagate_forward_time: 131.4745788574, propagate_backward_time: 205.1508636475, weight_update_time: 0.2539734542, other_time: 4.9121856689
epoch time: 33.8167114258s, input_fired_time: 0.9128091335, output_fired_time: 0.0000000000, propagate_forward_time: 31.2926559448, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6112480164
validation[          , genome  6904] predictions:    9762/  10000 (97.62%), best:    9819/10000 (98.19%), error:       790.37439, best error:       602.62988 on epoch:    69, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 351.6933288574s, input_fired_time: 5.7546653748, output_fired_time: 4.5787572861, propagate_forward_time: 132.7415924072, propagate_backward_time: 201.4881744385, weight_update_time: 0.2068765014, other_time: 7.1301269531
epoch time: 28.0753593445s, input_fired_time: 0.3935286403, output_fired_time: 0.0000000000, propagate_forward_time: 26.8977222443, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7841091156
validation[          , genome  6904] predictions:    9816/  10000 (98.16%), best:    9819/10000 (98.19%), error:       624.43604, best error:       602.62988 on epoch:    69, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 360.8485107422s, input_fired_time: 5.2894506454, output_fired_time: 4.2292284966, propagate_forward_time: 139.2845916748, propagate_backward_time: 205.9882659912, weight_update_time: 0.2072220892, other_time: 6.0569763184
epoch time: 29.9990196228s, input_fired_time: 0.4104176760, output_fired_time: 0.0000000000, propagate_forward_time: 28.3607978821, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2278041840
validation[          , genome  6904] predictions:    9829/  10000 (98.29%), best:    9829/10000 (98.29%), error:       592.97644, best error:       592.97644 on epoch:    77, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 353.4028625488s, input_fired_time: 4.7732858658, output_fired_time: 3.2003824711, propagate_forward_time: 133.2850494385, propagate_backward_time: 205.8455352783, weight_update_time: 0.2067976594, other_time: 6.2986145020
epoch time: 28.0503482819s, input_fired_time: 0.4431656003, output_fired_time: 0.0000000000, propagate_forward_time: 26.3137493134, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2934341431
validation[          , genome  6904] predictions:    9821/  10000 (98.21%), best:    9829/10000 (98.29%), error:       617.43329, best error:       592.97644 on epoch:    77, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 349.3459167480s, input_fired_time: 3.8101389408, output_fired_time: 4.2190976143, propagate_forward_time: 127.0004577637, propagate_backward_time: 209.1029205322, weight_update_time: 0.2540334165, other_time: 5.2133026123
epoch time: 29.2777938843s, input_fired_time: 0.3941722214, output_fired_time: 0.0000000000, propagate_forward_time: 27.6665267944, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2170944214
validation[          , genome  6904] predictions:    9802/  10000 (98.02%), best:    9829/10000 (98.29%), error:       675.92419, best error:       592.97644 on epoch:    77, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 355.0212707520s, input_fired_time: 3.7909188271, output_fired_time: 5.4474163055, propagate_forward_time: 133.8233184814, propagate_backward_time: 206.0691375732, weight_update_time: 0.2541141808, other_time: 5.8904724121
epoch time: 28.3968582153s, input_fired_time: 0.3947886229, output_fired_time: 0.0000000000, propagate_forward_time: 26.8942222595, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1078472137
validation[          , genome  6904] predictions:    9733/  10000 (97.33%), best:    9829/10000 (98.29%), error:       883.71503, best error:       592.97644 on epoch:    77, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 359.0794982910s, input_fired_time: 3.6746344566, output_fired_time: 4.3321242332, propagate_forward_time: 138.6028747559, propagate_backward_time: 206.6772460938, weight_update_time: 0.2069748044, other_time: 5.7926330566
epoch time: 28.3089942932s, input_fired_time: 0.4095963836, output_fired_time: 0.0000000000, propagate_forward_time: 27.0905208588, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8088779449
validation[          , genome  6904] predictions:    9788/  10000 (97.88%), best:    9829/10000 (98.29%), error:       736.34747, best error:       592.97644 on epoch:    77, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 333.5616455078s, input_fired_time: 4.0937352180, output_fired_time: 3.3544654846, propagate_forward_time: 123.3922958374, propagate_backward_time: 196.5048065186, weight_update_time: 0.4553346634, other_time: 6.2163238525
epoch time: 26.4635143280s, input_fired_time: 0.6405300498, output_fired_time: 0.0000000000, propagate_forward_time: 24.8015251160, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0214595795
validation[          , genome  6904] predictions:    9785/  10000 (97.85%), best:    9829/10000 (98.29%), error:       737.68341, best error:       592.97644 on epoch:    77, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 326.6661682129s, input_fired_time: 3.8028435707, output_fired_time: 4.2957801819, propagate_forward_time: 121.4106826782, propagate_backward_time: 191.7299346924, weight_update_time: 0.4523617029, other_time: 5.4269256592
epoch time: 24.7255096436s, input_fired_time: 0.8728035092, output_fired_time: 0.0000000000, propagate_forward_time: 23.1116600037, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7410469055
validation[          , genome  6904] predictions:    9813/  10000 (98.13%), best:    9829/10000 (98.29%), error:       656.48108, best error:       592.97644 on epoch:    77, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 324.7313537598s, input_fired_time: 5.0524535179, output_fired_time: 3.7828500271, propagate_forward_time: 122.3358688354, propagate_backward_time: 187.9470214844, weight_update_time: 0.1992107928, other_time: 5.6131591797
epoch time: 26.2109451294s, input_fired_time: 0.3860363960, output_fired_time: 0.0000000000, propagate_forward_time: 24.5591125488, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2657966614
validation[          , genome  6904] predictions:    9830/  10000 (98.30%), best:    9829/10000 (98.29%), error:       603.18518, best error:       592.97644 on epoch:    77, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 318.6442260742s, input_fired_time: 3.2600774765, output_fired_time: 3.4740512371, propagate_forward_time: 116.0556106567, propagate_backward_time: 189.5206451416, weight_update_time: 0.6972834468, other_time: 6.3338470459
epoch time: 25.1293506622s, input_fired_time: 0.6251696944, output_fired_time: 0.0000000000, propagate_forward_time: 23.2598094940, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2443714142
validation[          , genome  6904] predictions:    9805/  10000 (98.05%), best:    9829/10000 (98.29%), error:       655.67914, best error:       592.97644 on epoch:    77, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 321.5723876953s, input_fired_time: 4.2754831314, output_fired_time: 3.5018658638, propagate_forward_time: 125.9391403198, propagate_backward_time: 181.7488708496, weight_update_time: 0.1991427541, other_time: 6.1070251465
epoch time: 25.0522098541s, input_fired_time: 0.3760026097, output_fired_time: 0.0000000000, propagate_forward_time: 23.4343910217, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2418155670
validation[          , genome  6904] predictions:    9805/  10000 (98.05%), best:    9829/10000 (98.29%), error:       679.87189, best error:       592.97644 on epoch:    77, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 318.2928466797s, input_fired_time: 4.5146479607, output_fired_time: 3.7056684494, propagate_forward_time: 120.4242477417, propagate_backward_time: 184.5550231934, weight_update_time: 0.1971975565, other_time: 5.0932617188
epoch time: 25.6462745667s, input_fired_time: 0.3813392222, output_fired_time: 0.0000000000, propagate_forward_time: 24.0229644775, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2419700623
validation[          , genome  6904] predictions:    9811/  10000 (98.11%), best:    9829/10000 (98.29%), error:       658.34003, best error:       592.97644 on epoch:    77, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 316.2111206055s, input_fired_time: 4.5023441315, output_fired_time: 3.9535033703, propagate_forward_time: 113.2055053711, propagate_backward_time: 188.9929809570, weight_update_time: 0.1957352906, other_time: 5.5567932129
epoch time: 24.9728050232s, input_fired_time: 0.8758132458, output_fired_time: 0.0000000000, propagate_forward_time: 23.1143188477, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9826736450
validation[          , genome  6904] predictions:    9819/  10000 (98.19%), best:    9829/10000 (98.29%), error:       634.93066, best error:       592.97644 on epoch:    77, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 319.5586853027s, input_fired_time: 4.0191631317, output_fired_time: 2.9927983284, propagate_forward_time: 121.7558746338, propagate_backward_time: 184.9608154297, weight_update_time: 0.1968796402, other_time: 5.8300323486
epoch time: 25.5541439056s, input_fired_time: 0.6284218431, output_fired_time: 0.0000000000, propagate_forward_time: 23.9301261902, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9955959320
validation[          , genome  6904] predictions:    9837/  10000 (98.37%), best:    9829/10000 (98.29%), error:       608.37189, best error:       592.97644 on epoch:    77, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 320.0652465820s, input_fired_time: 4.0273404121, output_fired_time: 3.2400863171, propagate_forward_time: 125.4844665527, propagate_backward_time: 181.4676055908, weight_update_time: 0.6975965500, other_time: 5.8457489014
epoch time: 25.2544097900s, input_fired_time: 0.3785007596, output_fired_time: 0.0000000000, propagate_forward_time: 24.1325263977, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7433834076
validation[          , genome  6904] predictions:    9839/  10000 (98.39%), best:    9829/10000 (98.29%), error:       596.20001, best error:       592.97644 on epoch:    77, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 320.0171508789s, input_fired_time: 4.5351686478, output_fired_time: 3.2334358692, propagate_forward_time: 119.5598831177, propagate_backward_time: 187.3564147949, weight_update_time: 0.4467256963, other_time: 5.3322753906
epoch time: 25.7749481201s, input_fired_time: 0.8813728690, output_fired_time: 0.0000000000, propagate_forward_time: 23.3756103516, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5179653168
validation[          , genome  6904] predictions:    9820/  10000 (98.20%), best:    9829/10000 (98.29%), error:       644.76135, best error:       592.97644 on epoch:    77, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 317.7095947266s, input_fired_time: 4.5204339027, output_fired_time: 3.4659359455, propagate_forward_time: 121.0923385620, propagate_backward_time: 182.8364410400, weight_update_time: 0.4446724355, other_time: 5.7944183350
epoch time: 24.8368549347s, input_fired_time: 0.8729631901, output_fired_time: 0.0000000000, propagate_forward_time: 22.9769229889, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9869689941
validation[          , genome  6904] predictions:    9816/  10000 (98.16%), best:    9829/10000 (98.29%), error:       638.21808, best error:       592.97644 on epoch:    77, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 316.5226745605s, input_fired_time: 4.5130133629, output_fired_time: 3.7167568207, propagate_forward_time: 118.1857986450, propagate_backward_time: 184.2919311523, weight_update_time: 0.1955054551, other_time: 5.8151855469
epoch time: 25.8768196106s, input_fired_time: 0.8853582144, output_fired_time: 0.0000000000, propagate_forward_time: 23.9914093018, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0000514984
validation[          , genome  6904] predictions:    9819/  10000 (98.19%), best:    9829/10000 (98.29%), error:       661.25000, best error:       592.97644 on epoch:    77, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 324.1343688965s, input_fired_time: 3.8022537231, output_fired_time: 3.2618958950, propagate_forward_time: 119.5955276489, propagate_backward_time: 192.6109313965, weight_update_time: 0.1997934431, other_time: 4.8637695313
epoch time: 25.9281978607s, input_fired_time: 0.3853416145, output_fired_time: 0.0000000000, propagate_forward_time: 24.7881546021, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7547016144
validation[          , genome  6904] predictions:    9838/  10000 (98.38%), best:    9829/10000 (98.29%), error:       601.65997, best error:       592.97644 on epoch:    77, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 325.0701599121s, input_fired_time: 4.5499210358, output_fired_time: 3.7709875107, propagate_forward_time: 117.1456222534, propagate_backward_time: 192.9719085693, weight_update_time: 0.2001964003, other_time: 6.6316986084
epoch time: 26.3459815979s, input_fired_time: 0.6409603357, output_fired_time: 0.0000000000, propagate_forward_time: 24.9386672974, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7663536072
validation[          , genome  6904] predictions:    9816/  10000 (98.16%), best:    9829/10000 (98.29%), error:       629.72473, best error:       592.97644 on epoch:    77, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 323.4730529785s, input_fired_time: 4.5629687309, output_fired_time: 3.2806565762, propagate_forward_time: 115.8838806152, propagate_backward_time: 194.3743133545, weight_update_time: 0.2003326118, other_time: 5.3712310791
epoch time: 25.9219245911s, input_fired_time: 0.6352947354, output_fired_time: 0.0000000000, propagate_forward_time: 23.7825279236, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5041027069
validation[          , genome  6904] predictions:    9781/  10000 (97.81%), best:    9829/10000 (98.29%), error:       761.69299, best error:       592.97644 on epoch:    77, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 326.5650634766s, input_fired_time: 3.5708408356, output_fired_time: 3.3014087677, propagate_forward_time: 116.6590957642, propagate_backward_time: 197.3645019531, weight_update_time: 0.2017637044, other_time: 5.6692199707
epoch time: 26.2316780090s, input_fired_time: 0.3888969123, output_fired_time: 0.0000000000, propagate_forward_time: 25.0785999298, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7641811371
validation[          , genome  6904] predictions:    9822/  10000 (98.22%), best:    9829/10000 (98.29%), error:       638.94312, best error:       592.97644 on epoch:    77, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 326.1109313965s, input_fired_time: 3.8131585121, output_fired_time: 3.5488431454, propagate_forward_time: 118.2655258179, propagate_backward_time: 194.8423156738, weight_update_time: 0.2011353672, other_time: 5.6410827637
epoch time: 25.9952983856s, input_fired_time: 0.8882361650, output_fired_time: 0.0000000000, propagate_forward_time: 24.1009864807, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0060749054
validation[          , genome  6904] predictions:    9827/  10000 (98.27%), best:    9829/10000 (98.29%), error:       627.28827, best error:       592.97644 on epoch:    77, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 323.6453552246s, input_fired_time: 3.5480363369, output_fired_time: 3.0021975040, propagate_forward_time: 120.9921798706, propagate_backward_time: 190.4782562256, weight_update_time: 0.1994805932, other_time: 5.6246795654
epoch time: 25.2954826355s, input_fired_time: 0.3803634048, output_fired_time: 0.0000000000, propagate_forward_time: 23.6645793915, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2505397797
validation[          , genome  6904] predictions:    9792/  10000 (97.92%), best:    9829/10000 (98.29%), error:       722.20123, best error:       592.97644 on epoch:    77, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 323.2364501953s, input_fired_time: 4.0486893654, output_fired_time: 4.7600264549, propagate_forward_time: 123.8966751099, propagate_backward_time: 184.9236907959, weight_update_time: 0.1987172812, other_time: 5.6073760986
epoch time: 25.3176403046s, input_fired_time: 0.3815496862, output_fired_time: 0.0000000000, propagate_forward_time: 24.1829109192, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7531795502
validation[          , genome  6904] predictions:    9829/  10000 (98.29%), best:    9829/10000 (98.29%), error:       621.35962, best error:       592.97644 on epoch:    77, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 126.7968902588s, input_fired_time: 3.3914117813, output_fired_time: 0.0000000000, propagate_forward_time: 118.3611831665, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.0442962646
best training[          , genome  6904] predictions:   49826/  50000 (99.65%), best:    9829/10000 (98.29%), error:       912.44916, best error:       592.97644 on epoch:    77, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 25.3245201111s, input_fired_time: 0.3765560687, output_fired_time: 0.0000000000, propagate_forward_time: 24.2011966705, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7467670441
   testing[          , genome  6904] predictions:    9840/  10000 (98.40%), best:    9829/10000 (98.29%), error:       539.01233, best error:       592.97644 on epoch:    77, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
20:06:18 (9552): called boinc_finish(0)

</stderr_txt>
]]>