Nameexact_genome_1512568488_41_6898_0
Workunit2605730
Created7 Dec 2017, 22:35:13 UTC
Sent7 Dec 2017, 22:44:24 UTC
Report deadline16 Dec 2017, 2:10:24 UTC
Received8 Dec 2017, 2:42:56 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID65288
Run time1 hours 44 min 45 sec
CPU time1 hours 40 min 59 sec
Validate stateValid
Credit2,035.77
Device peak FLOPS4.42 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size156.43 MB
Peak swap size160.04 MB
Peak disk usage1.84 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
time: 0.0000000000, propagate_forward_time: 3.5595505238, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2676291466
validation[          , genome  6898] predictions:    9623/  10000 (96.23%), best:    9659/10000 (96.59%), error:      1264.36597, best error:      1171.03699 on epoch:     6, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 56.8320846558s, input_fired_time: 0.7026405334, output_fired_time: 0.5044787526, propagate_forward_time: 16.3566665649, propagate_backward_time: 38.0896492004, weight_update_time: 0.0554279871, other_time: 1.1786499023
epoch time: 3.5188994408s, input_fired_time: 0.0744910687, output_fired_time: 0.0000000000, propagate_forward_time: 3.2375664711, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2068419456
validation[          , genome  6898] predictions:    9663/  10000 (96.63%), best:    9663/10000 (96.63%), error:      1139.88647, best error:      1139.88647 on epoch:    15, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 56.7787094116s, input_fired_time: 0.7009401917, output_fired_time: 0.5022088289, propagate_forward_time: 16.1814746857, propagate_backward_time: 38.2164077759, weight_update_time: 0.0555487908, other_time: 1.1776809692
epoch time: 3.4977631569s, input_fired_time: 0.0772932619, output_fired_time: 0.0000000000, propagate_forward_time: 3.2123994827, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2080705166
validation[          , genome  6898] predictions:    9633/  10000 (96.33%), best:    9663/10000 (96.63%), error:      1227.52844, best error:      1139.88647 on epoch:    15, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 57.0437126160s, input_fired_time: 0.7061970830, output_fired_time: 0.4948984981, propagate_forward_time: 16.4628467560, propagate_backward_time: 38.2006111145, weight_update_time: 0.0581825748, other_time: 1.1791572571
epoch time: 3.4881455898s, input_fired_time: 0.0753534511, output_fired_time: 0.0000000000, propagate_forward_time: 3.2026071548, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2101850510
validation[          , genome  6898] predictions:    9572/  10000 (95.72%), best:    9663/10000 (96.63%), error:      1432.26831, best error:      1139.88647 on epoch:    15, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 56.7276382446s, input_fired_time: 0.7102552056, output_fired_time: 0.4896999300, propagate_forward_time: 16.2170410156, propagate_backward_time: 38.1191329956, weight_update_time: 0.0554516241, other_time: 1.1915092468
epoch time: 3.4838769436s, input_fired_time: 0.0751983970, output_fired_time: 0.0000000000, propagate_forward_time: 3.2009086609, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2077698708
validation[          , genome  6898] predictions:    9651/  10000 (96.51%), best:    9663/10000 (96.63%), error:      1170.88672, best error:      1139.88647 on epoch:    15, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 56.7087478638s, input_fired_time: 0.7084416151, output_fired_time: 0.4949164391, propagate_forward_time: 16.0688705444, propagate_backward_time: 38.2559700012, weight_update_time: 0.0554120764, other_time: 1.1805496216
epoch time: 3.4766650200s, input_fired_time: 0.0742513388, output_fired_time: 0.0000000000, propagate_forward_time: 3.1949746609, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2074389458
validation[          , genome  6898] predictions:    9590/  10000 (95.90%), best:    9663/10000 (96.63%), error:      1313.59021, best error:      1139.88647 on epoch:    15, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 56.7253227234s, input_fired_time: 0.7031581402, output_fired_time: 0.4863630235, propagate_forward_time: 16.1621494293, propagate_backward_time: 38.1905479431, weight_update_time: 0.0617204085, other_time: 1.1831016541
epoch time: 3.4968898296s, input_fired_time: 0.0749292225, output_fired_time: 0.0000000000, propagate_forward_time: 3.2157700062, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2061905861
validation[          , genome  6898] predictions:    9651/  10000 (96.51%), best:    9663/10000 (96.63%), error:      1168.86890, best error:      1139.88647 on epoch:    15, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 56.9494400024s, input_fired_time: 0.7346534729, output_fired_time: 0.5114259720, propagate_forward_time: 16.1130390167, propagate_backward_time: 38.4029808044, weight_update_time: 0.0551830940, other_time: 1.1873435974
epoch time: 3.5107793808s, input_fired_time: 0.0769777521, output_fired_time: 0.0000000000, propagate_forward_time: 3.2244231701, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2093784809
validation[          , genome  6898] predictions:    9706/  10000 (97.06%), best:    9706/10000 (97.06%), error:      1020.20807, best error:      1020.20807 on epoch:    21, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 56.7053451538s, input_fired_time: 0.7144073844, output_fired_time: 0.4881196916, propagate_forward_time: 16.0266151428, propagate_backward_time: 38.2977027893, weight_update_time: 0.0550775528, other_time: 1.1784973145
epoch time: 3.5967302322s, input_fired_time: 0.0824943632, output_fired_time: 0.0000000000, propagate_forward_time: 3.3057587147, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2084772587
validation[          , genome  6898] predictions:    9637/  10000 (96.37%), best:    9706/10000 (97.06%), error:      1184.30530, best error:      1020.20807 on epoch:    21, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 56.8341140747s, input_fired_time: 0.7192251086, output_fired_time: 0.4988703430, propagate_forward_time: 16.0596427917, propagate_backward_time: 38.3722114563, weight_update_time: 0.0550538488, other_time: 1.1841621399
epoch time: 3.5346181393s, input_fired_time: 0.0752777159, output_fired_time: 0.0000000000, propagate_forward_time: 3.2502419949, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2090983391
validation[          , genome  6898] predictions:    9601/  10000 (96.01%), best:    9706/10000 (97.06%), error:      1252.79456, best error:      1020.20807 on epoch:    21, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 56.6991996765s, input_fired_time: 0.7059157491, output_fired_time: 0.4932492971, propagate_forward_time: 16.0375671387, propagate_backward_time: 38.2793350220, weight_update_time: 0.0550470129, other_time: 1.1831321716
epoch time: 3.9453136921s, input_fired_time: 0.0824520066, output_fired_time: 0.0000000000, propagate_forward_time: 3.6463801861, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2164814472
validation[          , genome  6898] predictions:    9632/  10000 (96.32%), best:    9706/10000 (97.06%), error:      1171.67957, best error:      1020.20807 on epoch:    21, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 56.8481941223s, input_fired_time: 0.7051280737, output_fired_time: 0.4904707968, propagate_forward_time: 16.0740680695, propagate_backward_time: 38.3887062073, weight_update_time: 0.0561701544, other_time: 1.1898231506
epoch time: 3.4648742676s, input_fired_time: 0.0751956701, output_fired_time: 0.0000000000, propagate_forward_time: 3.1825895309, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2070889473
validation[          , genome  6898] predictions:    9674/  10000 (96.74%), best:    9706/10000 (97.06%), error:      1084.84534, best error:      1020.20807 on epoch:    21, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 56.8493728638s, input_fired_time: 0.7046822309, output_fired_time: 0.4890047312, propagate_forward_time: 16.3981018066, propagate_backward_time: 38.0740661621, weight_update_time: 0.0549899079, other_time: 1.1835174561
epoch time: 3.4836249352s, input_fired_time: 0.0757013559, output_fired_time: 0.0000000000, propagate_forward_time: 3.2010083199, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2069153786
validation[          , genome  6898] predictions:    9666/  10000 (96.66%), best:    9706/10000 (97.06%), error:      1127.72693, best error:      1020.20807 on epoch:    21, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 57.0741958618s, input_fired_time: 0.7092610598, output_fired_time: 0.4957110584, propagate_forward_time: 16.4065284729, propagate_backward_time: 38.2713775635, weight_update_time: 0.0588391460, other_time: 1.1913146973
epoch time: 3.4847354889s, input_fired_time: 0.0757963210, output_fired_time: 0.0000000000, propagate_forward_time: 3.2000319958, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2089071274
validation[          , genome  6898] predictions:    9473/  10000 (94.73%), best:    9706/10000 (97.06%), error:      1682.28271, best error:      1020.20807 on epoch:    21, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 56.8701133728s, input_fired_time: 0.7103455067, output_fired_time: 0.5251284838, propagate_forward_time: 16.0986671448, propagate_backward_time: 38.3611030579, weight_update_time: 0.0554423556, other_time: 1.1748695374
epoch time: 3.4570055008s, input_fired_time: 0.0757064521, output_fired_time: 0.0000000000, propagate_forward_time: 3.1694352627, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2118637562
validation[          , genome  6898] predictions:    9705/  10000 (97.05%), best:    9706/10000 (97.06%), error:      1033.38684, best error:      1020.20807 on epoch:    21, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 56.7084922791s, input_fired_time: 0.7049035430, output_fired_time: 0.4864478111, propagate_forward_time: 16.0326747894, propagate_backward_time: 38.2941093445, weight_update_time: 0.0630009472, other_time: 1.1903572083
epoch time: 3.4965569973s, input_fired_time: 0.0760012195, output_fired_time: 0.0000000000, propagate_forward_time: 3.2095727921, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2109830379
validation[          , genome  6898] predictions:    9679/  10000 (96.79%), best:    9706/10000 (97.06%), error:      1076.50928, best error:      1020.20807 on epoch:    21, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 56.7388000488s, input_fired_time: 0.7249728441, output_fired_time: 0.4893019795, propagate_forward_time: 16.0900306702, propagate_backward_time: 38.2578773499, weight_update_time: 0.0552064665, other_time: 1.1766166687
epoch time: 3.4964940548s, input_fired_time: 0.0784647688, output_fired_time: 0.0000000000, propagate_forward_time: 3.2100827694, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2079465389
validation[          , genome  6898] predictions:    9684/  10000 (96.84%), best:    9706/10000 (97.06%), error:      1057.70483, best error:      1020.20807 on epoch:    21, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 57.2334518433s, input_fired_time: 0.7570263743, output_fired_time: 0.4934603572, propagate_forward_time: 16.6404304504, propagate_backward_time: 38.1570892334, weight_update_time: 0.0552396029, other_time: 1.1854438782
epoch time: 3.4768409729s, input_fired_time: 0.0762923732, output_fired_time: 0.0000000000, propagate_forward_time: 3.1896893978, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2108592987
validation[          , genome  6898] predictions:    9618/  10000 (96.18%), best:    9706/10000 (97.06%), error:      1184.88672, best error:      1020.20807 on epoch:    21, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 56.7996215820s, input_fired_time: 0.7115380168, output_fired_time: 0.5003757477, propagate_forward_time: 16.0456314087, propagate_backward_time: 38.3653259277, weight_update_time: 0.0552076846, other_time: 1.1767501831
epoch time: 3.4768457413s, input_fired_time: 0.0763993785, output_fired_time: 0.0000000000, propagate_forward_time: 3.1945433617, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2059030533
validation[          , genome  6898] predictions:    9688/  10000 (96.88%), best:    9688/10000 (96.88%), error:      1002.36945, best error:      1002.36945 on epoch:    32, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 56.7772674561s, input_fired_time: 0.7067980170, output_fired_time: 0.4894842803, propagate_forward_time: 16.0478115082, propagate_backward_time: 38.3501358032, weight_update_time: 0.0553029105, other_time: 1.1830368042
epoch time: 3.4750490189s, input_fired_time: 0.0764720738, output_fired_time: 0.0000000000, propagate_forward_time: 3.1925318241, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2060451508
validation[          , genome  6898] predictions:    9689/  10000 (96.89%), best:    9688/10000 (96.88%), error:      1050.14978, best error:      1002.36945 on epoch:    32, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 57.2846908569s, input_fired_time: 0.7119073272, output_fired_time: 0.4912109971, propagate_forward_time: 16.4894733429, propagate_backward_time: 38.4120979309, weight_update_time: 0.0556073003, other_time: 1.1800041199
epoch time: 3.4913535118s, input_fired_time: 0.0750198513, output_fired_time: 0.0000000000, propagate_forward_time: 3.1931931973, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2231404781
validation[          , genome  6898] predictions:    9517/  10000 (95.17%), best:    9688/10000 (96.88%), error:      1517.22229, best error:      1002.36945 on epoch:    32, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 56.6828842163s, input_fired_time: 0.7060818076, output_fired_time: 0.4871464670, propagate_forward_time: 15.9990882874, propagate_backward_time: 38.3062019348, weight_update_time: 0.0554952584, other_time: 1.1843643188
epoch time: 3.5236077309s, input_fired_time: 0.0770219043, output_fired_time: 0.0000000000, propagate_forward_time: 3.2345299721, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2120559216
validation[          , genome  6898] predictions:    9682/  10000 (96.82%), best:    9688/10000 (96.88%), error:      1078.06091, best error:      1002.36945 on epoch:    32, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 57.1395835876s, input_fired_time: 0.7125230432, output_fired_time: 0.4891465902, propagate_forward_time: 16.1308555603, propagate_backward_time: 38.6152458191, weight_update_time: 0.0585955083, other_time: 1.1918106079
epoch time: 3.4976186752s, input_fired_time: 0.0764633194, output_fired_time: 0.0000000000, propagate_forward_time: 3.2132112980, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2079441547
validation[          , genome  6898] predictions:    9689/  10000 (96.89%), best:    9688/10000 (96.88%), error:      1061.02771, best error:      1002.36945 on epoch:    32, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 57.1327438354s, input_fired_time: 0.7316917777, output_fired_time: 0.4943775237, propagate_forward_time: 16.2680664063, propagate_backward_time: 38.4148101807, weight_update_time: 0.0549922474, other_time: 1.2237968445
epoch time: 3.4780824184s, input_fired_time: 0.0759636909, output_fired_time: 0.0000000000, propagate_forward_time: 3.1958606243, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2062580585
validation[          , genome  6898] predictions:    9683/  10000 (96.83%), best:    9688/10000 (96.88%), error:      1061.10706, best error:      1002.36945 on epoch:    32, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 56.7119636536s, input_fired_time: 0.7125149965, output_fired_time: 0.4880973399, propagate_forward_time: 16.1729602814, propagate_backward_time: 38.1583976746, weight_update_time: 0.0559904277, other_time: 1.1799888611
epoch time: 3.4895298481s, input_fired_time: 0.0767776370, output_fired_time: 0.0000000000, propagate_forward_time: 3.2037184238, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2090337276
validation[          , genome  6898] predictions:    9660/  10000 (96.60%), best:    9688/10000 (96.88%), error:      1073.23047, best error:      1002.36945 on epoch:    32, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 57.1202011108s, input_fired_time: 0.7169058323, output_fired_time: 0.5338346958, propagate_forward_time: 16.2462329865, propagate_backward_time: 38.4320945740, weight_update_time: 0.0553260818, other_time: 1.1911277771
epoch time: 3.4951353073s, input_fired_time: 0.0762972087, output_fired_time: 0.0000000000, propagate_forward_time: 3.2101106644, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2087273598
validation[          , genome  6898] predictions:    9723/  10000 (97.23%), best:    9723/10000 (97.23%), error:       928.48334, best error:       928.48334 on epoch:    39, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 56.8470420837s, input_fired_time: 0.7179055810, output_fired_time: 0.5001831055, propagate_forward_time: 16.2592754364, propagate_backward_time: 38.1664733887, weight_update_time: 0.0549649186, other_time: 1.2032012939
epoch time: 3.4786050320s, input_fired_time: 0.0761406794, output_fired_time: 0.0000000000, propagate_forward_time: 3.1935799122, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2088844776
validation[          , genome  6898] predictions:    9689/  10000 (96.89%), best:    9723/10000 (97.23%), error:      1011.67999, best error:       928.48334 on epoch:    39, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 60.4230232239s, input_fired_time: 0.8800193071, output_fired_time: 0.5429112911, propagate_forward_time: 17.0246295929, propagate_backward_time: 40.6574974060, weight_update_time: 0.0580838099, other_time: 1.3179664612
epoch time: 3.4925000668s, input_fired_time: 0.0759802014, output_fired_time: 0.0000000000, propagate_forward_time: 3.2086286545, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2078912258
validation[          , genome  6898] predictions:    9682/  10000 (96.82%), best:    9723/10000 (97.23%), error:      1060.73669, best error:       928.48334 on epoch:    39, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 57.0327339172s, input_fired_time: 0.7507672906, output_fired_time: 0.4894346595, propagate_forward_time: 16.2138614655, propagate_backward_time: 38.2389640808, weight_update_time: 0.0551380143, other_time: 1.3397102356
epoch time: 3.4805529118s, input_fired_time: 0.0764736161, output_fired_time: 0.0000000000, propagate_forward_time: 3.1957049370, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2083742619
validation[          , genome  6898] predictions:    9703/  10000 (97.03%), best:    9723/10000 (97.23%), error:      1047.29639, best error:       928.48334 on epoch:    39, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 57.2815818787s, input_fired_time: 0.7219778895, output_fired_time: 0.4919882715, propagate_forward_time: 16.1138534546, propagate_backward_time: 38.7619781494, weight_update_time: 0.0551220812, other_time: 1.1917839050
epoch time: 3.4952657223s, input_fired_time: 0.0773263201, output_fired_time: 0.0000000000, propagate_forward_time: 3.1926250458, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2253143787
validation[          , genome  6898] predictions:    9689/  10000 (96.89%), best:    9723/10000 (97.23%), error:      1022.11047, best error:       928.48334 on epoch:    39, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 56.3816909790s, input_fired_time: 0.7222328782, output_fired_time: 0.4927034676, propagate_forward_time: 16.0225944519, propagate_backward_time: 37.9672317505, weight_update_time: 0.0549267866, other_time: 1.1769294739
epoch time: 3.9872415066s, input_fired_time: 0.0925393254, output_fired_time: 0.0000000000, propagate_forward_time: 3.6783015728, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2164006233
validation[          , genome  6898] predictions:    9592/  10000 (95.92%), best:    9723/10000 (97.23%), error:      1250.88342, best error:       928.48334 on epoch:    39, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 56.3229370117s, input_fired_time: 0.7147014141, output_fired_time: 0.4881377518, propagate_forward_time: 16.0532951355, propagate_backward_time: 37.8877563477, weight_update_time: 0.0550418980, other_time: 1.1790466309
epoch time: 3.4869954586s, input_fired_time: 0.0779182464, output_fired_time: 0.0000000000, propagate_forward_time: 3.2013988495, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2076783180
validation[          , genome  6898] predictions:    9647/  10000 (96.47%), best:    9723/10000 (97.23%), error:      1162.20667, best error:       928.48334 on epoch:    39, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 56.8536529541s, input_fired_time: 0.7156656384, output_fired_time: 0.4901130497, propagate_forward_time: 16.2392272949, propagate_backward_time: 38.2287406921, weight_update_time: 0.0548618622, other_time: 1.1799087524
epoch time: 3.6394040585s, input_fired_time: 0.0782764256, output_fired_time: 0.0000000000, propagate_forward_time: 3.3528275490, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2083001137
validation[          , genome  6898] predictions:    9712/  10000 (97.12%), best:    9712/10000 (97.12%), error:       913.68231, best error:       913.68231 on epoch:    46, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 56.6969490051s, input_fired_time: 0.7160419226, output_fired_time: 0.4969528317, propagate_forward_time: 16.1873245239, propagate_backward_time: 38.1168403625, weight_update_time: 0.0561616570, other_time: 1.1797904968
epoch time: 3.5051808357s, input_fired_time: 0.0763089210, output_fired_time: 0.0000000000, propagate_forward_time: 3.2187111378, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2101607323
validation[          , genome  6898] predictions:    9655/  10000 (96.55%), best:    9712/10000 (97.12%), error:      1127.00940, best error:       913.68231 on epoch:    46, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 56.7367706299s, input_fired_time: 0.7270002365, output_fired_time: 0.4937750399, propagate_forward_time: 16.2028160095, propagate_backward_time: 38.1316566467, weight_update_time: 0.0551683940, other_time: 1.1815223694
epoch time: 3.9408392906s, input_fired_time: 0.3463331461, output_fired_time: 0.0000000000, propagate_forward_time: 3.3663804531, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2281258106
validation[          , genome  6898] predictions:    9696/  10000 (96.96%), best:    9712/10000 (97.12%), error:      1039.34729, best error:       913.68231 on epoch:    46, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 56.8096160889s, input_fired_time: 0.7160819769, output_fired_time: 0.4922693670, propagate_forward_time: 16.0407352448, propagate_backward_time: 38.3866386414, weight_update_time: 0.0553258099, other_time: 1.1738929749
epoch time: 3.4927661419s, input_fired_time: 0.0780374706, output_fired_time: 0.0000000000, propagate_forward_time: 3.2067861557, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2079424858
validation[          , genome  6898] predictions:    9091/  10000 (90.91%), best:    9712/10000 (97.12%), error:      3002.24878, best error:       913.68231 on epoch:    46, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

resetting weights to those on epoch: 46
epoch time: 56.2826614380s, input_fired_time: 0.7121366262, output_fired_time: 0.4882522523, propagate_forward_time: 15.9879465103, propagate_backward_time: 37.9142379761, weight_update_time: 0.0551212095, other_time: 1.1800918579
epoch time: 3.5083649158s, input_fired_time: 0.0772710070, output_fired_time: 0.0000000000, propagate_forward_time: 3.2248866558, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2062072754
validation[          , genome  6898] predictions:    9735/  10000 (97.35%), best:    9712/10000 (97.12%), error:       917.53430, best error:       913.68231 on epoch:    46, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 56.7399940491s, input_fired_time: 0.7258886695, output_fired_time: 0.4900568426, propagate_forward_time: 16.3872375488, propagate_backward_time: 37.9579887390, weight_update_time: 0.0556905381, other_time: 1.1788253784
epoch time: 3.5011579990s, input_fired_time: 0.0796771273, output_fired_time: 0.0000000000, propagate_forward_time: 3.2129485607, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2085323334
validation[          , genome  6898] predictions:    9693/  10000 (96.93%), best:    9712/10000 (97.12%), error:      1007.14459, best error:       913.68231 on epoch:    46, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 56.7849464417s, input_fired_time: 0.7289779186, output_fired_time: 0.4891377985, propagate_forward_time: 16.0173549652, propagate_backward_time: 38.3588333130, weight_update_time: 0.0548504852, other_time: 1.1906433105
epoch time: 3.8163249493s, input_fired_time: 0.0777406618, output_fired_time: 0.0000000000, propagate_forward_time: 3.5386772156, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.1999070644
validation[          , genome  6898] predictions:    9714/  10000 (97.14%), best:    9712/10000 (97.12%), error:       996.47156, best error:       913.68231 on epoch:    46, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 56.7593421936s, input_fired_time: 0.7427537441, output_fired_time: 0.4884124994, propagate_forward_time: 16.0555686951, propagate_backward_time: 38.2937164307, weight_update_time: 0.0554559678, other_time: 1.1788940430
epoch time: 3.4864008427s, input_fired_time: 0.0776787251, output_fired_time: 0.0000000000, propagate_forward_time: 3.2020385265, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2066836357
validation[          , genome  6898] predictions:    9699/  10000 (96.99%), best:    9712/10000 (97.12%), error:       978.51563, best error:       913.68231 on epoch:    46, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 56.8466873169s, input_fired_time: 0.7375125289, output_fired_time: 0.4866489172, propagate_forward_time: 16.1077690125, propagate_backward_time: 38.3315124512, weight_update_time: 0.0606530756, other_time: 1.1832466125
epoch time: 3.4605791569s, input_fired_time: 0.0772674233, output_fired_time: 0.0000000000, propagate_forward_time: 3.1773829460, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2059288025
validation[          , genome  6898] predictions:    9710/  10000 (97.10%), best:    9712/10000 (97.12%), error:       958.62213, best error:       913.68231 on epoch:    46, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 57.1209182739s, input_fired_time: 0.7191436291, output_fired_time: 0.4917913973, propagate_forward_time: 16.0555171967, propagate_backward_time: 38.6665954590, weight_update_time: 0.0592898987, other_time: 1.1878738403
epoch time: 3.5138254166s, input_fired_time: 0.0777490437, output_fired_time: 0.0000000000, propagate_forward_time: 3.2192316055, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2168447971
validation[          , genome  6898] predictions:    9642/  10000 (96.42%), best:    9712/10000 (97.12%), error:      1173.13562, best error:       913.68231 on epoch:    46, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 57.2837486267s, input_fired_time: 0.7255059481, output_fired_time: 0.4895499647, propagate_forward_time: 16.5767383575, propagate_backward_time: 38.3175811768, weight_update_time: 0.0549974255, other_time: 1.1743698120
epoch time: 3.4960808754s, input_fired_time: 0.0789587498, output_fired_time: 0.0000000000, propagate_forward_time: 3.2088434696, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2082786560
validation[          , genome  6898] predictions:    9701/  10000 (97.01%), best:    9712/10000 (97.12%), error:       973.53046, best error:       913.68231 on epoch:    46, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 56.8297004700s, input_fired_time: 0.7318513393, output_fired_time: 0.4925833941, propagate_forward_time: 16.0940036774, propagate_backward_time: 38.3220291138, weight_update_time: 0.0556623340, other_time: 1.1892318726
epoch time: 3.4732904434s, input_fired_time: 0.0782228783, output_fired_time: 0.0000000000, propagate_forward_time: 3.1801190376, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2149484158
validation[          , genome  6898] predictions:    9663/  10000 (96.63%), best:    9712/10000 (97.12%), error:      1054.76538, best error:       913.68231 on epoch:    46, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 56.7753143311s, input_fired_time: 0.7231557369, output_fired_time: 0.4885159433, propagate_forward_time: 16.3790016174, propagate_backward_time: 38.0106430054, weight_update_time: 0.0561751574, other_time: 1.1739959717
epoch time: 3.4738450050s, input_fired_time: 0.0777193382, output_fired_time: 0.0000000000, propagate_forward_time: 3.1893305779, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2067949772
validation[          , genome  6898] predictions:    9704/  10000 (97.04%), best:    9712/10000 (97.12%), error:       980.32928, best error:       913.68231 on epoch:    46, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 56.7560005188s, input_fired_time: 0.7400922775, output_fired_time: 0.4905336797, propagate_forward_time: 16.0601596832, propagate_backward_time: 38.2864456177, weight_update_time: 0.0572534949, other_time: 1.1787719727
epoch time: 3.5188875198s, input_fired_time: 0.0782790631, output_fired_time: 0.0000000000, propagate_forward_time: 3.2315437794, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2090647221
validation[          , genome  6898] predictions:    9731/  10000 (97.31%), best:    9731/10000 (97.31%), error:       903.67908, best error:       903.67908 on epoch:    59, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 56.7727165222s, input_fired_time: 0.7205312848, output_fired_time: 0.4882394075, propagate_forward_time: 16.0440979004, propagate_backward_time: 38.3274421692, weight_update_time: 0.0585697033, other_time: 1.1924057007
epoch time: 3.4698643684s, input_fired_time: 0.0774227381, output_fired_time: 0.0000000000, propagate_forward_time: 3.1845996380, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2078421116
validation[          , genome  6898] predictions:    9603/  10000 (96.03%), best:    9731/10000 (97.31%), error:      1346.15210, best error:       903.67908 on epoch:    59, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 56.7458572388s, input_fired_time: 0.7343257666, output_fired_time: 0.4876282811, propagate_forward_time: 16.1814212799, propagate_backward_time: 38.1638565063, weight_update_time: 0.0551133566, other_time: 1.1786270142
epoch time: 3.4775485992s, input_fired_time: 0.0782124028, output_fired_time: 0.0000000000, propagate_forward_time: 3.1918067932, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2075293064
validation[          , genome  6898] predictions:    9636/  10000 (96.36%), best:    9731/10000 (97.31%), error:      1203.95044, best error:       903.67908 on epoch:    59, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 57.2806892395s, input_fired_time: 0.7250528336, output_fired_time: 0.4916012585, propagate_forward_time: 16.0978393555, propagate_backward_time: 38.7702941895, weight_update_time: 0.0551367253, other_time: 1.1959037781
epoch time: 3.5075993538s, input_fired_time: 0.0782763809, output_fired_time: 0.0000000000, propagate_forward_time: 3.2058885098, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2234344482
validation[          , genome  6898] predictions:    9724/  10000 (97.24%), best:    9731/10000 (97.31%), error:       930.01196, best error:       903.67908 on epoch:    59, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 56.8094406128s, input_fired_time: 0.7213380933, output_fired_time: 0.4924514294, propagate_forward_time: 16.4153537750, propagate_backward_time: 38.0032348633, weight_update_time: 0.0549568571, other_time: 1.1770629883
epoch time: 3.5648002625s, input_fired_time: 0.0790804327, output_fired_time: 0.0000000000, propagate_forward_time: 3.2594351768, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2262847424
validation[          , genome  6898] predictions:    9655/  10000 (96.55%), best:    9731/10000 (97.31%), error:      1107.05310, best error:       903.67908 on epoch:    59, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 56.7691535950s, input_fired_time: 0.7205555439, output_fired_time: 0.4939457476, propagate_forward_time: 16.1691455841, propagate_backward_time: 38.2060775757, weight_update_time: 0.0599031411, other_time: 1.1794281006
epoch time: 3.5017020702s, input_fired_time: 0.0801165104, output_fired_time: 0.0000000000, propagate_forward_time: 3.2090325356, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2125530243
validation[          , genome  6898] predictions:    9712/  10000 (97.12%), best:    9731/10000 (97.31%), error:       964.58118, best error:       903.67908 on epoch:    59, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 56.8648643494s, input_fired_time: 0.7246886492, output_fired_time: 0.4936264455, propagate_forward_time: 16.2208557129, propagate_backward_time: 38.2445487976, weight_update_time: 0.0551362149, other_time: 1.1811447144
epoch time: 3.4901924133s, input_fired_time: 0.0795834139, output_fired_time: 0.0000000000, propagate_forward_time: 3.2014493942, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2091596127
validation[          , genome  6898] predictions:    9709/  10000 (97.09%), best:    9731/10000 (97.31%), error:       997.23065, best error:       903.67908 on epoch:    59, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 57.0208435059s, input_fired_time: 0.7249048948, output_fired_time: 0.4931915998, propagate_forward_time: 16.3132095337, propagate_backward_time: 38.3128166199, weight_update_time: 0.0552287176, other_time: 1.1767234802
epoch time: 3.9839169979s, input_fired_time: 0.0794361681, output_fired_time: 0.0000000000, propagate_forward_time: 3.3662574291, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5382235050
validation[          , genome  6898] predictions:    9704/  10000 (97.04%), best:    9731/10000 (97.31%), error:       977.54279, best error:       903.67908 on epoch:    59, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 56.3499870300s, input_fired_time: 0.7218586802, output_fired_time: 0.4879004061, propagate_forward_time: 16.0628089905, propagate_backward_time: 37.9066429138, weight_update_time: 0.0554811247, other_time: 1.1707763672
epoch time: 3.9577674866s, input_fired_time: 0.0860368460, output_fired_time: 0.0000000000, propagate_forward_time: 3.6530227661, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2187077999
validation[          , genome  6898] predictions:    9678/  10000 (96.78%), best:    9731/10000 (97.31%), error:      1094.60425, best error:       903.67908 on epoch:    59, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 56.3426971436s, input_fired_time: 0.7341799140, output_fired_time: 0.4886464477, propagate_forward_time: 16.0155735016, propagate_backward_time: 37.9264488220, weight_update_time: 0.0553015172, other_time: 1.1778450012
epoch time: 3.9255864620s, input_fired_time: 0.0816506594, output_fired_time: 0.0000000000, propagate_forward_time: 3.6286399364, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2152957916
validation[          , genome  6898] predictions:    9714/  10000 (97.14%), best:    9731/10000 (97.31%), error:      1013.36676, best error:       903.67908 on epoch:    59, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 56.8634071350s, input_fired_time: 0.7252392173, output_fired_time: 0.4893018901, propagate_forward_time: 16.1042385101, propagate_backward_time: 38.2321243286, weight_update_time: 0.0548207536, other_time: 1.3125000000
epoch time: 3.5034842491s, input_fired_time: 0.0783584118, output_fired_time: 0.0000000000, propagate_forward_time: 3.2142353058, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2108905315
validation[          , genome  6898] predictions:    9723/  10000 (97.23%), best:    9731/10000 (97.31%), error:       920.64478, best error:       903.67908 on epoch:    59, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 57.0464935303s, input_fired_time: 0.7246699333, output_fired_time: 0.4869902730, propagate_forward_time: 16.2135410309, propagate_backward_time: 38.4501991272, weight_update_time: 0.0546233132, other_time: 1.1710929871
epoch time: 3.5378859043s, input_fired_time: 0.0793899372, output_fired_time: 0.0000000000, propagate_forward_time: 3.2507271767, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2077686787
validation[          , genome  6898] predictions:    9617/  10000 (96.17%), best:    9731/10000 (97.31%), error:      1268.73120, best error:       903.67908 on epoch:    59, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 57.3358001709s, input_fired_time: 0.7343010902, output_fired_time: 0.4902466238, propagate_forward_time: 16.4796943665, propagate_backward_time: 38.4309844971, weight_update_time: 0.0555965900, other_time: 1.2005729675
epoch time: 3.5034005642s, input_fired_time: 0.0789311007, output_fired_time: 0.0000000000, propagate_forward_time: 3.2148437500, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2096257210
validation[          , genome  6898] predictions:    9606/  10000 (96.06%), best:    9731/10000 (97.31%), error:      1262.15662, best error:       903.67908 on epoch:    59, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 56.2749137878s, input_fired_time: 0.7245647907, output_fired_time: 0.4894678593, propagate_forward_time: 15.9994983673, propagate_backward_time: 37.8706054688, weight_update_time: 0.0552359037, other_time: 1.1907806396
epoch time: 3.4840939045s, input_fired_time: 0.0803562328, output_fired_time: 0.0000000000, propagate_forward_time: 3.1916067600, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2121310234
validation[          , genome  6898] predictions:    9716/  10000 (97.16%), best:    9731/10000 (97.31%), error:      1028.70801, best error:       903.67908 on epoch:    59, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 56.7995567322s, input_fired_time: 0.7548051476, output_fired_time: 0.4930519462, propagate_forward_time: 16.2819042206, propagate_backward_time: 38.0901641846, weight_update_time: 0.0560481735, other_time: 1.1796264648
epoch time: 3.4806303978s, input_fired_time: 0.0789338127, output_fired_time: 0.0000000000, propagate_forward_time: 3.1901547909, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2115418911
validation[          , genome  6898] predictions:    9599/  10000 (95.99%), best:    9731/10000 (97.31%), error:      1411.04736, best error:       903.67908 on epoch:    59, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 57.2844085693s, input_fired_time: 0.7480618358, output_fired_time: 0.4961749315, propagate_forward_time: 16.7536621094, propagate_backward_time: 38.0838584900, weight_update_time: 0.0554222427, other_time: 1.2026519775
epoch time: 3.4904229641s, input_fired_time: 0.0782039762, output_fired_time: 0.0000000000, propagate_forward_time: 3.1959304810, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2162885666
validation[          , genome  6898] predictions:    9682/  10000 (96.82%), best:    9731/10000 (97.31%), error:      1058.00342, best error:       903.67908 on epoch:    59, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 56.8573989868s, input_fired_time: 0.7278488874, output_fired_time: 0.4896675050, propagate_forward_time: 16.0481987000, propagate_backward_time: 38.4086265564, weight_update_time: 0.0553609729, other_time: 1.1830596924
epoch time: 3.4816901684s, input_fired_time: 0.0788485259, output_fired_time: 0.0000000000, propagate_forward_time: 3.1958000660, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2070415020
validation[          , genome  6898] predictions:    9741/  10000 (97.41%), best:    9741/10000 (97.41%), error:       887.67694, best error:       887.67694 on epoch:    75, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 57.2181358337s, input_fired_time: 0.7307704687, output_fired_time: 0.4918071628, propagate_forward_time: 16.4076442719, propagate_backward_time: 38.4068603516, weight_update_time: 0.0549706742, other_time: 1.1810531616
epoch time: 3.5029742718s, input_fired_time: 0.0795173198, output_fired_time: 0.0000000000, propagate_forward_time: 3.2173867226, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2060701847
validation[          , genome  6898] predictions:    9651/  10000 (96.51%), best:    9741/10000 (97.41%), error:      1150.34998, best error:       887.67694 on epoch:    75, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 56.9258804321s, input_fired_time: 0.7290903926, output_fired_time: 0.4919584990, propagate_forward_time: 16.2858276367, propagate_backward_time: 38.2247200012, weight_update_time: 0.0564460196, other_time: 1.1942825317
epoch time: 3.5011541843s, input_fired_time: 0.0796147287, output_fired_time: 0.0000000000, propagate_forward_time: 3.2145781517, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2069613934
validation[          , genome  6898] predictions:    9707/  10000 (97.07%), best:    9741/10000 (97.41%), error:       983.15167, best error:       887.67694 on epoch:    75, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 56.7395668030s, input_fired_time: 0.7330622673, output_fired_time: 0.4912641644, propagate_forward_time: 16.2339057922, propagate_backward_time: 38.1013107300, weight_update_time: 0.0552266724, other_time: 1.1800231934
epoch time: 3.5097544193s, input_fired_time: 0.0791985542, output_fired_time: 0.0000000000, propagate_forward_time: 3.2068331242, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2237226963
validation[          , genome  6898] predictions:    9722/  10000 (97.22%), best:    9741/10000 (97.41%), error:       950.51306, best error:       887.67694 on epoch:    75, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 56.8301277161s, input_fired_time: 0.7290570140, output_fired_time: 0.4902400076, propagate_forward_time: 16.4345436096, propagate_backward_time: 37.9734840393, weight_update_time: 0.0635466427, other_time: 1.2028045654
epoch time: 3.4825417995s, input_fired_time: 0.0795744359, output_fired_time: 0.0000000000, propagate_forward_time: 3.1955845356, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2073829174
validation[          , genome  6898] predictions:    9687/  10000 (96.87%), best:    9741/10000 (97.41%), error:      1050.20923, best error:       887.67694 on epoch:    75, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 56.7467155457s, input_fired_time: 0.7275533676, output_fired_time: 0.4946796298, propagate_forward_time: 16.1005649567, propagate_backward_time: 38.0799522400, weight_update_time: 0.0561454929, other_time: 1.3439674377
epoch time: 3.4991092682s, input_fired_time: 0.0789785832, output_fired_time: 0.0000000000, propagate_forward_time: 3.2091562748, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2109744549
validation[          , genome  6898] predictions:    9727/  10000 (97.27%), best:    9741/10000 (97.41%), error:       922.09229, best error:       887.67694 on epoch:    75, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 56.8691368103s, input_fired_time: 0.7503333092, output_fired_time: 0.4896046221, propagate_forward_time: 16.2353630066, propagate_backward_time: 38.0647163391, weight_update_time: 0.0548901446, other_time: 1.3291206360
epoch time: 3.4804971218s, input_fired_time: 0.0799502954, output_fired_time: 0.0000000000, propagate_forward_time: 3.1927690506, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2077777386
validation[          , genome  6898] predictions:    9665/  10000 (96.65%), best:    9741/10000 (97.41%), error:      1141.28137, best error:       887.67694 on epoch:    75, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 56.7928047180s, input_fired_time: 0.7312967181, output_fired_time: 0.4894328117, propagate_forward_time: 16.4147052765, propagate_backward_time: 37.9737854004, weight_update_time: 0.0561365150, other_time: 1.1835861206
epoch time: 3.4833467007s, input_fired_time: 0.0810788572, output_fired_time: 0.0000000000, propagate_forward_time: 3.1930334568, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2092344761
validation[          , genome  6898] predictions:    9705/  10000 (97.05%), best:    9741/10000 (97.41%), error:       994.00824, best error:       887.67694 on epoch:    75, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 57.1091766357s, input_fired_time: 0.7280736566, output_fired_time: 0.4997361600, propagate_forward_time: 16.3512573242, propagate_backward_time: 38.3515701294, weight_update_time: 0.0556220673, other_time: 1.1785392761
epoch time: 3.5078792572s, input_fired_time: 0.0798177868, output_fired_time: 0.0000000000, propagate_forward_time: 3.2114248276, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2166366577
validation[          , genome  6898] predictions:    9688/  10000 (96.88%), best:    9741/10000 (97.41%), error:      1043.35693, best error:       887.67694 on epoch:    75, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 56.7860641479s, input_fired_time: 0.7297898531, output_fired_time: 0.5564378500, propagate_forward_time: 16.0529155731, propagate_backward_time: 38.2612533569, weight_update_time: 0.0553543307, other_time: 1.1856689453
epoch time: 3.5121753216s, input_fired_time: 0.0803076029, output_fired_time: 0.0000000000, propagate_forward_time: 3.2238450050, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2080225945
validation[          , genome  6898] predictions:    9669/  10000 (96.69%), best:    9741/10000 (97.41%), error:      1028.61707, best error:       887.67694 on epoch:    75, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 57.2847824097s, input_fired_time: 0.7897748351, output_fired_time: 0.4930165112, propagate_forward_time: 16.2321090698, propagate_backward_time: 38.5774993896, weight_update_time: 0.0561649352, other_time: 1.1923828125
epoch time: 3.5021970272s, input_fired_time: 0.0804637820, output_fired_time: 0.0000000000, propagate_forward_time: 3.2152390480, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2064940929
validation[          , genome  6898] predictions:    9679/  10000 (96.79%), best:    9741/10000 (97.41%), error:       995.82874, best error:       887.67694 on epoch:    75, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 56.9088821411s, input_fired_time: 0.7355831265, output_fired_time: 0.4886240661, propagate_forward_time: 16.0456218719, propagate_backward_time: 38.4533729553, weight_update_time: 0.0563883148, other_time: 1.1856803894
epoch time: 3.4642176628s, input_fired_time: 0.0793078914, output_fired_time: 0.0000000000, propagate_forward_time: 3.1789119244, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2059979439
validation[          , genome  6898] predictions:    9708/  10000 (97.08%), best:    9741/10000 (97.41%), error:       984.20392, best error:       887.67694 on epoch:    75, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 56.8089027405s, input_fired_time: 0.7406769991, output_fired_time: 0.4884273708, propagate_forward_time: 16.1958084106, propagate_backward_time: 38.2074432373, weight_update_time: 0.0545319468, other_time: 1.1765480042
epoch time: 3.9045002460s, input_fired_time: 0.0843837112, output_fired_time: 0.0000000000, propagate_forward_time: 3.5603938103, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2597227097
validation[          , genome  6898] predictions:    9734/  10000 (97.34%), best:    9741/10000 (97.41%), error:       922.19061, best error:       887.67694 on epoch:    75, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 56.8373756409s, input_fired_time: 0.7329567671, output_fired_time: 0.4926427901, propagate_forward_time: 16.4359016418, propagate_backward_time: 37.9918785095, weight_update_time: 0.0576355271, other_time: 1.1839981079
epoch time: 3.4913220406s, input_fired_time: 0.0809628665, output_fired_time: 0.0000000000, propagate_forward_time: 3.1990561485, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2113029957
validation[          , genome  6898] predictions:    9709/  10000 (97.09%), best:    9741/10000 (97.41%), error:       946.62384, best error:       887.67694 on epoch:    75, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 56.7853546143s, input_fired_time: 0.7359986305, output_fired_time: 0.4884951413, propagate_forward_time: 16.1984024048, propagate_backward_time: 38.1701316833, weight_update_time: 0.0555436276, other_time: 1.1923255920
epoch time: 3.4951965809s, input_fired_time: 0.0814676732, output_fired_time: 0.0000000000, propagate_forward_time: 3.2024853230, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2112436295
validation[          , genome  6898] predictions:    9723/  10000 (97.23%), best:    9741/10000 (97.41%), error:       933.60059, best error:       887.67694 on epoch:    75, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 56.8276138306s, input_fired_time: 0.7502608299, output_fired_time: 0.5012965202, propagate_forward_time: 16.3482112885, propagate_backward_time: 38.0288162231, weight_update_time: 0.0550427921, other_time: 1.1990280151
epoch time: 3.4805436134s, input_fired_time: 0.0797751620, output_fired_time: 0.0000000000, propagate_forward_time: 3.1917095184, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2090590000
validation[          , genome  6898] predictions:    9717/  10000 (97.17%), best:    9741/10000 (97.41%), error:       940.07379, best error:       887.67694 on epoch:    75, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 56.8172187805s, input_fired_time: 0.7392756939, output_fired_time: 0.4889360070, propagate_forward_time: 16.3747711182, propagate_backward_time: 38.0147399902, weight_update_time: 0.0555369891, other_time: 1.1994934082
epoch time: 3.5209426880s, input_fired_time: 0.0811296329, output_fired_time: 0.0000000000, propagate_forward_time: 3.2111141682, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2286989689
validation[          , genome  6898] predictions:    9673/  10000 (96.73%), best:    9741/10000 (97.41%), error:      1133.15857, best error:       887.67694 on epoch:    75, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 57.2269248962s, input_fired_time: 0.7466704845, output_fired_time: 0.4937527180, propagate_forward_time: 16.3077373505, propagate_backward_time: 38.5037536621, weight_update_time: 0.0549633689, other_time: 1.1750106812
epoch time: 3.5031359196s, input_fired_time: 0.0814349055, output_fired_time: 0.0000000000, propagate_forward_time: 3.2117357254, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2099652290
validation[          , genome  6898] predictions:    9632/  10000 (96.32%), best:    9741/10000 (97.41%), error:      1210.97949, best error:       887.67694 on epoch:    75, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 56.8318672180s, input_fired_time: 0.7316251993, output_fired_time: 0.4917816520, propagate_forward_time: 16.0496578217, propagate_backward_time: 38.3817253113, weight_update_time: 0.0562690124, other_time: 1.1770744324
epoch time: 3.4821233749s, input_fired_time: 0.0812633857, output_fired_time: 0.0000000000, propagate_forward_time: 3.1937785149, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2070815563
validation[          , genome  6898] predictions:    9636/  10000 (96.36%), best:    9741/10000 (97.41%), error:      1201.51404, best error:       887.67694 on epoch:    75, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 56.8676872253s, input_fired_time: 0.7424533367, output_fired_time: 0.4887441993, propagate_forward_time: 16.0660324097, propagate_backward_time: 38.3808860779, weight_update_time: 0.0552940033, other_time: 1.1895713806
epoch time: 3.4880959988s, input_fired_time: 0.0813465342, output_fired_time: 0.0000000000, propagate_forward_time: 3.2010397911, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2057096958
validation[          , genome  6898] predictions:    9718/  10000 (97.18%), best:    9741/10000 (97.41%), error:       964.46649, best error:       887.67694 on epoch:    75, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 59.4633941650s, input_fired_time: 0.8489557505, output_fired_time: 0.4991520047, propagate_forward_time: 16.7666683197, propagate_backward_time: 40.0916366577, weight_update_time: 0.0623707920, other_time: 1.2569808960
epoch time: 3.5433542728s, input_fired_time: 0.0820523873, output_fired_time: 0.0000000000, propagate_forward_time: 3.2503716946, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2109301090
validation[          , genome  6898] predictions:    9703/  10000 (97.03%), best:    9741/10000 (97.41%), error:      1045.75684, best error:       887.67694 on epoch:    75, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 56.8826789856s, input_fired_time: 0.7363594770, output_fired_time: 0.4886874259, propagate_forward_time: 16.0675582886, propagate_backward_time: 38.4057960510, weight_update_time: 0.0553903989, other_time: 1.1842803955
epoch time: 3.4968183041s, input_fired_time: 0.0808294937, output_fired_time: 0.0000000000, propagate_forward_time: 3.2082810402, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2077078819
validation[          , genome  6898] predictions:    9693/  10000 (96.93%), best:    9741/10000 (97.41%), error:      1021.19928, best error:       887.67694 on epoch:    75, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 56.7824134827s, input_fired_time: 0.7417278290, output_fired_time: 0.4893734455, propagate_forward_time: 16.1702003479, propagate_backward_time: 38.1972503662, weight_update_time: 0.0552786663, other_time: 1.1838645935
epoch time: 3.5012812614s, input_fired_time: 0.0806183070, output_fired_time: 0.0000000000, propagate_forward_time: 3.2126193047, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2080435753
validation[          , genome  6898] predictions:    9725/  10000 (97.25%), best:    9741/10000 (97.41%), error:       893.92639, best error:       887.67694 on epoch:    75, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 56.8202209473s, input_fired_time: 0.7366006970, output_fired_time: 0.4882070422, propagate_forward_time: 16.3915824890, propagate_backward_time: 38.0279655457, weight_update_time: 0.0557975285, other_time: 1.1758651733
epoch time: 3.4984798431s, input_fired_time: 0.0815599188, output_fired_time: 0.0000000000, propagate_forward_time: 3.1931951046, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2237248421
validation[          , genome  6898] predictions:    9698/  10000 (96.98%), best:    9741/10000 (97.41%), error:      1003.45526, best error:       887.67694 on epoch:    75, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 59.3031272888s, input_fired_time: 0.7628144622, output_fired_time: 0.5359759331, propagate_forward_time: 16.9019584656, propagate_backward_time: 39.8780403137, weight_update_time: 0.0555129834, other_time: 1.2243385315
epoch time: 3.4920518398s, input_fired_time: 0.0824054405, output_fired_time: 0.0000000000, propagate_forward_time: 3.1964006424, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2132458687
validation[          , genome  6898] predictions:    9738/  10000 (97.38%), best:    9741/10000 (97.41%), error:       911.66071, best error:       887.67694 on epoch:    75, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 56.2305297852s, input_fired_time: 0.7315751314, output_fired_time: 0.4860126078, propagate_forward_time: 15.9409141541, propagate_backward_time: 37.8403053284, weight_update_time: 0.0597112477, other_time: 1.2317237854
epoch time: 3.5937640667s, input_fired_time: 0.0811990574, output_fired_time: 0.0000000000, propagate_forward_time: 3.3039896488, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2085752487
validation[          , genome  6898] predictions:    9730/  10000 (97.30%), best:    9741/10000 (97.41%), error:       933.53204, best error:       887.67694 on epoch:    75, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 17.5239410400s, input_fired_time: 0.4003850520, output_fired_time: 0.0000000000, propagate_forward_time: 16.0280284882, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0955276489
best training[          , genome  6898] predictions:   49426/  50000 (98.85%), best:    9741/10000 (97.41%), error:      2171.29810, best error:       887.67694 on epoch:    75, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 3.4784104824s, input_fired_time: 0.0790570080, output_fired_time: 0.0000000000, propagate_forward_time: 3.1902675629, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2090859413
   testing[          , genome  6898] predictions:    9761/  10000 (97.61%), best:    9741/10000 (97.41%), error:       759.25354, best error:       887.67694 on epoch:    75, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
20:43:06 (5720): called boinc_finish(0)

</stderr_txt>
]]>