Nameexact_genome_1512568488_42_6045_1
Workunit2601442
Created7 Dec 2017, 17:40:27 UTC
Sent7 Dec 2017, 17:44:44 UTC
Report deadline14 Dec 2017, 17:09:01 UTC
Received9 Dec 2017, 9:58:52 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID62426
Run time4 hours 56 min 51 sec
CPU time4 hours 41 min 58 sec
Validate stateValid
Credit1,743.80
Device peak FLOPS2.98 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size157.88 MB
Peak swap size156.24 MB
Peak disk usage2.79 MB

Stderr output

<core_client_version>7.6.22</core_client_version>
<![CDATA[
<stderr_txt>
97.09%), best:    9727/10000 (97.27%), error:      1016.76324, best error:       939.44452 on epoch:    11, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 156.1366577148s, input_fired_time: 2.0365116596, output_fired_time: 2.2454466820, propagate_forward_time: 58.9891242981, propagate_backward_time: 89.4502258301, weight_update_time: 0.2138761878, other_time: 3.4153442383
epoch time: 13.8178968430s, input_fired_time: 0.4060624838, output_fired_time: 0.0000000000, propagate_forward_time: 12.7450428009, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6667919159
validation[          , genome  6045] predictions:    9708/  10000 (97.08%), best:    9727/10000 (97.27%), error:       949.01813, best error:       939.44452 on epoch:    11, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 154.3816070557s, input_fired_time: 1.9396265745, output_fired_time: 2.2004354000, propagate_forward_time: 58.2941169739, propagate_backward_time: 88.5365982056, weight_update_time: 0.2139725238, other_time: 3.4108352661
epoch time: 20.0742721558s, input_fired_time: 0.3290447593, output_fired_time: 0.0000000000, propagate_forward_time: 18.8179702759, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9272575378
validation[          , genome  6045] predictions:    9697/  10000 (96.97%), best:    9727/10000 (97.27%), error:      1025.26953, best error:       939.44452 on epoch:    11, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 157.9042358398s, input_fired_time: 1.9374337196, output_fired_time: 2.1858778000, propagate_forward_time: 59.6460037231, propagate_backward_time: 90.5768127441, weight_update_time: 0.2151587158, other_time: 3.5580978394
epoch time: 14.6164178848s, input_fired_time: 1.9019743204, output_fired_time: 0.0000000000, propagate_forward_time: 12.0558328629, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6586103439
validation[          , genome  6045] predictions:    9750/  10000 (97.50%), best:    9750/10000 (97.50%), error:       868.99969, best error:       868.99969 on epoch:    17, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 159.2390594482s, input_fired_time: 2.0514819622, output_fired_time: 2.3094866276, propagate_forward_time: 60.1373710632, propagate_backward_time: 91.1829681396, weight_update_time: 0.2163449973, other_time: 3.5577392578
epoch time: 13.6638221741s, input_fired_time: 0.2361334562, output_fired_time: 0.0000000000, propagate_forward_time: 12.8141088486, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6135797501
validation[          , genome  6045] predictions:    9697/  10000 (96.97%), best:    9750/10000 (97.50%), error:       965.40833, best error:       868.99969 on epoch:    17, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 159.3328399658s, input_fired_time: 1.9448883533, output_fired_time: 2.3937447071, propagate_forward_time: 60.1824417114, propagate_backward_time: 91.3037490845, weight_update_time: 0.2459698915, other_time: 3.5080261230
epoch time: 12.8787965775s, input_fired_time: 0.2391468883, output_fired_time: 0.0000000000, propagate_forward_time: 12.0154800415, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6241693497
validation[          , genome  6045] predictions:    9700/  10000 (97.00%), best:    9750/10000 (97.50%), error:       972.78998, best error:       868.99969 on epoch:    17, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 167.8620147705s, input_fired_time: 2.1329152584, output_fired_time: 2.2772910595, propagate_forward_time: 62.5816726685, propagate_backward_time: 97.0770416260, weight_update_time: 0.2167088091, other_time: 3.7930831909
epoch time: 10.9072551727s, input_fired_time: 0.2088773698, output_fired_time: 0.0000000000, propagate_forward_time: 10.0852842331, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6130933762
validation[          , genome  6045] predictions:    9729/  10000 (97.29%), best:    9750/10000 (97.50%), error:       908.25769, best error:       868.99969 on epoch:    17, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 160.1129455566s, input_fired_time: 1.9615193605, output_fired_time: 2.2693486214, propagate_forward_time: 60.6795616150, propagate_backward_time: 91.6780090332, weight_update_time: 0.2158811092, other_time: 3.5245056152
epoch time: 12.3357095718s, input_fired_time: 0.2322985828, output_fired_time: 0.0000000000, propagate_forward_time: 11.4933586121, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6100521088
validation[          , genome  6045] predictions:    9565/  10000 (95.65%), best:    9750/10000 (97.50%), error:      1323.77051, best error:       868.99969 on epoch:    17, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 159.5139312744s, input_fired_time: 1.9608038664, output_fired_time: 2.2924304008, propagate_forward_time: 60.3758697510, propagate_backward_time: 91.2798767090, weight_update_time: 0.2163446397, other_time: 3.6049499512
epoch time: 15.5849504471s, input_fired_time: 0.2809002995, output_fired_time: 0.0000000000, propagate_forward_time: 14.5953702927, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7086801529
validation[          , genome  6045] predictions:    9673/  10000 (96.73%), best:    9750/10000 (97.50%), error:      1096.12671, best error:       868.99969 on epoch:    17, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 156.0080871582s, input_fired_time: 2.0005247593, output_fired_time: 2.1863479614, propagate_forward_time: 59.2256469727, propagate_backward_time: 89.0500183105, weight_update_time: 0.2191115618, other_time: 3.5455627441
epoch time: 21.5524597168s, input_fired_time: 0.3187645078, output_fired_time: 0.0000000000, propagate_forward_time: 20.5241699219, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7095260620
validation[          , genome  6045] predictions:    9728/  10000 (97.28%), best:    9750/10000 (97.50%), error:       895.09528, best error:       868.99969 on epoch:    17, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 161.8842620850s, input_fired_time: 2.1269662380, output_fired_time: 2.3321504593, propagate_forward_time: 61.2517395020, propagate_backward_time: 92.4303283691, weight_update_time: 0.2152977586, other_time: 3.7430725098
epoch time: 12.5194253922s, input_fired_time: 0.2354685664, output_fired_time: 0.0000000000, propagate_forward_time: 11.6726484299, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6113080978
validation[          , genome  6045] predictions:    9724/  10000 (97.24%), best:    9750/10000 (97.50%), error:       906.31342, best error:       868.99969 on epoch:    17, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 159.5825958252s, input_fired_time: 1.9610223770, output_fired_time: 2.2446291447, propagate_forward_time: 60.2925491333, propagate_backward_time: 91.5255508423, weight_update_time: 0.2158041000, other_time: 3.5588378906
epoch time: 13.3029317856s, input_fired_time: 0.2870132625, output_fired_time: 0.0000000000, propagate_forward_time: 12.3958539963, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6200647354
validation[          , genome  6045] predictions:    9699/  10000 (96.99%), best:    9750/10000 (97.50%), error:       945.81958, best error:       868.99969 on epoch:    17, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 169.7528228760s, input_fired_time: 1.9577720165, output_fired_time: 2.2456409931, propagate_forward_time: 61.2110176086, propagate_backward_time: 100.8898010254, weight_update_time: 0.2157667726, other_time: 3.4485931396
epoch time: 12.5165643692s, input_fired_time: 0.2356926799, output_fired_time: 0.0000000000, propagate_forward_time: 11.6666927338, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6141786575
validation[          , genome  6045] predictions:    9712/  10000 (97.12%), best:    9750/10000 (97.50%), error:       899.31976, best error:       868.99969 on epoch:    17, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 158.8292083740s, input_fired_time: 2.0848896503, output_fired_time: 2.2198891640, propagate_forward_time: 58.9604911804, propagate_backward_time: 92.0053710938, weight_update_time: 0.2160140127, other_time: 3.5585632324
epoch time: 13.4425363541s, input_fired_time: 0.2376910150, output_fired_time: 0.0000000000, propagate_forward_time: 12.3966102600, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8082351685
validation[          , genome  6045] predictions:    9741/  10000 (97.41%), best:    9741/10000 (97.41%), error:       820.37549, best error:       820.37549 on epoch:    27, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 172.1227874756s, input_fired_time: 2.1702055931, output_fired_time: 2.2632963657, propagate_forward_time: 61.1846199036, propagate_backward_time: 102.8810806274, weight_update_time: 0.2141950279, other_time: 3.6235885620
epoch time: 12.4844741821s, input_fired_time: 0.2344361395, output_fired_time: 0.0000000000, propagate_forward_time: 11.6354084015, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6146297455
validation[          , genome  6045] predictions:    9716/  10000 (97.16%), best:    9741/10000 (97.41%), error:       916.18884, best error:       820.37549 on epoch:    27, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 154.6808624268s, input_fired_time: 1.9369269609, output_fired_time: 2.1858053207, propagate_forward_time: 58.4620208740, propagate_backward_time: 88.6849212646, weight_update_time: 0.2141156346, other_time: 3.4111938477
epoch time: 14.9095039368s, input_fired_time: 0.2329075336, output_fired_time: 0.0000000000, propagate_forward_time: 13.9574308395, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7191658020
validation[          , genome  6045] predictions:    9717/  10000 (97.17%), best:    9741/10000 (97.41%), error:       903.15564, best error:       820.37549 on epoch:    27, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 178.8593292236s, input_fired_time: 2.0046715736, output_fired_time: 11.6151523590, propagate_forward_time: 67.5830841064, propagate_backward_time: 94.0761337280, weight_update_time: 0.2159241587, other_time: 3.5802841187
epoch time: 14.3461027145s, input_fired_time: 0.3345213830, output_fired_time: 0.0000000000, propagate_forward_time: 13.2942361832, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7173452377
validation[          , genome  6045] predictions:    9672/  10000 (96.72%), best:    9741/10000 (97.41%), error:      1038.56958, best error:       820.37549 on epoch:    27, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 165.8307952881s, input_fired_time: 1.9600027800, output_fired_time: 2.2199792862, propagate_forward_time: 68.2320022583, propagate_backward_time: 89.9667282104, weight_update_time: 0.2149983644, other_time: 3.4520721436
epoch time: 17.9585342407s, input_fired_time: 0.3369539678, output_fired_time: 0.0000000000, propagate_forward_time: 16.6811466217, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9404335022
validation[          , genome  6045] predictions:    9692/  10000 (96.92%), best:    9741/10000 (97.41%), error:       965.35394, best error:       820.37549 on epoch:    27, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 154.7292938232s, input_fired_time: 1.9736729860, output_fired_time: 2.2265024185, propagate_forward_time: 58.3839416504, propagate_backward_time: 88.7278213501, weight_update_time: 0.2138596624, other_time: 3.4173507690
epoch time: 16.6715927124s, input_fired_time: 0.3657767475, output_fired_time: 0.0000000000, propagate_forward_time: 15.3276081085, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9782085419
validation[          , genome  6045] predictions:    9745/  10000 (97.45%), best:    9741/10000 (97.41%), error:       823.89331, best error:       820.37549 on epoch:    27, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 156.7004394531s, input_fired_time: 1.9938430786, output_fired_time: 2.2314784527, propagate_forward_time: 59.2448425293, propagate_backward_time: 89.6918106079, weight_update_time: 0.2472005486, other_time: 3.5384750366
epoch time: 13.0332317352s, input_fired_time: 0.2362319976, output_fired_time: 0.0000000000, propagate_forward_time: 12.1197032928, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6772966385
validation[          , genome  6045] predictions:    9737/  10000 (97.37%), best:    9741/10000 (97.41%), error:       835.15198, best error:       820.37549 on epoch:    27, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 155.2904663086s, input_fired_time: 1.9835082293, output_fired_time: 2.1988859177, propagate_forward_time: 58.6510238647, propagate_backward_time: 88.9793319702, weight_update_time: 0.2144286186, other_time: 3.4777221680
epoch time: 13.2844743729s, input_fired_time: 0.2713264823, output_fired_time: 0.0000000000, propagate_forward_time: 12.2655849457, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7475633621
validation[          , genome  6045] predictions:    9733/  10000 (97.33%), best:    9741/10000 (97.41%), error:       858.65186, best error:       820.37549 on epoch:    27, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 155.3301544189s, input_fired_time: 1.9616740942, output_fired_time: 2.2130212784, propagate_forward_time: 58.7134017944, propagate_backward_time: 89.0069427490, weight_update_time: 0.2151973844, other_time: 3.4351119995
epoch time: 13.2208976746s, input_fired_time: 0.2382106632, output_fired_time: 0.0000000000, propagate_forward_time: 12.3295354843, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6531515121
validation[          , genome  6045] predictions:    9680/  10000 (96.80%), best:    9741/10000 (97.41%), error:      1040.47644, best error:       820.37549 on epoch:    27, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 156.0995178223s, input_fired_time: 1.9782378674, output_fired_time: 2.2080097198, propagate_forward_time: 58.9124717712, propagate_backward_time: 89.4573364258, weight_update_time: 0.2157006413, other_time: 3.5434570313
epoch time: 12.8557205200s, input_fired_time: 0.2382888347, output_fired_time: 0.0000000000, propagate_forward_time: 11.9957189560, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6217126846
validation[          , genome  6045] predictions:    9721/  10000 (97.21%), best:    9741/10000 (97.41%), error:       832.35968, best error:       820.37549 on epoch:    27, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 155.0080413818s, input_fired_time: 2.0067896843, output_fired_time: 2.2797403336, propagate_forward_time: 58.7971725464, propagate_backward_time: 88.4885253906, weight_update_time: 0.2130840421, other_time: 3.4358139038
epoch time: 12.3948383331s, input_fired_time: 0.2356556654, output_fired_time: 0.0000000000, propagate_forward_time: 11.5444831848, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6146993637
validation[          , genome  6045] predictions:    9731/  10000 (97.31%), best:    9741/10000 (97.41%), error:       859.09613, best error:       820.37549 on epoch:    27, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 157.5006866455s, input_fired_time: 1.9804987907, output_fired_time: 2.2018454075, propagate_forward_time: 59.4437751770, propagate_backward_time: 90.3885955811, weight_update_time: 0.2141918391, other_time: 3.4859771729
epoch time: 13.4630537033s, input_fired_time: 0.2385379523, output_fired_time: 0.0000000000, propagate_forward_time: 12.5790472031, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6454687119
validation[          , genome  6045] predictions:    9686/  10000 (96.86%), best:    9741/10000 (97.41%), error:       967.63654, best error:       820.37549 on epoch:    27, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 161.1308746338s, input_fired_time: 1.9643630981, output_fired_time: 2.1951730251, propagate_forward_time: 58.2632942200, propagate_backward_time: 95.2430648804, weight_update_time: 0.2148735076, other_time: 3.4649734497
epoch time: 18.2262916565s, input_fired_time: 0.3072381020, output_fired_time: 0.0000000000, propagate_forward_time: 16.9130420685, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0060119629
validation[          , genome  6045] predictions:    9703/  10000 (97.03%), best:    9741/10000 (97.41%), error:       929.12714, best error:       820.37549 on epoch:    27, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 159.8535766602s, input_fired_time: 2.0336780548, output_fired_time: 2.2807090282, propagate_forward_time: 60.3838500977, propagate_backward_time: 91.5825119019, weight_update_time: 0.2150730640, other_time: 3.5728225708
epoch time: 12.7753915787s, input_fired_time: 0.2415255010, output_fired_time: 0.0000000000, propagate_forward_time: 11.8706674576, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6631984711
validation[          , genome  6045] predictions:    9720/  10000 (97.20%), best:    9741/10000 (97.41%), error:       916.74152, best error:       820.37549 on epoch:    27, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 154.3894653320s, input_fired_time: 1.9542618990, output_fired_time: 2.1957049370, propagate_forward_time: 58.3236808777, propagate_backward_time: 88.4930419922, weight_update_time: 0.2139654458, other_time: 3.4227600098
epoch time: 16.4248790741s, input_fired_time: 0.2728369534, output_fired_time: 0.0000000000, propagate_forward_time: 15.4354591370, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7165832520
validation[          , genome  6045] predictions:    9742/  10000 (97.42%), best:    9741/10000 (97.41%), error:       883.92657, best error:       820.37549 on epoch:    27, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 160.1389465332s, input_fired_time: 1.9956907034, output_fired_time: 2.2249429226, propagate_forward_time: 62.9653701782, propagate_backward_time: 89.4372406006, weight_update_time: 0.2180622816, other_time: 3.5156936646
epoch time: 14.8179864883s, input_fired_time: 0.2394560277, output_fired_time: 0.0000000000, propagate_forward_time: 13.7978277206, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7807025909
validation[          , genome  6045] predictions:    9663/  10000 (96.63%), best:    9741/10000 (97.41%), error:      1092.57666, best error:       820.37549 on epoch:    27, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 167.0642547607s, input_fired_time: 2.0732927322, output_fired_time: 2.2712419033, propagate_forward_time: 61.9951171875, propagate_backward_time: 97.0554122925, weight_update_time: 0.2481841594, other_time: 3.6691970825
epoch time: 14.6900892258s, input_fired_time: 0.3366921544, output_fired_time: 0.0000000000, propagate_forward_time: 13.6388788223, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7145185471
validation[          , genome  6045] predictions:    9705/  10000 (97.05%), best:    9741/10000 (97.41%), error:       888.82587, best error:       820.37549 on epoch:    27, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 156.2928314209s, input_fired_time: 1.9563237429, output_fired_time: 2.3125462532, propagate_forward_time: 58.9322891235, propagate_backward_time: 89.5046615601, weight_update_time: 0.2144209445, other_time: 3.5870056152
epoch time: 13.2684135437s, input_fired_time: 0.2442429513, output_fired_time: 0.0000000000, propagate_forward_time: 12.2662086487, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7579622269
validation[          , genome  6045] predictions:    9751/  10000 (97.51%), best:    9751/10000 (97.51%), error:       805.45178, best error:       805.45178 on epoch:    44, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 155.0732574463s, input_fired_time: 1.9663412571, output_fired_time: 2.2153294086, propagate_forward_time: 58.5908050537, propagate_backward_time: 88.8745880127, weight_update_time: 0.2143022567, other_time: 3.4261932373
epoch time: 13.3064908981s, input_fired_time: 0.2528801262, output_fired_time: 0.0000000000, propagate_forward_time: 12.3800249100, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6735858917
validation[          , genome  6045] predictions:    9712/  10000 (97.12%), best:    9751/10000 (97.51%), error:       884.70575, best error:       805.45178 on epoch:    44, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 158.7361297607s, input_fired_time: 1.9920992851, output_fired_time: 2.3051388264, propagate_forward_time: 59.7880516052, propagate_backward_time: 91.1767044067, weight_update_time: 0.2141702771, other_time: 3.4741287231
epoch time: 13.0421113968s, input_fired_time: 0.2399051785, output_fired_time: 0.0000000000, propagate_forward_time: 12.1522369385, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6499691010
validation[          , genome  6045] predictions:    9765/  10000 (97.65%), best:    9765/10000 (97.65%), error:       740.09802, best error:       740.09802 on epoch:    46, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 156.2816467285s, input_fired_time: 1.9665404558, output_fired_time: 2.2404718399, propagate_forward_time: 58.9924964905, propagate_backward_time: 89.6518478394, weight_update_time: 0.2142349482, other_time: 3.4302902222
epoch time: 12.6554555893s, input_fired_time: 0.2710585296, output_fired_time: 0.0000000000, propagate_forward_time: 11.7657890320, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6186084747
validation[          , genome  6045] predictions:    9692/  10000 (96.92%), best:    9765/10000 (97.65%), error:       972.52271, best error:       740.09802 on epoch:    46, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 163.1596069336s, input_fired_time: 2.1071286201, output_fired_time: 2.3250310421, propagate_forward_time: 60.6368827820, propagate_backward_time: 94.5060119629, weight_update_time: 0.2169032842, other_time: 3.5845489502
epoch time: 12.5635766983s, input_fired_time: 0.2407837212, output_fired_time: 0.0000000000, propagate_forward_time: 11.7043380737, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6184549332
validation[          , genome  6045] predictions:    9756/  10000 (97.56%), best:    9765/10000 (97.65%), error:       795.99921, best error:       740.09802 on epoch:    46, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 157.2256774902s, input_fired_time: 2.0197582245, output_fired_time: 2.2373201847, propagate_forward_time: 59.0983314514, propagate_backward_time: 90.3282928467, weight_update_time: 0.2191963643, other_time: 3.5419769287
epoch time: 13.1378555298s, input_fired_time: 0.2480894476, output_fired_time: 0.0000000000, propagate_forward_time: 12.2491273880, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6406383514
validation[          , genome  6045] predictions:    9668/  10000 (96.68%), best:    9765/10000 (97.65%), error:      1102.61536, best error:       740.09802 on epoch:    46, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 159.9805145264s, input_fired_time: 1.9853626490, output_fired_time: 2.2206845284, propagate_forward_time: 59.9768638611, propagate_backward_time: 92.1873626709, weight_update_time: 0.2166867703, other_time: 3.6102294922
epoch time: 12.5775156021s, input_fired_time: 0.2436331511, output_fired_time: 0.0000000000, propagate_forward_time: 11.7002973557, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6335849762
validation[          , genome  6045] predictions:    9675/  10000 (96.75%), best:    9765/10000 (97.65%), error:      1073.74585, best error:       740.09802 on epoch:    46, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 160.4862365723s, input_fired_time: 2.0407340527, output_fired_time: 2.2438981533, propagate_forward_time: 60.1427688599, propagate_backward_time: 92.4971847534, weight_update_time: 0.2193021029, other_time: 3.5616455078
epoch time: 15.7490186691s, input_fired_time: 0.3886706829, output_fired_time: 0.0000000000, propagate_forward_time: 14.6229867935, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7373609543
validation[          , genome  6045] predictions:    9710/  10000 (97.10%), best:    9765/10000 (97.65%), error:       918.37933, best error:       740.09802 on epoch:    46, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 154.3387298584s, input_fired_time: 1.9605739117, output_fired_time: 2.1975219250, propagate_forward_time: 58.2588768005, propagate_backward_time: 88.4987792969, weight_update_time: 0.2148481160, other_time: 3.4229736328
epoch time: 12.4469394684s, input_fired_time: 0.2399706841, output_fired_time: 0.0000000000, propagate_forward_time: 11.5878038406, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6191644669
validation[          , genome  6045] predictions:    9712/  10000 (97.12%), best:    9765/10000 (97.65%), error:       892.95679, best error:       740.09802 on epoch:    46, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 154.4551239014s, input_fired_time: 1.9638541937, output_fired_time: 2.2008492947, propagate_forward_time: 58.2881507874, propagate_backward_time: 88.5853347778, weight_update_time: 0.2139127851, other_time: 3.4169387817
epoch time: 12.6022729874s, input_fired_time: 0.2430391312, output_fired_time: 0.0000000000, propagate_forward_time: 11.7390108109, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6202230453
validation[          , genome  6045] predictions:    9734/  10000 (97.34%), best:    9765/10000 (97.65%), error:       890.26245, best error:       740.09802 on epoch:    46, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 154.6407623291s, input_fired_time: 1.9810544252, output_fired_time: 2.2030768394, propagate_forward_time: 58.2170600891, propagate_backward_time: 88.7605667114, weight_update_time: 0.2151486129, other_time: 3.4790115356
epoch time: 13.5299062729s, input_fired_time: 0.2534767687, output_fired_time: 0.0000000000, propagate_forward_time: 12.6257286072, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6507005692
validation[          , genome  6045] predictions:    9731/  10000 (97.31%), best:    9765/10000 (97.65%), error:       849.11365, best error:       740.09802 on epoch:    46, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 154.5748901367s, input_fired_time: 1.9662718773, output_fired_time: 2.1986739635, propagate_forward_time: 58.4498214722, propagate_backward_time: 88.5420684814, weight_update_time: 0.2135846764, other_time: 3.4180526733
epoch time: 13.2827625275s, input_fired_time: 0.2491946071, output_fired_time: 0.0000000000, propagate_forward_time: 12.2727708817, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7607975006
validation[          , genome  6045] predictions:    9736/  10000 (97.36%), best:    9765/10000 (97.65%), error:       852.98724, best error:       740.09802 on epoch:    46, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 163.5107116699s, input_fired_time: 2.0787589550, output_fired_time: 2.3219597340, propagate_forward_time: 61.5811614990, propagate_backward_time: 93.8871078491, weight_update_time: 0.2134663016, other_time: 3.6417160034
epoch time: 14.0758218765s, input_fired_time: 0.2407637089, output_fired_time: 0.0000000000, propagate_forward_time: 13.0904502869, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7446079254
validation[          , genome  6045] predictions:    9736/  10000 (97.36%), best:    9765/10000 (97.65%), error:       851.07434, best error:       740.09802 on epoch:    46, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 156.3151245117s, input_fired_time: 1.9724993706, output_fired_time: 2.2406873703, propagate_forward_time: 59.0596542358, propagate_backward_time: 89.5558090210, weight_update_time: 0.2140090317, other_time: 3.4864654541
epoch time: 16.6546840668s, input_fired_time: 0.4007596076, output_fired_time: 0.0000000000, propagate_forward_time: 15.5100097656, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7439155579
validation[          , genome  6045] predictions:    9729/  10000 (97.29%), best:    9765/10000 (97.65%), error:       870.73132, best error:       740.09802 on epoch:    46, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 158.7084503174s, input_fired_time: 2.1431558132, output_fired_time: 2.2229757309, propagate_forward_time: 59.7910804749, propagate_backward_time: 91.0628967285, weight_update_time: 0.2147885561, other_time: 3.4883422852
epoch time: 12.5014572144s, input_fired_time: 0.2411181927, output_fired_time: 0.0000000000, propagate_forward_time: 11.6245460510, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6357927322
validation[          , genome  6045] predictions:    9678/  10000 (96.78%), best:    9765/10000 (97.65%), error:      1005.23590, best error:       740.09802 on epoch:    46, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 159.3786010742s, input_fired_time: 1.9796465635, output_fired_time: 2.2798087597, propagate_forward_time: 60.1918449402, propagate_backward_time: 91.4028778076, weight_update_time: 0.2463621348, other_time: 3.5244140625
epoch time: 17.0581245422s, input_fired_time: 0.3021607995, output_fired_time: 0.0000000000, propagate_forward_time: 16.1078376770, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6481266022
validation[          , genome  6045] predictions:    9697/  10000 (96.97%), best:    9765/10000 (97.65%), error:       913.82233, best error:       740.09802 on epoch:    46, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 161.6542510986s, input_fired_time: 2.0612857342, output_fired_time: 2.2154438496, propagate_forward_time: 59.3711776733, propagate_backward_time: 94.5430831909, weight_update_time: 0.2136586159, other_time: 3.4632720947
epoch time: 16.1699962616s, input_fired_time: 0.3064801693, output_fired_time: 0.0000000000, propagate_forward_time: 15.0218696594, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8416461945
validation[          , genome  6045] predictions:    9716/  10000 (97.16%), best:    9765/10000 (97.65%), error:       878.68707, best error:       740.09802 on epoch:    46, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 162.7516784668s, input_fired_time: 2.1287760735, output_fired_time: 2.2703423500, propagate_forward_time: 60.6993751526, propagate_backward_time: 94.0478210449, weight_update_time: 0.2180217803, other_time: 3.6053771973
epoch time: 12.7054710388s, input_fired_time: 0.2429767400, output_fired_time: 0.0000000000, propagate_forward_time: 11.8116788864, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6508150101
validation[          , genome  6045] predictions:    9691/  10000 (96.91%), best:    9765/10000 (97.65%), error:       995.24866, best error:       740.09802 on epoch:    46, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 191.8571166992s, input_fired_time: 2.2555806637, output_fired_time: 2.3389394283, propagate_forward_time: 65.8156738281, propagate_backward_time: 117.5465774536, weight_update_time: 0.2471735775, other_time: 3.9003372192
epoch time: 17.8357715607s, input_fired_time: 0.2461499721, output_fired_time: 0.0000000000, propagate_forward_time: 16.7108116150, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8788108826
validation[          , genome  6045] predictions:    9720/  10000 (97.20%), best:    9765/10000 (97.65%), error:       935.27783, best error:       740.09802 on epoch:    46, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 159.0596313477s, input_fired_time: 2.0536918640, output_fired_time: 2.2496383190, propagate_forward_time: 60.0264587402, propagate_backward_time: 91.2014236450, weight_update_time: 0.2474583387, other_time: 3.5284194946
epoch time: 12.4583024979s, input_fired_time: 0.2397057861, output_fired_time: 0.0000000000, propagate_forward_time: 11.5734806061, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6451158524
validation[          , genome  6045] predictions:    9708/  10000 (97.08%), best:    9765/10000 (97.65%), error:       954.36810, best error:       740.09802 on epoch:    46, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 158.9418487549s, input_fired_time: 2.0356054306, output_fired_time: 2.2581911087, propagate_forward_time: 59.9865837097, propagate_backward_time: 91.1800003052, weight_update_time: 0.2135089636, other_time: 3.4814682007
epoch time: 19.5135364532s, input_fired_time: 0.3710571527, output_fired_time: 0.0000000000, propagate_forward_time: 18.1092147827, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0332641602
validation[          , genome  6045] predictions:    9767/  10000 (97.67%), best:    9765/10000 (97.65%), error:       762.33490, best error:       740.09802 on epoch:    46, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 159.9864654541s, input_fired_time: 2.0593967438, output_fired_time: 2.2464935780, propagate_forward_time: 60.3518180847, propagate_backward_time: 91.7884979248, weight_update_time: 0.2150342911, other_time: 3.5402526855
epoch time: 12.6037626266s, input_fired_time: 0.2472174764, output_fired_time: 0.0000000000, propagate_forward_time: 11.7276773453, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6288681030
validation[          , genome  6045] predictions:    9719/  10000 (97.19%), best:    9765/10000 (97.65%), error:       888.94525, best error:       740.09802 on epoch:    46, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 156.5420837402s, input_fired_time: 2.0018091202, output_fired_time: 2.1786119938, propagate_forward_time: 59.3339805603, propagate_backward_time: 89.5536117554, weight_update_time: 0.2129057348, other_time: 3.4740524292
epoch time: 15.8440589905s, input_fired_time: 0.2713072002, output_fired_time: 0.0000000000, propagate_forward_time: 14.7982330322, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7745189667
validation[          , genome  6045] predictions:    9745/  10000 (97.45%), best:    9765/10000 (97.65%), error:       808.24945, best error:       740.09802 on epoch:    46, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 154.5002899170s, input_fired_time: 2.0013577938, output_fired_time: 2.1985883713, propagate_forward_time: 58.2710494995, propagate_backward_time: 88.6090621948, weight_update_time: 0.2140375674, other_time: 3.4202270508
epoch time: 14.8427762985s, input_fired_time: 0.2440288663, output_fired_time: 0.0000000000, propagate_forward_time: 13.8831987381, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7155485153
validation[          , genome  6045] predictions:    9746/  10000 (97.46%), best:    9765/10000 (97.65%), error:       814.90039, best error:       740.09802 on epoch:    46, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 157.2674713135s, input_fired_time: 2.0351691246, output_fired_time: 2.2441544533, propagate_forward_time: 59.3062705994, propagate_backward_time: 90.1446075439, weight_update_time: 0.2187229395, other_time: 3.5372619629
epoch time: 13.6221580505s, input_fired_time: 0.2423007935, output_fired_time: 0.0000000000, propagate_forward_time: 12.7319889069, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6478681564
validation[          , genome  6045] predictions:    9764/  10000 (97.64%), best:    9765/10000 (97.65%), error:       778.51251, best error:       740.09802 on epoch:    46, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 156.0051727295s, input_fired_time: 1.9875301123, output_fired_time: 2.2133409977, propagate_forward_time: 58.9227294922, propagate_backward_time: 89.4510269165, weight_update_time: 0.2143692970, other_time: 3.4305343628
epoch time: 14.8844470978s, input_fired_time: 0.2450193763, output_fired_time: 0.0000000000, propagate_forward_time: 13.9542322159, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6851959229
validation[          , genome  6045] predictions:    9724/  10000 (97.24%), best:    9765/10000 (97.65%), error:       874.33264, best error:       740.09802 on epoch:    46, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 182.1338958740s, input_fired_time: 2.1718201637, output_fired_time: 2.3939833641, propagate_forward_time: 66.1148681641, propagate_backward_time: 107.5374145508, weight_update_time: 0.2155496627, other_time: 3.9158172607
epoch time: 12.3947916031s, input_fired_time: 0.2447295785, output_fired_time: 0.0000000000, propagate_forward_time: 11.5347967148, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6152648926
validation[          , genome  6045] predictions:    9743/  10000 (97.43%), best:    9765/10000 (97.65%), error:       814.94781, best error:       740.09802 on epoch:    46, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 160.6179809570s, input_fired_time: 2.0217645168, output_fired_time: 2.3080372810, propagate_forward_time: 60.7640266418, propagate_backward_time: 92.0235366821, weight_update_time: 0.2148011476, other_time: 3.5006179810
epoch time: 15.8778800964s, input_fired_time: 0.2465565056, output_fired_time: 0.0000000000, propagate_forward_time: 14.8470516205, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7842721939
validation[          , genome  6045] predictions:    9697/  10000 (96.97%), best:    9765/10000 (97.65%), error:       953.62408, best error:       740.09802 on epoch:    46, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 160.4951324463s, input_fired_time: 2.0554904938, output_fired_time: 2.3722054958, propagate_forward_time: 60.5675277710, propagate_backward_time: 91.9071350098, weight_update_time: 0.2461874038, other_time: 3.5927658081
epoch time: 14.2072038651s, input_fired_time: 0.3086739779, output_fired_time: 0.0000000000, propagate_forward_time: 13.2427730560, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6557569504
validation[          , genome  6045] predictions:    9670/  10000 (96.70%), best:    9765/10000 (97.65%), error:       997.75116, best error:       740.09802 on epoch:    46, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 158.2968139648s, input_fired_time: 2.0194385052, output_fired_time: 2.1968164444, propagate_forward_time: 59.7194633484, propagate_backward_time: 90.8343200684, weight_update_time: 0.2155458927, other_time: 3.5267639160
epoch time: 24.5071296692s, input_fired_time: 0.4376778007, output_fired_time: 0.0000000000, propagate_forward_time: 22.9025516510, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1669006348
validation[          , genome  6045] predictions:    9732/  10000 (97.32%), best:    9765/10000 (97.65%), error:       824.24554, best error:       740.09802 on epoch:    46, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 160.5034942627s, input_fired_time: 2.0227296352, output_fired_time: 2.3539571762, propagate_forward_time: 60.5433540344, propagate_backward_time: 92.0525360107, weight_update_time: 0.2158945799, other_time: 3.5309143066
epoch time: 17.1819477081s, input_fired_time: 0.2965220809, output_fired_time: 0.0000000000, propagate_forward_time: 16.1678829193, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7175426483
validation[          , genome  6045] predictions:    9714/  10000 (97.14%), best:    9765/10000 (97.65%), error:       930.70349, best error:       740.09802 on epoch:    46, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 164.4177398682s, input_fired_time: 2.1002352238, output_fired_time: 2.3460395336, propagate_forward_time: 61.8182067871, propagate_backward_time: 94.4199600220, weight_update_time: 0.2160285413, other_time: 3.7332992554
epoch time: 13.3748006821s, input_fired_time: 0.2455706298, output_fired_time: 0.0000000000, propagate_forward_time: 12.4706573486, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6585731506
validation[          , genome  6045] predictions:    9744/  10000 (97.44%), best:    9765/10000 (97.65%), error:       858.76208, best error:       740.09802 on epoch:    46, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 155.3480529785s, input_fired_time: 1.9777952433, output_fired_time: 2.1883509159, propagate_forward_time: 58.5591621399, propagate_backward_time: 89.1999435425, weight_update_time: 0.2146049142, other_time: 3.4227981567
epoch time: 19.6170921326s, input_fired_time: 0.3404726982, output_fired_time: 0.0000000000, propagate_forward_time: 18.1469745636, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1296443939
validation[          , genome  6045] predictions:    9734/  10000 (97.34%), best:    9765/10000 (97.65%), error:       849.61578, best error:       740.09802 on epoch:    46, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 154.3554229736s, input_fired_time: 1.9601620436, output_fired_time: 2.1878864765, propagate_forward_time: 57.6838531494, propagate_backward_time: 89.0957107544, weight_update_time: 0.2150518000, other_time: 3.4278182983
epoch time: 18.9362792969s, input_fired_time: 0.4066443443, output_fired_time: 0.0000000000, propagate_forward_time: 17.7648105621, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7648239136
validation[          , genome  6045] predictions:    9735/  10000 (97.35%), best:    9765/10000 (97.65%), error:       839.95636, best error:       740.09802 on epoch:    46, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 153.6677856445s, input_fired_time: 1.9695390463, output_fired_time: 2.1799323559, propagate_forward_time: 57.8648948669, propagate_backward_time: 88.2436599731, weight_update_time: 0.2135250568, other_time: 3.4097518921
epoch time: 12.3687410355s, input_fired_time: 0.2410128266, output_fired_time: 0.0000000000, propagate_forward_time: 11.5140724182, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6136560440
validation[          , genome  6045] predictions:    9740/  10000 (97.40%), best:    9765/10000 (97.65%), error:       836.38904, best error:       740.09802 on epoch:    46, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 159.1348114014s, input_fired_time: 2.0294790268, output_fired_time: 2.2241034508, propagate_forward_time: 59.9911155701, propagate_backward_time: 91.3822784424, weight_update_time: 0.2162009925, other_time: 3.5078277588
epoch time: 13.6473302841s, input_fired_time: 0.2464036942, output_fired_time: 0.0000000000, propagate_forward_time: 12.6252918243, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7756347656
validation[          , genome  6045] predictions:    9694/  10000 (96.94%), best:    9765/10000 (97.65%), error:       992.47473, best error:       740.09802 on epoch:    46, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 155.4947509766s, input_fired_time: 1.9988892078, output_fired_time: 2.2179236412, propagate_forward_time: 58.7146301270, propagate_backward_time: 89.1398925781, weight_update_time: 0.2143054157, other_time: 3.4234161377
epoch time: 12.6041450500s, input_fired_time: 0.2463901788, output_fired_time: 0.0000000000, propagate_forward_time: 11.7400159836, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6177387238
validation[          , genome  6045] predictions:    9676/  10000 (96.76%), best:    9765/10000 (97.65%), error:      1063.92322, best error:       740.09802 on epoch:    46, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 155.8811645508s, input_fired_time: 2.0170788765, output_fired_time: 2.2484633923, propagate_forward_time: 58.7063140869, propagate_backward_time: 89.4015960693, weight_update_time: 0.2160840631, other_time: 3.5077209473
epoch time: 13.4090242386s, input_fired_time: 0.2791241407, output_fired_time: 0.0000000000, propagate_forward_time: 12.3183555603, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8115444183
validation[          , genome  6045] predictions:    9739/  10000 (97.39%), best:    9765/10000 (97.65%), error:       859.44714, best error:       740.09802 on epoch:    46, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 155.0424499512s, input_fired_time: 1.9819697142, output_fired_time: 2.2269098759, propagate_forward_time: 58.4268836975, propagate_backward_time: 88.9419021606, weight_update_time: 0.2138296664, other_time: 3.4647903442
epoch time: 12.5876502991s, input_fired_time: 0.2449243069, output_fired_time: 0.0000000000, propagate_forward_time: 11.7236957550, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6190299988
validation[          , genome  6045] predictions:    9750/  10000 (97.50%), best:    9765/10000 (97.65%), error:       837.89734, best error:       740.09802 on epoch:    46, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 177.3588256836s, input_fired_time: 2.1606395245, output_fired_time: 2.3293592930, propagate_forward_time: 75.4241104126, propagate_backward_time: 93.7705383301, weight_update_time: 0.2494928986, other_time: 3.6741714478
epoch time: 12.8732919693s, input_fired_time: 0.2517368197, output_fired_time: 0.0000000000, propagate_forward_time: 11.9583187103, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6632366180
validation[          , genome  6045] predictions:    9739/  10000 (97.39%), best:    9765/10000 (97.65%), error:       812.28662, best error:       740.09802 on epoch:    46, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 155.3499603271s, input_fired_time: 1.9759391546, output_fired_time: 2.2523863316, propagate_forward_time: 58.4771194458, propagate_backward_time: 89.2173156738, weight_update_time: 0.2130673975, other_time: 3.4272079468
epoch time: 18.4462871552s, input_fired_time: 0.3751140833, output_fired_time: 0.0000000000, propagate_forward_time: 17.3249588013, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7462139130
validation[          , genome  6045] predictions:    9624/  10000 (96.24%), best:    9765/10000 (97.65%), error:      1182.25452, best error:       740.09802 on epoch:    46, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 158.3671722412s, input_fired_time: 2.0439698696, output_fired_time: 2.2804455757, propagate_forward_time: 59.7339820862, propagate_backward_time: 90.7765197754, weight_update_time: 0.2158476114, other_time: 3.5322570801
epoch time: 15.8922472000s, input_fired_time: 0.4085622728, output_fired_time: 0.0000000000, propagate_forward_time: 14.7307815552, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7529029846
validation[          , genome  6045] predictions:    9729/  10000 (97.29%), best:    9765/10000 (97.65%), error:       857.52435, best error:       740.09802 on epoch:    46, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 164.9539184570s, input_fired_time: 2.1633491516, output_fired_time: 2.4885587692, propagate_forward_time: 62.0469474792, propagate_backward_time: 94.4027786255, weight_update_time: 0.2151347399, other_time: 3.8522872925
epoch time: 16.6435432434s, input_fired_time: 0.2462901026, output_fired_time: 0.0000000000, propagate_forward_time: 15.5494174957, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8478355408
validation[          , genome  6045] predictions:    9703/  10000 (97.03%), best:    9765/10000 (97.65%), error:       977.95966, best error:       740.09802 on epoch:    46, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 155.3934326172s, input_fired_time: 1.9967701435, output_fired_time: 2.2129471302, propagate_forward_time: 58.6587791443, propagate_backward_time: 89.0937194824, weight_update_time: 0.2147473246, other_time: 3.4312133789
epoch time: 19.8349914551s, input_fired_time: 0.5030605793, output_fired_time: 0.0000000000, propagate_forward_time: 18.3617401123, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9701900482
validation[          , genome  6045] predictions:    9726/  10000 (97.26%), best:    9765/10000 (97.65%), error:       876.55133, best error:       740.09802 on epoch:    46, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 151.7472076416s, input_fired_time: 2.0198271275, output_fired_time: 2.1658158302, propagate_forward_time: 56.3543853760, propagate_backward_time: 87.6545181274, weight_update_time: 0.2117182612, other_time: 3.5526657104
epoch time: 18.0243759155s, input_fired_time: 0.3752700388, output_fired_time: 0.0000000000, propagate_forward_time: 16.6785850525, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9705200195
validation[          , genome  6045] predictions:    9660/  10000 (96.60%), best:    9765/10000 (97.65%), error:      1063.47144, best error:       740.09802 on epoch:    46, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 160.6501464844s, input_fired_time: 2.1738288403, output_fired_time: 2.2909252644, propagate_forward_time: 60.4561195374, propagate_backward_time: 92.1566696167, weight_update_time: 0.2134961784, other_time: 3.5726089478
epoch time: 14.8575334549s, input_fired_time: 0.2483915389, output_fired_time: 0.0000000000, propagate_forward_time: 13.9549484253, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6541938782
validation[          , genome  6045] predictions:    9742/  10000 (97.42%), best:    9765/10000 (97.65%), error:       837.10712, best error:       740.09802 on epoch:    46, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 155.3961181641s, input_fired_time: 1.9976081848, output_fired_time: 2.2110581398, propagate_forward_time: 58.6541976929, propagate_backward_time: 89.1007843018, weight_update_time: 0.2147407532, other_time: 3.4324722290
epoch time: 34.4477996826s, input_fired_time: 0.4066778719, output_fired_time: 0.0000000000, propagate_forward_time: 32.9075355530, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1335868835
validation[          , genome  6045] predictions:    9730/  10000 (97.30%), best:    9765/10000 (97.65%), error:       851.77216, best error:       740.09802 on epoch:    46, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 156.7133941650s, input_fired_time: 2.0126523972, output_fired_time: 2.1866176128, propagate_forward_time: 58.9754333496, propagate_backward_time: 90.0558090210, weight_update_time: 0.2133067697, other_time: 3.4828872681
epoch time: 18.7339649200s, input_fired_time: 0.3759861588, output_fired_time: 0.0000000000, propagate_forward_time: 17.4831638336, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8748149872
validation[          , genome  6045] predictions:    9711/  10000 (97.11%), best:    9765/10000 (97.65%), error:       889.47559, best error:       740.09802 on epoch:    46, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 156.9862670898s, input_fired_time: 1.9983084202, output_fired_time: 2.2113721371, propagate_forward_time: 59.2565574646, propagate_backward_time: 90.0583038330, weight_update_time: 0.2145147622, other_time: 3.4617309570
epoch time: 15.1419487000s, input_fired_time: 0.3384444416, output_fired_time: 0.0000000000, propagate_forward_time: 14.0235834122, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7799205780
validation[          , genome  6045] predictions:    9717/  10000 (97.17%), best:    9765/10000 (97.65%), error:       902.97192, best error:       740.09802 on epoch:    46, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 155.1300506592s, input_fired_time: 2.0003080368, output_fired_time: 2.2154667377, propagate_forward_time: 58.3839225769, propagate_backward_time: 89.0902786255, weight_update_time: 0.2149482518, other_time: 3.4400711060
epoch time: 14.8482847214s, input_fired_time: 0.2470938861, output_fired_time: 0.0000000000, propagate_forward_time: 13.8222255707, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7789649963
validation[          , genome  6045] predictions:    9740/  10000 (97.40%), best:    9765/10000 (97.65%), error:       833.59222, best error:       740.09802 on epoch:    46, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 168.7840576172s, input_fired_time: 2.0651559830, output_fired_time: 2.2814300060, propagate_forward_time: 61.2324676514, propagate_backward_time: 99.6443481445, weight_update_time: 0.2146353275, other_time: 3.5606536865
epoch time: 13.3589553833s, input_fired_time: 0.2783184350, output_fired_time: 0.0000000000, propagate_forward_time: 12.3947639465, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6858730316
validation[          , genome  6045] predictions:    9735/  10000 (97.35%), best:    9765/10000 (97.65%), error:       815.63965, best error:       740.09802 on epoch:    46, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 154.4566955566s, input_fired_time: 1.9943801165, output_fired_time: 2.1965513229, propagate_forward_time: 58.3119735718, propagate_backward_time: 88.5315093994, weight_update_time: 0.2138057351, other_time: 3.4222793579
epoch time: 16.3581295013s, input_fired_time: 0.2827299237, output_fired_time: 0.0000000000, propagate_forward_time: 15.1280050278, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9473943710
validation[          , genome  6045] predictions:    9715/  10000 (97.15%), best:    9765/10000 (97.65%), error:       941.47650, best error:       740.09802 on epoch:    46, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 157.1844024658s, input_fired_time: 2.0488975048, output_fired_time: 2.2194323540, propagate_forward_time: 59.2188911438, propagate_backward_time: 90.1837463379, weight_update_time: 0.2158194780, other_time: 3.5134277344
epoch time: 13.7915534973s, input_fired_time: 0.2438433617, output_fired_time: 0.0000000000, propagate_forward_time: 12.8048276901, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7428827286
validation[          , genome  6045] predictions:    9671/  10000 (96.71%), best:    9765/10000 (97.65%), error:      1076.82288, best error:       740.09802 on epoch:    46, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 161.9328460693s, input_fired_time: 2.1325242519, output_fired_time: 2.3758375645, propagate_forward_time: 60.1480407715, propagate_backward_time: 93.5037155151, weight_update_time: 0.2097645402, other_time: 3.7727279663
epoch time: 25.1719722748s, input_fired_time: 0.5983724594, output_fired_time: 0.0000000000, propagate_forward_time: 23.4457511902, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1278495789
validation[          , genome  6045] predictions:    9744/  10000 (97.44%), best:    9765/10000 (97.65%), error:       813.85986, best error:       740.09802 on epoch:    46, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 166.4067230225s, input_fired_time: 2.3208620548, output_fired_time: 2.2798845768, propagate_forward_time: 62.5000610352, propagate_backward_time: 95.5097427368, weight_update_time: 0.2164709270, other_time: 3.7961654663
epoch time: 13.5143203735s, input_fired_time: 0.2520027757, output_fired_time: 0.0000000000, propagate_forward_time: 12.5945062637, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6678113937
validation[          , genome  6045] predictions:    9695/  10000 (96.95%), best:    9765/10000 (97.65%), error:       987.40161, best error:       740.09802 on epoch:    46, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 160.4826660156s, input_fired_time: 2.0331850052, output_fired_time: 2.2439880371, propagate_forward_time: 60.6058349609, propagate_backward_time: 92.1032562256, weight_update_time: 0.2152046710, other_time: 3.4963989258
epoch time: 14.8883028030s, input_fired_time: 0.2770965099, output_fired_time: 0.0000000000, propagate_forward_time: 13.7640180588, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8471879959
validation[          , genome  6045] predictions:    9588/  10000 (95.88%), best:    9765/10000 (97.65%), error:      1238.36475, best error:       740.09802 on epoch:    46, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 159.2760009766s, input_fired_time: 2.0047247410, output_fired_time: 2.2130939960, propagate_forward_time: 60.1841011047, propagate_backward_time: 91.3495788574, weight_update_time: 0.2465282232, other_time: 3.5245056152
epoch time: 14.9122200012s, input_fired_time: 0.2504299581, output_fired_time: 0.0000000000, propagate_forward_time: 13.9452819824, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7165079117
validation[          , genome  6045] predictions:    9737/  10000 (97.37%), best:    9765/10000 (97.65%), error:       818.91797, best error:       740.09802 on epoch:    46, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 71.9162673950s, input_fired_time: 1.3992036581, output_fired_time: 0.0000000000, propagate_forward_time: 67.0077667236, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5093002319
best training[          , genome  6045] predictions:   49503/  50000 (99.01%), best:    9765/10000 (97.65%), error:      1833.09326, best error:       740.09802 on epoch:    46, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 16.7811565399s, input_fired_time: 0.2777775526, output_fired_time: 0.0000000000, propagate_forward_time: 15.6817016602, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8216781616
   testing[          , genome  6045] predictions:    9798/  10000 (97.98%), best:    9765/10000 (97.65%), error:       668.46265, best error:       740.09802 on epoch:    46, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
03:58:37 (5016): called boinc_finish(0)

</stderr_txt>
]]>