Nameexact_genome_1512568488_43_6642_1
Workunit2604468
Created7 Dec 2017, 21:02:42 UTC
Sent7 Dec 2017, 21:09:38 UTC
Report deadline15 Dec 2017, 1:50:56 UTC
Received8 Dec 2017, 13:37:37 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID55108
Run time4 hours 6 min 57 sec
CPU time4 hours 2 min 12 sec
Validate stateValid
Credit1,798.84
Device peak FLOPS2.57 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size154.12 MB
Peak swap size157.47 MB
Peak disk usage1.79 MB

Stderr output

<core_client_version>7.8.2</core_client_version>
<![CDATA[
<stderr_txt>
dictions:    9628/  10000 (96.28%), best:    9701/10000 (97.01%), error:      1172.33972, best error:      1014.17896 on epoch:    11, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 145.2181243896s, input_fired_time: 1.2948030233, output_fired_time: 1.1591075659, propagate_forward_time: 53.2282180786, propagate_backward_time: 85.1947937012, weight_update_time: 0.1566118747, other_time: 4.3412094116
epoch time: 11.8449153900s, input_fired_time: 0.1585635990, output_fired_time: 0.0000000000, propagate_forward_time: 11.1256971359, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5606546402
validation[          , genome  6642] predictions:    9686/  10000 (96.86%), best:    9701/10000 (97.01%), error:      1042.92444, best error:      1014.17896 on epoch:    11, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 139.2683868408s, input_fired_time: 1.2513705492, output_fired_time: 1.1019455194, propagate_forward_time: 52.3785934448, propagate_backward_time: 81.3564376831, weight_update_time: 0.1563821584, other_time: 3.1800384521
epoch time: 10.5119438171s, input_fired_time: 0.1542766988, output_fired_time: 0.0000000000, propagate_forward_time: 9.8147840500, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5428829193
validation[          , genome  6642] predictions:    9641/  10000 (96.41%), best:    9701/10000 (97.01%), error:      1153.57263, best error:      1014.17896 on epoch:    11, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 139.9134063721s, input_fired_time: 1.2511396408, output_fired_time: 1.1138017178, propagate_forward_time: 51.8128166199, propagate_backward_time: 82.5703125000, weight_update_time: 0.1559392810, other_time: 3.1653289795
epoch time: 10.6619100571s, input_fired_time: 0.1576971561, output_fired_time: 0.0000000000, propagate_forward_time: 9.9547557831, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5494575500
validation[          , genome  6642] predictions:    9572/  10000 (95.72%), best:    9701/10000 (97.01%), error:      1383.56201, best error:      1014.17896 on epoch:    11, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 138.5012054443s, input_fired_time: 1.2449389696, output_fired_time: 1.0973054171, propagate_forward_time: 50.1124763489, propagate_backward_time: 81.8988494873, weight_update_time: 0.1551207602, other_time: 4.1476440430
epoch time: 12.3426704407s, input_fired_time: 0.1617307514, output_fired_time: 0.0000000000, propagate_forward_time: 11.6226272583, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5583124161
validation[          , genome  6642] predictions:    9703/  10000 (97.03%), best:    9703/10000 (97.03%), error:       974.70764, best error:       974.70764 on epoch:    18, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 145.4709472656s, input_fired_time: 1.3349785805, output_fired_time: 1.1523753405, propagate_forward_time: 54.6293601990, propagate_backward_time: 85.0697479248, weight_update_time: 0.1570662707, other_time: 3.2844848633
epoch time: 11.9127159119s, input_fired_time: 0.1569558233, output_fired_time: 0.0000000000, propagate_forward_time: 11.2085781097, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5471820831
validation[          , genome  6642] predictions:    9681/  10000 (96.81%), best:    9703/10000 (97.03%), error:      1031.07190, best error:       974.70764 on epoch:    18, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 140.6369934082s, input_fired_time: 1.2522184849, output_fired_time: 1.1124808788, propagate_forward_time: 52.8657455444, propagate_backward_time: 82.2357788086, weight_update_time: 0.1566616297, other_time: 3.1707687378
epoch time: 10.6556854248s, input_fired_time: 0.1572826803, output_fired_time: 0.0000000000, propagate_forward_time: 9.9443397522, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5540628433
validation[          , genome  6642] predictions:    9647/  10000 (96.47%), best:    9703/10000 (97.03%), error:      1150.51965, best error:       974.70764 on epoch:    18, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 140.1926727295s, input_fired_time: 1.2483570576, output_fired_time: 2.1199638844, propagate_forward_time: 54.8075866699, propagate_backward_time: 78.8919830322, weight_update_time: 0.1572477072, other_time: 3.1247863770
epoch time: 11.8047103882s, input_fired_time: 0.1585073322, output_fired_time: 0.0000000000, propagate_forward_time: 11.0922260284, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5539770126
validation[          , genome  6642] predictions:    9694/  10000 (96.94%), best:    9703/10000 (97.03%), error:      1018.31482, best error:       974.70764 on epoch:    18, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 140.1035461426s, input_fired_time: 1.2625718117, output_fired_time: 1.1115732193, propagate_forward_time: 52.9421501160, propagate_backward_time: 80.6165313721, weight_update_time: 0.1564993709, other_time: 4.1707153320
epoch time: 10.7026453018s, input_fired_time: 0.1573232859, output_fired_time: 0.0000000000, propagate_forward_time: 9.9876899719, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5576324463
validation[          , genome  6642] predictions:    9633/  10000 (96.33%), best:    9703/10000 (97.03%), error:      1217.86560, best error:       974.70764 on epoch:    18, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 139.4286804199s, input_fired_time: 1.2526978254, output_fired_time: 1.1287274361, propagate_forward_time: 53.5770187378, propagate_backward_time: 80.3010635376, weight_update_time: 0.1561040133, other_time: 3.1691741943
epoch time: 11.9230556488s, input_fired_time: 0.1613579243, output_fired_time: 0.0000000000, propagate_forward_time: 11.1924629211, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5692348480
validation[          , genome  6642] predictions:    9576/  10000 (95.76%), best:    9703/10000 (97.03%), error:      1314.60999, best error:       974.70764 on epoch:    18, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 139.7628936768s, input_fired_time: 1.2533103228, output_fired_time: 1.1140969992, propagate_forward_time: 54.6072158813, propagate_backward_time: 78.7560577393, weight_update_time: 0.1556563824, other_time: 4.0322189331
epoch time: 10.6395444870s, input_fired_time: 0.1581589133, output_fired_time: 0.0000000000, propagate_forward_time: 9.9255247116, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5558605194
validation[          , genome  6642] predictions:    9641/  10000 (96.41%), best:    9703/10000 (97.03%), error:      1092.97656, best error:       974.70764 on epoch:    18, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 139.6156005859s, input_fired_time: 1.2638044357, output_fired_time: 1.1118890047, propagate_forward_time: 51.6818428040, propagate_backward_time: 82.3917236328, weight_update_time: 0.1564803869, other_time: 3.1663360596
epoch time: 11.9732131958s, input_fired_time: 0.1619375795, output_fired_time: 0.0000000000, propagate_forward_time: 11.2512683868, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5600070953
validation[          , genome  6642] predictions:    9660/  10000 (96.60%), best:    9703/10000 (97.03%), error:      1109.82947, best error:       974.70764 on epoch:    18, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 139.7094421387s, input_fired_time: 1.2569178343, output_fired_time: 1.1177827120, propagate_forward_time: 51.5634994507, propagate_backward_time: 82.6041030884, weight_update_time: 0.1559814066, other_time: 3.1671447754
epoch time: 11.7698698044s, input_fired_time: 0.1589267105, output_fired_time: 0.0000000000, propagate_forward_time: 11.0601692200, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5507736206
validation[          , genome  6642] predictions:    9689/  10000 (96.89%), best:    9703/10000 (97.03%), error:       986.11121, best error:       974.70764 on epoch:    18, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 146.9022369385s, input_fired_time: 1.3294265270, output_fired_time: 1.1665611267, propagate_forward_time: 55.3243637085, propagate_backward_time: 85.6676483154, weight_update_time: 0.1568605602, other_time: 3.4142379761
epoch time: 11.8522701263s, input_fired_time: 0.1607236266, output_fired_time: 0.0000000000, propagate_forward_time: 11.1345090866, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5570373535
validation[          , genome  6642] predictions:    9717/  10000 (97.17%), best:    9717/10000 (97.17%), error:       952.28802, best error:       952.28802 on epoch:    27, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 141.9355926514s, input_fired_time: 1.2680908442, output_fired_time: 1.1261060238, propagate_forward_time: 54.5540771484, propagate_backward_time: 81.7555770874, weight_update_time: 0.1560493410, other_time: 3.2317428589
epoch time: 10.8008594513s, input_fired_time: 0.1593644917, output_fired_time: 0.0000000000, propagate_forward_time: 10.0898933411, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5516014099
validation[          , genome  6642] predictions:    9632/  10000 (96.32%), best:    9717/10000 (97.17%), error:      1170.03162, best error:       952.28802 on epoch:    27, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 139.1416168213s, input_fired_time: 1.2510571480, output_fired_time: 1.1090517044, propagate_forward_time: 53.2700233459, propagate_backward_time: 80.3814163208, weight_update_time: 0.1560634226, other_time: 3.1300735474
epoch time: 12.0844125748s, input_fired_time: 0.1617406011, output_fired_time: 0.0000000000, propagate_forward_time: 11.3693389893, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5533332825
validation[          , genome  6642] predictions:    9690/  10000 (96.90%), best:    9690/10000 (96.90%), error:       934.51678, best error:       934.51678 on epoch:    29, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 141.0032653809s, input_fired_time: 1.2640922070, output_fired_time: 1.1218152046, propagate_forward_time: 53.3185386658, propagate_backward_time: 82.1262664795, weight_update_time: 0.1574104279, other_time: 3.1725463867
epoch time: 10.7384529114s, input_fired_time: 0.1586754322, output_fired_time: 0.0000000000, propagate_forward_time: 10.0295972824, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5501804352
validation[          , genome  6642] predictions:    9726/  10000 (97.26%), best:    9726/10000 (97.26%), error:       885.07898, best error:       885.07898 on epoch:    30, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 143.9248809814s, input_fired_time: 1.2695214748, output_fired_time: 1.2409003973, propagate_forward_time: 53.5989570618, propagate_backward_time: 84.5971069336, weight_update_time: 0.1559515744, other_time: 3.2183990479
epoch time: 10.7850112915s, input_fired_time: 0.1562324762, output_fired_time: 0.0000000000, propagate_forward_time: 10.0910072327, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5377712250
validation[          , genome  6642] predictions:    9723/  10000 (97.23%), best:    9726/10000 (97.26%), error:       938.53333, best error:       885.07898 on epoch:    30, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 150.5106506348s, input_fired_time: 1.3034065962, output_fired_time: 1.1965960264, propagate_forward_time: 58.1984329224, propagate_backward_time: 86.3666992188, weight_update_time: 0.1734402329, other_time: 3.4455184937
epoch time: 12.8797826767s, input_fired_time: 0.1945038140, output_fired_time: 0.0000000000, propagate_forward_time: 12.0310964584, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6541824341
validation[          , genome  6642] predictions:    9491/  10000 (94.91%), best:    9726/10000 (97.26%), error:      1795.53845, best error:       885.07898 on epoch:    30, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 140.3086090088s, input_fired_time: 1.2528773546, output_fired_time: 1.1164690256, propagate_forward_time: 55.6486816406, propagate_backward_time: 79.1777877808, weight_update_time: 0.1552732289, other_time: 3.1127853394
epoch time: 11.7832593918s, input_fired_time: 0.1596362442, output_fired_time: 0.0000000000, propagate_forward_time: 11.0677795410, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5558433533
validation[          , genome  6642] predictions:    9671/  10000 (96.71%), best:    9726/10000 (97.26%), error:      1087.60449, best error:       885.07898 on epoch:    30, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 144.3884582520s, input_fired_time: 1.2895797491, output_fired_time: 2.1799895763, propagate_forward_time: 55.4488983154, propagate_backward_time: 82.2161712646, weight_update_time: 0.1562800705, other_time: 3.2538146973
epoch time: 11.9645786285s, input_fired_time: 0.1611976773, output_fired_time: 0.0000000000, propagate_forward_time: 11.2427902222, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5605907440
validation[          , genome  6642] predictions:    9634/  10000 (96.34%), best:    9726/10000 (97.26%), error:      1180.73279, best error:       885.07898 on epoch:    30, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 145.0883331299s, input_fired_time: 1.3000169992, output_fired_time: 1.1632701159, propagate_forward_time: 53.9076805115, propagate_backward_time: 84.4550323486, weight_update_time: 0.1649200022, other_time: 4.2623291016
epoch time: 11.8868865967s, input_fired_time: 0.1626681089, output_fired_time: 0.0000000000, propagate_forward_time: 11.1517572403, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5724611282
validation[          , genome  6642] predictions:    9736/  10000 (97.36%), best:    9726/10000 (97.26%), error:       890.49445, best error:       885.07898 on epoch:    30, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 140.7628021240s, input_fired_time: 1.2629213333, output_fired_time: 1.1162780523, propagate_forward_time: 53.1557846069, propagate_backward_time: 81.0679702759, weight_update_time: 0.1562394798, other_time: 4.1598510742
epoch time: 11.0839242935s, input_fired_time: 0.1589476019, output_fired_time: 0.0000000000, propagate_forward_time: 10.2809486389, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6440277100
validation[          , genome  6642] predictions:    9711/  10000 (97.11%), best:    9726/10000 (97.26%), error:       911.22369, best error:       885.07898 on epoch:    30, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 143.2828674316s, input_fired_time: 1.2734881639, output_fired_time: 1.1466028690, propagate_forward_time: 56.5980262756, propagate_backward_time: 80.0737915039, weight_update_time: 0.1571029872, other_time: 4.1909637451
epoch time: 10.8168382645s, input_fired_time: 0.1583187282, output_fired_time: 0.0000000000, propagate_forward_time: 10.1020174026, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5565023422
validation[          , genome  6642] predictions:    9617/  10000 (96.17%), best:    9726/10000 (97.26%), error:      1145.90271, best error:       885.07898 on epoch:    30, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 140.5148010254s, input_fired_time: 1.2567015886, output_fired_time: 1.1120320559, propagate_forward_time: 51.7703094482, propagate_backward_time: 83.1511993408, weight_update_time: 0.1555885673, other_time: 3.2245635986
epoch time: 12.2428503036s, input_fired_time: 0.1642363220, output_fired_time: 0.0000000000, propagate_forward_time: 11.5192689896, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5593452454
validation[          , genome  6642] predictions:    9671/  10000 (96.71%), best:    9726/10000 (97.26%), error:      1100.93481, best error:       885.07898 on epoch:    30, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 146.6136932373s, input_fired_time: 1.3169600964, output_fired_time: 1.2328428030, propagate_forward_time: 55.9033203125, propagate_backward_time: 84.8476028442, weight_update_time: 0.1573698372, other_time: 3.3129653931
epoch time: 12.1656789780s, input_fired_time: 0.1607954055, output_fired_time: 0.0000000000, propagate_forward_time: 11.4513406754, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5535430908
validation[          , genome  6642] predictions:    9719/  10000 (97.19%), best:    9719/10000 (97.19%), error:       876.55267, best error:       876.55267 on epoch:    39, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 139.5881347656s, input_fired_time: 1.2610229254, output_fired_time: 1.1075834036, propagate_forward_time: 53.5537834167, propagate_backward_time: 80.4585571289, weight_update_time: 0.1554774940, other_time: 3.2071838379
epoch time: 10.9755992889s, input_fired_time: 0.1594886482, output_fired_time: 0.0000000000, propagate_forward_time: 10.2421216965, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5739889145
validation[          , genome  6642] predictions:    9743/  10000 (97.43%), best:    9743/10000 (97.43%), error:       871.25665, best error:       871.25665 on epoch:    40, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 140.7447357178s, input_fired_time: 1.2734355927, output_fired_time: 1.1228967905, propagate_forward_time: 54.9593963623, propagate_backward_time: 79.2227020264, weight_update_time: 0.1574612111, other_time: 4.1663055420
epoch time: 12.1969594955s, input_fired_time: 0.1629725844, output_fired_time: 0.0000000000, propagate_forward_time: 11.4466991425, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5872879028
validation[          , genome  6642] predictions:    9597/  10000 (95.97%), best:    9743/10000 (97.43%), error:      1278.36133, best error:       871.25665 on epoch:    40, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 143.3048095703s, input_fired_time: 1.2706537247, output_fired_time: 1.1268986464, propagate_forward_time: 56.2169075012, propagate_backward_time: 81.4347076416, weight_update_time: 0.1563292891, other_time: 3.2556457520
epoch time: 12.0284805298s, input_fired_time: 0.1636993140, output_fired_time: 0.0000000000, propagate_forward_time: 11.3007345200, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5640468597
validation[          , genome  6642] predictions:    9743/  10000 (97.43%), best:    9743/10000 (97.43%), error:       891.57172, best error:       871.25665 on epoch:    40, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 140.6348876953s, input_fired_time: 1.2699030638, output_fired_time: 1.1245636940, propagate_forward_time: 54.8691291809, propagate_backward_time: 80.1959457397, weight_update_time: 0.1573854387, other_time: 3.1753616333
epoch time: 10.4790296555s, input_fired_time: 0.1587624252, output_fired_time: 0.0000000000, propagate_forward_time: 9.7624216080, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5578460693
validation[          , genome  6642] predictions:    9741/  10000 (97.41%), best:    9741/10000 (97.41%), error:       871.11578, best error:       871.11578 on epoch:    43, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 142.3896789551s, input_fired_time: 1.2809950113, output_fired_time: 1.1549707651, propagate_forward_time: 55.6292533875, propagate_backward_time: 81.1355895996, weight_update_time: 0.1557564288, other_time: 3.1888732910
epoch time: 11.8151950836s, input_fired_time: 0.1611947417, output_fired_time: 0.0000000000, propagate_forward_time: 10.0849037170, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5690965652
validation[          , genome  6642] predictions:    9658/  10000 (96.58%), best:    9741/10000 (97.41%), error:      1042.07483, best error:       871.11578 on epoch:    43, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 140.6953277588s, input_fired_time: 2.2733452320, output_fired_time: 1.1179207563, propagate_forward_time: 54.9848670959, propagate_backward_time: 79.1957092285, weight_update_time: 0.1555923820, other_time: 3.1234893799
epoch time: 12.4377536774s, input_fired_time: 0.1685100347, output_fired_time: 0.0000000000, propagate_forward_time: 11.6327562332, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6364870071
validation[          , genome  6642] predictions:    9763/  10000 (97.63%), best:    9763/10000 (97.63%), error:       775.49048, best error:       775.49048 on epoch:    45, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 141.6347198486s, input_fired_time: 1.2930324078, output_fired_time: 1.1214226484, propagate_forward_time: 52.3889122009, propagate_backward_time: 83.7087554932, weight_update_time: 0.1560903192, other_time: 3.1225891113
epoch time: 17.0272312164s, input_fired_time: 0.3113092780, output_fired_time: 0.0000000000, propagate_forward_time: 15.8944616318, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8214597702
validation[          , genome  6642] predictions:    9711/  10000 (97.11%), best:    9763/10000 (97.63%), error:       923.72675, best error:       775.49048 on epoch:    45, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 141.6485290527s, input_fired_time: 1.2642385960, output_fired_time: 1.1255165339, propagate_forward_time: 54.4032592773, propagate_backward_time: 80.7227554321, weight_update_time: 0.1556079388, other_time: 4.1327590942
epoch time: 10.7708473206s, input_fired_time: 0.1606287956, output_fired_time: 0.0000000000, propagate_forward_time: 10.0599193573, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5502986908
validation[          , genome  6642] predictions:    9678/  10000 (96.78%), best:    9763/10000 (97.63%), error:      1100.49878, best error:       775.49048 on epoch:    45, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 143.9915161133s, input_fired_time: 1.3167810440, output_fired_time: 1.1701405048, propagate_forward_time: 55.9301300049, propagate_backward_time: 82.3480834961, weight_update_time: 0.1652402282, other_time: 3.2263793945
epoch time: 11.0274143219s, input_fired_time: 0.1621916592, output_fired_time: 0.0000000000, propagate_forward_time: 10.2974061966, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5678167343
validation[          , genome  6642] predictions:    9694/  10000 (96.94%), best:    9763/10000 (97.63%), error:       996.38629, best error:       775.49048 on epoch:    45, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 140.8052062988s, input_fired_time: 1.2631982565, output_fired_time: 1.1171519756, propagate_forward_time: 52.9018363953, propagate_backward_time: 82.3762283325, weight_update_time: 0.1558084637, other_time: 3.1467819214
epoch time: 11.6424856186s, input_fired_time: 0.1608120799, output_fired_time: 0.0000000000, propagate_forward_time: 10.9248476028, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5568256378
validation[          , genome  6642] predictions:    9744/  10000 (97.44%), best:    9763/10000 (97.63%), error:       855.18738, best error:       775.49048 on epoch:    45, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 139.0444641113s, input_fired_time: 1.2626528740, output_fired_time: 2.1152412891, propagate_forward_time: 52.3343200684, propagate_backward_time: 79.1937408447, weight_update_time: 0.1556260139, other_time: 4.1385192871
epoch time: 10.6665992737s, input_fired_time: 0.1604152471, output_fired_time: 0.0000000000, propagate_forward_time: 9.9549140930, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5512695313
validation[          , genome  6642] predictions:    9706/  10000 (97.06%), best:    9763/10000 (97.63%), error:       902.04755, best error:       775.49048 on epoch:    45, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 138.2382049561s, input_fired_time: 1.2616572380, output_fired_time: 1.1034929752, propagate_forward_time: 53.0007324219, propagate_backward_time: 79.7294158936, weight_update_time: 0.1550112367, other_time: 3.1428985596
epoch time: 12.0736799240s, input_fired_time: 0.1635922343, output_fired_time: 0.0000000000, propagate_forward_time: 11.3493118286, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5607757568
validation[          , genome  6642] predictions:    9728/  10000 (97.28%), best:    9763/10000 (97.63%), error:       879.79230, best error:       775.49048 on epoch:    45, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 139.6453094482s, input_fired_time: 1.2712965012, output_fired_time: 2.1154525280, propagate_forward_time: 51.8601570129, propagate_backward_time: 81.2394409180, weight_update_time: 0.1573028117, other_time: 3.1589660645
epoch time: 10.6954240799s, input_fired_time: 0.1598239094, output_fired_time: 0.0000000000, propagate_forward_time: 9.9840984344, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5515012741
validation[          , genome  6642] predictions:    9671/  10000 (96.71%), best:    9763/10000 (97.63%), error:      1001.75226, best error:       775.49048 on epoch:    45, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 139.1207885742s, input_fired_time: 1.2654191256, output_fired_time: 1.1056255102, propagate_forward_time: 52.4153480530, propagate_backward_time: 80.1544265747, weight_update_time: 0.1564133912, other_time: 4.1799697876
epoch time: 11.8481388092s, input_fired_time: 0.1615143120, output_fired_time: 0.0000000000, propagate_forward_time: 11.1286706924, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5579538345
validation[          , genome  6642] predictions:    9587/  10000 (95.87%), best:    9763/10000 (97.63%), error:      1351.67188, best error:       775.49048 on epoch:    45, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 139.2412872314s, input_fired_time: 1.2796844244, output_fired_time: 1.1061029434, propagate_forward_time: 53.3577537537, propagate_backward_time: 80.3360214233, weight_update_time: 0.1553182304, other_time: 3.1617202759
epoch time: 10.9732570648s, input_fired_time: 0.1598311961, output_fired_time: 0.0000000000, propagate_forward_time: 10.2620840073, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5513420105
validation[          , genome  6642] predictions:    9710/  10000 (97.10%), best:    9763/10000 (97.63%), error:       994.09436, best error:       775.49048 on epoch:    45, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 142.8072662354s, input_fired_time: 1.2866158485, output_fired_time: 1.1594728231, propagate_forward_time: 52.5911369324, propagate_backward_time: 84.5966873169, weight_update_time: 0.1576616019, other_time: 3.1733474731
epoch time: 10.6458463669s, input_fired_time: 0.1589252055, output_fired_time: 0.0000000000, propagate_forward_time: 9.9429016113, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5440196991
validation[          , genome  6642] predictions:    9608/  10000 (96.08%), best:    9763/10000 (97.63%), error:      1274.63342, best error:       775.49048 on epoch:    45, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 139.9593963623s, input_fired_time: 1.2747154236, output_fired_time: 1.1552383900, propagate_forward_time: 53.6196289063, propagate_backward_time: 80.7366638184, weight_update_time: 0.1552316993, other_time: 3.1731414795
epoch time: 11.9604730606s, input_fired_time: 0.1655665487, output_fired_time: 0.0000000000, propagate_forward_time: 11.2270555496, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5678510666
validation[          , genome  6642] predictions:    9747/  10000 (97.47%), best:    9763/10000 (97.63%), error:       847.81842, best error:       775.49048 on epoch:    45, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 140.5626220703s, input_fired_time: 1.2711983919, output_fired_time: 2.1218864918, propagate_forward_time: 52.8180618286, propagate_backward_time: 81.1614990234, weight_update_time: 0.1566341668, other_time: 3.1899795532
epoch time: 10.3190269470s, input_fired_time: 0.1562476158, output_fired_time: 0.0000000000, propagate_forward_time: 9.6293220520, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5334568024
validation[          , genome  6642] predictions:    9728/  10000 (97.28%), best:    9763/10000 (97.63%), error:       925.82446, best error:       775.49048 on epoch:    45, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 141.2676849365s, input_fired_time: 1.2780703306, output_fired_time: 2.1183073521, propagate_forward_time: 52.4057960510, propagate_backward_time: 82.2818679810, weight_update_time: 0.1553264558, other_time: 3.1836471558
epoch time: 11.8609571457s, input_fired_time: 0.1626989543, output_fired_time: 0.0000000000, propagate_forward_time: 11.1464567184, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5518016815
validation[          , genome  6642] predictions:    9691/  10000 (96.91%), best:    9763/10000 (97.63%), error:       914.21295, best error:       775.49048 on epoch:    45, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 139.8066711426s, input_fired_time: 1.2775222063, output_fired_time: 1.1108912230, propagate_forward_time: 55.7211685181, propagate_backward_time: 78.5550308228, weight_update_time: 0.1562417746, other_time: 3.1420593262
epoch time: 11.8870944977s, input_fired_time: 0.1650925726, output_fired_time: 0.0000000000, propagate_forward_time: 11.1445274353, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5774745941
validation[          , genome  6642] predictions:    9763/  10000 (97.63%), best:    9763/10000 (97.63%), error:       809.15009, best error:       775.49048 on epoch:    45, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 143.6070861816s, input_fired_time: 1.2999919653, output_fired_time: 1.1277741194, propagate_forward_time: 53.1448249817, propagate_backward_time: 84.7808609009, weight_update_time: 0.1644412726, other_time: 3.2536392212
epoch time: 16.6309852600s, input_fired_time: 0.2240959108, output_fired_time: 0.0000000000, propagate_forward_time: 15.6532201767, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7536687851
validation[          , genome  6642] predictions:    9691/  10000 (96.91%), best:    9763/10000 (97.63%), error:       939.00513, best error:       775.49048 on epoch:    45, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 140.2474365234s, input_fired_time: 1.2813569307, output_fired_time: 1.1254309416, propagate_forward_time: 54.6583786011, propagate_backward_time: 80.0132904053, weight_update_time: 0.1560835689, other_time: 3.1689834595
epoch time: 10.6357860565s, input_fired_time: 0.1620093882, output_fired_time: 0.0000000000, propagate_forward_time: 9.9199008942, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5538759232
validation[          , genome  6642] predictions:    9745/  10000 (97.45%), best:    9763/10000 (97.63%), error:       842.42279, best error:       775.49048 on epoch:    45, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 143.9497222900s, input_fired_time: 1.3473976851, output_fired_time: 1.1279660463, propagate_forward_time: 52.9216384888, propagate_backward_time: 84.3103256226, weight_update_time: 0.1568087339, other_time: 4.2424011230
epoch time: 11.9214801788s, input_fired_time: 0.1669393331, output_fired_time: 0.0000000000, propagate_forward_time: 10.1739883423, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5805521011
validation[          , genome  6642] predictions:    9767/  10000 (97.67%), best:    9763/10000 (97.63%), error:       797.79340, best error:       775.49048 on epoch:    45, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 140.3191070557s, input_fired_time: 1.2815670967, output_fired_time: 1.2032587528, propagate_forward_time: 53.8479194641, propagate_backward_time: 80.8104782104, weight_update_time: 0.1572407186, other_time: 3.1758804321
epoch time: 11.9829769135s, input_fired_time: 0.1662092060, output_fired_time: 0.0000000000, propagate_forward_time: 11.2507944107, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5659732819
validation[          , genome  6642] predictions:    9728/  10000 (97.28%), best:    9763/10000 (97.63%), error:       941.54285, best error:       775.49048 on epoch:    45, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 139.6013946533s, input_fired_time: 1.2784160376, output_fired_time: 1.1107827425, propagate_forward_time: 51.6372833252, propagate_backward_time: 82.4225006104, weight_update_time: 0.1559891254, other_time: 3.1524200439
epoch time: 10.8099231720s, input_fired_time: 0.1631299406, output_fired_time: 0.0000000000, propagate_forward_time: 10.0892362595, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5575571060
validation[          , genome  6642] predictions:    9768/  10000 (97.68%), best:    9763/10000 (97.63%), error:       793.95807, best error:       775.49048 on epoch:    45, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 140.3544616699s, input_fired_time: 1.2818174362, output_fired_time: 1.1301661730, propagate_forward_time: 53.7727241516, propagate_backward_time: 80.9969100952, weight_update_time: 0.1573189497, other_time: 3.1728439331
epoch time: 11.9509944916s, input_fired_time: 0.1638654321, output_fired_time: 0.0000000000, propagate_forward_time: 11.2336187363, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5535106659
validation[          , genome  6642] predictions:    9764/  10000 (97.64%), best:    9763/10000 (97.63%), error:       859.62787, best error:       775.49048 on epoch:    45, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 139.1903533936s, input_fired_time: 1.2745772600, output_fired_time: 1.1066646576, propagate_forward_time: 53.2939491272, propagate_backward_time: 79.3466949463, weight_update_time: 0.1556070000, other_time: 4.1684722900
epoch time: 10.6288356781s, input_fired_time: 0.1768105179, output_fired_time: 0.0000000000, propagate_forward_time: 9.8961906433, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5558347702
validation[          , genome  6642] predictions:    9758/  10000 (97.58%), best:    9763/10000 (97.63%), error:       809.03552, best error:       775.49048 on epoch:    45, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 138.1544342041s, input_fired_time: 1.2778984308, output_fired_time: 1.1014358997, propagate_forward_time: 53.1972465515, propagate_backward_time: 79.4226608276, weight_update_time: 0.1551662236, other_time: 3.1551895142
epoch time: 12.0453166962s, input_fired_time: 0.1779663116, output_fired_time: 0.0000000000, propagate_forward_time: 11.2738075256, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5935430527
validation[          , genome  6642] predictions:    9743/  10000 (97.43%), best:    9763/10000 (97.63%), error:       857.56274, best error:       775.49048 on epoch:    45, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 139.6310729980s, input_fired_time: 1.2780208588, output_fired_time: 1.1069096327, propagate_forward_time: 52.7160110474, propagate_backward_time: 81.2969894409, weight_update_time: 0.1566596031, other_time: 3.2331542969
epoch time: 10.7667741776s, input_fired_time: 0.1606395692, output_fired_time: 0.0000000000, propagate_forward_time: 10.0471763611, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5589580536
validation[          , genome  6642] predictions:    9754/  10000 (97.54%), best:    9763/10000 (97.63%), error:       796.59717, best error:       775.49048 on epoch:    45, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 145.0147552490s, input_fired_time: 1.3116210699, output_fired_time: 1.1448634863, propagate_forward_time: 56.2912559509, propagate_backward_time: 83.0701980591, weight_update_time: 0.1565311402, other_time: 3.1968154907
epoch time: 10.7180347443s, input_fired_time: 0.1615666300, output_fired_time: 0.0000000000, propagate_forward_time: 10.0087947845, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5476732254
validation[          , genome  6642] predictions:    9708/  10000 (97.08%), best:    9763/10000 (97.63%), error:       985.46149, best error:       775.49048 on epoch:    45, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 139.9726867676s, input_fired_time: 1.2756739855, output_fired_time: 1.1077768803, propagate_forward_time: 53.7045516968, propagate_backward_time: 80.7171707153, weight_update_time: 0.1573356688, other_time: 3.1675109863
epoch time: 11.8606128693s, input_fired_time: 0.1639211476, output_fired_time: 0.0000000000, propagate_forward_time: 11.1394510269, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5572404861
validation[          , genome  6642] predictions:    9721/  10000 (97.21%), best:    9763/10000 (97.63%), error:       891.38861, best error:       775.49048 on epoch:    45, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 151.1662750244s, input_fired_time: 1.3674068451, output_fired_time: 1.1831885576, propagate_forward_time: 57.1365776062, propagate_backward_time: 87.9805908203, weight_update_time: 0.1737439334, other_time: 3.4985198975
epoch time: 11.6961412430s, input_fired_time: 0.1665699035, output_fired_time: 0.0000000000, propagate_forward_time: 10.9668102264, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5627613068
validation[          , genome  6642] predictions:    9730/  10000 (97.30%), best:    9763/10000 (97.63%), error:       859.86053, best error:       775.49048 on epoch:    45, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 139.9349060059s, input_fired_time: 1.2821803093, output_fired_time: 1.1111096144, propagate_forward_time: 54.7627792358, propagate_backward_time: 79.6259460449, weight_update_time: 0.1552404910, other_time: 3.1528854370
epoch time: 11.3613653183s, input_fired_time: 0.1686224043, output_fired_time: 0.0000000000, propagate_forward_time: 10.6250820160, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5676612854
validation[          , genome  6642] predictions:    9699/  10000 (96.99%), best:    9763/10000 (97.63%), error:       937.52594, best error:       775.49048 on epoch:    45, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 138.5318603516s, input_fired_time: 1.2737144232, output_fired_time: 1.0991173983, propagate_forward_time: 54.1840095520, propagate_backward_time: 78.8250656128, weight_update_time: 0.1557541341, other_time: 3.1499557495
epoch time: 10.5321083069s, input_fired_time: 0.1612176299, output_fired_time: 0.0000000000, propagate_forward_time: 9.8197708130, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5511198044
validation[          , genome  6642] predictions:    9760/  10000 (97.60%), best:    9763/10000 (97.63%), error:       803.45209, best error:       775.49048 on epoch:    45, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 139.5618591309s, input_fired_time: 1.2774959803, output_fired_time: 2.1287286282, propagate_forward_time: 50.4836196899, propagate_backward_time: 80.5265579224, weight_update_time: 0.1551017761, other_time: 5.1454620361
epoch time: 11.7624015808s, input_fired_time: 0.1635522395, output_fired_time: 0.0000000000, propagate_forward_time: 11.0467262268, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5521230698
validation[          , genome  6642] predictions:    9763/  10000 (97.63%), best:    9763/10000 (97.63%), error:       808.85889, best error:       775.49048 on epoch:    45, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 145.2795715332s, input_fired_time: 1.3272794485, output_fired_time: 1.1743339300, propagate_forward_time: 57.6963272095, propagate_backward_time: 80.7393417358, weight_update_time: 0.1608790159, other_time: 4.3422851563
epoch time: 13.0587148666s, input_fired_time: 0.2015601248, output_fired_time: 0.0000000000, propagate_forward_time: 12.2531633377, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6039915085
validation[          , genome  6642] predictions:    9710/  10000 (97.10%), best:    9763/10000 (97.63%), error:       951.16650, best error:       775.49048 on epoch:    45, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 140.5860443115s, input_fired_time: 1.2801432610, output_fired_time: 1.1137106419, propagate_forward_time: 56.9452705383, propagate_backward_time: 77.0454025269, weight_update_time: 0.1558605880, other_time: 4.2015304565
epoch time: 10.6399621964s, input_fired_time: 0.1635126323, output_fired_time: 0.0000000000, propagate_forward_time: 9.9323205948, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5441293716
validation[          , genome  6642] predictions:    9729/  10000 (97.29%), best:    9763/10000 (97.63%), error:       858.80481, best error:       775.49048 on epoch:    45, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 143.9571075439s, input_fired_time: 1.2988547087, output_fired_time: 1.1343950033, propagate_forward_time: 56.3096466064, propagate_backward_time: 82.0159759521, weight_update_time: 0.1662029177, other_time: 3.1982269287
epoch time: 11.5796451569s, input_fired_time: 0.1621085703, output_fired_time: 0.0000000000, propagate_forward_time: 10.8725528717, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5449838638
validation[          , genome  6642] predictions:    9756/  10000 (97.56%), best:    9756/10000 (97.56%), error:       757.14496, best error:       757.14496 on epoch:    77, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 139.6041412354s, input_fired_time: 1.3286503553, output_fired_time: 1.1043342352, propagate_forward_time: 52.5954589844, propagate_backward_time: 81.4125061035, weight_update_time: 0.1559247077, other_time: 3.1631927490
epoch time: 11.8461427689s, input_fired_time: 0.1652787477, output_fired_time: 0.0000000000, propagate_forward_time: 11.1149482727, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5659160614
validation[          , genome  6642] predictions:    9673/  10000 (96.73%), best:    9756/10000 (97.56%), error:      1049.61877, best error:       757.14496 on epoch:    77, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 139.2893981934s, input_fired_time: 1.2769535780, output_fired_time: 1.1018911600, propagate_forward_time: 52.3009109497, propagate_backward_time: 80.4500961304, weight_update_time: 0.1555117369, other_time: 4.1595458984
epoch time: 10.6351318359s, input_fired_time: 0.1615255475, output_fired_time: 0.0000000000, propagate_forward_time: 9.9297761917, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5438299179
validation[          , genome  6642] predictions:    9775/  10000 (97.75%), best:    9756/10000 (97.56%), error:       780.24164, best error:       757.14496 on epoch:    77, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 149.8320007324s, input_fired_time: 1.3623194695, output_fired_time: 1.1763880253, propagate_forward_time: 57.9423599243, propagate_backward_time: 85.9911727905, weight_update_time: 0.1737486720, other_time: 3.3597564697
epoch time: 10.9209289551s, input_fired_time: 0.1638126671, output_fired_time: 0.0000000000, propagate_forward_time: 10.2091197968, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5479965210
validation[          , genome  6642] predictions:    9721/  10000 (97.21%), best:    9756/10000 (97.56%), error:       895.28229, best error:       757.14496 on epoch:    77, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 151.0109863281s, input_fired_time: 1.4168944359, output_fired_time: 1.1753127575, propagate_forward_time: 59.3301696777, propagate_backward_time: 85.6999816895, weight_update_time: 0.1729988456, other_time: 3.3886260986
epoch time: 10.6809835434s, input_fired_time: 0.1611829698, output_fired_time: 0.0000000000, propagate_forward_time: 9.9788389206, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5409612656
validation[          , genome  6642] predictions:    9744/  10000 (97.44%), best:    9756/10000 (97.56%), error:       859.09686, best error:       757.14496 on epoch:    77, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 140.3264465332s, input_fired_time: 1.2746337652, output_fired_time: 1.1094119549, propagate_forward_time: 53.8489723206, propagate_backward_time: 80.9446334839, weight_update_time: 0.1558445841, other_time: 3.1488113403
epoch time: 11.9190254211s, input_fired_time: 0.1676860601, output_fired_time: 0.0000000000, propagate_forward_time: 11.1939554214, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5573835373
validation[          , genome  6642] predictions:    9733/  10000 (97.33%), best:    9756/10000 (97.56%), error:       900.15778, best error:       757.14496 on epoch:    77, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 138.7231140137s, input_fired_time: 1.2842516899, output_fired_time: 1.1072739363, propagate_forward_time: 55.4153327942, propagate_backward_time: 77.7699050903, weight_update_time: 0.1555879861, other_time: 3.1463546753
epoch time: 10.7035484314s, input_fired_time: 0.1636367440, output_fired_time: 0.0000000000, propagate_forward_time: 9.9922142029, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5476970673
validation[          , genome  6642] predictions:    9666/  10000 (96.66%), best:    9756/10000 (97.56%), error:      1156.38489, best error:       757.14496 on epoch:    77, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 139.1620330811s, input_fired_time: 1.2980078459, output_fired_time: 1.1117900610, propagate_forward_time: 52.4879837036, propagate_backward_time: 81.1257781982, weight_update_time: 0.1560371220, other_time: 3.1384811401
epoch time: 11.7192239761s, input_fired_time: 0.1654351056, output_fired_time: 0.0000000000, propagate_forward_time: 10.9974145889, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5563745499
validation[          , genome  6642] predictions:    9761/  10000 (97.61%), best:    9756/10000 (97.56%), error:       833.60681, best error:       757.14496 on epoch:    77, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 140.3249816895s, input_fired_time: 1.2818810940, output_fired_time: 1.1165218353, propagate_forward_time: 53.8318252563, propagate_backward_time: 80.9639892578, weight_update_time: 0.1556591988, other_time: 3.1307754517
epoch time: 12.0561103821s, input_fired_time: 0.1675673574, output_fired_time: 0.0000000000, propagate_forward_time: 11.3253850937, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5631580353
validation[          , genome  6642] predictions:    9666/  10000 (96.66%), best:    9756/10000 (97.56%), error:      1014.10846, best error:       757.14496 on epoch:    77, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 152.0761413574s, input_fired_time: 1.4423075914, output_fired_time: 1.1732572317, propagate_forward_time: 60.5325279236, propagate_backward_time: 85.3611526489, weight_update_time: 0.1883444041, other_time: 3.5668869019
epoch time: 14.6944122314s, input_fired_time: 0.1791347712, output_fired_time: 0.0000000000, propagate_forward_time: 13.8401060104, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6751718521
validation[          , genome  6642] predictions:    9765/  10000 (97.65%), best:    9756/10000 (97.56%), error:       792.35089, best error:       757.14496 on epoch:    77, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 142.0478820801s, input_fired_time: 1.3063915968, output_fired_time: 1.1390392780, propagate_forward_time: 55.3855514526, propagate_backward_time: 80.0536727905, weight_update_time: 0.1559881717, other_time: 4.1632232666
epoch time: 15.9424104691s, input_fired_time: 0.2170943171, output_fired_time: 0.0000000000, propagate_forward_time: 14.8468618393, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8784542084
validation[          , genome  6642] predictions:    9739/  10000 (97.39%), best:    9756/10000 (97.56%), error:       861.22156, best error:       757.14496 on epoch:    77, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 144.2635192871s, input_fired_time: 1.2975795269, output_fired_time: 1.1342356205, propagate_forward_time: 57.4065628052, propagate_backward_time: 81.1820755005, weight_update_time: 0.1555415541, other_time: 3.2430725098
epoch time: 13.9801120758s, input_fired_time: 0.1809097677, output_fired_time: 0.0000000000, propagate_forward_time: 12.1014814377, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6977205276
validation[          , genome  6642] predictions:    9734/  10000 (97.34%), best:    9756/10000 (97.56%), error:       911.21503, best error:       757.14496 on epoch:    77, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 146.4602203369s, input_fired_time: 2.3758025169, output_fired_time: 1.1758203506, propagate_forward_time: 53.9386367798, propagate_backward_time: 85.7163085938, weight_update_time: 0.1571840942, other_time: 3.2536392212
epoch time: 11.9605398178s, input_fired_time: 0.1674881428, output_fired_time: 0.0000000000, propagate_forward_time: 10.2155561447, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5774955750
validation[          , genome  6642] predictions:    9743/  10000 (97.43%), best:    9756/10000 (97.56%), error:       854.78540, best error:       757.14496 on epoch:    77, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 140.9989318848s, input_fired_time: 1.2947365046, output_fired_time: 1.1127817631, propagate_forward_time: 53.1762123108, propagate_backward_time: 82.2750167847, weight_update_time: 0.1557697207, other_time: 3.1401901245
epoch time: 10.5854616165s, input_fired_time: 0.1625049263, output_fired_time: 0.0000000000, propagate_forward_time: 9.8832597733, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5396966934
validation[          , genome  6642] predictions:    9759/  10000 (97.59%), best:    9756/10000 (97.56%), error:       806.83600, best error:       757.14496 on epoch:    77, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 140.3040008545s, input_fired_time: 1.3017404079, output_fired_time: 1.1211014986, propagate_forward_time: 53.6982078552, propagate_backward_time: 81.0234603882, weight_update_time: 0.1563778073, other_time: 3.1594772339
epoch time: 12.2074890137s, input_fired_time: 0.1701222807, output_fired_time: 0.0000000000, propagate_forward_time: 11.4798803329, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5574865341
validation[          , genome  6642] predictions:    9746/  10000 (97.46%), best:    9756/10000 (97.56%), error:       890.31946, best error:       757.14496 on epoch:    77, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 142.2780303955s, input_fired_time: 1.3212515116, output_fired_time: 1.1370981932, propagate_forward_time: 55.3684234619, propagate_backward_time: 80.1701507568, weight_update_time: 0.1591438949, other_time: 4.2810974121
epoch time: 11.9007911682s, input_fired_time: 0.1678746939, output_fired_time: 0.0000000000, propagate_forward_time: 11.1691761017, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5637407303
validation[          , genome  6642] predictions:    9658/  10000 (96.58%), best:    9756/10000 (97.56%), error:      1107.92065, best error:       757.14496 on epoch:    77, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 140.0324249268s, input_fired_time: 1.2931574583, output_fired_time: 1.1153401136, propagate_forward_time: 52.6261711121, propagate_backward_time: 81.7519836426, weight_update_time: 0.1572119296, other_time: 3.2457733154
epoch time: 11.1182441711s, input_fired_time: 0.1713224947, output_fired_time: 0.0000000000, propagate_forward_time: 10.3470239639, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5998973846
validation[          , genome  6642] predictions:    9699/  10000 (96.99%), best:    9756/10000 (97.56%), error:       987.86652, best error:       757.14496 on epoch:    77, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 140.1994323730s, input_fired_time: 1.2954045534, output_fired_time: 2.1309840679, propagate_forward_time: 52.8273963928, propagate_backward_time: 80.7242126465, weight_update_time: 0.1579743326, other_time: 3.2214355469
epoch time: 12.0614118576s, input_fired_time: 0.1703270227, output_fired_time: 0.0000000000, propagate_forward_time: 11.3076200485, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5834646225
validation[          , genome  6642] predictions:    9759/  10000 (97.59%), best:    9756/10000 (97.56%), error:       773.63226, best error:       757.14496 on epoch:    77, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 139.7398223877s, input_fired_time: 2.3072595596, output_fired_time: 1.1136398315, propagate_forward_time: 52.5731048584, propagate_backward_time: 80.5427246094, weight_update_time: 0.1570345461, other_time: 3.2030792236
epoch time: 12.1525354385s, input_fired_time: 0.1730188280, output_fired_time: 0.0000000000, propagate_forward_time: 11.3984241486, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5810928345
validation[          , genome  6642] predictions:    9739/  10000 (97.39%), best:    9756/10000 (97.56%), error:       829.23828, best error:       757.14496 on epoch:    77, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 145.0251770020s, input_fired_time: 1.3450028896, output_fired_time: 1.1466262341, propagate_forward_time: 53.5359916687, propagate_backward_time: 85.6683197021, weight_update_time: 0.1659521610, other_time: 3.3292388916
epoch time: 10.6851959229s, input_fired_time: 0.1650862545, output_fired_time: 0.0000000000, propagate_forward_time: 9.9440946579, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5760154724
validation[          , genome  6642] predictions:    9765/  10000 (97.65%), best:    9756/10000 (97.56%), error:       797.18640, best error:       757.14496 on epoch:    77, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 143.2122497559s, input_fired_time: 1.3401018381, output_fired_time: 1.1530672312, propagate_forward_time: 56.3693618774, propagate_backward_time: 81.0000839233, weight_update_time: 0.1582832783, other_time: 3.3496398926
epoch time: 10.7161512375s, input_fired_time: 0.1638273448, output_fired_time: 0.0000000000, propagate_forward_time: 9.9947633743, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5575609207
validation[          , genome  6642] predictions:    9754/  10000 (97.54%), best:    9756/10000 (97.56%), error:       824.37830, best error:       757.14496 on epoch:    77, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 139.0786285400s, input_fired_time: 1.2909586430, output_fired_time: 1.1161934137, propagate_forward_time: 52.2451324463, propagate_backward_time: 81.1152038574, weight_update_time: 0.1566588134, other_time: 3.3111419678
epoch time: 12.0419282913s, input_fired_time: 0.1690622568, output_fired_time: 0.0000000000, propagate_forward_time: 11.3110799789, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5617856979
validation[          , genome  6642] predictions:    9723/  10000 (97.23%), best:    9756/10000 (97.56%), error:       913.28564, best error:       757.14496 on epoch:    77, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 138.7009277344s, input_fired_time: 1.2900252342, output_fired_time: 2.1171402931, propagate_forward_time: 53.0092086792, propagate_backward_time: 79.0671997070, weight_update_time: 0.1561821997, other_time: 3.2173538208
epoch time: 10.5906391144s, input_fired_time: 0.1657532603, output_fired_time: 0.0000000000, propagate_forward_time: 9.8567619324, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5681238174
validation[          , genome  6642] predictions:    9704/  10000 (97.04%), best:    9756/10000 (97.56%), error:       922.20691, best error:       757.14496 on epoch:    77, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 139.9839782715s, input_fired_time: 2.3081817627, output_fired_time: 1.1144779921, propagate_forward_time: 53.6181526184, propagate_backward_time: 79.6874847412, weight_update_time: 0.1579191685, other_time: 3.2556915283
epoch time: 11.8722896576s, input_fired_time: 0.1684332341, output_fired_time: 0.0000000000, propagate_forward_time: 11.1310663223, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5727901459
validation[          , genome  6642] predictions:    9733/  10000 (97.33%), best:    9756/10000 (97.56%), error:       893.43146, best error:       757.14496 on epoch:    77, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 57.0270729065s, input_fired_time: 0.8344210982, output_fired_time: 0.0000000000, propagate_forward_time: 53.2144660950, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9781875610
best training[          , genome  6642] predictions:   49587/  50000 (99.17%), best:    9756/10000 (97.56%), error:      1742.37427, best error:       757.14496 on epoch:    77, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 10.7220773697s, input_fired_time: 0.1751113683, output_fired_time: 0.0000000000, propagate_forward_time: 9.9620351791, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5849304199
   testing[          , genome  6642] predictions:    9777/  10000 (97.77%), best:    9756/10000 (97.56%), error:       725.86182, best error:       757.14496 on epoch:    77, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
05:04:34 (6236): called boinc_finish(0)

</stderr_txt>
]]>