Nameexact_genome_1512568488_42_6683_0
Workunit2604640
Created7 Dec 2017, 21:13:23 UTC
Sent7 Dec 2017, 21:18:17 UTC
Report deadline13 Dec 2017, 23:34:47 UTC
Received12 Dec 2017, 18:59:50 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID63521
Run time3 hours 2 min 41 sec
CPU time2 hours 44 min 26 sec
Validate stateValid
Credit1,523.70
Device peak FLOPS3.42 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34

Stderr output

<core_client_version>7.0.80</core_client_version>
<![CDATA[
<stderr_txt>
100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 223.1545257568s, input_fired_time: 1.1608027220, output_fired_time: 1.2534697056, propagate_forward_time: 71.6262969971, propagate_backward_time: 135.6375732422, weight_update_time: 2.1417918205, other_time: 13.4763946533
epoch time: 17.0987968445s, input_fired_time: 0.1405083537, output_fired_time: 0.0000000000, propagate_forward_time: 15.5138349533, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4444532394
validation[          , genome  6683] predictions:    9578/  10000 (95.78%), best:    9620/10000 (96.20%), error:      1370.51404, best error:      1187.24146 on epoch:    13, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 225.4447326660s, input_fired_time: 4.1664700508, output_fired_time: 1.2768555880, propagate_forward_time: 81.9084091187, propagate_backward_time: 133.5680541992, weight_update_time: 0.1428944767, other_time: 4.5249328613
epoch time: 19.4905052185s, input_fired_time: 0.1444893330, output_fired_time: 0.0000000000, propagate_forward_time: 15.8677978516, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4782180786
validation[          , genome  6683] predictions:    9648/  10000 (96.48%), best:    9648/10000 (96.48%), error:      1125.58203, best error:      1125.58203 on epoch:    16, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 227.1042480469s, input_fired_time: 1.1658529043, output_fired_time: 4.3151564598, propagate_forward_time: 72.4286575317, propagate_backward_time: 142.6344909668, weight_update_time: 1.1469550133, other_time: 6.5600891113
epoch time: 18.1449565887s, input_fired_time: 0.1371872872, output_fired_time: 0.0000000000, propagate_forward_time: 15.5645771027, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4431915283
validation[          , genome  6683] predictions:    9696/  10000 (96.96%), best:    9696/10000 (96.96%), error:      1043.32935, best error:      1043.32935 on epoch:    17, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 227.6438140869s, input_fired_time: 2.1645605564, output_fired_time: 2.2884366512, propagate_forward_time: 85.0964355469, propagate_backward_time: 132.5049896240, weight_update_time: 0.1451735646, other_time: 5.5893859863
epoch time: 17.0445804596s, input_fired_time: 1.1411825418, output_fired_time: 0.0000000000, propagate_forward_time: 15.4567174911, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4466800690
validation[          , genome  6683] predictions:    9628/  10000 (96.28%), best:    9696/10000 (96.96%), error:      1240.37439, best error:      1043.32935 on epoch:    17, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 225.6528015137s, input_fired_time: 2.1861238480, output_fired_time: 2.2891302109, propagate_forward_time: 99.3328857422, propagate_backward_time: 114.3291549683, weight_update_time: 0.1409960538, other_time: 7.5155105591
epoch time: 17.9709148407s, input_fired_time: 1.1314516068, output_fired_time: 0.0000000000, propagate_forward_time: 16.3972892761, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4421730042
validation[          , genome  6683] predictions:    9510/  10000 (95.10%), best:    9696/10000 (96.96%), error:      1595.27014, best error:      1043.32935 on epoch:    17, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 228.2289886475s, input_fired_time: 1.1681498289, output_fired_time: 4.2885913849, propagate_forward_time: 92.3568420410, propagate_backward_time: 125.8276748657, weight_update_time: 0.1458478272, other_time: 4.5877304077
epoch time: 17.3319149017s, input_fired_time: 0.1399260312, output_fired_time: 0.0000000000, propagate_forward_time: 14.7440204620, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4479675293
validation[          , genome  6683] predictions:    9654/  10000 (96.54%), best:    9696/10000 (96.96%), error:      1246.28442, best error:      1043.32935 on epoch:    17, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 229.2931213379s, input_fired_time: 1.1859863997, output_fired_time: 6.3108124733, propagate_forward_time: 106.7038726807, propagate_backward_time: 110.5296936035, weight_update_time: 0.1433219463, other_time: 4.5627593994
epoch time: 17.2517242432s, input_fired_time: 0.1362310946, output_fired_time: 0.0000000000, propagate_forward_time: 16.6550197601, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4604740143
validation[          , genome  6683] predictions:    9683/  10000 (96.83%), best:    9696/10000 (96.96%), error:      1095.36218, best error:      1043.32935 on epoch:    17, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 226.9434661865s, input_fired_time: 1.1652717590, output_fired_time: 1.2702512741, propagate_forward_time: 81.1858978271, propagate_backward_time: 140.7615356445, weight_update_time: 0.1452779174, other_time: 2.5605163574
epoch time: 19.1142845154s, input_fired_time: 0.1498070359, output_fired_time: 0.0000000000, propagate_forward_time: 16.5074024200, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4570751190
validation[          , genome  6683] predictions:    9668/  10000 (96.68%), best:    9696/10000 (96.96%), error:      1075.16968, best error:      1043.32935 on epoch:    17, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 224.8812255859s, input_fired_time: 4.1573452950, output_fired_time: 2.2605528831, propagate_forward_time: 75.1067657471, propagate_backward_time: 139.8380889893, weight_update_time: 0.1415906698, other_time: 3.5184631348
epoch time: 17.3680877686s, input_fired_time: 0.1380962878, output_fired_time: 0.0000000000, propagate_forward_time: 16.7679424286, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4620494843
validation[          , genome  6683] predictions:    9645/  10000 (96.45%), best:    9696/10000 (96.96%), error:      1130.37048, best error:      1043.32935 on epoch:    17, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 225.3730621338s, input_fired_time: 6.1616086960, output_fired_time: 4.2731208801, propagate_forward_time: 78.8743438721, propagate_backward_time: 128.5238952637, weight_update_time: 0.1444347948, other_time: 7.5401000977
epoch time: 17.9082641602s, input_fired_time: 0.1363198161, output_fired_time: 0.0000000000, propagate_forward_time: 17.3365325928, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4354114532
validation[          , genome  6683] predictions:    9646/  10000 (96.46%), best:    9696/10000 (96.96%), error:      1173.30835, best error:      1043.32935 on epoch:    17, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 229.9174346924s, input_fired_time: 3.1791844368, output_fired_time: 4.2999873161, propagate_forward_time: 82.7198867798, propagate_backward_time: 129.1625366211, weight_update_time: 0.1413005590, other_time: 10.5558471680
epoch time: 19.4750308990s, input_fired_time: 0.1419855356, output_fired_time: 0.0000000000, propagate_forward_time: 17.8760585785, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4569873810
validation[          , genome  6683] predictions:    9651/  10000 (96.51%), best:    9696/10000 (96.96%), error:      1156.29041, best error:      1043.32935 on epoch:    17, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 225.6129150391s, input_fired_time: 6.1881818771, output_fired_time: 3.2923061848, propagate_forward_time: 74.2266769409, propagate_backward_time: 137.3498382568, weight_update_time: 0.1418779194, other_time: 4.5558929443
epoch time: 19.5319404602s, input_fired_time: 0.1427744478, output_fired_time: 0.0000000000, propagate_forward_time: 18.9156723022, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4734935760
validation[          , genome  6683] predictions:    9628/  10000 (96.28%), best:    9696/10000 (96.96%), error:      1213.83862, best error:      1043.32935 on epoch:    17, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 228.0797271729s, input_fired_time: 1.1786061525, output_fired_time: 2.2756478786, propagate_forward_time: 81.3062744141, propagate_backward_time: 139.7848968506, weight_update_time: 0.1410939544, other_time: 3.5343017578
epoch time: 17.1222515106s, input_fired_time: 0.1384941339, output_fired_time: 0.0000000000, propagate_forward_time: 16.5406742096, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4430828094
validation[          , genome  6683] predictions:    9607/  10000 (96.07%), best:    9696/10000 (96.96%), error:      1241.98779, best error:      1043.32935 on epoch:    17, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 217.0508575439s, input_fired_time: 6.1521577835, output_fired_time: 3.2623798847, propagate_forward_time: 89.1600799561, propagate_backward_time: 113.0058822632, weight_update_time: 0.1373155713, other_time: 5.4703598022
epoch time: 17.1511726379s, input_fired_time: 0.1389129311, output_fired_time: 0.0000000000, propagate_forward_time: 16.5602970123, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4519634247
validation[          , genome  6683] predictions:    9680/  10000 (96.80%), best:    9680/10000 (96.80%), error:       994.07813, best error:       994.07813 on epoch:    28, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 262.4912719727s, input_fired_time: 1.3056237698, output_fired_time: 5.4432964325, propagate_forward_time: 99.0280075073, propagate_backward_time: 148.8360900879, weight_update_time: 0.1567235887, other_time: 7.8782348633
epoch time: 20.0897102356s, input_fired_time: 0.1579189152, output_fired_time: 0.0000000000, propagate_forward_time: 17.3975963593, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5341949463
validation[          , genome  6683] predictions:    9711/  10000 (97.11%), best:    9711/10000 (97.11%), error:       988.15540, best error:       988.15540 on epoch:    29, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 254.7700042725s, input_fired_time: 5.3307271004, output_fired_time: 9.5127334595, propagate_forward_time: 94.1328887939, propagate_backward_time: 140.9627685547, weight_update_time: 0.1583541036, other_time: 4.8308868408
epoch time: 20.2057895660s, input_fired_time: 0.1516617686, output_fired_time: 0.0000000000, propagate_forward_time: 19.5212669373, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5328617096
validation[          , genome  6683] predictions:    9722/  10000 (97.22%), best:    9722/10000 (97.22%), error:       984.04346, best error:       984.04346 on epoch:    30, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 252.9518432617s, input_fired_time: 1.3126448393, output_fired_time: 2.4921076298, propagate_forward_time: 97.8875961304, propagate_backward_time: 140.3654785156, weight_update_time: 0.1555666775, other_time: 10.8940124512
epoch time: 20.0797557831s, input_fired_time: 0.1538047493, output_fired_time: 0.0000000000, propagate_forward_time: 17.4003238678, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5256271362
validation[          , genome  6683] predictions:    9727/  10000 (97.27%), best:    9727/10000 (97.27%), error:       920.73920, best error:       920.73920 on epoch:    31, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 279.4764404297s, input_fired_time: 4.4481339455, output_fired_time: 3.4737102985, propagate_forward_time: 124.1431961060, propagate_backward_time: 139.2500000000, weight_update_time: 1.1823266745, other_time: 8.1614074707
epoch time: 20.3081359863s, input_fired_time: 0.1703589559, output_fired_time: 0.0000000000, propagate_forward_time: 17.6053867340, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5323905945
validation[          , genome  6683] predictions:    9703/  10000 (97.03%), best:    9727/10000 (97.27%), error:       947.97681, best error:       920.73920 on epoch:    31, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 283.5975341797s, input_fired_time: 3.4613440037, output_fired_time: 1.6024962664, propagate_forward_time: 108.7143249512, propagate_backward_time: 164.6056671143, weight_update_time: 0.1654412746, other_time: 5.2136993408
epoch time: 23.7478351593s, input_fired_time: 0.1709806621, output_fired_time: 0.0000000000, propagate_forward_time: 22.9841213226, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5927333832
validation[          , genome  6683] predictions:    9729/  10000 (97.29%), best:    9729/10000 (97.29%), error:       891.11615, best error:       891.11615 on epoch:    33, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 296.8045959473s, input_fired_time: 4.4105668068, output_fired_time: 1.7102175951, propagate_forward_time: 109.7043838501, propagate_backward_time: 170.6906738281, weight_update_time: 3.1883065701, other_time: 10.2887878418
epoch time: 17.9001598358s, input_fired_time: 0.1342449635, output_fired_time: 0.0000000000, propagate_forward_time: 15.4359655380, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3299493790
validation[          , genome  6683] predictions:    9675/  10000 (96.75%), best:    9729/10000 (97.29%), error:      1055.94885, best error:       891.11615 on epoch:    33, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 235.2984619141s, input_fired_time: 1.2497785091, output_fired_time: 6.3721289635, propagate_forward_time: 83.3513717651, propagate_backward_time: 138.7774047852, weight_update_time: 0.1549939513, other_time: 5.5477905273
epoch time: 19.4062328339s, input_fired_time: 0.1431756914, output_fired_time: 0.0000000000, propagate_forward_time: 18.7994976044, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4635601044
validation[          , genome  6683] predictions:    9691/  10000 (96.91%), best:    9729/10000 (97.29%), error:      1014.71661, best error:       891.11615 on epoch:    33, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 235.2075500488s, input_fired_time: 2.2095465660, output_fired_time: 5.3171372414, propagate_forward_time: 87.6399688721, propagate_backward_time: 127.4472351074, weight_update_time: 0.1438728124, other_time: 12.5936584473
epoch time: 19.7199153900s, input_fired_time: 0.1562663019, output_fired_time: 0.0000000000, propagate_forward_time: 17.0763378143, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4873104095
validation[          , genome  6683] predictions:    9715/  10000 (97.15%), best:    9729/10000 (97.29%), error:       907.82239, best error:       891.11615 on epoch:    33, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 240.8670349121s, input_fired_time: 5.2403211594, output_fired_time: 4.4009699821, propagate_forward_time: 94.4983901978, propagate_backward_time: 133.0561370850, weight_update_time: 0.1482610703, other_time: 3.6712188721
epoch time: 19.9382781982s, input_fired_time: 0.1461410969, output_fired_time: 0.0000000000, propagate_forward_time: 17.3114795685, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4806575775
validation[          , genome  6683] predictions:    9688/  10000 (96.88%), best:    9729/10000 (97.29%), error:      1026.78430, best error:       891.11615 on epoch:    33, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 232.9917449951s, input_fired_time: 1.3462399244, output_fired_time: 1.3544182777, propagate_forward_time: 93.0339584351, propagate_backward_time: 133.6085662842, weight_update_time: 0.1488318592, other_time: 3.6485748291
epoch time: 22.3168029785s, input_fired_time: 0.1511493623, output_fired_time: 0.0000000000, propagate_forward_time: 19.6619243622, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5037288666
validation[          , genome  6683] predictions:    9615/  10000 (96.15%), best:    9729/10000 (97.29%), error:      1248.59021, best error:       891.11615 on epoch:    33, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 240.0639801025s, input_fired_time: 7.2351055145, output_fired_time: 4.3411540985, propagate_forward_time: 77.2073364258, propagate_backward_time: 145.5444946289, weight_update_time: 0.1515780389, other_time: 5.7358856201
epoch time: 18.1172981262s, input_fired_time: 0.1392304450, output_fired_time: 0.0000000000, propagate_forward_time: 15.5490779877, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4289894104
validation[          , genome  6683] predictions:    9724/  10000 (97.24%), best:    9729/10000 (97.29%), error:       910.35419, best error:       891.11615 on epoch:    33, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 238.1893310547s, input_fired_time: 7.2352151871, output_fired_time: 1.3444473743, propagate_forward_time: 78.7711105347, propagate_backward_time: 145.2104492188, weight_update_time: 0.1656417698, other_time: 5.6281127930
epoch time: 19.4031352997s, input_fired_time: 0.1422740668, output_fired_time: 0.0000000000, propagate_forward_time: 18.8204574585, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4404029846
validation[          , genome  6683] predictions:    9636/  10000 (96.36%), best:    9729/10000 (97.29%), error:      1216.20093, best error:       891.11615 on epoch:    33, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 235.6680297852s, input_fired_time: 5.2151522636, output_fired_time: 3.3634898663, propagate_forward_time: 83.4289550781, propagate_backward_time: 133.0150146484, weight_update_time: 0.1454983503, other_time: 10.6454162598
epoch time: 19.7853908539s, input_fired_time: 0.1429934204, output_fired_time: 0.0000000000, propagate_forward_time: 17.1748943329, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4675025940
validation[          , genome  6683] predictions:    9701/  10000 (97.01%), best:    9729/10000 (97.29%), error:       964.53003, best error:       891.11615 on epoch:    33, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 237.0705718994s, input_fired_time: 3.2295212746, output_fired_time: 2.3634574413, propagate_forward_time: 91.8258132935, propagate_backward_time: 133.9814147949, weight_update_time: 0.1509750932, other_time: 5.6703491211
epoch time: 19.8354682922s, input_fired_time: 0.1535691321, output_fired_time: 0.0000000000, propagate_forward_time: 17.1705627441, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5113372803
validation[          , genome  6683] predictions:    9699/  10000 (96.99%), best:    9729/10000 (97.29%), error:       922.01477, best error:       891.11615 on epoch:    33, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 237.1840667725s, input_fired_time: 3.2330911160, output_fired_time: 2.3343324661, propagate_forward_time: 93.9096679688, propagate_backward_time: 134.0695648193, weight_update_time: 0.1468341947, other_time: 3.6374053955
epoch time: 17.4694156647s, input_fired_time: 0.1459348202, output_fired_time: 0.0000000000, propagate_forward_time: 16.8746089935, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4488716125
validation[          , genome  6683] predictions:    9700/  10000 (97.00%), best:    9729/10000 (97.29%), error:       969.86298, best error:       891.11615 on epoch:    33, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 240.3495788574s, input_fired_time: 3.2323045731, output_fired_time: 1.4079205990, propagate_forward_time: 90.0958023071, propagate_backward_time: 141.0189971924, weight_update_time: 0.1441588551, other_time: 4.5945587158
epoch time: 20.2356643677s, input_fired_time: 0.1515146047, output_fired_time: 0.0000000000, propagate_forward_time: 14.5763893127, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.5077610016
validation[          , genome  6683] predictions:    9730/  10000 (97.30%), best:    9730/10000 (97.30%), error:       868.70831, best error:       868.70831 on epoch:    44, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 237.3777465820s, input_fired_time: 2.2319037914, output_fired_time: 4.3830018044, propagate_forward_time: 85.2019271851, propagate_backward_time: 138.9185028076, weight_update_time: 0.1531278640, other_time: 6.6424102783
epoch time: 18.2191772461s, input_fired_time: 0.1400443017, output_fired_time: 0.0000000000, propagate_forward_time: 17.6246948242, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4544372559
validation[          , genome  6683] predictions:    9682/  10000 (96.82%), best:    9730/10000 (97.30%), error:      1079.99280, best error:       868.70831 on epoch:    44, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 235.5814666748s, input_fired_time: 3.2112779617, output_fired_time: 1.3365579844, propagate_forward_time: 80.4476242065, propagate_backward_time: 147.0851593018, weight_update_time: 0.1574641466, other_time: 3.5008392334
epoch time: 18.2941703796s, input_fired_time: 0.1427322477, output_fired_time: 0.0000000000, propagate_forward_time: 17.6941375732, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4573001862
validation[          , genome  6683] predictions:    9685/  10000 (96.85%), best:    9730/10000 (97.30%), error:      1003.86938, best error:       868.70831 on epoch:    44, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 237.5101165771s, input_fired_time: 5.2320961952, output_fired_time: 3.3469390869, propagate_forward_time: 89.4752349854, propagate_backward_time: 133.8621673584, weight_update_time: 0.1458765417, other_time: 5.5936737061
epoch time: 19.5998668671s, input_fired_time: 0.1436665207, output_fired_time: 0.0000000000, propagate_forward_time: 18.9975891113, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4586105347
validation[          , genome  6683] predictions:    9607/  10000 (96.07%), best:    9730/10000 (97.30%), error:      1221.32568, best error:       868.70831 on epoch:    44, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 240.2977905273s, input_fired_time: 1.2485100031, output_fired_time: 4.3635935783, propagate_forward_time: 82.2633895874, propagate_backward_time: 144.7104797363, weight_update_time: 0.1581604332, other_time: 7.7118225098
epoch time: 22.8200378418s, input_fired_time: 0.1620607078, output_fired_time: 0.0000000000, propagate_forward_time: 20.0396785736, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6182994843
validation[          , genome  6683] predictions:    9674/  10000 (96.74%), best:    9730/10000 (97.30%), error:      1073.17041, best error:       868.70831 on epoch:    44, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 249.6657714844s, input_fired_time: 3.2746226788, output_fired_time: 1.3849530220, propagate_forward_time: 91.5067596436, propagate_backward_time: 147.6932678223, weight_update_time: 0.1512029171, other_time: 5.8061676025
epoch time: 20.1722164154s, input_fired_time: 1.1694123745, output_fired_time: 0.0000000000, propagate_forward_time: 18.4986019135, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5042018890
validation[          , genome  6683] predictions:    9740/  10000 (97.40%), best:    9740/10000 (97.40%), error:       838.97577, best error:       838.97577 on epoch:    49, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 239.8579406738s, input_fired_time: 5.2532687187, output_fired_time: 1.3541338444, propagate_forward_time: 80.8847122192, propagate_backward_time: 146.6120758057, weight_update_time: 0.1451050639, other_time: 5.7537384033
epoch time: 18.5022678375s, input_fired_time: 0.1512297094, output_fired_time: 0.0000000000, propagate_forward_time: 13.8786439896, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4723939896
validation[          , genome  6683] predictions:    9650/  10000 (96.50%), best:    9740/10000 (97.40%), error:      1132.26367, best error:       838.97577 on epoch:    49, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 229.5399017334s, input_fired_time: 3.2337946892, output_fired_time: 1.3370109797, propagate_forward_time: 80.5991744995, propagate_backward_time: 139.7693634033, weight_update_time: 0.1554457247, other_time: 4.6005706787
epoch time: 18.6859893799s, input_fired_time: 0.1450787634, output_fired_time: 0.0000000000, propagate_forward_time: 18.0596046448, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4813060760
validation[          , genome  6683] predictions:    9658/  10000 (96.58%), best:    9740/10000 (97.40%), error:      1140.95422, best error:       838.97577 on epoch:    49, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 234.4606933594s, input_fired_time: 5.2300004959, output_fired_time: 1.3098154068, propagate_forward_time: 95.2895736694, propagate_backward_time: 124.0217514038, weight_update_time: 0.1545206308, other_time: 8.6095657349
epoch time: 17.2825279236s, input_fired_time: 0.1424631178, output_fired_time: 0.0000000000, propagate_forward_time: 15.7076768875, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4323873520
validation[          , genome  6683] predictions:    9704/  10000 (97.04%), best:    9740/10000 (97.40%), error:       933.04016, best error:       838.97577 on epoch:    49, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 227.7872009277s, input_fired_time: 2.1669590473, output_fired_time: 4.3011069298, propagate_forward_time: 74.0182800293, propagate_backward_time: 138.8091888428, weight_update_time: 0.1386354417, other_time: 8.4916687012
epoch time: 17.2047691345s, input_fired_time: 1.1418179274, output_fired_time: 0.0000000000, propagate_forward_time: 15.6146163940, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4483356476
validation[          , genome  6683] predictions:    9674/  10000 (96.74%), best:    9740/10000 (97.40%), error:      1077.25293, best error:       838.97577 on epoch:    49, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 225.5749816895s, input_fired_time: 2.1678676605, output_fired_time: 7.2978944778, propagate_forward_time: 80.1458053589, propagate_backward_time: 132.4838562012, weight_update_time: 0.1378613859, other_time: 3.4795532227
epoch time: 18.3737449646s, input_fired_time: 0.1449779719, output_fired_time: 0.0000000000, propagate_forward_time: 16.7863540649, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4424133301
validation[          , genome  6683] predictions:    9687/  10000 (96.87%), best:    9740/10000 (97.40%), error:      1011.30847, best error:       838.97577 on epoch:    49, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 225.1472930908s, input_fired_time: 7.1830186844, output_fired_time: 5.2645516396, propagate_forward_time: 77.8192443848, propagate_backward_time: 131.4651031494, weight_update_time: 0.1378867924, other_time: 3.4153747559
epoch time: 17.2478065491s, input_fired_time: 0.1416326463, output_fired_time: 0.0000000000, propagate_forward_time: 15.6682710648, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4379034042
validation[          , genome  6683] predictions:    9716/  10000 (97.16%), best:    9740/10000 (97.40%), error:       886.88763, best error:       838.97577 on epoch:    49, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 2499.9882812500s, input_fired_time: 3.2879092693, output_fired_time: 3.4536848068, propagate_forward_time: 109.9195098877, propagate_backward_time: 2377.3593750000, weight_update_time: 0.1498282850, other_time: 5.9680175781
epoch time: 19.6001491547s, input_fired_time: 0.1554579735, output_fired_time: 0.0000000000, propagate_forward_time: 17.9143199921, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5303707123
validation[          , genome  6683] predictions:    9706/  10000 (97.06%), best:    9740/10000 (97.40%), error:       982.27979, best error:       838.97577 on epoch:    49, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 239.7489624023s, input_fired_time: 1.2201323509, output_fired_time: 5.3514137268, propagate_forward_time: 87.8435058594, propagate_backward_time: 139.6231994629, weight_update_time: 0.1496054083, other_time: 5.7107086182
epoch time: 19.8901710510s, input_fired_time: 0.1529584527, output_fired_time: 0.0000000000, propagate_forward_time: 19.2605533600, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4766597748
validation[          , genome  6683] predictions:    9667/  10000 (96.67%), best:    9740/10000 (97.40%), error:      1057.02478, best error:       838.97577 on epoch:    49, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 233.2873840332s, input_fired_time: 1.2038031816, output_fired_time: 4.3211975098, propagate_forward_time: 86.9493865967, propagate_backward_time: 134.1761932373, weight_update_time: 0.1491058320, other_time: 6.6368103027
epoch time: 19.3739662170s, input_fired_time: 0.1479233950, output_fired_time: 0.0000000000, propagate_forward_time: 17.7461700439, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4798736572
validation[          , genome  6683] predictions:    9634/  10000 (96.34%), best:    9740/10000 (97.40%), error:      1165.29236, best error:       838.97577 on epoch:    49, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 268.4187927246s, input_fired_time: 6.3406963348, output_fired_time: 3.5508415699, propagate_forward_time: 106.2821655273, propagate_backward_time: 145.3145599365, weight_update_time: 0.1569205970, other_time: 6.9305267334
epoch time: 25.7624053955s, input_fired_time: 0.2099243104, output_fired_time: 0.0000000000, propagate_forward_time: 22.7921161652, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7603645325
validation[          , genome  6683] predictions:    9708/  10000 (97.08%), best:    9740/10000 (97.40%), error:       986.84613, best error:       838.97577 on epoch:    49, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 274.4992065430s, input_fired_time: 1.4684011936, output_fired_time: 2.5445134640, propagate_forward_time: 102.8901672363, propagate_backward_time: 159.4812316895, weight_update_time: 0.1707741916, other_time: 8.1148681641
epoch time: 20.1192722321s, input_fired_time: 0.1613053977, output_fired_time: 0.0000000000, propagate_forward_time: 16.4431114197, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5148563385
validation[          , genome  6683] predictions:    9722/  10000 (97.22%), best:    9740/10000 (97.40%), error:       886.44653, best error:       838.97577 on epoch:    49, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 260.1977844238s, input_fired_time: 2.3531274796, output_fired_time: 2.4854912758, propagate_forward_time: 105.2630310059, propagate_backward_time: 142.1396636963, weight_update_time: 1.1586312056, other_time: 7.9564819336
epoch time: 20.1196098328s, input_fired_time: 0.1744485646, output_fired_time: 0.0000000000, propagate_forward_time: 18.4389209747, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5062408447
validation[          , genome  6683] predictions:    9714/  10000 (97.14%), best:    9740/10000 (97.40%), error:       927.71613, best error:       838.97577 on epoch:    49, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 257.0642089844s, input_fired_time: 3.3686451912, output_fired_time: 4.4767618179, propagate_forward_time: 99.4580001831, propagate_backward_time: 143.8769531250, weight_update_time: 0.1611914635, other_time: 5.8838500977
epoch time: 20.1805801392s, input_fired_time: 0.1590614915, output_fired_time: 0.0000000000, propagate_forward_time: 19.5015754700, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5199432373
validation[          , genome  6683] predictions:    9717/  10000 (97.17%), best:    9740/10000 (97.40%), error:       967.43634, best error:       838.97577 on epoch:    49, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 258.4959716797s, input_fired_time: 5.3619656563, output_fired_time: 5.3903369904, propagate_forward_time: 97.9194793701, propagate_backward_time: 140.9890441895, weight_update_time: 0.1631471664, other_time: 8.8351440430
epoch time: 21.7664737701s, input_fired_time: 0.1936219484, output_fired_time: 0.0000000000, propagate_forward_time: 19.0162925720, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5565586090
validation[          , genome  6683] predictions:    9666/  10000 (96.66%), best:    9740/10000 (97.40%), error:      1066.66089, best error:       838.97577 on epoch:    49, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 292.0849609375s, input_fired_time: 1.5132668018, output_fired_time: 7.7000970840, propagate_forward_time: 117.7114181519, propagate_backward_time: 158.7996215820, weight_update_time: 0.1915721595, other_time: 6.3605346680
epoch time: 22.3942184448s, input_fired_time: 0.1706296653, output_fired_time: 0.0000000000, propagate_forward_time: 21.6787738800, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5448150635
validation[          , genome  6683] predictions:    9734/  10000 (97.34%), best:    9740/10000 (97.40%), error:       878.51941, best error:       838.97577 on epoch:    49, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 260.7219848633s, input_fired_time: 3.3302164078, output_fired_time: 1.4717649221, propagate_forward_time: 95.0590744019, propagate_backward_time: 155.9352111816, weight_update_time: 0.1629631370, other_time: 4.9256896973
epoch time: 22.2169055939s, input_fired_time: 2.1701889038, output_fired_time: 0.0000000000, propagate_forward_time: 19.5027065277, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5440101624
validation[          , genome  6683] predictions:    9591/  10000 (95.91%), best:    9740/10000 (97.40%), error:      1276.66211, best error:       838.97577 on epoch:    49, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 280.5973815918s, input_fired_time: 3.4166967869, output_fired_time: 2.5919668674, propagate_forward_time: 102.6483306885, propagate_backward_time: 165.7436981201, weight_update_time: 0.1667695343, other_time: 6.1966857910
epoch time: 23.0567321777s, input_fired_time: 0.1815338880, output_fired_time: 0.0000000000, propagate_forward_time: 20.2319850922, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6432132721
validation[          , genome  6683] predictions:    9692/  10000 (96.92%), best:    9740/10000 (97.40%), error:       950.05573, best error:       838.97577 on epoch:    49, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 279.9396667480s, input_fired_time: 3.4368860722, output_fired_time: 5.6694455147, propagate_forward_time: 102.9469223022, propagate_backward_time: 156.8374633789, weight_update_time: 0.2076798230, other_time: 11.0489501953
epoch time: 26.2750720978s, input_fired_time: 0.2262831628, output_fired_time: 0.0000000000, propagate_forward_time: 24.4093704224, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6394176483
validation[          , genome  6683] predictions:    9690/  10000 (96.90%), best:    9740/10000 (97.40%), error:       979.31573, best error:       838.97577 on epoch:    49, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 255.8577728271s, input_fired_time: 1.3338495493, output_fired_time: 3.4637022018, propagate_forward_time: 93.6540908813, propagate_backward_time: 148.5599975586, weight_update_time: 0.1570515782, other_time: 8.8461303711
epoch time: 19.3036003113s, input_fired_time: 0.1680596173, output_fired_time: 0.0000000000, propagate_forward_time: 18.6203784943, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5151615143
validation[          , genome  6683] predictions:    9634/  10000 (96.34%), best:    9740/10000 (97.40%), error:      1215.57825, best error:       838.97577 on epoch:    49, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 257.9317626953s, input_fired_time: 1.3390457630, output_fired_time: 7.3728137016, propagate_forward_time: 84.8233032227, propagate_backward_time: 154.4862670898, weight_update_time: 0.1696640551, other_time: 9.9103240967
epoch time: 18.4174098969s, input_fired_time: 0.1523232907, output_fired_time: 0.0000000000, propagate_forward_time: 17.8069686890, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4581184387
validation[          , genome  6683] predictions:    9629/  10000 (96.29%), best:    9740/10000 (97.40%), error:      1228.06628, best error:       838.97577 on epoch:    49, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 275.8588256836s, input_fired_time: 3.3626549244, output_fired_time: 1.5131022930, propagate_forward_time: 104.1377563477, propagate_backward_time: 159.6633758545, weight_update_time: 0.1650627255, other_time: 7.1819610596
epoch time: 21.8485126495s, input_fired_time: 0.1804968119, output_fired_time: 0.0000000000, propagate_forward_time: 21.0980014801, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5700149536
validation[          , genome  6683] predictions:    9696/  10000 (96.96%), best:    9740/10000 (97.40%), error:       997.91272, best error:       838.97577 on epoch:    49, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 280.1296081543s, input_fired_time: 4.4520173073, output_fired_time: 3.6704096794, propagate_forward_time: 102.5279083252, propagate_backward_time: 164.2529754639, weight_update_time: 0.1735636592, other_time: 5.2262878418
epoch time: 22.5577602386s, input_fired_time: 0.2020901591, output_fired_time: 0.0000000000, propagate_forward_time: 21.7091350555, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6465358734
validation[          , genome  6683] predictions:    9716/  10000 (97.16%), best:    9740/10000 (97.40%), error:       907.36261, best error:       838.97577 on epoch:    49, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 270.1984558105s, input_fired_time: 3.4055013657, output_fired_time: 7.5509881973, propagate_forward_time: 88.8802566528, propagate_backward_time: 163.2966461182, weight_update_time: 1.1777454615, other_time: 7.0650787354
epoch time: 23.1871471405s, input_fired_time: 4.1187095642, output_fired_time: 0.0000000000, propagate_forward_time: 16.4979915619, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5704460144
validation[          , genome  6683] predictions:    9735/  10000 (97.35%), best:    9740/10000 (97.40%), error:       881.85077, best error:       838.97577 on epoch:    49, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 285.7251892090s, input_fired_time: 2.4155225754, output_fired_time: 4.6781969070, propagate_forward_time: 103.9556808472, propagate_backward_time: 167.4418334961, weight_update_time: 0.1808661073, other_time: 7.2339477539
epoch time: 24.9668006897s, input_fired_time: 0.1932810247, output_fired_time: 0.0000000000, propagate_forward_time: 22.1295967102, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6439228058
validation[          , genome  6683] predictions:    9715/  10000 (97.15%), best:    9740/10000 (97.40%), error:       916.34601, best error:       838.97577 on epoch:    49, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 277.1267089844s, input_fired_time: 3.4358096123, output_fired_time: 8.6072196960, propagate_forward_time: 97.7432708740, propagate_backward_time: 158.2504730225, weight_update_time: 0.1673939675, other_time: 9.0899353027
epoch time: 20.4707412720s, input_fired_time: 0.1841885895, output_fired_time: 0.0000000000, propagate_forward_time: 19.7633934021, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5231590271
validation[          , genome  6683] predictions:    9709/  10000 (97.09%), best:    9740/10000 (97.40%), error:       952.64801, best error:       838.97577 on epoch:    49, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 260.6503295898s, input_fired_time: 3.3709182739, output_fired_time: 7.4988880157, propagate_forward_time: 97.0867004395, propagate_backward_time: 145.6497802734, weight_update_time: 0.1741412282, other_time: 7.0440521240
epoch time: 22.3749694824s, input_fired_time: 0.1679289937, output_fired_time: 0.0000000000, propagate_forward_time: 20.6729984283, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5340423584
validation[          , genome  6683] predictions:    9750/  10000 (97.50%), best:    9750/10000 (97.50%), error:       830.49860, best error:       830.49860 on epoch:    75, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 265.9709777832s, input_fired_time: 3.4204621315, output_fired_time: 2.5401306152, propagate_forward_time: 104.8632202148, propagate_backward_time: 146.0167236328, weight_update_time: 0.1812941134, other_time: 9.1304321289
epoch time: 24.9066181183s, input_fired_time: 0.1930058151, output_fired_time: 0.0000000000, propagate_forward_time: 24.0677967072, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6458148956
validation[          , genome  6683] predictions:    9726/  10000 (97.26%), best:    9750/10000 (97.50%), error:       907.13330, best error:       830.49860 on epoch:    75, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 287.3885803223s, input_fired_time: 4.4279122353, output_fired_time: 3.6336483955, propagate_forward_time: 107.2250900269, propagate_backward_time: 160.8395996094, weight_update_time: 1.1735783815, other_time: 11.2623291016
epoch time: 25.6252822876s, input_fired_time: 0.1891448498, output_fired_time: 0.0000000000, propagate_forward_time: 22.8808155060, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5553226471
validation[          , genome  6683] predictions:    9661/  10000 (96.61%), best:    9750/10000 (97.50%), error:      1091.76880, best error:       830.49860 on epoch:    75, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 278.3162231445s, input_fired_time: 5.4404172897, output_fired_time: 1.5923887491, propagate_forward_time: 95.2589492798, propagate_backward_time: 167.9265899658, weight_update_time: 0.1822617054, other_time: 8.0978851318
epoch time: 20.4568119049s, input_fired_time: 0.1676651388, output_fired_time: 0.0000000000, propagate_forward_time: 19.7515678406, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5375785828
validation[          , genome  6683] predictions:    9728/  10000 (97.28%), best:    9750/10000 (97.50%), error:       931.00482, best error:       830.49860 on epoch:    75, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 276.2453308105s, input_fired_time: 5.4443831444, output_fired_time: 5.5975327492, propagate_forward_time: 83.9634017944, propagate_backward_time: 174.0903320313, weight_update_time: 1.1811280251, other_time: 7.1496582031
epoch time: 23.6886310577s, input_fired_time: 0.1894777417, output_fired_time: 0.0000000000, propagate_forward_time: 22.9170246124, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5821285248
validation[          , genome  6683] predictions:    9678/  10000 (96.78%), best:    9750/10000 (97.50%), error:      1053.55200, best error:       830.49860 on epoch:    75, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 268.1503295898s, input_fired_time: 3.4336133003, output_fired_time: 7.5354046822, propagate_forward_time: 89.0918655396, propagate_backward_time: 156.9527282715, weight_update_time: 2.1679382324, other_time: 11.1367187500
epoch time: 20.1756725311s, input_fired_time: 0.1555026174, output_fired_time: 0.0000000000, propagate_forward_time: 17.5008888245, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5192813873
validation[          , genome  6683] predictions:    9687/  10000 (96.87%), best:    9750/10000 (97.50%), error:      1018.71198, best error:       830.49860 on epoch:    75, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 257.8984985352s, input_fired_time: 2.3824369907, output_fired_time: 1.4481898546, propagate_forward_time: 106.3207168579, propagate_backward_time: 144.8467407227, weight_update_time: 0.1543974131, other_time: 2.9004211426
epoch time: 20.3559055328s, input_fired_time: 0.1641965508, output_fired_time: 0.0000000000, propagate_forward_time: 19.6744804382, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5172290802
validation[          , genome  6683] predictions:    9617/  10000 (96.17%), best:    9750/10000 (97.50%), error:      1230.56116, best error:       830.49860 on epoch:    75, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 253.0157318115s, input_fired_time: 1.3305275440, output_fired_time: 6.4311394691, propagate_forward_time: 92.5728149414, propagate_backward_time: 141.8614959717, weight_update_time: 0.1623668373, other_time: 10.8197631836
epoch time: 20.0702762604s, input_fired_time: 0.1604434252, output_fired_time: 0.0000000000, propagate_forward_time: 18.3879203796, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5219116211
validation[          , genome  6683] predictions:    9740/  10000 (97.40%), best:    9750/10000 (97.50%), error:       864.67255, best error:       830.49860 on epoch:    75, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 239.7909240723s, input_fired_time: 1.2781416178, output_fired_time: 1.3741344213, propagate_forward_time: 81.9853439331, propagate_backward_time: 150.3678436279, weight_update_time: 2.1594927311, other_time: 4.7854766846
epoch time: 20.1423759460s, input_fired_time: 1.1676735878, output_fired_time: 0.0000000000, propagate_forward_time: 17.4440536499, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5306491852
validation[          , genome  6683] predictions:    9696/  10000 (96.96%), best:    9750/10000 (97.50%), error:       988.73694, best error:       830.49860 on epoch:    75, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 257.4525756836s, input_fired_time: 2.3459913731, output_fired_time: 4.4950509071, propagate_forward_time: 92.4809417725, propagate_backward_time: 149.1383209229, weight_update_time: 0.1681551635, other_time: 8.9922637939
epoch time: 20.7171745300s, input_fired_time: 0.1678471416, output_fired_time: 0.0000000000, propagate_forward_time: 20.0095767975, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5397510529
validation[          , genome  6683] predictions:    9725/  10000 (97.25%), best:    9750/10000 (97.50%), error:       879.91730, best error:       830.49860 on epoch:    75, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 272.6354675293s, input_fired_time: 1.4133639336, output_fired_time: 2.5684497356, propagate_forward_time: 96.0328292847, propagate_backward_time: 159.4546051025, weight_update_time: 2.1741540432, other_time: 13.1662139893
epoch time: 20.6649665833s, input_fired_time: 0.1659127474, output_fired_time: 0.0000000000, propagate_forward_time: 17.9514122009, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5476417542
validation[          , genome  6683] predictions:    9728/  10000 (97.28%), best:    9750/10000 (97.50%), error:       898.78271, best error:       830.49860 on epoch:    75, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 263.4110717773s, input_fired_time: 1.4591739178, output_fired_time: 1.5030170679, propagate_forward_time: 99.4243545532, propagate_backward_time: 152.9151000977, weight_update_time: 0.1638830900, other_time: 8.1094360352
epoch time: 20.3442707062s, input_fired_time: 0.1598118693, output_fired_time: 0.0000000000, propagate_forward_time: 18.6475925446, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5368671417
validation[          , genome  6683] predictions:    9726/  10000 (97.26%), best:    9750/10000 (97.50%), error:       878.77429, best error:       830.49860 on epoch:    75, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 252.4248657227s, input_fired_time: 7.3242425919, output_fired_time: 1.4238091707, propagate_forward_time: 80.8564376831, propagate_backward_time: 150.9777832031, weight_update_time: 0.1594227254, other_time: 11.8425903320
epoch time: 20.7972297668s, input_fired_time: 0.1555103660, output_fired_time: 0.0000000000, propagate_forward_time: 20.1232280731, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5184917450
validation[          , genome  6683] predictions:    9731/  10000 (97.31%), best:    9750/10000 (97.50%), error:       907.07831, best error:       830.49860 on epoch:    75, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 253.1349487305s, input_fired_time: 5.3287959099, output_fired_time: 4.4155483246, propagate_forward_time: 99.7904052734, propagate_backward_time: 133.7274475098, weight_update_time: 0.1556014866, other_time: 9.8727569580
epoch time: 17.3512992859s, input_fired_time: 0.1479369551, output_fired_time: 0.0000000000, propagate_forward_time: 16.7221221924, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4812393188
validation[          , genome  6683] predictions:    9695/  10000 (96.95%), best:    9750/10000 (97.50%), error:       942.82111, best error:       830.49860 on epoch:    75, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 232.0851135254s, input_fired_time: 1.2156918049, output_fired_time: 4.3119430542, propagate_forward_time: 80.8731613159, propagate_backward_time: 140.0918426514, weight_update_time: 0.1463809609, other_time: 5.5924530029
epoch time: 18.0993919373s, input_fired_time: 0.1445173025, output_fired_time: 0.0000000000, propagate_forward_time: 16.5199890137, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4348850250
validation[          , genome  6683] predictions:    9689/  10000 (96.89%), best:    9750/10000 (97.50%), error:      1020.91455, best error:       830.49860 on epoch:    75, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 227.8300628662s, input_fired_time: 2.1788797379, output_fired_time: 3.2646532059, propagate_forward_time: 87.1279983521, propagate_backward_time: 128.7276306152, weight_update_time: 0.1389039308, other_time: 6.5309143066
epoch time: 19.9740638733s, input_fired_time: 3.1750242710, output_fired_time: 0.0000000000, propagate_forward_time: 16.3196716309, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4793682098
validation[          , genome  6683] predictions:    9711/  10000 (97.11%), best:    9750/10000 (97.50%), error:       938.54993, best error:       830.49860 on epoch:    75, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 214.6670379639s, input_fired_time: 3.1207492352, output_fired_time: 1.1892074347, propagate_forward_time: 80.6361007690, propagate_backward_time: 126.3859786987, weight_update_time: 0.1308006495, other_time: 3.3349990845
epoch time: 16.9920787811s, input_fired_time: 0.1383857876, output_fired_time: 0.0000000000, propagate_forward_time: 16.4451694489, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4085235596
validation[          , genome  6683] predictions:    9723/  10000 (97.23%), best:    9750/10000 (97.50%), error:       934.17151, best error:       830.49860 on epoch:    75, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 223.2126922607s, input_fired_time: 1.1342746019, output_fired_time: 1.2352044582, propagate_forward_time: 81.4802703857, propagate_backward_time: 136.9626770020, weight_update_time: 0.1401105076, other_time: 2.4002685547
epoch time: 21.4710807800s, input_fired_time: 0.1674710959, output_fired_time: 0.0000000000, propagate_forward_time: 20.7435665131, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5600433350
validation[          , genome  6683] predictions:    9565/  10000 (95.65%), best:    9750/10000 (97.50%), error:      1434.58691, best error:       830.49860 on epoch:    75, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 237.9176788330s, input_fired_time: 1.2339199781, output_fired_time: 1.3575980663, propagate_forward_time: 78.6847457886, propagate_backward_time: 147.9396972656, weight_update_time: 0.1507813334, other_time: 8.7017211914
epoch time: 20.2391815186s, input_fired_time: 0.1635040045, output_fired_time: 0.0000000000, propagate_forward_time: 19.5810127258, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4946651459
validation[          , genome  6683] predictions:    9734/  10000 (97.34%), best:    9750/10000 (97.50%), error:       892.18427, best error:       830.49860 on epoch:    75, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 276.2583007813s, input_fired_time: 2.3835527897, output_fired_time: 13.5626363754, propagate_forward_time: 104.9153747559, propagate_backward_time: 149.2664794922, weight_update_time: 0.1711020470, other_time: 6.1302795410
epoch time: 20.8188438416s, input_fired_time: 0.1891193241, output_fired_time: 0.0000000000, propagate_forward_time: 18.0175590515, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6121654510
validation[          , genome  6683] predictions:    9707/  10000 (97.07%), best:    9750/10000 (97.50%), error:       944.45636, best error:       830.49860 on epoch:    75, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 265.2789001465s, input_fired_time: 4.3810410500, output_fired_time: 2.5454390049, propagate_forward_time: 100.6263351440, propagate_backward_time: 149.5676574707, weight_update_time: 0.1625996530, other_time: 8.1584167480
epoch time: 19.9386329651s, input_fired_time: 0.1586986929, output_fired_time: 0.0000000000, propagate_forward_time: 17.2351093292, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5448246002
validation[          , genome  6683] predictions:    9735/  10000 (97.35%), best:    9750/10000 (97.50%), error:       866.75983, best error:       830.49860 on epoch:    75, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 253.8022918701s, input_fired_time: 1.3342446089, output_fired_time: 9.4844121933, propagate_forward_time: 86.1452331543, propagate_backward_time: 151.9139404297, weight_update_time: 0.1574410349, other_time: 4.9244689941
epoch time: 20.0778961182s, input_fired_time: 1.1573231220, output_fired_time: 0.0000000000, propagate_forward_time: 18.4019432068, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5186290741
validation[          , genome  6683] predictions:    9716/  10000 (97.16%), best:    9750/10000 (97.50%), error:       958.06903, best error:       830.49860 on epoch:    75, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 268.4933471680s, input_fired_time: 7.3909721375, output_fired_time: 2.4809379578, propagate_forward_time: 102.2533264160, propagate_backward_time: 149.3379364014, weight_update_time: 0.1711448282, other_time: 7.0301971436
epoch time: 22.7104129791s, input_fired_time: 0.1712578684, output_fired_time: 0.0000000000, propagate_forward_time: 19.9637298584, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5754261017
validation[          , genome  6683] predictions:    9582/  10000 (95.82%), best:    9750/10000 (97.50%), error:      1348.78333, best error:       830.49860 on epoch:    75, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 253.2115936279s, input_fired_time: 1.3110711575, output_fired_time: 3.4689698219, propagate_forward_time: 96.9981689453, propagate_backward_time: 141.5709075928, weight_update_time: 0.1579233408, other_time: 9.8624877930
epoch time: 19.8211803436s, input_fired_time: 0.1562484354, output_fired_time: 0.0000000000, propagate_forward_time: 19.1769428253, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4879894257
validation[          , genome  6683] predictions:    9607/  10000 (96.07%), best:    9750/10000 (97.50%), error:      1303.46655, best error:       830.49860 on epoch:    75, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 252.3093566895s, input_fired_time: 5.3111371994, output_fired_time: 1.4429019690, propagate_forward_time: 88.6023864746, propagate_backward_time: 143.0386199951, weight_update_time: 3.1711068153, other_time: 13.9143066406
epoch time: 19.7599716187s, input_fired_time: 0.1529014856, output_fired_time: 0.0000000000, propagate_forward_time: 15.1240215302, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4830493927
validation[          , genome  6683] predictions:    9644/  10000 (96.44%), best:    9750/10000 (97.50%), error:      1215.49536, best error:       830.49860 on epoch:    75, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 266.9179687500s, input_fired_time: 3.4120259285, output_fired_time: 1.4953488111, propagate_forward_time: 102.0060653687, propagate_backward_time: 149.9131011963, weight_update_time: 0.1701372266, other_time: 10.0914154053
epoch time: 19.9430828094s, input_fired_time: 0.1627203226, output_fired_time: 0.0000000000, propagate_forward_time: 17.3057384491, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4746246338
validation[          , genome  6683] predictions:    9647/  10000 (96.47%), best:    9750/10000 (97.50%), error:      1164.88391, best error:       830.49860 on epoch:    75, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 105.2037200928s, input_fired_time: 2.8919117451, output_fired_time: 0.0000000000, propagate_forward_time: 96.4850540161, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.8267517090
best training[          , genome  6683] predictions:   49548/  50000 (99.10%), best:    9750/10000 (97.50%), error:      1780.26416, best error:       830.49860 on epoch:    75, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 17.8754215240s, input_fired_time: 0.1783094853, output_fired_time: 0.0000000000, propagate_forward_time: 17.0532646179, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6438465118
   testing[          , genome  6683] predictions:    9799/  10000 (97.99%), best:    9750/10000 (97.50%), error:       709.47498, best error:       830.49860 on epoch:    75, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
10:48:48 (2200): called boinc_finish(0)

</stderr_txt>
]]>