Nameexact_genome_1512568488_45_6969_2
Workunit2606096
Created8 Dec 2017, 0:09:17 UTC
Sent8 Dec 2017, 0:12:43 UTC
Report deadline15 Dec 2017, 10:39:20 UTC
Received8 Dec 2017, 17:03:46 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID64142
Run time5 hours 3 min 31 sec
CPU time3 hours 42 min 43 sec
Validate stateValid
Credit1,858.79
Device peak FLOPS3.08 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size155.93 MB
Peak swap size158.76 MB
Peak disk usage1.94 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
ons:    9696/  10000 (96.96%), best:    9713/10000 (97.13%), error:       992.75183, best error:       959.18903 on epoch:    10, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 117.0956115723s, input_fired_time: 1.2089259624, output_fired_time: 1.1203871965, propagate_forward_time: 43.5151405334, propagate_backward_time: 68.4951095581, weight_update_time: 0.1338524967, other_time: 2.7560501099
epoch time: 10.3376417160s, input_fired_time: 0.1633985043, output_fired_time: 0.0000000000, propagate_forward_time: 9.6354331970, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5388097763
validation[          , genome  6969] predictions:    9730/  10000 (97.30%), best:    9730/10000 (97.30%), error:       920.29895, best error:       920.29895 on epoch:    15, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 121.3799819946s, input_fired_time: 1.2516930103, output_fired_time: 1.1104900837, propagate_forward_time: 45.0698204041, propagate_backward_time: 71.0521774292, weight_update_time: 0.1354530156, other_time: 2.8958053589
epoch time: 8.5335378647s, input_fired_time: 0.1425183266, output_fired_time: 0.0000000000, propagate_forward_time: 7.9202790260, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4707407951
validation[          , genome  6969] predictions:    9726/  10000 (97.26%), best:    9726/10000 (97.26%), error:       914.75525, best error:       914.75525 on epoch:    16, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 120.8574523926s, input_fired_time: 1.2327744961, output_fired_time: 1.1488404274, propagate_forward_time: 45.0995025635, propagate_backward_time: 70.5635604858, weight_update_time: 0.1373044550, other_time: 2.8127746582
epoch time: 11.4148635864s, input_fired_time: 0.2116680741, output_fired_time: 0.0000000000, propagate_forward_time: 10.5682106018, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6349849701
validation[          , genome  6969] predictions:    9687/  10000 (96.87%), best:    9726/10000 (97.26%), error:      1013.32239, best error:       914.75525 on epoch:    16, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 120.7706527710s, input_fired_time: 1.2216308117, output_fired_time: 1.1479382515, propagate_forward_time: 45.0076141357, propagate_backward_time: 70.5430603027, weight_update_time: 0.1352303624, other_time: 2.8504028320
epoch time: 11.1662425995s, input_fired_time: 0.2396881580, output_fired_time: 0.0000000000, propagate_forward_time: 10.3458318710, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5807228088
validation[          , genome  6969] predictions:    9709/  10000 (97.09%), best:    9726/10000 (97.26%), error:       943.07532, best error:       914.75525 on epoch:    16, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 119.5311813354s, input_fired_time: 1.2312068939, output_fired_time: 1.1031903028, propagate_forward_time: 44.6051330566, propagate_backward_time: 69.7479705811, weight_update_time: 0.1367617249, other_time: 2.8436813354
epoch time: 10.3902826309s, input_fired_time: 0.1624754071, output_fired_time: 0.0000000000, propagate_forward_time: 9.6731166840, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5546903610
validation[          , genome  6969] predictions:    9695/  10000 (96.95%), best:    9726/10000 (97.26%), error:      1043.09094, best error:       914.75525 on epoch:    16, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 120.0355606079s, input_fired_time: 1.2695540190, output_fired_time: 1.0886973143, propagate_forward_time: 44.7943344116, propagate_backward_time: 70.0593414307, weight_update_time: 0.1367597133, other_time: 2.8236312866
epoch time: 8.5530614853s, input_fired_time: 0.1410032809, output_fired_time: 0.0000000000, propagate_forward_time: 7.9424014091, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4696564674
validation[          , genome  6969] predictions:    9709/  10000 (97.09%), best:    9726/10000 (97.26%), error:      1014.39661, best error:       914.75525 on epoch:    16, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 119.7481613159s, input_fired_time: 1.2227703333, output_fired_time: 1.1341121197, propagate_forward_time: 44.5170059204, propagate_backward_time: 70.0974273682, weight_update_time: 0.1353127211, other_time: 2.7768478394
epoch time: 9.9218597412s, input_fired_time: 0.1481335163, output_fired_time: 0.0000000000, propagate_forward_time: 9.2480983734, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5256280899
validation[          , genome  6969] predictions:    9731/  10000 (97.31%), best:    9731/10000 (97.31%), error:       888.16766, best error:       888.16766 on epoch:    21, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 118.4892425537s, input_fired_time: 1.2283194065, output_fired_time: 1.1203663349, propagate_forward_time: 44.2575836182, propagate_backward_time: 69.0491027832, weight_update_time: 0.1333907098, other_time: 2.8338699341
epoch time: 9.8133783340s, input_fired_time: 0.1575119197, output_fired_time: 0.0000000000, propagate_forward_time: 9.1348524094, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5210142136
validation[          , genome  6969] predictions:    9713/  10000 (97.13%), best:    9731/10000 (97.31%), error:       973.48834, best error:       888.16766 on epoch:    21, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 118.0343856812s, input_fired_time: 1.2452890873, output_fired_time: 1.0792193413, propagate_forward_time: 44.0212402344, propagate_backward_time: 68.8838882446, weight_update_time: 0.1342707872, other_time: 2.8047485352
epoch time: 9.6928348541s, input_fired_time: 0.1534958035, output_fired_time: 0.0000000000, propagate_forward_time: 9.0155286789, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5238103867
validation[          , genome  6969] predictions:    9696/  10000 (96.96%), best:    9731/10000 (97.31%), error:       996.32343, best error:       888.16766 on epoch:    21, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 117.8557662964s, input_fired_time: 1.2609115839, output_fired_time: 1.1102057695, propagate_forward_time: 43.7433853149, propagate_backward_time: 68.9611129761, weight_update_time: 0.1340675354, other_time: 2.7801513672
epoch time: 10.0373983383s, input_fired_time: 0.1566543281, output_fired_time: 0.0000000000, propagate_forward_time: 9.3614253998, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5193185806
validation[          , genome  6969] predictions:    9715/  10000 (97.15%), best:    9731/10000 (97.31%), error:       957.03717, best error:       888.16766 on epoch:    21, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 124.7982559204s, input_fired_time: 1.2746249437, output_fired_time: 1.1753386259, propagate_forward_time: 46.7275390625, propagate_backward_time: 72.6514511108, weight_update_time: 0.1380545199, other_time: 2.9692993164
epoch time: 19.4874744415s, input_fired_time: 0.7132352591, output_fired_time: 0.0000000000, propagate_forward_time: 17.6919860840, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0822525024
validation[          , genome  6969] predictions:    9739/  10000 (97.39%), best:    9731/10000 (97.31%), error:       931.32257, best error:       888.16766 on epoch:    21, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 200.8954315186s, input_fired_time: 2.6383607388, output_fired_time: 1.5912250280, propagate_forward_time: 75.8413772583, propagate_backward_time: 116.1960220337, weight_update_time: 0.1480073929, other_time: 4.6284332275
epoch time: 15.2863855362s, input_fired_time: 0.1991750300, output_fired_time: 0.0000000000, propagate_forward_time: 14.2863159180, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8008947372
validation[          , genome  6969] predictions:    9721/  10000 (97.21%), best:    9731/10000 (97.31%), error:       930.93695, best error:       888.16766 on epoch:    21, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 248.7036132813s, input_fired_time: 2.8167173862, output_fired_time: 1.6841900349, propagate_forward_time: 92.9273529053, propagate_backward_time: 146.1770172119, weight_update_time: 0.1960428357, other_time: 5.0983428955
epoch time: 26.6248836517s, input_fired_time: 0.5109815001, output_fired_time: 0.0000000000, propagate_forward_time: 24.1825771332, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9313259125
validation[          , genome  6969] predictions:    9735/  10000 (97.35%), best:    9731/10000 (97.31%), error:       899.04761, best error:       888.16766 on epoch:    21, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 314.3788757324s, input_fired_time: 2.5837807655, output_fired_time: 2.6008150578, propagate_forward_time: 120.6426849365, propagate_backward_time: 181.8580627441, weight_update_time: 0.4315106273, other_time: 6.6935272217
epoch time: 23.2423210144s, input_fired_time: 0.2134605497, output_fired_time: 0.0000000000, propagate_forward_time: 21.9469642639, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0818958282
validation[          , genome  6969] predictions:    9729/  10000 (97.29%), best:    9731/10000 (97.31%), error:       931.35492, best error:       888.16766 on epoch:    21, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 314.3941345215s, input_fired_time: 2.3931605816, output_fired_time: 3.5102000237, propagate_forward_time: 115.5095901489, propagate_backward_time: 185.1534576416, weight_update_time: 0.5860915780, other_time: 7.8277435303
epoch time: 19.1180896759s, input_fired_time: 0.3378870487, output_fired_time: 0.0000000000, propagate_forward_time: 17.9024658203, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8777370453
validation[          , genome  6969] predictions:    9742/  10000 (97.42%), best:    9742/10000 (97.42%), error:       828.81201, best error:       828.81201 on epoch:    29, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 215.2277374268s, input_fired_time: 1.4829522371, output_fired_time: 1.5925132036, propagate_forward_time: 81.8490066528, propagate_backward_time: 124.9157409668, weight_update_time: 0.1481056958, other_time: 5.3875122070
epoch time: 15.1380681992s, input_fired_time: 0.1671387255, output_fired_time: 0.0000000000, propagate_forward_time: 14.3753910065, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5955381393
validation[          , genome  6969] predictions:    9731/  10000 (97.31%), best:    9742/10000 (97.42%), error:       875.25159, best error:       828.81201 on epoch:    29, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 217.5098114014s, input_fired_time: 2.2838912010, output_fired_time: 2.1571562290, propagate_forward_time: 81.8790435791, propagate_backward_time: 125.8572616577, weight_update_time: 0.3979749084, other_time: 5.3324661255
epoch time: 16.7068328857s, input_fired_time: 0.2137268782, output_fired_time: 0.0000000000, propagate_forward_time: 15.7867708206, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7063360214
validation[          , genome  6969] predictions:    9711/  10000 (97.11%), best:    9742/10000 (97.42%), error:       995.44727, best error:       828.81201 on epoch:    29, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 213.8838195801s, input_fired_time: 1.7041761875, output_fired_time: 1.3728230000, propagate_forward_time: 79.2343521118, propagate_backward_time: 126.9982604980, weight_update_time: 0.1952776015, other_time: 4.5742187500
epoch time: 15.6370191574s, input_fired_time: 0.1661689728, output_fired_time: 0.0000000000, propagate_forward_time: 14.6243619919, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8464879990
validation[          , genome  6969] predictions:    9733/  10000 (97.33%), best:    9742/10000 (97.42%), error:       885.34076, best error:       828.81201 on epoch:    29, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 225.6830139160s, input_fired_time: 2.3749933243, output_fired_time: 1.9961727858, propagate_forward_time: 82.3502273560, propagate_backward_time: 134.3845977783, weight_update_time: 0.4915920198, other_time: 4.5770111084
epoch time: 23.9433231354s, input_fired_time: 0.4322414100, output_fired_time: 0.0000000000, propagate_forward_time: 22.3468666077, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1642150879
validation[          , genome  6969] predictions:    9685/  10000 (96.85%), best:    9742/10000 (97.42%), error:      1015.38727, best error:       828.81201 on epoch:    29, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 363.3819274902s, input_fired_time: 3.9277389050, output_fired_time: 3.9499957561, propagate_forward_time: 134.3103027344, propagate_backward_time: 211.5918426514, weight_update_time: 0.5546198487, other_time: 9.6020660400
epoch time: 31.1040229797s, input_fired_time: 0.1669452041, output_fired_time: 0.0000000000, propagate_forward_time: 29.3117942810, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6252841949
validation[          , genome  6969] predictions:    9707/  10000 (97.07%), best:    9742/10000 (97.42%), error:       913.69257, best error:       828.81201 on epoch:    29, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 204.1958160400s, input_fired_time: 1.5280436277, output_fired_time: 2.2202944756, propagate_forward_time: 74.0786590576, propagate_backward_time: 120.4934387207, weight_update_time: 0.5598160028, other_time: 5.8753814697
epoch time: 10.1679706573s, input_fired_time: 0.1521415710, output_fired_time: 0.0000000000, propagate_forward_time: 9.5185499191, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4972791672
validation[          , genome  6969] predictions:    9682/  10000 (96.82%), best:    9742/10000 (97.42%), error:      1092.70264, best error:       828.81201 on epoch:    29, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 117.4319152832s, input_fired_time: 1.1974660158, output_fired_time: 1.2055308819, propagate_forward_time: 43.6623077393, propagate_backward_time: 68.4486923218, weight_update_time: 0.1300283819, other_time: 2.9179229736
epoch time: 9.6945867538s, input_fired_time: 0.1531506628, output_fired_time: 0.0000000000, propagate_forward_time: 9.0434103012, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4980258942
validation[          , genome  6969] predictions:    9774/  10000 (97.74%), best:    9774/10000 (97.74%), error:       820.73383, best error:       820.73383 on epoch:    36, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 114.6421356201s, input_fired_time: 1.2023800611, output_fired_time: 1.0480525494, propagate_forward_time: 42.6214218140, propagate_backward_time: 67.0731735229, weight_update_time: 0.1305424124, other_time: 2.6971130371
epoch time: 10.5088644028s, input_fired_time: 0.1427385509, output_fired_time: 0.0000000000, propagate_forward_time: 9.8040590286, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5620670319
validation[          , genome  6969] predictions:    9744/  10000 (97.44%), best:    9774/10000 (97.74%), error:       846.25269, best error:       820.73383 on epoch:    36, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 118.6595916748s, input_fired_time: 1.1975086927, output_fired_time: 1.1485852003, propagate_forward_time: 43.9579086304, propagate_backward_time: 69.5792160034, weight_update_time: 0.1300964653, other_time: 2.7763748169
epoch time: 9.8715238571s, input_fired_time: 0.1498718262, output_fired_time: 0.0000000000, propagate_forward_time: 9.2318840027, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4897680283
validation[          , genome  6969] predictions:    9716/  10000 (97.16%), best:    9774/10000 (97.74%), error:       950.22949, best error:       820.73383 on epoch:    36, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 119.3560104370s, input_fired_time: 1.2113811970, output_fired_time: 1.0560908318, propagate_forward_time: 44.4781455994, propagate_backward_time: 69.5750656128, weight_update_time: 0.1318136752, other_time: 3.0353317261
epoch time: 10.0704240799s, input_fired_time: 0.1451956332, output_fired_time: 0.0000000000, propagate_forward_time: 9.3576288223, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5675992966
validation[          , genome  6969] predictions:    9714/  10000 (97.14%), best:    9774/10000 (97.74%), error:       941.92255, best error:       820.73383 on epoch:    36, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 122.7848434448s, input_fired_time: 1.3041721582, output_fired_time: 1.1999815702, propagate_forward_time: 45.7468910217, propagate_backward_time: 71.6977691650, weight_update_time: 0.1321935952, other_time: 2.8360290527
epoch time: 9.1962623596s, input_fired_time: 0.1505650729, output_fired_time: 0.0000000000, propagate_forward_time: 8.5515079498, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4941892624
validation[          , genome  6969] predictions:    9724/  10000 (97.24%), best:    9774/10000 (97.74%), error:       959.11987, best error:       820.73383 on epoch:    36, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 123.4318389893s, input_fired_time: 1.2214217186, output_fired_time: 1.2096756697, propagate_forward_time: 45.7887001038, propagate_backward_time: 72.3770217896, weight_update_time: 0.1328673810, other_time: 2.8350143433
epoch time: 9.7565765381s, input_fired_time: 0.1559585631, output_fired_time: 0.0000000000, propagate_forward_time: 9.0938978195, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5067205429
validation[          , genome  6969] predictions:    9764/  10000 (97.64%), best:    9764/10000 (97.64%), error:       816.99646, best error:       816.99646 on epoch:    41, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 123.1686477661s, input_fired_time: 1.2371627092, output_fired_time: 1.0856654644, propagate_forward_time: 45.9240570068, propagate_backward_time: 72.1475219727, weight_update_time: 0.1350147575, other_time: 2.7742462158
epoch time: 10.1867485046s, input_fired_time: 0.1555166692, output_fired_time: 0.0000000000, propagate_forward_time: 9.5253562927, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5058755875
validation[          , genome  6969] predictions:    9672/  10000 (96.72%), best:    9764/10000 (97.64%), error:      1014.02026, best error:       816.99646 on epoch:    41, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 126.0131378174s, input_fired_time: 1.3526421785, output_fired_time: 1.1174058914, propagate_forward_time: 47.0473594666, propagate_backward_time: 73.6436920166, weight_update_time: 0.1390528977, other_time: 2.8520355225
epoch time: 10.5894050598s, input_fired_time: 0.1560358852, output_fired_time: 0.0000000000, propagate_forward_time: 9.9237728119, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5095968246
validation[          , genome  6969] predictions:    9750/  10000 (97.50%), best:    9764/10000 (97.64%), error:       829.72217, best error:       816.99646 on epoch:    41, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 123.5451889038s, input_fired_time: 1.3673731089, output_fired_time: 1.0991469622, propagate_forward_time: 45.6663322449, propagate_backward_time: 72.5510787964, weight_update_time: 0.1359594315, other_time: 2.8612594604
epoch time: 9.6765079498s, input_fired_time: 0.1554900557, output_fired_time: 0.0000000000, propagate_forward_time: 9.0134305954, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5075874329
validation[          , genome  6969] predictions:    9733/  10000 (97.33%), best:    9764/10000 (97.64%), error:       893.45508, best error:       816.99646 on epoch:    41, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 121.7716064453s, input_fired_time: 1.2372614145, output_fired_time: 1.0893017054, propagate_forward_time: 45.2794036865, propagate_backward_time: 71.2508544922, weight_update_time: 0.1354090124, other_time: 2.9147872925
epoch time: 10.0492773056s, input_fired_time: 0.1520089358, output_fired_time: 0.0000000000, propagate_forward_time: 9.4071779251, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4900903702
validation[          , genome  6969] predictions:    9760/  10000 (97.60%), best:    9764/10000 (97.64%), error:       857.59662, best error:       816.99646 on epoch:    41, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 122.9857788086s, input_fired_time: 1.4387264252, output_fired_time: 1.0860589743, propagate_forward_time: 45.4849052429, propagate_backward_time: 71.8854064941, weight_update_time: 0.1352595091, other_time: 3.0906829834
epoch time: 10.0783185959s, input_fired_time: 0.1628983617, output_fired_time: 0.0000000000, propagate_forward_time: 9.3838233948, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5315971375
validation[          , genome  6969] predictions:    9749/  10000 (97.49%), best:    9764/10000 (97.64%), error:       820.30115, best error:       816.99646 on epoch:    41, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 120.4908142090s, input_fired_time: 1.2443521023, output_fired_time: 1.0989164114, propagate_forward_time: 45.3549079895, propagate_backward_time: 69.9890136719, weight_update_time: 0.1368252039, other_time: 2.8036193848
epoch time: 11.3156290054s, input_fired_time: 0.1630877107, output_fired_time: 0.0000000000, propagate_forward_time: 10.5146942139, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6378469467
validation[          , genome  6969] predictions:    9714/  10000 (97.14%), best:    9764/10000 (97.64%), error:       944.48553, best error:       816.99646 on epoch:    41, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 126.7078018188s, input_fired_time: 1.3519393206, output_fired_time: 1.3084110022, propagate_forward_time: 47.1247406006, propagate_backward_time: 74.0265426636, weight_update_time: 0.1358667463, other_time: 2.8961715698
epoch time: 9.8420953751s, input_fired_time: 0.1607325226, output_fired_time: 0.0000000000, propagate_forward_time: 9.1585912704, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5227718353
validation[          , genome  6969] predictions:    9773/  10000 (97.73%), best:    9773/10000 (97.73%), error:       791.72546, best error:       791.72546 on epoch:    48, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 164.6603240967s, input_fired_time: 1.4875804186, output_fired_time: 1.6013927460, propagate_forward_time: 62.2185630798, propagate_backward_time: 95.6527633667, weight_update_time: 0.1425821930, other_time: 3.7000198364
epoch time: 22.3604049683s, input_fired_time: 0.1692702323, output_fired_time: 0.0000000000, propagate_forward_time: 21.4224510193, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7686843872
validation[          , genome  6969] predictions:    9718/  10000 (97.18%), best:    9773/10000 (97.73%), error:       914.59967, best error:       791.72546 on epoch:    48, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 217.0919342041s, input_fired_time: 1.6713083982, output_fired_time: 2.2007498741, propagate_forward_time: 82.1457138062, propagate_backward_time: 127.3160018921, weight_update_time: 0.1479659230, other_time: 3.7581558228
epoch time: 25.1828708649s, input_fired_time: 0.1702005565, output_fired_time: 0.0000000000, propagate_forward_time: 23.5718898773, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4407806396
validation[          , genome  6969] predictions:    9767/  10000 (97.67%), best:    9773/10000 (97.73%), error:       822.89447, best error:       791.72546 on epoch:    48, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 219.5002136230s, input_fired_time: 2.1078577042, output_fired_time: 2.0620405674, propagate_forward_time: 81.4967575073, propagate_backward_time: 128.0150604248, weight_update_time: 0.5110287666, other_time: 5.8184967041
epoch time: 14.3579139709s, input_fired_time: 0.1682600826, output_fired_time: 0.0000000000, propagate_forward_time: 13.6422710419, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5473833084
validation[          , genome  6969] predictions:    9720/  10000 (97.20%), best:    9773/10000 (97.73%), error:       915.48212, best error:       791.72546 on epoch:    48, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 410.3697509766s, input_fired_time: 4.3462810516, output_fired_time: 3.8452661037, propagate_forward_time: 153.4284667969, propagate_backward_time: 238.5589447021, weight_update_time: 0.6483364701, other_time: 10.1907806396
epoch time: 16.3104076385s, input_fired_time: 0.6234537959, output_fired_time: 0.0000000000, propagate_forward_time: 15.1390056610, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5479478836
validation[          , genome  6969] predictions:    9726/  10000 (97.26%), best:    9773/10000 (97.73%), error:       931.90515, best error:       791.72546 on epoch:    48, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 366.8370666504s, input_fired_time: 4.6269574165, output_fired_time: 2.5920343399, propagate_forward_time: 135.8168487549, propagate_backward_time: 214.3750915527, weight_update_time: 0.2576676309, other_time: 9.4261322021
epoch time: 52.2198524475s, input_fired_time: 1.2810648680, output_fired_time: 0.0000000000, propagate_forward_time: 48.8742103577, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0645790100
validation[          , genome  6969] predictions:    9749/  10000 (97.49%), best:    9773/10000 (97.73%), error:       821.17010, best error:       791.72546 on epoch:    48, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 489.9403381348s, input_fired_time: 5.1924471855, output_fired_time: 5.2784895897, propagate_forward_time: 180.9684295654, propagate_backward_time: 285.2618103027, weight_update_time: 0.1480042785, other_time: 13.2391662598
epoch time: 19.2707805634s, input_fired_time: 0.1624845862, output_fired_time: 0.0000000000, propagate_forward_time: 18.1782817841, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9300136566
validation[          , genome  6969] predictions:    9717/  10000 (97.17%), best:    9773/10000 (97.73%), error:       952.95337, best error:       791.72546 on epoch:    48, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 116.4788894653s, input_fired_time: 1.2228641510, output_fired_time: 1.0666568279, propagate_forward_time: 43.2873497009, propagate_backward_time: 68.0883407593, weight_update_time: 0.1323988885, other_time: 2.8136825562
epoch time: 10.0280523300s, input_fired_time: 0.1512844115, output_fired_time: 0.0000000000, propagate_forward_time: 9.3864746094, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4902935028
validation[          , genome  6969] predictions:    9735/  10000 (97.35%), best:    9773/10000 (97.73%), error:       867.37451, best error:       791.72546 on epoch:    48, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 117.2184219360s, input_fired_time: 1.3228186369, output_fired_time: 1.0564768314, propagate_forward_time: 43.6626586914, propagate_backward_time: 68.4562606812, weight_update_time: 0.1316503435, other_time: 2.7202072144
epoch time: 11.1641845703s, input_fired_time: 0.1629879177, output_fired_time: 0.0000000000, propagate_forward_time: 10.4708309174, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5303659439
validation[          , genome  6969] predictions:    9744/  10000 (97.44%), best:    9773/10000 (97.73%), error:       822.59558, best error:       791.72546 on epoch:    48, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 118.7086334229s, input_fired_time: 1.3063579798, output_fired_time: 1.0365437269, propagate_forward_time: 44.0921058655, propagate_backward_time: 69.5036773682, weight_update_time: 0.1291385293, other_time: 2.7699432373
epoch time: 8.6237382889s, input_fired_time: 0.1469462216, output_fired_time: 0.0000000000, propagate_forward_time: 8.0025892258, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4742031097
validation[          , genome  6969] predictions:    9737/  10000 (97.37%), best:    9773/10000 (97.73%), error:       861.90814, best error:       791.72546 on epoch:    48, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 119.2095489502s, input_fired_time: 1.2506326437, output_fired_time: 1.0987730026, propagate_forward_time: 44.4481887817, propagate_backward_time: 69.6298141479, weight_update_time: 0.1354161501, other_time: 2.7821426392
epoch time: 9.1362466812s, input_fired_time: 0.1496905535, output_fired_time: 0.0000000000, propagate_forward_time: 8.5047369003, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4818191528
validation[          , genome  6969] predictions:    9677/  10000 (96.77%), best:    9773/10000 (97.73%), error:      1007.85297, best error:       791.72546 on epoch:    48, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 121.6932296753s, input_fired_time: 1.2385123968, output_fired_time: 1.1896405220, propagate_forward_time: 45.3099594116, propagate_backward_time: 71.0696640015, weight_update_time: 0.1340035498, other_time: 2.8854522705
epoch time: 9.6468191147s, input_fired_time: 0.1603106409, output_fired_time: 0.0000000000, propagate_forward_time: 8.9716205597, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5148878098
validation[          , genome  6969] predictions:    9735/  10000 (97.35%), best:    9773/10000 (97.73%), error:       879.08600, best error:       791.72546 on epoch:    48, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 121.5358047485s, input_fired_time: 1.3502652645, output_fired_time: 1.2176846266, propagate_forward_time: 45.1863861084, propagate_backward_time: 70.7249832153, weight_update_time: 0.1318398714, other_time: 3.0564880371
epoch time: 10.9931097031s, input_fired_time: 0.2448835373, output_fired_time: 0.0000000000, propagate_forward_time: 10.2612934113, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4869327545
validation[          , genome  6969] predictions:    9762/  10000 (97.62%), best:    9773/10000 (97.73%), error:       825.92340, best error:       791.72546 on epoch:    48, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 125.0725326538s, input_fired_time: 1.4337918758, output_fired_time: 1.3222755194, propagate_forward_time: 46.0856933594, propagate_backward_time: 73.2420043945, weight_update_time: 0.1277284771, other_time: 2.9887695313
epoch time: 9.4101448059s, input_fired_time: 0.1555940211, output_fired_time: 0.0000000000, propagate_forward_time: 8.7564620972, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4980888367
validation[          , genome  6969] predictions:    9702/  10000 (97.02%), best:    9773/10000 (97.73%), error:       949.75000, best error:       791.72546 on epoch:    48, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 119.4209594727s, input_fired_time: 1.3177396059, output_fired_time: 1.0768551826, propagate_forward_time: 44.3902587891, propagate_backward_time: 69.8762207031, weight_update_time: 0.1338734925, other_time: 2.7598800659
epoch time: 8.8959770203s, input_fired_time: 0.1512429714, output_fired_time: 0.0000000000, propagate_forward_time: 8.2592964172, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4854373932
validation[          , genome  6969] predictions:    9731/  10000 (97.31%), best:    9773/10000 (97.73%), error:       908.71423, best error:       791.72546 on epoch:    48, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 115.9735183716s, input_fired_time: 1.2177131176, output_fired_time: 1.0439251661, propagate_forward_time: 43.2941017151, propagate_backward_time: 67.7134399414, weight_update_time: 0.1306437999, other_time: 2.7043457031
epoch time: 9.7542285919s, input_fired_time: 0.1511221528, output_fired_time: 0.0000000000, propagate_forward_time: 9.1234693527, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4796371460
validation[          , genome  6969] predictions:    9739/  10000 (97.39%), best:    9773/10000 (97.73%), error:       890.42487, best error:       791.72546 on epoch:    48, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 118.1801376343s, input_fired_time: 1.2221604586, output_fired_time: 1.0550276041, propagate_forward_time: 44.0183677673, propagate_backward_time: 69.1777725220, weight_update_time: 0.1312305480, other_time: 2.7068099976
epoch time: 10.0340938568s, input_fired_time: 0.1516397595, output_fired_time: 0.0000000000, propagate_forward_time: 9.3959178925, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4865360260
validation[          , genome  6969] predictions:    9757/  10000 (97.57%), best:    9773/10000 (97.73%), error:       798.28265, best error:       791.72546 on epoch:    48, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 118.9510192871s, input_fired_time: 1.2172001600, output_fired_time: 1.0479098558, propagate_forward_time: 44.4759559631, propagate_backward_time: 69.2581176758, weight_update_time: 0.1305905581, other_time: 2.9518280029
epoch time: 10.4707412720s, input_fired_time: 0.1614877433, output_fired_time: 0.0000000000, propagate_forward_time: 9.5998325348, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7094211578
validation[          , genome  6969] predictions:    9700/  10000 (97.00%), best:    9773/10000 (97.73%), error:       975.73334, best error:       791.72546 on epoch:    48, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 116.5002670288s, input_fired_time: 1.2221621275, output_fired_time: 1.0515481234, propagate_forward_time: 43.2854614258, propagate_backward_time: 68.1431121826, weight_update_time: 0.1308890432, other_time: 2.7979812622
epoch time: 9.8662805557s, input_fired_time: 0.1463527679, output_fired_time: 0.0000000000, propagate_forward_time: 9.1559820175, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5639457703
validation[          , genome  6969] predictions:    9716/  10000 (97.16%), best:    9773/10000 (97.73%), error:       962.94415, best error:       791.72546 on epoch:    48, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 119.8038787842s, input_fired_time: 1.2092723846, output_fired_time: 1.1522870064, propagate_forward_time: 44.5026130676, propagate_backward_time: 69.8860397339, weight_update_time: 0.1290668845, other_time: 3.0536575317
epoch time: 9.2092313766s, input_fired_time: 0.2447023839, output_fired_time: 0.0000000000, propagate_forward_time: 8.4854345322, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4790945053
validation[          , genome  6969] predictions:    9723/  10000 (97.23%), best:    9773/10000 (97.73%), error:       933.55768, best error:       791.72546 on epoch:    48, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 118.5413818359s, input_fired_time: 1.2205829620, output_fired_time: 1.1490585804, propagate_forward_time: 44.0623893738, propagate_backward_time: 69.1131668091, weight_update_time: 0.1313421428, other_time: 2.9961929321
epoch time: 9.4253406525s, input_fired_time: 0.1526914090, output_fired_time: 0.0000000000, propagate_forward_time: 8.7767953873, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4958534241
validation[          , genome  6969] predictions:    9707/  10000 (97.07%), best:    9773/10000 (97.73%), error:       922.89166, best error:       791.72546 on epoch:    48, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 118.5657958984s, input_fired_time: 1.2952450514, output_fired_time: 1.0615882874, propagate_forward_time: 44.3122901917, propagate_backward_time: 69.1329498291, weight_update_time: 0.1318695545, other_time: 2.7637329102
epoch time: 9.9009675980s, input_fired_time: 0.1635787785, output_fired_time: 0.0000000000, propagate_forward_time: 9.1971607208, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5402278900
validation[          , genome  6969] predictions:    9770/  10000 (97.70%), best:    9773/10000 (97.73%), error:       798.93060, best error:       791.72546 on epoch:    48, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 122.7467117310s, input_fired_time: 1.3801231384, output_fired_time: 1.1498297453, propagate_forward_time: 45.5908203125, propagate_backward_time: 71.7299575806, weight_update_time: 0.1333522350, other_time: 2.8959884644
epoch time: 10.0449056625s, input_fired_time: 0.1628967971, output_fired_time: 0.0000000000, propagate_forward_time: 9.3666162491, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5153923035
validation[          , genome  6969] predictions:    9717/  10000 (97.17%), best:    9773/10000 (97.73%), error:       921.14905, best error:       791.72546 on epoch:    48, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 131.9167633057s, input_fired_time: 1.3278925419, output_fired_time: 1.1750042439, propagate_forward_time: 49.5923194885, propagate_backward_time: 76.8216323853, weight_update_time: 0.1816575825, other_time: 2.9999160767
epoch time: 16.3869686127s, input_fired_time: 0.1729193181, output_fired_time: 0.0000000000, propagate_forward_time: 15.3657388687, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8483095169
validation[          , genome  6969] predictions:    9696/  10000 (96.96%), best:    9773/10000 (97.73%), error:      1014.83594, best error:       791.72546 on epoch:    48, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 193.0479583740s, input_fired_time: 1.8190631866, output_fired_time: 1.9801081419, propagate_forward_time: 72.9882583618, propagate_backward_time: 112.3694381714, weight_update_time: 0.1480831355, other_time: 3.8910980225
epoch time: 16.3366832733s, input_fired_time: 0.1837053001, output_fired_time: 0.0000000000, propagate_forward_time: 14.7137889862, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4391899109
validation[          , genome  6969] predictions:    9723/  10000 (97.23%), best:    9773/10000 (97.73%), error:       874.14551, best error:       791.72546 on epoch:    48, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 187.9956512451s, input_fired_time: 2.4444894791, output_fired_time: 1.5766386986, propagate_forward_time: 70.6566619873, propagate_backward_time: 108.8179931641, weight_update_time: 0.1482372433, other_time: 4.4998626709
epoch time: 14.9129972458s, input_fired_time: 0.4223933816, output_fired_time: 0.0000000000, propagate_forward_time: 13.6086721420, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8819313049
validation[          , genome  6969] predictions:    9751/  10000 (97.51%), best:    9773/10000 (97.73%), error:       792.48737, best error:       791.72546 on epoch:    48, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 184.3049926758s, input_fired_time: 1.4293923378, output_fired_time: 1.8114727736, propagate_forward_time: 70.0117111206, propagate_backward_time: 106.8710327148, weight_update_time: 0.1950165033, other_time: 4.1813735962
epoch time: 14.0899753571s, input_fired_time: 0.4223087132, output_fired_time: 0.0000000000, propagate_forward_time: 13.1188049316, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5488615036
validation[          , genome  6969] predictions:    9654/  10000 (96.54%), best:    9773/10000 (97.73%), error:      1094.35364, best error:       791.72546 on epoch:    48, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 184.8455505371s, input_fired_time: 1.6825791597, output_fired_time: 1.4474723339, propagate_forward_time: 69.6895065308, propagate_backward_time: 107.8069763184, weight_update_time: 0.3981087208, other_time: 4.2190017700
epoch time: 15.5168218613s, input_fired_time: 0.4708975255, output_fired_time: 0.0000000000, propagate_forward_time: 14.4950151443, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5509090424
validation[          , genome  6969] predictions:    9763/  10000 (97.63%), best:    9773/10000 (97.73%), error:       828.89453, best error:       791.72546 on epoch:    48, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 184.9410705566s, input_fired_time: 1.6566246748, output_fired_time: 1.7157055140, propagate_forward_time: 68.0579605103, propagate_backward_time: 108.6934661865, weight_update_time: 0.1479521245, other_time: 4.8173141479
epoch time: 15.2505712509s, input_fired_time: 0.4400578737, output_fired_time: 0.0000000000, propagate_forward_time: 14.2300081253, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5805053711
validation[          , genome  6969] predictions:    9715/  10000 (97.15%), best:    9773/10000 (97.73%), error:       916.69702, best error:       791.72546 on epoch:    48, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 184.3533325195s, input_fired_time: 1.9277247190, output_fired_time: 1.5592565536, propagate_forward_time: 68.1387481689, propagate_backward_time: 108.5089187622, weight_update_time: 0.1796269119, other_time: 4.2186965942
epoch time: 14.4012823105s, input_fired_time: 0.6885126233, output_fired_time: 0.0000000000, propagate_forward_time: 12.8972225189, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8155469894
validation[          , genome  6969] predictions:    9743/  10000 (97.43%), best:    9773/10000 (97.73%), error:       806.23083, best error:       791.72546 on epoch:    48, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 181.2665710449s, input_fired_time: 1.6080541611, output_fired_time: 1.9474016428, propagate_forward_time: 65.4652328491, propagate_backward_time: 106.7576065063, weight_update_time: 0.1479152292, other_time: 5.4882812500
epoch time: 14.2366943359s, input_fired_time: 0.4233033657, output_fired_time: 0.0000000000, propagate_forward_time: 13.2369480133, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5764427185
validation[          , genome  6969] predictions:    9733/  10000 (97.33%), best:    9773/10000 (97.73%), error:       890.68970, best error:       791.72546 on epoch:    48, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 179.3706817627s, input_fired_time: 2.6836357117, output_fired_time: 2.2842535973, propagate_forward_time: 66.6660614014, propagate_backward_time: 103.8487777710, weight_update_time: 0.1482597589, other_time: 3.8879470825
epoch time: 14.4405136108s, input_fired_time: 0.4228630960, output_fired_time: 0.0000000000, propagate_forward_time: 13.4054222107, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6122283936
validation[          , genome  6969] predictions:    9746/  10000 (97.46%), best:    9773/10000 (97.73%), error:       864.53967, best error:       791.72546 on epoch:    48, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 178.4505157471s, input_fired_time: 1.4065235853, output_fired_time: 1.5295349360, propagate_forward_time: 67.9791412354, propagate_backward_time: 103.7516784668, weight_update_time: 0.1498490274, other_time: 3.7836303711
epoch time: 14.5791702271s, input_fired_time: 0.1734958142, output_fired_time: 0.0000000000, propagate_forward_time: 13.8550729752, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5506010056
validation[          , genome  6969] predictions:    9772/  10000 (97.72%), best:    9772/10000 (97.72%), error:       770.22632, best error:       770.22632 on epoch:    80, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 181.3452758789s, input_fired_time: 1.9781371355, output_fired_time: 1.4648385048, propagate_forward_time: 67.8084793091, propagate_backward_time: 106.6773910522, weight_update_time: 0.1478778273, other_time: 3.4164276123
epoch time: 14.9924049377s, input_fired_time: 0.1737026870, output_fired_time: 0.0000000000, propagate_forward_time: 14.2334928513, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5852098465
validation[          , genome  6969] predictions:    9729/  10000 (97.29%), best:    9772/10000 (97.72%), error:       885.69470, best error:       770.22632 on epoch:    80, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 180.2489166260s, input_fired_time: 1.4199750423, output_fired_time: 2.0288975239, propagate_forward_time: 67.6941833496, propagate_backward_time: 104.3630294800, weight_update_time: 0.1479428858, other_time: 4.7428359985
epoch time: 14.9440174103s, input_fired_time: 0.1736750156, output_fired_time: 0.0000000000, propagate_forward_time: 13.4551248550, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3152179718
validation[          , genome  6969] predictions:    9770/  10000 (97.70%), best:    9772/10000 (97.72%), error:       790.41107, best error:       770.22632 on epoch:    80, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 181.7251129150s, input_fired_time: 1.5923051834, output_fired_time: 1.7625586987, propagate_forward_time: 68.2539596558, propagate_backward_time: 106.2660751343, weight_update_time: 0.1950332671, other_time: 3.8502197266
epoch time: 14.9207477570s, input_fired_time: 0.4236807227, output_fired_time: 0.0000000000, propagate_forward_time: 13.4317836761, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0652837753
validation[          , genome  6969] predictions:    9765/  10000 (97.65%), best:    9765/10000 (97.65%), error:       765.74255, best error:       765.74255 on epoch:    83, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 182.3629913330s, input_fired_time: 2.4099998474, output_fired_time: 1.9898420572, propagate_forward_time: 67.9714813232, propagate_backward_time: 106.0707092285, weight_update_time: 0.1481410265, other_time: 3.9209594727
epoch time: 16.2374000549s, input_fired_time: 0.1745771468, output_fired_time: 0.0000000000, propagate_forward_time: 15.3706426620, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6921796799
validation[          , genome  6969] predictions:    9767/  10000 (97.67%), best:    9765/10000 (97.65%), error:       794.81531, best error:       765.74255 on epoch:    83, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 190.3733978271s, input_fired_time: 1.9316488504, output_fired_time: 1.9983328581, propagate_forward_time: 70.4337158203, propagate_backward_time: 110.9636611938, weight_update_time: 0.1950859874, other_time: 5.0460281372
epoch time: 14.9363536835s, input_fired_time: 0.6743336916, output_fired_time: 0.0000000000, propagate_forward_time: 13.4467878342, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8152322769
validation[          , genome  6969] predictions:    9743/  10000 (97.43%), best:    9765/10000 (97.65%), error:       826.04712, best error:       765.74255 on epoch:    83, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 184.6611633301s, input_fired_time: 1.6355549097, output_fired_time: 1.7635614872, propagate_forward_time: 68.7892303467, propagate_backward_time: 107.9364089966, weight_update_time: 0.1480093747, other_time: 4.5363998413
epoch time: 15.2900896072s, input_fired_time: 0.2043612152, output_fired_time: 0.0000000000, propagate_forward_time: 14.4849357605, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6007928848
validation[          , genome  6969] predictions:    9719/  10000 (97.19%), best:    9765/10000 (97.65%), error:       920.57556, best error:       765.74255 on epoch:    83, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 191.7312316895s, input_fired_time: 1.6936643124, output_fired_time: 1.7031474113, propagate_forward_time: 72.6055297852, propagate_backward_time: 111.2421188354, weight_update_time: 0.1481195390, other_time: 4.4867782593
epoch time: 15.6414642334s, input_fired_time: 0.1736832708, output_fired_time: 0.0000000000, propagate_forward_time: 14.3728866577, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0948944092
validation[          , genome  6969] predictions:    9733/  10000 (97.33%), best:    9765/10000 (97.65%), error:       900.66187, best error:       765.74255 on epoch:    83, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 207.0291290283s, input_fired_time: 2.7257776260, output_fired_time: 1.9356628656, propagate_forward_time: 78.8422164917, propagate_backward_time: 119.1540451050, weight_update_time: 0.1479602605, other_time: 4.3714141846
epoch time: 15.2891159058s, input_fired_time: 0.1735009253, output_fired_time: 0.0000000000, propagate_forward_time: 14.3160009384, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7996139526
validation[          , genome  6969] predictions:    9767/  10000 (97.67%), best:    9765/10000 (97.65%), error:       817.69263, best error:       765.74255 on epoch:    83, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 209.6255340576s, input_fired_time: 1.9096463919, output_fired_time: 1.9959828854, propagate_forward_time: 79.9954681396, propagate_backward_time: 121.8320617676, weight_update_time: 0.1481650323, other_time: 3.8923645020
epoch time: 16.4381999969s, input_fired_time: 0.1734866202, output_fired_time: 0.0000000000, propagate_forward_time: 15.3236436844, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9410696030
validation[          , genome  6969] predictions:    9724/  10000 (97.24%), best:    9765/10000 (97.65%), error:       905.23993, best error:       765.74255 on epoch:    83, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 189.1972808838s, input_fired_time: 2.2430849075, output_fired_time: 1.4507888556, propagate_forward_time: 71.3855972290, propagate_backward_time: 109.3720092773, weight_update_time: 0.1486514807, other_time: 4.7457962036
epoch time: 15.8495941162s, input_fired_time: 0.1751501113, output_fired_time: 0.0000000000, propagate_forward_time: 14.8279075623, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8465366364
validation[          , genome  6969] predictions:    9744/  10000 (97.44%), best:    9765/10000 (97.65%), error:       868.46533, best error:       765.74255 on epoch:    83, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 179.3919677734s, input_fired_time: 1.9173938036, output_fired_time: 1.2007490396, propagate_forward_time: 68.2401504517, propagate_backward_time: 104.3758087158, weight_update_time: 0.1481804252, other_time: 3.6578750610
epoch time: 14.7579517365s, input_fired_time: 0.2058977336, output_fired_time: 0.0000000000, propagate_forward_time: 14.0035123825, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5485420227
validation[          , genome  6969] predictions:    9738/  10000 (97.38%), best:    9765/10000 (97.65%), error:       904.33313, best error:       765.74255 on epoch:    83, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 180.7498321533s, input_fired_time: 2.1330363750, output_fired_time: 2.4834122658, propagate_forward_time: 68.3278121948, propagate_backward_time: 104.0259017944, weight_update_time: 0.1481430233, other_time: 3.7796630859
epoch time: 14.3611917496s, input_fired_time: 0.1738225222, output_fired_time: 0.0000000000, propagate_forward_time: 13.3347263336, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8526430130
validation[          , genome  6969] predictions:    9659/  10000 (96.59%), best:    9765/10000 (97.65%), error:      1088.21155, best error:       765.74255 on epoch:    83, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 176.7557830811s, input_fired_time: 1.8496232033, output_fired_time: 1.5307049751, propagate_forward_time: 66.9531402588, propagate_backward_time: 102.8949279785, weight_update_time: 0.1480191946, other_time: 3.5273895264
epoch time: 15.6611948013s, input_fired_time: 0.4246053696, output_fired_time: 0.0000000000, propagate_forward_time: 14.1359710693, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1006183624
validation[          , genome  6969] predictions:    9752/  10000 (97.52%), best:    9765/10000 (97.65%), error:       828.26996, best error:       765.74255 on epoch:    83, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 179.4382781982s, input_fired_time: 1.8665741682, output_fired_time: 1.4869279861, propagate_forward_time: 68.4861831665, propagate_backward_time: 102.9994506836, weight_update_time: 0.1482300907, other_time: 4.5991439819
epoch time: 14.8054733276s, input_fired_time: 0.4252116382, output_fired_time: 0.0000000000, propagate_forward_time: 13.7837085724, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5965528488
validation[          , genome  6969] predictions:    9737/  10000 (97.37%), best:    9765/10000 (97.65%), error:       899.95825, best error:       765.74255 on epoch:    83, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 177.9618988037s, input_fired_time: 2.1820764542, output_fired_time: 1.9682475328, propagate_forward_time: 66.4219055176, propagate_backward_time: 103.5639343262, weight_update_time: 0.1481087655, other_time: 3.8257293701
epoch time: 14.6151542664s, input_fired_time: 0.1753626168, output_fired_time: 0.0000000000, propagate_forward_time: 13.6414442062, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7983474731
validation[          , genome  6969] predictions:    9770/  10000 (97.70%), best:    9765/10000 (97.65%), error:       807.11584, best error:       765.74255 on epoch:    83, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 179.9652404785s, input_fired_time: 1.9803632498, output_fired_time: 1.4829187393, propagate_forward_time: 66.1217575073, propagate_backward_time: 105.7644119263, weight_update_time: 0.3980578482, other_time: 4.6157836914
epoch time: 14.8793649673s, input_fired_time: 0.1750210673, output_fired_time: 0.0000000000, propagate_forward_time: 14.1389465332, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5653972626
validation[          , genome  6969] predictions:    9699/  10000 (96.99%), best:    9765/10000 (97.65%), error:       972.11792, best error:       765.74255 on epoch:    83, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 164.1007232666s, input_fired_time: 1.6716803312, output_fired_time: 1.4026640654, propagate_forward_time: 62.1270256042, propagate_backward_time: 94.7344589233, weight_update_time: 0.1426528692, other_time: 4.1648941040
epoch time: 9.0465679169s, input_fired_time: 0.1527907252, output_fired_time: 0.0000000000, propagate_forward_time: 8.4179964066, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4757804871
validation[          , genome  6969] predictions:    9771/  10000 (97.71%), best:    9765/10000 (97.65%), error:       781.43939, best error:       765.74255 on epoch:    83, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 114.3932418823s, input_fired_time: 1.2521259785, output_fired_time: 1.1495927572, propagate_forward_time: 42.3011283875, propagate_backward_time: 66.9740524292, weight_update_time: 0.1275241524, other_time: 2.7163467407
epoch time: 8.7806415558s, input_fired_time: 0.1509086043, output_fired_time: 0.0000000000, propagate_forward_time: 8.1570701599, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4726629257
validation[          , genome  6969] predictions:    9735/  10000 (97.35%), best:    9765/10000 (97.65%), error:       849.72272, best error:       765.74255 on epoch:    83, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 109.6715011597s, input_fired_time: 1.2620621920, output_fired_time: 1.0197821856, propagate_forward_time: 40.5226249695, propagate_backward_time: 64.2302627563, weight_update_time: 0.1268113554, other_time: 2.6367721558
epoch time: 9.7671556473s, input_fired_time: 0.1813771725, output_fired_time: 0.0000000000, propagate_forward_time: 9.0431280136, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5426502228
validation[          , genome  6969] predictions:    9778/  10000 (97.78%), best:    9778/10000 (97.78%), error:       757.08936, best error:       757.08936 on epoch:    99, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 110.7368011475s, input_fired_time: 1.2377457619, output_fired_time: 1.0198045969, propagate_forward_time: 40.9980125427, propagate_backward_time: 64.8001174927, weight_update_time: 0.1295670867, other_time: 2.6811141968
epoch time: 9.3924732208s, input_fired_time: 0.2015927583, output_fired_time: 0.0000000000, propagate_forward_time: 8.7117643356, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4791164398
validation[          , genome  6969] predictions:    9750/  10000 (97.50%), best:    9778/10000 (97.78%), error:       835.27222, best error:       757.08936 on epoch:    99, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 44.9720306396s, input_fired_time: 0.7765803337, output_fired_time: 0.0000000000, propagate_forward_time: 41.6707191467, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5247306824
best training[          , genome  6969] predictions:   49679/  50000 (99.36%), best:    9778/10000 (97.78%), error:      1438.66663, best error:       757.08936 on epoch:    99, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 8.5780467987s, input_fired_time: 0.1509193778, output_fired_time: 0.0000000000, propagate_forward_time: 7.9574661255, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4696617126
   testing[          , genome  6969] predictions:    9789/  10000 (97.89%), best:    9778/10000 (97.78%), error:       692.67914, best error:       757.08936 on epoch:    99, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
17:56:34 (11104): called boinc_finish(0)

</stderr_txt>
]]>