Nameexact_genome_1512568488_44_6564_0
Workunit2604172
Created7 Dec 2017, 20:40:06 UTC
Sent7 Dec 2017, 20:48:34 UTC
Report deadline16 Dec 2017, 19:46:47 UTC
Received9 Dec 2017, 13:49:11 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID62426
Run time5 hours 52 min 19 sec
CPU time5 hours 30 min 43 sec
Validate stateValid
Credit2,239.28
Device peak FLOPS2.98 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size155.80 MB
Peak swap size154.14 MB
Peak disk usage1.94 MB

Stderr output

<core_client_version>7.6.22</core_client_version>
<![CDATA[
<stderr_txt>
     885.68207 on epoch:    13, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 191.4117736816s, input_fired_time: 2.4524261951, output_fired_time: 2.9861388206, propagate_forward_time: 71.7741241455, propagate_backward_time: 110.4004592896, weight_update_time: 0.2070900053, other_time: 3.7986221313
epoch time: 14.6914443970s, input_fired_time: 0.2912001610, output_fired_time: 0.0000000000, propagate_forward_time: 13.7412014008, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6590423584
validation[          , genome  6564] predictions:    9700/  10000 (97.00%), best:    9736/10000 (97.36%), error:       987.48755, best error:       885.68207 on epoch:    13, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 193.2528991699s, input_fired_time: 2.5772259235, output_fired_time: 2.7741842270, propagate_forward_time: 72.3975448608, propagate_backward_time: 111.6362533569, weight_update_time: 0.2082988769, other_time: 3.8676910400
epoch time: 16.2849159241s, input_fired_time: 0.3030571043, output_fired_time: 0.0000000000, propagate_forward_time: 15.2333784103, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7484807968
validation[          , genome  6564] predictions:    9728/  10000 (97.28%), best:    9736/10000 (97.36%), error:       951.07043, best error:       885.68207 on epoch:    13, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 185.6760711670s, input_fired_time: 2.4343154430, output_fired_time: 2.7335948944, propagate_forward_time: 69.4531555176, propagate_backward_time: 107.2339935303, weight_update_time: 0.2075374126, other_time: 3.8210144043
epoch time: 14.7335987091s, input_fired_time: 0.2936623096, output_fired_time: 0.0000000000, propagate_forward_time: 13.7683820724, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6715545654
validation[          , genome  6564] predictions:    9580/  10000 (95.80%), best:    9736/10000 (97.36%), error:      1305.87183, best error:       885.68207 on epoch:    13, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 180.1696929932s, input_fired_time: 2.3704271317, output_fired_time: 2.6451227665, propagate_forward_time: 67.7773437500, propagate_backward_time: 103.7164535522, weight_update_time: 0.2051886767, other_time: 3.6603469849
epoch time: 16.4501838684s, input_fired_time: 0.3027164340, output_fired_time: 0.0000000000, propagate_forward_time: 15.4370212555, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7104454041
validation[          , genome  6564] predictions:    9708/  10000 (97.08%), best:    9736/10000 (97.36%), error:       915.86444, best error:       885.68207 on epoch:    13, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 196.0008544922s, input_fired_time: 2.4414021969, output_fired_time: 2.7397820950, propagate_forward_time: 78.4266357422, propagate_backward_time: 108.6437606812, weight_update_time: 0.2069510967, other_time: 3.7492752075
epoch time: 17.4295864105s, input_fired_time: 0.3938215971, output_fired_time: 0.0000000000, propagate_forward_time: 16.2761917114, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7595729828
validation[          , genome  6564] predictions:    9724/  10000 (97.24%), best:    9736/10000 (97.36%), error:       918.51270, best error:       885.68207 on epoch:    13, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 198.8297119141s, input_fired_time: 2.5009343624, output_fired_time: 2.9328885078, propagate_forward_time: 78.4346008301, propagate_backward_time: 111.1993713379, weight_update_time: 0.2394531071, other_time: 3.7619171143
epoch time: 14.5636405945s, input_fired_time: 0.2899852693, output_fired_time: 0.0000000000, propagate_forward_time: 13.6067934036, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6668615341
validation[          , genome  6564] predictions:    9703/  10000 (97.03%), best:    9736/10000 (97.36%), error:       963.28131, best error:       885.68207 on epoch:    13, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 185.3422393799s, input_fired_time: 2.4407885075, output_fired_time: 2.7756586075, propagate_forward_time: 69.0732421875, propagate_backward_time: 107.2543563843, weight_update_time: 0.2058959752, other_time: 3.7981796265
epoch time: 22.3538799286s, input_fired_time: 0.4528083801, output_fired_time: 0.0000000000, propagate_forward_time: 20.8714981079, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0295734406
validation[          , genome  6564] predictions:    9700/  10000 (97.00%), best:    9736/10000 (97.36%), error:       957.14893, best error:       885.68207 on epoch:    13, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 184.1229858398s, input_fired_time: 2.4168474674, output_fired_time: 2.7051999569, propagate_forward_time: 68.9631652832, propagate_backward_time: 106.3253555298, weight_update_time: 0.2080609500, other_time: 3.7124099731
epoch time: 16.6043128967s, input_fired_time: 0.3260609210, output_fired_time: 0.0000000000, propagate_forward_time: 15.5495710373, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7286806107
validation[          , genome  6564] predictions:    9655/  10000 (96.55%), best:    9736/10000 (97.36%), error:      1120.34949, best error:       885.68207 on epoch:    13, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 185.7668609619s, input_fired_time: 2.5293123722, output_fired_time: 2.7057871819, propagate_forward_time: 69.6725845337, propagate_backward_time: 107.1379318237, weight_update_time: 0.2086846083, other_time: 3.7212524414
epoch time: 18.2986431122s, input_fired_time: 0.4201553166, output_fired_time: 0.0000000000, propagate_forward_time: 17.1198863983, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7586021423
validation[          , genome  6564] predictions:    9729/  10000 (97.29%), best:    9729/10000 (97.29%), error:       885.64923, best error:       885.64923 on epoch:    23, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 189.6970825195s, input_fired_time: 2.4387869835, output_fired_time: 2.6860113144, propagate_forward_time: 75.1216354370, propagate_backward_time: 105.7389907837, weight_update_time: 0.2076001316, other_time: 3.7116699219
epoch time: 19.2478008270s, input_fired_time: 0.3587524891, output_fired_time: 0.0000000000, propagate_forward_time: 17.9966697693, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8923778534
validation[          , genome  6564] predictions:    9728/  10000 (97.28%), best:    9729/10000 (97.29%), error:       925.73853, best error:       885.64923 on epoch:    23, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 162.9741668701s, input_fired_time: 2.2398836613, output_fired_time: 2.5339047909, propagate_forward_time: 58.7954521179, propagate_backward_time: 95.5321426392, weight_update_time: 0.2326225042, other_time: 3.8727798462
epoch time: 16.3001632690s, input_fired_time: 0.2952921987, output_fired_time: 0.0000000000, propagate_forward_time: 15.3099021912, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6949691772
validation[          , genome  6564] predictions:    9734/  10000 (97.34%), best:    9734/10000 (97.34%), error:       870.18469, best error:       870.18469 on epoch:    25, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 185.0416870117s, input_fired_time: 2.4369049072, output_fired_time: 2.7310819626, propagate_forward_time: 69.5144882202, propagate_backward_time: 106.6695480347, weight_update_time: 0.2105496228, other_time: 3.6896667480
epoch time: 16.2140941620s, input_fired_time: 0.3247681856, output_fired_time: 0.0000000000, propagate_forward_time: 15.1634044647, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7259216309
validation[          , genome  6564] predictions:    9703/  10000 (97.03%), best:    9734/10000 (97.34%), error:      1014.73761, best error:       870.18469 on epoch:    25, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 185.7258605957s, input_fired_time: 2.4448425770, output_fired_time: 2.7703115940, propagate_forward_time: 69.6887817383, propagate_backward_time: 107.1340026855, weight_update_time: 0.2115143389, other_time: 3.6879272461
epoch time: 17.7464008331s, input_fired_time: 0.3322793543, output_fired_time: 0.0000000000, propagate_forward_time: 16.5489788055, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8651428223
validation[          , genome  6564] predictions:    9737/  10000 (97.37%), best:    9734/10000 (97.34%), error:       908.81488, best error:       870.18469 on epoch:    25, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 196.9811859131s, input_fired_time: 2.6175403595, output_fired_time: 2.9732577801, propagate_forward_time: 73.8089675903, propagate_backward_time: 113.6136474609, weight_update_time: 0.2394445240, other_time: 3.9677810669
epoch time: 14.7674303055s, input_fired_time: 0.2967265248, output_fired_time: 0.0000000000, propagate_forward_time: 13.7955074310, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6751966476
validation[          , genome  6564] predictions:    9699/  10000 (96.99%), best:    9734/10000 (97.34%), error:       951.41876, best error:       870.18469 on epoch:    25, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 194.5245361328s, input_fired_time: 2.5315999985, output_fired_time: 2.9859826565, propagate_forward_time: 72.6960144043, propagate_backward_time: 112.3542404175, weight_update_time: 0.2068364173, other_time: 3.9567031860
epoch time: 14.9766626358s, input_fired_time: 0.2977489531, output_fired_time: 0.0000000000, propagate_forward_time: 14.0157909393, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6631231308
validation[          , genome  6564] predictions:    9705/  10000 (97.05%), best:    9734/10000 (97.34%), error:       965.02838, best error:       870.18469 on epoch:    25, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 185.4573822021s, input_fired_time: 2.4409270287, output_fired_time: 2.7513804436, propagate_forward_time: 69.3817291260, propagate_backward_time: 107.1449890137, weight_update_time: 0.2074876577, other_time: 3.7383575439
epoch time: 20.6996936798s, input_fired_time: 0.3975017965, output_fired_time: 0.0000000000, propagate_forward_time: 19.3816452026, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9205474854
validation[          , genome  6564] predictions:    9717/  10000 (97.17%), best:    9717/10000 (97.17%), error:       866.89063, best error:       866.89063 on epoch:    30, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 185.2690124512s, input_fired_time: 2.5177361965, output_fired_time: 2.7356703281, propagate_forward_time: 69.2517776489, propagate_backward_time: 107.0124969482, weight_update_time: 0.2076933086, other_time: 3.7513351440
epoch time: 18.8031272888s, input_fired_time: 0.3913531005, output_fired_time: 0.0000000000, propagate_forward_time: 17.6779289246, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7338447571
validation[          , genome  6564] predictions:    9747/  10000 (97.47%), best:    9717/10000 (97.17%), error:       897.06146, best error:       866.89063 on epoch:    30, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 183.1584625244s, input_fired_time: 2.4052817822, output_fired_time: 2.6893861294, propagate_forward_time: 68.5744628906, propagate_backward_time: 105.7937088013, weight_update_time: 0.2075215727, other_time: 3.6956100464
epoch time: 15.5204172134s, input_fired_time: 0.3312076926, output_fired_time: 0.0000000000, propagate_forward_time: 14.5287704468, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6604394913
validation[          , genome  6564] predictions:    9714/  10000 (97.14%), best:    9717/10000 (97.17%), error:       910.46863, best error:       866.89063 on epoch:    30, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 204.4566497803s, input_fired_time: 2.4716136456, output_fired_time: 2.7308814526, propagate_forward_time: 68.5139541626, propagate_backward_time: 127.0367660522, weight_update_time: 0.2077953070, other_time: 3.7034378052
epoch time: 14.7571840286s, input_fired_time: 0.2978444397, output_fired_time: 0.0000000000, propagate_forward_time: 13.7920894623, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6672496796
validation[          , genome  6564] predictions:    9719/  10000 (97.19%), best:    9719/10000 (97.19%), error:       855.72565, best error:       855.72565 on epoch:    33, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 193.7140502930s, input_fired_time: 2.6228690147, output_fired_time: 2.7498388290, propagate_forward_time: 72.6258926392, propagate_backward_time: 111.6948318481, weight_update_time: 0.2100435793, other_time: 4.0206298828
epoch time: 21.1840896606s, input_fired_time: 0.3208640516, output_fired_time: 0.0000000000, propagate_forward_time: 19.8450927734, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0181331635
validation[          , genome  6564] predictions:    9780/  10000 (97.80%), best:    9780/10000 (97.80%), error:       766.43622, best error:       766.43622 on epoch:    34, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 184.7411346436s, input_fired_time: 2.5249261856, output_fired_time: 2.7563688755, propagate_forward_time: 68.9330062866, propagate_backward_time: 106.7340087891, weight_update_time: 0.2095415145, other_time: 3.7928237915
epoch time: 14.5816469193s, input_fired_time: 0.2924050987, output_fired_time: 0.0000000000, propagate_forward_time: 13.6265439987, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6626977921
validation[          , genome  6564] predictions:    9725/  10000 (97.25%), best:    9780/10000 (97.80%), error:       873.16162, best error:       766.43622 on epoch:    34, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 187.3103027344s, input_fired_time: 2.4656267166, output_fired_time: 2.7728364468, propagate_forward_time: 70.2046432495, propagate_backward_time: 108.0245590210, weight_update_time: 0.2102617621, other_time: 3.8426361084
epoch time: 14.7719221115s, input_fired_time: 0.3019781113, output_fired_time: 0.0000000000, propagate_forward_time: 13.8013219833, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6686220169
validation[          , genome  6564] predictions:    9699/  10000 (96.99%), best:    9780/10000 (97.80%), error:      1014.07648, best error:       766.43622 on epoch:    34, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 195.5008087158s, input_fired_time: 2.6018326283, output_fired_time: 2.9424436092, propagate_forward_time: 73.1985397339, propagate_backward_time: 112.8043365479, weight_update_time: 0.2385677397, other_time: 3.9536514282
epoch time: 19.2202434540s, input_fired_time: 0.3033782244, output_fired_time: 0.0000000000, propagate_forward_time: 18.1537933350, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7630710602
validation[          , genome  6564] predictions:    9718/  10000 (97.18%), best:    9780/10000 (97.80%), error:       929.50787, best error:       766.43622 on epoch:    34, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 187.1852416992s, input_fired_time: 2.4701743126, output_fired_time: 2.7351784706, propagate_forward_time: 70.6694946289, propagate_backward_time: 107.5784149170, weight_update_time: 0.2089339346, other_time: 3.7319793701
epoch time: 26.0497341156s, input_fired_time: 0.4576441348, output_fired_time: 0.0000000000, propagate_forward_time: 24.6020736694, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9900169373
validation[          , genome  6564] predictions:    9732/  10000 (97.32%), best:    9780/10000 (97.80%), error:       848.80609, best error:       766.43622 on epoch:    34, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 204.7756042480s, input_fired_time: 2.5453393459, output_fired_time: 2.7449257374, propagate_forward_time: 78.4668579102, propagate_backward_time: 116.8401489258, weight_update_time: 0.2129536718, other_time: 4.1783447266
epoch time: 15.0597162247s, input_fired_time: 0.3000352383, output_fired_time: 0.0000000000, propagate_forward_time: 14.0912580490, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6684226990
validation[          , genome  6564] predictions:    9741/  10000 (97.41%), best:    9780/10000 (97.80%), error:       881.27081, best error:       766.43622 on epoch:    34, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 193.0080566406s, input_fired_time: 2.5046479702, output_fired_time: 2.7470252514, propagate_forward_time: 70.5843353271, propagate_backward_time: 113.4060974121, weight_update_time: 0.2110935301, other_time: 3.7659454346
epoch time: 15.0471744537s, input_fired_time: 0.2986660004, output_fired_time: 0.0000000000, propagate_forward_time: 14.0766525269, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6718559265
validation[          , genome  6564] predictions:    9712/  10000 (97.12%), best:    9780/10000 (97.80%), error:       930.37213, best error:       766.43622 on epoch:    34, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 186.2124938965s, input_fired_time: 2.4904012680, output_fired_time: 2.7601289749, propagate_forward_time: 69.6644439697, propagate_backward_time: 107.4670181274, weight_update_time: 0.2072908431, other_time: 3.8304977417
epoch time: 20.6700458527s, input_fired_time: 0.3883461952, output_fired_time: 0.0000000000, propagate_forward_time: 19.3255271912, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9561729431
validation[          , genome  6564] predictions:    9715/  10000 (97.15%), best:    9780/10000 (97.80%), error:       912.43079, best error:       766.43622 on epoch:    34, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 184.6819915771s, input_fired_time: 2.4369356632, output_fired_time: 2.7142992020, propagate_forward_time: 69.2782745361, propagate_backward_time: 106.5564117432, weight_update_time: 0.2075164765, other_time: 3.6960754395
epoch time: 18.6973972321s, input_fired_time: 0.4617432058, output_fired_time: 0.0000000000, propagate_forward_time: 17.4079341888, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8277206421
validation[          , genome  6564] predictions:    9727/  10000 (97.27%), best:    9780/10000 (97.80%), error:       851.20599, best error:       766.43622 on epoch:    34, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 195.2596130371s, input_fired_time: 2.5852479935, output_fired_time: 2.8224127293, propagate_forward_time: 72.9264984131, propagate_backward_time: 112.9660720825, weight_update_time: 0.2086448967, other_time: 3.9593734741
epoch time: 15.6578283310s, input_fired_time: 0.2975975573, output_fired_time: 0.0000000000, propagate_forward_time: 14.6963968277, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6638336182
validation[          , genome  6564] predictions:    9665/  10000 (96.65%), best:    9780/10000 (97.80%), error:      1138.05493, best error:       766.43622 on epoch:    34, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 190.9272766113s, input_fired_time: 2.5748951435, output_fired_time: 2.8160972595, propagate_forward_time: 71.4043350220, propagate_backward_time: 110.2890243530, weight_update_time: 0.2412730902, other_time: 3.8429260254
epoch time: 20.7984848022s, input_fired_time: 0.3001538515, output_fired_time: 0.0000000000, propagate_forward_time: 19.8296279907, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6687030792
validation[          , genome  6564] predictions:    9731/  10000 (97.31%), best:    9780/10000 (97.80%), error:       856.91211, best error:       766.43622 on epoch:    34, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 207.1154174805s, input_fired_time: 2.5036256313, output_fired_time: 2.7755956650, propagate_forward_time: 90.0255126953, propagate_backward_time: 108.0909500122, weight_update_time: 0.2093537152, other_time: 3.7197341919
epoch time: 17.9206714630s, input_fired_time: 0.4008349776, output_fired_time: 0.0000000000, propagate_forward_time: 16.7175922394, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8022441864
validation[          , genome  6564] predictions:    9754/  10000 (97.54%), best:    9780/10000 (97.80%), error:       836.43719, best error:       766.43622 on epoch:    34, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 189.8048095703s, input_fired_time: 2.5456280708, output_fired_time: 2.8193798065, propagate_forward_time: 71.2678070068, propagate_backward_time: 109.3213958740, weight_update_time: 0.2405433208, other_time: 3.8506011963
epoch time: 22.2528190613s, input_fired_time: 0.2933820486, output_fired_time: 0.0000000000, propagate_forward_time: 21.1731605530, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7862758636
validation[          , genome  6564] predictions:    9737/  10000 (97.37%), best:    9780/10000 (97.80%), error:       876.92700, best error:       766.43622 on epoch:    34, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 200.2807159424s, input_fired_time: 2.5124354362, output_fired_time: 2.8021900654, propagate_forward_time: 73.1050033569, propagate_backward_time: 118.0616989136, weight_update_time: 0.2120009363, other_time: 3.7993927002
epoch time: 15.0623798370s, input_fired_time: 0.3017283082, output_fired_time: 0.0000000000, propagate_forward_time: 14.0950183868, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6656332016
validation[          , genome  6564] predictions:    9571/  10000 (95.71%), best:    9780/10000 (97.80%), error:      1407.82666, best error:       766.43622 on epoch:    34, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 189.2981262207s, input_fired_time: 5.4659295082, output_fired_time: 2.7592546940, propagate_forward_time: 69.6568756104, propagate_backward_time: 107.6752014160, weight_update_time: 0.2081402540, other_time: 3.7408599854
epoch time: 15.9795742035s, input_fired_time: 0.3433903754, output_fired_time: 0.0000000000, propagate_forward_time: 14.8585414886, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7776422501
validation[          , genome  6564] predictions:    9753/  10000 (97.53%), best:    9780/10000 (97.80%), error:       793.44623, best error:       766.43622 on epoch:    34, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 178.9755096436s, input_fired_time: 2.3249449730, output_fired_time: 2.5700163841, propagate_forward_time: 63.2136268616, propagate_backward_time: 107.1704559326, weight_update_time: 0.2019849867, other_time: 3.6964569092
epoch time: 14.9827194214s, input_fired_time: 0.3017844558, output_fired_time: 0.0000000000, propagate_forward_time: 14.0157279968, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6652069092
validation[          , genome  6564] predictions:    9752/  10000 (97.52%), best:    9780/10000 (97.80%), error:       850.68799, best error:       766.43622 on epoch:    34, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 209.5482025146s, input_fired_time: 2.8612272739, output_fired_time: 5.2315497398, propagate_forward_time: 77.4839859009, propagate_backward_time: 119.5117874146, weight_update_time: 0.2444087267, other_time: 4.4596557617
epoch time: 15.6871910095s, input_fired_time: 0.2958773673, output_fired_time: 0.0000000000, propagate_forward_time: 14.6600151062, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7312984467
validation[          , genome  6564] predictions:    9774/  10000 (97.74%), best:    9780/10000 (97.80%), error:       803.69385, best error:       766.43622 on epoch:    34, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 199.8183135986s, input_fired_time: 2.6705982685, output_fired_time: 2.9873135090, propagate_forward_time: 74.6700134277, propagate_backward_time: 115.3047256470, weight_update_time: 0.2542273402, other_time: 4.1856613159
epoch time: 19.2842731476s, input_fired_time: 0.3642760217, output_fired_time: 0.0000000000, propagate_forward_time: 18.0587463379, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8612499237
validation[          , genome  6564] predictions:    9769/  10000 (97.69%), best:    9780/10000 (97.80%), error:       778.79388, best error:       766.43622 on epoch:    34, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 184.9850463867s, input_fired_time: 2.4602034092, output_fired_time: 2.7239477634, propagate_forward_time: 69.3285522461, propagate_backward_time: 106.7521896362, weight_update_time: 0.2078877687, other_time: 3.7201461792
epoch time: 19.9026412964s, input_fired_time: 0.3725953996, output_fired_time: 0.0000000000, propagate_forward_time: 18.7659378052, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7641086578
validation[          , genome  6564] predictions:    9747/  10000 (97.47%), best:    9780/10000 (97.80%), error:       839.66437, best error:       766.43622 on epoch:    34, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 186.4685211182s, input_fired_time: 2.4713282585, output_fired_time: 2.7000026703, propagate_forward_time: 69.8785629272, propagate_backward_time: 107.7305831909, weight_update_time: 0.2079869658, other_time: 3.6880493164
epoch time: 20.4570217133s, input_fired_time: 0.3967027366, output_fired_time: 0.0000000000, propagate_forward_time: 19.0693664551, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9909534454
validation[          , genome  6564] predictions:    9711/  10000 (97.11%), best:    9780/10000 (97.80%), error:       911.40845, best error:       766.43622 on epoch:    34, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 190.3714599609s, input_fired_time: 2.4952983856, output_fired_time: 2.7255742550, propagate_forward_time: 71.3732070923, propagate_backward_time: 109.9025115967, weight_update_time: 0.2117044479, other_time: 3.8748703003
epoch time: 16.4506950378s, input_fired_time: 0.3275814354, output_fired_time: 0.0000000000, propagate_forward_time: 15.4326734543, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6904401779
validation[          , genome  6564] predictions:    9712/  10000 (97.12%), best:    9780/10000 (97.80%), error:       962.07416, best error:       766.43622 on epoch:    34, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 195.8834533691s, input_fired_time: 2.6166179180, output_fired_time: 2.8448085785, propagate_forward_time: 76.5242919922, propagate_backward_time: 110.1258544922, weight_update_time: 0.2087016851, other_time: 3.7718811035
epoch time: 21.7702484131s, input_fired_time: 0.4998324513, output_fired_time: 0.0000000000, propagate_forward_time: 20.2067356110, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0636806488
validation[          , genome  6564] predictions:    9720/  10000 (97.20%), best:    9780/10000 (97.80%), error:       938.95435, best error:       766.43622 on epoch:    34, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 198.0895538330s, input_fired_time: 2.6438221931, output_fired_time: 2.8310036659, propagate_forward_time: 79.3096542358, propagate_backward_time: 109.4221496582, weight_update_time: 0.2190444320, other_time: 3.8829116821
epoch time: 17.1833381653s, input_fired_time: 0.3651635945, output_fired_time: 0.0000000000, propagate_forward_time: 15.9946422577, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8235321045
validation[          , genome  6564] predictions:    9734/  10000 (97.34%), best:    9780/10000 (97.80%), error:       922.11737, best error:       766.43622 on epoch:    34, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 183.6388549805s, input_fired_time: 2.4367878437, output_fired_time: 2.6948170662, propagate_forward_time: 68.8232727051, propagate_backward_time: 105.9767379761, weight_update_time: 0.2068733275, other_time: 3.7072372437
epoch time: 14.6279754639s, input_fired_time: 0.3017359972, output_fired_time: 0.0000000000, propagate_forward_time: 13.6606159210, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6656236649
validation[          , genome  6564] predictions:    9696/  10000 (96.96%), best:    9780/10000 (97.80%), error:       992.28339, best error:       766.43622 on epoch:    34, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 192.6896972656s, input_fired_time: 2.4806859493, output_fired_time: 2.8061890602, propagate_forward_time: 71.5251235962, propagate_backward_time: 111.9538803101, weight_update_time: 0.2082445621, other_time: 3.9238281250
epoch time: 17.4652309418s, input_fired_time: 0.3304916918, output_fired_time: 0.0000000000, propagate_forward_time: 16.3976860046, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7370529175
validation[          , genome  6564] predictions:    9703/  10000 (97.03%), best:    9780/10000 (97.80%), error:      1030.20056, best error:       766.43622 on epoch:    34, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 191.1691284180s, input_fired_time: 2.5098412037, output_fired_time: 2.8576798439, propagate_forward_time: 71.6310653687, propagate_backward_time: 110.2836227417, weight_update_time: 0.2262270302, other_time: 3.8869171143
epoch time: 15.6587610245s, input_fired_time: 0.3365805447, output_fired_time: 0.0000000000, propagate_forward_time: 14.5947008133, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7274799347
validation[          , genome  6564] predictions:    9726/  10000 (97.26%), best:    9780/10000 (97.80%), error:       890.91785, best error:       766.43622 on epoch:    34, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 195.7702331543s, input_fired_time: 2.6109311581, output_fired_time: 2.7510011196, propagate_forward_time: 73.3381195068, propagate_backward_time: 113.2085113525, weight_update_time: 0.2082224786, other_time: 3.8616638184
epoch time: 13.1173610687s, input_fired_time: 0.3004352748, output_fired_time: 0.0000000000, propagate_forward_time: 12.1340322495, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6828937531
validation[          , genome  6564] predictions:    9699/  10000 (96.99%), best:    9780/10000 (97.80%), error:       999.25079, best error:       766.43622 on epoch:    34, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 199.9213409424s, input_fired_time: 2.6930658817, output_fired_time: 2.9193966389, propagate_forward_time: 74.7383422852, propagate_backward_time: 115.6142730713, weight_update_time: 0.2087156475, other_time: 3.9562530518
epoch time: 19.1290264130s, input_fired_time: 0.5208177567, output_fired_time: 0.0000000000, propagate_forward_time: 17.6911487579, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9170589447
validation[          , genome  6564] predictions:    9737/  10000 (97.37%), best:    9780/10000 (97.80%), error:       863.62305, best error:       766.43622 on epoch:    34, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 189.2913665771s, input_fired_time: 2.5095639229, output_fired_time: 2.8051371574, propagate_forward_time: 71.4059219360, propagate_backward_time: 108.5243988037, weight_update_time: 0.2109500468, other_time: 4.0463485718
epoch time: 18.6438274384s, input_fired_time: 0.3024370372, output_fired_time: 0.0000000000, propagate_forward_time: 17.4428272247, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8985633850
validation[          , genome  6564] predictions:    9698/  10000 (96.98%), best:    9780/10000 (97.80%), error:       956.07666, best error:       766.43622 on epoch:    34, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 187.9066467285s, input_fired_time: 2.4618921280, output_fired_time: 2.7538199425, propagate_forward_time: 70.5714874268, propagate_backward_time: 108.3817520142, weight_update_time: 0.2086294740, other_time: 3.7376937866
epoch time: 20.3708763123s, input_fired_time: 0.4668202996, output_fired_time: 0.0000000000, propagate_forward_time: 18.9071807861, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9968757629
validation[          , genome  6564] predictions:    9682/  10000 (96.82%), best:    9780/10000 (97.80%), error:      1070.95776, best error:       766.43622 on epoch:    34, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 194.0579223633s, input_fired_time: 2.5355527401, output_fired_time: 2.8885519505, propagate_forward_time: 72.9034271240, propagate_backward_time: 111.8183135986, weight_update_time: 0.2089664191, other_time: 3.9120788574
epoch time: 14.9027042389s, input_fired_time: 0.3102954626, output_fired_time: 0.0000000000, propagate_forward_time: 13.9173307419, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6750783920
validation[          , genome  6564] predictions:    9681/  10000 (96.81%), best:    9780/10000 (97.80%), error:      1008.74329, best error:       766.43622 on epoch:    34, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 182.5495147705s, input_fired_time: 2.4651226997, output_fired_time: 2.7186219692, propagate_forward_time: 68.3826446533, propagate_backward_time: 105.3450622559, weight_update_time: 0.2063123286, other_time: 3.6380615234
epoch time: 14.7295646667s, input_fired_time: 0.3015854359, output_fired_time: 0.0000000000, propagate_forward_time: 13.7653427124, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6626367569
validation[          , genome  6564] predictions:    9735/  10000 (97.35%), best:    9780/10000 (97.80%), error:       882.63690, best error:       766.43622 on epoch:    34, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 185.3836517334s, input_fired_time: 2.4809846878, output_fired_time: 2.7306752205, propagate_forward_time: 69.6482620239, propagate_backward_time: 106.8233871460, weight_update_time: 0.2099336684, other_time: 3.7003326416
epoch time: 18.1814517975s, input_fired_time: 0.3036961555, output_fired_time: 0.0000000000, propagate_forward_time: 17.0489292145, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8288269043
validation[          , genome  6564] predictions:    9723/  10000 (97.23%), best:    9780/10000 (97.80%), error:       947.73303, best error:       766.43622 on epoch:    34, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 173.6296539307s, input_fired_time: 2.4226500988, output_fired_time: 2.6742670536, propagate_forward_time: 63.6808547974, propagate_backward_time: 100.9572906494, weight_update_time: 0.2464023530, other_time: 3.8945846558
epoch time: 23.1558895111s, input_fired_time: 0.3368862271, output_fired_time: 0.0000000000, propagate_forward_time: 22.1192893982, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6997146606
validation[          , genome  6564] predictions:    9728/  10000 (97.28%), best:    9780/10000 (97.80%), error:       834.68829, best error:       766.43622 on epoch:    34, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 190.8784637451s, input_fired_time: 2.5187857151, output_fired_time: 2.7580881119, propagate_forward_time: 71.2424926758, propagate_backward_time: 110.5696258545, weight_update_time: 0.2084724158, other_time: 3.7894744873
epoch time: 15.5073566437s, input_fired_time: 0.3052159250, output_fired_time: 0.0000000000, propagate_forward_time: 14.5043840408, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6977567673
validation[          , genome  6564] predictions:    9753/  10000 (97.53%), best:    9780/10000 (97.80%), error:       826.05048, best error:       766.43622 on epoch:    34, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 193.0468750000s, input_fired_time: 2.4589600563, output_fired_time: 2.7381508350, propagate_forward_time: 77.0415573120, propagate_backward_time: 107.0845565796, weight_update_time: 0.2077447772, other_time: 3.7236633301
epoch time: 17.4603538513s, input_fired_time: 0.3687146902, output_fired_time: 0.0000000000, propagate_forward_time: 16.2677955627, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8238430023
validation[          , genome  6564] predictions:    9746/  10000 (97.46%), best:    9780/10000 (97.80%), error:       865.18829, best error:       766.43622 on epoch:    34, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 184.1241912842s, input_fired_time: 2.4616312981, output_fired_time: 2.7285747528, propagate_forward_time: 69.0114364624, propagate_backward_time: 106.1706771851, weight_update_time: 0.2082044333, other_time: 3.7518768311
epoch time: 24.1837387085s, input_fired_time: 0.3006407917, output_fired_time: 0.0000000000, propagate_forward_time: 23.2208309174, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6622676849
validation[          , genome  6564] predictions:    9692/  10000 (96.92%), best:    9780/10000 (97.80%), error:       991.42773, best error:       766.43622 on epoch:    34, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 191.1476440430s, input_fired_time: 2.5677888393, output_fired_time: 2.9450461864, propagate_forward_time: 71.6407699585, propagate_backward_time: 110.1190643311, weight_update_time: 0.2142504901, other_time: 3.8749618530
epoch time: 14.5672893524s, input_fired_time: 0.2967684865, output_fired_time: 0.0000000000, propagate_forward_time: 13.6032152176, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6673059464
validation[          , genome  6564] predictions:    9754/  10000 (97.54%), best:    9780/10000 (97.80%), error:       852.46490, best error:       766.43622 on epoch:    34, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 183.6863708496s, input_fired_time: 2.4668414593, output_fired_time: 2.7172195911, propagate_forward_time: 68.7724838257, propagate_backward_time: 106.0133972168, weight_update_time: 0.2075547129, other_time: 3.7164230347
epoch time: 14.5649938583s, input_fired_time: 0.3033127487, output_fired_time: 0.0000000000, propagate_forward_time: 13.5981616974, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6635198593
validation[          , genome  6564] predictions:    9757/  10000 (97.57%), best:    9780/10000 (97.80%), error:       783.35065, best error:       766.43622 on epoch:    34, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 190.8733520508s, input_fired_time: 2.4991872311, output_fired_time: 2.8752329350, propagate_forward_time: 71.7038192749, propagate_backward_time: 110.0562591553, weight_update_time: 0.2087665498, other_time: 3.7388534546
epoch time: 18.6059665680s, input_fired_time: 0.5084241629, output_fired_time: 0.0000000000, propagate_forward_time: 17.2594509125, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8380908966
validation[          , genome  6564] predictions:    9728/  10000 (97.28%), best:    9780/10000 (97.80%), error:       898.76471, best error:       766.43622 on epoch:    34, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 188.0338745117s, input_fired_time: 2.4637029171, output_fired_time: 2.8151831627, propagate_forward_time: 70.6067123413, propagate_backward_time: 108.4350967407, weight_update_time: 0.2100010663, other_time: 3.7131805420
epoch time: 14.7734918594s, input_fired_time: 0.3047725260, output_fired_time: 0.0000000000, propagate_forward_time: 13.8079214096, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6607980728
validation[          , genome  6564] predictions:    9707/  10000 (97.07%), best:    9780/10000 (97.80%), error:       954.30511, best error:       766.43622 on epoch:    34, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 177.4799804688s, input_fired_time: 2.3674364090, output_fired_time: 2.5740635395, propagate_forward_time: 64.1525802612, propagate_backward_time: 104.5221328735, weight_update_time: 0.2027264386, other_time: 3.8637695313
epoch time: 16.5482196808s, input_fired_time: 0.3090689778, output_fired_time: 0.0000000000, propagate_forward_time: 13.8361501694, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4030008316
validation[          , genome  6564] predictions:    9756/  10000 (97.56%), best:    9780/10000 (97.80%), error:       860.48444, best error:       766.43622 on epoch:    34, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 191.4772949219s, input_fired_time: 2.4755928516, output_fired_time: 2.7487697601, propagate_forward_time: 71.1072311401, propagate_backward_time: 111.2684860229, weight_update_time: 0.2078510970, other_time: 3.8772277832
epoch time: 16.1355457306s, input_fired_time: 0.2968447506, output_fired_time: 0.0000000000, propagate_forward_time: 15.0861425400, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7525587082
validation[          , genome  6564] predictions:    9761/  10000 (97.61%), best:    9780/10000 (97.80%), error:       816.09094, best error:       766.43622 on epoch:    34, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 159.3811950684s, input_fired_time: 2.2550144196, output_fired_time: 2.4383907318, propagate_forward_time: 57.4823951721, propagate_backward_time: 93.4921264648, weight_update_time: 0.1986858547, other_time: 3.7132720947
epoch time: 17.2919483185s, input_fired_time: 0.3079048395, output_fired_time: 0.0000000000, propagate_forward_time: 16.2891464233, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6948966980
validation[          , genome  6564] predictions:    9757/  10000 (97.57%), best:    9780/10000 (97.80%), error:       770.11041, best error:       766.43622 on epoch:    34, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 188.7716217041s, input_fired_time: 2.5461766720, output_fired_time: 2.7805342674, propagate_forward_time: 70.4625549316, propagate_backward_time: 109.1431732178, weight_update_time: 0.2385600358, other_time: 3.8391876221
epoch time: 15.1943569183s, input_fired_time: 0.2994504273, output_fired_time: 0.0000000000, propagate_forward_time: 14.2033672333, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6915388107
validation[          , genome  6564] predictions:    9635/  10000 (96.35%), best:    9780/10000 (97.80%), error:      1209.20386, best error:       766.43622 on epoch:    34, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 156.6996459961s, input_fired_time: 2.2345409393, output_fired_time: 2.4257063866, propagate_forward_time: 56.4022254944, propagate_backward_time: 91.9706878662, weight_update_time: 0.1966032535, other_time: 3.6664886475
epoch time: 16.2369441986s, input_fired_time: 0.3361466229, output_fired_time: 0.0000000000, propagate_forward_time: 15.1283502579, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7724475861
validation[          , genome  6564] predictions:    9726/  10000 (97.26%), best:    9780/10000 (97.80%), error:       914.93359, best error:       766.43622 on epoch:    34, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 186.6865844727s, input_fired_time: 2.5020546913, output_fired_time: 2.7510533333, propagate_forward_time: 70.0852203369, propagate_backward_time: 107.6607666016, weight_update_time: 0.2077394724, other_time: 3.6874847412
epoch time: 18.2461204529s, input_fired_time: 0.4339486063, output_fired_time: 0.0000000000, propagate_forward_time: 16.9826812744, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8294906616
validation[          , genome  6564] predictions:    9751/  10000 (97.51%), best:    9780/10000 (97.80%), error:       814.27936, best error:       766.43622 on epoch:    34, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 157.4872741699s, input_fired_time: 2.2433502674, output_fired_time: 2.4203059673, propagate_forward_time: 56.6885910034, propagate_backward_time: 92.4474868774, weight_update_time: 0.1977135241, other_time: 3.6875457764
epoch time: 12.4635629654s, input_fired_time: 0.2732577324, output_fired_time: 0.0000000000, propagate_forward_time: 11.4980297089, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6922760010
validation[          , genome  6564] predictions:    9742/  10000 (97.42%), best:    9780/10000 (97.80%), error:       862.00140, best error:       766.43622 on epoch:    34, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 182.8632659912s, input_fired_time: 2.4144289494, output_fired_time: 2.6936454773, propagate_forward_time: 68.1834030151, propagate_backward_time: 105.7400054932, weight_update_time: 0.2059998810, other_time: 3.8317794800
epoch time: 13.7661428452s, input_fired_time: 0.3349947631, output_fired_time: 0.0000000000, propagate_forward_time: 12.6779069901, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7532415390
validation[          , genome  6564] predictions:    9749/  10000 (97.49%), best:    9780/10000 (97.80%), error:       839.31134, best error:       766.43622 on epoch:    34, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 199.4448852539s, input_fired_time: 2.7223885059, output_fired_time: 2.8914463520, propagate_forward_time: 73.1084823608, propagate_backward_time: 116.8616180420, weight_update_time: 0.2077956498, other_time: 3.8609542847
epoch time: 13.5628080368s, input_fired_time: 0.3361417651, output_fired_time: 0.0000000000, propagate_forward_time: 12.5032358170, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7234306335
validation[          , genome  6564] predictions:    9730/  10000 (97.30%), best:    9780/10000 (97.80%), error:       929.76849, best error:       766.43622 on epoch:    34, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 156.8332214355s, input_fired_time: 2.2440614700, output_fired_time: 2.4269876480, propagate_forward_time: 56.5113563538, propagate_backward_time: 92.0087203979, weight_update_time: 0.1977323890, other_time: 3.6420974731
epoch time: 17.0052165985s, input_fired_time: 0.4594200850, output_fired_time: 0.0000000000, propagate_forward_time: 15.6891050339, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8566923141
validation[          , genome  6564] predictions:    9776/  10000 (97.76%), best:    9776/10000 (97.76%), error:       740.04382, best error:       740.04382 on epoch:    84, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 201.0578155518s, input_fired_time: 2.6096739769, output_fired_time: 2.9455685616, propagate_forward_time: 73.6067733765, propagate_backward_time: 117.9281387329, weight_update_time: 0.2078676075, other_time: 3.9676513672
epoch time: 15.1615610123s, input_fired_time: 0.3378559351, output_fired_time: 0.0000000000, propagate_forward_time: 13.9909210205, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8327836990
validation[          , genome  6564] predictions:    9767/  10000 (97.67%), best:    9776/10000 (97.76%), error:       768.99835, best error:       740.04382 on epoch:    84, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 185.4720306396s, input_fired_time: 2.5077848434, output_fired_time: 2.7197515965, propagate_forward_time: 69.4676971436, propagate_backward_time: 107.0835800171, weight_update_time: 0.2078106403, other_time: 3.6932144165
epoch time: 17.2816276550s, input_fired_time: 0.3324160576, output_fired_time: 0.0000000000, propagate_forward_time: 16.1105632782, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8386478424
validation[          , genome  6564] predictions:    9757/  10000 (97.57%), best:    9776/10000 (97.76%), error:       810.18829, best error:       740.04382 on epoch:    84, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 182.7076568604s, input_fired_time: 2.4540095329, output_fired_time: 2.6891274452, propagate_forward_time: 68.2482528687, propagate_backward_time: 105.6821212769, weight_update_time: 0.2067518979, other_time: 3.6341400146
epoch time: 22.0921878815s, input_fired_time: 0.5616343021, output_fired_time: 0.0000000000, propagate_forward_time: 20.4828052521, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0477485657
validation[          , genome  6564] predictions:    9774/  10000 (97.74%), best:    9776/10000 (97.76%), error:       768.75262, best error:       740.04382 on epoch:    84, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 184.8938140869s, input_fired_time: 2.4705162048, output_fired_time: 2.7639222145, propagate_forward_time: 69.4546966553, propagate_backward_time: 106.4897689819, weight_update_time: 0.2081440687, other_time: 3.7149124146
epoch time: 15.4218263626s, input_fired_time: 0.3684529364, output_fired_time: 0.0000000000, propagate_forward_time: 14.3836078644, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6697654724
validation[          , genome  6564] predictions:    9777/  10000 (97.77%), best:    9777/10000 (97.77%), error:       737.37634, best error:       737.37634 on epoch:    88, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 187.2726440430s, input_fired_time: 2.5122909546, output_fired_time: 2.8210341930, propagate_forward_time: 70.3312530518, propagate_backward_time: 107.9135894775, weight_update_time: 0.2089293897, other_time: 3.6944732666
epoch time: 15.5935287476s, input_fired_time: 0.3395552933, output_fired_time: 0.0000000000, propagate_forward_time: 14.5567760468, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6971969604
validation[          , genome  6564] predictions:    9732/  10000 (97.32%), best:    9777/10000 (97.77%), error:       864.81451, best error:       737.37634 on epoch:    88, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 187.1774902344s, input_fired_time: 2.5123963356, output_fired_time: 2.7504434586, propagate_forward_time: 70.3396148682, propagate_backward_time: 107.8755722046, weight_update_time: 0.2073364705, other_time: 3.6994705200
epoch time: 15.7004528046s, input_fired_time: 0.3099994659, output_fired_time: 0.0000000000, propagate_forward_time: 14.6862983704, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7041549683
validation[          , genome  6564] predictions:    9726/  10000 (97.26%), best:    9777/10000 (97.77%), error:       927.79303, best error:       737.37634 on epoch:    88, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 192.9976959229s, input_fired_time: 5.5346384048, output_fired_time: 2.7863070965, propagate_forward_time: 71.2016296387, propagate_backward_time: 109.6593399048, weight_update_time: 0.2087190002, other_time: 3.8157882690
epoch time: 19.9648342133s, input_fired_time: 0.3738985062, output_fired_time: 0.0000000000, propagate_forward_time: 18.7858657837, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8050689697
validation[          , genome  6564] predictions:    9752/  10000 (97.52%), best:    9777/10000 (97.77%), error:       837.15918, best error:       737.37634 on epoch:    88, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 187.0087127686s, input_fired_time: 2.4888598919, output_fired_time: 2.7410144806, propagate_forward_time: 69.9092102051, propagate_backward_time: 108.1090545654, weight_update_time: 0.2071385533, other_time: 3.7605743408
epoch time: 14.8166017532s, input_fired_time: 0.3055624664, output_fired_time: 0.0000000000, propagate_forward_time: 13.8478326797, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6632070541
validation[          , genome  6564] predictions:    9711/  10000 (97.11%), best:    9777/10000 (97.77%), error:       941.93622, best error:       737.37634 on epoch:    88, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 186.4894104004s, input_fired_time: 2.5599064827, output_fired_time: 2.7800571918, propagate_forward_time: 69.9540100098, propagate_backward_time: 107.4688491821, weight_update_time: 0.2083443850, other_time: 3.7265853882
epoch time: 19.3123359680s, input_fired_time: 0.5924800634, output_fired_time: 0.0000000000, propagate_forward_time: 17.8631973267, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8566589355
validation[          , genome  6564] predictions:    9716/  10000 (97.16%), best:    9777/10000 (97.77%), error:       895.01276, best error:       737.37634 on epoch:    88, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 189.7696838379s, input_fired_time: 2.5687816143, output_fired_time: 2.8530218601, propagate_forward_time: 71.1601333618, propagate_backward_time: 109.4285278320, weight_update_time: 0.2077851146, other_time: 3.7592086792
epoch time: 19.6598739624s, input_fired_time: 0.3676204979, output_fired_time: 0.0000000000, propagate_forward_time: 18.3731899261, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9190635681
validation[          , genome  6564] predictions:    9598/  10000 (95.98%), best:    9777/10000 (97.77%), error:      1304.30640, best error:       737.37634 on epoch:    88, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 187.0685119629s, input_fired_time: 2.4987833500, output_fired_time: 2.7367076874, propagate_forward_time: 70.2397384644, propagate_backward_time: 107.8817825317, weight_update_time: 0.2069990933, other_time: 3.7115020752
epoch time: 15.7288131714s, input_fired_time: 0.3389665186, output_fired_time: 0.0000000000, propagate_forward_time: 14.6285781860, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7612686157
validation[          , genome  6564] predictions:    9758/  10000 (97.58%), best:    9777/10000 (97.77%), error:       849.32928, best error:       737.37634 on epoch:    88, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 221.6423034668s, input_fired_time: 2.8897502422, output_fired_time: 3.2958626747, propagate_forward_time: 82.1017303467, propagate_backward_time: 128.9856414795, weight_update_time: 0.2723443508, other_time: 4.3693084717
epoch time: 17.6030292511s, input_fired_time: 0.4725299180, output_fired_time: 0.0000000000, propagate_forward_time: 16.2637615204, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8667373657
validation[          , genome  6564] predictions:    9757/  10000 (97.57%), best:    9777/10000 (97.77%), error:       823.39233, best error:       737.37634 on epoch:    88, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 192.7248687744s, input_fired_time: 2.5793800354, output_fired_time: 2.7476642132, propagate_forward_time: 71.4060516357, propagate_backward_time: 112.2459716797, weight_update_time: 0.2073881030, other_time: 3.7458038330
epoch time: 15.3859443665s, input_fired_time: 0.3030744493, output_fired_time: 0.0000000000, propagate_forward_time: 14.4204320908, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6624374390
validation[          , genome  6564] predictions:    9746/  10000 (97.46%), best:    9777/10000 (97.77%), error:       875.96033, best error:       737.37634 on epoch:    88, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 190.8993225098s, input_fired_time: 2.5341188908, output_fired_time: 2.7716033459, propagate_forward_time: 70.2072372437, propagate_backward_time: 111.6719284058, weight_update_time: 0.2090764493, other_time: 3.7144317627
epoch time: 18.7073116302s, input_fired_time: 0.4957810342, output_fired_time: 0.0000000000, propagate_forward_time: 17.3035907745, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9079399109
validation[          , genome  6564] predictions:    9754/  10000 (97.54%), best:    9777/10000 (97.77%), error:       830.33502, best error:       737.37634 on epoch:    88, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 190.3792877197s, input_fired_time: 2.6009111404, output_fired_time: 2.8769493103, propagate_forward_time: 71.2252578735, propagate_backward_time: 109.7676925659, weight_update_time: 0.2082386613, other_time: 3.9084777832
epoch time: 15.4304151535s, input_fired_time: 0.3031957746, output_fired_time: 0.0000000000, propagate_forward_time: 14.4394073486, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6878118515
validation[          , genome  6564] predictions:    9733/  10000 (97.33%), best:    9777/10000 (97.77%), error:       884.69696, best error:       737.37634 on epoch:    88, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 185.6516113281s, input_fired_time: 2.4809725285, output_fired_time: 2.7156465054, propagate_forward_time: 69.0306320190, propagate_backward_time: 107.7229385376, weight_update_time: 0.2081390023, other_time: 3.7014160156
epoch time: 16.5420207977s, input_fired_time: 0.3087078631, output_fired_time: 0.0000000000, propagate_forward_time: 15.4557504654, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7775621414
validation[          , genome  6564] predictions:    9757/  10000 (97.57%), best:    9777/10000 (97.77%), error:       829.03473, best error:       737.37634 on epoch:    88, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 86.2055740356s, input_fired_time: 1.7975240946, output_fired_time: 0.0000000000, propagate_forward_time: 80.4314956665, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9765548706
best training[          , genome  6564] predictions:   49638/  50000 (99.28%), best:    9777/10000 (97.77%), error:      1464.52136, best error:       737.37634 on epoch:    88, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 15.2855367661s, input_fired_time: 0.3030914962, output_fired_time: 0.0000000000, propagate_forward_time: 14.2868289948, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6956167221
   testing[          , genome  6564] predictions:    9778/  10000 (97.78%), best:    9777/10000 (97.77%), error:       689.24304, best error:       737.37634 on epoch:    88, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
07:48:48 (5628): called boinc_finish(0)

</stderr_txt>
]]>