Nameexact_genome_1512568488_44_6941_0
Workunit2605989
Created7 Dec 2017, 22:50:42 UTC
Sent7 Dec 2017, 22:57:47 UTC
Report deadline17 Dec 2017, 6:16:17 UTC
Received8 Dec 2017, 15:55:33 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID55108
Run time5 hours 8 min 31 sec
CPU time4 hours 59 min
Validate stateValid
Credit2,326.13
Device peak FLOPS2.57 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size156.33 MB
Peak swap size159.64 MB
Peak disk usage1.83 MB

Stderr output

<core_client_version>7.8.2</core_client_version>
<![CDATA[
<stderr_txt>
.28143, best error:       943.28143 on epoch:    14, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 182.0102386475s, input_fired_time: 2.4779777527, output_fired_time: 2.1681635380, propagate_forward_time: 66.3776245117, propagate_backward_time: 106.7930755615, weight_update_time: 0.1573409289, other_time: 4.1933898926
epoch time: 14.1999912262s, input_fired_time: 0.2970813513, output_fired_time: 0.0000000000, propagate_forward_time: 13.1683731079, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7345371246
validation[          , genome  6941] predictions:    9668/  10000 (96.68%), best:    9700/10000 (97.00%), error:      1102.69336, best error:       943.28143 on epoch:    14, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 174.8800048828s, input_fired_time: 2.3390069008, output_fired_time: 2.1337792873, propagate_forward_time: 65.6184387207, propagate_backward_time: 100.7151870728, weight_update_time: 0.1575927138, other_time: 4.0736007690
epoch time: 13.0194606781s, input_fired_time: 0.2905009985, output_fired_time: 0.0000000000, propagate_forward_time: 11.9643192291, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7646408081
validation[          , genome  6941] predictions:    9632/  10000 (96.32%), best:    9700/10000 (97.00%), error:      1205.58569, best error:       943.28143 on epoch:    14, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 205.3526000977s, input_fired_time: 2.6112332344, output_fired_time: 2.4377760887, propagate_forward_time: 77.5439605713, propagate_backward_time: 118.1515350342, weight_update_time: 0.1865358651, other_time: 4.6080932617
epoch time: 13.2087831497s, input_fired_time: 0.2991476357, output_fired_time: 0.0000000000, propagate_forward_time: 12.1978263855, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7118091583
validation[          , genome  6941] predictions:    9684/  10000 (96.84%), best:    9700/10000 (97.00%), error:      1051.86450, best error:       943.28143 on epoch:    14, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 174.4946136475s, input_fired_time: 2.3410685062, output_fired_time: 2.0741739273, propagate_forward_time: 65.2548675537, propagate_backward_time: 100.7627105713, weight_update_time: 0.1564074606, other_time: 4.0617980957
epoch time: 14.2238302231s, input_fired_time: 1.3044563532, output_fired_time: 0.0000000000, propagate_forward_time: 12.1905374527, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7288360596
validation[          , genome  6941] predictions:    9679/  10000 (96.79%), best:    9700/10000 (97.00%), error:      1028.51099, best error:       943.28143 on epoch:    14, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 175.1613311768s, input_fired_time: 3.2535848618, output_fired_time: 3.1503767967, propagate_forward_time: 63.3746109009, propagate_backward_time: 101.3122482300, weight_update_time: 0.1567887813, other_time: 4.0705108643
epoch time: 12.8822145462s, input_fired_time: 0.2869423330, output_fired_time: 0.0000000000, propagate_forward_time: 11.8857851028, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7094869614
validation[          , genome  6941] predictions:    9729/  10000 (97.29%), best:    9700/10000 (97.00%), error:       966.97308, best error:       943.28143 on epoch:    14, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 174.6368255615s, input_fired_time: 2.3417651653, output_fired_time: 2.1736984253, propagate_forward_time: 62.2938537598, propagate_backward_time: 103.7760238647, weight_update_time: 0.1581082046, other_time: 4.0514907837
epoch time: 14.1698732376s, input_fired_time: 0.2899771035, output_fired_time: 0.0000000000, propagate_forward_time: 13.1755151749, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7043809891
validation[          , genome  6941] predictions:    9722/  10000 (97.22%), best:    9722/10000 (97.22%), error:       920.90704, best error:       920.90704 on epoch:    20, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 180.8945312500s, input_fired_time: 2.4175264835, output_fired_time: 2.2055070400, propagate_forward_time: 68.8264770508, propagate_backward_time: 103.2576599121, weight_update_time: 0.1651237905, other_time: 4.1873626709
epoch time: 12.7699356079s, input_fired_time: 0.2878601253, output_fired_time: 0.0000000000, propagate_forward_time: 11.7478294373, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7342462540
validation[          , genome  6941] predictions:    9697/  10000 (96.97%), best:    9722/10000 (97.22%), error:       996.98438, best error:       920.90704 on epoch:    20, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 188.5068511963s, input_fired_time: 2.4317269325, output_fired_time: 2.2134935856, propagate_forward_time: 68.3242721558, propagate_backward_time: 111.2698135376, weight_update_time: 0.1706623733, other_time: 4.2675323486
epoch time: 14.2392644882s, input_fired_time: 0.2911939621, output_fired_time: 0.0000000000, propagate_forward_time: 13.2323026657, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7157678604
validation[          , genome  6941] predictions:    9730/  10000 (97.30%), best:    9730/10000 (97.30%), error:       880.02539, best error:       880.02539 on epoch:    22, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 179.5189666748s, input_fired_time: 2.3858132362, output_fired_time: 2.1577615738, propagate_forward_time: 66.0697479248, propagate_backward_time: 102.6741638184, weight_update_time: 0.1654081345, other_time: 6.2314758301
epoch time: 13.0044345856s, input_fired_time: 0.2948275506, output_fired_time: 0.0000000000, propagate_forward_time: 11.9914646149, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7181425095
validation[          , genome  6941] predictions:    9756/  10000 (97.56%), best:    9756/10000 (97.56%), error:       803.88727, best error:       803.88727 on epoch:    23, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 179.6088104248s, input_fired_time: 2.4049034119, output_fired_time: 3.1656453609, propagate_forward_time: 66.2285919189, propagate_backward_time: 103.6293869019, weight_update_time: 0.1649741232, other_time: 4.1802749634
epoch time: 18.8396358490s, input_fired_time: 0.4414071143, output_fired_time: 0.0000000000, propagate_forward_time: 17.3535614014, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0446681976
validation[          , genome  6941] predictions:    9718/  10000 (97.18%), best:    9756/10000 (97.56%), error:       884.35553, best error:       803.88727 on epoch:    23, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 174.6429443359s, input_fired_time: 2.3615701199, output_fired_time: 2.0939779282, propagate_forward_time: 63.3915786743, propagate_backward_time: 102.7112197876, weight_update_time: 0.1613409519, other_time: 4.0845947266
epoch time: 14.1789731979s, input_fired_time: 0.2943314314, output_fired_time: 0.0000000000, propagate_forward_time: 13.1616249084, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7230167389
validation[          , genome  6941] predictions:    9689/  10000 (96.89%), best:    9756/10000 (97.56%), error:      1001.34277, best error:       803.88727 on epoch:    23, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 172.2155761719s, input_fired_time: 2.3434591293, output_fired_time: 2.0696678162, propagate_forward_time: 62.7647819519, propagate_backward_time: 100.9563293457, weight_update_time: 0.1585647017, other_time: 4.0813293457
epoch time: 14.1370496750s, input_fired_time: 0.2976882458, output_fired_time: 0.0000000000, propagate_forward_time: 13.1082820892, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7310791016
validation[          , genome  6941] predictions:    9700/  10000 (97.00%), best:    9756/10000 (97.56%), error:      1015.87927, best error:       803.88727 on epoch:    23, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 172.8791198730s, input_fired_time: 3.3597216606, output_fired_time: 2.0673596859, propagate_forward_time: 64.0606994629, propagate_backward_time: 98.2713088989, weight_update_time: 0.1566044092, other_time: 5.1200332642
epoch time: 12.9892196655s, input_fired_time: 0.2940621376, output_fired_time: 0.0000000000, propagate_forward_time: 11.9839620590, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7111959457
validation[          , genome  6941] predictions:    9645/  10000 (96.45%), best:    9756/10000 (97.56%), error:      1119.25354, best error:       803.88727 on epoch:    23, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 172.6305541992s, input_fired_time: 2.3605010509, output_fired_time: 2.0892877579, propagate_forward_time: 65.4476013184, propagate_backward_time: 98.7128448486, weight_update_time: 0.1559158564, other_time: 4.0203094482
epoch time: 13.9382019043s, input_fired_time: 0.2914842963, output_fired_time: 0.0000000000, propagate_forward_time: 12.9333229065, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7133951187
validation[          , genome  6941] predictions:    9743/  10000 (97.43%), best:    9756/10000 (97.56%), error:       849.59894, best error:       803.88727 on epoch:    23, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 183.1528930664s, input_fired_time: 2.4562687874, output_fired_time: 2.1762058735, propagate_forward_time: 70.3734588623, propagate_backward_time: 102.7641143799, weight_update_time: 0.1612648219, other_time: 5.3828430176
epoch time: 14.1846361160s, input_fired_time: 0.3050851524, output_fired_time: 0.0000000000, propagate_forward_time: 13.1444902420, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7350606918
validation[          , genome  6941] predictions:    9727/  10000 (97.27%), best:    9756/10000 (97.56%), error:       896.28595, best error:       803.88727 on epoch:    23, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 171.9704132080s, input_fired_time: 2.3485291004, output_fired_time: 2.0515189171, propagate_forward_time: 61.8648490906, propagate_backward_time: 101.6898345947, weight_update_time: 0.1559751034, other_time: 4.0156860352
epoch time: 14.0986709595s, input_fired_time: 0.3008554876, output_fired_time: 0.0000000000, propagate_forward_time: 13.0708761215, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7269392014
validation[          , genome  6941] predictions:    9717/  10000 (97.17%), best:    9756/10000 (97.56%), error:       915.56659, best error:       803.88727 on epoch:    23, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 176.0437469482s, input_fired_time: 2.3901686668, output_fired_time: 3.0838768482, propagate_forward_time: 63.3738212585, propagate_backward_time: 103.0962371826, weight_update_time: 0.1571776867, other_time: 4.0996398926
epoch time: 13.1766586304s, input_fired_time: 0.2965453565, output_fired_time: 0.0000000000, propagate_forward_time: 12.1720495224, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7080640793
validation[          , genome  6941] predictions:    9552/  10000 (95.52%), best:    9756/10000 (97.56%), error:      1454.57947, best error:       803.88727 on epoch:    23, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 175.6159667969s, input_fired_time: 2.5075078011, output_fired_time: 2.1682333946, propagate_forward_time: 61.6598052979, propagate_backward_time: 104.1977844238, weight_update_time: 0.1563351005, other_time: 5.0826416016
epoch time: 14.2760133743s, input_fired_time: 0.2970236540, output_fired_time: 0.0000000000, propagate_forward_time: 13.2600030899, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7189865112
validation[          , genome  6941] predictions:    9721/  10000 (97.21%), best:    9756/10000 (97.56%), error:       951.06897, best error:       803.88727 on epoch:    23, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 173.3752136230s, input_fired_time: 2.3729281425, output_fired_time: 2.1058106422, propagate_forward_time: 68.0223159790, propagate_backward_time: 96.8661880493, weight_update_time: 0.1562892050, other_time: 4.0079803467
epoch time: 13.1171398163s, input_fired_time: 0.2956132293, output_fired_time: 0.0000000000, propagate_forward_time: 12.1064672470, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7150592804
validation[          , genome  6941] predictions:    9734/  10000 (97.34%), best:    9756/10000 (97.56%), error:       886.87616, best error:       803.88727 on epoch:    23, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 181.2792358398s, input_fired_time: 2.5379965305, output_fired_time: 2.1668889523, propagate_forward_time: 66.6294555664, propagate_backward_time: 104.7079391479, weight_update_time: 0.1586491019, other_time: 5.2369613647
epoch time: 14.2264547348s, input_fired_time: 0.3003399670, output_fired_time: 0.0000000000, propagate_forward_time: 13.1901187897, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7359962463
validation[          , genome  6941] predictions:    9761/  10000 (97.61%), best:    9761/10000 (97.61%), error:       752.60199, best error:       752.60199 on epoch:    34, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 174.7719879150s, input_fired_time: 2.3802843094, output_fired_time: 2.0923106670, propagate_forward_time: 63.4788818359, propagate_backward_time: 102.7696609497, weight_update_time: 0.1578203589, other_time: 4.0508499146
epoch time: 13.0000038147s, input_fired_time: 0.2935695350, output_fired_time: 0.0000000000, propagate_forward_time: 12.0030889511, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7033452988
validation[          , genome  6941] predictions:    9709/  10000 (97.09%), best:    9761/10000 (97.61%), error:       962.15741, best error:       752.60199 on epoch:    34, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 172.2753143311s, input_fired_time: 2.3678252697, output_fired_time: 2.0580067635, propagate_forward_time: 62.9442520142, propagate_backward_time: 100.8989486694, weight_update_time: 0.1555948704, other_time: 4.0062713623
epoch time: 14.3871822357s, input_fired_time: 0.3097220659, output_fired_time: 0.0000000000, propagate_forward_time: 13.3487205505, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7287397385
validation[          , genome  6941] predictions:    9729/  10000 (97.29%), best:    9761/10000 (97.61%), error:       869.40930, best error:       752.60199 on epoch:    34, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 173.6371307373s, input_fired_time: 2.3633201122, output_fired_time: 2.0694277287, propagate_forward_time: 63.8182220459, propagate_backward_time: 101.3757476807, weight_update_time: 0.1571675688, other_time: 4.0104064941
epoch time: 13.4886722565s, input_fired_time: 0.3027071953, output_fired_time: 0.0000000000, propagate_forward_time: 12.4366207123, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7493438721
validation[          , genome  6941] predictions:    9741/  10000 (97.41%), best:    9761/10000 (97.61%), error:       858.94635, best error:       752.60199 on epoch:    34, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 173.0451507568s, input_fired_time: 2.3675150871, output_fired_time: 2.0593619347, propagate_forward_time: 61.7012519836, propagate_backward_time: 102.8037796021, weight_update_time: 0.1565902531, other_time: 4.1132583618
epoch time: 13.9949693680s, input_fired_time: 0.3011262715, output_fired_time: 0.0000000000, propagate_forward_time: 12.9818687439, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7119741440
validation[          , genome  6941] predictions:    9557/  10000 (95.57%), best:    9761/10000 (97.61%), error:      1523.88928, best error:       752.60199 on epoch:    34, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 171.9770050049s, input_fired_time: 2.3777818680, output_fired_time: 2.0653958321, propagate_forward_time: 63.0559539795, propagate_backward_time: 100.4432449341, weight_update_time: 0.1566240042, other_time: 4.0346298218
epoch time: 14.2960510254s, input_fired_time: 0.3068772554, output_fired_time: 0.0000000000, propagate_forward_time: 13.2642049789, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7249689102
validation[          , genome  6941] predictions:    9626/  10000 (96.26%), best:    9761/10000 (97.61%), error:      1216.76880, best error:       752.60199 on epoch:    34, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 172.7037658691s, input_fired_time: 2.3729672432, output_fired_time: 2.0706975460, propagate_forward_time: 63.5865478516, propagate_backward_time: 100.6441497803, weight_update_time: 0.1564519852, other_time: 4.0294036865
epoch time: 13.1217536926s, input_fired_time: 0.2978676558, output_fired_time: 0.0000000000, propagate_forward_time: 12.1074409485, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7164449692
validation[          , genome  6941] predictions:    9733/  10000 (97.33%), best:    9761/10000 (97.61%), error:       878.99420, best error:       752.60199 on epoch:    34, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 185.8513793945s, input_fired_time: 2.5172882080, output_fired_time: 2.2505939007, propagate_forward_time: 68.4289474487, propagate_backward_time: 106.4078598022, weight_update_time: 0.1658908874, other_time: 6.2466888428
epoch time: 12.8064365387s, input_fired_time: 0.2942503393, output_fired_time: 0.0000000000, propagate_forward_time: 11.7959995270, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7161865234
validation[          , genome  6941] predictions:    9707/  10000 (97.07%), best:    9761/10000 (97.61%), error:       940.66663, best error:       752.60199 on epoch:    34, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 186.0755615234s, input_fired_time: 2.4489841461, output_fired_time: 2.2802567482, propagate_forward_time: 71.0660552979, propagate_backward_time: 105.8567504883, weight_update_time: 0.1621316224, other_time: 4.4235076904
epoch time: 12.7952585220s, input_fired_time: 0.2977064550, output_fired_time: 0.0000000000, propagate_forward_time: 11.7942838669, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7032680511
validation[          , genome  6941] predictions:    9736/  10000 (97.36%), best:    9761/10000 (97.61%), error:       847.50696, best error:       752.60199 on epoch:    34, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 173.8019409180s, input_fired_time: 2.3633420467, output_fired_time: 2.0727338791, propagate_forward_time: 65.9301376343, propagate_backward_time: 98.3805770874, weight_update_time: 0.1564729512, other_time: 5.0551452637
epoch time: 14.3277482986s, input_fired_time: 0.3068274856, output_fired_time: 0.0000000000, propagate_forward_time: 13.2746973038, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7462234497
validation[          , genome  6941] predictions:    9762/  10000 (97.62%), best:    9761/10000 (97.61%), error:       833.10052, best error:       752.60199 on epoch:    34, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 171.2583770752s, input_fired_time: 3.3722207546, output_fired_time: 2.0720796585, propagate_forward_time: 60.7858734131, propagate_backward_time: 101.0268554688, weight_update_time: 0.1562130153, other_time: 4.0013427734
epoch time: 14.1895284653s, input_fired_time: 0.3035038114, output_fired_time: 0.0000000000, propagate_forward_time: 13.1584205627, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7276039124
validation[          , genome  6941] predictions:    9749/  10000 (97.49%), best:    9761/10000 (97.61%), error:       806.64282, best error:       752.60199 on epoch:    34, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 180.3988342285s, input_fired_time: 2.4827010632, output_fired_time: 3.1820459366, propagate_forward_time: 65.5312805176, propagate_backward_time: 105.0532455444, weight_update_time: 0.1656899452, other_time: 4.1495590210
epoch time: 14.7904338837s, input_fired_time: 0.3227809668, output_fired_time: 0.0000000000, propagate_forward_time: 13.7050542831, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7625989914
validation[          , genome  6941] predictions:    9737/  10000 (97.37%), best:    9761/10000 (97.61%), error:       850.93860, best error:       752.60199 on epoch:    34, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 187.0546112061s, input_fired_time: 2.5131077766, output_fired_time: 2.1933548450, propagate_forward_time: 71.2269287109, propagate_backward_time: 106.6932678223, weight_update_time: 0.1666326076, other_time: 4.4279479980
epoch time: 14.3501138687s, input_fired_time: 0.3039142191, output_fired_time: 0.0000000000, propagate_forward_time: 13.2858934402, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7603063583
validation[          , genome  6941] predictions:    9704/  10000 (97.04%), best:    9761/10000 (97.61%), error:       931.40161, best error:       752.60199 on epoch:    34, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 189.5200347900s, input_fired_time: 2.5857498646, output_fired_time: 3.2990474701, propagate_forward_time: 66.7701492310, propagate_backward_time: 112.5486602783, weight_update_time: 0.1723166257, other_time: 4.3164291382
epoch time: 14.5456390381s, input_fired_time: 0.3009084165, output_fired_time: 0.0000000000, propagate_forward_time: 13.5000886917, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7446422577
validation[          , genome  6941] predictions:    9722/  10000 (97.22%), best:    9761/10000 (97.61%), error:       893.77539, best error:       752.60199 on epoch:    34, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 173.4814300537s, input_fired_time: 3.3891093731, output_fired_time: 2.0944209099, propagate_forward_time: 64.9578704834, propagate_backward_time: 99.0205307007, weight_update_time: 0.1564642489, other_time: 4.0194931030
epoch time: 12.7579011917s, input_fired_time: 0.2972514033, output_fired_time: 0.0000000000, propagate_forward_time: 11.7493648529, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7112846375
validation[          , genome  6941] predictions:    9765/  10000 (97.65%), best:    9761/10000 (97.61%), error:       792.35437, best error:       752.60199 on epoch:    34, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 173.9872436523s, input_fired_time: 2.3815884590, output_fired_time: 3.0845799446, propagate_forward_time: 67.2230453491, propagate_backward_time: 97.2385177612, weight_update_time: 0.1570101529, other_time: 4.0595092773
epoch time: 13.8938980103s, input_fired_time: 0.2984848320, output_fired_time: 0.0000000000, propagate_forward_time: 12.8835573196, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7118558884
validation[          , genome  6941] predictions:    9727/  10000 (97.27%), best:    9761/10000 (97.61%), error:       884.93787, best error:       752.60199 on epoch:    34, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 191.0930023193s, input_fired_time: 2.7128582001, output_fired_time: 2.3326334953, propagate_forward_time: 71.4401626587, propagate_backward_time: 109.1567382813, weight_update_time: 0.1574994177, other_time: 5.4506149292
epoch time: 14.3124742508s, input_fired_time: 0.3039754033, output_fired_time: 0.0000000000, propagate_forward_time: 13.2889766693, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7195224762
validation[          , genome  6941] predictions:    9726/  10000 (97.26%), best:    9761/10000 (97.61%), error:       844.69269, best error:       752.60199 on epoch:    34, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 181.0138244629s, input_fired_time: 2.4659490585, output_fired_time: 2.1723413467, propagate_forward_time: 67.5645904541, propagate_backward_time: 103.6384429932, weight_update_time: 0.1559623778, other_time: 5.1725006104
epoch time: 14.2988128662s, input_fired_time: 0.3213323653, output_fired_time: 0.0000000000, propagate_forward_time: 13.2623291016, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7151517868
validation[          , genome  6941] predictions:    9756/  10000 (97.56%), best:    9761/10000 (97.61%), error:       834.05652, best error:       752.60199 on epoch:    34, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 171.0890502930s, input_fired_time: 2.3665573597, output_fired_time: 2.0692815781, propagate_forward_time: 63.8361549377, propagate_backward_time: 98.7819900513, weight_update_time: 0.1574909687, other_time: 4.0350723267
epoch time: 13.1332035065s, input_fired_time: 0.3022605181, output_fired_time: 0.0000000000, propagate_forward_time: 12.0957908630, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7351522446
validation[          , genome  6941] predictions:    9580/  10000 (95.80%), best:    9761/10000 (97.61%), error:      1415.11865, best error:       752.60199 on epoch:    34, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 173.5821838379s, input_fired_time: 2.3725919724, output_fired_time: 3.0769586563, propagate_forward_time: 64.9364395142, propagate_backward_time: 99.1862792969, weight_update_time: 0.1569074839, other_time: 4.0099105835
epoch time: 22.9442653656s, input_fired_time: 0.4952978194, output_fired_time: 0.0000000000, propagate_forward_time: 21.2752857208, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1736812592
validation[          , genome  6941] predictions:    9743/  10000 (97.43%), best:    9761/10000 (97.61%), error:       886.79742, best error:       752.60199 on epoch:    34, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 185.1503906250s, input_fired_time: 2.5413706303, output_fired_time: 2.1716079712, propagate_forward_time: 68.7410354614, propagate_backward_time: 107.3700714111, weight_update_time: 0.1640613675, other_time: 4.3263015747
epoch time: 13.8340692520s, input_fired_time: 0.3181657493, output_fired_time: 0.0000000000, propagate_forward_time: 12.7844915390, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7314119339
validation[          , genome  6941] predictions:    9743/  10000 (97.43%), best:    9761/10000 (97.61%), error:       835.79596, best error:       752.60199 on epoch:    34, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 188.9492645264s, input_fired_time: 2.5469677448, output_fired_time: 2.2477576733, propagate_forward_time: 67.7593917847, propagate_backward_time: 109.9521636963, weight_update_time: 0.1652550548, other_time: 6.4429855347
epoch time: 15.6377515793s, input_fired_time: 0.3758265376, output_fired_time: 0.0000000000, propagate_forward_time: 14.4821271896, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7797975540
validation[          , genome  6941] predictions:    9786/  10000 (97.86%), best:    9786/10000 (97.86%), error:       721.84424, best error:       721.84424 on epoch:    55, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 193.9544830322s, input_fired_time: 2.6462154388, output_fired_time: 3.3161671162, propagate_forward_time: 72.5341949463, propagate_backward_time: 111.0753936768, weight_update_time: 0.1568913162, other_time: 4.3825225830
epoch time: 14.5008573532s, input_fired_time: 0.3066016138, output_fired_time: 0.0000000000, propagate_forward_time: 13.4640731812, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7301826477
validation[          , genome  6941] predictions:    9768/  10000 (97.68%), best:    9786/10000 (97.86%), error:       831.96588, best error:       721.84424 on epoch:    55, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 174.7078247070s, input_fired_time: 2.3756659031, output_fired_time: 2.0864584446, propagate_forward_time: 65.4534759521, propagate_backward_time: 100.7486419678, weight_update_time: 0.1596006900, other_time: 4.0435791016
epoch time: 13.2705869675s, input_fired_time: 0.3005320728, output_fired_time: 0.0000000000, propagate_forward_time: 12.2488851547, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7211694717
validation[          , genome  6941] predictions:    9678/  10000 (96.78%), best:    9786/10000 (97.86%), error:      1055.76257, best error:       721.84424 on epoch:    55, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 184.7403869629s, input_fired_time: 2.5645058155, output_fired_time: 2.1744313240, propagate_forward_time: 68.0733795166, propagate_backward_time: 107.6216964722, weight_update_time: 0.1738838702, other_time: 4.3063735962
epoch time: 13.1576662064s, input_fired_time: 0.3049103022, output_fired_time: 0.0000000000, propagate_forward_time: 12.1268157959, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7259397507
validation[          , genome  6941] predictions:    9754/  10000 (97.54%), best:    9786/10000 (97.86%), error:       854.56989, best error:       721.84424 on epoch:    55, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 177.4386444092s, input_fired_time: 2.4471056461, output_fired_time: 2.1068334579, propagate_forward_time: 64.6586761475, propagate_backward_time: 103.9992752075, weight_update_time: 0.1616781205, other_time: 4.2267532349
epoch time: 14.7842807770s, input_fired_time: 0.3099970818, output_fired_time: 0.0000000000, propagate_forward_time: 13.7002620697, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7740211487
validation[          , genome  6941] predictions:    9458/  10000 (94.58%), best:    9786/10000 (97.86%), error:      1755.57410, best error:       721.84424 on epoch:    55, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 174.4040985107s, input_fired_time: 2.4248666763, output_fired_time: 2.0815899372, propagate_forward_time: 63.3799285889, propagate_backward_time: 102.3759307861, weight_update_time: 0.1564280987, other_time: 4.1417846680
epoch time: 13.0659523010s, input_fired_time: 0.3014082313, output_fired_time: 0.0000000000, propagate_forward_time: 12.0412406921, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7233037949
validation[          , genome  6941] predictions:    9750/  10000 (97.50%), best:    9786/10000 (97.86%), error:       828.16278, best error:       721.84424 on epoch:    55, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 172.6679382324s, input_fired_time: 2.4140448570, output_fired_time: 2.0790429115, propagate_forward_time: 64.5592498779, propagate_backward_time: 99.4878463745, weight_update_time: 0.1560190171, other_time: 4.1277542114
epoch time: 14.1609878540s, input_fired_time: 0.3017942309, output_fired_time: 0.0000000000, propagate_forward_time: 13.0908145905, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7683792114
validation[          , genome  6941] predictions:    9728/  10000 (97.28%), best:    9786/10000 (97.86%), error:       896.40192, best error:       721.84424 on epoch:    55, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 181.2285614014s, input_fired_time: 2.4609925747, output_fired_time: 2.1532728672, propagate_forward_time: 68.8250656128, propagate_backward_time: 103.4224319458, weight_update_time: 0.1582778543, other_time: 4.3667907715
epoch time: 13.1557245255s, input_fired_time: 0.3019810617, output_fired_time: 0.0000000000, propagate_forward_time: 12.1136579514, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7400856018
validation[          , genome  6941] predictions:    9715/  10000 (97.15%), best:    9786/10000 (97.86%), error:       944.80750, best error:       721.84424 on epoch:    55, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 177.8471984863s, input_fired_time: 2.4666211605, output_fired_time: 2.1148777008, propagate_forward_time: 67.8083496094, propagate_backward_time: 101.2102050781, weight_update_time: 0.1565869004, other_time: 4.2471466064
epoch time: 14.3259897232s, input_fired_time: 0.3086630106, output_fired_time: 0.0000000000, propagate_forward_time: 13.2520055771, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7653207779
validation[          , genome  6941] predictions:    9654/  10000 (96.54%), best:    9786/10000 (97.86%), error:      1175.25708, best error:       721.84424 on epoch:    55, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 171.9753112793s, input_fired_time: 2.3801443577, output_fired_time: 2.0657839775, propagate_forward_time: 64.1154174805, propagate_backward_time: 98.2500305176, weight_update_time: 0.1565595865, other_time: 5.1639404297
epoch time: 12.9656419754s, input_fired_time: 0.3013862669, output_fired_time: 0.0000000000, propagate_forward_time: 11.9215202332, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7427358627
validation[          , genome  6941] predictions:    9746/  10000 (97.46%), best:    9786/10000 (97.86%), error:       832.14343, best error:       721.84424 on epoch:    55, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 172.5824127197s, input_fired_time: 2.3860604763, output_fired_time: 2.0953638554, propagate_forward_time: 63.6023406982, propagate_backward_time: 100.3414764404, weight_update_time: 0.1566137671, other_time: 4.1571655273
epoch time: 14.5565338135s, input_fired_time: 0.3041356504, output_fired_time: 0.0000000000, propagate_forward_time: 13.5055685043, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7468299866
validation[          , genome  6941] predictions:    9686/  10000 (96.86%), best:    9786/10000 (97.86%), error:      1017.70746, best error:       721.84424 on epoch:    55, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 171.8595733643s, input_fired_time: 2.3967800140, output_fired_time: 2.0714566708, propagate_forward_time: 63.6066741943, propagate_backward_time: 99.6302642822, weight_update_time: 0.1573454142, other_time: 4.1544036865
epoch time: 14.2362108231s, input_fired_time: 0.3189187050, output_fired_time: 0.0000000000, propagate_forward_time: 13.1277866364, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7895050049
validation[          , genome  6941] predictions:    9764/  10000 (97.64%), best:    9786/10000 (97.86%), error:       797.52441, best error:       721.84424 on epoch:    55, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 175.9169158936s, input_fired_time: 2.4353654385, output_fired_time: 2.1020884514, propagate_forward_time: 63.4143371582, propagate_backward_time: 103.7455368042, weight_update_time: 0.1580354571, other_time: 4.2195968628
epoch time: 13.0711212158s, input_fired_time: 0.3109910488, output_fired_time: 0.0000000000, propagate_forward_time: 11.9874839783, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7726459503
validation[          , genome  6941] predictions:    9780/  10000 (97.80%), best:    9786/10000 (97.86%), error:       763.09698, best error:       721.84424 on epoch:    55, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 174.4380187988s, input_fired_time: 3.4437375069, output_fired_time: 2.0990586281, propagate_forward_time: 63.7182693481, propagate_backward_time: 99.8313064575, weight_update_time: 0.1597990692, other_time: 5.3456420898
epoch time: 14.3031711578s, input_fired_time: 0.3100415170, output_fired_time: 0.0000000000, propagate_forward_time: 13.1958456039, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7972841263
validation[          , genome  6941] predictions:    9761/  10000 (97.61%), best:    9786/10000 (97.86%), error:       788.12842, best error:       721.84424 on epoch:    55, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 175.6269989014s, input_fired_time: 2.4301176071, output_fired_time: 2.1362984180, propagate_forward_time: 63.6010169983, propagate_backward_time: 103.1805038452, weight_update_time: 0.1591496915, other_time: 4.2790756226
epoch time: 12.9199943542s, input_fired_time: 0.3027907610, output_fired_time: 0.0000000000, propagate_forward_time: 11.8560905457, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7611131668
validation[          , genome  6941] predictions:    9751/  10000 (97.51%), best:    9786/10000 (97.86%), error:       859.68958, best error:       721.84424 on epoch:    55, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 174.1661987305s, input_fired_time: 3.4368891716, output_fired_time: 2.1114740372, propagate_forward_time: 62.9830627441, propagate_backward_time: 101.1753921509, weight_update_time: 0.1594942063, other_time: 4.4593734741
epoch time: 14.1215887070s, input_fired_time: 0.3039685488, output_fired_time: 0.0000000000, propagate_forward_time: 13.0378780365, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7797422409
validation[          , genome  6941] predictions:    9782/  10000 (97.82%), best:    9786/10000 (97.86%), error:       749.39886, best error:       721.84424 on epoch:    55, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 170.7486572266s, input_fired_time: 2.3921005726, output_fired_time: 2.0672514439, propagate_forward_time: 63.2874374390, propagate_backward_time: 98.6821899414, weight_update_time: 0.1579523981, other_time: 4.3196792603
epoch time: 14.0937538147s, input_fired_time: 0.3037970066, output_fired_time: 0.0000000000, propagate_forward_time: 12.9876184464, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8023386002
validation[          , genome  6941] predictions:    9760/  10000 (97.60%), best:    9786/10000 (97.86%), error:       822.01270, best error:       721.84424 on epoch:    55, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 171.5269927979s, input_fired_time: 3.3928396702, output_fired_time: 2.0711319447, propagate_forward_time: 62.3094215393, propagate_backward_time: 99.4368896484, weight_update_time: 0.1577670723, other_time: 4.3167114258
epoch time: 12.9289426804s, input_fired_time: 0.3051399589, output_fired_time: 0.0000000000, propagate_forward_time: 11.8616104126, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7621927261
validation[          , genome  6941] predictions:    9743/  10000 (97.43%), best:    9786/10000 (97.86%), error:       907.25043, best error:       721.84424 on epoch:    55, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 171.6562957764s, input_fired_time: 3.3921239376, output_fired_time: 2.0613951683, propagate_forward_time: 62.3057670593, propagate_backward_time: 99.6198196411, weight_update_time: 0.1578023136, other_time: 4.2771835327
epoch time: 14.0609674454s, input_fired_time: 0.3050021231, output_fired_time: 0.0000000000, propagate_forward_time: 12.9791345596, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7768306732
validation[          , genome  6941] predictions:    9738/  10000 (97.38%), best:    9786/10000 (97.86%), error:       857.72034, best error:       721.84424 on epoch:    55, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 173.1850738525s, input_fired_time: 2.4467835426, output_fired_time: 2.1009507179, propagate_forward_time: 63.1885147095, propagate_backward_time: 101.0574951172, weight_update_time: 0.1600122899, other_time: 4.3913345337
epoch time: 15.4130859375s, input_fired_time: 0.3205549717, output_fired_time: 0.0000000000, propagate_forward_time: 14.3064231873, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7861080170
validation[          , genome  6941] predictions:    9778/  10000 (97.78%), best:    9786/10000 (97.86%), error:       767.34583, best error:       721.84424 on epoch:    55, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 172.1691894531s, input_fired_time: 2.4159293175, output_fired_time: 2.1067895889, propagate_forward_time: 64.6445693970, propagate_backward_time: 96.8334197998, weight_update_time: 0.1591100544, other_time: 6.1684799194
epoch time: 15.7872886658s, input_fired_time: 0.3570209742, output_fired_time: 0.0000000000, propagate_forward_time: 14.5557565689, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8745107651
validation[          , genome  6941] predictions:    9706/  10000 (97.06%), best:    9786/10000 (97.86%), error:       970.64282, best error:       721.84424 on epoch:    55, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 177.7516784668s, input_fired_time: 2.5159826279, output_fired_time: 2.1669988632, propagate_forward_time: 63.9597816467, propagate_backward_time: 104.7668151855, weight_update_time: 0.1597445309, other_time: 4.3421173096
epoch time: 14.0706939697s, input_fired_time: 0.3145991862, output_fired_time: 0.0000000000, propagate_forward_time: 12.9968223572, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7592725754
validation[          , genome  6941] predictions:    9615/  10000 (96.15%), best:    9786/10000 (97.86%), error:      1250.01855, best error:       721.84424 on epoch:    55, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 177.2042541504s, input_fired_time: 2.4831209183, output_fired_time: 2.1464738846, propagate_forward_time: 65.4352951050, propagate_backward_time: 101.9062194824, weight_update_time: 0.1597966701, other_time: 5.2331466675
epoch time: 14.3481492996s, input_fired_time: 0.3111455142, output_fired_time: 0.0000000000, propagate_forward_time: 13.2794694901, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7575340271
validation[          , genome  6941] predictions:    9746/  10000 (97.46%), best:    9786/10000 (97.86%), error:       837.08905, best error:       721.84424 on epoch:    55, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 175.1642456055s, input_fired_time: 2.4311573505, output_fired_time: 2.0888793468, propagate_forward_time: 65.3373413086, propagate_backward_time: 100.7135696411, weight_update_time: 0.1754459441, other_time: 4.5932998657
epoch time: 13.0281248093s, input_fired_time: 0.3094116747, output_fired_time: 0.0000000000, propagate_forward_time: 11.8638305664, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8548822403
validation[          , genome  6941] predictions:    9752/  10000 (97.52%), best:    9786/10000 (97.86%), error:       817.37952, best error:       721.84424 on epoch:    55, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 175.8754577637s, input_fired_time: 2.4641385078, output_fired_time: 2.1450631618, propagate_forward_time: 63.8650703430, propagate_backward_time: 103.0349121094, weight_update_time: 0.1739187986, other_time: 4.3662719727
epoch time: 14.1313524246s, input_fired_time: 0.3083547056, output_fired_time: 0.0000000000, propagate_forward_time: 13.0339927673, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7890052795
validation[          , genome  6941] predictions:    9731/  10000 (97.31%), best:    9786/10000 (97.86%), error:       852.74805, best error:       721.84424 on epoch:    55, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 173.1001586914s, input_fired_time: 2.4239187241, output_fired_time: 2.1005213261, propagate_forward_time: 68.1461868286, propagate_backward_time: 96.2112426758, weight_update_time: 0.1567833722, other_time: 4.2182846069
epoch time: 16.1261024475s, input_fired_time: 0.3529692292, output_fired_time: 0.0000000000, propagate_forward_time: 14.8560924530, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9170408249
validation[          , genome  6941] predictions:    9758/  10000 (97.58%), best:    9786/10000 (97.86%), error:       858.74359, best error:       721.84424 on epoch:    55, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 170.3521881104s, input_fired_time: 4.4122176170, output_fired_time: 2.0635964870, propagate_forward_time: 62.1603622437, propagate_backward_time: 97.4379882813, weight_update_time: 0.1586658210, other_time: 4.2780227661
epoch time: 13.0125761032s, input_fired_time: 0.3099721968, output_fired_time: 0.0000000000, propagate_forward_time: 11.8938694000, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8087348938
validation[          , genome  6941] predictions:    9752/  10000 (97.52%), best:    9786/10000 (97.86%), error:       836.16974, best error:       721.84424 on epoch:    55, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 171.9797363281s, input_fired_time: 2.4133989811, output_fired_time: 2.0688703060, propagate_forward_time: 62.3506774902, propagate_backward_time: 100.8448944092, weight_update_time: 0.1589956135, other_time: 4.3018951416
epoch time: 14.1632814407s, input_fired_time: 0.3084625602, output_fired_time: 0.0000000000, propagate_forward_time: 13.1132249832, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7415943146
validation[          , genome  6941] predictions:    9699/  10000 (96.99%), best:    9786/10000 (97.86%), error:       949.43085, best error:       721.84424 on epoch:    55, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 170.7459411621s, input_fired_time: 2.4024593830, output_fired_time: 2.0632851124, propagate_forward_time: 64.2124176025, propagate_backward_time: 97.6984252930, weight_update_time: 0.1577129215, other_time: 4.3693542480
epoch time: 14.1263856888s, input_fired_time: 0.3070804775, output_fired_time: 0.0000000000, propagate_forward_time: 13.0640583038, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7552471161
validation[          , genome  6941] predictions:    9748/  10000 (97.48%), best:    9786/10000 (97.86%), error:       829.08972, best error:       721.84424 on epoch:    55, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 182.4611663818s, input_fired_time: 2.4031538963, output_fired_time: 2.0649971962, propagate_forward_time: 65.5219650269, propagate_backward_time: 108.3092117310, weight_update_time: 0.1573497653, other_time: 4.1618347168
epoch time: 12.9354295731s, input_fired_time: 0.3015856147, output_fired_time: 0.0000000000, propagate_forward_time: 11.9174814224, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7163629532
validation[          , genome  6941] predictions:    9758/  10000 (97.58%), best:    9786/10000 (97.86%), error:       839.58716, best error:       721.84424 on epoch:    55, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 172.3793334961s, input_fired_time: 2.4204211235, output_fired_time: 2.0653870106, propagate_forward_time: 62.5153312683, propagate_backward_time: 99.9865570068, weight_update_time: 0.1575433761, other_time: 5.3916320801
epoch time: 13.9925003052s, input_fired_time: 0.3033635318, output_fired_time: 0.0000000000, propagate_forward_time: 11.9582920074, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7308444977
validation[          , genome  6941] predictions:    9767/  10000 (97.67%), best:    9786/10000 (97.86%), error:       787.05420, best error:       721.84424 on epoch:    55, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 170.2362213135s, input_fired_time: 2.3922195435, output_fired_time: 2.0511870384, propagate_forward_time: 65.0524291992, propagate_backward_time: 96.5795364380, weight_update_time: 0.1576967686, other_time: 4.1608352661
epoch time: 14.0419702530s, input_fired_time: 0.3063914478, output_fired_time: 0.0000000000, propagate_forward_time: 13.0011062622, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7344722748
validation[          , genome  6941] predictions:    9755/  10000 (97.55%), best:    9786/10000 (97.86%), error:       810.35681, best error:       721.84424 on epoch:    55, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 170.8644409180s, input_fired_time: 2.3942034245, output_fired_time: 2.0706484318, propagate_forward_time: 63.2503166199, propagate_backward_time: 98.9755706787, weight_update_time: 0.1577016115, other_time: 4.1736907959
epoch time: 14.0863571167s, input_fired_time: 0.3069045842, output_fired_time: 0.0000000000, propagate_forward_time: 13.0363245010, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7431278229
validation[          , genome  6941] predictions:    9721/  10000 (97.21%), best:    9786/10000 (97.86%), error:       932.98590, best error:       721.84424 on epoch:    55, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 183.4425811768s, input_fired_time: 2.5528759956, output_fired_time: 2.1996340752, propagate_forward_time: 67.9850921631, propagate_backward_time: 106.3999786377, weight_update_time: 0.1573049128, other_time: 4.3050079346
epoch time: 14.1488246918s, input_fired_time: 0.3089205027, output_fired_time: 0.0000000000, propagate_forward_time: 13.0989170074, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7409868240
validation[          , genome  6941] predictions:    9761/  10000 (97.61%), best:    9786/10000 (97.86%), error:       820.69110, best error:       721.84424 on epoch:    55, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 178.0585021973s, input_fired_time: 2.4764497280, output_fired_time: 2.1358594894, propagate_forward_time: 65.3752746582, propagate_backward_time: 103.7935714722, weight_update_time: 0.1564856619, other_time: 4.2773361206
epoch time: 14.1743535995s, input_fired_time: 0.3043287694, output_fired_time: 0.0000000000, propagate_forward_time: 13.1368942261, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7331304550
validation[          , genome  6941] predictions:    9721/  10000 (97.21%), best:    9786/10000 (97.86%), error:       945.64679, best error:       721.84424 on epoch:    55, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 171.4919586182s, input_fired_time: 2.3980929852, output_fired_time: 2.0920124054, propagate_forward_time: 65.4450378418, propagate_backward_time: 96.3773269653, weight_update_time: 0.1571425050, other_time: 5.1794967651
epoch time: 14.2766284943s, input_fired_time: 0.3094907701, output_fired_time: 0.0000000000, propagate_forward_time: 13.1745328903, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7926044464
validation[          , genome  6941] predictions:    9775/  10000 (97.75%), best:    9786/10000 (97.86%), error:       756.36737, best error:       721.84424 on epoch:    55, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 182.0126647949s, input_fired_time: 2.5177912712, output_fired_time: 2.2034907341, propagate_forward_time: 63.8443794250, propagate_backward_time: 108.0631179810, weight_update_time: 0.1656819135, other_time: 5.3838882446
epoch time: 14.1110343933s, input_fired_time: 0.3082607985, output_fired_time: 0.0000000000, propagate_forward_time: 13.0251598358, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7776136398
validation[          , genome  6941] predictions:    9746/  10000 (97.46%), best:    9786/10000 (97.86%), error:       853.93518, best error:       721.84424 on epoch:    55, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 170.8551940918s, input_fired_time: 2.3932273388, output_fired_time: 2.0569133759, propagate_forward_time: 63.2742691040, propagate_backward_time: 99.0682601929, weight_update_time: 0.1570086032, other_time: 4.0625152588
epoch time: 14.3313369751s, input_fired_time: 0.3111499548, output_fired_time: 0.0000000000, propagate_forward_time: 13.2846946716, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7354927063
validation[          , genome  6941] predictions:    9743/  10000 (97.43%), best:    9786/10000 (97.86%), error:       830.36914, best error:       721.84424 on epoch:    55, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 174.4382171631s, input_fired_time: 2.4203481674, output_fired_time: 2.0759732723, propagate_forward_time: 63.5265274048, propagate_backward_time: 102.2397994995, weight_update_time: 0.1575583816, other_time: 4.1755676270
epoch time: 18.3330612183s, input_fired_time: 0.4720856547, output_fired_time: 0.0000000000, propagate_forward_time: 16.9416313171, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9193439484
validation[          , genome  6941] predictions:    9740/  10000 (97.40%), best:    9786/10000 (97.86%), error:       872.62451, best error:       721.84424 on epoch:    55, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 172.9938964844s, input_fired_time: 2.4028718472, output_fired_time: 2.1193037033, propagate_forward_time: 63.9986190796, propagate_backward_time: 100.3926086426, weight_update_time: 0.1570467502, other_time: 4.0804824829
epoch time: 13.4124050140s, input_fired_time: 0.3255635798, output_fired_time: 0.0000000000, propagate_forward_time: 12.3544149399, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7324266434
validation[          , genome  6941] predictions:    9772/  10000 (97.72%), best:    9786/10000 (97.86%), error:       779.06860, best error:       721.84424 on epoch:    55, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 173.0665588379s, input_fired_time: 2.4077665806, output_fired_time: 2.0653667450, propagate_forward_time: 66.8666839600, propagate_backward_time: 97.7347869873, weight_update_time: 0.1561627537, other_time: 3.9919586182
epoch time: 14.4809293747s, input_fired_time: 0.3179707229, output_fired_time: 0.0000000000, propagate_forward_time: 13.4176845551, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7452745438
validation[          , genome  6941] predictions:    9758/  10000 (97.58%), best:    9786/10000 (97.86%), error:       794.81067, best error:       721.84424 on epoch:    55, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 187.2114105225s, input_fired_time: 3.6171154976, output_fired_time: 2.2766876221, propagate_forward_time: 67.7865829468, propagate_backward_time: 108.2930526733, weight_update_time: 0.1656517386, other_time: 5.2379760742
epoch time: 14.3463773727s, input_fired_time: 0.3101759851, output_fired_time: 0.0000000000, propagate_forward_time: 13.3016920090, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7345094681
validation[          , genome  6941] predictions:    9769/  10000 (97.69%), best:    9786/10000 (97.86%), error:       827.26398, best error:       721.84424 on epoch:    55, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 172.0687713623s, input_fired_time: 2.4142510891, output_fired_time: 2.0726413727, propagate_forward_time: 63.8087348938, propagate_backward_time: 98.7641372681, weight_update_time: 0.1559510529, other_time: 5.0090103149
epoch time: 14.1011629105s, input_fired_time: 0.3061794043, output_fired_time: 0.0000000000, propagate_forward_time: 13.0735282898, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7214555740
validation[          , genome  6941] predictions:    9774/  10000 (97.74%), best:    9786/10000 (97.86%), error:       806.29926, best error:       721.84424 on epoch:    55, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 183.9563140869s, input_fired_time: 2.5624272823, output_fired_time: 2.1810827255, propagate_forward_time: 67.6974411011, propagate_backward_time: 107.2434310913, weight_update_time: 0.1650503874, other_time: 4.2719421387
epoch time: 15.9884033203s, input_fired_time: 0.3572184145, output_fired_time: 0.0000000000, propagate_forward_time: 14.8190927505, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8120918274
validation[          , genome  6941] predictions:    9791/  10000 (97.91%), best:    9786/10000 (97.86%), error:       738.10938, best error:       721.84424 on epoch:    55, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 176.9851379395s, input_fired_time: 2.4582920074, output_fired_time: 2.1369526386, propagate_forward_time: 65.3174133301, propagate_backward_time: 102.9532318115, weight_update_time: 0.1653760970, other_time: 4.1192474365
epoch time: 20.6843643188s, input_fired_time: 0.4473131895, output_fired_time: 0.0000000000, propagate_forward_time: 19.1015548706, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1354961395
validation[          , genome  6941] predictions:    9698/  10000 (96.98%), best:    9786/10000 (97.86%), error:       978.54340, best error:       721.84424 on epoch:    55, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 177.8658752441s, input_fired_time: 2.4879741669, output_fired_time: 2.1242861748, propagate_forward_time: 65.5778427124, propagate_backward_time: 103.4466629028, weight_update_time: 0.1604001671, other_time: 4.2291107178
epoch time: 19.5413360596s, input_fired_time: 0.4185778201, output_fired_time: 0.0000000000, propagate_forward_time: 18.1662731171, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9564857483
validation[          , genome  6941] predictions:    9771/  10000 (97.71%), best:    9786/10000 (97.86%), error:       793.58893, best error:       721.84424 on epoch:    55, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 72.2089309692s, input_fired_time: 1.5978339911, output_fired_time: 0.0000000000, propagate_forward_time: 65.6914672852, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.9196319580
best training[          , genome  6941] predictions:   49476/  50000 (98.95%), best:    9786/10000 (97.86%), error:      1786.59009, best error:       721.84424 on epoch:    55, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 13.1336259842s, input_fired_time: 0.2999861836, output_fired_time: 0.0000000000, propagate_forward_time: 12.1235246658, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7101154327
   testing[          , genome  6941] predictions:    9785/  10000 (97.85%), best:    9786/10000 (97.86%), error:       691.46198, best error:       721.84424 on epoch:    55, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
06:54:45 (6940): called boinc_finish(0)

</stderr_txt>
]]>