Nameexact_genome_1512568488_42_6423_0
Workunit2603340
Created7 Dec 2017, 19:42:20 UTC
Sent7 Dec 2017, 19:47:36 UTC
Report deadline16 Dec 2017, 11:30:27 UTC
Received8 Dec 2017, 13:37:37 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID55108
Run time5 hours 3 min 48 sec
CPU time4 hours 54 min 2 sec
Validate stateValid
Credit2,163.69
Device peak FLOPS2.57 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size157.75 MB
Peak swap size160.99 MB
Peak disk usage2.30 MB

Stderr output

<core_client_version>7.8.2</core_client_version>
<![CDATA[
<stderr_txt>
 (97.23%), error:       956.12506, best error:       956.12506 on epoch:    14, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 170.7531738281s, input_fired_time: 2.4034814835, output_fired_time: 2.2019944191, propagate_forward_time: 64.0755920410, propagate_backward_time: 98.1129684448, weight_update_time: 0.1840307862, other_time: 3.9591293335
epoch time: 14.2628011703s, input_fired_time: 0.2977175415, output_fired_time: 0.0000000000, propagate_forward_time: 13.2630739212, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7020101547
validation[          , genome  6423] predictions:    9685/  10000 (96.85%), best:    9723/10000 (97.23%), error:      1052.24414, best error:       956.12506 on epoch:    14, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 168.9889984131s, input_fired_time: 3.3767869473, output_fired_time: 2.1803195477, propagate_forward_time: 61.5935325623, propagate_backward_time: 97.8770294189, weight_update_time: 0.1828193069, other_time: 3.9613342285
epoch time: 14.3018341064s, input_fired_time: 0.2998707294, output_fired_time: 0.0000000000, propagate_forward_time: 13.2865228653, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7154407501
validation[          , genome  6423] predictions:    9719/  10000 (97.19%), best:    9719/10000 (97.19%), error:       931.13062, best error:       931.13062 on epoch:    16, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 168.7967834473s, input_fired_time: 2.3609766960, output_fired_time: 2.1665954590, propagate_forward_time: 62.4879989624, propagate_backward_time: 97.8329238892, weight_update_time: 0.1831828356, other_time: 3.9482879639
epoch time: 14.1101465225s, input_fired_time: 0.2991641462, output_fired_time: 0.0000000000, propagate_forward_time: 13.1129198074, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6980628967
validation[          , genome  6423] predictions:    9666/  10000 (96.66%), best:    9719/10000 (97.19%), error:      1024.57483, best error:       931.13062 on epoch:    16, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 170.0349426270s, input_fired_time: 2.3768985271, output_fired_time: 2.1751394272, propagate_forward_time: 65.5609664917, propagate_backward_time: 95.9492034912, weight_update_time: 0.1829472631, other_time: 3.9727401733
epoch time: 12.7347097397s, input_fired_time: 0.2890706062, output_fired_time: 0.0000000000, propagate_forward_time: 11.7638263702, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6818122864
validation[          , genome  6423] predictions:    9726/  10000 (97.26%), best:    9726/10000 (97.26%), error:       901.05188, best error:       901.05188 on epoch:    18, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 171.8952484131s, input_fired_time: 3.3883476257, output_fired_time: 2.2216479778, propagate_forward_time: 65.2636718750, propagate_backward_time: 96.9580230713, weight_update_time: 0.1838357896, other_time: 4.0635528564
epoch time: 14.2647838593s, input_fired_time: 0.2999255955, output_fired_time: 0.0000000000, propagate_forward_time: 13.1996288300, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7652292252
validation[          , genome  6423] predictions:    9695/  10000 (96.95%), best:    9726/10000 (97.26%), error:       972.92847, best error:       901.05188 on epoch:    18, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 169.0213928223s, input_fired_time: 2.3985621929, output_fired_time: 2.1804249287, propagate_forward_time: 65.1943435669, propagate_backward_time: 95.2295455933, weight_update_time: 0.1852178872, other_time: 4.0185241699
epoch time: 14.1481742859s, input_fired_time: 0.2957481742, output_fired_time: 0.0000000000, propagate_forward_time: 13.1511354446, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7012910843
validation[          , genome  6423] predictions:    9745/  10000 (97.45%), best:    9745/10000 (97.45%), error:       859.05927, best error:       859.05927 on epoch:    20, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 178.0423889160s, input_fired_time: 2.4769337177, output_fired_time: 2.2500035763, propagate_forward_time: 67.4541549683, propagate_backward_time: 101.7225112915, weight_update_time: 0.1846543103, other_time: 4.1387939453
epoch time: 12.9269180298s, input_fired_time: 0.2927187681, output_fired_time: 0.0000000000, propagate_forward_time: 11.9493360519, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6848630905
validation[          , genome  6423] predictions:    9664/  10000 (96.64%), best:    9745/10000 (97.45%), error:      1039.20557, best error:       859.05927 on epoch:    20, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 170.1377563477s, input_fired_time: 2.3886978626, output_fired_time: 3.1848871708, propagate_forward_time: 61.6920013428, propagate_backward_time: 97.9401626587, weight_update_time: 0.1815246046, other_time: 4.9319992065
epoch time: 14.1769647598s, input_fired_time: 0.3012923896, output_fired_time: 0.0000000000, propagate_forward_time: 13.1629266739, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7127456665
validation[          , genome  6423] predictions:    9713/  10000 (97.13%), best:    9745/10000 (97.45%), error:       947.03674, best error:       859.05927 on epoch:    20, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 186.6727752686s, input_fired_time: 2.5865347385, output_fired_time: 2.3631544113, propagate_forward_time: 69.0691070557, propagate_backward_time: 108.3751525879, weight_update_time: 0.1857656240, other_time: 4.2788238525
epoch time: 14.3369531631s, input_fired_time: 0.3023143411, output_fired_time: 0.0000000000, propagate_forward_time: 13.3256092072, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7090291977
validation[          , genome  6423] predictions:    9667/  10000 (96.67%), best:    9745/10000 (97.45%), error:      1066.95923, best error:       859.05927 on epoch:    20, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 178.4722137451s, input_fired_time: 2.4724354744, output_fired_time: 2.2973568439, propagate_forward_time: 66.0930633545, propagate_backward_time: 103.4364166260, weight_update_time: 0.1916793436, other_time: 4.1729278564
epoch time: 12.7234401703s, input_fired_time: 0.2879866064, output_fired_time: 0.0000000000, propagate_forward_time: 11.7533273697, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6821260452
validation[          , genome  6423] predictions:    9741/  10000 (97.41%), best:    9741/10000 (97.41%), error:       849.47046, best error:       849.47046 on epoch:    24, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 170.2332763672s, input_fired_time: 2.3655903339, output_fired_time: 3.2040534019, propagate_forward_time: 64.4287948608, propagate_backward_time: 96.2645339966, weight_update_time: 0.1824443638, other_time: 3.9703063965
epoch time: 14.1649808884s, input_fired_time: 0.2983988523, output_fired_time: 0.0000000000, propagate_forward_time: 13.1684637070, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6981182098
validation[          , genome  6423] predictions:    9680/  10000 (96.80%), best:    9741/10000 (97.41%), error:      1008.09131, best error:       849.47046 on epoch:    24, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 170.5634155273s, input_fired_time: 2.3745946884, output_fired_time: 3.2684245110, propagate_forward_time: 66.1157760620, propagate_backward_time: 93.8893203735, weight_update_time: 0.1805315167, other_time: 4.9153137207
epoch time: 14.4199857712s, input_fired_time: 0.3073571324, output_fired_time: 0.0000000000, propagate_forward_time: 13.3844776154, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7281513214
validation[          , genome  6423] predictions:    9671/  10000 (96.71%), best:    9741/10000 (97.41%), error:      1070.66187, best error:       849.47046 on epoch:    24, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 169.6972198486s, input_fired_time: 2.3817467690, output_fired_time: 3.2098250389, propagate_forward_time: 62.8005104065, propagate_backward_time: 97.3700485229, weight_update_time: 0.1810111105, other_time: 3.9350967407
epoch time: 14.6044998169s, input_fired_time: 0.3150576353, output_fired_time: 0.0000000000, propagate_forward_time: 13.5531063080, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7363357544
validation[          , genome  6423] predictions:    9745/  10000 (97.45%), best:    9745/10000 (97.45%), error:       834.96051, best error:       834.96051 on epoch:    27, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 173.8845672607s, input_fired_time: 2.4139866829, output_fired_time: 2.1959636211, propagate_forward_time: 66.2099151611, propagate_backward_time: 98.0121459961, weight_update_time: 0.1809099615, other_time: 5.0525512695
epoch time: 14.5739212036s, input_fired_time: 0.2970823050, output_fired_time: 0.0000000000, propagate_forward_time: 13.5714788437, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7053604126
validation[          , genome  6423] predictions:    9700/  10000 (97.00%), best:    9745/10000 (97.45%), error:       938.80493, best error:       834.96051 on epoch:    27, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 173.2338867188s, input_fired_time: 2.4374110699, output_fired_time: 2.2223508358, propagate_forward_time: 63.0301742554, propagate_backward_time: 101.4862518311, weight_update_time: 0.1897514462, other_time: 4.0577011108
epoch time: 15.3023653030s, input_fired_time: 0.3395827413, output_fired_time: 0.0000000000, propagate_forward_time: 14.2072877884, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7554950714
validation[          , genome  6423] predictions:    9649/  10000 (96.49%), best:    9745/10000 (97.45%), error:      1106.51599, best error:       834.96051 on epoch:    27, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 168.1990509033s, input_fired_time: 2.3878557682, output_fired_time: 2.1825246811, propagate_forward_time: 65.4382705688, propagate_backward_time: 94.2255630493, weight_update_time: 0.1824854910, other_time: 3.9648284912
epoch time: 13.2158594131s, input_fired_time: 0.2966038883, output_fired_time: 0.0000000000, propagate_forward_time: 12.2088117599, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7104434967
validation[          , genome  6423] predictions:    9717/  10000 (97.17%), best:    9745/10000 (97.45%), error:       940.64886, best error:       834.96051 on epoch:    27, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 170.0395507813s, input_fired_time: 2.3895413876, output_fired_time: 2.1784060001, propagate_forward_time: 66.5020523071, propagate_backward_time: 94.0218963623, weight_update_time: 0.1821253002, other_time: 4.9476547241
epoch time: 12.8524971008s, input_fired_time: 0.2929195762, output_fired_time: 0.0000000000, propagate_forward_time: 11.8691701889, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6904077530
validation[          , genome  6423] predictions:    9703/  10000 (97.03%), best:    9745/10000 (97.45%), error:       982.44983, best error:       834.96051 on epoch:    27, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 177.3598632813s, input_fired_time: 2.4401938915, output_fired_time: 2.2848556042, propagate_forward_time: 64.3027725220, propagate_backward_time: 104.1729660034, weight_update_time: 0.1887561381, other_time: 4.1590728760
epoch time: 14.4332523346s, input_fired_time: 0.2984907925, output_fired_time: 0.0000000000, propagate_forward_time: 13.4164896011, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7182722092
validation[          , genome  6423] predictions:    9593/  10000 (95.93%), best:    9745/10000 (97.45%), error:      1220.87683, best error:       834.96051 on epoch:    27, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 168.6938018799s, input_fired_time: 2.3697514534, output_fired_time: 2.1653773785, propagate_forward_time: 61.3594589233, propagate_backward_time: 98.8782043457, weight_update_time: 0.1828827113, other_time: 3.9210128784
epoch time: 14.0892181396s, input_fired_time: 0.3001258373, output_fired_time: 0.0000000000, propagate_forward_time: 13.0860652924, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7030267715
validation[          , genome  6423] predictions:    9719/  10000 (97.19%), best:    9745/10000 (97.45%), error:       870.46777, best error:       834.96051 on epoch:    27, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 184.1680297852s, input_fired_time: 2.5890195370, output_fired_time: 3.2289280891, propagate_forward_time: 67.1590881348, propagate_backward_time: 106.9044036865, weight_update_time: 0.1923414469, other_time: 4.2865905762
epoch time: 14.1554594040s, input_fired_time: 0.3037324846, output_fired_time: 0.0000000000, propagate_forward_time: 13.1359138489, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7158126831
validation[          , genome  6423] predictions:    9687/  10000 (96.87%), best:    9745/10000 (97.45%), error:      1015.01300, best error:       834.96051 on epoch:    27, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 174.4931945801s, input_fired_time: 2.4297170639, output_fired_time: 2.2205414772, propagate_forward_time: 65.2995529175, propagate_backward_time: 98.4758682251, weight_update_time: 0.1902487874, other_time: 6.0675201416
epoch time: 12.9437961578s, input_fired_time: 0.2950200737, output_fired_time: 0.0000000000, propagate_forward_time: 11.9626836777, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6860923767
validation[          , genome  6423] predictions:    9705/  10000 (97.05%), best:    9745/10000 (97.45%), error:       972.30774, best error:       834.96051 on epoch:    27, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 169.5543518066s, input_fired_time: 2.3880856037, output_fired_time: 2.3281710148, propagate_forward_time: 63.5803070068, propagate_backward_time: 97.3346939087, weight_update_time: 0.1811556965, other_time: 3.9230880737
epoch time: 14.3647003174s, input_fired_time: 0.3048168421, output_fired_time: 0.0000000000, propagate_forward_time: 13.3480501175, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7118330002
validation[          , genome  6423] predictions:    9728/  10000 (97.28%), best:    9745/10000 (97.45%), error:       846.02216, best error:       834.96051 on epoch:    27, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 169.7026519775s, input_fired_time: 2.4277265072, output_fired_time: 3.2017953396, propagate_forward_time: 63.1175422668, propagate_backward_time: 97.0231704712, weight_update_time: 0.1835235506, other_time: 3.9324264526
epoch time: 14.2878875732s, input_fired_time: 0.3030713499, output_fired_time: 0.0000000000, propagate_forward_time: 13.2821645737, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7026519775
validation[          , genome  6423] predictions:    9739/  10000 (97.39%), best:    9745/10000 (97.45%), error:       858.87439, best error:       834.96051 on epoch:    27, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 172.0120239258s, input_fired_time: 2.4010784626, output_fired_time: 2.1914668083, propagate_forward_time: 65.1574630737, propagate_backward_time: 97.3279724121, weight_update_time: 0.1812216789, other_time: 4.9340438843
epoch time: 12.9486417770s, input_fired_time: 0.2956083715, output_fired_time: 0.0000000000, propagate_forward_time: 11.9680519104, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6849813461
validation[          , genome  6423] predictions:    9766/  10000 (97.66%), best:    9766/10000 (97.66%), error:       782.27118, best error:       782.27118 on epoch:    38, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 190.1074829102s, input_fired_time: 2.5994656086, output_fired_time: 3.4179549217, propagate_forward_time: 70.4794235229, propagate_backward_time: 108.2785568237, weight_update_time: 0.1970711350, other_time: 5.3320770264
epoch time: 12.9172172546s, input_fired_time: 0.2969259024, output_fired_time: 0.0000000000, propagate_forward_time: 11.9226331711, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6976585388
validation[          , genome  6423] predictions:    9747/  10000 (97.47%), best:    9766/10000 (97.66%), error:       802.41412, best error:       782.27118 on epoch:    38, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 179.5019683838s, input_fired_time: 2.5149841309, output_fired_time: 2.2971243858, propagate_forward_time: 66.3281555176, propagate_backward_time: 103.2399291992, weight_update_time: 0.2086246461, other_time: 5.1217803955
epoch time: 14.2070522308s, input_fired_time: 0.2993288040, output_fired_time: 0.0000000000, propagate_forward_time: 13.2139797211, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6937437057
validation[          , genome  6423] predictions:    9691/  10000 (96.91%), best:    9766/10000 (97.66%), error:       942.83441, best error:       782.27118 on epoch:    38, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 179.3348388672s, input_fired_time: 2.5766720772, output_fired_time: 2.3012101650, propagate_forward_time: 66.3407974243, propagate_backward_time: 104.0504302979, weight_update_time: 0.1818633229, other_time: 4.0657272339
epoch time: 14.2652893066s, input_fired_time: 0.3016891778, output_fired_time: 0.0000000000, propagate_forward_time: 13.2651262283, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6984739304
validation[          , genome  6423] predictions:    9701/  10000 (97.01%), best:    9766/10000 (97.66%), error:       921.95813, best error:       782.27118 on epoch:    38, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 180.2750244141s, input_fired_time: 2.6040709019, output_fired_time: 2.2929761410, propagate_forward_time: 67.7095642090, propagate_backward_time: 103.6103744507, weight_update_time: 0.1833919883, other_time: 4.0580520630
epoch time: 14.1766328812s, input_fired_time: 0.2977161705, output_fired_time: 0.0000000000, propagate_forward_time: 13.1752910614, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7036256790
validation[          , genome  6423] predictions:    9741/  10000 (97.41%), best:    9766/10000 (97.66%), error:       812.90851, best error:       782.27118 on epoch:    38, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 169.9280395508s, input_fired_time: 2.3822755814, output_fired_time: 2.1871106625, propagate_forward_time: 63.8193588257, propagate_backward_time: 96.5295791626, weight_update_time: 0.1841118485, other_time: 5.0097198486
epoch time: 13.9722080231s, input_fired_time: 0.2986064553, output_fired_time: 0.0000000000, propagate_forward_time: 12.9802932739, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6933078766
validation[          , genome  6423] predictions:    9747/  10000 (97.47%), best:    9747/10000 (97.47%), error:       778.45514, best error:       778.45514 on epoch:    43, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 178.9750518799s, input_fired_time: 2.4873499870, output_fired_time: 2.2925646305, propagate_forward_time: 66.4126281738, propagate_backward_time: 103.7288131714, weight_update_time: 0.1923315227, other_time: 4.0536880493
epoch time: 16.4489212036s, input_fired_time: 0.3614680469, output_fired_time: 0.0000000000, propagate_forward_time: 14.2170133591, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8704404831
validation[          , genome  6423] predictions:    9729/  10000 (97.29%), best:    9747/10000 (97.47%), error:       904.85107, best error:       778.45514 on epoch:    43, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 170.8240661621s, input_fired_time: 2.4028429985, output_fired_time: 2.1945517063, propagate_forward_time: 66.2878570557, propagate_backward_time: 95.9533996582, weight_update_time: 0.1851351559, other_time: 3.9854125977
epoch time: 14.5493192673s, input_fired_time: 0.3081239164, output_fired_time: 0.0000000000, propagate_forward_time: 13.5133981705, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7277975082
validation[          , genome  6423] predictions:    9678/  10000 (96.78%), best:    9747/10000 (97.47%), error:      1063.17175, best error:       778.45514 on epoch:    43, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 185.0372619629s, input_fired_time: 2.6971294880, output_fired_time: 2.4394080639, propagate_forward_time: 71.8280944824, propagate_backward_time: 103.8058242798, weight_update_time: 0.1984794289, other_time: 4.2668075562
epoch time: 14.4607725143s, input_fired_time: 0.3070565462, output_fired_time: 0.0000000000, propagate_forward_time: 13.4538669586, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6998491287
validation[          , genome  6423] predictions:    9715/  10000 (97.15%), best:    9747/10000 (97.47%), error:       853.76331, best error:       778.45514 on epoch:    43, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 182.3315887451s, input_fired_time: 2.5737435818, output_fired_time: 2.3012325764, propagate_forward_time: 70.2524795532, propagate_backward_time: 102.9345474243, weight_update_time: 0.1922156513, other_time: 4.2695770264
epoch time: 14.2067995071s, input_fired_time: 0.3026871979, output_fired_time: 0.0000000000, propagate_forward_time: 13.1891355515, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7149763107
validation[          , genome  6423] predictions:    9732/  10000 (97.32%), best:    9747/10000 (97.47%), error:       956.61426, best error:       778.45514 on epoch:    43, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 181.1206207275s, input_fired_time: 2.4642269611, output_fired_time: 2.2556378841, propagate_forward_time: 70.6447067261, propagate_backward_time: 101.5773468018, weight_update_time: 0.1980136335, other_time: 4.1787033081
epoch time: 14.0629520416s, input_fired_time: 0.3011507690, output_fired_time: 0.0000000000, propagate_forward_time: 13.0510101318, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7107915878
validation[          , genome  6423] predictions:    9715/  10000 (97.15%), best:    9747/10000 (97.47%), error:       950.41260, best error:       778.45514 on epoch:    43, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 183.5328369141s, input_fired_time: 2.5326952934, output_fired_time: 2.2865250111, propagate_forward_time: 71.5174942017, propagate_backward_time: 102.9277725220, weight_update_time: 0.1972196549, other_time: 4.2683410645
epoch time: 20.6674690247s, input_fired_time: 0.5083523393, output_fired_time: 0.0000000000, propagate_forward_time: 19.1493339539, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0097827911
validation[          , genome  6423] predictions:    9722/  10000 (97.22%), best:    9747/10000 (97.47%), error:       880.53717, best error:       778.45514 on epoch:    43, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 198.6960754395s, input_fired_time: 2.8714106083, output_fired_time: 2.5592222214, propagate_forward_time: 73.1939926147, propagate_backward_time: 115.4023818970, weight_update_time: 0.2218767852, other_time: 4.6690673828
epoch time: 16.4044094086s, input_fired_time: 0.3327542245, output_fired_time: 0.0000000000, propagate_forward_time: 15.1817903519, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8898649216
validation[          , genome  6423] predictions:    9762/  10000 (97.62%), best:    9747/10000 (97.47%), error:       793.43085, best error:       778.45514 on epoch:    43, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 169.8068389893s, input_fired_time: 3.4027788639, output_fired_time: 2.1801152229, propagate_forward_time: 63.7172164917, propagate_backward_time: 95.5528259277, weight_update_time: 0.1840365678, other_time: 4.9538955688
epoch time: 14.3876333237s, input_fired_time: 0.3095474839, output_fired_time: 0.0000000000, propagate_forward_time: 13.3592252731, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7188606262
validation[          , genome  6423] predictions:    9772/  10000 (97.72%), best:    9772/10000 (97.72%), error:       751.47675, best error:       751.47675 on epoch:    51, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 183.5691986084s, input_fired_time: 2.5524861813, output_fired_time: 3.3272609711, propagate_forward_time: 67.0783920288, propagate_backward_time: 105.3076705933, weight_update_time: 0.1830569208, other_time: 5.3033905029
epoch time: 14.0556764603s, input_fired_time: 0.2997970283, output_fired_time: 0.0000000000, propagate_forward_time: 13.0569038391, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6989755630
validation[          , genome  6423] predictions:    9753/  10000 (97.53%), best:    9772/10000 (97.72%), error:       828.96393, best error:       751.47675 on epoch:    51, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 168.9689025879s, input_fired_time: 2.3966186047, output_fired_time: 2.1815912724, propagate_forward_time: 61.6153259277, propagate_backward_time: 98.8264923096, weight_update_time: 0.1832218766, other_time: 3.9488677979
epoch time: 14.1633262634s, input_fired_time: 0.3014542162, output_fired_time: 0.0000000000, propagate_forward_time: 13.1584444046, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7034273148
validation[          , genome  6423] predictions:    9719/  10000 (97.19%), best:    9772/10000 (97.72%), error:       898.63556, best error:       751.47675 on epoch:    51, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 169.0279998779s, input_fired_time: 2.3750548363, output_fired_time: 2.1617319584, propagate_forward_time: 61.2538070679, propagate_backward_time: 99.2919387817, weight_update_time: 0.1812704802, other_time: 3.9454650879
epoch time: 14.3426103592s, input_fired_time: 0.3003845215, output_fired_time: 0.0000000000, propagate_forward_time: 13.3320522308, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7101736069
validation[          , genome  6423] predictions:    9725/  10000 (97.25%), best:    9772/10000 (97.72%), error:       829.84241, best error:       751.47675 on epoch:    51, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 169.5319519043s, input_fired_time: 2.4422686100, output_fired_time: 2.1850597858, propagate_forward_time: 65.9384231567, propagate_backward_time: 95.0172348022, weight_update_time: 0.1816385984, other_time: 3.9489593506
epoch time: 12.9504566193s, input_fired_time: 0.2976491451, output_fired_time: 0.0000000000, propagate_forward_time: 11.9582548141, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6945524216
validation[          , genome  6423] predictions:    9734/  10000 (97.34%), best:    9772/10000 (97.72%), error:       816.20825, best error:       751.47675 on epoch:    51, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 170.9876403809s, input_fired_time: 2.4042196274, output_fired_time: 2.1711342335, propagate_forward_time: 62.9754219055, propagate_backward_time: 98.4200134277, weight_update_time: 0.1828754544, other_time: 5.0168609619
epoch time: 14.5912542343s, input_fired_time: 0.3049196005, output_fired_time: 0.0000000000, propagate_forward_time: 13.5682668686, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7180681229
validation[          , genome  6423] predictions:    9751/  10000 (97.51%), best:    9772/10000 (97.72%), error:       830.92285, best error:       751.47675 on epoch:    51, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 171.8191986084s, input_fired_time: 2.4078464508, output_fired_time: 2.2153806686, propagate_forward_time: 63.8089714050, propagate_backward_time: 99.3416442871, weight_update_time: 0.1809109002, other_time: 4.0453491211
epoch time: 14.2621326447s, input_fired_time: 0.3017215729, output_fired_time: 0.0000000000, propagate_forward_time: 13.2601680756, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7002429962
validation[          , genome  6423] predictions:    9754/  10000 (97.54%), best:    9772/10000 (97.72%), error:       825.43958, best error:       751.47675 on epoch:    51, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 174.0427856445s, input_fired_time: 2.4802370071, output_fired_time: 2.2306475639, propagate_forward_time: 62.7485885620, propagate_backward_time: 102.6123962402, weight_update_time: 0.1817881018, other_time: 3.9709091187
epoch time: 12.9151124954s, input_fired_time: 0.2943876982, output_fired_time: 0.0000000000, propagate_forward_time: 11.9454383850, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6752862930
validation[          , genome  6423] predictions:    9727/  10000 (97.27%), best:    9772/10000 (97.72%), error:       842.48724, best error:       751.47675 on epoch:    51, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 176.4869842529s, input_fired_time: 3.4327828884, output_fired_time: 2.2656612396, propagate_forward_time: 65.0757369995, propagate_backward_time: 101.6354598999, weight_update_time: 0.1865261793, other_time: 4.0773468018
epoch time: 13.5496311188s, input_fired_time: 0.2914080918, output_fired_time: 0.0000000000, propagate_forward_time: 12.5667715073, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6914510727
validation[          , genome  6423] predictions:    9753/  10000 (97.53%), best:    9772/10000 (97.72%), error:       807.05072, best error:       751.47675 on epoch:    51, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 169.2272796631s, input_fired_time: 2.4156866074, output_fired_time: 3.1881866455, propagate_forward_time: 63.6219749451, propagate_backward_time: 96.0577163696, weight_update_time: 0.1822312921, other_time: 3.9437179565
epoch time: 14.0157346725s, input_fired_time: 0.3014977574, output_fired_time: 0.0000000000, propagate_forward_time: 13.0198049545, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6944322586
validation[          , genome  6423] predictions:    9743/  10000 (97.43%), best:    9772/10000 (97.72%), error:       776.50269, best error:       751.47675 on epoch:    51, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 176.8059539795s, input_fired_time: 3.5065157413, output_fired_time: 2.2104458809, propagate_forward_time: 65.3965377808, propagate_backward_time: 101.6526260376, weight_update_time: 0.1812010705, other_time: 4.0398254395
epoch time: 14.0404338837s, input_fired_time: 0.2995741367, output_fired_time: 0.0000000000, propagate_forward_time: 13.0528860092, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6879739761
validation[          , genome  6423] predictions:    9759/  10000 (97.59%), best:    9759/10000 (97.59%), error:       736.53125, best error:       736.53125 on epoch:    61, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 171.6576080322s, input_fired_time: 3.4597222805, output_fired_time: 2.2150034904, propagate_forward_time: 65.6255950928, propagate_backward_time: 96.3661956787, weight_update_time: 0.1995816231, other_time: 3.9911041260
epoch time: 15.9082593918s, input_fired_time: 0.3193058670, output_fired_time: 0.0000000000, propagate_forward_time: 14.7791519165, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8098020554
validation[          , genome  6423] predictions:    9646/  10000 (96.46%), best:    9759/10000 (97.59%), error:      1145.26904, best error:       736.53125 on epoch:    61, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 174.7684783936s, input_fired_time: 3.5088236332, output_fired_time: 2.2278251648, propagate_forward_time: 65.1166610718, propagate_backward_time: 99.8808593750, weight_update_time: 0.1828744560, other_time: 4.0343093872
epoch time: 12.8362855911s, input_fired_time: 0.2998357415, output_fired_time: 0.0000000000, propagate_forward_time: 11.8521022797, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6843471527
validation[          , genome  6423] predictions:    9731/  10000 (97.31%), best:    9759/10000 (97.59%), error:       858.47620, best error:       736.53125 on epoch:    61, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 169.5377655029s, input_fired_time: 3.4074542522, output_fired_time: 2.2021796703, propagate_forward_time: 64.7763137817, propagate_backward_time: 95.2243804932, weight_update_time: 0.1819512546, other_time: 3.9274368286
epoch time: 14.2307395935s, input_fired_time: 0.3064740300, output_fired_time: 0.0000000000, propagate_forward_time: 13.2225971222, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7016687393
validation[          , genome  6423] predictions:    9668/  10000 (96.68%), best:    9759/10000 (97.59%), error:      1015.12567, best error:       736.53125 on epoch:    61, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 169.9616241455s, input_fired_time: 2.4280812740, output_fired_time: 2.1770479679, propagate_forward_time: 64.9526824951, propagate_backward_time: 96.4521026611, weight_update_time: 0.1882958859, other_time: 3.9517059326
epoch time: 14.2017326355s, input_fired_time: 0.3033913672, output_fired_time: 0.0000000000, propagate_forward_time: 13.1918354034, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7065057755
validation[          , genome  6423] predictions:    9719/  10000 (97.19%), best:    9759/10000 (97.59%), error:       879.54852, best error:       736.53125 on epoch:    61, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 169.6089172363s, input_fired_time: 2.4162523746, output_fired_time: 2.1815826893, propagate_forward_time: 62.9152908325, propagate_backward_time: 98.1596221924, weight_update_time: 0.1834774911, other_time: 3.9361648560
epoch time: 14.3137273788s, input_fired_time: 0.3038121760, output_fired_time: 0.0000000000, propagate_forward_time: 13.3098125458, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7001028061
validation[          , genome  6423] predictions:    9767/  10000 (97.67%), best:    9767/10000 (97.67%), error:       726.09601, best error:       726.09601 on epoch:    66, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 169.9487304688s, input_fired_time: 2.3985085487, output_fired_time: 3.1835262775, propagate_forward_time: 64.3244476318, propagate_backward_time: 95.0875091553, weight_update_time: 0.1829262227, other_time: 4.9547271729
epoch time: 12.8595123291s, input_fired_time: 0.3203496933, output_fired_time: 0.0000000000, propagate_forward_time: 11.8352537155, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7039089203
validation[          , genome  6423] predictions:    9756/  10000 (97.56%), best:    9767/10000 (97.67%), error:       791.09241, best error:       726.09601 on epoch:    66, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 177.8963317871s, input_fired_time: 2.4665505886, output_fired_time: 2.2729420662, propagate_forward_time: 65.8856277466, propagate_backward_time: 103.2511520386, weight_update_time: 0.1907014251, other_time: 4.0200500488
epoch time: 14.2962713242s, input_fired_time: 0.3081054389, output_fired_time: 0.0000000000, propagate_forward_time: 13.2683362961, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7198295593
validation[          , genome  6423] predictions:    9766/  10000 (97.66%), best:    9767/10000 (97.67%), error:       734.78735, best error:       726.09601 on epoch:    66, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 181.6555023193s, input_fired_time: 2.5234005451, output_fired_time: 2.3164606094, propagate_forward_time: 67.0642318726, propagate_backward_time: 105.4880218506, weight_update_time: 0.2042951286, other_time: 4.2633743286
epoch time: 14.3069076538s, input_fired_time: 0.3055216074, output_fired_time: 0.0000000000, propagate_forward_time: 12.4004545212, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6009311676
validation[          , genome  6423] predictions:    9773/  10000 (97.73%), best:    9767/10000 (97.67%), error:       754.06628, best error:       726.09601 on epoch:    66, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 174.9259796143s, input_fired_time: 2.4615762234, output_fired_time: 2.2188701630, propagate_forward_time: 66.5370559692, propagate_backward_time: 99.7485046387, weight_update_time: 0.1822797805, other_time: 3.9599685669
epoch time: 12.7193670273s, input_fired_time: 0.2983680964, output_fired_time: 0.0000000000, propagate_forward_time: 11.7378664017, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6831321716
validation[          , genome  6423] predictions:    9722/  10000 (97.22%), best:    9767/10000 (97.67%), error:       881.51532, best error:       726.09601 on epoch:    66, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 169.9272155762s, input_fired_time: 2.3936724663, output_fired_time: 2.1666502953, propagate_forward_time: 64.8035736084, propagate_backward_time: 96.6574935913, weight_update_time: 0.1832835227, other_time: 3.9058151245
epoch time: 13.0539598465s, input_fired_time: 0.3010094762, output_fired_time: 0.0000000000, propagate_forward_time: 12.0538654327, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6990852356
validation[          , genome  6423] predictions:    9736/  10000 (97.36%), best:    9767/10000 (97.67%), error:       842.28516, best error:       726.09601 on epoch:    66, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 169.8733520508s, input_fired_time: 2.3955883980, output_fired_time: 2.1665694714, propagate_forward_time: 64.4139709473, propagate_backward_time: 96.9187164307, weight_update_time: 0.1825005263, other_time: 3.9785156250
epoch time: 14.0532989502s, input_fired_time: 0.3043076992, output_fired_time: 0.0000000000, propagate_forward_time: 13.0594606400, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6895303726
validation[          , genome  6423] predictions:    9742/  10000 (97.42%), best:    9767/10000 (97.67%), error:       812.94708, best error:       726.09601 on epoch:    66, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 180.0715026855s, input_fired_time: 2.6121602058, output_fired_time: 2.2797634602, propagate_forward_time: 67.0898742676, propagate_backward_time: 102.0220947266, weight_update_time: 0.1973105371, other_time: 6.0675964355
epoch time: 15.7145185471s, input_fired_time: 0.3608161807, output_fired_time: 0.0000000000, propagate_forward_time: 14.4804849625, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8732175827
validation[          , genome  6423] predictions:    9764/  10000 (97.64%), best:    9767/10000 (97.67%), error:       799.33801, best error:       726.09601 on epoch:    66, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 178.4564056396s, input_fired_time: 2.5577578545, output_fired_time: 2.2973308563, propagate_forward_time: 68.1775512695, propagate_backward_time: 101.2473220825, weight_update_time: 0.2020388544, other_time: 4.1764450073
epoch time: 22.0253295898s, input_fired_time: 1.4457664490, output_fired_time: 0.0000000000, propagate_forward_time: 19.4715099335, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1080532074
validation[          , genome  6423] predictions:    9725/  10000 (97.25%), best:    9767/10000 (97.67%), error:       917.28174, best error:       726.09601 on epoch:    66, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 178.6805572510s, input_fired_time: 2.5179955959, output_fired_time: 3.3224790096, propagate_forward_time: 65.4156951904, propagate_backward_time: 103.2988510132, weight_update_time: 0.1865902692, other_time: 4.1255416870
epoch time: 12.9495992661s, input_fired_time: 0.3001874685, output_fired_time: 0.0000000000, propagate_forward_time: 11.9556636810, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6937484741
validation[          , genome  6423] predictions:    9752/  10000 (97.52%), best:    9767/10000 (97.67%), error:       842.46832, best error:       726.09601 on epoch:    66, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 170.5552368164s, input_fired_time: 2.4148354530, output_fired_time: 2.1822254658, propagate_forward_time: 65.7898635864, propagate_backward_time: 96.2570800781, weight_update_time: 0.1817260236, other_time: 3.9112319946
epoch time: 12.9651460648s, input_fired_time: 0.2954783440, output_fired_time: 0.0000000000, propagate_forward_time: 11.9849462509, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6847219467
validation[          , genome  6423] predictions:    9730/  10000 (97.30%), best:    9767/10000 (97.67%), error:       849.09827, best error:       726.09601 on epoch:    66, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 183.7090911865s, input_fired_time: 2.6161682606, output_fired_time: 2.3699300289, propagate_forward_time: 69.4198226929, propagate_backward_time: 105.0797653198, weight_update_time: 0.2064486146, other_time: 4.2234039307
epoch time: 16.5407066345s, input_fired_time: 0.3731690347, output_fired_time: 0.0000000000, propagate_forward_time: 15.2547187805, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9128189087
validation[          , genome  6423] predictions:    9657/  10000 (96.57%), best:    9767/10000 (97.67%), error:      1091.51770, best error:       726.09601 on epoch:    66, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 194.4166412354s, input_fired_time: 2.6328039169, output_fired_time: 2.4686830044, propagate_forward_time: 72.7005386353, propagate_backward_time: 112.1158370972, weight_update_time: 0.2215601802, other_time: 4.4987792969
epoch time: 14.4701747894s, input_fired_time: 0.3136652410, output_fired_time: 0.0000000000, propagate_forward_time: 13.4445524216, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7119569778
validation[          , genome  6423] predictions:    9757/  10000 (97.57%), best:    9767/10000 (97.67%), error:       739.50024, best error:       726.09601 on epoch:    66, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 168.8077697754s, input_fired_time: 2.3996577263, output_fired_time: 2.1659383774, propagate_forward_time: 65.3741760254, propagate_backward_time: 94.9205245972, weight_update_time: 0.1822234243, other_time: 3.9474716187
epoch time: 14.2548465729s, input_fired_time: 0.3041811585, output_fired_time: 0.0000000000, propagate_forward_time: 13.2522459030, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6984195709
validation[          , genome  6423] predictions:    9725/  10000 (97.25%), best:    9767/10000 (97.67%), error:       899.21472, best error:       726.09601 on epoch:    66, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 168.9835968018s, input_fired_time: 2.4101390839, output_fired_time: 2.1717755795, propagate_forward_time: 63.3703117371, propagate_backward_time: 96.0847625732, weight_update_time: 0.1840014309, other_time: 4.9466094971
epoch time: 13.1342144012s, input_fired_time: 0.3025361598, output_fired_time: 0.0000000000, propagate_forward_time: 12.1229133606, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7087650299
validation[          , genome  6423] predictions:    9676/  10000 (96.76%), best:    9767/10000 (97.67%), error:      1028.29651, best error:       726.09601 on epoch:    66, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 179.7237396240s, input_fired_time: 2.4853198528, output_fired_time: 2.3201291561, propagate_forward_time: 67.3848876953, propagate_backward_time: 103.3132019043, weight_update_time: 0.1896487921, other_time: 4.2201995850
epoch time: 14.0771932602s, input_fired_time: 1.2195956707, output_fired_time: 0.0000000000, propagate_forward_time: 12.1583948135, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6992025375
validation[          , genome  6423] predictions:    9763/  10000 (97.63%), best:    9767/10000 (97.67%), error:       778.66382, best error:       726.09601 on epoch:    66, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 170.5619812012s, input_fired_time: 2.4314191341, output_fired_time: 2.2152271271, propagate_forward_time: 64.1498260498, propagate_backward_time: 97.8165969849, weight_update_time: 0.1833553910, other_time: 3.9489212036
epoch time: 13.3115873337s, input_fired_time: 0.3096266985, output_fired_time: 0.0000000000, propagate_forward_time: 12.2877550125, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7142057419
validation[          , genome  6423] predictions:    9730/  10000 (97.30%), best:    9767/10000 (97.67%), error:       869.36389, best error:       726.09601 on epoch:    66, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 180.7450256348s, input_fired_time: 2.5106282234, output_fired_time: 2.2821815014, propagate_forward_time: 67.6035766602, propagate_backward_time: 104.2115402222, weight_update_time: 0.1832117289, other_time: 4.1370925903
epoch time: 14.1057939529s, input_fired_time: 0.3036836088, output_fired_time: 0.0000000000, propagate_forward_time: 13.1054239273, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6966867447
validation[          , genome  6423] predictions:    9708/  10000 (97.08%), best:    9767/10000 (97.67%), error:       945.67468, best error:       726.09601 on epoch:    66, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 176.0982666016s, input_fired_time: 2.5107944012, output_fired_time: 3.2221856117, propagate_forward_time: 65.3434906006, propagate_backward_time: 100.9736557007, weight_update_time: 0.1826883107, other_time: 4.0481491089
epoch time: 12.8668632507s, input_fired_time: 0.3007455766, output_fired_time: 0.0000000000, propagate_forward_time: 11.8810043335, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6851129532
validation[          , genome  6423] predictions:    9744/  10000 (97.44%), best:    9767/10000 (97.67%), error:       779.20197, best error:       726.09601 on epoch:    66, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 172.8005218506s, input_fired_time: 2.4524815083, output_fired_time: 2.1931352615, propagate_forward_time: 64.5643157959, propagate_backward_time: 98.5982437134, weight_update_time: 0.1865969449, other_time: 4.9923477173
epoch time: 14.2857580185s, input_fired_time: 0.3106739521, output_fired_time: 0.0000000000, propagate_forward_time: 13.2452926636, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7297916412
validation[          , genome  6423] predictions:    9763/  10000 (97.63%), best:    9767/10000 (97.67%), error:       754.06427, best error:       726.09601 on epoch:    66, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 170.8604583740s, input_fired_time: 2.4197781086, output_fired_time: 2.2035562992, propagate_forward_time: 65.2144470215, propagate_backward_time: 96.9448471069, weight_update_time: 0.1835411489, other_time: 4.0778274536
epoch time: 14.3957481384s, input_fired_time: 0.3094587028, output_fired_time: 0.0000000000, propagate_forward_time: 13.3682193756, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7180700302
validation[          , genome  6423] predictions:    9705/  10000 (97.05%), best:    9767/10000 (97.67%), error:       894.69232, best error:       726.09601 on epoch:    66, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 173.5393676758s, input_fired_time: 2.4807615280, output_fired_time: 2.2387549877, propagate_forward_time: 66.8167648315, propagate_backward_time: 96.9121170044, weight_update_time: 0.1832190156, other_time: 5.0909729004
epoch time: 14.7151107788s, input_fired_time: 0.3213861585, output_fired_time: 0.0000000000, propagate_forward_time: 13.6578760147, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7358484268
validation[          , genome  6423] predictions:    9727/  10000 (97.27%), best:    9767/10000 (97.67%), error:       900.62671, best error:       726.09601 on epoch:    66, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 169.4204254150s, input_fired_time: 2.4247953892, output_fired_time: 2.1825060844, propagate_forward_time: 61.3987388611, propagate_backward_time: 99.3322448730, weight_update_time: 0.1829403937, other_time: 4.0821380615
epoch time: 14.3012990952s, input_fired_time: 0.3046023548, output_fired_time: 0.0000000000, propagate_forward_time: 13.2718830109, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7248134613
validation[          , genome  6423] predictions:    9743/  10000 (97.43%), best:    9767/10000 (97.67%), error:       809.11237, best error:       726.09601 on epoch:    66, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 169.3582611084s, input_fired_time: 2.4246127605, output_fired_time: 2.1940674782, propagate_forward_time: 64.5094909668, propagate_backward_time: 96.1879577637, weight_update_time: 0.1836188734, other_time: 4.0421447754
epoch time: 14.0770778656s, input_fired_time: 0.3042544127, output_fired_time: 0.0000000000, propagate_forward_time: 13.0353221893, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7375011444
validation[          , genome  6423] predictions:    9762/  10000 (97.62%), best:    9767/10000 (97.67%), error:       764.60718, best error:       726.09601 on epoch:    66, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 176.6086730957s, input_fired_time: 2.5061812401, output_fired_time: 2.2858507633, propagate_forward_time: 66.8638381958, propagate_backward_time: 100.7379837036, weight_update_time: 0.2244482189, other_time: 4.2148132324
epoch time: 12.9343862534s, input_fired_time: 0.2997706532, output_fired_time: 0.0000000000, propagate_forward_time: 11.9195470810, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7150688171
validation[          , genome  6423] predictions:    9733/  10000 (97.33%), best:    9767/10000 (97.67%), error:       858.57593, best error:       726.09601 on epoch:    66, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 172.0706024170s, input_fired_time: 2.4700512886, output_fired_time: 2.2201669216, propagate_forward_time: 63.1179618835, propagate_backward_time: 100.0508804321, weight_update_time: 0.1991722733, other_time: 4.2115402222
epoch time: 14.0405168533s, input_fired_time: 0.3069261611, output_fired_time: 0.0000000000, propagate_forward_time: 13.0130491257, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7205419540
validation[          , genome  6423] predictions:    9751/  10000 (97.51%), best:    9767/10000 (97.67%), error:       791.70630, best error:       726.09601 on epoch:    66, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 167.9992980957s, input_fired_time: 2.4188220501, output_fired_time: 2.1671521664, propagate_forward_time: 63.0962600708, propagate_backward_time: 96.2289047241, weight_update_time: 0.1845110953, other_time: 4.0881652832
epoch time: 14.0252962112s, input_fired_time: 0.3103162646, output_fired_time: 0.0000000000, propagate_forward_time: 11.9753589630, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7396211624
validation[          , genome  6423] predictions:    9735/  10000 (97.35%), best:    9767/10000 (97.67%), error:       819.42987, best error:       726.09601 on epoch:    66, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 167.9239196777s, input_fired_time: 3.4291987419, output_fired_time: 2.1917736530, propagate_forward_time: 62.1306610107, propagate_backward_time: 96.0867919922, weight_update_time: 0.1822488904, other_time: 4.0854949951
epoch time: 14.1847887039s, input_fired_time: 0.3119788170, output_fired_time: 0.0000000000, propagate_forward_time: 13.1209983826, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7518119812
validation[          , genome  6423] predictions:    9749/  10000 (97.49%), best:    9767/10000 (97.67%), error:       785.87671, best error:       726.09601 on epoch:    66, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 169.5418090820s, input_fired_time: 2.4315798283, output_fired_time: 2.1717665195, propagate_forward_time: 60.3443145752, propagate_backward_time: 99.5025177002, weight_update_time: 0.1846303642, other_time: 5.0916290283
epoch time: 12.8398885727s, input_fired_time: 0.2974493504, output_fired_time: 0.0000000000, propagate_forward_time: 11.8224782944, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7199611664
validation[          , genome  6423] predictions:    9727/  10000 (97.27%), best:    9767/10000 (97.67%), error:       849.16840, best error:       726.09601 on epoch:    66, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 173.5537414551s, input_fired_time: 2.5241122246, output_fired_time: 2.2741324902, propagate_forward_time: 63.6742095947, propagate_backward_time: 100.9179992676, weight_update_time: 0.1848424822, other_time: 4.1632843018
epoch time: 14.6568078995s, input_fired_time: 0.3109026551, output_fired_time: 0.0000000000, propagate_forward_time: 13.5815143585, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7643909454
validation[          , genome  6423] predictions:    9736/  10000 (97.36%), best:    9767/10000 (97.67%), error:       812.64655, best error:       726.09601 on epoch:    66, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 170.4573669434s, input_fired_time: 2.4564647675, output_fired_time: 2.2168374062, propagate_forward_time: 64.0779571533, propagate_backward_time: 96.5273818970, weight_update_time: 0.1827005297, other_time: 5.1787185669
epoch time: 14.4731826782s, input_fired_time: 0.3112584352, output_fired_time: 0.0000000000, propagate_forward_time: 13.3570775986, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8048467636
validation[          , genome  6423] predictions:    9754/  10000 (97.54%), best:    9767/10000 (97.67%), error:       784.35773, best error:       726.09601 on epoch:    66, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 172.0573883057s, input_fired_time: 4.4174537659, output_fired_time: 2.2106978893, propagate_forward_time: 63.2729454041, propagate_backward_time: 97.8860702515, weight_update_time: 0.1856130809, other_time: 4.2702255249
epoch time: 12.3331613541s, input_fired_time: 0.2893682122, output_fired_time: 0.0000000000, propagate_forward_time: 11.2779417038, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7658510208
validation[          , genome  6423] predictions:    9769/  10000 (97.69%), best:    9767/10000 (97.67%), error:       772.20117, best error:       726.09601 on epoch:    66, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 176.0816802979s, input_fired_time: 3.5651884079, output_fired_time: 3.3287928104, propagate_forward_time: 66.0620193481, propagate_backward_time: 97.7998962402, weight_update_time: 0.1848849505, other_time: 5.3257827759
epoch time: 14.1455526352s, input_fired_time: 0.3133276701, output_fired_time: 0.0000000000, propagate_forward_time: 13.0715456009, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7606792450
validation[          , genome  6423] predictions:    9732/  10000 (97.32%), best:    9767/10000 (97.67%), error:       842.53815, best error:       726.09601 on epoch:    66, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 167.9606475830s, input_fired_time: 2.4431908131, output_fired_time: 2.1951773167, propagate_forward_time: 64.9550399780, propagate_backward_time: 94.0823516846, weight_update_time: 0.1866756678, other_time: 4.2848892212
epoch time: 13.9926090240s, input_fired_time: 0.3027546704, output_fired_time: 0.0000000000, propagate_forward_time: 12.8989315033, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7909231186
validation[          , genome  6423] predictions:    9759/  10000 (97.59%), best:    9767/10000 (97.67%), error:       792.18958, best error:       726.09601 on epoch:    66, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 168.0406188965s, input_fired_time: 2.4353325367, output_fired_time: 2.1840064526, propagate_forward_time: 62.8898048401, propagate_backward_time: 96.2930984497, weight_update_time: 0.1871614605, other_time: 4.2383804321
epoch time: 14.2924003601s, input_fired_time: 0.3107008040, output_fired_time: 0.0000000000, propagate_forward_time: 13.2143011093, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7673988342
validation[          , genome  6423] predictions:    9737/  10000 (97.37%), best:    9767/10000 (97.67%), error:       858.33490, best error:       726.09601 on epoch:    66, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 68.5949478149s, input_fired_time: 1.5223252773, output_fired_time: 0.0000000000, propagate_forward_time: 63.0903091431, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9823150635
best training[          , genome  6423] predictions:   49621/  50000 (99.24%), best:    9767/10000 (97.67%), error:      1427.87048, best error:       726.09601 on epoch:    66, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 14.3803682327s, input_fired_time: 0.3158003688, output_fired_time: 0.0000000000, propagate_forward_time: 12.3780136108, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6865539551
   testing[          , genome  6423] predictions:    9783/  10000 (97.83%), best:    9767/10000 (97.67%), error:       716.95795, best error:       726.09601 on epoch:    66, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
05:25:13 (2004): called boinc_finish(0)

</stderr_txt>
]]>