Nameexact_genome_1512568488_41_7106_0
Workunit2606818
Created7 Dec 2017, 23:55:19 UTC
Sent8 Dec 2017, 0:00:03 UTC
Report deadline15 Dec 2017, 16:12:47 UTC
Received8 Dec 2017, 7:15:43 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID55693
Run time3 hours 17 min 2 sec
CPU time2 hours 41 min 11 sec
Validate stateValid
Credit1,918.88
Device peak FLOPS4.44 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size156.13 MB
Peak swap size160.05 MB
Peak disk usage1.86 MB

Stderr output

<core_client_version>7.6.33</core_client_version>
<![CDATA[
<stderr_txt>
  1201.65515, best error:      1117.51782 on epoch:    10, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 175.3237762451s, input_fired_time: 1.9999456406, output_fired_time: 2.9119231701, propagate_forward_time: 66.2623825073, propagate_backward_time: 99.7993392944, weight_update_time: 0.1453901231, other_time: 4.3501892090
epoch time: 14.9412479401s, input_fired_time: 0.1091665849, output_fired_time: 0.0000000000, propagate_forward_time: 14.3607845306, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4712972641
validation[          , genome  7106] predictions:    9618/  10000 (96.18%), best:    9680/10000 (96.80%), error:      1246.31946, best error:      1117.51782 on epoch:    10, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 178.2703247070s, input_fired_time: 0.9312308431, output_fired_time: 2.0163531303, propagate_forward_time: 71.6263351440, propagate_backward_time: 99.0721664429, weight_update_time: 0.1595304310, other_time: 4.6242370605
epoch time: 16.1126384735s, input_fired_time: 0.1410002857, output_fired_time: 0.0000000000, propagate_forward_time: 15.5270786285, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4445590973
validation[          , genome  7106] predictions:    9638/  10000 (96.38%), best:    9680/10000 (96.80%), error:      1199.95972, best error:      1117.51782 on epoch:    10, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 178.4023284912s, input_fired_time: 1.0369836092, output_fired_time: 1.9641809464, propagate_forward_time: 69.6321105957, propagate_backward_time: 102.3787994385, weight_update_time: 0.1538951844, other_time: 3.3902435303
epoch time: 14.9466419220s, input_fired_time: 0.1370894462, output_fired_time: 0.0000000000, propagate_forward_time: 14.3836174011, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4259347916
validation[          , genome  7106] predictions:    9634/  10000 (96.34%), best:    9680/10000 (96.80%), error:      1243.59399, best error:      1117.51782 on epoch:    10, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 180.0732269287s, input_fired_time: 1.0751188993, output_fired_time: 0.9983050823, propagate_forward_time: 70.1899185181, propagate_backward_time: 104.2543411255, weight_update_time: 0.1482639015, other_time: 3.5555419922
epoch time: 14.1937046051s, input_fired_time: 0.1327746212, output_fired_time: 0.0000000000, propagate_forward_time: 13.6732025146, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3877277374
validation[          , genome  7106] predictions:    9651/  10000 (96.51%), best:    9680/10000 (96.80%), error:      1191.09229, best error:      1117.51782 on epoch:    10, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 174.8141937256s, input_fired_time: 0.9745628834, output_fired_time: 0.8922769427, propagate_forward_time: 70.8237533569, propagate_backward_time: 98.8216400146, weight_update_time: 0.1446065009, other_time: 3.3019638062
epoch time: 15.4164667130s, input_fired_time: 1.1261984110, output_fired_time: 0.0000000000, propagate_forward_time: 13.8952617645, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3950061798
validation[          , genome  7106] predictions:    9585/  10000 (95.85%), best:    9680/10000 (96.80%), error:      1375.74548, best error:      1117.51782 on epoch:    10, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 171.9393463135s, input_fired_time: 1.0183178186, output_fired_time: 1.9572356939, propagate_forward_time: 69.8188781738, propagate_backward_time: 94.8618621826, weight_update_time: 0.1447026879, other_time: 4.2830657959
epoch time: 14.6884088516s, input_fired_time: 0.1140556186, output_fired_time: 0.0000000000, propagate_forward_time: 13.1601762772, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4141769409
validation[          , genome  7106] predictions:    9639/  10000 (96.39%), best:    9680/10000 (96.80%), error:      1216.99976, best error:      1117.51782 on epoch:    10, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 172.0592498779s, input_fired_time: 1.9609799385, output_fired_time: 2.0739300251, propagate_forward_time: 60.9093055725, propagate_backward_time: 102.7425842285, weight_update_time: 0.1424697936, other_time: 4.3724517822
epoch time: 13.3503007889s, input_fired_time: 0.1237305477, output_fired_time: 0.0000000000, propagate_forward_time: 12.8702096939, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3563604355
validation[          , genome  7106] predictions:    9651/  10000 (96.51%), best:    9680/10000 (96.80%), error:      1188.47937, best error:      1117.51782 on epoch:    10, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 175.0391998291s, input_fired_time: 1.0297721624, output_fired_time: 0.8068141341, propagate_forward_time: 64.9908828735, propagate_backward_time: 101.5032882690, weight_update_time: 0.1653608382, other_time: 6.7084503174
epoch time: 14.9512205124s, input_fired_time: 0.1246532574, output_fired_time: 0.0000000000, propagate_forward_time: 14.4678411484, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3587265015
validation[          , genome  7106] predictions:    9696/  10000 (96.96%), best:    9696/10000 (96.96%), error:      1057.84619, best error:      1057.84619 on epoch:    22, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 175.7398071289s, input_fired_time: 3.2079608440, output_fired_time: 3.0774955750, propagate_forward_time: 58.8158760071, propagate_backward_time: 107.5074691772, weight_update_time: 1.0904026031, other_time: 3.1310043335
epoch time: 14.7721567154s, input_fired_time: 0.1127415374, output_fired_time: 0.0000000000, propagate_forward_time: 13.2500629425, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4093523026
validation[          , genome  7106] predictions:    9581/  10000 (95.81%), best:    9696/10000 (96.96%), error:      1466.78540, best error:      1057.84619 on epoch:    22, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 172.0047149658s, input_fired_time: 3.2419097424, output_fired_time: 0.8487452865, propagate_forward_time: 66.1107635498, propagate_backward_time: 99.5392761230, weight_update_time: 0.1850933582, other_time: 2.2640228271
epoch time: 14.9402503967s, input_fired_time: 0.1160965040, output_fired_time: 0.0000000000, propagate_forward_time: 13.4988002777, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3253536224
validation[          , genome  7106] predictions:    9617/  10000 (96.17%), best:    9696/10000 (96.96%), error:      1232.44617, best error:      1057.84619 on epoch:    22, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 172.8178710938s, input_fired_time: 1.0874387026, output_fired_time: 1.8563498259, propagate_forward_time: 63.6651840210, propagate_backward_time: 100.9045410156, weight_update_time: 0.1683312207, other_time: 5.3043594360
epoch time: 14.6337575912s, input_fired_time: 0.1190405115, output_fired_time: 0.0000000000, propagate_forward_time: 13.1505088806, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3642082214
validation[          , genome  7106] predictions:    9711/  10000 (97.11%), best:    9711/10000 (97.11%), error:      1011.95062, best error:      1011.95062 on epoch:    25, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 172.0188140869s, input_fired_time: 2.8512721062, output_fired_time: 1.9310004711, propagate_forward_time: 67.5439529419, propagate_backward_time: 96.3889465332, weight_update_time: 0.1478883326, other_time: 3.3036422729
epoch time: 13.3600540161s, input_fired_time: 0.1137484387, output_fired_time: 0.0000000000, propagate_forward_time: 12.9055433273, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3407621384
validation[          , genome  7106] predictions:    9701/  10000 (97.01%), best:    9711/10000 (97.11%), error:      1022.12958, best error:      1011.95062 on epoch:    25, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 170.2388000488s, input_fired_time: 2.0053825378, output_fired_time: 0.8865128160, propagate_forward_time: 67.8660659790, propagate_backward_time: 96.2070541382, weight_update_time: 0.1489433199, other_time: 3.2737731934
epoch time: 15.2113466263s, input_fired_time: 0.1807889491, output_fired_time: 0.0000000000, propagate_forward_time: 13.6919116974, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3386459351
validation[          , genome  7106] predictions:    9717/  10000 (97.17%), best:    9717/10000 (97.17%), error:       964.37170, best error:       964.37170 on epoch:    27, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 172.1654815674s, input_fired_time: 1.1418806314, output_fired_time: 0.8113482594, propagate_forward_time: 66.5239181519, propagate_backward_time: 98.3382263184, weight_update_time: 0.1460182369, other_time: 5.3501052856
epoch time: 14.3105144501s, input_fired_time: 0.1159596741, output_fired_time: 0.0000000000, propagate_forward_time: 13.8301296234, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3644247055
validation[          , genome  7106] predictions:    9703/  10000 (97.03%), best:    9717/10000 (97.17%), error:      1015.27576, best error:       964.37170 on epoch:    27, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 181.0364837646s, input_fired_time: 1.0138154030, output_fired_time: 0.8688569665, propagate_forward_time: 73.9217453003, propagate_backward_time: 101.7049484253, weight_update_time: 0.2213124931, other_time: 3.5271301270
epoch time: 14.9188489914s, input_fired_time: 0.1269544512, output_fired_time: 0.0000000000, propagate_forward_time: 14.2415370941, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5503578186
validation[          , genome  7106] predictions:    9668/  10000 (96.68%), best:    9717/10000 (97.17%), error:      1132.40723, best error:       964.37170 on epoch:    27, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 183.7998962402s, input_fired_time: 3.2512083054, output_fired_time: 2.0275838375, propagate_forward_time: 71.5591583252, propagate_backward_time: 101.4981842041, weight_update_time: 2.2219915390, other_time: 5.4637603760
epoch time: 15.4734535217s, input_fired_time: 0.1545066684, output_fired_time: 0.0000000000, propagate_forward_time: 14.9261369705, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3928098679
validation[          , genome  7106] predictions:    9650/  10000 (96.50%), best:    9717/10000 (97.17%), error:      1227.31421, best error:       964.37170 on epoch:    27, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 174.8356781006s, input_fired_time: 3.2211651802, output_fired_time: 0.9023396373, propagate_forward_time: 63.6176033020, propagate_backward_time: 103.8660812378, weight_update_time: 0.1614413559, other_time: 3.2284927368
epoch time: 12.7751483917s, input_fired_time: 0.1140382737, output_fired_time: 0.0000000000, propagate_forward_time: 12.3093252182, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3517847061
validation[          , genome  7106] predictions:    9683/  10000 (96.83%), best:    9717/10000 (97.17%), error:      1078.11816, best error:       964.37170 on epoch:    27, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 176.5406494141s, input_fired_time: 2.0952372551, output_fired_time: 1.0020025969, propagate_forward_time: 63.2239036560, propagate_backward_time: 105.7219848633, weight_update_time: 0.1833642125, other_time: 4.4975280762
epoch time: 14.8972930908s, input_fired_time: 0.1112386882, output_fired_time: 0.0000000000, propagate_forward_time: 14.4503202438, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3357343674
validation[          , genome  7106] predictions:    9721/  10000 (97.21%), best:    9717/10000 (97.17%), error:       964.58307, best error:       964.37170 on epoch:    27, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 185.3856353760s, input_fired_time: 1.0791375637, output_fired_time: 0.9075307250, propagate_forward_time: 66.3499603271, propagate_backward_time: 113.4404754639, weight_update_time: 0.1821012497, other_time: 3.6085357666
epoch time: 15.2958040237s, input_fired_time: 0.1863534898, output_fired_time: 0.0000000000, propagate_forward_time: 13.6615943909, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4478559494
validation[          , genome  7106] predictions:    9697/  10000 (96.97%), best:    9717/10000 (97.17%), error:      1004.24872, best error:       964.37170 on epoch:    27, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 182.5105285645s, input_fired_time: 1.0028150082, output_fired_time: 0.9717686176, propagate_forward_time: 74.9598312378, propagate_backward_time: 101.9386215210, weight_update_time: 0.1771734953, other_time: 3.6374969482
epoch time: 14.8484735489s, input_fired_time: 0.1111738458, output_fired_time: 0.0000000000, propagate_forward_time: 14.3511772156, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3861227036
validation[          , genome  7106] predictions:    9702/  10000 (97.02%), best:    9717/10000 (97.17%), error:      1084.11719, best error:       964.37170 on epoch:    27, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 179.9764556885s, input_fired_time: 1.0506215096, output_fired_time: 1.9874459505, propagate_forward_time: 72.8939895630, propagate_backward_time: 100.7520751953, weight_update_time: 0.1621956080, other_time: 3.2923202515
epoch time: 13.3560304642s, input_fired_time: 1.1176432371, output_fired_time: 0.0000000000, propagate_forward_time: 11.9183406830, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3200464249
validation[          , genome  7106] predictions:    9700/  10000 (97.00%), best:    9717/10000 (97.17%), error:      1004.65674, best error:       964.37170 on epoch:    27, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 177.7629547119s, input_fired_time: 4.2360639572, output_fired_time: 0.8739953637, propagate_forward_time: 72.7602157593, propagate_backward_time: 96.7300109863, weight_update_time: 0.1451788247, other_time: 3.1626663208
epoch time: 15.1363105774s, input_fired_time: 0.1753931344, output_fired_time: 0.0000000000, propagate_forward_time: 14.6234712601, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3374462128
validation[          , genome  7106] predictions:    9718/  10000 (97.18%), best:    9717/10000 (97.17%), error:       984.21375, best error:       964.37170 on epoch:    27, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 174.9099731445s, input_fired_time: 2.0666072369, output_fired_time: 0.8649923801, propagate_forward_time: 79.5166778564, propagate_backward_time: 88.0785675049, weight_update_time: 0.1433534622, other_time: 4.3831329346
epoch time: 13.5568761826s, input_fired_time: 0.2234264016, output_fired_time: 0.0000000000, propagate_forward_time: 12.0584897995, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2749595642
validation[          , genome  7106] predictions:    9654/  10000 (96.54%), best:    9717/10000 (97.17%), error:      1137.35669, best error:       964.37170 on epoch:    27, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 172.9049682617s, input_fired_time: 3.8890407085, output_fired_time: 2.8730854988, propagate_forward_time: 66.4342041016, propagate_backward_time: 95.2737426758, weight_update_time: 0.1757184118, other_time: 4.4348907471
epoch time: 15.1663732529s, input_fired_time: 0.1118836254, output_fired_time: 0.0000000000, propagate_forward_time: 14.6241598129, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4303302765
validation[          , genome  7106] predictions:    9677/  10000 (96.77%), best:    9717/10000 (97.17%), error:      1115.36694, best error:       964.37170 on epoch:    27, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 180.5076446533s, input_fired_time: 1.1793832779, output_fired_time: 0.9698259830, propagate_forward_time: 72.8051452637, propagate_backward_time: 103.0639343262, weight_update_time: 0.1761037856, other_time: 2.4893493652
epoch time: 15.2224378586s, input_fired_time: 0.1679785550, output_fired_time: 0.0000000000, propagate_forward_time: 14.6001720428, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4542875290
validation[          , genome  7106] predictions:    9569/  10000 (95.69%), best:    9717/10000 (97.17%), error:      1408.20081, best error:       964.37170 on epoch:    27, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 180.2586059570s, input_fired_time: 0.9351071119, output_fired_time: 0.9918259978, propagate_forward_time: 62.0434951782, propagate_backward_time: 112.9989929199, weight_update_time: 0.1692408472, other_time: 3.2891921997
epoch time: 15.0287170410s, input_fired_time: 1.1175473928, output_fired_time: 0.0000000000, propagate_forward_time: 12.4405097961, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4706602097
validation[          , genome  7106] predictions:    9716/  10000 (97.16%), best:    9716/10000 (97.16%), error:       951.49988, best error:       951.49988 on epoch:    40, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 180.3446655273s, input_fired_time: 2.0114555359, output_fired_time: 3.0307230949, propagate_forward_time: 68.5740203857, propagate_backward_time: 104.2149200439, weight_update_time: 0.2676472664, other_time: 2.5135498047
epoch time: 13.8856906891s, input_fired_time: 0.1370820254, output_fired_time: 0.0000000000, propagate_forward_time: 13.3714799881, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3771286011
validation[          , genome  7106] predictions:    9722/  10000 (97.22%), best:    9722/10000 (97.22%), error:       900.82874, best error:       900.82874 on epoch:    41, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 178.0483245850s, input_fired_time: 1.9950292110, output_fired_time: 0.9138739705, propagate_forward_time: 74.7393951416, propagate_backward_time: 97.9852676392, weight_update_time: 0.1853142381, other_time: 2.4147567749
epoch time: 14.6656360626s, input_fired_time: 0.1197811663, output_fired_time: 0.0000000000, propagate_forward_time: 14.1129674911, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4328870773
validation[          , genome  7106] predictions:    9697/  10000 (96.97%), best:    9722/10000 (97.22%), error:      1027.93860, best error:       900.82874 on epoch:    41, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 177.0037384033s, input_fired_time: 3.2093045712, output_fired_time: 2.9723899364, propagate_forward_time: 73.4436340332, propagate_backward_time: 92.7852783203, weight_update_time: 0.2351447195, other_time: 4.5931243896
epoch time: 15.7669162750s, input_fired_time: 0.1120792106, output_fired_time: 0.0000000000, propagate_forward_time: 15.2395257950, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4153108597
validation[          , genome  7106] predictions:    9705/  10000 (97.05%), best:    9722/10000 (97.22%), error:       956.75031, best error:       900.82874 on epoch:    41, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 182.9084930420s, input_fired_time: 0.9478321671, output_fired_time: 0.8564107418, propagate_forward_time: 70.0958099365, propagate_backward_time: 107.2272491455, weight_update_time: 0.2266665995, other_time: 3.7811889648
epoch time: 15.2929306030s, input_fired_time: 1.1838344336, output_fired_time: 0.0000000000, propagate_forward_time: 13.7483673096, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3607292175
validation[          , genome  7106] predictions:    9689/  10000 (96.89%), best:    9722/10000 (97.22%), error:       994.31250, best error:       900.82874 on epoch:    41, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 183.9394378662s, input_fired_time: 2.2801978588, output_fired_time: 0.9654385448, propagate_forward_time: 73.1980667114, propagate_backward_time: 104.9162063599, weight_update_time: 0.1433216035, other_time: 2.5795288086
epoch time: 14.9817886353s, input_fired_time: 0.1355162412, output_fired_time: 0.0000000000, propagate_forward_time: 14.4811210632, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3651514053
validation[          , genome  7106] predictions:    9686/  10000 (96.86%), best:    9722/10000 (97.22%), error:      1088.05835, best error:       900.82874 on epoch:    41, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 183.1638336182s, input_fired_time: 0.9412582517, output_fired_time: 1.9417918921, propagate_forward_time: 63.9937820435, propagate_backward_time: 111.6819229126, weight_update_time: 0.2148112208, other_time: 4.6050872803
epoch time: 13.9029855728s, input_fired_time: 0.1112183407, output_fired_time: 0.0000000000, propagate_forward_time: 13.4388513565, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3529157639
validation[          , genome  7106] predictions:    9701/  10000 (97.01%), best:    9722/10000 (97.22%), error:      1001.04303, best error:       900.82874 on epoch:    41, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 187.6587982178s, input_fired_time: 1.0427412987, output_fired_time: 0.9705528617, propagate_forward_time: 81.9648590088, propagate_backward_time: 101.0376663208, weight_update_time: 0.1790282726, other_time: 2.6429824829
epoch time: 15.1096534729s, input_fired_time: 0.2004896700, output_fired_time: 0.0000000000, propagate_forward_time: 13.5268173218, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3823461533
validation[          , genome  7106] predictions:    9732/  10000 (97.32%), best:    9722/10000 (97.22%), error:       919.16248, best error:       900.82874 on epoch:    41, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 184.9183502197s, input_fired_time: 2.1087219715, output_fired_time: 1.0970969200, propagate_forward_time: 64.7076644897, propagate_backward_time: 113.2550659180, weight_update_time: 0.2189344913, other_time: 3.7498092651
epoch time: 15.4656963348s, input_fired_time: 0.1107693762, output_fired_time: 0.0000000000, propagate_forward_time: 14.9819869995, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3729400635
validation[          , genome  7106] predictions:    9743/  10000 (97.43%), best:    9722/10000 (97.22%), error:       903.35785, best error:       900.82874 on epoch:    41, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 177.3324279785s, input_fired_time: 2.0164463520, output_fired_time: 1.9646673203, propagate_forward_time: 68.9215011597, propagate_backward_time: 98.9667739868, weight_update_time: 0.1437419355, other_time: 5.4630432129
epoch time: 13.5949888229s, input_fired_time: 0.1114804521, output_fired_time: 0.0000000000, propagate_forward_time: 13.1221008301, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3614072800
validation[          , genome  7106] predictions:    9613/  10000 (96.13%), best:    9722/10000 (97.22%), error:      1298.02930, best error:       900.82874 on epoch:    41, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 185.8152313232s, input_fired_time: 1.1834295988, output_fired_time: 2.0875241756, propagate_forward_time: 74.8534698486, propagate_backward_time: 105.1006393433, weight_update_time: 0.1512846500, other_time: 2.5901718140
epoch time: 14.9835100174s, input_fired_time: 0.1213640422, output_fired_time: 0.0000000000, propagate_forward_time: 14.5316390991, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3305072784
validation[          , genome  7106] predictions:    9701/  10000 (97.01%), best:    9722/10000 (97.22%), error:       980.31561, best error:       900.82874 on epoch:    41, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 185.1852722168s, input_fired_time: 1.0935508013, output_fired_time: 0.9482266307, propagate_forward_time: 74.6857528687, propagate_backward_time: 104.1343536377, weight_update_time: 0.1639697254, other_time: 4.3233871460
epoch time: 14.9505739212s, input_fired_time: 0.1139690802, output_fired_time: 0.0000000000, propagate_forward_time: 14.4742479324, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3623571396
validation[          , genome  7106] predictions:    9685/  10000 (96.85%), best:    9722/10000 (97.22%), error:      1047.60034, best error:       900.82874 on epoch:    41, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 175.7363739014s, input_fired_time: 1.0873548985, output_fired_time: 3.1348731518, propagate_forward_time: 67.8553085327, propagate_backward_time: 99.2920227051, weight_update_time: 1.2222503424, other_time: 4.3668136597
epoch time: 15.3561716080s, input_fired_time: 0.1173040941, output_fired_time: 0.0000000000, propagate_forward_time: 14.8574619293, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3814058304
validation[          , genome  7106] predictions:    9504/  10000 (95.04%), best:    9722/10000 (97.22%), error:      1660.49756, best error:       900.82874 on epoch:    41, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 178.0156097412s, input_fired_time: 1.1256842613, output_fired_time: 0.8682816029, propagate_forward_time: 75.1371231079, propagate_backward_time: 96.6181869507, weight_update_time: 0.1595117897, other_time: 4.2663269043
epoch time: 14.5615158081s, input_fired_time: 0.1129137054, output_fired_time: 0.0000000000, propagate_forward_time: 14.1248092651, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3237924576
validation[          , genome  7106] predictions:    9746/  10000 (97.46%), best:    9722/10000 (97.22%), error:       921.48071, best error:       900.82874 on epoch:    41, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 175.7279052734s, input_fired_time: 2.0500471592, output_fired_time: 0.9781381488, propagate_forward_time: 74.4357604980, propagate_backward_time: 93.8566894531, weight_update_time: 0.1850980967, other_time: 4.4072723389
epoch time: 14.4739847183s, input_fired_time: 0.1140972301, output_fired_time: 0.0000000000, propagate_forward_time: 14.0455036163, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3143835068
validation[          , genome  7106] predictions:    9698/  10000 (96.98%), best:    9722/10000 (97.22%), error:      1028.06238, best error:       900.82874 on epoch:    41, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 176.8969879150s, input_fired_time: 1.2419710159, output_fired_time: 2.1414487362, propagate_forward_time: 64.0210418701, propagate_backward_time: 106.0394439697, weight_update_time: 1.2233071327, other_time: 3.4530792236
epoch time: 13.4363708496s, input_fired_time: 0.1457407624, output_fired_time: 0.0000000000, propagate_forward_time: 12.9459085464, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3447217941
validation[          , genome  7106] predictions:    9707/  10000 (97.07%), best:    9722/10000 (97.22%), error:      1021.08374, best error:       900.82874 on epoch:    41, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 182.4564819336s, input_fired_time: 1.0101009607, output_fired_time: 2.0316407681, propagate_forward_time: 65.4028549194, propagate_backward_time: 104.3296737671, weight_update_time: 0.1531120688, other_time: 9.6822052002
epoch time: 14.9637804031s, input_fired_time: 1.1691882610, output_fired_time: 0.0000000000, propagate_forward_time: 13.4537239075, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3408679962
validation[          , genome  7106] predictions:    9686/  10000 (96.86%), best:    9722/10000 (97.22%), error:      1051.34216, best error:       900.82874 on epoch:    41, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 177.7802124023s, input_fired_time: 1.0883176327, output_fired_time: 3.0147759914, propagate_forward_time: 71.6034469604, propagate_backward_time: 97.4074249268, weight_update_time: 0.1461219639, other_time: 4.6662521362
epoch time: 15.4534559250s, input_fired_time: 0.1894986331, output_fired_time: 0.0000000000, propagate_forward_time: 14.8549041748, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4090528488
validation[          , genome  7106] predictions:    9728/  10000 (97.28%), best:    9722/10000 (97.22%), error:       941.22369, best error:       900.82874 on epoch:    41, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 179.4886322021s, input_fired_time: 1.0034865141, output_fired_time: 0.9550125003, propagate_forward_time: 70.5566711426, propagate_backward_time: 100.3332672119, weight_update_time: 0.1609224528, other_time: 6.6401977539
epoch time: 16.9908962250s, input_fired_time: 1.0386642218, output_fired_time: 0.0000000000, propagate_forward_time: 15.6022996902, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3499326706
validation[          , genome  7106] predictions:    9556/  10000 (95.56%), best:    9722/10000 (97.22%), error:      1405.49390, best error:       900.82874 on epoch:    41, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 177.5903472900s, input_fired_time: 2.1101956367, output_fired_time: 0.9072700739, propagate_forward_time: 68.6998672485, propagate_backward_time: 101.5780868530, weight_update_time: 0.1478196681, other_time: 4.2949218750
epoch time: 15.0310811996s, input_fired_time: 0.1654713154, output_fired_time: 0.0000000000, propagate_forward_time: 14.4997053146, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3659048080
validation[          , genome  7106] predictions:    9719/  10000 (97.19%), best:    9722/10000 (97.22%), error:       945.21558, best error:       900.82874 on epoch:    41, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 180.3733215332s, input_fired_time: 2.3059983253, output_fired_time: 2.0155081749, propagate_forward_time: 71.3914108276, propagate_backward_time: 99.9045562744, weight_update_time: 0.1588978469, other_time: 4.7558517456
epoch time: 14.7986459732s, input_fired_time: 0.1149744317, output_fired_time: 0.0000000000, propagate_forward_time: 14.2444744110, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4391975403
validation[          , genome  7106] predictions:    9727/  10000 (97.27%), best:    9722/10000 (97.22%), error:       929.71564, best error:       900.82874 on epoch:    41, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 181.1723937988s, input_fired_time: 1.0668765306, output_fired_time: 3.9850380421, propagate_forward_time: 69.8475112915, propagate_backward_time: 100.6093521118, weight_update_time: 0.1742152125, other_time: 5.6636199951
epoch time: 14.6690206528s, input_fired_time: 0.1504694968, output_fired_time: 0.0000000000, propagate_forward_time: 14.1294240952, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3891267776
validation[          , genome  7106] predictions:    9668/  10000 (96.68%), best:    9722/10000 (97.22%), error:      1089.52454, best error:       900.82874 on epoch:    41, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 192.5960388184s, input_fired_time: 2.1638791561, output_fired_time: 1.8030983210, propagate_forward_time: 70.8912200928, propagate_backward_time: 115.2144699097, weight_update_time: 0.1447743922, other_time: 2.5233688354
epoch time: 14.5592660904s, input_fired_time: 1.1390919685, output_fired_time: 0.0000000000, propagate_forward_time: 13.0470132828, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3731603622
validation[          , genome  7106] predictions:    9744/  10000 (97.44%), best:    9722/10000 (97.22%), error:       924.22571, best error:       900.82874 on epoch:    41, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 172.4511718750s, input_fired_time: 1.0668969154, output_fired_time: 0.9036915302, propagate_forward_time: 71.0578613281, propagate_backward_time: 95.9325866699, weight_update_time: 0.1472106576, other_time: 3.4901428223
epoch time: 14.2730798721s, input_fired_time: 0.2285813689, output_fired_time: 0.0000000000, propagate_forward_time: 13.6702194214, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3742790222
validation[          , genome  7106] predictions:    9735/  10000 (97.35%), best:    9722/10000 (97.22%), error:       938.52362, best error:       900.82874 on epoch:    41, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 170.7967071533s, input_fired_time: 2.0391275883, output_fired_time: 0.9931229949, propagate_forward_time: 69.4659881592, propagate_backward_time: 92.8666915894, weight_update_time: 0.2043340355, other_time: 5.4317855835
epoch time: 14.8859224319s, input_fired_time: 1.1493688822, output_fired_time: 0.0000000000, propagate_forward_time: 12.3006467819, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4359064102
validation[          , genome  7106] predictions:    9686/  10000 (96.86%), best:    9722/10000 (97.22%), error:      1040.90576, best error:       900.82874 on epoch:    41, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 181.7806549072s, input_fired_time: 2.0295937061, output_fired_time: 2.9983265400, propagate_forward_time: 71.6016693115, propagate_backward_time: 99.2637710571, weight_update_time: 0.1981839985, other_time: 5.8873062134
epoch time: 14.9090356827s, input_fired_time: 0.2145177275, output_fired_time: 0.0000000000, propagate_forward_time: 12.2812805176, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4132375717
validation[          , genome  7106] predictions:    9697/  10000 (96.97%), best:    9722/10000 (97.22%), error:      1049.47473, best error:       900.82874 on epoch:    41, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 174.3515167236s, input_fired_time: 3.0849342346, output_fired_time: 1.8642922640, propagate_forward_time: 65.9526290894, propagate_backward_time: 100.1247863770, weight_update_time: 0.1545339823, other_time: 3.3248825073
epoch time: 13.1780824661s, input_fired_time: 0.1160246357, output_fired_time: 0.0000000000, propagate_forward_time: 11.6936349869, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3684225082
validation[          , genome  7106] predictions:    9683/  10000 (96.83%), best:    9722/10000 (97.22%), error:      1074.72827, best error:       900.82874 on epoch:    41, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 192.1017456055s, input_fired_time: 1.0721774101, output_fired_time: 2.9260685444, propagate_forward_time: 81.6474685669, propagate_backward_time: 102.0658111572, weight_update_time: 0.1514103264, other_time: 4.3902206421
epoch time: 15.0619201660s, input_fired_time: 0.1362568438, output_fired_time: 0.0000000000, propagate_forward_time: 14.5678720474, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3577909470
validation[          , genome  7106] predictions:    9717/  10000 (97.17%), best:    9722/10000 (97.22%), error:       962.21594, best error:       900.82874 on epoch:    41, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 184.5577697754s, input_fired_time: 1.1343719959, output_fired_time: 1.8873524666, propagate_forward_time: 72.4299697876, propagate_backward_time: 105.5714721680, weight_update_time: 0.1897634864, other_time: 3.5345993042
epoch time: 13.0266523361s, input_fired_time: 0.1203464121, output_fired_time: 0.0000000000, propagate_forward_time: 12.5604705811, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3458356857
validation[          , genome  7106] predictions:    9720/  10000 (97.20%), best:    9722/10000 (97.22%), error:       958.14575, best error:       900.82874 on epoch:    41, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 176.4444885254s, input_fired_time: 1.0633380413, output_fired_time: 1.8398429155, propagate_forward_time: 67.3479766846, propagate_backward_time: 98.5469665527, weight_update_time: 2.2833805084, other_time: 7.6463623047
epoch time: 15.4167861938s, input_fired_time: 1.3163666725, output_fired_time: 0.0000000000, propagate_forward_time: 13.7379264832, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3624935150
validation[          , genome  7106] predictions:    9719/  10000 (97.19%), best:    9722/10000 (97.22%), error:      1004.49677, best error:       900.82874 on epoch:    41, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 182.1535949707s, input_fired_time: 1.0409700871, output_fired_time: 2.9130394459, propagate_forward_time: 69.2139663696, propagate_backward_time: 103.2318191528, weight_update_time: 0.1937353909, other_time: 5.7537994385
epoch time: 14.6781826019s, input_fired_time: 0.1363469809, output_fired_time: 0.0000000000, propagate_forward_time: 14.1524686813, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3893671036
validation[          , genome  7106] predictions:    9664/  10000 (96.64%), best:    9722/10000 (97.22%), error:      1157.94067, best error:       900.82874 on epoch:    41, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 180.7201385498s, input_fired_time: 2.0056457520, output_fired_time: 0.9183931947, propagate_forward_time: 73.5135498047, propagate_backward_time: 98.6541137695, weight_update_time: 0.1503179967, other_time: 5.6284332275
epoch time: 16.2607231140s, input_fired_time: 0.1172797531, output_fired_time: 0.0000000000, propagate_forward_time: 15.7234973907, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4199466705
validation[          , genome  7106] predictions:    9691/  10000 (96.91%), best:    9722/10000 (97.22%), error:      1049.55579, best error:       900.82874 on epoch:    41, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 180.5136108398s, input_fired_time: 2.0572075844, output_fired_time: 0.9463950396, propagate_forward_time: 71.5138854980, propagate_backward_time: 100.3870315552, weight_update_time: 0.1711594164, other_time: 5.6090927124
epoch time: 15.2114248276s, input_fired_time: 0.1376765221, output_fired_time: 0.0000000000, propagate_forward_time: 14.6739549637, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3997936249
validation[          , genome  7106] predictions:    9716/  10000 (97.16%), best:    9722/10000 (97.22%), error:       984.51593, best error:       900.82874 on epoch:    41, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 179.7635192871s, input_fired_time: 2.1365022659, output_fired_time: 0.9374466538, propagate_forward_time: 63.2454261780, propagate_backward_time: 107.8250961304, weight_update_time: 0.1612888575, other_time: 5.6190414429
epoch time: 44.4079360962s, input_fired_time: 0.1167929992, output_fired_time: 0.0000000000, propagate_forward_time: 43.9327774048, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3583641052
validation[          , genome  7106] predictions:    9728/  10000 (97.28%), best:    9722/10000 (97.22%), error:       942.80603, best error:       900.82874 on epoch:    41, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 176.9439697266s, input_fired_time: 0.9604179859, output_fired_time: 0.8138988614, propagate_forward_time: 66.4147186279, propagate_backward_time: 102.1996688843, weight_update_time: 0.2590845227, other_time: 6.5552597046
epoch time: 15.0176067352s, input_fired_time: 0.1270835996, output_fired_time: 0.0000000000, propagate_forward_time: 14.4938087463, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3967142105
validation[          , genome  7106] predictions:    9684/  10000 (96.84%), best:    9722/10000 (97.22%), error:      1137.13379, best error:       900.82874 on epoch:    41, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 170.3441619873s, input_fired_time: 3.0287544727, output_fired_time: 0.8280982375, propagate_forward_time: 68.9582443237, propagate_backward_time: 95.1506652832, weight_update_time: 0.1539905220, other_time: 2.3784103394
epoch time: 14.6633443832s, input_fired_time: 0.1276935041, output_fired_time: 0.0000000000, propagate_forward_time: 13.1983604431, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3372907639
validation[          , genome  7106] predictions:    9735/  10000 (97.35%), best:    9722/10000 (97.22%), error:       927.60004, best error:       900.82874 on epoch:    41, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 177.4803619385s, input_fired_time: 1.0894510746, output_fired_time: 0.8642400503, propagate_forward_time: 74.8634643555, propagate_backward_time: 97.2071990967, weight_update_time: 0.1461916864, other_time: 3.4560089111
epoch time: 15.1295747757s, input_fired_time: 0.1159461141, output_fired_time: 0.0000000000, propagate_forward_time: 14.6872119904, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3264169693
validation[          , genome  7106] predictions:    9733/  10000 (97.33%), best:    9722/10000 (97.22%), error:       944.38568, best error:       900.82874 on epoch:    41, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 209.4930114746s, input_fired_time: 1.0679712296, output_fired_time: 0.8834841847, propagate_forward_time: 74.6931533813, propagate_backward_time: 111.5682144165, weight_update_time: 0.1444787383, other_time: 21.2801742554
epoch time: 14.9262351990s, input_fired_time: 1.2211641073, output_fired_time: 0.0000000000, propagate_forward_time: 12.4429311752, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2621402740
validation[          , genome  7106] predictions:    9707/  10000 (97.07%), best:    9722/10000 (97.22%), error:      1017.37823, best error:       900.82874 on epoch:    41, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 179.8313598633s, input_fired_time: 1.0578328371, output_fired_time: 0.8510954380, propagate_forward_time: 73.0592956543, propagate_backward_time: 101.4868011475, weight_update_time: 0.1674290895, other_time: 3.3763427734
epoch time: 13.2468042374s, input_fired_time: 0.1690872610, output_fired_time: 0.0000000000, propagate_forward_time: 12.7361392975, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3415775299
validation[          , genome  7106] predictions:    9695/  10000 (96.95%), best:    9722/10000 (97.22%), error:      1040.32214, best error:       900.82874 on epoch:    41, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 175.3698425293s, input_fired_time: 2.0953679085, output_fired_time: 0.8309118152, propagate_forward_time: 65.2244644165, propagate_backward_time: 104.8015747070, weight_update_time: 0.1646732688, other_time: 2.4175186157
epoch time: 14.6722316742s, input_fired_time: 0.1379183680, output_fired_time: 0.0000000000, propagate_forward_time: 13.1386041641, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3957090378
validation[          , genome  7106] predictions:    9725/  10000 (97.25%), best:    9722/10000 (97.22%), error:       961.72058, best error:       900.82874 on epoch:    41, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 182.2609558105s, input_fired_time: 2.1457533836, output_fired_time: 0.8944897652, propagate_forward_time: 62.8647651672, propagate_backward_time: 112.7247161865, weight_update_time: 0.1426674724, other_time: 3.6312408447
epoch time: 14.8684759140s, input_fired_time: 0.1299890578, output_fired_time: 0.0000000000, propagate_forward_time: 14.3848829269, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3536043167
validation[          , genome  7106] predictions:    9714/  10000 (97.14%), best:    9722/10000 (97.22%), error:       970.19757, best error:       900.82874 on epoch:    41, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 173.2779693604s, input_fired_time: 2.0859668255, output_fired_time: 0.8812996149, propagate_forward_time: 61.4937133789, propagate_backward_time: 104.3249816895, weight_update_time: 0.1528000087, other_time: 4.4920043945
epoch time: 14.5830507278s, input_fired_time: 0.1163279936, output_fired_time: 0.0000000000, propagate_forward_time: 12.0797739029, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3869485855
validation[          , genome  7106] predictions:    9717/  10000 (97.17%), best:    9722/10000 (97.22%), error:       959.26837, best error:       900.82874 on epoch:    41, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 176.6575469971s, input_fired_time: 1.1105878353, output_fired_time: 1.9287667274, propagate_forward_time: 80.4942169189, propagate_backward_time: 87.2956695557, weight_update_time: 0.2390715033, other_time: 5.8283081055
epoch time: 13.4362554550s, input_fired_time: 0.1473733485, output_fired_time: 0.0000000000, propagate_forward_time: 12.8962221146, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3926601410
validation[          , genome  7106] predictions:    9728/  10000 (97.28%), best:    9722/10000 (97.22%), error:       927.26129, best error:       900.82874 on epoch:    41, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 186.6231994629s, input_fired_time: 1.1392635107, output_fired_time: 5.0439372063, propagate_forward_time: 66.5460433960, propagate_backward_time: 107.5614471436, weight_update_time: 0.1509346962, other_time: 6.3325119019
epoch time: 15.4511575699s, input_fired_time: 0.1201986820, output_fired_time: 0.0000000000, propagate_forward_time: 14.9806938171, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3502655029
validation[          , genome  7106] predictions:    9739/  10000 (97.39%), best:    9722/10000 (97.22%), error:       939.52228, best error:       900.82874 on epoch:    41, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 185.0064086914s, input_fired_time: 1.0108963251, output_fired_time: 2.0441613197, propagate_forward_time: 68.0352249146, propagate_backward_time: 110.4811553955, weight_update_time: 0.1761832684, other_time: 3.4349746704
epoch time: 14.9465284348s, input_fired_time: 0.1164689362, output_fired_time: 0.0000000000, propagate_forward_time: 14.4690675735, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3609914780
validation[          , genome  7106] predictions:    9746/  10000 (97.46%), best:    9746/10000 (97.46%), error:       898.89941, best error:       898.89941 on epoch:    84, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 176.7554168701s, input_fired_time: 2.2430722713, output_fired_time: 1.9926639795, propagate_forward_time: 52.6318550110, propagate_backward_time: 115.4431762695, weight_update_time: 0.1506055444, other_time: 4.4446563721
epoch time: 15.1606168747s, input_fired_time: 0.1249422804, output_fired_time: 0.0000000000, propagate_forward_time: 14.7137165070, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3219585419
validation[          , genome  7106] predictions:    9689/  10000 (96.89%), best:    9746/10000 (97.46%), error:      1056.90308, best error:       898.89941 on epoch:    84, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 175.3443908691s, input_fired_time: 3.1672089100, output_fired_time: 0.8514322042, propagate_forward_time: 68.6092453003, propagate_backward_time: 98.3750534058, weight_update_time: 0.1535660774, other_time: 4.3414611816
epoch time: 14.4665298462s, input_fired_time: 0.1160660088, output_fired_time: 0.0000000000, propagate_forward_time: 14.0126180649, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3378458023
validation[          , genome  7106] predictions:    9726/  10000 (97.26%), best:    9746/10000 (97.46%), error:       922.67450, best error:       898.89941 on epoch:    84, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 179.8404693604s, input_fired_time: 1.9729138613, output_fired_time: 3.1538238525, propagate_forward_time: 77.8414001465, propagate_backward_time: 94.5465316772, weight_update_time: 0.1537716985, other_time: 2.3257980347
epoch time: 14.4889354706s, input_fired_time: 0.1279467195, output_fired_time: 0.0000000000, propagate_forward_time: 13.0372400284, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3237485886
validation[          , genome  7106] predictions:    9711/  10000 (97.11%), best:    9746/10000 (97.46%), error:       978.58490, best error:       898.89941 on epoch:    84, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 172.6592254639s, input_fired_time: 2.0761756897, output_fired_time: 1.9156235456, propagate_forward_time: 67.5157165527, propagate_backward_time: 95.6573181152, weight_update_time: 0.1505707651, other_time: 5.4944000244
epoch time: 14.8400030136s, input_fired_time: 0.1191926301, output_fired_time: 0.0000000000, propagate_forward_time: 14.3811740875, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3396358490
validation[          , genome  7106] predictions:    9701/  10000 (97.01%), best:    9746/10000 (97.46%), error:       974.02606, best error:       898.89941 on epoch:    84, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 177.8164367676s, input_fired_time: 2.1578159332, output_fired_time: 1.0389518738, propagate_forward_time: 74.1195831299, propagate_backward_time: 94.9842453003, weight_update_time: 0.1729160845, other_time: 5.5158309937
epoch time: 14.6854257584s, input_fired_time: 0.1172016412, output_fired_time: 0.0000000000, propagate_forward_time: 13.2596788406, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3085451126
validation[          , genome  7106] predictions:    9743/  10000 (97.43%), best:    9743/10000 (97.43%), error:       896.20422, best error:       896.20422 on epoch:    89, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 179.5886840820s, input_fired_time: 3.0398113728, output_fired_time: 0.8899012208, propagate_forward_time: 71.9415664673, propagate_backward_time: 100.3682327271, weight_update_time: 0.2514391840, other_time: 3.3491668701
epoch time: 14.7148275375s, input_fired_time: 0.1369088739, output_fired_time: 0.0000000000, propagate_forward_time: 14.2031164169, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3748025894
validation[          , genome  7106] predictions:    9734/  10000 (97.34%), best:    9743/10000 (97.43%), error:       905.59241, best error:       896.20422 on epoch:    89, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 182.8151245117s, input_fired_time: 3.1565923691, output_fired_time: 0.9399976730, propagate_forward_time: 69.8291702271, propagate_backward_time: 104.3822097778, weight_update_time: 0.1479648650, other_time: 4.5071563721
epoch time: 15.3376436234s, input_fired_time: 0.1561127752, output_fired_time: 0.0000000000, propagate_forward_time: 14.8447599411, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3367710114
validation[          , genome  7106] predictions:    9722/  10000 (97.22%), best:    9743/10000 (97.43%), error:       952.30774, best error:       896.20422 on epoch:    89, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 178.1318511963s, input_fired_time: 2.0428173542, output_fired_time: 0.8302196264, propagate_forward_time: 71.9963607788, propagate_backward_time: 99.4169616699, weight_update_time: 0.1431734115, other_time: 3.8454971313
epoch time: 14.8958587646s, input_fired_time: 0.1860000342, output_fired_time: 0.0000000000, propagate_forward_time: 14.3922090530, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3176498413
validation[          , genome  7106] predictions:    9734/  10000 (97.34%), best:    9743/10000 (97.43%), error:       918.28363, best error:       896.20422 on epoch:    89, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 179.7377014160s, input_fired_time: 2.1925883293, output_fired_time: 0.9091742039, propagate_forward_time: 65.5622406006, propagate_backward_time: 105.7225494385, weight_update_time: 0.1591698676, other_time: 5.3511505127
epoch time: 14.6122426987s, input_fired_time: 0.1667004526, output_fired_time: 0.0000000000, propagate_forward_time: 13.0879745483, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3575677872
validation[          , genome  7106] predictions:    9729/  10000 (97.29%), best:    9743/10000 (97.43%), error:       922.01068, best error:       896.20422 on epoch:    89, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 194.4675903320s, input_fired_time: 3.0334823132, output_fired_time: 1.8413270712, propagate_forward_time: 72.5606079102, propagate_backward_time: 114.8266372681, weight_update_time: 0.1755347252, other_time: 2.2055435181
epoch time: 13.4343404770s, input_fired_time: 0.1201324910, output_fired_time: 0.0000000000, propagate_forward_time: 12.9783525467, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3358554840
validation[          , genome  7106] predictions:    9724/  10000 (97.24%), best:    9743/10000 (97.43%), error:       976.94885, best error:       896.20422 on epoch:    89, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 172.3555603027s, input_fired_time: 0.9985409975, output_fired_time: 1.9531487226, propagate_forward_time: 69.9844436646, propagate_backward_time: 96.2310256958, weight_update_time: 0.2096726149, other_time: 3.1884002686
epoch time: 13.4942493439s, input_fired_time: 0.1731164604, output_fired_time: 0.0000000000, propagate_forward_time: 12.9717226028, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3494100571
validation[          , genome  7106] predictions:    9691/  10000 (96.91%), best:    9743/10000 (97.43%), error:      1024.66077, best error:       896.20422 on epoch:    89, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 172.4350280762s, input_fired_time: 2.1420497894, output_fired_time: 1.9205678701, propagate_forward_time: 61.3931694031, propagate_backward_time: 102.8099441528, weight_update_time: 1.1761679649, other_time: 4.1693038940
epoch time: 14.9957132339s, input_fired_time: 0.1169068664, output_fired_time: 0.0000000000, propagate_forward_time: 13.4343681335, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4444379807
validation[          , genome  7106] predictions:    9735/  10000 (97.35%), best:    9743/10000 (97.43%), error:       936.63470, best error:       896.20422 on epoch:    89, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 181.0604858398s, input_fired_time: 1.1170356274, output_fired_time: 2.9177436829, propagate_forward_time: 70.3010559082, propagate_backward_time: 104.3064575195, weight_update_time: 0.1545253098, other_time: 2.4181976318
epoch time: 13.6901302338s, input_fired_time: 0.1159754992, output_fired_time: 0.0000000000, propagate_forward_time: 13.1878509521, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3863039017
validation[          , genome  7106] predictions:    9734/  10000 (97.34%), best:    9743/10000 (97.43%), error:       912.39825, best error:       896.20422 on epoch:    89, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 198.8126373291s, input_fired_time: 1.9870594740, output_fired_time: 0.8538743854, propagate_forward_time: 79.1815719604, propagate_backward_time: 113.5370254517, weight_update_time: 0.1864496469, other_time: 3.2530975342
epoch time: 13.4436721802s, input_fired_time: 0.1183520481, output_fired_time: 0.0000000000, propagate_forward_time: 12.9859085083, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3394117355
validation[          , genome  7106] predictions:    9723/  10000 (97.23%), best:    9743/10000 (97.43%), error:       954.74573, best error:       896.20422 on epoch:    89, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 173.9370269775s, input_fired_time: 1.1150391102, output_fired_time: 0.9129462838, propagate_forward_time: 74.0610351563, propagate_backward_time: 93.4503021240, weight_update_time: 0.1666104198, other_time: 4.3977050781
epoch time: 14.5882139206s, input_fired_time: 0.1294022352, output_fired_time: 0.0000000000, propagate_forward_time: 13.1208486557, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3379631042
validation[          , genome  7106] predictions:    9714/  10000 (97.14%), best:    9743/10000 (97.43%), error:       940.67682, best error:       896.20422 on epoch:    89, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 202.7050323486s, input_fired_time: 2.1124231815, output_fired_time: 1.9623878002, propagate_forward_time: 67.7155075073, propagate_backward_time: 127.5238571167, weight_update_time: 0.1695341617, other_time: 3.3908462524
epoch time: 14.2002420425s, input_fired_time: 0.1139215827, output_fired_time: 0.0000000000, propagate_forward_time: 12.7590065002, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3273143768
validation[          , genome  7106] predictions:    9736/  10000 (97.36%), best:    9743/10000 (97.43%), error:       935.61407, best error:       896.20422 on epoch:    89, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 72.2383728027s, input_fired_time: 2.7480370998, output_fired_time: 0.0000000000, propagate_forward_time: 66.5673065186, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9230270386
best training[          , genome  7106] predictions:   49509/  50000 (99.02%), best:    9743/10000 (97.43%), error:      2002.30322, best error:       896.20422 on epoch:    89, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 14.8451929092s, input_fired_time: 1.1179454327, output_fired_time: 0.0000000000, propagate_forward_time: 13.3717956543, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3554515839
   testing[          , genome  7106] predictions:    9759/  10000 (97.59%), best:    9743/10000 (97.43%), error:       809.74078, best error:       896.20422 on epoch:    89, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
07:15:06 (10700): called boinc_finish(0)

</stderr_txt>
]]>