Nameexact_genome_1512568488_43_6411_1
Workunit2603357
Created7 Dec 2017, 19:42:26 UTC
Sent7 Dec 2017, 19:47:36 UTC
Report deadline18 Dec 2017, 1:26:45 UTC
Received8 Dec 2017, 13:37:37 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID55108
Run time5 hours 41 min 51 sec
CPU time5 hours 30 min 40 sec
Validate stateValid
Credit2,558.88
Device peak FLOPS2.57 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size155.52 MB
Peak swap size158.87 MB
Peak disk usage2.01 MB

Stderr output

<core_client_version>7.8.2</core_client_version>
<![CDATA[
<stderr_txt>
054.40906 on epoch:     8, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 189.3674316406s, input_fired_time: 1.8119808435, output_fired_time: 1.5999461412, propagate_forward_time: 72.2311782837, propagate_backward_time: 110.1481018066, weight_update_time: 0.1754443049, other_time: 3.5762252808
epoch time: 15.6101856232s, input_fired_time: 0.2326295525, output_fired_time: 0.0000000000, propagate_forward_time: 14.7376747131, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6398811340
validation[          , genome  6411] predictions:    9616/  10000 (96.16%), best:    9699/10000 (96.99%), error:      1197.62585, best error:      1054.40906 on epoch:     8, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 195.4344940186s, input_fired_time: 1.8369742632, output_fired_time: 1.6730213165, propagate_forward_time: 72.5111999512, propagate_backward_time: 113.8612442017, weight_update_time: 0.1762731522, other_time: 5.5520553589
epoch time: 15.6576566696s, input_fired_time: 0.2349288166, output_fired_time: 0.0000000000, propagate_forward_time: 14.7767572403, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6459703445
validation[          , genome  6411] predictions:    9648/  10000 (96.48%), best:    9699/10000 (96.99%), error:      1154.45459, best error:      1054.40906 on epoch:     8, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 188.8517913818s, input_fired_time: 1.8172471523, output_fired_time: 1.6183638573, propagate_forward_time: 71.1896286011, propagate_backward_time: 110.6173171997, weight_update_time: 0.1768634915, other_time: 3.6092376709
epoch time: 15.6734685898s, input_fired_time: 0.2283724248, output_fired_time: 0.0000000000, propagate_forward_time: 14.8198890686, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6252069473
validation[          , genome  6411] predictions:    9728/  10000 (97.28%), best:    9728/10000 (97.28%), error:       931.68970, best error:       931.68970 on epoch:    17, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 191.0277252197s, input_fired_time: 1.8160213232, output_fired_time: 1.6067028046, propagate_forward_time: 72.4081802368, propagate_backward_time: 111.6142196655, weight_update_time: 0.1791037470, other_time: 3.5825958252
epoch time: 14.0342636108s, input_fired_time: 0.2259797305, output_fired_time: 0.0000000000, propagate_forward_time: 13.1867227554, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6215610504
validation[          , genome  6411] predictions:    9699/  10000 (96.99%), best:    9728/10000 (97.28%), error:      1018.95557, best error:       931.68970 on epoch:    17, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 207.3963470459s, input_fired_time: 1.9578462839, output_fired_time: 1.6892566681, propagate_forward_time: 78.9666519165, propagate_backward_time: 120.8867187500, weight_update_time: 0.1864032000, other_time: 3.8958816528
epoch time: 14.2356004715s, input_fired_time: 0.2280068845, output_fired_time: 0.0000000000, propagate_forward_time: 13.3733968735, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6341962814
validation[          , genome  6411] predictions:    9713/  10000 (97.13%), best:    9728/10000 (97.28%), error:       978.96594, best error:       931.68970 on epoch:    17, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 200.9079742432s, input_fired_time: 1.9249711037, output_fired_time: 1.6675338745, propagate_forward_time: 75.0378494263, propagate_backward_time: 117.5135421753, weight_update_time: 0.1852607578, other_time: 4.7640686035
epoch time: 15.1595849991s, input_fired_time: 0.2328347564, output_fired_time: 0.0000000000, propagate_forward_time: 14.2774658203, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6492843628
validation[          , genome  6411] predictions:    9688/  10000 (96.88%), best:    9728/10000 (97.28%), error:      1088.49927, best error:       931.68970 on epoch:    17, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 191.6439056396s, input_fired_time: 1.8347117901, output_fired_time: 1.6296613216, propagate_forward_time: 69.7967453003, propagate_backward_time: 113.7746429443, weight_update_time: 0.1760937870, other_time: 4.6081466675
epoch time: 18.2083549500s, input_fired_time: 0.2580809295, output_fired_time: 0.0000000000, propagate_forward_time: 16.2406578064, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7096157074
validation[          , genome  6411] predictions:    9713/  10000 (97.13%), best:    9728/10000 (97.28%), error:       962.66254, best error:       931.68970 on epoch:    17, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 203.3236694336s, input_fired_time: 1.9805605412, output_fired_time: 1.7022061348, propagate_forward_time: 77.1235046387, propagate_backward_time: 117.7929077148, weight_update_time: 0.1847353727, other_time: 4.7244873047
epoch time: 15.5707845688s, input_fired_time: 0.2308564931, output_fired_time: 0.0000000000, propagate_forward_time: 14.7054376602, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6344900131
validation[          , genome  6411] predictions:    9689/  10000 (96.89%), best:    9728/10000 (97.28%), error:      1018.88788, best error:       931.68970 on epoch:    17, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 201.0260772705s, input_fired_time: 1.9389792681, output_fired_time: 1.7114107609, propagate_forward_time: 74.8183670044, propagate_backward_time: 118.7960510254, weight_update_time: 0.1943680942, other_time: 3.7612686157
epoch time: 15.8531656265s, input_fired_time: 0.2338781208, output_fired_time: 0.0000000000, propagate_forward_time: 14.9844837189, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6348037720
validation[          , genome  6411] predictions:    9727/  10000 (97.27%), best:    9728/10000 (97.28%), error:       959.63232, best error:       931.68970 on epoch:    17, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 197.4439544678s, input_fired_time: 2.8951194286, output_fired_time: 2.6650104523, propagate_forward_time: 74.1983718872, propagate_backward_time: 114.0130386353, weight_update_time: 0.1921305507, other_time: 3.6724090576
epoch time: 14.4384269714s, input_fired_time: 0.2302574217, output_fired_time: 0.0000000000, propagate_forward_time: 13.5791912079, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6289787292
validation[          , genome  6411] predictions:    9611/  10000 (96.11%), best:    9728/10000 (97.28%), error:      1313.01685, best error:       931.68970 on epoch:    17, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 196.9678802490s, input_fired_time: 1.8863860369, output_fired_time: 1.7473100424, propagate_forward_time: 72.7717437744, propagate_backward_time: 116.8650360107, weight_update_time: 0.1769568473, other_time: 3.6974029541
epoch time: 15.5231647491s, input_fired_time: 0.2337881625, output_fired_time: 0.0000000000, propagate_forward_time: 14.6471166611, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6422595978
validation[          , genome  6411] predictions:    9761/  10000 (97.61%), best:    9761/10000 (97.61%), error:       896.23688, best error:       896.23688 on epoch:    25, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 191.6339263916s, input_fired_time: 1.8212358952, output_fired_time: 1.6032516956, propagate_forward_time: 72.6207351685, propagate_backward_time: 112.0003433228, weight_update_time: 0.1754999757, other_time: 3.5883483887
epoch time: 14.5578851700s, input_fired_time: 0.2302373201, output_fired_time: 0.0000000000, propagate_forward_time: 13.6933174133, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6343307495
validation[          , genome  6411] predictions:    9714/  10000 (97.14%), best:    9761/10000 (97.61%), error:       977.27374, best error:       896.23688 on epoch:    25, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 191.9133453369s, input_fired_time: 1.8244764805, output_fired_time: 1.5985314846, propagate_forward_time: 69.8229522705, propagate_backward_time: 114.0022735596, weight_update_time: 1.2023516893, other_time: 4.6651153564
epoch time: 15.5828380585s, input_fired_time: 0.2313613296, output_fired_time: 0.0000000000, propagate_forward_time: 14.7164068222, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6350698471
validation[          , genome  6411] predictions:    9763/  10000 (97.63%), best:    9763/10000 (97.63%), error:       859.18823, best error:       859.18823 on epoch:    27, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 191.6840972900s, input_fired_time: 1.8381388187, output_fired_time: 1.6063735485, propagate_forward_time: 70.1153411865, propagate_backward_time: 113.4643554688, weight_update_time: 0.1784426719, other_time: 4.6598968506
epoch time: 15.7170314789s, input_fired_time: 0.2365366668, output_fired_time: 0.0000000000, propagate_forward_time: 14.8242368698, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6562576294
validation[          , genome  6411] predictions:    9669/  10000 (96.69%), best:    9763/10000 (97.63%), error:      1000.56958, best error:       859.18823 on epoch:    27, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 191.0380554199s, input_fired_time: 1.8283196688, output_fired_time: 1.6047564745, propagate_forward_time: 72.2919540405, propagate_backward_time: 110.6780166626, weight_update_time: 0.1771505177, other_time: 4.6350097656
epoch time: 14.2834253311s, input_fired_time: 0.2278012037, output_fired_time: 0.0000000000, propagate_forward_time: 13.4405403137, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6150836945
validation[          , genome  6411] predictions:    9727/  10000 (97.27%), best:    9763/10000 (97.63%), error:       923.27594, best error:       859.18823 on epoch:    27, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 190.6579284668s, input_fired_time: 1.8222324848, output_fired_time: 1.5907633305, propagate_forward_time: 70.2912826538, propagate_backward_time: 113.3601150513, weight_update_time: 0.1771963090, other_time: 3.5935363770
epoch time: 15.7238073349s, input_fired_time: 0.2339553088, output_fired_time: 0.0000000000, propagate_forward_time: 14.8575553894, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6322965622
validation[          , genome  6411] predictions:    9732/  10000 (97.32%), best:    9763/10000 (97.63%), error:       921.58362, best error:       859.18823 on epoch:    27, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 190.7559814453s, input_fired_time: 1.8590290546, output_fired_time: 1.6617181301, propagate_forward_time: 69.6371536255, propagate_backward_time: 113.9124450684, weight_update_time: 0.2171359956, other_time: 3.6856460571
epoch time: 16.2670001984s, input_fired_time: 0.2311189622, output_fired_time: 0.0000000000, propagate_forward_time: 15.3772106171, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6586704254
validation[          , genome  6411] predictions:    9728/  10000 (97.28%), best:    9763/10000 (97.63%), error:       877.04688, best error:       859.18823 on epoch:    27, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 192.4407196045s, input_fired_time: 1.8575389385, output_fired_time: 2.6303622723, propagate_forward_time: 70.9709777832, propagate_backward_time: 113.3189849854, weight_update_time: 0.1759858131, other_time: 3.6628570557
epoch time: 18.5377330780s, input_fired_time: 0.2808575928, output_fired_time: 0.0000000000, propagate_forward_time: 17.4779472351, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7789287567
validation[          , genome  6411] predictions:    9730/  10000 (97.30%), best:    9763/10000 (97.63%), error:       959.70929, best error:       859.18823 on epoch:    27, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 205.2174682617s, input_fired_time: 1.9674340487, output_fired_time: 1.6935061216, propagate_forward_time: 77.0948791504, propagate_backward_time: 120.5878524780, weight_update_time: 0.1901268214, other_time: 3.8737869263
epoch time: 15.7769527435s, input_fired_time: 0.2342666388, output_fired_time: 0.0000000000, propagate_forward_time: 14.9086523056, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6340341568
validation[          , genome  6411] predictions:    9725/  10000 (97.25%), best:    9763/10000 (97.63%), error:       902.37891, best error:       859.18823 on epoch:    27, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 196.2292480469s, input_fired_time: 1.8514723778, output_fired_time: 1.6448144913, propagate_forward_time: 71.2033233643, propagate_backward_time: 117.8838424683, weight_update_time: 0.1762629002, other_time: 3.6457901001
epoch time: 14.2231159210s, input_fired_time: 0.2279287726, output_fired_time: 0.0000000000, propagate_forward_time: 13.3723745346, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6228122711
validation[          , genome  6411] predictions:    9723/  10000 (97.23%), best:    9763/10000 (97.63%), error:       915.58344, best error:       859.18823 on epoch:    27, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 209.8790893555s, input_fired_time: 1.9823743105, output_fired_time: 1.9586122036, propagate_forward_time: 80.1816635132, propagate_backward_time: 120.8037490845, weight_update_time: 0.1914868057, other_time: 4.9526824951
epoch time: 17.6140899658s, input_fired_time: 0.2501669228, output_fired_time: 0.0000000000, propagate_forward_time: 16.6246757507, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7392463684
validation[          , genome  6411] predictions:    9697/  10000 (96.97%), best:    9763/10000 (97.63%), error:       955.78064, best error:       859.18823 on epoch:    27, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 196.0208435059s, input_fired_time: 1.8654309511, output_fired_time: 1.6323180199, propagate_forward_time: 74.5193176270, propagate_backward_time: 114.3031005859, weight_update_time: 0.1851454228, other_time: 3.7006683350
epoch time: 14.6413354874s, input_fired_time: 0.2375898212, output_fired_time: 0.0000000000, propagate_forward_time: 13.7494792938, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6542663574
validation[          , genome  6411] predictions:    9739/  10000 (97.39%), best:    9763/10000 (97.63%), error:       882.80231, best error:       859.18823 on epoch:    27, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 191.3244476318s, input_fired_time: 1.8372075558, output_fired_time: 1.6107522249, propagate_forward_time: 70.4593963623, propagate_backward_time: 113.8362350464, weight_update_time: 0.1763924062, other_time: 3.5808639526
epoch time: 15.6824798584s, input_fired_time: 0.2360924333, output_fired_time: 0.0000000000, propagate_forward_time: 14.8086585999, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6377286911
validation[          , genome  6411] predictions:    9737/  10000 (97.37%), best:    9763/10000 (97.63%), error:       878.48553, best error:       859.18823 on epoch:    27, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 201.4288940430s, input_fired_time: 1.9411095381, output_fired_time: 2.7075049877, propagate_forward_time: 76.6503067017, propagate_backward_time: 116.3390274048, weight_update_time: 0.1841416210, other_time: 3.7909393311
epoch time: 15.5327873230s, input_fired_time: 0.2318256199, output_fired_time: 0.0000000000, propagate_forward_time: 14.6674232483, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6335382462
validation[          , genome  6411] predictions:    9756/  10000 (97.56%), best:    9763/10000 (97.63%), error:       866.23462, best error:       859.18823 on epoch:    27, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 191.7369689941s, input_fired_time: 1.8442580700, output_fired_time: 1.6120671034, propagate_forward_time: 72.1872863770, propagate_backward_time: 112.4276580811, weight_update_time: 0.1760277748, other_time: 3.6657104492
epoch time: 15.7659654617s, input_fired_time: 0.2340295613, output_fired_time: 0.0000000000, propagate_forward_time: 14.8950223923, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6369132996
validation[          , genome  6411] predictions:    9738/  10000 (97.38%), best:    9763/10000 (97.63%), error:       868.16412, best error:       859.18823 on epoch:    27, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 193.4170837402s, input_fired_time: 1.8488084078, output_fired_time: 1.6196718216, propagate_forward_time: 70.3002014160, propagate_backward_time: 115.9719314575, weight_update_time: 0.1769099385, other_time: 3.6764602661
epoch time: 14.2033967972s, input_fired_time: 0.2310969234, output_fired_time: 0.0000000000, propagate_forward_time: 13.3443250656, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6279745102
validation[          , genome  6411] predictions:    9727/  10000 (97.27%), best:    9763/10000 (97.63%), error:       972.03320, best error:       859.18823 on epoch:    27, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 194.0295867920s, input_fired_time: 2.8658988476, output_fired_time: 1.6298677921, propagate_forward_time: 73.6005249023, propagate_backward_time: 112.2713546753, weight_update_time: 0.1774328798, other_time: 3.6619338989
epoch time: 16.1094894409s, input_fired_time: 0.2348800153, output_fired_time: 0.0000000000, propagate_forward_time: 15.2431221008, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6314868927
validation[          , genome  6411] predictions:    9727/  10000 (97.27%), best:    9763/10000 (97.63%), error:       904.66418, best error:       859.18823 on epoch:    27, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 190.0768127441s, input_fired_time: 1.8330769539, output_fired_time: 1.5973283052, propagate_forward_time: 70.7078781128, propagate_backward_time: 112.3216323853, weight_update_time: 0.1764706820, other_time: 3.6168823242
epoch time: 15.5109710693s, input_fired_time: 0.2361212969, output_fired_time: 0.0000000000, propagate_forward_time: 14.6360235214, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6388263702
validation[          , genome  6411] predictions:    9635/  10000 (96.35%), best:    9763/10000 (97.63%), error:      1175.96143, best error:       859.18823 on epoch:    27, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 199.3700408936s, input_fired_time: 1.9187872410, output_fired_time: 1.6580973864, propagate_forward_time: 76.6488265991, propagate_backward_time: 115.4063186646, weight_update_time: 0.1925126761, other_time: 3.7380065918
epoch time: 15.5816955566s, input_fired_time: 0.2363627106, output_fired_time: 0.0000000000, propagate_forward_time: 14.6953878403, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6499452591
validation[          , genome  6411] predictions:    9673/  10000 (96.73%), best:    9763/10000 (97.63%), error:      1051.62378, best error:       859.18823 on epoch:    27, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 191.0760345459s, input_fired_time: 1.8372974396, output_fired_time: 1.6029438972, propagate_forward_time: 71.6451339722, propagate_backward_time: 111.3433151245, weight_update_time: 0.1768537015, other_time: 4.6473388672
epoch time: 14.4147472382s, input_fired_time: 0.2346810549, output_fired_time: 0.0000000000, propagate_forward_time: 13.5348281860, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6452379227
validation[          , genome  6411] predictions:    9746/  10000 (97.46%), best:    9763/10000 (97.63%), error:       885.97223, best error:       859.18823 on epoch:    27, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 198.9286499023s, input_fired_time: 2.9323627949, output_fired_time: 1.6773977280, propagate_forward_time: 76.1256179810, propagate_backward_time: 114.3703994751, weight_update_time: 0.1942442954, other_time: 3.8228759766
epoch time: 15.4673423767s, input_fired_time: 0.2346214503, output_fired_time: 0.0000000000, propagate_forward_time: 14.5964279175, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6362934113
validation[          , genome  6411] predictions:    9759/  10000 (97.59%), best:    9759/10000 (97.59%), error:       840.27911, best error:       840.27911 on epoch:    45, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 194.8726043701s, input_fired_time: 1.8827129602, output_fired_time: 1.6570175886, propagate_forward_time: 73.2024078369, propagate_backward_time: 112.4592590332, weight_update_time: 0.1768977493, other_time: 5.6712188721
epoch time: 15.7108039856s, input_fired_time: 0.2467816025, output_fired_time: 0.0000000000, propagate_forward_time: 14.8199281693, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6440944672
validation[          , genome  6411] predictions:    9668/  10000 (96.68%), best:    9759/10000 (97.59%), error:      1109.78308, best error:       840.27911 on epoch:    45, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 191.4187011719s, input_fired_time: 2.8601303101, output_fired_time: 1.6059985161, propagate_forward_time: 71.9998626709, propagate_backward_time: 111.3750762939, weight_update_time: 0.1751340777, other_time: 3.5776214600
epoch time: 15.7878303528s, input_fired_time: 0.2383785397, output_fired_time: 0.0000000000, propagate_forward_time: 13.8992195129, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6502323151
validation[          , genome  6411] predictions:    9696/  10000 (96.96%), best:    9759/10000 (97.59%), error:      1046.76196, best error:       840.27911 on epoch:    45, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 191.9501800537s, input_fired_time: 1.8315525055, output_fired_time: 1.6047306061, propagate_forward_time: 72.6861801147, propagate_backward_time: 112.1273345947, weight_update_time: 0.2585893571, other_time: 3.7003707886
epoch time: 14.5424966812s, input_fired_time: 0.2401417494, output_fired_time: 0.0000000000, propagate_forward_time: 13.6538925171, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6484622955
validation[          , genome  6411] predictions:    9720/  10000 (97.20%), best:    9759/10000 (97.59%), error:       889.68671, best error:       840.27911 on epoch:    45, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 206.7212066650s, input_fired_time: 1.9562287331, output_fired_time: 1.6821032763, propagate_forward_time: 76.5925750732, propagate_backward_time: 121.6054534912, weight_update_time: 0.2001509368, other_time: 4.8848571777
epoch time: 14.4301719666s, input_fired_time: 0.2312444896, output_fired_time: 0.0000000000, propagate_forward_time: 13.5778770447, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6210508347
validation[          , genome  6411] predictions:    9710/  10000 (97.10%), best:    9759/10000 (97.59%), error:       946.21991, best error:       840.27911 on epoch:    45, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 205.9445037842s, input_fired_time: 1.9869325161, output_fired_time: 1.7215532064, propagate_forward_time: 79.7325363159, propagate_backward_time: 118.6579284668, weight_update_time: 0.1812354922, other_time: 3.8455429077
epoch time: 14.3671913147s, input_fired_time: 0.2310632467, output_fired_time: 0.0000000000, propagate_forward_time: 13.4520187378, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6841096878
validation[          , genome  6411] predictions:    9746/  10000 (97.46%), best:    9759/10000 (97.59%), error:       866.95496, best error:       840.27911 on epoch:    45, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 200.7996826172s, input_fired_time: 1.8918783665, output_fired_time: 1.7106368542, propagate_forward_time: 75.7182846069, propagate_backward_time: 117.6946792603, weight_update_time: 0.1847773790, other_time: 3.7842102051
epoch time: 14.7301425934s, input_fired_time: 0.2342769057, output_fired_time: 0.0000000000, propagate_forward_time: 13.8618307114, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6340351105
validation[          , genome  6411] predictions:    9711/  10000 (97.11%), best:    9759/10000 (97.59%), error:       952.09357, best error:       840.27911 on epoch:    45, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 194.1352844238s, input_fired_time: 1.8396868706, output_fired_time: 2.6392519474, propagate_forward_time: 73.6366271973, propagate_backward_time: 112.4118576050, weight_update_time: 0.1775041372, other_time: 3.6078567505
epoch time: 15.5655403137s, input_fired_time: 0.2368860245, output_fired_time: 0.0000000000, propagate_forward_time: 13.6869773865, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6416769028
validation[          , genome  6411] predictions:    9745/  10000 (97.45%), best:    9759/10000 (97.59%), error:       849.84265, best error:       840.27911 on epoch:    45, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 192.3163146973s, input_fired_time: 1.8450481892, output_fired_time: 1.6126377583, propagate_forward_time: 73.4025878906, propagate_backward_time: 111.8779907227, weight_update_time: 0.1763019413, other_time: 3.5780487061
epoch time: 15.7813711166s, input_fired_time: 0.2348633409, output_fired_time: 0.0000000000, propagate_forward_time: 14.8887491226, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6577587128
validation[          , genome  6411] predictions:    9689/  10000 (96.89%), best:    9759/10000 (97.59%), error:      1038.07214, best error:       840.27911 on epoch:    45, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 208.2254638672s, input_fired_time: 1.9484568834, output_fired_time: 1.7402552366, propagate_forward_time: 80.4951477051, propagate_backward_time: 120.2399749756, weight_update_time: 0.1762408167, other_time: 3.8016357422
epoch time: 14.2670259476s, input_fired_time: 0.2321882546, output_fired_time: 0.0000000000, propagate_forward_time: 13.4083709717, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6264667511
validation[          , genome  6411] predictions:    9698/  10000 (96.98%), best:    9759/10000 (97.59%), error:      1016.53198, best error:       840.27911 on epoch:    45, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 206.6614685059s, input_fired_time: 1.9996105433, output_fired_time: 1.7979831696, propagate_forward_time: 78.8086853027, propagate_backward_time: 119.2178421021, weight_update_time: 0.1917750537, other_time: 4.8373489380
epoch time: 15.3976650238s, input_fired_time: 0.2356389016, output_fired_time: 0.0000000000, propagate_forward_time: 14.5161724091, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6458539963
validation[          , genome  6411] predictions:    9764/  10000 (97.64%), best:    9764/10000 (97.64%), error:       799.10016, best error:       799.10016 on epoch:    55, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 195.1963958740s, input_fired_time: 2.0467572212, output_fired_time: 1.6599507332, propagate_forward_time: 71.5601348877, propagate_backward_time: 115.2044219971, weight_update_time: 0.1771316677, other_time: 4.7251281738
epoch time: 15.3311386108s, input_fired_time: 0.2320855260, output_fired_time: 0.0000000000, propagate_forward_time: 14.4696645737, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6293888092
validation[          , genome  6411] predictions:    9746/  10000 (97.46%), best:    9764/10000 (97.64%), error:       862.43414, best error:       799.10016 on epoch:    55, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 192.6951599121s, input_fired_time: 1.8536550999, output_fired_time: 1.6131683588, propagate_forward_time: 71.0530090332, propagate_backward_time: 113.5310974121, weight_update_time: 0.1790265888, other_time: 4.6442260742
epoch time: 22.0858173370s, input_fired_time: 0.3675425947, output_fired_time: 0.0000000000, propagate_forward_time: 20.8182716370, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9000034332
validation[          , genome  6411] predictions:    9745/  10000 (97.45%), best:    9764/10000 (97.64%), error:       846.88141, best error:       799.10016 on epoch:    55, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 198.7906646729s, input_fired_time: 1.9352501631, output_fired_time: 1.7079370022, propagate_forward_time: 74.8655395508, propagate_backward_time: 116.5917968750, weight_update_time: 0.1766709536, other_time: 3.6901397705
epoch time: 19.5757102966s, input_fired_time: 0.2548323870, output_fired_time: 0.0000000000, propagate_forward_time: 18.4191360474, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9017410278
validation[          , genome  6411] predictions:    9690/  10000 (96.90%), best:    9764/10000 (97.64%), error:      1046.16101, best error:       799.10016 on epoch:    55, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 205.6287536621s, input_fired_time: 1.9237940311, output_fired_time: 1.7263598442, propagate_forward_time: 78.0127487183, propagate_backward_time: 120.0675735474, weight_update_time: 0.1860525757, other_time: 3.8982696533
epoch time: 16.4301280975s, input_fired_time: 0.2422074825, output_fired_time: 0.0000000000, propagate_forward_time: 15.5310726166, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6568489075
validation[          , genome  6411] predictions:    9744/  10000 (97.44%), best:    9764/10000 (97.64%), error:       841.96265, best error:       799.10016 on epoch:    55, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 198.1125640869s, input_fired_time: 1.9019110203, output_fired_time: 1.6643207073, propagate_forward_time: 73.3153228760, propagate_backward_time: 116.4663925171, weight_update_time: 0.1846731603, other_time: 4.7646102905
epoch time: 18.0373039246s, input_fired_time: 0.2723732293, output_fired_time: 0.0000000000, propagate_forward_time: 17.0232372284, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7416934967
validation[          , genome  6411] predictions:    9742/  10000 (97.42%), best:    9764/10000 (97.64%), error:       859.54578, best error:       799.10016 on epoch:    55, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 198.9253082275s, input_fired_time: 1.9549428225, output_fired_time: 1.6762982607, propagate_forward_time: 73.8517074585, propagate_backward_time: 117.6334152222, weight_update_time: 0.1919554025, other_time: 3.8089447021
epoch time: 15.8645143509s, input_fired_time: 0.2420867831, output_fired_time: 0.0000000000, propagate_forward_time: 14.9697351456, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6526927948
validation[          , genome  6411] predictions:    9719/  10000 (97.19%), best:    9764/10000 (97.64%), error:       921.98145, best error:       799.10016 on epoch:    55, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 190.6262207031s, input_fired_time: 1.8600218296, output_fired_time: 1.6176859140, propagate_forward_time: 72.6363449097, propagate_backward_time: 110.9208374023, weight_update_time: 0.1769422144, other_time: 3.5913314819
epoch time: 15.5823478699s, input_fired_time: 0.2350729406, output_fired_time: 0.0000000000, propagate_forward_time: 14.7125968933, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6346778870
validation[          , genome  6411] predictions:    9730/  10000 (97.30%), best:    9764/10000 (97.64%), error:       889.72754, best error:       799.10016 on epoch:    55, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 191.2779998779s, input_fired_time: 1.9008792639, output_fired_time: 1.6054140329, propagate_forward_time: 72.2467956543, propagate_backward_time: 111.9505386353, weight_update_time: 0.1760191172, other_time: 3.5743789673
epoch time: 14.7297391891s, input_fired_time: 0.2402898371, output_fired_time: 0.0000000000, propagate_forward_time: 13.8373193741, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6521301270
validation[          , genome  6411] predictions:    9731/  10000 (97.31%), best:    9764/10000 (97.64%), error:       851.18872, best error:       799.10016 on epoch:    55, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 191.6300201416s, input_fired_time: 1.8594769239, output_fired_time: 1.6097742319, propagate_forward_time: 73.8191909790, propagate_backward_time: 110.7554550171, weight_update_time: 0.1762858033, other_time: 3.5861206055
epoch time: 15.7549066544s, input_fired_time: 0.2375682294, output_fired_time: 0.0000000000, propagate_forward_time: 14.8818407059, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6354980469
validation[          , genome  6411] predictions:    9754/  10000 (97.54%), best:    9764/10000 (97.64%), error:       845.70056, best error:       799.10016 on epoch:    55, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 203.1402282715s, input_fired_time: 1.9456049204, output_fired_time: 2.7289254665, propagate_forward_time: 77.4490203857, propagate_backward_time: 117.2196960449, weight_update_time: 0.2077402472, other_time: 3.7969818115
epoch time: 15.8681907654s, input_fired_time: 0.2388594598, output_fired_time: 0.0000000000, propagate_forward_time: 13.9814815521, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6478500366
validation[          , genome  6411] predictions:    9742/  10000 (97.42%), best:    9764/10000 (97.64%), error:       890.87769, best error:       799.10016 on epoch:    55, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 190.4619293213s, input_fired_time: 1.8409185410, output_fired_time: 1.6007841825, propagate_forward_time: 71.4712142944, propagate_backward_time: 111.9482803345, weight_update_time: 0.1771910042, other_time: 3.6007385254
epoch time: 15.2543382645s, input_fired_time: 0.2314268053, output_fired_time: 0.0000000000, propagate_forward_time: 14.3998661041, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6230449677
validation[          , genome  6411] predictions:    9726/  10000 (97.26%), best:    9764/10000 (97.64%), error:       921.75165, best error:       799.10016 on epoch:    55, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 206.6940155029s, input_fired_time: 2.0760602951, output_fired_time: 1.6832904816, propagate_forward_time: 80.1379165649, propagate_backward_time: 117.9389114380, weight_update_time: 0.1841455251, other_time: 4.8578338623
epoch time: 15.6680889130s, input_fired_time: 0.2395807207, output_fired_time: 0.0000000000, propagate_forward_time: 14.7879171371, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6405906677
validation[          , genome  6411] predictions:    9615/  10000 (96.15%), best:    9764/10000 (97.64%), error:      1279.03552, best error:       799.10016 on epoch:    55, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 192.5009613037s, input_fired_time: 1.8545973301, output_fired_time: 2.6244914532, propagate_forward_time: 70.9507141113, propagate_backward_time: 113.4545364380, weight_update_time: 0.1772183627, other_time: 3.6166152954
epoch time: 14.3418960571s, input_fired_time: 0.2313877195, output_fired_time: 0.0000000000, propagate_forward_time: 13.4904775620, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6200304031
validation[          , genome  6411] predictions:    9681/  10000 (96.81%), best:    9764/10000 (97.64%), error:      1063.37158, best error:       799.10016 on epoch:    55, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 194.9059600830s, input_fired_time: 1.8770983219, output_fired_time: 1.6301518679, propagate_forward_time: 75.4010848999, propagate_backward_time: 112.3634719849, weight_update_time: 0.1756345034, other_time: 3.6341400146
epoch time: 15.7731971741s, input_fired_time: 0.2399971038, output_fired_time: 0.0000000000, propagate_forward_time: 14.8828687668, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6503314972
validation[          , genome  6411] predictions:    9746/  10000 (97.46%), best:    9764/10000 (97.64%), error:       860.74567, best error:       799.10016 on epoch:    55, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 198.9458770752s, input_fired_time: 1.9434328079, output_fired_time: 1.7042970657, propagate_forward_time: 74.7625122070, propagate_backward_time: 116.7470016479, weight_update_time: 0.1911925524, other_time: 3.7886276245
epoch time: 24.3807697296s, input_fired_time: 0.4029389322, output_fired_time: 0.0000000000, propagate_forward_time: 22.9168148041, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0610160828
validation[          , genome  6411] predictions:    9670/  10000 (96.70%), best:    9764/10000 (97.64%), error:      1133.67078, best error:       799.10016 on epoch:    55, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 192.2245635986s, input_fired_time: 1.8545668125, output_fired_time: 1.6128449440, propagate_forward_time: 74.7077789307, propagate_backward_time: 110.4026489258, weight_update_time: 0.1770560741, other_time: 3.6467285156
epoch time: 15.5031690598s, input_fired_time: 0.2378477752, output_fired_time: 0.0000000000, propagate_forward_time: 14.6266508102, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6386709213
validation[          , genome  6411] predictions:    9745/  10000 (97.45%), best:    9764/10000 (97.64%), error:       876.12311, best error:       799.10016 on epoch:    55, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 190.9864196777s, input_fired_time: 2.8585131168, output_fired_time: 1.6403735876, propagate_forward_time: 70.8947372437, propagate_backward_time: 111.9941329956, weight_update_time: 0.1762946844, other_time: 3.5986480713
epoch time: 15.7831888199s, input_fired_time: 0.2421703786, output_fired_time: 0.0000000000, propagate_forward_time: 14.8922472000, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6487712860
validation[          , genome  6411] predictions:    9716/  10000 (97.16%), best:    9764/10000 (97.64%), error:       958.08850, best error:       799.10016 on epoch:    55, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 191.5924530029s, input_fired_time: 1.8502875566, output_fired_time: 1.6063091755, propagate_forward_time: 70.8098144531, propagate_backward_time: 113.7416152954, weight_update_time: 0.1766836643, other_time: 3.5844345093
epoch time: 14.3421516418s, input_fired_time: 0.2322688699, output_fired_time: 0.0000000000, propagate_forward_time: 13.4872817993, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6226005554
validation[          , genome  6411] predictions:    9707/  10000 (97.07%), best:    9764/10000 (97.64%), error:       947.89044, best error:       799.10016 on epoch:    55, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 189.7553100586s, input_fired_time: 1.8427850008, output_fired_time: 1.5882670879, propagate_forward_time: 70.2724838257, propagate_backward_time: 112.4772567749, weight_update_time: 0.1752229631, other_time: 3.5745086670
epoch time: 15.6353435516s, input_fired_time: 0.2391956449, output_fired_time: 0.0000000000, propagate_forward_time: 14.7551164627, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6410312653
validation[          , genome  6411] predictions:    9762/  10000 (97.62%), best:    9764/10000 (97.64%), error:       804.50244, best error:       799.10016 on epoch:    55, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 196.1648559570s, input_fired_time: 1.9011393785, output_fired_time: 1.6896382570, propagate_forward_time: 72.7074356079, propagate_backward_time: 116.2135925293, weight_update_time: 0.1820995808, other_time: 3.6530532837
epoch time: 18.0440845490s, input_fired_time: 0.2978558838, output_fired_time: 0.0000000000, propagate_forward_time: 16.9364051819, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8098239899
validation[          , genome  6411] predictions:    9746/  10000 (97.46%), best:    9764/10000 (97.64%), error:       830.93726, best error:       799.10016 on epoch:    55, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 206.1281127930s, input_fired_time: 1.9345439672, output_fired_time: 1.6650683880, propagate_forward_time: 76.1130371094, propagate_backward_time: 122.4645690918, weight_update_time: 0.1849186867, other_time: 3.9508972168
epoch time: 15.5745086670s, input_fired_time: 0.2370238453, output_fired_time: 0.0000000000, propagate_forward_time: 13.6921491623, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6453351974
validation[          , genome  6411] predictions:    9698/  10000 (96.98%), best:    9764/10000 (97.64%), error:      1012.61975, best error:       799.10016 on epoch:    55, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 196.6803741455s, input_fired_time: 1.9130845070, output_fired_time: 1.6571700573, propagate_forward_time: 73.9919967651, propagate_backward_time: 115.3796310425, weight_update_time: 0.1827937514, other_time: 3.7384948730
epoch time: 15.7459812164s, input_fired_time: 0.2406167835, output_fired_time: 0.0000000000, propagate_forward_time: 14.8621244431, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6432399750
validation[          , genome  6411] predictions:    9742/  10000 (97.42%), best:    9764/10000 (97.64%), error:       888.48102, best error:       799.10016 on epoch:    55, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 191.4904327393s, input_fired_time: 1.8548146486, output_fired_time: 1.6275697947, propagate_forward_time: 72.6832046509, propagate_backward_time: 111.7014617920, weight_update_time: 0.1772158146, other_time: 3.6233901978
epoch time: 15.5700454712s, input_fired_time: 0.2371631563, output_fired_time: 0.0000000000, propagate_forward_time: 14.6990432739, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6338386536
validation[          , genome  6411] predictions:    9699/  10000 (96.99%), best:    9764/10000 (97.64%), error:       990.21094, best error:       799.10016 on epoch:    55, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 190.7486724854s, input_fired_time: 1.8500479460, output_fired_time: 1.6015740633, propagate_forward_time: 71.6570816040, propagate_backward_time: 112.0453643799, weight_update_time: 0.1766626984, other_time: 3.5945968628
epoch time: 15.6578073502s, input_fired_time: 0.2394219488, output_fired_time: 0.0000000000, propagate_forward_time: 14.7778978348, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6404876709
validation[          , genome  6411] predictions:    9759/  10000 (97.59%), best:    9764/10000 (97.64%), error:       821.89020, best error:       799.10016 on epoch:    55, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 214.0167236328s, input_fired_time: 2.0241231918, output_fired_time: 1.8072139025, propagate_forward_time: 80.9276428223, propagate_backward_time: 125.3109817505, weight_update_time: 0.1877404600, other_time: 3.9467544556
epoch time: 14.4471521378s, input_fired_time: 0.2373835295, output_fired_time: 0.0000000000, propagate_forward_time: 13.5702142715, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6395540237
validation[          , genome  6411] predictions:    9731/  10000 (97.31%), best:    9764/10000 (97.64%), error:       935.28430, best error:       799.10016 on epoch:    55, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 197.4071044922s, input_fired_time: 1.9122810364, output_fired_time: 1.6395707130, propagate_forward_time: 71.5909576416, propagate_backward_time: 118.5611114502, weight_update_time: 0.1944751292, other_time: 3.7031860352
epoch time: 19.3572978973s, input_fired_time: 0.2964924574, output_fired_time: 0.0000000000, propagate_forward_time: 18.1614379883, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8993682861
validation[          , genome  6411] predictions:    9760/  10000 (97.60%), best:    9764/10000 (97.64%), error:       811.61761, best error:       799.10016 on epoch:    55, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 190.9715576172s, input_fired_time: 1.8451608419, output_fired_time: 2.5924904346, propagate_forward_time: 72.4854965210, propagate_backward_time: 110.4768829346, weight_update_time: 0.1753192097, other_time: 3.5715408325
epoch time: 15.5596923828s, input_fired_time: 0.2400132716, output_fired_time: 0.0000000000, propagate_forward_time: 14.6725273132, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6471519470
validation[          , genome  6411] predictions:    9730/  10000 (97.30%), best:    9764/10000 (97.64%), error:       880.48328, best error:       799.10016 on epoch:    55, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 190.8993835449s, input_fired_time: 1.8651155233, output_fired_time: 1.6110707521, propagate_forward_time: 69.7743911743, propagate_backward_time: 114.0398330688, weight_update_time: 0.1772104651, other_time: 3.6089782715
epoch time: 20.6585426331s, input_fired_time: 0.2937561572, output_fired_time: 0.0000000000, propagate_forward_time: 18.4829921722, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8817939758
validation[          , genome  6411] predictions:    9727/  10000 (97.27%), best:    9764/10000 (97.64%), error:       918.15417, best error:       799.10016 on epoch:    55, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 202.9798736572s, input_fired_time: 2.9183576107, output_fired_time: 1.8390781879, propagate_forward_time: 76.7952117920, propagate_backward_time: 117.6247634888, weight_update_time: 0.1778116524, other_time: 3.8024673462
epoch time: 15.7295179367s, input_fired_time: 0.2398241460, output_fired_time: 0.0000000000, propagate_forward_time: 14.8486671448, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6410264969
validation[          , genome  6411] predictions:    9757/  10000 (97.57%), best:    9764/10000 (97.64%), error:       820.74860, best error:       799.10016 on epoch:    55, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 199.7658691406s, input_fired_time: 1.8992251158, output_fired_time: 1.6541893482, propagate_forward_time: 74.8443222046, propagate_backward_time: 116.6662368774, weight_update_time: 0.1852758527, other_time: 4.7018890381
epoch time: 15.4090175629s, input_fired_time: 0.2355250865, output_fired_time: 0.0000000000, propagate_forward_time: 14.5488452911, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6246471405
validation[          , genome  6411] predictions:    9762/  10000 (97.62%), best:    9764/10000 (97.64%), error:       809.01782, best error:       799.10016 on epoch:    55, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 190.1758117676s, input_fired_time: 1.8684974909, output_fired_time: 1.6018567085, propagate_forward_time: 72.5693206787, propagate_backward_time: 110.5489883423, weight_update_time: 0.1760211587, other_time: 3.5871505737
epoch time: 14.7818050385s, input_fired_time: 0.2436809242, output_fired_time: 0.0000000000, propagate_forward_time: 13.8854494095, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6526746750
validation[          , genome  6411] predictions:    9718/  10000 (97.18%), best:    9764/10000 (97.64%), error:       963.34076, best error:       799.10016 on epoch:    55, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 194.6254730225s, input_fired_time: 1.8765491247, output_fired_time: 2.6395759583, propagate_forward_time: 72.4636535645, propagate_backward_time: 113.9547576904, weight_update_time: 0.1773009598, other_time: 3.6909332275
epoch time: 15.7075319290s, input_fired_time: 0.2438656092, output_fired_time: 0.0000000000, propagate_forward_time: 14.8224945068, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6411714554
validation[          , genome  6411] predictions:    9751/  10000 (97.51%), best:    9764/10000 (97.64%), error:       844.81787, best error:       799.10016 on epoch:    55, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 215.2229614258s, input_fired_time: 2.0702433586, output_fired_time: 1.9676518440, propagate_forward_time: 82.2076263428, propagate_backward_time: 124.8958816528, weight_update_time: 0.2131129205, other_time: 4.0815658569
epoch time: 14.3594369888s, input_fired_time: 0.2365224957, output_fired_time: 0.0000000000, propagate_forward_time: 13.4933242798, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6295900345
validation[          , genome  6411] predictions:    9756/  10000 (97.56%), best:    9764/10000 (97.64%), error:       816.01575, best error:       799.10016 on epoch:    55, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 196.7075042725s, input_fired_time: 1.9044085741, output_fired_time: 1.6217468977, propagate_forward_time: 71.9772720337, propagate_backward_time: 117.5057373047, weight_update_time: 0.1773199588, other_time: 3.6983413696
epoch time: 16.1308383942s, input_fired_time: 0.2423619926, output_fired_time: 0.0000000000, propagate_forward_time: 15.2485818863, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6398944855
validation[          , genome  6411] predictions:    9714/  10000 (97.14%), best:    9764/10000 (97.64%), error:       931.53705, best error:       799.10016 on epoch:    55, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 201.1329956055s, input_fired_time: 1.9177255630, output_fired_time: 1.6959246397, propagate_forward_time: 78.0446243286, propagate_backward_time: 114.7064971924, weight_update_time: 0.1814220101, other_time: 4.7682266235
epoch time: 16.0147571564s, input_fired_time: 0.2409046292, output_fired_time: 0.0000000000, propagate_forward_time: 15.0916385651, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6822137833
validation[          , genome  6411] predictions:    9751/  10000 (97.51%), best:    9764/10000 (97.64%), error:       845.70288, best error:       799.10016 on epoch:    55, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 193.2886199951s, input_fired_time: 1.8698046207, output_fired_time: 1.6235909462, propagate_forward_time: 71.3653793335, propagate_backward_time: 114.7508239746, weight_update_time: 0.1780145019, other_time: 3.6790084839
epoch time: 21.3348560333s, input_fired_time: 0.3468375206, output_fired_time: 0.0000000000, propagate_forward_time: 20.1492633820, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8387546539
validation[          , genome  6411] predictions:    9751/  10000 (97.51%), best:    9764/10000 (97.64%), error:       850.62231, best error:       799.10016 on epoch:    55, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 194.3732604980s, input_fired_time: 1.8882896900, output_fired_time: 1.6428722143, propagate_forward_time: 71.5196914673, propagate_backward_time: 115.6521835327, weight_update_time: 0.1769432724, other_time: 3.6702270508
epoch time: 15.9429140091s, input_fired_time: 0.2428656667, output_fired_time: 0.0000000000, propagate_forward_time: 15.0341339111, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6659145355
validation[          , genome  6411] predictions:    9746/  10000 (97.46%), best:    9764/10000 (97.64%), error:       851.15424, best error:       799.10016 on epoch:    55, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 192.9111633301s, input_fired_time: 1.8617347479, output_fired_time: 1.6182403564, propagate_forward_time: 74.1047210693, propagate_backward_time: 111.5943756104, weight_update_time: 0.1776312143, other_time: 3.7320861816
epoch time: 15.4970893860s, input_fired_time: 0.2383926958, output_fired_time: 0.0000000000, propagate_forward_time: 14.6234493256, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6352472305
validation[          , genome  6411] predictions:    9739/  10000 (97.39%), best:    9764/10000 (97.64%), error:       877.87421, best error:       799.10016 on epoch:    55, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 191.0026092529s, input_fired_time: 1.8647818565, output_fired_time: 1.6126409769, propagate_forward_time: 72.9414443970, propagate_backward_time: 110.9241561890, weight_update_time: 0.1769954860, other_time: 3.6595916748
epoch time: 15.8532304764s, input_fired_time: 0.2453077734, output_fired_time: 0.0000000000, propagate_forward_time: 14.9427642822, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6651582718
validation[          , genome  6411] predictions:    9747/  10000 (97.47%), best:    9764/10000 (97.64%), error:       842.29297, best error:       799.10016 on epoch:    55, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 199.4527740479s, input_fired_time: 1.9295896292, output_fired_time: 1.6676727533, propagate_forward_time: 77.4446411133, propagate_backward_time: 114.5398788452, weight_update_time: 0.1857510507, other_time: 3.8709793091
epoch time: 15.5851936340s, input_fired_time: 0.2975690663, output_fired_time: 0.0000000000, propagate_forward_time: 14.5868310928, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7007932663
validation[          , genome  6411] predictions:    9748/  10000 (97.48%), best:    9764/10000 (97.64%), error:       847.38025, best error:       799.10016 on epoch:    55, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 191.2088165283s, input_fired_time: 1.8832287788, output_fired_time: 1.6136550903, propagate_forward_time: 69.8264083862, propagate_backward_time: 114.1181945801, weight_update_time: 0.1803681105, other_time: 3.7673416138
epoch time: 15.5342550278s, input_fired_time: 0.2423633337, output_fired_time: 0.0000000000, propagate_forward_time: 14.6375494003, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6543426514
validation[          , genome  6411] predictions:    9685/  10000 (96.85%), best:    9764/10000 (97.64%), error:      1021.98364, best error:       799.10016 on epoch:    55, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 191.0735931396s, input_fired_time: 1.8697865009, output_fired_time: 1.6144398451, propagate_forward_time: 72.2324752808, propagate_backward_time: 111.6599349976, weight_update_time: 0.1796604395, other_time: 3.6969604492
epoch time: 14.3939476013s, input_fired_time: 0.2417578548, output_fired_time: 0.0000000000, propagate_forward_time: 13.4652624130, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6869277954
validation[          , genome  6411] predictions:    9746/  10000 (97.46%), best:    9764/10000 (97.64%), error:       853.34637, best error:       799.10016 on epoch:    55, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 191.0716094971s, input_fired_time: 1.8785154819, output_fired_time: 1.6093086004, propagate_forward_time: 70.4232788086, propagate_backward_time: 113.4357452393, weight_update_time: 0.1902827322, other_time: 3.7247619629
epoch time: 15.4835166931s, input_fired_time: 0.2389751822, output_fired_time: 0.0000000000, propagate_forward_time: 14.5636339188, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6809072495
validation[          , genome  6411] predictions:    9753/  10000 (97.53%), best:    9764/10000 (97.64%), error:       821.67322, best error:       799.10016 on epoch:    55, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 189.4129486084s, input_fired_time: 1.8890380859, output_fired_time: 1.6108198166, propagate_forward_time: 71.2898712158, propagate_backward_time: 110.8318862915, weight_update_time: 0.1786424816, other_time: 3.7913284302
epoch time: 15.5836191177s, input_fired_time: 0.2427117825, output_fired_time: 0.0000000000, propagate_forward_time: 14.6561260223, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6847810745
validation[          , genome  6411] predictions:    9735/  10000 (97.35%), best:    9764/10000 (97.64%), error:       872.39154, best error:       799.10016 on epoch:    55, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 192.9890747070s, input_fired_time: 1.9040198326, output_fired_time: 1.6213266850, propagate_forward_time: 71.5636367798, propagate_backward_time: 113.1081008911, weight_update_time: 0.1790675223, other_time: 4.7919921875
epoch time: 14.9280223846s, input_fired_time: 0.2525667846, output_fired_time: 0.0000000000, propagate_forward_time: 14.0111541748, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6643018723
validation[          , genome  6411] predictions:    9703/  10000 (97.03%), best:    9764/10000 (97.64%), error:       952.66608, best error:       799.10016 on epoch:    55, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 78.7713012695s, input_fired_time: 1.2413966656, output_fired_time: 0.0000000000, propagate_forward_time: 73.9336395264, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5962677002
best training[          , genome  6411] predictions:   49492/  50000 (98.98%), best:    9764/10000 (97.64%), error:      1970.58618, best error:       799.10016 on epoch:    55, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 14.7648286819s, input_fired_time: 0.2415892929, output_fired_time: 0.0000000000, propagate_forward_time: 13.7945280075, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7287111282
   testing[          , genome  6411] predictions:    9778/  10000 (97.78%), best:    9764/10000 (97.64%), error:       749.42126, best error:       799.10016 on epoch:    55, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
05:12:35 (5000): called boinc_finish(0)

</stderr_txt>
]]>