Nameexact_genome_1512568488_45_4488_0
Workunit2593695
Created7 Dec 2017, 10:12:01 UTC
Sent7 Dec 2017, 10:13:37 UTC
Report deadline12 Dec 2017, 0:22:57 UTC
Received8 Dec 2017, 0:12:42 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID64142
Run time2 hours 3 min 28 sec
CPU time1 hours 50 min 47 sec
Validate stateValid
Credit1,147.46
Device peak FLOPS3.08 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size153.78 MB
Peak swap size156.90 MB
Peak disk usage1.62 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
: 0.0000000000, other_time: 0.3553390503
validation[          , genome  4488] predictions:    9544/  10000 (95.44%), best:    9657/10000 (96.57%), error:      1430.81152, best error:      1136.05627 on epoch:    12, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 91.5924148560s, input_fired_time: 1.1659172773, output_fired_time: 0.5794634819, propagate_forward_time: 34.5680885315, propagate_backward_time: 52.3845214844, weight_update_time: 0.3599013984, other_time: 2.8944282532
epoch time: 6.4882121086s, input_fired_time: 0.0755887702, output_fired_time: 0.0000000000, propagate_forward_time: 6.0587558746, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3538675308
validation[          , genome  4488] predictions:    9611/  10000 (96.11%), best:    9657/10000 (96.57%), error:      1304.00220, best error:      1136.05627 on epoch:    12, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 94.9912490845s, input_fired_time: 1.4303909540, output_fired_time: 0.8487712145, propagate_forward_time: 34.1620674133, propagate_backward_time: 55.8496170044, weight_update_time: 0.1133809313, other_time: 2.7004051208
epoch time: 5.6212148666s, input_fired_time: 0.0693100318, output_fired_time: 0.0000000000, propagate_forward_time: 4.9775643349, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5743403435
validation[          , genome  4488] predictions:    9616/  10000 (96.16%), best:    9657/10000 (96.57%), error:      1249.06226, best error:      1136.05627 on epoch:    12, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 96.1050567627s, input_fired_time: 1.1856589317, output_fired_time: 0.8547582626, propagate_forward_time: 35.7368927002, propagate_backward_time: 55.8611335754, weight_update_time: 0.1145498306, other_time: 2.4666099548
epoch time: 7.3861236572s, input_fired_time: 0.0827738345, output_fired_time: 0.0000000000, propagate_forward_time: 6.9171824455, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3861675262
validation[          , genome  4488] predictions:    9644/  10000 (96.44%), best:    9657/10000 (96.57%), error:      1219.93652, best error:      1136.05627 on epoch:    12, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/mnist_training_50k.bin'
boincified validation filename: '../../projects/csgrid.org_csg/mnist_validation_10k.bin'
boincified testing filename: '../../projects/csgrid.org_csg/mnist_testing_new.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1512568488_45_4488.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1512568488_45_4488_0_r167533043_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.846925
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.00364986
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 0.000145994
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 24
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 12
read number_validation_images: 10000
read best_validation_predictions: 9657
read best_validation_error: 1136.06
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 4488
read normal distribution: '1 0.549893021583557 -1.307168841362'
generator_str: '1905171431'
read generator: 1905171431
read generated_by_map:
1 add_node 1
reading 18 nodes.
reading 34 edges.
number input nodes: 1
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 4923 images.
reading image set with 5742 images.
reading image set with 4958 images.
reading image set with 5131 images.
reading image set with 4842 images.
reading image set with 4421 images.
reading image set with 4918 images.
reading image set with 5265 images.
reading image set with 4851 images.
reading image set with 4949 images.
image_size: 1x28x28 = 784
read 50000 images.
    class    0: 4923
    class    1: 5742
    class    2: 4958
    class    3: 5131
    class    4: 4842
    class    5: 4421
    class    6: 4918
    class    7: 5265
    class    8: 4851
    class    9: 4949
calculating averages and standard deviations for images
average pixel value for channel 0: 0.130530551075935
pixel variance for channel 0: 0.0948646068572998
pixel standard deviation for channel 0: 0.308000981807709
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 1x28x28 = 784
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 980 images.
reading image set with 1135 images.
reading image set with 1032 images.
reading image set with 1010 images.
reading image set with 982 images.
reading image set with 892 images.
reading image set with 958 images.
reading image set with 1028 images.
reading image set with 974 images.
reading image set with 1009 images.
image_size: 1x28x28 = 784
read 10000 images.
    class    0: 980
    class    1: 1135
    class    2: 1032
    class    3: 1010
    class    4: 982
    class    5: 892
    class    6: 958
    class    7: 1028
    class    8: 974
    class    9: 1009
loaded images
starting backpropagation!
epoch time: 73.7716674804688s, input_fired_time: 0.590810000896454, output_fired_time: 0.479875952005386, propagate_forward_time: 27.0392532348633, propagate_backward_time: 43.0196304321289, weight_update_time: 0.0918507501482964, other_time: 2.64209747314453
epoch time: 7.1179633140564s, input_fired_time: 0.0805536061525345, output_fired_time: 0, propagate_forward_time: 6.40607833862305, propagate_backward_time: 0, weight_update_time: 0, other_time: 0.631331443786621
validation[          , genome  4488] predictions:    9692/  10000 (96.92%), best:    9692/10000 (96.92%), error:      1070.97888, best error:      1070.97888 on epoch:    24, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 75.7273178101s, input_fired_time: 0.6030691862, output_fired_time: 0.7421092391, propagate_forward_time: 27.8600883484, propagate_backward_time: 43.8192024231, weight_update_time: 0.0940994769, other_time: 2.7028503418
epoch time: 7.2814865112s, input_fired_time: 0.0818269923, output_fired_time: 0.0000000000, propagate_forward_time: 6.8109960556, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3886632919
validation[          , genome  4488] predictions:    9671/  10000 (96.71%), best:    9671/10000 (96.71%), error:      1063.56140, best error:      1063.56140 on epoch:    25, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 74.9605102539s, input_fired_time: 1.0959022045, output_fired_time: 0.4850704670, propagate_forward_time: 27.7910537720, propagate_backward_time: 43.1850280762, weight_update_time: 0.0925455615, other_time: 2.4034576416
epoch time: 4.6010808945s, input_fired_time: 0.0625549033, output_fired_time: 0.0000000000, propagate_forward_time: 4.2481474876, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2903785706
validation[          , genome  4488] predictions:    9668/  10000 (96.68%), best:    9671/10000 (96.71%), error:      1126.23193, best error:      1063.56140 on epoch:    25, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 77.1178131104s, input_fired_time: 0.6081696153, output_fired_time: 0.4986405671, propagate_forward_time: 28.5861320496, propagate_backward_time: 45.4819641113, weight_update_time: 0.0951122567, other_time: 1.9429054260
epoch time: 5.9229812622s, input_fired_time: 0.0706354380, output_fired_time: 0.0000000000, propagate_forward_time: 5.5200929642, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3322529793
validation[          , genome  4488] predictions:    9638/  10000 (96.38%), best:    9671/10000 (96.71%), error:      1140.05542, best error:      1063.56140 on epoch:    25, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 77.4919815063s, input_fired_time: 0.8591144681, output_fired_time: 0.4995912910, propagate_forward_time: 28.3729515076, propagate_backward_time: 44.3132057190, weight_update_time: 0.3453428447, other_time: 3.4471206665
epoch time: 7.2646412849s, input_fired_time: 0.3324217200, output_fired_time: 0.0000000000, propagate_forward_time: 6.2956786156, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6365408897
validation[          , genome  4488] predictions:    9682/  10000 (96.82%), best:    9682/10000 (96.82%), error:      1009.17175, best error:      1009.17175 on epoch:    28, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 92.0843811035s, input_fired_time: 0.6723585725, output_fired_time: 0.8330864310, propagate_forward_time: 35.3777198792, propagate_backward_time: 52.2501144409, weight_update_time: 0.1097945943, other_time: 2.9511070251
epoch time: 7.0909352303s, input_fired_time: 0.0799796432, output_fired_time: 0.0000000000, propagate_forward_time: 6.3809485435, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6300072670
validation[          , genome  4488] predictions:    9656/  10000 (96.56%), best:    9682/10000 (96.82%), error:      1093.57849, best error:      1009.17175 on epoch:    28, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 86.3505783081s, input_fired_time: 0.8973777890, output_fired_time: 0.5512027740, propagate_forward_time: 31.3912906647, propagate_backward_time: 51.1482238770, weight_update_time: 0.1044820398, other_time: 2.3624877930
epoch time: 6.7510900497s, input_fired_time: 0.0766858459, output_fired_time: 0.0000000000, propagate_forward_time: 6.3116641045, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3627400398
validation[          , genome  4488] predictions:    9685/  10000 (96.85%), best:    9682/10000 (96.82%), error:      1078.61780, best error:      1009.17175 on epoch:    28, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 47.7783927917s, input_fired_time: 0.5484443903, output_fired_time: 0.4191528261, propagate_forward_time: 17.2756233215, propagate_backward_time: 27.8643341064, weight_update_time: 0.0805778503, other_time: 1.6708412170
epoch time: 3.5875995159s, input_fired_time: 0.0620751567, output_fired_time: 0.0000000000, propagate_forward_time: 3.2403874397, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2851369381
validation[          , genome  4488] predictions:    9662/  10000 (96.62%), best:    9682/10000 (96.82%), error:      1126.69470, best error:      1009.17175 on epoch:    28, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 46.8321609497s, input_fired_time: 0.5442926288, output_fired_time: 0.4146552682, propagate_forward_time: 16.7554206848, propagate_backward_time: 27.4664974213, weight_update_time: 0.0793198720, other_time: 1.6512966156
epoch time: 4.4463028908s, input_fired_time: 0.0711336583, output_fired_time: 0.0000000000, propagate_forward_time: 4.0463080406, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3288612366
validation[          , genome  4488] predictions:    9621/  10000 (96.21%), best:    9682/10000 (96.82%), error:      1190.21838, best error:      1009.17175 on epoch:    28, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 48.3357620239s, input_fired_time: 0.5531275272, output_fired_time: 0.4265837371, propagate_forward_time: 17.3520011902, propagate_backward_time: 28.3192138672, weight_update_time: 0.0817145184, other_time: 1.6848373413
epoch time: 4.2711730003s, input_fired_time: 0.0690876767, output_fired_time: 0.0000000000, propagate_forward_time: 3.8804399967, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3216454983
validation[          , genome  4488] predictions:    9533/  10000 (95.33%), best:    9682/10000 (96.82%), error:      1557.19214, best error:      1009.17175 on epoch:    28, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 46.4203758240s, input_fired_time: 0.5415688157, output_fired_time: 0.4116056859, propagate_forward_time: 16.5908451080, propagate_backward_time: 27.2356452942, weight_update_time: 0.0789671019, other_time: 1.6407108307
epoch time: 3.8614895344s, input_fired_time: 0.0653755665, output_fired_time: 0.0000000000, propagate_forward_time: 3.4965274334, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2995865345
validation[          , genome  4488] predictions:    9647/  10000 (96.47%), best:    9682/10000 (96.82%), error:      1165.51294, best error:      1009.17175 on epoch:    28, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 49.3925857544s, input_fired_time: 0.5588887930, output_fired_time: 0.4350251853, propagate_forward_time: 17.8183498383, propagate_backward_time: 28.8766174316, weight_update_time: 0.0826366693, other_time: 1.7037067413
epoch time: 3.7365858555s, input_fired_time: 0.0633132160, output_fired_time: 0.0000000000, propagate_forward_time: 3.3788578510, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2944147587
validation[          , genome  4488] predictions:    9685/  10000 (96.85%), best:    9682/10000 (96.82%), error:      1102.80957, best error:      1009.17175 on epoch:    28, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 45.9137077332s, input_fired_time: 0.5388725996, output_fired_time: 0.4077979922, propagate_forward_time: 16.4131221771, propagate_backward_time: 26.9247379303, weight_update_time: 0.0782543793, other_time: 1.6291770935
epoch time: 3.9131855965s, input_fired_time: 0.0656535923, output_fired_time: 0.0000000000, propagate_forward_time: 3.5445637703, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3029682636
validation[          , genome  4488] predictions:    9695/  10000 (96.95%), best:    9695/10000 (96.95%), error:      1006.50842, best error:      1006.50842 on epoch:    36, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 48.8765029907s, input_fired_time: 0.5558062792, output_fired_time: 0.4304194748, propagate_forward_time: 17.5922527313, propagate_backward_time: 28.6017971039, weight_update_time: 0.0822638869, other_time: 1.6962280273
epoch time: 4.5864458084s, input_fired_time: 0.0728038102, output_fired_time: 0.0000000000, propagate_forward_time: 4.1777997017, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3358421326
validation[          , genome  4488] predictions:    9688/  10000 (96.88%), best:    9695/10000 (96.95%), error:      1035.34167, best error:      1006.50842 on epoch:    36, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 47.5633697510s, input_fired_time: 0.5494594574, output_fired_time: 0.4202598333, propagate_forward_time: 17.0414142609, propagate_backward_time: 27.8805503845, weight_update_time: 0.0805983767, other_time: 1.6716823578
epoch time: 5.0831942558s, input_fired_time: 0.0775455609, output_fired_time: 0.0000000000, propagate_forward_time: 4.6449413300, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3607072830
validation[          , genome  4488] predictions:    9701/  10000 (97.01%), best:    9695/10000 (96.95%), error:      1080.44360, best error:      1006.50842 on epoch:    36, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 48.8883628845s, input_fired_time: 0.5566528440, output_fired_time: 0.4316048920, propagate_forward_time: 17.5549411774, propagate_backward_time: 28.6505756378, weight_update_time: 0.0818993673, other_time: 1.6945877075
epoch time: 3.7831280231s, input_fired_time: 0.0642015189, output_fired_time: 0.0000000000, propagate_forward_time: 3.4225640297, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2963624001
validation[          , genome  4488] predictions:    9689/  10000 (96.89%), best:    9695/10000 (96.95%), error:      1020.21313, best error:      1006.50842 on epoch:    36, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 47.5646820068s, input_fired_time: 0.5514373779, output_fired_time: 0.4208286405, propagate_forward_time: 17.0574035645, propagate_backward_time: 27.8738441467, weight_update_time: 0.0801897198, other_time: 1.6611671448
epoch time: 3.5887465477s, input_fired_time: 0.0623700768, output_fired_time: 0.0000000000, propagate_forward_time: 3.2398936749, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2864828110
validation[          , genome  4488] predictions:    9660/  10000 (96.60%), best:    9695/10000 (96.95%), error:      1074.67932, best error:      1006.50842 on epoch:    36, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 46.2668762207s, input_fired_time: 0.5413025618, output_fired_time: 0.4104271829, propagate_forward_time: 16.5323486328, propagate_backward_time: 27.1426353455, weight_update_time: 0.0788754150, other_time: 1.6401634216
epoch time: 3.5890061855s, input_fired_time: 0.0630843043, output_fired_time: 0.0000000000, propagate_forward_time: 3.2395210266, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2864007950
validation[          , genome  4488] predictions:    9690/  10000 (96.90%), best:    9695/10000 (96.95%), error:      1066.58215, best error:      1006.50842 on epoch:    36, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 46.3084220886s, input_fired_time: 0.5431498885, output_fired_time: 0.4107102752, propagate_forward_time: 16.5542411804, propagate_backward_time: 27.1601791382, weight_update_time: 0.0790976286, other_time: 1.6401443481
epoch time: 3.5989975929s, input_fired_time: 0.0631718934, output_fired_time: 0.0000000000, propagate_forward_time: 3.2490699291, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2867558002
validation[          , genome  4488] predictions:    9644/  10000 (96.44%), best:    9695/10000 (96.95%), error:      1155.13074, best error:      1006.50842 on epoch:    36, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 51.1390151978s, input_fired_time: 0.5725170970, output_fired_time: 0.4480946362, propagate_forward_time: 18.5015335083, propagate_backward_time: 29.8558692932, weight_update_time: 0.0858526155, other_time: 1.7610015869
epoch time: 3.9510595798s, input_fired_time: 0.0660632029, output_fired_time: 0.0000000000, propagate_forward_time: 3.5795207024, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3054757118
validation[          , genome  4488] predictions:    9649/  10000 (96.49%), best:    9695/10000 (96.95%), error:      1186.92200, best error:      1006.50842 on epoch:    36, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 54.5220985413s, input_fired_time: 0.5913096666, output_fired_time: 0.4740723073, propagate_forward_time: 19.8707103729, propagate_backward_time: 31.7493743896, weight_update_time: 0.0900767669, other_time: 1.8366317749
epoch time: 4.7649478912s, input_fired_time: 0.0750090405, output_fired_time: 0.0000000000, propagate_forward_time: 4.3433575630, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3465814590
validation[          , genome  4488] predictions:    9690/  10000 (96.90%), best:    9690/10000 (96.90%), error:       979.53583, best error:       979.53583 on epoch:    44, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 52.1285629272s, input_fired_time: 0.5779130459, output_fired_time: 0.4559289217, propagate_forward_time: 18.9037132263, propagate_backward_time: 30.4011745453, weight_update_time: 0.0869717970, other_time: 1.7898349762
epoch time: 4.6616034508s, input_fired_time: 0.0742999241, output_fired_time: 0.0000000000, propagate_forward_time: 4.2469501495, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3403534889
validation[          , genome  4488] predictions:    9661/  10000 (96.61%), best:    9690/10000 (96.90%), error:      1124.04761, best error:       979.53583 on epoch:    44, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 52.9705009460s, input_fired_time: 0.5844714046, output_fired_time: 0.4622191489, propagate_forward_time: 19.2552757263, propagate_backward_time: 30.8671150208, weight_update_time: 0.0879717544, other_time: 1.8014183044
epoch time: 5.6166911125s, input_fired_time: 0.0834367573, output_fired_time: 0.0000000000, propagate_forward_time: 5.1449422836, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3883118629
validation[          , genome  4488] predictions:    9680/  10000 (96.80%), best:    9690/10000 (96.90%), error:      1052.76941, best error:       979.53583 on epoch:    44, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 53.6247596741s, input_fired_time: 0.5887292027, output_fired_time: 0.4661026895, propagate_forward_time: 19.5319499969, propagate_backward_time: 31.2199592590, weight_update_time: 0.0887925476, other_time: 1.8180198669
epoch time: 4.6640439034s, input_fired_time: 0.0738734156, output_fired_time: 0.0000000000, propagate_forward_time: 4.2486186028, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3415517807
validation[          , genome  4488] predictions:    9643/  10000 (96.43%), best:    9690/10000 (96.90%), error:      1136.66907, best error:       979.53583 on epoch:    44, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 55.9980506897s, input_fired_time: 0.6020715237, output_fired_time: 0.4846065640, propagate_forward_time: 20.4625034332, propagate_backward_time: 32.5679817200, weight_update_time: 0.0924283266, other_time: 1.8808860779
epoch time: 4.3203582764s, input_fired_time: 0.0706472695, output_fired_time: 0.0000000000, propagate_forward_time: 3.9232695103, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3264415264
validation[          , genome  4488] predictions:    9701/  10000 (97.01%), best:    9690/10000 (96.90%), error:      1008.65680, best error:       979.53583 on epoch:    44, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 48.4299430847s, input_fired_time: 0.5598753691, output_fired_time: 0.4275788963, propagate_forward_time: 17.4008827209, propagate_backward_time: 28.3306732178, weight_update_time: 0.0825469866, other_time: 1.7109336853
epoch time: 4.9469165802s, input_fired_time: 0.0774426460, output_fired_time: 0.0000000000, propagate_forward_time: 4.5134744644, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3559994698
validation[          , genome  4488] predictions:    9674/  10000 (96.74%), best:    9690/10000 (96.90%), error:      1072.94214, best error:       979.53583 on epoch:    44, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 57.0551071167s, input_fired_time: 0.6106495261, output_fired_time: 0.4930546284, propagate_forward_time: 20.9087104797, propagate_backward_time: 33.1367378235, weight_update_time: 0.0936064348, other_time: 1.9059562683
epoch time: 4.7192044258s, input_fired_time: 0.0744863003, output_fired_time: 0.0000000000, propagate_forward_time: 4.2994651794, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3452529907
validation[          , genome  4488] predictions:    9694/  10000 (96.94%), best:    9690/10000 (96.90%), error:      1028.70911, best error:       979.53583 on epoch:    44, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 56.9491882324s, input_fired_time: 0.6097571254, output_fired_time: 0.4901077151, propagate_forward_time: 20.8331527710, propagate_backward_time: 33.1086769104, weight_update_time: 0.0939280465, other_time: 1.9074935913
epoch time: 4.6895389557s, input_fired_time: 0.0750075206, output_fired_time: 0.0000000000, propagate_forward_time: 4.2717123032, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3428192139
validation[          , genome  4488] predictions:    9715/  10000 (97.15%), best:    9715/10000 (97.15%), error:       955.72638, best error:       955.72638 on epoch:    51, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 56.1246643066s, input_fired_time: 0.6033791900, output_fired_time: 0.4851958156, propagate_forward_time: 20.4711780548, propagate_backward_time: 32.6772537231, weight_update_time: 0.0926065147, other_time: 1.8876571655
epoch time: 3.7402677536s, input_fired_time: 0.0651369840, output_fired_time: 0.0000000000, propagate_forward_time: 3.3795096874, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2956211567
validation[          , genome  4488] predictions:    9629/  10000 (96.29%), best:    9715/10000 (97.15%), error:      1174.95117, best error:       955.72638 on epoch:    51, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 81.1321334839s, input_fired_time: 1.1392720938, output_fired_time: 1.0320717096, propagate_forward_time: 29.7825603485, propagate_backward_time: 46.3834419250, weight_update_time: 0.1009087116, other_time: 2.7947807312
epoch time: 6.0424394608s, input_fired_time: 0.0733869821, output_fired_time: 0.0000000000, propagate_forward_time: 5.1299638748, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8390884399
validation[          , genome  4488] predictions:    9682/  10000 (96.82%), best:    9715/10000 (97.15%), error:      1086.41919, best error:       955.72638 on epoch:    51, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 87.5619277954s, input_fired_time: 0.6583188772, output_fired_time: 0.8055193424, propagate_forward_time: 30.8198394775, propagate_backward_time: 52.4148292542, weight_update_time: 0.3550231457, other_time: 2.8634223938
epoch time: 7.9165492058s, input_fired_time: 0.0876260027, output_fired_time: 0.0000000000, propagate_forward_time: 7.4194331169, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4094901085
validation[          , genome  4488] predictions:    9708/  10000 (97.08%), best:    9708/10000 (97.08%), error:       954.75555, best error:       954.75555 on epoch:    54, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 95.1785049438s, input_fired_time: 0.6918231845, output_fired_time: 0.5998420119, propagate_forward_time: 34.6779975891, propagate_backward_time: 55.9644851685, weight_update_time: 0.1123254448, other_time: 3.2443580627
epoch time: 6.7502985001s, input_fired_time: 0.0781686604, output_fired_time: 0.0000000000, propagate_forward_time: 6.3118062019, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3603234291
validation[          , genome  4488] predictions:    9713/  10000 (97.13%), best:    9708/10000 (97.08%), error:       987.20483, best error:       954.75555 on epoch:    54, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 93.1164016724s, input_fired_time: 0.9344767332, output_fired_time: 0.5893016458, propagate_forward_time: 37.3403167725, propagate_backward_time: 51.5376014709, weight_update_time: 0.1104801595, other_time: 2.7147026062
epoch time: 7.0043001175s, input_fired_time: 0.0812632442, output_fired_time: 0.0000000000, propagate_forward_time: 6.5480060577, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3750309944
validation[          , genome  4488] predictions:    9702/  10000 (97.02%), best:    9708/10000 (97.08%), error:       985.35931, best error:       954.75555 on epoch:    54, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 98.6468963623s, input_fired_time: 0.9573022723, output_fired_time: 0.6170634627, propagate_forward_time: 36.1984481812, propagate_backward_time: 57.5694847107, weight_update_time: 0.1157180592, other_time: 3.3045921326
epoch time: 6.4940013885s, input_fired_time: 0.0780780464, output_fired_time: 0.0000000000, propagate_forward_time: 6.0521373749, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3637857437
validation[          , genome  4488] predictions:    9710/  10000 (97.10%), best:    9708/10000 (97.08%), error:       988.51910, best error:       954.75555 on epoch:    54, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 88.0274581909s, input_fired_time: 0.9126777053, output_fired_time: 1.0571870804, propagate_forward_time: 30.0201931000, propagate_backward_time: 53.1583213806, weight_update_time: 0.1055433750, other_time: 2.8790779114
epoch time: 5.2281303406s, input_fired_time: 0.0678777471, output_fired_time: 0.0000000000, propagate_forward_time: 4.8504171371, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3098354340
validation[          , genome  4488] predictions:    9663/  10000 (96.63%), best:    9708/10000 (97.08%), error:      1081.35120, best error:       954.75555 on epoch:    54, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 83.7857284546s, input_fired_time: 0.6473851204, output_fired_time: 0.7868683934, propagate_forward_time: 31.3215522766, propagate_backward_time: 47.9733848572, weight_update_time: 0.3519999683, other_time: 3.0565414429
epoch time: 6.0685653687s, input_fired_time: 0.0745656118, output_fired_time: 0.0000000000, propagate_forward_time: 5.6547031403, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3392968178
validation[          , genome  4488] predictions:    9703/  10000 (97.03%), best:    9708/10000 (97.08%), error:       980.84607, best error:       954.75555 on epoch:    54, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 90.9207000732s, input_fired_time: 0.6778886318, output_fired_time: 0.5771279335, propagate_forward_time: 32.2366142273, propagate_backward_time: 53.7512245178, weight_update_time: 0.3584635854, other_time: 3.6778488159
epoch time: 7.2815752029s, input_fired_time: 0.0809012428, output_fired_time: 0.0000000000, propagate_forward_time: 6.8245811462, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3760929108
validation[          , genome  4488] predictions:    9717/  10000 (97.17%), best:    9717/10000 (97.17%), error:       945.49030, best error:       945.49030 on epoch:    60, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 65.7400207520s, input_fired_time: 0.6342393756, output_fired_time: 0.5192530155, propagate_forward_time: 23.6475734711, propagate_backward_time: 38.7043342590, weight_update_time: 0.0982632488, other_time: 2.2346153259
epoch time: 5.4628300667s, input_fired_time: 0.0833076909, output_fired_time: 0.0000000000, propagate_forward_time: 4.9998912811, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3796310425
validation[          , genome  4488] predictions:    9687/  10000 (96.87%), best:    9717/10000 (97.17%), error:       980.38159, best error:       945.49030 on epoch:    60, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 59.7932701111s, input_fired_time: 0.6281320453, output_fired_time: 0.5123616457, propagate_forward_time: 21.9620208740, propagate_backward_time: 34.7366065979, weight_update_time: 0.0966826156, other_time: 1.9541473389
epoch time: 3.9157915115s, input_fired_time: 0.0677907392, output_fired_time: 0.0000000000, propagate_forward_time: 3.5429780483, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3050227165
validation[          , genome  4488] predictions:    9730/  10000 (97.30%), best:    9717/10000 (97.17%), error:       951.51630, best error:       945.49030 on epoch:    60, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 59.6011772156s, input_fired_time: 0.6275051832, output_fired_time: 0.5112711787, propagate_forward_time: 21.8939590454, propagate_backward_time: 34.6206130981, weight_update_time: 0.0966258049, other_time: 1.9478263855
epoch time: 4.6267762184s, input_fired_time: 0.0753090978, output_fired_time: 0.0000000000, propagate_forward_time: 4.2111930847, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3402738571
validation[          , genome  4488] predictions:    9703/  10000 (97.03%), best:    9717/10000 (97.17%), error:       980.68494, best error:       945.49030 on epoch:    60, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 60.6090278625s, input_fired_time: 0.6342820525, output_fired_time: 0.5185138583, propagate_forward_time: 22.3216018677, propagate_backward_time: 35.1630325317, weight_update_time: 0.0979052484, other_time: 1.9715995789
epoch time: 5.0415716171s, input_fired_time: 0.0799202248, output_fired_time: 0.0000000000, propagate_forward_time: 4.6008195877, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3608317375
validation[          , genome  4488] predictions:    9688/  10000 (96.88%), best:    9717/10000 (97.17%), error:      1005.93317, best error:       945.49030 on epoch:    60, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 58.3067359924s, input_fired_time: 0.6220447421, output_fired_time: 0.5025497675, propagate_forward_time: 21.4228935242, propagate_backward_time: 33.8391036987, weight_update_time: 0.0950236693, other_time: 1.9201469421
epoch time: 4.3065528870s, input_fired_time: 0.0717997625, output_fired_time: 0.0000000000, propagate_forward_time: 3.9098994732, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3248536587
validation[          , genome  4488] predictions:    9705/  10000 (97.05%), best:    9717/10000 (97.17%), error:       999.39368, best error:       945.49030 on epoch:    60, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 64.5883178711s, input_fired_time: 0.6574143767, output_fired_time: 0.5504436493, propagate_forward_time: 23.9350357056, propagate_backward_time: 37.3862380981, weight_update_time: 0.1028175503, other_time: 2.0591888428
epoch time: 3.9575970173s, input_fired_time: 0.0680738091, output_fired_time: 0.0000000000, propagate_forward_time: 3.5826983452, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3068249226
validation[          , genome  4488] predictions:    9679/  10000 (96.79%), best:    9717/10000 (97.17%), error:      1055.03918, best error:       945.49030 on epoch:    60, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 57.4663658142s, input_fired_time: 0.6156532764, output_fired_time: 0.4950836599, propagate_forward_time: 20.9995174408, propagate_backward_time: 33.4552421570, weight_update_time: 0.0936991498, other_time: 1.9008674622
epoch time: 4.9566879272s, input_fired_time: 0.0787272602, output_fired_time: 0.0000000000, propagate_forward_time: 4.5213489532, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3566117287
validation[          , genome  4488] predictions:    9699/  10000 (96.99%), best:    9699/10000 (96.99%), error:       943.36145, best error:       943.36145 on epoch:    67, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 59.2252082825s, input_fired_time: 0.6277956963, output_fired_time: 0.5077539086, propagate_forward_time: 21.7773265839, propagate_backward_time: 34.3730697632, weight_update_time: 0.0960503072, other_time: 1.9392623901
epoch time: 4.7885026932s, input_fired_time: 0.0770427436, output_fired_time: 0.0000000000, propagate_forward_time: 4.3626680374, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3487920761
validation[          , genome  4488] predictions:    9713/  10000 (97.13%), best:    9699/10000 (96.99%), error:       953.55670, best error:       943.36145 on epoch:    67, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 59.7510681152s, input_fired_time: 0.6316207647, output_fired_time: 0.5141255260, propagate_forward_time: 22.0093021393, propagate_backward_time: 34.6349601746, weight_update_time: 0.0972468704, other_time: 1.9610557556
epoch time: 3.8714671135s, input_fired_time: 0.0674287006, output_fired_time: 0.0000000000, propagate_forward_time: 3.5019106865, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3021278381
validation[          , genome  4488] predictions:    9684/  10000 (96.84%), best:    9699/10000 (96.99%), error:      1030.31641, best error:       943.36145 on epoch:    67, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 59.0447425842s, input_fired_time: 0.6274474859, output_fired_time: 0.5087745190, propagate_forward_time: 21.6723575592, propagate_backward_time: 34.2930412292, weight_update_time: 0.0956683010, other_time: 1.9431190491
epoch time: 5.2000188828s, input_fired_time: 0.0810732916, output_fired_time: 0.0000000000, propagate_forward_time: 4.7496938705, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3692517281
validation[          , genome  4488] predictions:    9680/  10000 (96.80%), best:    9699/10000 (96.99%), error:      1028.08228, best error:       943.36145 on epoch:    67, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 59.8565330505s, input_fired_time: 0.6325638294, output_fired_time: 0.5137164593, propagate_forward_time: 22.0759429932, propagate_backward_time: 34.6762924194, weight_update_time: 0.0967061445, other_time: 1.9580154419
epoch time: 5.4947533607s, input_fired_time: 0.0839799717, output_fired_time: 0.0000000000, propagate_forward_time: 5.0257730484, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3850002289
validation[          , genome  4488] predictions:    9675/  10000 (96.75%), best:    9699/10000 (96.99%), error:      1091.35095, best error:       943.36145 on epoch:    67, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 62.4864997864s, input_fired_time: 0.6470350027, output_fired_time: 0.5312865973, propagate_forward_time: 23.0565376282, propagate_backward_time: 36.2272911072, weight_update_time: 0.1008058414, other_time: 2.0243492126
epoch time: 5.4999041557s, input_fired_time: 0.0844110921, output_fired_time: 0.0000000000, propagate_forward_time: 5.0310730934, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3844199181
validation[          , genome  4488] predictions:    9694/  10000 (96.94%), best:    9699/10000 (96.99%), error:       990.21985, best error:       943.36145 on epoch:    67, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 60.9247665405s, input_fired_time: 0.6394411325, output_fired_time: 0.5224891901, propagate_forward_time: 22.4282016754, propagate_backward_time: 35.3462028503, weight_update_time: 0.0988509655, other_time: 1.9884300232
epoch time: 3.9654853344s, input_fired_time: 0.0687589198, output_fired_time: 0.0000000000, propagate_forward_time: 3.5879623890, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3087639809
validation[          , genome  4488] predictions:    9711/  10000 (97.11%), best:    9699/10000 (96.99%), error:       947.51831, best error:       943.36145 on epoch:    67, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 64.0897293091s, input_fired_time: 0.6576052904, output_fired_time: 0.5455442071, propagate_forward_time: 23.7748661041, propagate_backward_time: 37.0493812561, weight_update_time: 0.1029178128, other_time: 2.0623359680
epoch time: 5.5018925667s, input_fired_time: 0.0840132609, output_fired_time: 0.0000000000, propagate_forward_time: 5.0319695473, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3859095573
validation[          , genome  4488] predictions:    9627/  10000 (96.27%), best:    9699/10000 (96.99%), error:      1169.41187, best error:       943.36145 on epoch:    67, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 62.5029487610s, input_fired_time: 0.6490281224, output_fired_time: 0.5329153538, propagate_forward_time: 23.0926570892, propagate_backward_time: 36.2019081116, weight_update_time: 0.1007520482, other_time: 2.0264396667
epoch time: 5.2542476654s, input_fired_time: 0.0820471272, output_fired_time: 0.0000000000, propagate_forward_time: 4.8021016121, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3700990677
validation[          , genome  4488] predictions:    9696/  10000 (96.96%), best:    9699/10000 (96.99%), error:       972.23322, best error:       943.36145 on epoch:    67, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 61.7787399292s, input_fired_time: 0.6457115412, output_fired_time: 0.5276604891, propagate_forward_time: 22.8322200775, propagate_backward_time: 35.7636260986, weight_update_time: 0.0997090712, other_time: 2.0095214844
epoch time: 5.3209786415s, input_fired_time: 0.0834203511, output_fired_time: 0.0000000000, propagate_forward_time: 4.8614473343, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3761110306
validation[          , genome  4488] predictions:    9689/  10000 (96.89%), best:    9699/10000 (96.99%), error:      1014.55096, best error:       943.36145 on epoch:    67, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 59.9465255737s, input_fired_time: 0.6372091174, output_fired_time: 0.5136426091, propagate_forward_time: 22.0547771454, propagate_backward_time: 34.7663993835, weight_update_time: 0.0978561044, other_time: 1.9744987488
epoch time: 4.5262117386s, input_fired_time: 0.0756137371, output_fired_time: 0.0000000000, propagate_forward_time: 4.1144008636, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3361968994
validation[          , genome  4488] predictions:    9599/  10000 (95.99%), best:    9699/10000 (96.99%), error:      1304.80029, best error:       943.36145 on epoch:    67, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 60.1154289246s, input_fired_time: 0.6376475096, output_fired_time: 0.5149918199, propagate_forward_time: 22.0926685333, propagate_backward_time: 34.8901405334, weight_update_time: 0.0976784527, other_time: 1.9799842834
epoch time: 5.2720623016s, input_fired_time: 0.0831704512, output_fired_time: 0.0000000000, propagate_forward_time: 4.8166294098, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3722624779
validation[          , genome  4488] predictions:    9622/  10000 (96.22%), best:    9699/10000 (96.99%), error:      1211.81226, best error:       943.36145 on epoch:    67, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 59.3240432739s, input_fired_time: 0.6344845891, output_fired_time: 0.5106157064, propagate_forward_time: 21.8008766174, propagate_backward_time: 34.4217262268, weight_update_time: 0.0966472626, other_time: 1.9563407898
epoch time: 5.1978836060s, input_fired_time: 0.0822089314, output_fired_time: 0.0000000000, propagate_forward_time: 4.7458782196, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3697962761
validation[          , genome  4488] predictions:    9655/  10000 (96.55%), best:    9699/10000 (96.99%), error:      1090.86414, best error:       943.36145 on epoch:    67, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 62.0772819519s, input_fired_time: 0.6504012942, output_fired_time: 0.5306287408, propagate_forward_time: 22.9040985107, propagate_backward_time: 35.9704856873, weight_update_time: 0.1001663357, other_time: 2.0216674805
epoch time: 4.4238448143s, input_fired_time: 0.0739327967, output_fired_time: 0.0000000000, propagate_forward_time: 4.0202174187, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3296947479
validation[          , genome  4488] predictions:    9663/  10000 (96.63%), best:    9699/10000 (96.99%), error:      1108.84558, best error:       943.36145 on epoch:    67, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 72.5414428711s, input_fired_time: 0.6559458971, output_fired_time: 0.5374986529, propagate_forward_time: 27.4205398560, propagate_backward_time: 41.3693504333, weight_update_time: 0.1020355746, other_time: 2.5581092834
epoch time: 7.7548704147s, input_fired_time: 0.0881467238, output_fired_time: 0.0000000000, propagate_forward_time: 7.0159311295, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6507925987
validation[          , genome  4488] predictions:    9675/  10000 (96.75%), best:    9699/10000 (96.99%), error:      1042.42871, best error:       943.36145 on epoch:    67, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 92.4866180420s, input_fired_time: 1.1930708885, output_fired_time: 0.5868956447, propagate_forward_time: 33.1807403564, propagate_backward_time: 54.3280181885, weight_update_time: 0.1098309755, other_time: 3.1978912354
epoch time: 8.4276857376s, input_fired_time: 0.0924773067, output_fired_time: 0.0000000000, propagate_forward_time: 7.4149770737, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9202318192
validation[          , genome  4488] predictions:    9698/  10000 (96.98%), best:    9699/10000 (96.99%), error:       968.25806, best error:       943.36145 on epoch:    67, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 95.0223846436s, input_fired_time: 0.9546031952, output_fired_time: 0.8493613005, propagate_forward_time: 36.2571029663, propagate_backward_time: 53.4694709778, weight_update_time: 0.1123668849, other_time: 3.4918479919
epoch time: 8.2410268784s, input_fired_time: 0.0929447562, output_fired_time: 0.0000000000, propagate_forward_time: 7.4731659889, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6749157906
validation[          , genome  4488] predictions:    9727/  10000 (97.27%), best:    9727/10000 (97.27%), error:       915.74487, best error:       915.74487 on epoch:    83, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 94.9470138550s, input_fired_time: 0.9512034059, output_fired_time: 1.0962796211, propagate_forward_time: 34.6126022339, propagate_backward_time: 55.7919197083, weight_update_time: 0.1126817763, other_time: 2.4950065613
epoch time: 8.1004981995s, input_fired_time: 0.0921398923, output_fired_time: 0.0000000000, propagate_forward_time: 7.5924506187, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4159073830
validation[          , genome  4488] predictions:    9677/  10000 (96.77%), best:    9727/10000 (97.27%), error:      1051.33948, best error:       915.74487 on epoch:    83, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 102.7171020508s, input_fired_time: 0.9870381951, output_fired_time: 0.6407805681, propagate_forward_time: 37.1043777466, propagate_backward_time: 60.6054267883, weight_update_time: 0.1201657653, other_time: 3.3794822693
epoch time: 8.3065776825s, input_fired_time: 0.0911173970, output_fired_time: 0.0000000000, propagate_forward_time: 7.8009939194, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4144659042
validation[          , genome  4488] predictions:    9694/  10000 (96.94%), best:    9727/10000 (97.27%), error:       970.00598, best error:       915.74487 on epoch:    83, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 106.5089645386s, input_fired_time: 1.2537081242, output_fired_time: 0.6636297107, propagate_forward_time: 41.0980758667, propagate_backward_time: 60.0444869995, weight_update_time: 0.1241671517, other_time: 3.4490661621
epoch time: 8.9273605347s, input_fired_time: 0.3478662670, output_fired_time: 0.0000000000, propagate_forward_time: 7.6307878494, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9487066269
validation[          , genome  4488] predictions:    9683/  10000 (96.83%), best:    9727/10000 (97.27%), error:       999.18073, best error:       915.74487 on epoch:    83, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 106.7965393066s, input_fired_time: 0.7568157911, output_fired_time: 0.6662365794, propagate_forward_time: 40.3726310730, propagate_backward_time: 62.2855529785, weight_update_time: 0.1249750629, other_time: 2.7153015137
epoch time: 8.0220375061s, input_fired_time: 0.0911178812, output_fired_time: 0.0000000000, propagate_forward_time: 7.0123715401, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9185481071
validation[          , genome  4488] predictions:    9672/  10000 (96.72%), best:    9727/10000 (97.27%), error:      1024.41772, best error:       915.74487 on epoch:    83, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 106.3074645996s, input_fired_time: 0.7501358986, output_fired_time: 1.1580575705, propagate_forward_time: 36.9555473328, propagate_backward_time: 64.2456283569, weight_update_time: 0.1238758415, other_time: 3.1980972290
epoch time: 8.8531579971s, input_fired_time: 0.0974023491, output_fired_time: 0.0000000000, propagate_forward_time: 8.3132228851, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4425325394
validation[          , genome  4488] predictions:    9681/  10000 (96.81%), best:    9727/10000 (97.27%), error:      1045.03442, best error:       915.74487 on epoch:    83, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 107.7991180420s, input_fired_time: 1.0138270855, output_fired_time: 0.9247001410, propagate_forward_time: 41.6206779480, propagate_backward_time: 61.5216674805, weight_update_time: 0.1248578206, other_time: 2.7182464600
epoch time: 9.0784053802s, input_fired_time: 0.0994974598, output_fired_time: 0.0000000000, propagate_forward_time: 8.5226783752, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4562292099
validation[          , genome  4488] predictions:    9654/  10000 (96.54%), best:    9727/10000 (97.27%), error:      1137.76086, best error:       915.74487 on epoch:    83, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 84.3809967041s, input_fired_time: 0.9737532735, output_fired_time: 0.8721361160, propagate_forward_time: 31.6071338654, propagate_backward_time: 48.3764877319, weight_update_time: 0.1159679443, other_time: 2.5514831543
epoch time: 5.6451816559s, input_fired_time: 0.0867596790, output_fired_time: 0.0000000000, propagate_forward_time: 5.1649098396, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3935122490
validation[          , genome  4488] predictions:    9671/  10000 (96.71%), best:    9727/10000 (97.27%), error:      1058.34204, best error:       915.74487 on epoch:    83, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 70.1332092285s, input_fired_time: 0.6987411976, output_fired_time: 0.5907161236, propagate_forward_time: 26.1707954407, propagate_backward_time: 40.4545059204, weight_update_time: 0.1120213792, other_time: 2.2184562683
epoch time: 5.8376107216s, input_fired_time: 0.0897585303, output_fired_time: 0.0000000000, propagate_forward_time: 5.3450865746, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4027657509
validation[          , genome  4488] predictions:    9704/  10000 (97.04%), best:    9727/10000 (97.27%), error:       942.56622, best error:       915.74487 on epoch:    83, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 70.0585327148s, input_fired_time: 0.6995560527, output_fired_time: 0.5897819400, propagate_forward_time: 26.1285266876, propagate_backward_time: 40.4407691956, weight_update_time: 0.1103926226, other_time: 2.1999015808
epoch time: 5.6898446083s, input_fired_time: 0.0882040188, output_fired_time: 0.0000000000, propagate_forward_time: 5.2063407898, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3952999115
validation[          , genome  4488] predictions:    9686/  10000 (96.86%), best:    9727/10000 (97.27%), error:      1012.62347, best error:       915.74487 on epoch:    83, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 70.2183151245s, input_fired_time: 0.6996305585, output_fired_time: 0.5908073187, propagate_forward_time: 26.2083683014, propagate_backward_time: 40.5100860596, weight_update_time: 0.1106194779, other_time: 2.2094268799
epoch time: 5.6132164001s, input_fired_time: 0.0879598185, output_fired_time: 0.0000000000, propagate_forward_time: 5.1349229813, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3903336525
validation[          , genome  4488] predictions:    9702/  10000 (97.02%), best:    9727/10000 (97.27%), error:       956.66107, best error:       915.74487 on epoch:    83, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 70.3805084229s, input_fired_time: 0.7008190751, output_fired_time: 0.5935922861, propagate_forward_time: 26.2737464905, propagate_backward_time: 40.5993614197, weight_update_time: 0.1128507853, other_time: 2.2129898071
epoch time: 5.9524226189s, input_fired_time: 0.0910165235, output_fired_time: 0.0000000000, propagate_forward_time: 5.4516406059, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4097657204
validation[          , genome  4488] predictions:    9685/  10000 (96.85%), best:    9727/10000 (97.27%), error:      1055.00916, best error:       915.74487 on epoch:    83, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 70.2423095703s, input_fired_time: 0.7015447617, output_fired_time: 0.5908213258, propagate_forward_time: 26.2223434448, propagate_backward_time: 40.5165405273, weight_update_time: 0.1111524627, other_time: 2.2110595703
epoch time: 5.8005604744s, input_fired_time: 0.0887452289, output_fired_time: 0.0000000000, propagate_forward_time: 5.2959790230, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4158363342
validation[          , genome  4488] predictions:    9720/  10000 (97.20%), best:    9727/10000 (97.27%), error:       947.44995, best error:       915.74487 on epoch:    83, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 70.8562088013s, input_fired_time: 0.7059994936, output_fired_time: 0.5971121192, propagate_forward_time: 26.4405784607, propagate_backward_time: 40.8806648254, weight_update_time: 0.1119086817, other_time: 2.2318496704
epoch time: 5.8595399857s, input_fired_time: 0.0899510533, output_fired_time: 0.0000000000, propagate_forward_time: 5.3671126366, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4024763107
validation[          , genome  4488] predictions:    9725/  10000 (97.25%), best:    9725/10000 (97.25%), error:       896.47437, best error:       896.47437 on epoch:    96, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 70.9263534546s, input_fired_time: 0.7177522182, output_fired_time: 0.5894765854, propagate_forward_time: 26.4771175385, propagate_backward_time: 40.9000320435, weight_update_time: 0.1113408878, other_time: 2.2419738770
epoch time: 5.7252130508s, input_fired_time: 0.0890063718, output_fired_time: 0.0000000000, propagate_forward_time: 5.2404460907, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3957605362
validation[          , genome  4488] predictions:    9699/  10000 (96.99%), best:    9725/10000 (97.25%), error:       983.43835, best error:       896.47437 on epoch:    96, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 71.8146286011s, input_fired_time: 0.7076480985, output_fired_time: 0.5972709060, propagate_forward_time: 26.9040050507, propagate_backward_time: 41.3740196228, weight_update_time: 0.1118825972, other_time: 2.2316856384
epoch time: 5.6812801361s, input_fired_time: 0.0884395614, output_fired_time: 0.0000000000, propagate_forward_time: 5.1981816292, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3946590424
validation[          , genome  4488] predictions:    9682/  10000 (96.82%), best:    9725/10000 (97.25%), error:      1003.54089, best error:       896.47437 on epoch:    96, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 70.4743957520s, input_fired_time: 0.7064754367, output_fired_time: 0.5924432874, propagate_forward_time: 26.3294391632, propagate_backward_time: 40.6252975464, weight_update_time: 0.1113588065, other_time: 2.2207412720
epoch time: 5.6664738655s, input_fired_time: 0.0880990624, output_fired_time: 0.0000000000, propagate_forward_time: 5.1837291718, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3946456909
validation[          , genome  4488] predictions:    9686/  10000 (96.86%), best:    9725/10000 (97.25%), error:       985.19879, best error:       896.47437 on epoch:    96, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 69.9007186890s, input_fired_time: 0.7028079629, output_fired_time: 0.5877997875, propagate_forward_time: 26.1252803802, propagate_backward_time: 40.2720069885, weight_update_time: 0.1109916940, other_time: 2.2128257751
epoch time: 5.5192117691s, input_fired_time: 0.0866439939, output_fired_time: 0.0000000000, propagate_forward_time: 5.0465950966, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3859724998
validation[          , genome  4488] predictions:    9722/  10000 (97.22%), best:    9725/10000 (97.25%), error:       898.42731, best error:       896.47437 on epoch:    96, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 28.8702087402s, input_fired_time: 0.4455501735, output_fired_time: 0.0000000000, propagate_forward_time: 26.3511962891, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0734615326
best training[          , genome  4488] predictions:   49472/  50000 (98.94%), best:    9725/10000 (97.25%), error:      2115.65723, best error:       896.47437 on epoch:    96, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 5.6897926331s, input_fired_time: 0.0874217078, output_fired_time: 0.0000000000, propagate_forward_time: 5.2059102058, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3964605331
   testing[          , genome  4488] predictions:    9742/  10000 (97.42%), best:    9725/10000 (97.25%), error:       859.13898, best error:       896.47437 on epoch:    96, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
01:09:17 (11936): called boinc_finish(0)

</stderr_txt>
]]>