Nameexact_genome_1512185335_39_8717_0
Workunit2562078
Created5 Dec 2017, 11:18:48 UTC
Sent5 Dec 2017, 11:37:03 UTC
Report deadline23 Dec 2017, 0:16:42 UTC
Received7 Dec 2017, 6:38:54 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID52320
Run time8 hours 40 min 27 sec
CPU time8 hours 40 min 17 sec
Validate stateValid
Credit4,381.89
Device peak FLOPS2.93 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size161.49 MB
Peak swap size160.09 MB
Peak disk usage3.70 MB

Stderr output

<core_client_version>7.8.2</core_client_version>
<![CDATA[
<stderr_txt>
866100, output_fired_time: 3.4838020802, propagate_forward_time: 107.7723922729, propagate_backward_time: 164.0120086670, weight_update_time: 0.3223335743, other_time: 4.5818634033
epoch time: 22.7053642273s, input_fired_time: 0.4519061744, output_fired_time: 0.0000000000, propagate_forward_time: 21.4590740204, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7943840027
validation[          , genome  8717] predictions:    9785/  10000 (97.85%), best:    9831/10000 (98.31%), error:       709.02466, best error:       541.83521 on epoch:    17, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 283.5114440918s, input_fired_time: 3.7142512798, output_fired_time: 3.4913570881, propagate_forward_time: 107.7225418091, propagate_backward_time: 164.0185394287, weight_update_time: 0.3207882941, other_time: 4.5647430420
epoch time: 22.8024921417s, input_fired_time: 0.4560259879, output_fired_time: 0.0000000000, propagate_forward_time: 21.5115337372, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8349323273
validation[          , genome  8717] predictions:    9831/  10000 (98.31%), best:    9831/10000 (98.31%), error:       542.32330, best error:       541.83521 on epoch:    17, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 284.2621459961s, input_fired_time: 3.7029445171, output_fired_time: 3.4957835674, propagate_forward_time: 108.0435333252, propagate_backward_time: 164.5020446777, weight_update_time: 0.3206335306, other_time: 4.5178375244
epoch time: 22.9323177338s, input_fired_time: 0.4517811835, output_fired_time: 0.0000000000, propagate_forward_time: 21.6809253693, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7996120453
validation[          , genome  8717] predictions:    9805/  10000 (98.05%), best:    9831/10000 (98.31%), error:       596.61658, best error:       541.83521 on epoch:    17, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 282.0774536133s, input_fired_time: 3.6804394722, output_fired_time: 3.4638171196, propagate_forward_time: 107.1902618408, propagate_backward_time: 163.2538604736, weight_update_time: 0.3181304932, other_time: 4.4890747070
epoch time: 22.7750511169s, input_fired_time: 0.4635585248, output_fired_time: 0.0000000000, propagate_forward_time: 21.4815006256, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8299922943
validation[          , genome  8717] predictions:    9781/  10000 (97.81%), best:    9831/10000 (98.31%), error:       657.94385, best error:       541.83521 on epoch:    17, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 282.5556030273s, input_fired_time: 3.7722928524, output_fired_time: 3.4512426853, propagate_forward_time: 107.1854400635, propagate_backward_time: 163.4645080566, weight_update_time: 0.3237072229, other_time: 4.6821441650
epoch time: 22.8626785278s, input_fired_time: 0.4660134912, output_fired_time: 0.0000000000, propagate_forward_time: 21.5636692047, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8329963684
validation[          , genome  8717] predictions:    9797/  10000 (97.97%), best:    9831/10000 (98.31%), error:       605.64185, best error:       541.83521 on epoch:    17, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 285.2081909180s, input_fired_time: 3.7136378288, output_fired_time: 3.5008075237, propagate_forward_time: 108.2993469238, propagate_backward_time: 165.2111968994, weight_update_time: 0.3181701899, other_time: 4.4832305908
epoch time: 22.8458137512s, input_fired_time: 0.4537319243, output_fired_time: 0.0000000000, propagate_forward_time: 21.5934104919, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7986717224
validation[          , genome  8717] predictions:    9804/  10000 (98.04%), best:    9831/10000 (98.31%), error:       646.33649, best error:       541.83521 on epoch:    17, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 284.3621826172s, input_fired_time: 3.7763564587, output_fired_time: 3.5029697418, propagate_forward_time: 107.8327255249, propagate_backward_time: 164.5801239014, weight_update_time: 0.3234807551, other_time: 4.6699981689
epoch time: 22.9017848969s, input_fired_time: 0.4513022304, output_fired_time: 0.0000000000, propagate_forward_time: 21.6481399536, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8023433685
validation[          , genome  8717] predictions:    9794/  10000 (97.94%), best:    9831/10000 (98.31%), error:       614.15442, best error:       541.83521 on epoch:    17, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 284.3932800293s, input_fired_time: 3.7620308399, output_fired_time: 3.4936547279, propagate_forward_time: 107.9409866333, propagate_backward_time: 164.5922241211, weight_update_time: 0.3216537237, other_time: 4.6044006348
epoch time: 22.9398097992s, input_fired_time: 0.4547956288, output_fired_time: 0.0000000000, propagate_forward_time: 21.6816425323, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8033714294
validation[          , genome  8717] predictions:    9816/  10000 (98.16%), best:    9831/10000 (98.31%), error:       622.70355, best error:       541.83521 on epoch:    17, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/mnist_training_50k.bin'
boincified validation filename: '../../projects/csgrid.org_csg/mnist_validation_10k.bin'
boincified testing filename: '../../projects/csgrid.org_csg/mnist_testing_new.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1512185335_39_8717.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1512185335_39_8717_0_r866573263_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.879292
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.00282419
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 0.000112968
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 29
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 17
read number_validation_images: 10000
read best_validation_predictions: 9831
read best_validation_error: 541.835
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 8717
read normal distribution: '1 0 0'
generator_str: '1960993522'
read generator: 1960993522
read generated_by_map:
1 enable_node 1
reading 40 nodes.
reading 134 edges.
number input nodes: 1
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 4923 images.
reading image set with 5742 images.
reading image set with 4958 images.
reading image set with 5131 images.
reading image set with 4842 images.
reading image set with 4421 images.
reading image set with 4918 images.
reading image set with 5265 images.
reading image set with 4851 images.
reading image set with 4949 images.
image_size: 1x28x28 = 784
read 50000 images.
    class    0: 4923
    class    1: 5742
    class    2: 4958
    class    3: 5131
    class    4: 4842
    class    5: 4421
    class    6: 4918
    class    7: 5265
    class    8: 4851
    class    9: 4949
calculating averages and standard deviations for images
average pixel value for channel 0: 0.130530551075935
pixel variance for channel 0: 0.0948646068572998
pixel standard deviation for channel 0: 0.308000981807709
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 1x28x28 = 784
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 980 images.
reading image set with 1135 images.
reading image set with 1032 images.
reading image set with 1010 images.
reading image set with 982 images.
reading image set with 892 images.
reading image set with 958 images.
reading image set with 1028 images.
reading image set with 974 images.
reading image set with 1009 images.
image_size: 1x28x28 = 784
read 10000 images.
    class    0: 980
    class    1: 1135
    class    2: 1032
    class    3: 1010
    class    4: 982
    class    5: 892
    class    6: 958
    class    7: 1028
    class    8: 974
    class    9: 1009
loaded images
starting backpropagation!
epoch time: 284.414733886719s, input_fired_time: 3.68243336677551, output_fired_time: 3.48138833045959, propagate_forward_time: 107.911315917969, propagate_backward_time: 164.832916259766, weight_update_time: 0.317939162254333, other_time: 4.50668334960938
epoch time: 22.7770042419434s, input_fired_time: 0.463887095451355, output_fired_time: 0, propagate_forward_time: 21.4804229736328, propagate_backward_time: 0, weight_update_time: 0, other_time: 0.832695007324219
validation[          , genome  8717] predictions:    9813/  10000 (98.13%), best:    9831/10000 (98.31%), error:       615.61664, best error:       541.83521 on epoch:    17, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 284.6502685547s, input_fired_time: 3.7583851814, output_fired_time: 3.4915318489, propagate_forward_time: 108.0489120483, propagate_backward_time: 164.7062377930, weight_update_time: 0.3213430345, other_time: 4.6451721191
epoch time: 22.8906383514s, input_fired_time: 0.4652244747, output_fired_time: 0.0000000000, propagate_forward_time: 21.5941104889, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8313026428
validation[          , genome  8717] predictions:    9795/  10000 (97.95%), best:    9831/10000 (98.31%), error:       632.32800, best error:       541.83521 on epoch:    17, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 284.3335876465s, input_fired_time: 3.7759883404, output_fired_time: 3.4836950302, propagate_forward_time: 107.7102737427, propagate_backward_time: 164.6768188477, weight_update_time: 0.3275265098, other_time: 4.6867980957
epoch time: 22.7249164581s, input_fired_time: 0.4562414289, output_fired_time: 0.0000000000, propagate_forward_time: 21.4671592712, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8015155792
validation[          , genome  8717] predictions:    9830/  10000 (98.30%), best:    9831/10000 (98.31%), error:       545.39575, best error:       541.83521 on epoch:    17, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 284.6037597656s, input_fired_time: 3.6957120895, output_fired_time: 3.4983766079, propagate_forward_time: 107.9706726074, propagate_backward_time: 164.9449462891, weight_update_time: 0.3180271685, other_time: 4.4940490723
epoch time: 22.8546485901s, input_fired_time: 0.4555661380, output_fired_time: 0.0000000000, propagate_forward_time: 21.5924930573, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8065891266
validation[          , genome  8717] predictions:    9783/  10000 (97.83%), best:    9831/10000 (98.31%), error:       668.39349, best error:       541.83521 on epoch:    17, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 283.6426086426s, input_fired_time: 3.6930894852, output_fired_time: 3.4703359604, propagate_forward_time: 107.6221694946, propagate_backward_time: 164.3575286865, weight_update_time: 0.3160648346, other_time: 4.4994964600
epoch time: 22.8127231598s, input_fired_time: 0.4574275911, output_fired_time: 0.0000000000, propagate_forward_time: 21.5557060242, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7995891571
validation[          , genome  8717] predictions:    9835/  10000 (98.35%), best:    9835/10000 (98.35%), error:       533.01343, best error:       533.01343 on epoch:    33, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 284.9762268066s, input_fired_time: 3.7398357391, output_fired_time: 3.4886789322, propagate_forward_time: 107.9557342529, propagate_backward_time: 165.2198638916, weight_update_time: 0.3186349869, other_time: 4.5721130371
epoch time: 22.8933238983s, input_fired_time: 0.4669650495, output_fired_time: 0.0000000000, propagate_forward_time: 21.5903453827, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8360137939
validation[          , genome  8717] predictions:    9828/  10000 (98.28%), best:    9835/10000 (98.35%), error:       578.38269, best error:       533.01343 on epoch:    33, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 285.2732543945s, input_fired_time: 3.7189545631, output_fired_time: 3.4987320900, propagate_forward_time: 108.2388305664, propagate_backward_time: 165.3230895996, weight_update_time: 0.3181027174, other_time: 4.4936523438
epoch time: 22.9880809784s, input_fired_time: 0.4635312259, output_fired_time: 0.0000000000, propagate_forward_time: 21.7204685211, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8040809631
validation[          , genome  8717] predictions:    9816/  10000 (98.16%), best:    9835/10000 (98.35%), error:       581.13306, best error:       533.01343 on epoch:    33, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 284.4750061035s, input_fired_time: 3.7109737396, output_fired_time: 3.4891121387, propagate_forward_time: 107.9032897949, propagate_backward_time: 164.8837738037, weight_update_time: 0.3170032799, other_time: 4.4878692627
epoch time: 22.8702735901s, input_fired_time: 0.4592935443, output_fired_time: 0.0000000000, propagate_forward_time: 21.6089458466, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8020343781
validation[          , genome  8717] predictions:    9837/  10000 (98.37%), best:    9837/10000 (98.37%), error:       508.38657, best error:       508.38657 on epoch:    36, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 283.5981445313s, input_fired_time: 3.7084012032, output_fired_time: 3.4690432549, propagate_forward_time: 107.5004653931, propagate_backward_time: 164.4265441895, weight_update_time: 0.3167729378, other_time: 4.4936828613
epoch time: 22.5698242188s, input_fired_time: 0.4574112892, output_fired_time: 0.0000000000, propagate_forward_time: 21.3203849792, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7920284271
validation[          , genome  8717] predictions:    9819/  10000 (98.19%), best:    9837/10000 (98.37%), error:       598.74805, best error:       508.38657 on epoch:    36, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 286.5007934570s, input_fired_time: 3.7382183075, output_fired_time: 3.5083780289, propagate_forward_time: 108.5987777710, propagate_backward_time: 166.1030883789, weight_update_time: 0.3214705586, other_time: 4.5523071289
epoch time: 22.8700351715s, input_fired_time: 0.4606159627, output_fired_time: 0.0000000000, propagate_forward_time: 21.6090488434, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8003711700
validation[          , genome  8717] predictions:    9815/  10000 (98.15%), best:    9837/10000 (98.37%), error:       594.01550, best error:       508.38657 on epoch:    36, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 284.4661865234s, input_fired_time: 3.7707633972, output_fired_time: 3.4848508835, propagate_forward_time: 107.8225479126, propagate_backward_time: 164.7401733398, weight_update_time: 0.3244120777, other_time: 4.6478576660
epoch time: 22.6957912445s, input_fired_time: 0.4612390697, output_fired_time: 0.0000000000, propagate_forward_time: 21.4222030640, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8123493195
validation[          , genome  8717] predictions:    9840/  10000 (98.40%), best:    9837/10000 (98.37%), error:       516.04553, best error:       508.38657 on epoch:    36, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 285.3229370117s, input_fired_time: 3.7251164913, output_fired_time: 3.4954936504, propagate_forward_time: 108.1600189209, propagate_backward_time: 165.4160614014, weight_update_time: 0.3192821741, other_time: 4.5262451172
epoch time: 23.0716991425s, input_fired_time: 0.4688436985, output_fired_time: 0.0000000000, propagate_forward_time: 21.7710952759, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8317604065
validation[          , genome  8717] predictions:    9824/  10000 (98.24%), best:    9837/10000 (98.37%), error:       556.40161, best error:       508.38657 on epoch:    36, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 285.1463623047s, input_fired_time: 3.7615432739, output_fired_time: 3.4972984791, propagate_forward_time: 108.0237121582, propagate_backward_time: 165.2717437744, weight_update_time: 0.3217070699, other_time: 4.5920867920
epoch time: 23.0391693115s, input_fired_time: 0.4730563164, output_fired_time: 0.0000000000, propagate_forward_time: 21.7294101715, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8367023468
validation[          , genome  8717] predictions:    9818/  10000 (98.18%), best:    9837/10000 (98.37%), error:       580.85815, best error:       508.38657 on epoch:    36, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 283.8602600098s, input_fired_time: 3.7081246376, output_fired_time: 3.4604787827, propagate_forward_time: 107.4836883545, propagate_backward_time: 164.7162628174, weight_update_time: 0.3160665631, other_time: 4.4916992188
epoch time: 22.7896976471s, input_fired_time: 0.4572401941, output_fired_time: 0.0000000000, propagate_forward_time: 21.5307559967, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8017005920
validation[          , genome  8717] predictions:    9811/  10000 (98.11%), best:    9837/10000 (98.37%), error:       622.91138, best error:       508.38657 on epoch:    36, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 286.0751037598s, input_fired_time: 3.7137267590, output_fired_time: 3.4877576828, propagate_forward_time: 108.3624649048, propagate_backward_time: 166.0194549561, weight_update_time: 0.3176538348, other_time: 4.4917144775
epoch time: 23.0611934662s, input_fired_time: 0.4695761800, output_fired_time: 0.0000000000, propagate_forward_time: 21.7644767761, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8271408081
validation[          , genome  8717] predictions:    9834/  10000 (98.34%), best:    9837/10000 (98.37%), error:       531.58118, best error:       508.38657 on epoch:    36, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 283.9504089355s, input_fired_time: 3.7072358131, output_fired_time: 3.4810791016, propagate_forward_time: 107.6217422485, propagate_backward_time: 164.6499328613, weight_update_time: 0.3166050613, other_time: 4.4904174805
epoch time: 22.8268585205s, input_fired_time: 0.4553093910, output_fired_time: 0.0000000000, propagate_forward_time: 21.5709190369, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8006305695
validation[          , genome  8717] predictions:    9833/  10000 (98.33%), best:    9837/10000 (98.37%), error:       545.64288, best error:       508.38657 on epoch:    36, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 285.1571655273s, input_fired_time: 3.7628197670, output_fired_time: 3.4906036854, propagate_forward_time: 107.9621582031, propagate_backward_time: 165.3360595703, weight_update_time: 0.3217825294, other_time: 4.6055297852
epoch time: 22.6336460114s, input_fired_time: 0.4606740177, output_fired_time: 0.0000000000, propagate_forward_time: 21.3708114624, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8021602631
validation[          , genome  8717] predictions:    9835/  10000 (98.35%), best:    9837/10000 (98.37%), error:       561.77222, best error:       508.38657 on epoch:    36, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 285.4574279785s, input_fired_time: 3.7397506237, output_fired_time: 3.5024180412, propagate_forward_time: 108.0459060669, propagate_backward_time: 165.6400146484, weight_update_time: 0.3180363774, other_time: 4.5293579102
epoch time: 22.9536476135s, input_fired_time: 0.4688377380, output_fired_time: 0.0000000000, propagate_forward_time: 21.6558113098, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8289985657
validation[          , genome  8717] predictions:    9808/  10000 (98.08%), best:    9837/10000 (98.37%), error:       605.24536, best error:       508.38657 on epoch:    36, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 283.9066162109s, input_fired_time: 3.7157235146, output_fired_time: 3.4740686417, propagate_forward_time: 107.4781875610, propagate_backward_time: 164.7438354492, weight_update_time: 0.3159410059, other_time: 4.4948120117
epoch time: 22.8164787292s, input_fired_time: 0.4582213461, output_fired_time: 0.0000000000, propagate_forward_time: 21.5540294647, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8042278290
validation[          , genome  8717] predictions:    9829/  10000 (98.29%), best:    9837/10000 (98.37%), error:       579.70660, best error:       508.38657 on epoch:    36, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 284.6348876953s, input_fired_time: 3.7892110348, output_fired_time: 3.4812722206, propagate_forward_time: 107.5952835083, propagate_backward_time: 165.0704803467, weight_update_time: 0.3242432475, other_time: 4.6986541748
epoch time: 22.9248390198s, input_fired_time: 0.4671666622, output_fired_time: 0.0000000000, propagate_forward_time: 21.6218109131, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8358612061
validation[          , genome  8717] predictions:    9825/  10000 (98.25%), best:    9837/10000 (98.37%), error:       586.86676, best error:       508.38657 on epoch:    36, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 284.2927551270s, input_fired_time: 3.7115983963, output_fired_time: 3.4743018150, propagate_forward_time: 107.6626510620, propagate_backward_time: 164.9442749023, weight_update_time: 0.3158770502, other_time: 4.4999084473
epoch time: 22.8526954651s, input_fired_time: 0.4572896361, output_fired_time: 0.0000000000, propagate_forward_time: 21.5932369232, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8021697998
validation[          , genome  8717] predictions:    9737/  10000 (97.37%), best:    9837/10000 (98.37%), error:       869.18799, best error:       508.38657 on epoch:    36, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 283.7572021484s, input_fired_time: 3.7113938332, output_fired_time: 3.4675412178, propagate_forward_time: 107.4524917603, propagate_backward_time: 164.6352081299, weight_update_time: 0.3169594407, other_time: 4.4905853271
epoch time: 22.7938690186s, input_fired_time: 0.4571635723, output_fired_time: 0.0000000000, propagate_forward_time: 21.5389137268, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7977924347
validation[          , genome  8717] predictions:    9798/  10000 (97.98%), best:    9837/10000 (98.37%), error:       622.10986, best error:       508.38657 on epoch:    36, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 284.8175659180s, input_fired_time: 3.7482571602, output_fired_time: 3.4857382774, propagate_forward_time: 107.8275680542, propagate_backward_time: 165.1974639893, weight_update_time: 0.3192636073, other_time: 4.5585174561
epoch time: 22.6980648041s, input_fired_time: 0.4584988654, output_fired_time: 0.0000000000, propagate_forward_time: 21.4404983521, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7990684509
validation[          , genome  8717] predictions:    9831/  10000 (98.31%), best:    9837/10000 (98.37%), error:       520.36261, best error:       508.38657 on epoch:    36, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 285.6583862305s, input_fired_time: 3.7443225384, output_fired_time: 3.4942364693, propagate_forward_time: 108.1058578491, propagate_backward_time: 165.7673492432, weight_update_time: 0.3219384253, other_time: 4.5466156006
epoch time: 22.7937755585s, input_fired_time: 0.4688010216, output_fired_time: 0.0000000000, propagate_forward_time: 21.4906711578, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8343029022
validation[          , genome  8717] predictions:    9848/  10000 (98.48%), best:    9848/10000 (98.48%), error:       497.58359, best error:       497.58359 on epoch:    52, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 284.5439453125s, input_fired_time: 3.7331440449, output_fired_time: 3.4813671112, propagate_forward_time: 107.5860595703, propagate_backward_time: 165.2525787354, weight_update_time: 0.3188979924, other_time: 4.4907989502
epoch time: 22.7230434418s, input_fired_time: 0.4605907500, output_fired_time: 0.0000000000, propagate_forward_time: 21.4656467438, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7968063354
validation[          , genome  8717] predictions:    9803/  10000 (98.03%), best:    9848/10000 (98.48%), error:       640.47009, best error:       497.58359 on epoch:    52, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 284.3189697266s, input_fired_time: 3.7243237495, output_fired_time: 3.4840812683, propagate_forward_time: 107.5983657837, propagate_backward_time: 165.0271606445, weight_update_time: 0.3156010509, other_time: 4.4850463867
epoch time: 22.7906951904s, input_fired_time: 0.4631557763, output_fired_time: 0.0000000000, propagate_forward_time: 21.5283031464, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7992362976
validation[          , genome  8717] predictions:    9830/  10000 (98.30%), best:    9848/10000 (98.48%), error:       559.33740, best error:       497.58359 on epoch:    52, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 283.3945312500s, input_fired_time: 3.7156491280, output_fired_time: 3.4566354752, propagate_forward_time: 107.2450027466, propagate_backward_time: 164.4904327393, weight_update_time: 0.3153295219, other_time: 4.4868316650
epoch time: 22.7517738342s, input_fired_time: 0.4584664404, output_fired_time: 0.0000000000, propagate_forward_time: 21.4929714203, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8003368378
validation[          , genome  8717] predictions:    9813/  10000 (98.13%), best:    9848/10000 (98.48%), error:       604.77161, best error:       497.58359 on epoch:    52, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 285.7214355469s, input_fired_time: 3.8019485474, output_fired_time: 3.4945366383, propagate_forward_time: 108.0824508667, propagate_backward_time: 165.6716918945, weight_update_time: 0.3261280358, other_time: 4.6708068848
epoch time: 22.9214687347s, input_fired_time: 0.4676238000, output_fired_time: 0.0000000000, propagate_forward_time: 21.6143436432, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8395004272
validation[          , genome  8717] predictions:    9802/  10000 (98.02%), best:    9848/10000 (98.48%), error:       634.67975, best error:       497.58359 on epoch:    52, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 284.6853637695s, input_fired_time: 3.7679255009, output_fired_time: 3.4811992645, propagate_forward_time: 107.6346817017, propagate_backward_time: 165.2057037354, weight_update_time: 0.3222269416, other_time: 4.5958709717
epoch time: 22.8380661011s, input_fired_time: 0.4620943666, output_fired_time: 0.0000000000, propagate_forward_time: 21.5783691406, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7976016998
validation[          , genome  8717] predictions:    9808/  10000 (98.08%), best:    9848/10000 (98.48%), error:       602.87750, best error:       497.58359 on epoch:    52, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 285.0147705078s, input_fired_time: 3.7698900700, output_fired_time: 3.4885270596, propagate_forward_time: 107.6269149780, propagate_backward_time: 165.5213928223, weight_update_time: 0.3226827383, other_time: 4.6080322266
epoch time: 22.9776077271s, input_fired_time: 0.4692473412, output_fired_time: 0.0000000000, propagate_forward_time: 21.6779251099, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8304347992
validation[          , genome  8717] predictions:    9815/  10000 (98.15%), best:    9848/10000 (98.48%), error:       581.67926, best error:       497.58359 on epoch:    52, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 285.0872192383s, input_fired_time: 3.7324745655, output_fired_time: 3.4826560020, propagate_forward_time: 107.7947692871, propagate_backward_time: 165.5731048584, weight_update_time: 0.3185522854, other_time: 4.5041961670
epoch time: 22.7938995361s, input_fired_time: 0.4662636817, output_fired_time: 0.0000000000, propagate_forward_time: 21.5247402191, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8028964996
validation[          , genome  8717] predictions:    9790/  10000 (97.90%), best:    9848/10000 (98.48%), error:       694.74976, best error:       497.58359 on epoch:    52, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 284.6184692383s, input_fired_time: 3.7646169662, output_fired_time: 3.4748005867, propagate_forward_time: 107.6324844360, propagate_backward_time: 165.1456451416, weight_update_time: 0.3189822137, other_time: 4.6009368896
epoch time: 22.8948478699s, input_fired_time: 0.4705127180, output_fired_time: 0.0000000000, propagate_forward_time: 21.5924491882, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8318862915
validation[          , genome  8717] predictions:    9835/  10000 (98.35%), best:    9848/10000 (98.48%), error:       511.68018, best error:       497.58359 on epoch:    52, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 285.6452026367s, input_fired_time: 3.8120617867, output_fired_time: 3.4951126575, propagate_forward_time: 107.8453292847, propagate_backward_time: 165.8065032959, weight_update_time: 0.3247665763, other_time: 4.6861724854
epoch time: 22.9289512634s, input_fired_time: 0.4676838517, output_fired_time: 0.0000000000, propagate_forward_time: 21.6315383911, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8297290802
validation[          , genome  8717] predictions:    9816/  10000 (98.16%), best:    9848/10000 (98.48%), error:       558.56744, best error:       497.58359 on epoch:    52, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 286.4892578125s, input_fired_time: 3.7855618000, output_fired_time: 3.4993927479, propagate_forward_time: 108.2321853638, propagate_backward_time: 166.3535308838, weight_update_time: 0.3222598433, other_time: 4.6186065674
epoch time: 22.8934154510s, input_fired_time: 0.4739124179, output_fired_time: 0.0000000000, propagate_forward_time: 21.5863704681, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8331317902
validation[          , genome  8717] predictions:    9825/  10000 (98.25%), best:    9848/10000 (98.48%), error:       567.90375, best error:       497.58359 on epoch:    52, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 286.0582580566s, input_fired_time: 3.8222105503, output_fired_time: 3.5037589073, propagate_forward_time: 108.1397781372, propagate_backward_time: 165.8958282471, weight_update_time: 0.3265959024, other_time: 4.6967010498
epoch time: 22.8429832458s, input_fired_time: 0.4737901986, output_fired_time: 0.0000000000, propagate_forward_time: 21.5398426056, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8293495178
validation[          , genome  8717] predictions:    9830/  10000 (98.30%), best:    9848/10000 (98.48%), error:       524.84937, best error:       497.58359 on epoch:    52, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 285.3703613281s, input_fired_time: 3.7686879635, output_fired_time: 3.4882647991, propagate_forward_time: 107.9734268188, propagate_backward_time: 165.5847167969, weight_update_time: 0.3205278814, other_time: 4.5552978516
epoch time: 22.8889007568s, input_fired_time: 0.4717641473, output_fired_time: 0.0000000000, propagate_forward_time: 21.5836009979, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8335361481
validation[          , genome  8717] predictions:    9825/  10000 (98.25%), best:    9848/10000 (98.48%), error:       566.01733, best error:       497.58359 on epoch:    52, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 285.3034362793s, input_fired_time: 3.8259801865, output_fired_time: 3.4867656231, propagate_forward_time: 107.8090896606, propagate_backward_time: 165.4851531982, weight_update_time: 0.3253667057, other_time: 4.6964569092
epoch time: 22.8805637360s, input_fired_time: 0.4729494750, output_fired_time: 0.0000000000, propagate_forward_time: 21.5755004883, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8321132660
validation[          , genome  8717] predictions:    9822/  10000 (98.22%), best:    9848/10000 (98.48%), error:       552.94440, best error:       497.58359 on epoch:    52, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 284.8319702148s, input_fired_time: 3.7322385311, output_fired_time: 3.4932503700, propagate_forward_time: 107.7893829346, propagate_backward_time: 165.3328247070, weight_update_time: 0.3167335689, other_time: 4.4842681885
epoch time: 22.8572578430s, input_fired_time: 0.4635820687, output_fired_time: 0.0000000000, propagate_forward_time: 21.5904178619, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8032569885
validation[          , genome  8717] predictions:    9834/  10000 (98.34%), best:    9848/10000 (98.48%), error:       520.80017, best error:       497.58359 on epoch:    52, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 287.6129150391s, input_fired_time: 3.8209252357, output_fired_time: 3.5187275410, propagate_forward_time: 108.6004791260, propagate_backward_time: 166.9587707520, weight_update_time: 0.3280978203, other_time: 4.7140045166
epoch time: 22.9357185364s, input_fired_time: 0.4741241336, output_fired_time: 0.0000000000, propagate_forward_time: 21.6306362152, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8309574127
validation[          , genome  8717] predictions:    9822/  10000 (98.22%), best:    9848/10000 (98.48%), error:       540.83844, best error:       497.58359 on epoch:    52, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 285.6492004395s, input_fired_time: 3.7425456047, output_fired_time: 3.4962964058, propagate_forward_time: 107.9572830200, propagate_backward_time: 165.9592285156, weight_update_time: 0.3171163499, other_time: 4.4938354492
epoch time: 22.8719425201s, input_fired_time: 0.4640565217, output_fired_time: 0.0000000000, propagate_forward_time: 21.6047821045, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8031044006
validation[          , genome  8717] predictions:    9830/  10000 (98.30%), best:    9848/10000 (98.48%), error:       517.32672, best error:       497.58359 on epoch:    52, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 286.0547790527s, input_fired_time: 3.7408199310, output_fired_time: 3.5041892529, propagate_forward_time: 108.1214904785, propagate_backward_time: 166.2064361572, weight_update_time: 0.3196195364, other_time: 4.4818572998
epoch time: 22.6596031189s, input_fired_time: 0.4662595689, output_fired_time: 0.0000000000, propagate_forward_time: 21.3930950165, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8002490997
validation[          , genome  8717] predictions:    9836/  10000 (98.36%), best:    9848/10000 (98.48%), error:       523.61157, best error:       497.58359 on epoch:    52, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 287.4815673828s, input_fired_time: 3.8312766552, output_fired_time: 3.5245280266, propagate_forward_time: 108.5347595215, propagate_backward_time: 166.8892211914, weight_update_time: 0.3266721964, other_time: 4.7017822266
epoch time: 23.0587921143s, input_fired_time: 0.4716914892, output_fired_time: 0.0000000000, propagate_forward_time: 21.7529621124, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8341388702
validation[          , genome  8717] predictions:    9812/  10000 (98.12%), best:    9848/10000 (98.48%), error:       637.76990, best error:       497.58359 on epoch:    52, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 286.3857727051s, input_fired_time: 3.7313401699, output_fired_time: 3.5165216923, propagate_forward_time: 108.1408462524, propagate_backward_time: 166.5014953613, weight_update_time: 0.3189873695, other_time: 4.4955749512
epoch time: 22.8945102692s, input_fired_time: 0.4641296864, output_fired_time: 0.0000000000, propagate_forward_time: 21.6278209686, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8025588989
validation[          , genome  8717] predictions:    9831/  10000 (98.31%), best:    9848/10000 (98.48%), error:       543.90302, best error:       497.58359 on epoch:    52, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 285.0757446289s, input_fired_time: 3.7901697159, output_fired_time: 3.4785680771, propagate_forward_time: 107.7462463379, propagate_backward_time: 165.4432830811, weight_update_time: 0.3215672672, other_time: 4.6174774170
epoch time: 22.8467388153s, input_fired_time: 0.4589082301, output_fired_time: 0.0000000000, propagate_forward_time: 21.5898513794, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7979793549
validation[          , genome  8717] predictions:    9803/  10000 (98.03%), best:    9848/10000 (98.48%), error:       641.90576, best error:       497.58359 on epoch:    52, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 284.7851867676s, input_fired_time: 3.7792646885, output_fired_time: 3.4927995205, propagate_forward_time: 107.5708465576, propagate_backward_time: 165.3231811523, weight_update_time: 0.3221915662, other_time: 4.6190948486
epoch time: 22.8232212067s, input_fired_time: 0.4738597572, output_fired_time: 0.0000000000, propagate_forward_time: 21.5190391541, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8303222656
validation[          , genome  8717] predictions:    9836/  10000 (98.36%), best:    9848/10000 (98.48%), error:       535.52509, best error:       497.58359 on epoch:    52, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 286.4077758789s, input_fired_time: 3.7513194084, output_fired_time: 3.5055158138, propagate_forward_time: 108.2403869629, propagate_backward_time: 166.4042510986, weight_update_time: 0.3208291531, other_time: 4.5063018799
epoch time: 22.7874698639s, input_fired_time: 0.4623971581, output_fired_time: 0.0000000000, propagate_forward_time: 21.5204162598, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8046569824
validation[          , genome  8717] predictions:    9849/  10000 (98.49%), best:    9848/10000 (98.48%), error:       523.79431, best error:       497.58359 on epoch:    52, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 284.3749389648s, input_fired_time: 3.7866201401, output_fired_time: 3.4735333920, propagate_forward_time: 107.4386901855, propagate_backward_time: 165.0387268066, weight_update_time: 0.3234606683, other_time: 4.6373596191
epoch time: 22.7129936218s, input_fired_time: 0.4575301409, output_fired_time: 0.0000000000, propagate_forward_time: 21.4586639404, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7967987061
validation[          , genome  8717] predictions:    9846/  10000 (98.46%), best:    9848/10000 (98.48%), error:       505.15070, best error:       497.58359 on epoch:    52, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 286.3805541992s, input_fired_time: 3.7519066334, output_fired_time: 3.4990646839, propagate_forward_time: 108.3830947876, propagate_backward_time: 166.2156677246, weight_update_time: 0.3216140568, other_time: 4.5308532715
epoch time: 23.0129489899s, input_fired_time: 0.4601328671, output_fired_time: 0.0000000000, propagate_forward_time: 21.7492618561, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8035545349
validation[          , genome  8717] predictions:    9787/  10000 (97.87%), best:    9848/10000 (98.48%), error:       638.42291, best error:       497.58359 on epoch:    52, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 284.5761108398s, input_fired_time: 3.8108284473, output_fired_time: 3.4782071114, propagate_forward_time: 107.4470214844, propagate_backward_time: 165.1431274414, weight_update_time: 0.3240077198, other_time: 4.6969299316
epoch time: 22.7770500183s, input_fired_time: 0.4712316096, output_fired_time: 0.0000000000, propagate_forward_time: 21.4795379639, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8262805939
validation[          , genome  8717] predictions:    9834/  10000 (98.34%), best:    9848/10000 (98.48%), error:       503.85434, best error:       497.58359 on epoch:    52, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 284.9237060547s, input_fired_time: 3.7609534264, output_fired_time: 3.4824459553, propagate_forward_time: 107.7184448242, propagate_backward_time: 165.4058837891, weight_update_time: 0.3190445602, other_time: 4.5559692383
epoch time: 22.8825473785s, input_fired_time: 0.4681146741, output_fired_time: 0.0000000000, propagate_forward_time: 21.6102638245, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8041687012
validation[          , genome  8717] predictions:    9845/  10000 (98.45%), best:    9848/10000 (98.48%), error:       500.03650, best error:       497.58359 on epoch:    52, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 286.5940246582s, input_fired_time: 3.8166749477, output_fired_time: 3.5110061169, propagate_forward_time: 108.1812438965, propagate_backward_time: 166.4030761719, weight_update_time: 0.3302041292, other_time: 4.6820068359
epoch time: 22.9947605133s, input_fired_time: 0.4714082479, output_fired_time: 0.0000000000, propagate_forward_time: 21.6891670227, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8341846466
validation[          , genome  8717] predictions:    9818/  10000 (98.18%), best:    9848/10000 (98.48%), error:       594.83801, best error:       497.58359 on epoch:    52, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 286.1999206543s, input_fired_time: 3.7458636761, output_fired_time: 3.5080637932, propagate_forward_time: 108.1437149048, propagate_backward_time: 166.3154907227, weight_update_time: 0.3170640767, other_time: 4.4868164063
epoch time: 22.8831195831s, input_fired_time: 0.4654192328, output_fired_time: 0.0000000000, propagate_forward_time: 21.6209545135, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7967453003
validation[          , genome  8717] predictions:    9827/  10000 (98.27%), best:    9848/10000 (98.48%), error:       533.80963, best error:       497.58359 on epoch:    52, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 286.0326232910s, input_fired_time: 3.8104267120, output_fired_time: 3.4928116798, propagate_forward_time: 107.9557418823, propagate_backward_time: 166.1280822754, weight_update_time: 0.3232337832, other_time: 4.6455688477
epoch time: 22.7844581604s, input_fired_time: 0.4670227766, output_fired_time: 0.0000000000, propagate_forward_time: 21.4871292114, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8303070068
validation[          , genome  8717] predictions:    9853/  10000 (98.53%), best:    9848/10000 (98.48%), error:       501.13275, best error:       497.58359 on epoch:    52, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 287.8424987793s, input_fired_time: 3.8328485489, output_fired_time: 3.5188102722, propagate_forward_time: 108.6655654907, propagate_backward_time: 167.1209869385, weight_update_time: 0.3278022707, other_time: 4.7042999268
epoch time: 23.0411872864s, input_fired_time: 0.4711990058, output_fired_time: 0.0000000000, propagate_forward_time: 21.7384624481, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8315258026
validation[          , genome  8717] predictions:    9849/  10000 (98.49%), best:    9849/10000 (98.49%), error:       494.83377, best error:       494.83377 on epoch:    82, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 286.1775512695s, input_fired_time: 3.7537052631, output_fired_time: 3.4975199699, propagate_forward_time: 108.1663742065, propagate_backward_time: 166.2425994873, weight_update_time: 0.3205224574, other_time: 4.5173492432
epoch time: 22.8761920929s, input_fired_time: 0.4677267373, output_fired_time: 0.0000000000, propagate_forward_time: 21.6049556732, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8035087585
validation[          , genome  8717] predictions:    9823/  10000 (98.23%), best:    9849/10000 (98.49%), error:       579.03375, best error:       494.83377 on epoch:    82, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 285.1245727539s, input_fired_time: 3.7561757565, output_fired_time: 3.4837841988, propagate_forward_time: 107.8363265991, propagate_backward_time: 165.5352172852, weight_update_time: 0.3177652061, other_time: 4.5130615234
epoch time: 22.9044303894s, input_fired_time: 0.4658105969, output_fired_time: 0.0000000000, propagate_forward_time: 21.6351299286, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8034896851
validation[          , genome  8717] predictions:    9807/  10000 (98.07%), best:    9849/10000 (98.49%), error:       549.97845, best error:       494.83377 on epoch:    82, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 285.4061584473s, input_fired_time: 3.8287572861, output_fired_time: 3.4705784321, propagate_forward_time: 107.7481536865, propagate_backward_time: 165.6616210938, weight_update_time: 0.3268251121, other_time: 4.6970367432
epoch time: 22.8041477203s, input_fired_time: 0.4754231572, output_fired_time: 0.0000000000, propagate_forward_time: 21.4962596893, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8324642181
validation[          , genome  8717] predictions:    9843/  10000 (98.43%), best:    9849/10000 (98.49%), error:       498.92480, best error:       494.83377 on epoch:    82, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 286.0190124512s, input_fired_time: 3.8285641670, output_fired_time: 3.4955670834, propagate_forward_time: 107.9435501099, propagate_backward_time: 166.0597991943, weight_update_time: 0.3273259103, other_time: 4.6915435791
epoch time: 22.9205417633s, input_fired_time: 0.4731251597, output_fired_time: 0.0000000000, propagate_forward_time: 21.6185684204, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8288478851
validation[          , genome  8717] predictions:    9830/  10000 (98.30%), best:    9849/10000 (98.49%), error:       562.59833, best error:       494.83377 on epoch:    82, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 284.9564208984s, input_fired_time: 3.7575831413, output_fired_time: 3.4950916767, propagate_forward_time: 107.6256256104, propagate_backward_time: 165.5771331787, weight_update_time: 0.3187746406, other_time: 4.5010070801
epoch time: 23.0224342346s, input_fired_time: 0.4658557475, output_fired_time: 0.0000000000, propagate_forward_time: 21.7512207031, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8053569794
validation[          , genome  8717] predictions:    9833/  10000 (98.33%), best:    9849/10000 (98.49%), error:       506.80487, best error:       494.83377 on epoch:    82, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 285.1822509766s, input_fired_time: 3.8289015293, output_fired_time: 3.4912021160, propagate_forward_time: 107.6693954468, propagate_backward_time: 165.5048217773, weight_update_time: 0.3262378871, other_time: 4.6879272461
epoch time: 22.7851886749s, input_fired_time: 0.4706636667, output_fired_time: 0.0000000000, propagate_forward_time: 21.4817180634, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8328075409
validation[          , genome  8717] predictions:    9854/  10000 (98.54%), best:    9854/10000 (98.54%), error:       482.69055, best error:       482.69055 on epoch:    88, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 285.8701782227s, input_fired_time: 3.8346304893, output_fired_time: 3.4892389774, propagate_forward_time: 107.9633102417, propagate_backward_time: 165.8788146973, weight_update_time: 0.3262417912, other_time: 4.7041931152
epoch time: 22.9562911987s, input_fired_time: 0.4774970412, output_fired_time: 0.0000000000, propagate_forward_time: 21.6439743042, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8348197937
validation[          , genome  8717] predictions:    9856/  10000 (98.56%), best:    9854/10000 (98.54%), error:       498.09109, best error:       482.69055 on epoch:    88, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 285.5380859375s, input_fired_time: 3.8388595581, output_fired_time: 3.4861025810, propagate_forward_time: 107.8735351563, propagate_backward_time: 165.6383361816, weight_update_time: 0.3296917677, other_time: 4.7012329102
epoch time: 22.9486312866s, input_fired_time: 0.4741036594, output_fired_time: 0.0000000000, propagate_forward_time: 21.6384696960, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8360576630
validation[          , genome  8717] predictions:    9841/  10000 (98.41%), best:    9854/10000 (98.54%), error:       542.03668, best error:       482.69055 on epoch:    88, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 284.0428771973s, input_fired_time: 3.7499563694, output_fired_time: 3.4718861580, propagate_forward_time: 107.3473892212, propagate_backward_time: 164.9466705322, weight_update_time: 0.3206180930, other_time: 4.5269622803
epoch time: 22.9439525604s, input_fired_time: 0.4783876538, output_fired_time: 0.0000000000, propagate_forward_time: 21.6377906799, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8277740479
validation[          , genome  8717] predictions:    9842/  10000 (98.42%), best:    9854/10000 (98.54%), error:       501.68805, best error:       482.69055 on epoch:    88, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 286.3700256348s, input_fired_time: 3.7499082088, output_fired_time: 3.5020816326, propagate_forward_time: 108.2335891724, propagate_backward_time: 166.3781585693, weight_update_time: 0.3196392357, other_time: 4.5063018799
epoch time: 22.8649215698s, input_fired_time: 0.4611959457, output_fired_time: 0.0000000000, propagate_forward_time: 21.6048049927, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7989196777
validation[          , genome  8717] predictions:    9840/  10000 (98.40%), best:    9854/10000 (98.54%), error:       493.94955, best error:       482.69055 on epoch:    88, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 285.4381103516s, input_fired_time: 3.8064222336, output_fired_time: 3.4829127789, propagate_forward_time: 107.7363433838, propagate_backward_time: 165.7689666748, weight_update_time: 0.3256256580, other_time: 4.6434631348
epoch time: 22.8218574524s, input_fired_time: 0.4692790806, output_fired_time: 0.0000000000, propagate_forward_time: 21.5562915802, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7962875366
validation[          , genome  8717] predictions:    9851/  10000 (98.51%), best:    9854/10000 (98.54%), error:       503.00320, best error:       482.69055 on epoch:    88, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 284.6416931152s, input_fired_time: 3.7976849079, output_fired_time: 3.4741246700, propagate_forward_time: 107.5052108765, propagate_backward_time: 165.2643585205, weight_update_time: 0.3249936104, other_time: 4.6002960205
epoch time: 22.7650165558s, input_fired_time: 0.4655444026, output_fired_time: 0.0000000000, propagate_forward_time: 21.5006294250, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7988433838
validation[          , genome  8717] predictions:    9840/  10000 (98.40%), best:    9854/10000 (98.54%), error:       515.32275, best error:       482.69055 on epoch:    88, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 287.2343139648s, input_fired_time: 3.7881133556, output_fired_time: 3.5117578506, propagate_forward_time: 108.5580596924, propagate_backward_time: 166.8477325439, weight_update_time: 0.3229715824, other_time: 4.5286560059
epoch time: 23.0183830261s, input_fired_time: 0.4635209739, output_fired_time: 0.0000000000, propagate_forward_time: 21.7530403137, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8018226624
validation[          , genome  8717] predictions:    9783/  10000 (97.83%), best:    9854/10000 (98.54%), error:       698.93427, best error:       482.69055 on epoch:    88, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 285.5078125000s, input_fired_time: 3.7865793705, output_fired_time: 3.4803693295, propagate_forward_time: 107.9931640625, propagate_backward_time: 165.6545257568, weight_update_time: 0.3240525424, other_time: 4.5931549072
epoch time: 23.0452499390s, input_fired_time: 0.4765213728, output_fired_time: 0.0000000000, propagate_forward_time: 21.7350044250, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8337249756
validation[          , genome  8717] predictions:    9827/  10000 (98.27%), best:    9854/10000 (98.54%), error:       551.57141, best error:       482.69055 on epoch:    88, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 283.9057922363s, input_fired_time: 3.7468900681, output_fired_time: 3.4664940834, propagate_forward_time: 107.3043746948, propagate_backward_time: 164.8895416260, weight_update_time: 0.3186270893, other_time: 4.4984893799
epoch time: 22.8132972717s, input_fired_time: 0.4775175750, output_fired_time: 0.0000000000, propagate_forward_time: 21.5018634796, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8339157104
validation[          , genome  8717] predictions:    9824/  10000 (98.24%), best:    9854/10000 (98.54%), error:       579.73492, best error:       482.69055 on epoch:    88, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 286.6146850586s, input_fired_time: 3.7732739449, output_fired_time: 3.5515713692, propagate_forward_time: 108.2822494507, propagate_backward_time: 166.5128784180, weight_update_time: 0.3236837685, other_time: 4.4946899414
epoch time: 22.9596424103s, input_fired_time: 0.4659402966, output_fired_time: 0.0000000000, propagate_forward_time: 21.6886558533, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8050460815
validation[          , genome  8717] predictions:    9840/  10000 (98.40%), best:    9854/10000 (98.54%), error:       503.45865, best error:       482.69055 on epoch:    88, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 285.5997924805s, input_fired_time: 3.8035979271, output_fired_time: 3.4928174019, propagate_forward_time: 107.8472137451, propagate_backward_time: 165.8670349121, weight_update_time: 0.3240700066, other_time: 4.5891265869
epoch time: 22.8898315430s, input_fired_time: 0.4672642350, output_fired_time: 0.0000000000, propagate_forward_time: 21.6195316315, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8030357361
validation[          , genome  8717] predictions:    9848/  10000 (98.48%), best:    9854/10000 (98.54%), error:       484.41882, best error:       482.69055 on epoch:    88, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 288.1817626953s, input_fired_time: 3.8876047134, output_fired_time: 3.5403904915, propagate_forward_time: 108.6472396851, propagate_backward_time: 167.3852081299, weight_update_time: 0.3299322724, other_time: 4.7212982178
epoch time: 22.8964939117s, input_fired_time: 0.4778088331, output_fired_time: 0.0000000000, propagate_forward_time: 21.5848884583, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8337974548
validation[          , genome  8717] predictions:    9838/  10000 (98.38%), best:    9854/10000 (98.54%), error:       535.13153, best error:       482.69055 on epoch:    88, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 114.4511489868s, input_fired_time: 2.3696410656, output_fired_time: 0.0000000000, propagate_forward_time: 107.8448562622, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.2366485596
best training[          , genome  8717] predictions:   49968/  50000 (99.94%), best:    9854/10000 (98.54%), error:       417.70963, best error:       482.69055 on epoch:    88, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 23.0200557709s, input_fired_time: 0.4728218317, output_fired_time: 0.0000000000, propagate_forward_time: 21.7135162354, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8337173462
   testing[          , genome  8717] predictions:    9863/  10000 (98.63%), best:    9854/10000 (98.54%), error:       412.79810, best error:       482.69055 on epoch:    88, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
14:38:18 (3824): called boinc_finish(0)

</stderr_txt>
]]>