Nameexact_genome_1512568488_43_6617_0
Workunit2604363
Created7 Dec 2017, 20:54:53 UTC
Sent7 Dec 2017, 21:01:34 UTC
Report deadline16 Dec 2017, 16:05:04 UTC
Received8 Dec 2017, 11:13:08 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID55829
Run time4 hours 19 min 6 sec
CPU time4 hours 15 min 38 sec
Validate stateInitial
Credit0.00
Device peak FLOPS2.39 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.33
Peak working set size150.56 MB
Peak swap size152.31 MB
Peak disk usage1.20 MB

Stderr output

<core_client_version>7.6.31</core_client_version>
<![CDATA[
<stderr_txt>
ht_update_time: 0.2061669230, other_time: 3.6913375854
epoch time: 11.9437294006s, input_fired_time: 0.1522074193, output_fired_time: 0.0000000000, propagate_forward_time: 11.1547737122, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6367483139
validation[          , genome  6617] predictions:    9729/  10000 (97.29%), best:    9752/10000 (97.52%), error:       897.32678, best error:       833.05304 on epoch:     9, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 140.7266082764s, input_fired_time: 1.3229926825, output_fired_time: 0.9734934568, propagate_forward_time: 56.6439437866, propagate_backward_time: 78.1847991943, weight_update_time: 0.2210327834, other_time: 3.6013717651
epoch time: 12.0871047974s, input_fired_time: 0.1491273195, output_fired_time: 0.0000000000, propagate_forward_time: 11.3017978668, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6361799240
validation[          , genome  6617] predictions:    9746/  10000 (97.46%), best:    9746/10000 (97.46%), error:       807.00708, best error:       807.00708 on epoch:    21, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 140.4800109863s, input_fired_time: 1.3178831339, output_fired_time: 0.9854760766, propagate_forward_time: 56.3104057312, propagate_backward_time: 78.2275695801, weight_update_time: 0.2058655918, other_time: 3.6386718750
epoch time: 12.0587577820s, input_fired_time: 0.1513843834, output_fired_time: 0.0000000000, propagate_forward_time: 11.2427368164, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6646366119
validation[          , genome  6617] predictions:    9772/  10000 (97.72%), best:    9772/10000 (97.72%), error:       799.69458, best error:       799.69458 on epoch:    22, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 141.2763824463s, input_fired_time: 1.3248617649, output_fired_time: 0.9793946743, propagate_forward_time: 56.5721626282, propagate_backward_time: 78.7458038330, weight_update_time: 0.2065348625, other_time: 3.6541595459
epoch time: 11.8407802582s, input_fired_time: 0.1445439756, output_fired_time: 0.0000000000, propagate_forward_time: 11.1020545959, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5941820145
validation[          , genome  6617] predictions:    9690/  10000 (96.90%), best:    9772/10000 (97.72%), error:      1014.61499, best error:       799.69458 on epoch:    22, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

arguments:
	'../../projects/csgrid.org_csg/exact_client_0.33_x86_64-pc-linux-gnu'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/mnist_training_50k.bin'
boincified validation filename: '../../projects/csgrid.org_csg/mnist_validation_10k.bin'
boincified testing filename: '../../projects/csgrid.org_csg/mnist_testing_new.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1512568488_43_6617.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1512568488_43_6617_0_r1390223222_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.846925
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.00364986
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 0.000145994
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 24
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 22
read number_validation_images: 10000
read best_validation_predictions: 9772
read best_validation_error: 799.695
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6617
read normal distribution: '1 -2.06696057319641 0.341677904129028'
generator_str: '1389591733'
read generator: 1389591733
read generated_by_map:
1 add_edge 1
reading 24 nodes.
reading 55 edges.
number input nodes: 1
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 4923 images.
reading image set with 5742 images.
reading image set with 4958 images.
reading image set with 5131 images.
reading image set with 4842 images.
reading image set with 4421 images.
reading image set with 4918 images.
reading image set with 5265 images.
reading image set with 4851 images.
reading image set with 4949 images.
image_size: 1x28x28 = 784
read 50000 images.
    class    0: 4923
    class    1: 5742
    class    2: 4958
    class    3: 5131
    class    4: 4842
    class    5: 4421
    class    6: 4918
    class    7: 5265
    class    8: 4851
    class    9: 4949
calculating averages and standard deviations for images
average pixel value for channel 0: 0.130530551075935
pixel variance for channel 0: 0.0948646068572998
pixel standard deviation for channel 0: 0.308000981807709
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 1x28x28 = 784
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 980 images.
reading image set with 1135 images.
reading image set with 1032 images.
reading image set with 1010 images.
reading image set with 982 images.
reading image set with 892 images.
reading image set with 958 images.
reading image set with 1028 images.
reading image set with 974 images.
reading image set with 1009 images.
image_size: 1x28x28 = 784
read 10000 images.
    class    0: 980
    class    1: 1135
    class    2: 1032
    class    3: 1010
    class    4: 982
    class    5: 892
    class    6: 958
    class    7: 1028
    class    8: 974
    class    9: 1009
loaded images
starting backpropagation!
epoch time: 141.611114501953s, input_fired_time: 1.35042333602905, output_fired_time: 0.998823821544647, propagate_forward_time: 56.9624862670898, propagate_backward_time: 78.4856033325195, weight_update_time: 0.216373592615128, other_time: 3.81378173828125
epoch time: 11.9927597045898s, input_fired_time: 0.169482290744781, output_fired_time: 0, propagate_forward_time: 11.1672048568726, propagate_backward_time: 0, weight_update_time: 0, other_time: 0.656072616577148
validation[          , genome  6617] predictions:    9746/  10000 (97.46%), best:    9772/10000 (97.72%), error:       861.53180, best error:       799.69458 on epoch:    22, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 141.0152587891s, input_fired_time: 1.4329360723, output_fired_time: 1.0077091455, propagate_forward_time: 56.5593299866, propagate_backward_time: 78.2754211426, weight_update_time: 0.2174345106, other_time: 3.7398681641
epoch time: 11.9245185852s, input_fired_time: 0.1534420550, output_fired_time: 0.0000000000, propagate_forward_time: 11.1155128479, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6555633545
validation[          , genome  6617] predictions:    9745/  10000 (97.45%), best:    9772/10000 (97.72%), error:       819.84454, best error:       799.69458 on epoch:    22, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 141.1463165283s, input_fired_time: 1.3545502424, output_fired_time: 1.0046230555, propagate_forward_time: 56.4651145935, propagate_backward_time: 78.4998779297, weight_update_time: 0.2187549770, other_time: 3.8221435547
epoch time: 12.0108327866s, input_fired_time: 0.1569454521, output_fired_time: 0.0000000000, propagate_forward_time: 11.2081766129, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6457109451
validation[          , genome  6617] predictions:    9756/  10000 (97.56%), best:    9772/10000 (97.72%), error:       822.70117, best error:       799.69458 on epoch:    22, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 140.5771026611s, input_fired_time: 1.3332750797, output_fired_time: 1.0043607950, propagate_forward_time: 56.2934150696, propagate_backward_time: 78.2022476196, weight_update_time: 0.2184592187, other_time: 3.7437973022
epoch time: 11.9881544113s, input_fired_time: 0.1627095342, output_fired_time: 0.0000000000, propagate_forward_time: 11.1700897217, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6553554535
validation[          , genome  6617] predictions:    9767/  10000 (97.67%), best:    9767/10000 (97.67%), error:       792.48175, best error:       792.48175 on epoch:    27, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 141.3724670410s, input_fired_time: 1.3516958952, output_fired_time: 1.0140565634, propagate_forward_time: 56.5908012390, propagate_backward_time: 78.5809783936, weight_update_time: 0.2146220207, other_time: 3.8349304199
epoch time: 11.9401473999s, input_fired_time: 0.1535885781, output_fired_time: 0.0000000000, propagate_forward_time: 11.1329545975, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6536045074
validation[          , genome  6617] predictions:    9767/  10000 (97.67%), best:    9767/10000 (97.67%), error:       790.47064, best error:       790.47064 on epoch:    28, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 141.2208709717s, input_fired_time: 1.3580566645, output_fired_time: 0.9992538691, propagate_forward_time: 56.5947265625, propagate_backward_time: 78.5369567871, weight_update_time: 0.2203957587, other_time: 3.7318725586
epoch time: 11.9469203949s, input_fired_time: 0.1530556083, output_fired_time: 0.0000000000, propagate_forward_time: 11.1509761810, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6428890228
validation[          , genome  6617] predictions:    9787/  10000 (97.87%), best:    9787/10000 (97.87%), error:       737.20123, best error:       737.20123 on epoch:    29, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 141.3839263916s, input_fired_time: 1.4076520205, output_fired_time: 1.0170962811, propagate_forward_time: 56.5413436890, propagate_backward_time: 78.6541137695, weight_update_time: 0.2184806913, other_time: 3.7637252808
epoch time: 12.1155891418s, input_fired_time: 0.1509872377, output_fired_time: 0.0000000000, propagate_forward_time: 11.3014001846, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6632013321
validation[          , genome  6617] predictions:    9742/  10000 (97.42%), best:    9787/10000 (97.87%), error:       882.01312, best error:       737.20123 on epoch:    29, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 141.5618438721s, input_fired_time: 1.4082964659, output_fired_time: 0.9935314059, propagate_forward_time: 56.9687194824, propagate_backward_time: 78.4944458008, weight_update_time: 0.2113646567, other_time: 3.6968536377
epoch time: 11.9344797134s, input_fired_time: 0.1497320831, output_fired_time: 0.0000000000, propagate_forward_time: 11.1435031891, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6412448883
validation[          , genome  6617] predictions:    9754/  10000 (97.54%), best:    9787/10000 (97.87%), error:       821.88812, best error:       737.20123 on epoch:    29, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 140.4685211182s, input_fired_time: 1.3310499191, output_fired_time: 0.9835000038, propagate_forward_time: 56.3521804810, propagate_backward_time: 78.1763687134, weight_update_time: 0.2091248333, other_time: 3.6254119873
epoch time: 12.0167617798s, input_fired_time: 0.1545484960, output_fired_time: 0.0000000000, propagate_forward_time: 11.2121610641, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6500520706
validation[          , genome  6617] predictions:    9738/  10000 (97.38%), best:    9787/10000 (97.87%), error:       857.24774, best error:       737.20123 on epoch:    29, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 140.6413879395s, input_fired_time: 1.3384774923, output_fired_time: 0.9890770912, propagate_forward_time: 56.3693161011, propagate_backward_time: 78.3198776245, weight_update_time: 0.2079361230, other_time: 3.6246490479
epoch time: 11.8512296677s, input_fired_time: 0.1530005485, output_fired_time: 0.0000000000, propagate_forward_time: 11.0566740036, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6415548325
validation[          , genome  6617] predictions:    9769/  10000 (97.69%), best:    9787/10000 (97.87%), error:       748.98352, best error:       737.20123 on epoch:    29, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 140.6054534912s, input_fired_time: 1.3438441753, output_fired_time: 0.9927563071, propagate_forward_time: 56.2988128662, propagate_backward_time: 78.3121032715, weight_update_time: 0.2141041756, other_time: 3.6579437256
epoch time: 12.0038986206s, input_fired_time: 0.1543998271, output_fired_time: 0.0000000000, propagate_forward_time: 11.2001037598, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6493949890
validation[          , genome  6617] predictions:    9748/  10000 (97.48%), best:    9787/10000 (97.87%), error:       813.59106, best error:       737.20123 on epoch:    29, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 141.1844787598s, input_fired_time: 1.4183508158, output_fired_time: 0.9854164720, propagate_forward_time: 56.6487541199, propagate_backward_time: 78.4836425781, weight_update_time: 0.2097925395, other_time: 3.6483154297
epoch time: 12.0771608353s, input_fired_time: 0.1533580869, output_fired_time: 0.0000000000, propagate_forward_time: 11.2864761353, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6373262405
validation[          , genome  6617] predictions:    9748/  10000 (97.48%), best:    9787/10000 (97.87%), error:       818.46423, best error:       737.20123 on epoch:    29, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 141.0216369629s, input_fired_time: 1.3516151905, output_fired_time: 1.0344551802, propagate_forward_time: 56.6790885925, propagate_backward_time: 78.2752380371, weight_update_time: 0.2089637667, other_time: 3.6812438965
epoch time: 11.9672231674s, input_fired_time: 0.1507515460, output_fired_time: 0.0000000000, propagate_forward_time: 11.1692914963, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6471805573
validation[          , genome  6617] predictions:    9749/  10000 (97.49%), best:    9787/10000 (97.87%), error:       811.94696, best error:       737.20123 on epoch:    29, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 140.9791259766s, input_fired_time: 1.3952779770, output_fired_time: 0.9868327379, propagate_forward_time: 56.4657020569, propagate_backward_time: 78.4821166992, weight_update_time: 0.2095944434, other_time: 3.6492004395
epoch time: 11.9846916199s, input_fired_time: 0.1525608897, output_fired_time: 0.0000000000, propagate_forward_time: 11.1926832199, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6394472122
validation[          , genome  6617] predictions:    9776/  10000 (97.76%), best:    9787/10000 (97.87%), error:       739.60400, best error:       737.20123 on epoch:    29, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 141.0849761963s, input_fired_time: 1.3445914984, output_fired_time: 1.0112242699, propagate_forward_time: 56.4554481506, propagate_backward_time: 78.5964508057, weight_update_time: 0.2375211120, other_time: 3.6772613525
epoch time: 12.0612392426s, input_fired_time: 0.1554817557, output_fired_time: 0.0000000000, propagate_forward_time: 11.2544593811, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6512985229
validation[          , genome  6617] predictions:    9772/  10000 (97.72%), best:    9787/10000 (97.87%), error:       789.72021, best error:       737.20123 on epoch:    29, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 141.1719512939s, input_fired_time: 1.3429425955, output_fired_time: 1.0102286339, propagate_forward_time: 56.5407676697, propagate_backward_time: 78.6164855957, weight_update_time: 0.2179711610, other_time: 3.6615295410
epoch time: 12.0332489014s, input_fired_time: 0.1567504704, output_fired_time: 0.0000000000, propagate_forward_time: 11.2373952866, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6391029358
validation[          , genome  6617] predictions:    9752/  10000 (97.52%), best:    9787/10000 (97.87%), error:       827.41290, best error:       737.20123 on epoch:    29, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 141.2074584961s, input_fired_time: 1.4032369852, output_fired_time: 1.0014191866, propagate_forward_time: 56.6500358582, propagate_backward_time: 78.4564208984, weight_update_time: 0.2098605633, other_time: 3.6963348389
epoch time: 11.9660253525s, input_fired_time: 0.1518460214, output_fired_time: 0.0000000000, propagate_forward_time: 11.1582880020, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6558914185
validation[          , genome  6617] predictions:    9753/  10000 (97.53%), best:    9787/10000 (97.87%), error:       815.99164, best error:       737.20123 on epoch:    29, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 141.4685363770s, input_fired_time: 1.3492319584, output_fired_time: 0.9901367426, propagate_forward_time: 56.6719169617, propagate_backward_time: 78.7726440430, weight_update_time: 0.2092452049, other_time: 3.6846008301
epoch time: 11.8910999298s, input_fired_time: 0.1610257626, output_fired_time: 0.0000000000, propagate_forward_time: 11.0939388275, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6361351013
validation[          , genome  6617] predictions:    9775/  10000 (97.75%), best:    9787/10000 (97.87%), error:       777.42255, best error:       737.20123 on epoch:    29, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 141.2419433594s, input_fired_time: 1.3339312077, output_fired_time: 1.0009275675, propagate_forward_time: 56.6843452454, propagate_backward_time: 78.5677490234, weight_update_time: 0.2170343101, other_time: 3.6549835205
epoch time: 11.8821344376s, input_fired_time: 0.1572048813, output_fired_time: 0.0000000000, propagate_forward_time: 11.0836610794, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6412687302
validation[          , genome  6617] predictions:    9735/  10000 (97.35%), best:    9787/10000 (97.87%), error:       824.63586, best error:       737.20123 on epoch:    29, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 141.2983245850s, input_fired_time: 1.3852716684, output_fired_time: 0.9841344953, propagate_forward_time: 56.6896896362, propagate_backward_time: 78.5438308716, weight_update_time: 0.2225282192, other_time: 3.6954040527
epoch time: 11.9677076340s, input_fired_time: 0.1523502469, output_fired_time: 0.0000000000, propagate_forward_time: 11.1729850769, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6423721313
validation[          , genome  6617] predictions:    9783/  10000 (97.83%), best:    9783/10000 (97.83%), error:       736.31073, best error:       736.31073 on epoch:    43, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 141.3758239746s, input_fired_time: 1.3538483381, output_fired_time: 0.9909834266, propagate_forward_time: 56.7316818237, propagate_backward_time: 78.6055984497, weight_update_time: 0.2073894441, other_time: 3.6937103271
epoch time: 12.0133638382s, input_fired_time: 0.1548381299, output_fired_time: 0.0000000000, propagate_forward_time: 11.2166481018, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6418771744
validation[          , genome  6617] predictions:    9758/  10000 (97.58%), best:    9783/10000 (97.83%), error:       816.91455, best error:       736.31073 on epoch:    43, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 140.6201782227s, input_fired_time: 1.3523610830, output_fired_time: 0.9904221296, propagate_forward_time: 56.4547119141, propagate_backward_time: 78.1323242188, weight_update_time: 0.2089676261, other_time: 3.6903686523
epoch time: 11.9623260498s, input_fired_time: 0.1521504819, output_fired_time: 0.0000000000, propagate_forward_time: 11.1786537170, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6315221786
validation[          , genome  6617] predictions:    9791/  10000 (97.91%), best:    9791/10000 (97.91%), error:       691.05530, best error:       691.05530 on epoch:    45, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 140.8114318848s, input_fired_time: 1.3476077318, output_fired_time: 1.0003976822, propagate_forward_time: 56.4587478638, propagate_backward_time: 78.3646163940, weight_update_time: 0.2096669376, other_time: 3.6400604248
epoch time: 12.3235960007s, input_fired_time: 0.1630996615, output_fired_time: 0.0000000000, propagate_forward_time: 11.5044364929, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6560602188
validation[          , genome  6617] predictions:    9744/  10000 (97.44%), best:    9791/10000 (97.91%), error:       830.15277, best error:       691.05530 on epoch:    45, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 141.6676330566s, input_fired_time: 1.3509783745, output_fired_time: 0.9881566167, propagate_forward_time: 56.8414955139, propagate_backward_time: 78.7959976196, weight_update_time: 0.2076737285, other_time: 3.6910018921
epoch time: 11.9758920670s, input_fired_time: 0.1524170488, output_fired_time: 0.0000000000, propagate_forward_time: 11.1351222992, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6883525848
validation[          , genome  6617] predictions:    9771/  10000 (97.71%), best:    9791/10000 (97.91%), error:       766.76251, best error:       691.05530 on epoch:    45, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 141.1466827393s, input_fired_time: 1.3400675058, output_fired_time: 1.0040863752, propagate_forward_time: 56.4965362549, propagate_backward_time: 78.5947189331, weight_update_time: 0.2508398890, other_time: 3.7112655640
epoch time: 12.0912141800s, input_fired_time: 0.1687425226, output_fired_time: 0.0000000000, propagate_forward_time: 11.2576351166, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6648368835
validation[          , genome  6617] predictions:    9757/  10000 (97.57%), best:    9791/10000 (97.91%), error:       808.36987, best error:       691.05530 on epoch:    45, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 141.4418487549s, input_fired_time: 1.3386887312, output_fired_time: 0.9828082919, propagate_forward_time: 56.7988243103, propagate_backward_time: 78.6559066772, weight_update_time: 0.2097466737, other_time: 3.6656265259
epoch time: 12.0115137100s, input_fired_time: 0.1514011770, output_fired_time: 0.0000000000, propagate_forward_time: 11.2254886627, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6346235275
validation[          , genome  6617] predictions:    9786/  10000 (97.86%), best:    9791/10000 (97.91%), error:       705.38550, best error:       691.05530 on epoch:    45, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 140.9129638672s, input_fired_time: 1.3404229879, output_fired_time: 0.9891793132, propagate_forward_time: 56.4569244385, propagate_backward_time: 78.3646774292, weight_update_time: 0.2126133144, other_time: 3.7617568970
epoch time: 11.9891510010s, input_fired_time: 0.1630191803, output_fired_time: 0.0000000000, propagate_forward_time: 11.1640214920, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6621103287
validation[          , genome  6617] predictions:    9780/  10000 (97.80%), best:    9791/10000 (97.91%), error:       728.88721, best error:       691.05530 on epoch:    45, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 141.9694671631s, input_fired_time: 1.3404350281, output_fired_time: 1.0203121901, propagate_forward_time: 56.8532485962, propagate_backward_time: 79.0672607422, weight_update_time: 0.2090753615, other_time: 3.6882095337
epoch time: 11.9958019257s, input_fired_time: 0.1631182581, output_fired_time: 0.0000000000, propagate_forward_time: 11.1757411957, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6569423676
validation[          , genome  6617] predictions:    9795/  10000 (97.95%), best:    9791/10000 (97.91%), error:       694.46252, best error:       691.05530 on epoch:    45, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 140.8442840576s, input_fired_time: 1.3687183857, output_fired_time: 0.9957489967, propagate_forward_time: 56.4138450623, propagate_backward_time: 78.3776550293, weight_update_time: 0.2083115280, other_time: 3.6883239746
epoch time: 12.0574941635s, input_fired_time: 0.1677452922, output_fired_time: 0.0000000000, propagate_forward_time: 11.2336397171, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6561088562
validation[          , genome  6617] predictions:    9760/  10000 (97.60%), best:    9791/10000 (97.91%), error:       753.15106, best error:       691.05530 on epoch:    45, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 142.2778778076s, input_fired_time: 1.3669120073, output_fired_time: 0.9969655275, propagate_forward_time: 57.1041030884, propagate_backward_time: 79.1273727417, weight_update_time: 0.2095898241, other_time: 3.6825256348
epoch time: 11.9498243332s, input_fired_time: 0.1537651718, output_fired_time: 0.0000000000, propagate_forward_time: 11.1619367599, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6341228485
validation[          , genome  6617] predictions:    9753/  10000 (97.53%), best:    9791/10000 (97.91%), error:       771.76154, best error:       691.05530 on epoch:    45, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 141.4638977051s, input_fired_time: 1.3548069000, output_fired_time: 1.0055973530, propagate_forward_time: 56.8610115051, propagate_backward_time: 78.5551986694, weight_update_time: 0.2093771398, other_time: 3.6872787476
epoch time: 11.8864641190s, input_fired_time: 0.1556818336, output_fired_time: 0.0000000000, propagate_forward_time: 11.0846357346, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6461467743
validation[          , genome  6617] predictions:    9763/  10000 (97.63%), best:    9791/10000 (97.91%), error:       788.51874, best error:       691.05530 on epoch:    45, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 142.0587005615s, input_fired_time: 1.3925888538, output_fired_time: 0.9945454597, propagate_forward_time: 56.9480895996, propagate_backward_time: 79.0588684082, weight_update_time: 0.2092799097, other_time: 3.6645965576
epoch time: 11.9481334686s, input_fired_time: 0.1584234685, output_fired_time: 0.0000000000, propagate_forward_time: 11.1370372772, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6526727676
validation[          , genome  6617] predictions:    9780/  10000 (97.80%), best:    9791/10000 (97.91%), error:       758.29712, best error:       691.05530 on epoch:    45, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 141.0462341309s, input_fired_time: 1.3502237797, output_fired_time: 0.9991601110, propagate_forward_time: 56.7204513550, propagate_backward_time: 78.3259658813, weight_update_time: 0.2088592499, other_time: 3.6504364014
epoch time: 12.0033531189s, input_fired_time: 0.1540122479, output_fired_time: 0.0000000000, propagate_forward_time: 11.2073926926, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6419477463
validation[          , genome  6617] predictions:    9706/  10000 (97.06%), best:    9791/10000 (97.91%), error:       871.02521, best error:       691.05530 on epoch:    45, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 141.1735687256s, input_fired_time: 1.3462072611, output_fired_time: 0.9962108135, propagate_forward_time: 56.4498443604, propagate_backward_time: 78.7127914429, weight_update_time: 0.2078796476, other_time: 3.6685104370
epoch time: 11.8887453079s, input_fired_time: 0.1596654952, output_fired_time: 0.0000000000, propagate_forward_time: 11.0675621033, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6615180969
validation[          , genome  6617] predictions:    9759/  10000 (97.59%), best:    9791/10000 (97.91%), error:       818.29388, best error:       691.05530 on epoch:    45, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 140.8816070557s, input_fired_time: 1.3796954155, output_fired_time: 0.9990524054, propagate_forward_time: 56.5930557251, propagate_backward_time: 78.2610855103, weight_update_time: 0.2065424621, other_time: 3.6487121582
epoch time: 12.0065107346s, input_fired_time: 0.1572964489, output_fired_time: 0.0000000000, propagate_forward_time: 11.1795520782, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6696624756
validation[          , genome  6617] predictions:    9740/  10000 (97.40%), best:    9791/10000 (97.91%), error:       846.69629, best error:       691.05530 on epoch:    45, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 141.3505401611s, input_fired_time: 1.4454661608, output_fired_time: 0.9939692616, propagate_forward_time: 56.6852760315, propagate_backward_time: 78.5440750122, weight_update_time: 0.2073561251, other_time: 3.6817550659
epoch time: 12.0345640182s, input_fired_time: 0.1621355116, output_fired_time: 0.0000000000, propagate_forward_time: 11.1876506805, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6847782135
validation[          , genome  6617] predictions:    9769/  10000 (97.69%), best:    9791/10000 (97.91%), error:       811.53424, best error:       691.05530 on epoch:    45, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 141.4183959961s, input_fired_time: 1.3512909412, output_fired_time: 0.9845139980, propagate_forward_time: 56.8520088196, propagate_backward_time: 78.5665359497, weight_update_time: 0.2075379044, other_time: 3.6640548706
epoch time: 12.0337619781s, input_fired_time: 0.1541447043, output_fired_time: 0.0000000000, propagate_forward_time: 11.1874780655, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6921396255
validation[          , genome  6617] predictions:    9792/  10000 (97.92%), best:    9791/10000 (97.91%), error:       721.89764, best error:       691.05530 on epoch:    45, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 141.4101409912s, input_fired_time: 1.3721143007, output_fired_time: 1.0041272640, propagate_forward_time: 56.6600914001, propagate_backward_time: 78.6566467285, weight_update_time: 0.2123415172, other_time: 3.7171630859
epoch time: 11.9430704117s, input_fired_time: 0.1567172408, output_fired_time: 0.0000000000, propagate_forward_time: 11.1503219604, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6360311508
validation[          , genome  6617] predictions:    9772/  10000 (97.72%), best:    9791/10000 (97.91%), error:       773.50549, best error:       691.05530 on epoch:    45, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 140.9351959229s, input_fired_time: 1.3878356218, output_fired_time: 1.0031764507, propagate_forward_time: 56.5527839661, propagate_backward_time: 78.3304672241, weight_update_time: 0.2087916583, other_time: 3.6609420776
epoch time: 12.0793733597s, input_fired_time: 0.1570890993, output_fired_time: 0.0000000000, propagate_forward_time: 11.2779493332, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6443347931
validation[          , genome  6617] predictions:    9797/  10000 (97.97%), best:    9791/10000 (97.91%), error:       709.84558, best error:       691.05530 on epoch:    45, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 141.0876922607s, input_fired_time: 1.3576000929, output_fired_time: 1.0105937719, propagate_forward_time: 56.3913002014, propagate_backward_time: 78.6785278320, weight_update_time: 0.2144079208, other_time: 3.6496734619
epoch time: 12.1564807892s, input_fired_time: 0.1556453705, output_fired_time: 0.0000000000, propagate_forward_time: 11.3569269180, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6439085007
validation[          , genome  6617] predictions:    9773/  10000 (97.73%), best:    9791/10000 (97.91%), error:       771.92548, best error:       691.05530 on epoch:    45, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 141.1199951172s, input_fired_time: 1.3892282248, output_fired_time: 0.9942630529, propagate_forward_time: 56.7576789856, propagate_backward_time: 78.3042602539, weight_update_time: 0.2089423686, other_time: 3.6745758057
epoch time: 11.9001407623s, input_fired_time: 0.1554723829, output_fired_time: 0.0000000000, propagate_forward_time: 11.1099939346, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6346740723
validation[          , genome  6617] predictions:    9772/  10000 (97.72%), best:    9791/10000 (97.91%), error:       766.58844, best error:       691.05530 on epoch:    45, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 141.2655029297s, input_fired_time: 1.3657157421, output_fired_time: 1.0443638563, propagate_forward_time: 56.4573707581, propagate_backward_time: 78.7258300781, weight_update_time: 0.2088562846, other_time: 3.6722259521
epoch time: 11.9702024460s, input_fired_time: 0.1570237577, output_fired_time: 0.0000000000, propagate_forward_time: 11.1725654602, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6406135559
validation[          , genome  6617] predictions:    9767/  10000 (97.67%), best:    9791/10000 (97.91%), error:       779.34473, best error:       691.05530 on epoch:    45, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 140.7404327393s, input_fired_time: 1.3710374832, output_fired_time: 0.9983684421, propagate_forward_time: 56.5820465088, propagate_backward_time: 78.1327285767, weight_update_time: 0.2138733864, other_time: 3.6562576294
epoch time: 11.9029836655s, input_fired_time: 0.1609469354, output_fired_time: 0.0000000000, propagate_forward_time: 11.0937938690, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6482429504
validation[          , genome  6617] predictions:    9794/  10000 (97.94%), best:    9791/10000 (97.91%), error:       695.54626, best error:       691.05530 on epoch:    45, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 141.2448883057s, input_fired_time: 1.3576518297, output_fired_time: 0.9909777045, propagate_forward_time: 56.4634704590, propagate_backward_time: 78.7362060547, weight_update_time: 0.2161371857, other_time: 3.6965789795
epoch time: 12.0413484573s, input_fired_time: 0.1583255976, output_fired_time: 0.0000000000, propagate_forward_time: 11.1464614868, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7365617752
validation[          , genome  6617] predictions:    9800/  10000 (98.00%), best:    9791/10000 (97.91%), error:       702.27820, best error:       691.05530 on epoch:    45, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 140.7409973145s, input_fired_time: 1.3517826796, output_fired_time: 0.9979253411, propagate_forward_time: 56.2773361206, propagate_backward_time: 78.4156112671, weight_update_time: 0.2091383189, other_time: 3.6983489990
epoch time: 12.0631542206s, input_fired_time: 0.1569258273, output_fired_time: 0.0000000000, propagate_forward_time: 11.2664060593, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6398220062
validation[          , genome  6617] predictions:    9745/  10000 (97.45%), best:    9791/10000 (97.91%), error:       821.59851, best error:       691.05530 on epoch:    45, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 141.0588989258s, input_fired_time: 1.3727982044, output_fired_time: 0.9981032014, propagate_forward_time: 56.6937294006, propagate_backward_time: 78.2982330322, weight_update_time: 0.2074901611, other_time: 3.6960296631
epoch time: 12.0372619629s, input_fired_time: 0.1595884264, output_fired_time: 0.0000000000, propagate_forward_time: 11.2477540970, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6299190521
validation[          , genome  6617] predictions:    9779/  10000 (97.79%), best:    9791/10000 (97.91%), error:       748.94592, best error:       691.05530 on epoch:    45, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 141.3788604736s, input_fired_time: 1.3611608744, output_fired_time: 0.9987232685, propagate_forward_time: 56.6317977905, propagate_backward_time: 78.7343521118, weight_update_time: 0.2079359740, other_time: 3.6528320312
epoch time: 11.9576959610s, input_fired_time: 0.1583115458, output_fired_time: 0.0000000000, propagate_forward_time: 11.1328392029, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6665449142
validation[          , genome  6617] predictions:    9792/  10000 (97.92%), best:    9792/10000 (97.92%), error:       669.00421, best error:       669.00421 on epoch:    70, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 140.9993133545s, input_fired_time: 1.3583813906, output_fired_time: 0.9906064272, propagate_forward_time: 56.3615493774, propagate_backward_time: 78.5910873413, weight_update_time: 0.2076311409, other_time: 3.6976928711
epoch time: 12.0592832565s, input_fired_time: 0.1587271392, output_fired_time: 0.0000000000, propagate_forward_time: 11.2380647659, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6624917984
validation[          , genome  6617] predictions:    9773/  10000 (97.73%), best:    9792/10000 (97.92%), error:       722.11743, best error:       669.00421 on epoch:    70, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 140.7398681641s, input_fired_time: 1.3465751410, output_fired_time: 0.9870243073, propagate_forward_time: 56.3597183228, propagate_backward_time: 78.4233093262, weight_update_time: 0.2083341181, other_time: 3.6232376099
epoch time: 12.0103626251s, input_fired_time: 0.1660886407, output_fired_time: 0.0000000000, propagate_forward_time: 11.1715164185, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6727571487
validation[          , genome  6617] predictions:    9802/  10000 (98.02%), best:    9802/10000 (98.02%), error:       655.77917, best error:       655.77917 on epoch:    72, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 140.7817535400s, input_fired_time: 1.3659884930, output_fired_time: 1.0055702925, propagate_forward_time: 56.0517730713, propagate_backward_time: 78.6668243408, weight_update_time: 0.2133391649, other_time: 3.6916046143
epoch time: 11.9423656464s, input_fired_time: 0.1613395065, output_fired_time: 0.0000000000, propagate_forward_time: 11.1367082596, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6443176270
validation[          , genome  6617] predictions:    9794/  10000 (97.94%), best:    9802/10000 (98.02%), error:       668.40735, best error:       655.77917 on epoch:    72, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 141.3218688965s, input_fired_time: 1.3713495731, output_fired_time: 0.9950595498, propagate_forward_time: 56.9602584839, propagate_backward_time: 78.2898178101, weight_update_time: 0.2191943377, other_time: 3.7053833008
epoch time: 11.9144592285s, input_fired_time: 0.1564712971, output_fired_time: 0.0000000000, propagate_forward_time: 11.1119127274, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6460752487
validation[          , genome  6617] predictions:    9738/  10000 (97.38%), best:    9802/10000 (98.02%), error:       848.27332, best error:       655.77917 on epoch:    72, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 141.1020355225s, input_fired_time: 1.3582547903, output_fired_time: 1.0038111210, propagate_forward_time: 56.4365692139, propagate_backward_time: 78.6367721558, weight_update_time: 0.2128711194, other_time: 3.6666183472
epoch time: 12.0438709259s, input_fired_time: 0.1587184221, output_fired_time: 0.0000000000, propagate_forward_time: 11.2391786575, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6459741592
validation[          , genome  6617] predictions:    9743/  10000 (97.43%), best:    9802/10000 (98.02%), error:       846.74603, best error:       655.77917 on epoch:    72, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 141.0091094971s, input_fired_time: 1.3629810810, output_fired_time: 1.0887067318, propagate_forward_time: 56.6970977783, propagate_backward_time: 78.1789016724, weight_update_time: 0.2121090442, other_time: 3.6814346313
epoch time: 11.9645586014s, input_fired_time: 0.1563591212, output_fired_time: 0.0000000000, propagate_forward_time: 11.1641759872, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6440238953
validation[          , genome  6617] predictions:    9761/  10000 (97.61%), best:    9802/10000 (98.02%), error:       854.43958, best error:       655.77917 on epoch:    72, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 141.2215728760s, input_fired_time: 1.3612234592, output_fired_time: 0.9973219037, propagate_forward_time: 57.0104179382, propagate_backward_time: 78.1669311523, weight_update_time: 0.2116932720, other_time: 3.6856842041
epoch time: 11.9350748062s, input_fired_time: 0.1576944143, output_fired_time: 0.0000000000, propagate_forward_time: 11.1288919449, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6484880447
validation[          , genome  6617] predictions:    9767/  10000 (97.67%), best:    9802/10000 (98.02%), error:       750.56506, best error:       655.77917 on epoch:    72, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 141.1163024902s, input_fired_time: 1.3703917265, output_fired_time: 1.0124154091, propagate_forward_time: 56.6364173889, propagate_backward_time: 78.3144989014, weight_update_time: 0.2116199583, other_time: 3.7825775146
epoch time: 12.0171051025s, input_fired_time: 0.1665855646, output_fired_time: 0.0000000000, propagate_forward_time: 11.2043437958, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6461753845
validation[          , genome  6617] predictions:    9736/  10000 (97.36%), best:    9802/10000 (98.02%), error:       830.43549, best error:       655.77917 on epoch:    72, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 140.8946990967s, input_fired_time: 1.3688468933, output_fired_time: 1.0057935715, propagate_forward_time: 56.3311042786, propagate_backward_time: 78.4612503052, weight_update_time: 0.2119664103, other_time: 3.7276992798
epoch time: 12.0430126190s, input_fired_time: 0.1614370942, output_fired_time: 0.0000000000, propagate_forward_time: 11.2276554108, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6539201736
validation[          , genome  6617] predictions:    9790/  10000 (97.90%), best:    9802/10000 (98.02%), error:       713.85809, best error:       655.77917 on epoch:    72, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 141.0155639648s, input_fired_time: 1.3670156002, output_fired_time: 1.0320481062, propagate_forward_time: 56.3742637634, propagate_backward_time: 78.5580139160, weight_update_time: 0.2190407217, other_time: 3.6842193604
epoch time: 12.0181217194s, input_fired_time: 0.1707209796, output_fired_time: 0.0000000000, propagate_forward_time: 11.1956491470, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6517515182
validation[          , genome  6617] predictions:    9791/  10000 (97.91%), best:    9802/10000 (98.02%), error:       706.02301, best error:       655.77917 on epoch:    72, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 141.1652221680s, input_fired_time: 1.3881602287, output_fired_time: 0.9938638210, propagate_forward_time: 56.4444923401, propagate_backward_time: 78.6424407959, weight_update_time: 0.2129923254, other_time: 3.6962738037
epoch time: 11.9483747482s, input_fired_time: 0.1567502320, output_fired_time: 0.0000000000, propagate_forward_time: 11.1513862610, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6402378082
validation[          , genome  6617] predictions:    9757/  10000 (97.57%), best:    9802/10000 (98.02%), error:       799.13098, best error:       655.77917 on epoch:    72, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 141.4758148193s, input_fired_time: 1.4295247793, output_fired_time: 0.9917953014, propagate_forward_time: 56.7591285706, propagate_backward_time: 78.6125564575, weight_update_time: 0.2204023302, other_time: 3.6828231812
epoch time: 12.0385932922s, input_fired_time: 0.1563454419, output_fired_time: 0.0000000000, propagate_forward_time: 11.2401313782, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6421165466
validation[          , genome  6617] predictions:    9744/  10000 (97.44%), best:    9802/10000 (98.02%), error:       798.56567, best error:       655.77917 on epoch:    72, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 140.8300781250s, input_fired_time: 1.3616414070, output_fired_time: 1.0057857037, propagate_forward_time: 56.4323616028, propagate_backward_time: 78.3761749268, weight_update_time: 0.2140361220, other_time: 3.6541137695
epoch time: 11.9110784531s, input_fired_time: 0.1580965221, output_fired_time: 0.0000000000, propagate_forward_time: 11.1048250198, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6481571198
validation[          , genome  6617] predictions:    9786/  10000 (97.86%), best:    9802/10000 (98.02%), error:       693.18060, best error:       655.77917 on epoch:    72, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 140.7568969727s, input_fired_time: 1.3825075626, output_fired_time: 1.0396486521, propagate_forward_time: 56.4271202087, propagate_backward_time: 78.2008285522, weight_update_time: 0.2140469104, other_time: 3.7067947388
epoch time: 11.9578685760s, input_fired_time: 0.1602028459, output_fired_time: 0.0000000000, propagate_forward_time: 11.1580953598, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6395702362
validation[          , genome  6617] predictions:    9777/  10000 (97.77%), best:    9802/10000 (98.02%), error:       711.01093, best error:       655.77917 on epoch:    72, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 140.9120635986s, input_fired_time: 1.3575570583, output_fired_time: 0.9885655046, propagate_forward_time: 56.4007110596, propagate_backward_time: 78.5150146484, weight_update_time: 0.2114439160, other_time: 3.6502075195
epoch time: 11.8996238708s, input_fired_time: 0.1608722061, output_fired_time: 0.0000000000, propagate_forward_time: 11.0918378830, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6469135284
validation[          , genome  6617] predictions:    9788/  10000 (97.88%), best:    9802/10000 (98.02%), error:       742.20911, best error:       655.77917 on epoch:    72, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 141.2085723877s, input_fired_time: 1.3928097486, output_fired_time: 0.9918859005, propagate_forward_time: 56.6994552612, propagate_backward_time: 78.4621810913, weight_update_time: 0.2121566832, other_time: 3.6622467041
epoch time: 11.9188928604s, input_fired_time: 0.1614881456, output_fired_time: 0.0000000000, propagate_forward_time: 11.1069431305, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6504611969
validation[          , genome  6617] predictions:    9800/  10000 (98.00%), best:    9802/10000 (98.02%), error:       688.87897, best error:       655.77917 on epoch:    72, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 141.1524810791s, input_fired_time: 1.3584530354, output_fired_time: 1.0007609129, propagate_forward_time: 56.5038566589, propagate_backward_time: 78.6341323853, weight_update_time: 0.2108348608, other_time: 3.6552658081
epoch time: 12.0500936508s, input_fired_time: 0.1655560732, output_fired_time: 0.0000000000, propagate_forward_time: 11.2443246841, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6402130127
validation[          , genome  6617] predictions:    9683/  10000 (96.83%), best:    9802/10000 (98.02%), error:       989.86871, best error:       655.77917 on epoch:    72, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 141.0303344727s, input_fired_time: 1.3722862005, output_fired_time: 0.9926914573, propagate_forward_time: 56.5091934204, propagate_backward_time: 78.4500961304, weight_update_time: 0.2093963474, other_time: 3.7060699463
epoch time: 12.0780105591s, input_fired_time: 0.1590207219, output_fired_time: 0.0000000000, propagate_forward_time: 11.2903594971, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6286306381
validation[          , genome  6617] predictions:    9691/  10000 (96.91%), best:    9802/10000 (98.02%), error:       988.97473, best error:       655.77917 on epoch:    72, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 141.1234283447s, input_fired_time: 1.3576732874, output_fired_time: 0.9913245440, propagate_forward_time: 56.4443931580, propagate_backward_time: 78.6780395508, weight_update_time: 0.2095875293, other_time: 3.6520080566
epoch time: 11.9767694473s, input_fired_time: 0.1590681076, output_fired_time: 0.0000000000, propagate_forward_time: 11.1634073257, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6542940140
validation[          , genome  6617] predictions:    9724/  10000 (97.24%), best:    9802/10000 (98.02%), error:       895.11176, best error:       655.77917 on epoch:    72, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 141.0952606201s, input_fired_time: 1.3829250336, output_fired_time: 1.0230057240, propagate_forward_time: 56.4034233093, propagate_backward_time: 78.6500854492, weight_update_time: 0.2129752934, other_time: 3.6358184814
epoch time: 12.0031757355s, input_fired_time: 0.1560591459, output_fired_time: 0.0000000000, propagate_forward_time: 11.2091693878, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6379470825
validation[          , genome  6617] predictions:    9756/  10000 (97.56%), best:    9802/10000 (98.02%), error:       779.05396, best error:       655.77917 on epoch:    72, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 140.8080749512s, input_fired_time: 1.3773176670, output_fired_time: 0.9927315712, propagate_forward_time: 56.5193862915, propagate_backward_time: 78.2743530273, weight_update_time: 0.2182617038, other_time: 3.6442794800
epoch time: 11.8251457214s, input_fired_time: 0.1582927555, output_fired_time: 0.0000000000, propagate_forward_time: 11.0348834991, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6319694519
validation[          , genome  6617] predictions:    9760/  10000 (97.60%), best:    9802/10000 (98.02%), error:       787.63141, best error:       655.77917 on epoch:    72, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 140.6900177002s, input_fired_time: 1.3758784533, output_fired_time: 1.0063748360, propagate_forward_time: 56.4203186035, propagate_backward_time: 78.2528991699, weight_update_time: 0.2105222940, other_time: 3.6345367432
epoch time: 12.0370187759s, input_fired_time: 0.1608400047, output_fired_time: 0.0000000000, propagate_forward_time: 11.1461238861, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7300548553
validation[          , genome  6617] predictions:    9736/  10000 (97.36%), best:    9802/10000 (98.02%), error:       843.37891, best error:       655.77917 on epoch:    72, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 142.5980682373s, input_fired_time: 1.4113812447, output_fired_time: 1.0415184498, propagate_forward_time: 56.9807090759, propagate_backward_time: 79.3880233765, weight_update_time: 0.2090893388, other_time: 3.7764358521
epoch time: 12.0178403854s, input_fired_time: 0.1627201587, output_fired_time: 0.0000000000, propagate_forward_time: 11.2005729675, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6545476913
validation[          , genome  6617] predictions:    9780/  10000 (97.80%), best:    9802/10000 (98.02%), error:       735.29779, best error:       655.77917 on epoch:    72, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 140.7084655762s, input_fired_time: 1.4399918318, output_fired_time: 0.9868540168, propagate_forward_time: 56.2387351990, propagate_backward_time: 78.3925628662, weight_update_time: 0.2093860060, other_time: 3.6503295898
epoch time: 11.9379892349s, input_fired_time: 0.1676503718, output_fired_time: 0.0000000000, propagate_forward_time: 11.1302413940, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6400976181
validation[          , genome  6617] predictions:    9762/  10000 (97.62%), best:    9802/10000 (98.02%), error:       842.75476, best error:       655.77917 on epoch:    72, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 141.1138610840s, input_fired_time: 1.3682297468, output_fired_time: 0.9985212088, propagate_forward_time: 56.4803428650, propagate_backward_time: 78.5651473999, weight_update_time: 0.2087968588, other_time: 3.7016220093
epoch time: 11.9571886063s, input_fired_time: 0.1615405828, output_fired_time: 0.0000000000, propagate_forward_time: 11.1446905136, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6509571075
validation[          , genome  6617] predictions:    9774/  10000 (97.74%), best:    9802/10000 (98.02%), error:       766.82983, best error:       655.77917 on epoch:    72, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 140.7436218262s, input_fired_time: 1.3853991032, output_fired_time: 0.9965613484, propagate_forward_time: 56.4981613159, propagate_backward_time: 78.1661300659, weight_update_time: 0.2086164802, other_time: 3.6973571777
epoch time: 11.8778028488s, input_fired_time: 0.1588405222, output_fired_time: 0.0000000000, propagate_forward_time: 11.0800046921, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6389579773
validation[          , genome  6617] predictions:    9776/  10000 (97.76%), best:    9802/10000 (98.02%), error:       735.95038, best error:       655.77917 on epoch:    72, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 141.3596801758s, input_fired_time: 1.4271734953, output_fired_time: 1.0102360249, propagate_forward_time: 56.5885620117, propagate_backward_time: 78.6953582764, weight_update_time: 0.2098966539, other_time: 3.6383514404
epoch time: 12.0075387955s, input_fired_time: 0.1619209796, output_fired_time: 0.0000000000, propagate_forward_time: 11.1958780289, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6497402191
validation[          , genome  6617] predictions:    9791/  10000 (97.91%), best:    9802/10000 (98.02%), error:       710.29321, best error:       655.77917 on epoch:    72, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 141.1576995850s, input_fired_time: 1.3928368092, output_fired_time: 1.0397493839, propagate_forward_time: 56.5048103333, propagate_backward_time: 78.5350418091, weight_update_time: 0.2086285651, other_time: 3.6852645874
epoch time: 11.9087972641s, input_fired_time: 0.1632205844, output_fired_time: 0.0000000000, propagate_forward_time: 11.0984363556, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6471405029
validation[          , genome  6617] predictions:    9732/  10000 (97.32%), best:    9802/10000 (98.02%), error:       835.87219, best error:       655.77917 on epoch:    72, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 141.1862640381s, input_fired_time: 1.4545526505, output_fired_time: 0.9998915195, propagate_forward_time: 56.6673469543, propagate_backward_time: 78.4002914429, weight_update_time: 0.2107312530, other_time: 3.6641769409
epoch time: 11.9993581772s, input_fired_time: 0.1599890590, output_fired_time: 0.0000000000, propagate_forward_time: 11.1850214005, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6543474197
validation[          , genome  6617] predictions:    9663/  10000 (96.63%), best:    9802/10000 (98.02%), error:      1132.05615, best error:       655.77917 on epoch:    72, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 141.0594024658s, input_fired_time: 1.3831715584, output_fired_time: 1.0051045418, propagate_forward_time: 56.6072921753, propagate_backward_time: 78.4521865845, weight_update_time: 0.2122726142, other_time: 3.6116333008
epoch time: 11.9961042404s, input_fired_time: 0.1601187885, output_fired_time: 0.0000000000, propagate_forward_time: 11.1999692917, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6360158920
validation[          , genome  6617] predictions:    9768/  10000 (97.68%), best:    9802/10000 (98.02%), error:       812.46967, best error:       655.77917 on epoch:    72, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 59.9956703186s, input_fired_time: 0.7926470637, output_fired_time: 0.0000000000, propagate_forward_time: 55.9425735474, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2604484558
best training[          , genome  6617] predictions:   49677/  50000 (99.35%), best:    9802/10000 (98.02%), error:      1318.14648, best error:       655.77917 on epoch:    72, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 12.5748186111s, input_fired_time: 0.1556215584, output_fired_time: 0.0000000000, propagate_forward_time: 11.4776210785, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9415760040
   testing[          , genome  6617] predictions:    9804/  10000 (98.04%), best:    9802/10000 (98.02%), error:       620.58868, best error:       655.77917 on epoch:    72, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
10:18:59 (13685): called boinc_finish(0)

</stderr_txt>
]]>