Nameexact_genome_1512185335_36_8972_0
Workunit2563222
Created5 Dec 2017, 13:51:53 UTC
Sent5 Dec 2017, 14:02:22 UTC
Report deadline27 Dec 2017, 0:05:45 UTC
Received7 Dec 2017, 11:29:52 UTC
Server stateOver
OutcomeComputation error
Client stateCompute error
Exit status194 (0xc2) EXIT_ABORTED_BY_CLIENT
Computer ID57938
Run time6 hours 32 min 44 sec
CPU time6 hours 29 min 38 sec
Validate stateInvalid
Credit0.00
Device peak FLOPS2.90 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size159.73 MB
Peak swap size164.64 MB
Peak disk usage3.49 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 194 (0xc2)</message>
<stderr_txt>
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/mnist_training_50k.bin'
boincified validation filename: '../../projects/csgrid.org_csg/mnist_validation_10k.bin'
boincified testing filename: '../../projects/csgrid.org_csg/mnist_testing_new.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1512185335_36_8972.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1512185335_36_8972_0_r1730919882_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from input file: '../../projects/csgrid.org_csg/exact_genome_1512185335_36_8972.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.5
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.0125
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 0.0005
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 0
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 0
read best_validation_error: 1e+07
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 8972
read normal distribution: '1 -0.562201738357544 -0.52257627248764'
generator_str: '1329697948'
read generator: 1329697948
read generated_by_map:
1 change_size 1
reading 41 nodes.
reading 130 edges.
number input nodes: 1
number softmax nodes: 10
order_size: 0
parsed input file
loaded genome
loading images
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 4923 images.
reading image set with 5742 images.
reading image set with 4958 images.
reading image set with 5131 images.
reading image set with 4842 images.
reading image set with 4421 images.
reading image set with 4918 images.
reading image set with 5265 images.
reading image set with 4851 images.
reading image set with 4949 images.
image_size: 1x28x28 = 784
read 50000 images.
    class    0: 4923
    class    1: 5742
    class    2: 4958
    class    3: 5131
    class    4: 4842
    class    5: 4421
    class    6: 4918
    class    7: 5265
    class    8: 4851
    class    9: 4949
calculating averages and standard deviations for images
average pixel value for channel 0: 0.130530551075935
pixel variance for channel 0: 0.0948646068572998
pixel standard deviation for channel 0: 0.308000981807709
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 1x28x28 = 784
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 980 images.
reading image set with 1135 images.
reading image set with 1032 images.
reading image set with 1010 images.
reading image set with 982 images.
reading image set with 892 images.
reading image set with 958 images.
reading image set with 1028 images.
reading image set with 974 images.
reading image set with 1009 images.
image_size: 1x28x28 = 784
read 10000 images.
    class    0: 980
    class    1: 1135
    class    2: 1032
    class    3: 1010
    class    4: 982
    class    5: 892
    class    6: 958
    class    7: 1028
    class    8: 974
    class    9: 1009
loaded images
starting backpropagation!
generator min: 1, generator max: 2147483646
pre shuffle 1: 1518581354
post shuffle 1: 23855527
epoch time: 384.105255126953s, input_fired_time: 4.32259035110474, output_fired_time: 4.63082075119019, propagate_forward_time: 144.323776245117, propagate_backward_time: 225.293701171875, weight_update_time: 0.410680651664734, other_time: 5.53434753417969
epoch time: 29.963695526123s, input_fired_time: 0.533056735992432, output_fired_time: 0, propagate_forward_time: 28.4314231872559, propagate_backward_time: 0, weight_update_time: 0, other_time: 0.999216079711914
validation[          , genome  8972] predictions:    9792/  10000 (97.92%), best:    9792/10000 (97.92%), error:       740.94568, best error:       740.94568 on epoch:     0, epoch:    0/100, mu: 0.5000000000, learning_rate: 0.0125000002, weight_decay: 0.0005000000

epoch time: 388.8436889648s, input_fired_time: 4.3998064995, output_fired_time: 4.6879863739, propagate_forward_time: 146.2137298584, propagate_backward_time: 227.9620971680, weight_update_time: 0.4149546325, other_time: 5.5800628662
epoch time: 30.7727565765s, input_fired_time: 0.5386041999, output_fired_time: 0.0000000000, propagate_forward_time: 29.2451210022, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9890308380
validation[          , genome  8972] predictions:    9719/  10000 (97.19%), best:    9792/10000 (97.92%), error:       944.19604, best error:       740.94568 on epoch:     0, epoch:    1/100, mu: 0.5245000124, learning_rate: 0.0118749999, weight_decay: 0.0004750000

epoch time: 386.0205078125s, input_fired_time: 4.4076957703, output_fired_time: 4.6611609459, propagate_forward_time: 144.6308898926, propagate_backward_time: 226.6461334229, weight_update_time: 0.4136888683, other_time: 5.6746368408
epoch time: 31.1453189850s, input_fired_time: 0.5476298332, output_fired_time: 0.0000000000, propagate_forward_time: 29.5929222107, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0047664642
validation[          , genome  8972] predictions:    9817/  10000 (98.17%), best:    9817/10000 (98.17%), error:       663.76495, best error:       663.76495 on epoch:     2, epoch:    2/100, mu: 0.5477750301, learning_rate: 0.0112812500, weight_decay: 0.0004512500

epoch time: 383.9331970215s, input_fired_time: 4.3657269478, output_fired_time: 4.6399893761, propagate_forward_time: 143.3453063965, propagate_backward_time: 226.0123596191, weight_update_time: 0.4099826217, other_time: 5.5698242188
epoch time: 30.0702285767s, input_fired_time: 0.5455718040, output_fired_time: 0.0000000000, propagate_forward_time: 28.5035228729, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0211334229
validation[          , genome  8972] predictions:    9791/  10000 (97.91%), best:    9817/10000 (98.17%), error:       707.90271, best error:       663.76495 on epoch:     2, epoch:    3/100, mu: 0.5698862672, learning_rate: 0.0107171871, weight_decay: 0.0004286875

epoch time: 387.6151123047s, input_fired_time: 4.3897967339, output_fired_time: 4.6702194214, propagate_forward_time: 144.8117828369, propagate_backward_time: 228.1528167725, weight_update_time: 0.4115580916, other_time: 5.5904846191
epoch time: 30.7972183228s, input_fired_time: 0.5491214991, output_fired_time: 0.0000000000, propagate_forward_time: 29.2240257263, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0240707397
validation[          , genome  8972] predictions:    9790/  10000 (97.90%), best:    9817/10000 (98.17%), error:       664.33612, best error:       663.76495 on epoch:     2, epoch:    4/100, mu: 0.5908919573, learning_rate: 0.0101813274, weight_decay: 0.0004072531

epoch time: 386.8126525879s, input_fired_time: 4.3507719040, output_fired_time: 4.6469836235, propagate_forward_time: 144.3169097900, propagate_backward_time: 227.9612274170, weight_update_time: 0.4095935524, other_time: 5.5367736816
epoch time: 30.3766155243s, input_fired_time: 0.5306836367, output_fired_time: 0.0000000000, propagate_forward_time: 28.8890647888, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9568672180
validation[          , genome  8972] predictions:    9800/  10000 (98.00%), best:    9800/10000 (98.00%), error:       660.43542, best error:       660.43542 on epoch:     5, epoch:    5/100, mu: 0.6108473539, learning_rate: 0.0096722608, weight_decay: 0.0003868904

epoch time: 391.2816162109s, input_fired_time: 4.4075398445, output_fired_time: 4.6967802048, propagate_forward_time: 145.9131469727, propagate_backward_time: 230.6017761230, weight_update_time: 0.4201819003, other_time: 5.6623840332
epoch time: 29.6644897461s, input_fired_time: 0.5479589105, output_fired_time: 0.0000000000, propagate_forward_time: 28.0227355957, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0937957764
validation[          , genome  8972] predictions:    9708/  10000 (97.08%), best:    9800/10000 (98.00%), error:       915.55219, best error:       660.43542 on epoch:     5, epoch:    6/100, mu: 0.6298049688, learning_rate: 0.0091886474, weight_decay: 0.0003675459

epoch time: 388.3547363281s, input_fired_time: 4.3679776192, output_fired_time: 4.6482343674, propagate_forward_time: 144.6239013672, propagate_backward_time: 229.1145477295, weight_update_time: 0.4154190421, other_time: 5.6000823975
epoch time: 31.1064205170s, input_fired_time: 0.5371695757, output_fired_time: 0.0000000000, propagate_forward_time: 29.5907955170, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9784545898
validation[          , genome  8972] predictions:    9751/  10000 (97.51%), best:    9800/10000 (98.00%), error:       805.41382, best error:       660.43542 on epoch:     5, epoch:    7/100, mu: 0.6478147507, learning_rate: 0.0087292148, weight_decay: 0.0003491686

epoch time: 389.0134582520s, input_fired_time: 4.3796277046, output_fired_time: 4.6656332016, propagate_forward_time: 144.7303619385, propagate_backward_time: 229.6079101563, weight_update_time: 0.4158746004, other_time: 5.6299285889
epoch time: 29.8276939392s, input_fired_time: 0.5404050946, output_fired_time: 0.0000000000, propagate_forward_time: 28.2571048737, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0301837921
validation[          , genome  8972] predictions:    9823/  10000 (98.23%), best:    9823/10000 (98.23%), error:       565.35938, best error:       565.35938 on epoch:     8, epoch:    8/100, mu: 0.6649240255, learning_rate: 0.0082927542, weight_decay: 0.0003317102

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/mnist_training_50k.bin'
boincified validation filename: '../../projects/csgrid.org_csg/mnist_validation_10k.bin'
boincified testing filename: '../../projects/csgrid.org_csg/mnist_testing_new.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1512185335_36_8972.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1512185335_36_8972_0_r1730919882_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.681178
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.00787812
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 0.000315125
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 9
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 8
read number_validation_images: 10000
read best_validation_predictions: 9823
read best_validation_error: 565.359
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 8972
read normal distribution: '1 -0.562201738357544 -0.52257627248764'
generator_str: '1284207938'
read generator: 1284207938
read generated_by_map:
1 change_size 1
reading 41 nodes.
reading 130 edges.
number input nodes: 1
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 4923 images.
reading image set with 5742 images.
reading image set with 4958 images.
reading image set with 5131 images.
reading image set with 4842 images.
reading image set with 4421 images.
reading image set with 4918 images.
reading image set with 5265 images.
reading image set with 4851 images.
reading image set with 4949 images.
image_size: 1x28x28 = 784
read 50000 images.
    class    0: 4923
    class    1: 5742
    class    2: 4958
    class    3: 5131
    class    4: 4842
    class    5: 4421
    class    6: 4918
    class    7: 5265
    class    8: 4851
    class    9: 4949
calculating averages and standard deviations for images
average pixel value for channel 0: 0.130530551075935
pixel variance for channel 0: 0.0948646068572998
pixel standard deviation for channel 0: 0.308000981807709
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 1x28x28 = 784
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 980 images.
reading image set with 1135 images.
reading image set with 1032 images.
reading image set with 1010 images.
reading image set with 982 images.
reading image set with 892 images.
reading image set with 958 images.
reading image set with 1028 images.
reading image set with 974 images.
reading image set with 1009 images.
image_size: 1x28x28 = 784
read 10000 images.
    class    0: 980
    class    1: 1135
    class    2: 1032
    class    3: 1010
    class    4: 982
    class    5: 892
    class    6: 958
    class    7: 1028
    class    8: 974
    class    9: 1009
loaded images
starting backpropagation!
epoch time: 391.565246582031s, input_fired_time: 4.39050245285034, output_fired_time: 4.68588447570801, propagate_forward_time: 145.625961303711, propagate_backward_time: 231.228759765625, weight_update_time: 0.424760311841965, other_time: 5.63414001464844
epoch time: 29.6399345397949s, input_fired_time: 0.546118855476379, output_fired_time: 0, propagate_forward_time: 28.0630931854248, propagate_backward_time: 0, weight_update_time: 0, other_time: 1.03072166442871
validation[          , genome  8972] predictions:    9769/  10000 (97.69%), best:    9823/10000 (98.23%), error:       782.57208, best error:       565.35938 on epoch:     8, epoch:    9/100, mu: 0.6811778545, learning_rate: 0.0078781163, weight_decay: 0.0003151247

epoch time: 393.1366577148s, input_fired_time: 4.4002099037, output_fired_time: 4.6982340813, propagate_forward_time: 146.1302795410, propagate_backward_time: 232.2908477783, weight_update_time: 0.4256364703, other_time: 5.6170806885
epoch time: 30.3372192383s, input_fired_time: 0.5316823125, output_fired_time: 0.0000000000, propagate_forward_time: 28.8373661041, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9681701660
validation[          , genome  8972] predictions:    9764/  10000 (97.64%), best:    9823/10000 (98.23%), error:       715.29053, best error:       565.35938 on epoch:     8, epoch:   10/100, mu: 0.6966189742, learning_rate: 0.0074842102, weight_decay: 0.0002993684

epoch time: 394.1662597656s, input_fired_time: 4.4109745026, output_fired_time: 4.7006263733, propagate_forward_time: 146.4045562744, propagate_backward_time: 232.9928436279, weight_update_time: 0.4254659116, other_time: 5.6572570801
epoch time: 30.4570407867s, input_fired_time: 0.5445300937, output_fired_time: 0.0000000000, propagate_forward_time: 28.8869533539, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0255565643
validation[          , genome  8972] predictions:    9808/  10000 (98.08%), best:    9823/10000 (98.23%), error:       650.46063, best error:       565.35938 on epoch:     8, epoch:   11/100, mu: 0.7112880349, learning_rate: 0.0071099997, weight_decay: 0.0002844000

epoch time: 392.1198425293s, input_fired_time: 4.3929691315, output_fired_time: 4.6654067039, propagate_forward_time: 145.5787811279, propagate_backward_time: 231.9323577881, weight_update_time: 0.4251637757, other_time: 5.5503234863
epoch time: 29.7124748230s, input_fired_time: 0.5312670469, output_fired_time: 0.0000000000, propagate_forward_time: 28.1972885132, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9839191437
validation[          , genome  8972] predictions:    9804/  10000 (98.04%), best:    9823/10000 (98.23%), error:       641.42352, best error:       565.35938 on epoch:     8, epoch:   12/100, mu: 0.7252236605, learning_rate: 0.0067544994, weight_decay: 0.0002701800

epoch time: 390.0238342285s, input_fired_time: 4.3807821274, output_fired_time: 4.6755270958, propagate_forward_time: 144.0900421143, propagate_backward_time: 231.2452392578, weight_update_time: 0.4324142635, other_time: 5.6322479248
epoch time: 31.2216110229s, input_fired_time: 0.5480628014, output_fired_time: 0.0000000000, propagate_forward_time: 29.6731624603, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0003852844
validation[          , genome  8972] predictions:    9817/  10000 (98.17%), best:    9823/10000 (98.23%), error:       613.60364, best error:       565.35938 on epoch:     8, epoch:   13/100, mu: 0.7384625077, learning_rate: 0.0064167744, weight_decay: 0.0002566710

epoch time: 392.6240234375s, input_fired_time: 4.3986105919, output_fired_time: 4.6764574051, propagate_forward_time: 145.1051788330, propagate_backward_time: 232.8338012695, weight_update_time: 0.4381293654, other_time: 5.6099700928
epoch time: 29.5984554291s, input_fired_time: 0.5333902240, output_fired_time: 0.0000000000, propagate_forward_time: 28.0547466278, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0103187561
validation[          , genome  8972] predictions:    9807/  10000 (98.07%), best:    9823/10000 (98.23%), error:       624.35504, best error:       565.35938 on epoch:     8, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 392.2637634277s, input_fired_time: 4.3839540482, output_fired_time: 4.6522974968, propagate_forward_time: 145.2058868408, propagate_backward_time: 232.4037475586, weight_update_time: 0.4461148381, other_time: 5.6179046631
epoch time: 31.1167602539s, input_fired_time: 0.5449564457, output_fired_time: 0.0000000000, propagate_forward_time: 29.5794544220, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9923496246
validation[          , genome  8972] predictions:    9833/  10000 (98.33%), best:    9823/10000 (98.23%), error:       590.53870, best error:       565.35938 on epoch:     8, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 393.0232849121s, input_fired_time: 4.3823900223, output_fired_time: 4.6660699844, propagate_forward_time: 145.3237152100, propagate_backward_time: 233.1069183350, weight_update_time: 0.4519827962, other_time: 5.5441894531
epoch time: 30.6779823303s, input_fired_time: 0.5417668819, output_fired_time: 0.0000000000, propagate_forward_time: 29.1661128998, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9701023102
validation[          , genome  8972] predictions:    9824/  10000 (98.24%), best:    9823/10000 (98.23%), error:       619.18988, best error:       565.35938 on epoch:     8, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 393.0874328613s, input_fired_time: 4.3788418770, output_fired_time: 4.6975760460, propagate_forward_time: 145.0419006348, propagate_backward_time: 233.3378601074, weight_update_time: 0.4669112563, other_time: 5.6312561035
epoch time: 30.7408046722s, input_fired_time: 0.5605921149, output_fired_time: 0.0000000000, propagate_forward_time: 29.1053371429, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0748748779
validation[          , genome  8972] predictions:    9836/  10000 (98.36%), best:    9836/10000 (98.36%), error:       524.86786, best error:       524.86786 on epoch:    17, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 396.2357788086s, input_fired_time: 4.4408726692, output_fired_time: 4.7106189728, propagate_forward_time: 146.5764770508, propagate_backward_time: 234.8553314209, weight_update_time: 0.4813964963, other_time: 5.6524505615
epoch time: 30.2523021698s, input_fired_time: 0.5345211029, output_fired_time: 0.0000000000, propagate_forward_time: 28.7361812592, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9815998077
validation[          , genome  8972] predictions:    9836/  10000 (98.36%), best:    9836/10000 (98.36%), error:       528.15747, best error:       524.86786 on epoch:    17, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 395.6359252930s, input_fired_time: 4.3893995285, output_fired_time: 4.6781148911, propagate_forward_time: 146.6869201660, propagate_backward_time: 234.3021087646, weight_update_time: 0.4958437979, other_time: 5.5793914795
epoch time: 30.9512691498s, input_fired_time: 0.5432985425, output_fired_time: 0.0000000000, propagate_forward_time: 29.4185810089, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9893894196
validation[          , genome  8972] predictions:    9802/  10000 (98.02%), best:    9836/10000 (98.36%), error:       649.65173, best error:       524.86786 on epoch:    17, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 392.0610656738s, input_fired_time: 4.3803925514, output_fired_time: 4.6591482162, propagate_forward_time: 144.2096099854, propagate_backward_time: 233.1639099121, weight_update_time: 0.5153172612, other_time: 5.6479949951
epoch time: 30.9947700500s, input_fired_time: 0.5434294343, output_fired_time: 0.0000000000, propagate_forward_time: 29.4711380005, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9802017212
validation[          , genome  8972] predictions:    9811/  10000 (98.11%), best:    9836/10000 (98.36%), error:       622.44104, best error:       524.86786 on epoch:    17, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 392.9161376953s, input_fired_time: 4.4149765968, output_fired_time: 4.6939826012, propagate_forward_time: 144.4038696289, propagate_backward_time: 233.6084442139, weight_update_time: 0.5429185629, other_time: 5.7948760986
epoch time: 30.5166893005s, input_fired_time: 0.5443239212, output_fired_time: 0.0000000000, propagate_forward_time: 28.9816837311, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9906826019
validation[          , genome  8972] predictions:    9807/  10000 (98.07%), best:    9836/10000 (98.36%), error:       622.37292, best error:       524.86786 on epoch:    17, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 395.8894348145s, input_fired_time: 4.4142608643, output_fired_time: 4.6955666542, propagate_forward_time: 146.1397399902, propagate_backward_time: 234.9558258057, weight_update_time: 0.5577270985, other_time: 5.6840362549
epoch time: 30.5122032166s, input_fired_time: 0.5389063954, output_fired_time: 0.0000000000, propagate_forward_time: 29.0001907349, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9731063843
validation[          , genome  8972] predictions:    9825/  10000 (98.25%), best:    9836/10000 (98.36%), error:       546.29608, best error:       524.86786 on epoch:    17, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 395.6689147949s, input_fired_time: 4.4180526733, output_fired_time: 4.6887097359, propagate_forward_time: 146.2670898438, propagate_backward_time: 234.5470428467, weight_update_time: 0.5773445368, other_time: 5.7480010986
epoch time: 31.3098125458s, input_fired_time: 0.5589283109, output_fired_time: 0.0000000000, propagate_forward_time: 29.7444210052, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0064640045
validation[          , genome  8972] predictions:    9788/  10000 (97.88%), best:    9836/10000 (98.36%), error:       640.40674, best error:       524.86786 on epoch:    17, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 395.8683471680s, input_fired_time: 4.4247245789, output_fired_time: 4.7068452835, propagate_forward_time: 145.6723327637, propagate_backward_time: 235.2937011719, weight_update_time: 0.5953781009, other_time: 5.7707519531
epoch time: 31.2985286713s, input_fired_time: 0.5557954907, output_fired_time: 0.0000000000, propagate_forward_time: 29.7353229523, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0074100494
validation[          , genome  8972] predictions:    9831/  10000 (98.31%), best:    9836/10000 (98.36%), error:       529.81616, best error:       524.86786 on epoch:    17, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 397.6623840332s, input_fired_time: 4.4264893532, output_fired_time: 4.7146277428, propagate_forward_time: 146.8615112305, propagate_backward_time: 235.9188079834, weight_update_time: 0.6042770147, other_time: 5.7409515381
epoch time: 31.1988372803s, input_fired_time: 0.5442886949, output_fired_time: 0.0000000000, propagate_forward_time: 29.6885242462, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9660243988
validation[          , genome  8972] predictions:    9816/  10000 (98.16%), best:    9836/10000 (98.36%), error:       626.77209, best error:       524.86786 on epoch:    17, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 394.4571228027s, input_fired_time: 4.4217762947, output_fired_time: 4.6904287338, propagate_forward_time: 144.8627624512, propagate_backward_time: 234.7023010254, weight_update_time: 0.6054328680, other_time: 5.7798461914
epoch time: 30.7188339233s, input_fired_time: 0.5664172769, output_fired_time: 0.0000000000, propagate_forward_time: 29.0883712769, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0640449524
validation[          , genome  8972] predictions:    9831/  10000 (98.31%), best:    9836/10000 (98.36%), error:       586.69330, best error:       524.86786 on epoch:    17, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 397.8661804199s, input_fired_time: 4.4711704254, output_fired_time: 4.7184762955, propagate_forward_time: 146.4977264404, propagate_backward_time: 236.3194732666, weight_update_time: 0.6114420295, other_time: 5.8593444824
epoch time: 31.6285915375s, input_fired_time: 0.5601547360, output_fired_time: 0.0000000000, propagate_forward_time: 30.0622634888, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0061740875
validation[          , genome  8972] predictions:    9834/  10000 (98.34%), best:    9834/10000 (98.34%), error:       522.84564, best error:       522.84564 on epoch:    27, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 399.0218200684s, input_fired_time: 4.4552521706, output_fired_time: 4.7223567963, propagate_forward_time: 147.5043029785, propagate_backward_time: 236.5869903564, weight_update_time: 0.6114020348, other_time: 5.7529144287
epoch time: 31.0173130035s, input_fired_time: 0.5472138524, output_fired_time: 0.0000000000, propagate_forward_time: 29.5219898224, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9481086731
validation[          , genome  8972] predictions:    9852/  10000 (98.52%), best:    9852/10000 (98.52%), error:       473.93796, best error:       473.93796 on epoch:    28, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 396.8468933105s, input_fired_time: 4.4161133766, output_fired_time: 4.6865215302, propagate_forward_time: 146.5372772217, propagate_backward_time: 235.4662780762, weight_update_time: 0.6169002056, other_time: 5.7407073975
epoch time: 30.9647903442s, input_fired_time: 0.5497026443, output_fired_time: 0.0000000000, propagate_forward_time: 29.4325790405, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9825096130
validation[          , genome  8972] predictions:    9835/  10000 (98.35%), best:    9852/10000 (98.52%), error:       539.75415, best error:       473.93796 on epoch:    28, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 397.4310302734s, input_fired_time: 4.4271817207, output_fired_time: 4.7001557350, propagate_forward_time: 146.5879516602, propagate_backward_time: 235.9481658936, weight_update_time: 0.6083089113, other_time: 5.7675628662
epoch time: 29.7629852295s, input_fired_time: 0.5384006500, output_fired_time: 0.0000000000, propagate_forward_time: 28.2511425018, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9734420776
validation[          , genome  8972] predictions:    9820/  10000 (98.20%), best:    9852/10000 (98.52%), error:       546.23035, best error:       473.93796 on epoch:    28, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 398.0269165039s, input_fired_time: 4.4626932144, output_fired_time: 4.7101240158, propagate_forward_time: 146.8448028564, propagate_backward_time: 236.1248168945, weight_update_time: 0.6194585562, other_time: 5.8844757080
epoch time: 31.3639144897s, input_fired_time: 0.5499696732, output_fired_time: 0.0000000000, propagate_forward_time: 29.8572883606, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9566574097
validation[          , genome  8972] predictions:    9810/  10000 (98.10%), best:    9852/10000 (98.52%), error:       580.10712, best error:       473.93796 on epoch:    28, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 396.1898803711s, input_fired_time: 4.4261646271, output_fired_time: 4.6843237877, propagate_forward_time: 146.0382080078, propagate_backward_time: 235.3189849854, weight_update_time: 0.6064558625, other_time: 5.7221832275
epoch time: 31.2491855621s, input_fired_time: 0.5445595980, output_fired_time: 0.0000000000, propagate_forward_time: 29.7449474335, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9596786499
validation[          , genome  8972] predictions:    9815/  10000 (98.15%), best:    9852/10000 (98.52%), error:       577.31586, best error:       473.93796 on epoch:    28, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 397.5873718262s, input_fired_time: 4.4470295906, output_fired_time: 4.7033143044, propagate_forward_time: 146.7377471924, propagate_backward_time: 235.8909606934, weight_update_time: 0.6131518483, other_time: 5.8083343506
epoch time: 29.8082599640s, input_fired_time: 0.5418395400, output_fired_time: 0.0000000000, propagate_forward_time: 28.2564239502, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0099964142
validation[          , genome  8972] predictions:    9816/  10000 (98.16%), best:    9852/10000 (98.52%), error:       555.25488, best error:       473.93796 on epoch:    28, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 398.0397949219s, input_fired_time: 4.4313063622, output_fired_time: 4.6981630325, propagate_forward_time: 146.9529876709, propagate_backward_time: 236.2133026123, weight_update_time: 0.6101376414, other_time: 5.7440490723
epoch time: 31.1136131287s, input_fired_time: 0.5453816652, output_fired_time: 0.0000000000, propagate_forward_time: 29.6048126221, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9634189606
validation[          , genome  8972] predictions:    9842/  10000 (98.42%), best:    9852/10000 (98.52%), error:       552.98865, best error:       473.93796 on epoch:    28, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 400.7402038574s, input_fired_time: 4.4630432129, output_fired_time: 4.7255935669, propagate_forward_time: 148.1507263184, propagate_backward_time: 237.6023559570, weight_update_time: 0.6137276292, other_time: 5.7984924316
epoch time: 31.5138568878s, input_fired_time: 0.5677728653, output_fired_time: 0.0000000000, propagate_forward_time: 29.9478912354, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9981918335
validation[          , genome  8972] predictions:    9810/  10000 (98.10%), best:    9852/10000 (98.52%), error:       559.28180, best error:       473.93796 on epoch:    28, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 397.7439880371s, input_fired_time: 4.4596929550, output_fired_time: 4.7194695473, propagate_forward_time: 146.3741912842, propagate_backward_time: 236.3628845215, weight_update_time: 0.6120707989, other_time: 5.8277435303
epoch time: 30.7859191895s, input_fired_time: 0.5558771491, output_fired_time: 0.0000000000, propagate_forward_time: 29.2318553925, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9981861115
validation[          , genome  8972] predictions:    9844/  10000 (98.44%), best:    9852/10000 (98.52%), error:       501.71130, best error:       473.93796 on epoch:    28, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 398.2562255859s, input_fired_time: 4.4464769363, output_fired_time: 4.6945252419, propagate_forward_time: 147.0190582275, propagate_backward_time: 236.3892211914, weight_update_time: 0.6074239612, other_time: 5.7069549561
epoch time: 30.4646911621s, input_fired_time: 0.5427666306, output_fired_time: 0.0000000000, propagate_forward_time: 28.9646453857, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9572792053
validation[          , genome  8972] predictions:    9816/  10000 (98.16%), best:    9852/10000 (98.52%), error:       566.39880, best error:       473.93796 on epoch:    28, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 399.9533996582s, input_fired_time: 4.5167703629, output_fired_time: 4.7188529968, propagate_forward_time: 147.7539062500, propagate_backward_time: 237.1472473145, weight_update_time: 0.6119956374, other_time: 5.8166198730
epoch time: 31.3557720184s, input_fired_time: 0.5569475293, output_fired_time: 0.0000000000, propagate_forward_time: 29.7981719971, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0006523132
validation[          , genome  8972] predictions:    9831/  10000 (98.31%), best:    9852/10000 (98.52%), error:       529.73029, best error:       473.93796 on epoch:    28, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 397.3142089844s, input_fired_time: 4.4232425690, output_fired_time: 4.6961379051, propagate_forward_time: 146.4719543457, propagate_backward_time: 235.9746856689, weight_update_time: 0.6096317768, other_time: 5.7481842041
epoch time: 31.3689155579s, input_fired_time: 0.5562955737, output_fired_time: 0.0000000000, propagate_forward_time: 29.8118209839, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0007991791
validation[          , genome  8972] predictions:    9821/  10000 (98.21%), best:    9852/10000 (98.52%), error:       595.29010, best error:       473.93796 on epoch:    28, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 399.8516845703s, input_fired_time: 4.4645075798, output_fired_time: 4.7115321159, propagate_forward_time: 147.7377777100, propagate_backward_time: 237.1906890869, weight_update_time: 0.6189848185, other_time: 5.7471923828
epoch time: 30.5573024750s, input_fired_time: 0.5515304804, output_fired_time: 0.0000000000, propagate_forward_time: 29.0237083435, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9820632935
validation[          , genome  8972] predictions:    9851/  10000 (98.51%), best:    9852/10000 (98.52%), error:       485.43826, best error:       473.93796 on epoch:    28, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 398.9035034180s, input_fired_time: 4.4757037163, output_fired_time: 4.7705979347, propagate_forward_time: 146.7788238525, propagate_backward_time: 237.1060943604, weight_update_time: 0.6097995639, other_time: 5.7722778320
epoch time: 31.4347381592s, input_fired_time: 0.5524249077, output_fired_time: 0.0000000000, propagate_forward_time: 29.8916912079, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9906215668
validation[          , genome  8972] predictions:    9867/  10000 (98.67%), best:    9867/10000 (98.67%), error:       464.70050, best error:       464.70050 on epoch:    41, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 395.9416503906s, input_fired_time: 4.4093770981, output_fired_time: 4.6824502945, propagate_forward_time: 145.4619293213, propagate_backward_time: 235.6668548584, weight_update_time: 0.6063582897, other_time: 5.7210388184
epoch time: 30.8453979492s, input_fired_time: 0.5532177091, output_fired_time: 0.0000000000, propagate_forward_time: 29.3069744110, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9852066040
validation[          , genome  8972] predictions:    9833/  10000 (98.33%), best:    9867/10000 (98.67%), error:       557.29272, best error:       464.70050 on epoch:    41, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 399.5792541504s, input_fired_time: 4.4565534592, output_fired_time: 4.7073698044, propagate_forward_time: 147.6296844482, propagate_backward_time: 237.0912933350, weight_update_time: 0.6078953743, other_time: 5.6943664551
epoch time: 31.8000431061s, input_fired_time: 0.5711283088, output_fired_time: 0.0000000000, propagate_forward_time: 30.1906795502, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0382347107
validation[          , genome  8972] predictions:    9859/  10000 (98.59%), best:    9859/10000 (98.59%), error:       454.48279, best error:       454.48279 on epoch:    43, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 397.8296813965s, input_fired_time: 4.4743075371, output_fired_time: 4.7056341171, propagate_forward_time: 146.6568145752, propagate_backward_time: 236.2081451416, weight_update_time: 0.6133000851, other_time: 5.7847900391
epoch time: 30.6953411102s, input_fired_time: 0.5484252572, output_fired_time: 0.0000000000, propagate_forward_time: 29.1763610840, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9705543518
validation[          , genome  8972] predictions:    9842/  10000 (98.42%), best:    9859/10000 (98.59%), error:       512.88446, best error:       454.48279 on epoch:    43, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 397.8461914063s, input_fired_time: 4.4508008957, output_fired_time: 4.7015357018, propagate_forward_time: 146.2736206055, propagate_backward_time: 236.6586761475, weight_update_time: 0.6081804037, other_time: 5.7615509033
epoch time: 31.4841938019s, input_fired_time: 0.5630012751, output_fired_time: 0.0000000000, propagate_forward_time: 29.9231224060, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9980697632
validation[          , genome  8972] predictions:    9843/  10000 (98.43%), best:    9859/10000 (98.59%), error:       484.02460, best error:       454.48279 on epoch:    43, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 400.7478942871s, input_fired_time: 4.4697484970, output_fired_time: 4.7201218605, propagate_forward_time: 147.7447357178, propagate_backward_time: 238.0743408203, weight_update_time: 0.6123314500, other_time: 5.7389373779
epoch time: 31.8691616058s, input_fired_time: 0.5740242600, output_fired_time: 0.0000000000, propagate_forward_time: 30.2660808563, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0290565491
validation[          , genome  8972] predictions:    9849/  10000 (98.49%), best:    9859/10000 (98.59%), error:       512.86987, best error:       454.48279 on epoch:    43, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 393.6560974121s, input_fired_time: 4.4297323227, output_fired_time: 4.6912436485, propagate_forward_time: 144.0536651611, propagate_backward_time: 234.6255187988, weight_update_time: 0.6093090177, other_time: 5.8559417725
epoch time: 31.1539955139s, input_fired_time: 0.5796021223, output_fired_time: 0.0000000000, propagate_forward_time: 29.5224952698, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0518989563
validation[          , genome  8972] predictions:    9825/  10000 (98.25%), best:    9859/10000 (98.59%), error:       564.33380, best error:       454.48279 on epoch:    43, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 395.9200744629s, input_fired_time: 4.4188919067, output_fired_time: 4.6910305023, propagate_forward_time: 145.7308197021, propagate_backward_time: 235.3630218506, weight_update_time: 0.6044620872, other_time: 5.7163085938
epoch time: 31.2600383759s, input_fired_time: 0.5470175743, output_fired_time: 0.0000000000, propagate_forward_time: 29.7575931549, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9554271698
validation[          , genome  8972] predictions:    9805/  10000 (98.05%), best:    9859/10000 (98.59%), error:       633.58813, best error:       454.48279 on epoch:    43, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 392.5331726074s, input_fired_time: 4.4101409912, output_fired_time: 4.6519804001, propagate_forward_time: 143.5539398193, propagate_backward_time: 234.0970458984, weight_update_time: 0.6062511206, other_time: 5.8200836182
epoch time: 30.3214912415s, input_fired_time: 0.5552402735, output_fired_time: 0.0000000000, propagate_forward_time: 28.7354412079, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0308094025
validation[          , genome  8972] predictions:    9842/  10000 (98.42%), best:    9859/10000 (98.59%), error:       497.64847, best error:       454.48279 on epoch:    43, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 397.9800720215s, input_fired_time: 4.4647116661, output_fired_time: 4.7062163353, propagate_forward_time: 146.6157226563, propagate_backward_time: 236.4138946533, weight_update_time: 0.6109663248, other_time: 5.7795257568
epoch time: 28.9069366455s, input_fired_time: 0.5565387607, output_fired_time: 0.0000000000, propagate_forward_time: 27.2115058899, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1388912201
validation[          , genome  8972] predictions:    9812/  10000 (98.12%), best:    9859/10000 (98.59%), error:       567.39526, best error:       454.48279 on epoch:    43, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 401.1152038574s, input_fired_time: 4.5020852089, output_fired_time: 4.7289614677, propagate_forward_time: 148.2490234375, propagate_backward_time: 237.8910064697, weight_update_time: 0.6135447025, other_time: 5.7441253662
epoch time: 30.7695293427s, input_fired_time: 0.5500560999, output_fired_time: 0.0000000000, propagate_forward_time: 29.2331237793, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9863491058
validation[          , genome  8972] predictions:    9852/  10000 (98.52%), best:    9859/10000 (98.59%), error:       464.81915, best error:       454.48279 on epoch:    43, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 398.1040344238s, input_fired_time: 4.4703946114, output_fired_time: 4.7120275497, propagate_forward_time: 146.5152282715, propagate_backward_time: 236.6707000732, weight_update_time: 0.6085036993, other_time: 5.7356719971
epoch time: 31.3345394135s, input_fired_time: 0.5641317964, output_fired_time: 0.0000000000, propagate_forward_time: 29.7560081482, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0143985748
validation[          , genome  8972] predictions:    9845/  10000 (98.45%), best:    9859/10000 (98.59%), error:       513.35095, best error:       454.48279 on epoch:    43, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 398.6943664551s, input_fired_time: 4.4873938560, output_fired_time: 4.7214059830, propagate_forward_time: 146.7563323975, propagate_backward_time: 236.8905181885, weight_update_time: 0.6131692529, other_time: 5.8387145996
epoch time: 31.2445468903s, input_fired_time: 0.5579232574, output_fired_time: 0.0000000000, propagate_forward_time: 29.6844139099, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0022106171
validation[          , genome  8972] predictions:    9802/  10000 (98.02%), best:    9859/10000 (98.59%), error:       581.04712, best error:       454.48279 on epoch:    43, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 402.1592407227s, input_fired_time: 4.4861364365, output_fired_time: 4.7369604111, propagate_forward_time: 148.6559906006, propagate_backward_time: 238.6048278809, weight_update_time: 0.6086659431, other_time: 5.6753082275
epoch time: 31.1715717316s, input_fired_time: 0.5700536370, output_fired_time: 0.0000000000, propagate_forward_time: 29.5702819824, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0312366486
validation[          , genome  8972] predictions:    9858/  10000 (98.58%), best:    9859/10000 (98.59%), error:       467.58487, best error:       454.48279 on epoch:    43, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361


</stderr_txt>
]]>