Nameexact_genome_1509704703_30_14846_2
Workunit2359574
Created1 Dec 2017, 15:44:06 UTC
Sent1 Dec 2017, 16:02:21 UTC
Report deadline23 Dec 2017, 21:45:40 UTC
Received2 Dec 2017, 11:20:25 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID67174
Run time7 hours 0 min 22 sec
CPU time7 hours 0 min 22 sec
Validate stateValid
Credit5,559.61
Device peak FLOPS4.03 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.33
Peak working set size163.43 MB
Peak swap size165.12 MB
Peak disk usage2.33 MB

Stderr output

<core_client_version>7.6.31</core_client_version>
<![CDATA[
<stderr_txt>
s, input_fired_time: 0.5071598887, output_fired_time: 0.0000000000, propagate_forward_time: 17.3705272675, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9475975037
validation[          , genome 14846] predictions:    9795/  10000 (97.95%), best:    9843/10000 (98.43%), error:       646.39197, best error:       492.47369 on epoch:    18, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 226.3855743408s, input_fired_time: 4.7136559486, output_fired_time: 3.0130131245, propagate_forward_time: 87.9382019043, propagate_backward_time: 125.1945571899, weight_update_time: 0.3306041956, other_time: 5.5261459351
epoch time: 19.6699142456s, input_fired_time: 0.5035216808, output_fired_time: 0.0000000000, propagate_forward_time: 18.1762447357, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9901485443
validation[          , genome 14846] predictions:    9814/  10000 (98.14%), best:    9843/10000 (98.43%), error:       591.61450, best error:       492.47369 on epoch:    18, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 232.7684173584s, input_fired_time: 4.7876639366, output_fired_time: 3.0593628883, propagate_forward_time: 90.9184036255, propagate_backward_time: 128.5344543457, weight_update_time: 0.3356560469, other_time: 5.4685363770
epoch time: 19.7887134552s, input_fired_time: 0.5064610839, output_fired_time: 0.0000000000, propagate_forward_time: 18.3088417053, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9734115601
validation[          , genome 14846] predictions:    9783/  10000 (97.83%), best:    9843/10000 (98.43%), error:       710.70776, best error:       492.47369 on epoch:    18, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 228.2656402588s, input_fired_time: 4.7250370979, output_fired_time: 3.0161359310, propagate_forward_time: 88.8754043579, propagate_backward_time: 126.1951141357, weight_update_time: 0.3322111368, other_time: 5.4539642334
epoch time: 19.4876689911s, input_fired_time: 0.4950940013, output_fired_time: 0.0000000000, propagate_forward_time: 18.0377998352, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9547748566
validation[          , genome 14846] predictions:    9836/  10000 (98.36%), best:    9843/10000 (98.43%), error:       519.35046, best error:       492.47369 on epoch:    18, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 229.2601776123s, input_fired_time: 4.6551399231, output_fired_time: 3.0357244015, propagate_forward_time: 89.2299194336, propagate_backward_time: 127.0023574829, weight_update_time: 0.3160446882, other_time: 5.3370437622
epoch time: 19.3522815704s, input_fired_time: 0.4906701744, output_fired_time: 0.0000000000, propagate_forward_time: 17.9285030365, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9331092834
validation[          , genome 14846] predictions:    9834/  10000 (98.34%), best:    9843/10000 (98.43%), error:       554.07764, best error:       492.47369 on epoch:    18, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 228.0346069336s, input_fired_time: 4.6447229385, output_fired_time: 3.0101053715, propagate_forward_time: 88.8652267456, propagate_backward_time: 126.2714385986, weight_update_time: 0.3146216273, other_time: 5.2431182861
epoch time: 18.9434070587s, input_fired_time: 0.4854933918, output_fired_time: 0.0000000000, propagate_forward_time: 17.5477828979, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9101314545
validation[          , genome 14846] predictions:    9853/  10000 (98.53%), best:    9853/10000 (98.53%), error:       477.26880, best error:       477.26880 on epoch:    25, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 228.3486938477s, input_fired_time: 4.6549367905, output_fired_time: 3.0177567005, propagate_forward_time: 88.9807128906, propagate_backward_time: 126.4575347900, weight_update_time: 0.3138736486, other_time: 5.2377471924
epoch time: 19.6317825317s, input_fired_time: 0.4926849306, output_fired_time: 0.0000000000, propagate_forward_time: 18.1883602142, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9507369995
validation[          , genome 14846] predictions:    9853/  10000 (98.53%), best:    9853/10000 (98.53%), error:       505.23660, best error:       477.26880 on epoch:    25, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 226.3145294189s, input_fired_time: 4.7714362144, output_fired_time: 3.0146551132, propagate_forward_time: 87.9673309326, propagate_backward_time: 125.0269622803, weight_update_time: 0.3252886534, other_time: 5.5341491699
epoch time: 18.9135017395s, input_fired_time: 0.5158581734, output_fired_time: 0.0000000000, propagate_forward_time: 17.4034786224, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9941654205
validation[          , genome 14846] predictions:    9772/  10000 (97.72%), best:    9853/10000 (98.53%), error:       713.11963, best error:       477.26880 on epoch:    25, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 227.0449218750s, input_fired_time: 4.8362193108, output_fired_time: 3.0187144279, propagate_forward_time: 88.2681503296, propagate_backward_time: 125.2358932495, weight_update_time: 0.3316768706, other_time: 5.6859512329
epoch time: 18.8776664734s, input_fired_time: 0.5160710216, output_fired_time: 0.0000000000, propagate_forward_time: 17.3885364532, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9730587006
validation[          , genome 14846] predictions:    9838/  10000 (98.38%), best:    9853/10000 (98.53%), error:       542.57843, best error:       477.26880 on epoch:    25, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 225.2527618408s, input_fired_time: 4.8344492912, output_fired_time: 2.9979331493, propagate_forward_time: 87.5558090210, propagate_backward_time: 124.1306381226, weight_update_time: 0.3302277923, other_time: 5.7339248657
epoch time: 18.9201641083s, input_fired_time: 0.5157948732, output_fired_time: 0.0000000000, propagate_forward_time: 17.4033489227, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0010204315
validation[          , genome 14846] predictions:    9861/  10000 (98.61%), best:    9861/10000 (98.61%), error:       449.06290, best error:       449.06290 on epoch:    29, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 229.0422668457s, input_fired_time: 4.8122358322, output_fired_time: 3.0387737751, propagate_forward_time: 89.2633819580, propagate_backward_time: 126.3477401733, weight_update_time: 0.3282292485, other_time: 5.5801315308
epoch time: 20.0815773010s, input_fired_time: 0.5199055672, output_fired_time: 0.0000000000, propagate_forward_time: 18.5767154694, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9849567413
validation[          , genome 14846] predictions:    9837/  10000 (98.37%), best:    9861/10000 (98.61%), error:       510.16452, best error:       449.06290 on epoch:    29, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 234.5557861328s, input_fired_time: 4.7924141884, output_fired_time: 3.0822229385, propagate_forward_time: 91.7294921875, propagate_backward_time: 129.4538421631, weight_update_time: 0.3246870339, other_time: 5.4978027344
epoch time: 19.4929847717s, input_fired_time: 0.5247083902, output_fired_time: 0.0000000000, propagate_forward_time: 17.9035682678, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0647087097
validation[          , genome 14846] predictions:    9861/  10000 (98.61%), best:    9861/10000 (98.61%), error:       491.64566, best error:       449.06290 on epoch:    29, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 232.8239898682s, input_fired_time: 4.8841376305, output_fired_time: 3.0835676193, propagate_forward_time: 90.8828887939, propagate_backward_time: 128.1044769287, weight_update_time: 0.3347266316, other_time: 5.8689117432
epoch time: 18.9636478424s, input_fired_time: 0.5113368034, output_fired_time: 0.0000000000, propagate_forward_time: 17.4821701050, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9701404572
validation[          , genome 14846] predictions:    9847/  10000 (98.47%), best:    9861/10000 (98.61%), error:       467.85770, best error:       449.06290 on epoch:    29, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 237.5283966064s, input_fired_time: 4.8581137657, output_fired_time: 3.1163170338, propagate_forward_time: 92.8351364136, propagate_backward_time: 131.1398315430, weight_update_time: 0.3295970261, other_time: 5.5790100098
epoch time: 19.7164859772s, input_fired_time: 0.4996583760, output_fired_time: 0.0000000000, propagate_forward_time: 18.2724647522, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9443626404
validation[          , genome 14846] predictions:    9853/  10000 (98.53%), best:    9861/10000 (98.61%), error:       469.73193, best error:       449.06290 on epoch:    29, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 233.5941925049s, input_fired_time: 4.8385815620, output_fired_time: 3.0829052925, propagate_forward_time: 91.2481613159, propagate_backward_time: 128.8281250000, weight_update_time: 0.3269238174, other_time: 5.5964355469
epoch time: 22.0446300507s, input_fired_time: 0.5604694486, output_fired_time: 0.0000000000, propagate_forward_time: 20.4142913818, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0698699951
validation[          , genome 14846] predictions:    9840/  10000 (98.40%), best:    9861/10000 (98.61%), error:       531.62604, best error:       449.06290 on epoch:    29, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 229.2834472656s, input_fired_time: 4.7816190720, output_fired_time: 3.0226962566, propagate_forward_time: 89.5048141479, propagate_backward_time: 126.5573272705, weight_update_time: 0.3208796382, other_time: 5.4170074463
epoch time: 18.8790378571s, input_fired_time: 0.4909400940, output_fired_time: 0.0000000000, propagate_forward_time: 17.4638824463, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9242153168
validation[          , genome 14846] predictions:    9838/  10000 (98.38%), best:    9861/10000 (98.61%), error:       500.86777, best error:       449.06290 on epoch:    29, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 229.4327392578s, input_fired_time: 4.6997299194, output_fired_time: 3.0200073719, propagate_forward_time: 89.6510696411, propagate_backward_time: 126.6910171509, weight_update_time: 0.3148764968, other_time: 5.3709030151
epoch time: 19.6655502319s, input_fired_time: 0.5010956526, output_fired_time: 0.0000000000, propagate_forward_time: 18.1795310974, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9849243164
validation[          , genome 14846] predictions:    9855/  10000 (98.55%), best:    9861/10000 (98.61%), error:       483.17499, best error:       449.06290 on epoch:    29, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 229.7304534912s, input_fired_time: 4.7023596764, output_fired_time: 3.0389366150, propagate_forward_time: 89.5822677612, propagate_backward_time: 127.0470809937, weight_update_time: 0.3156744242, other_time: 5.3598098755
epoch time: 19.3079853058s, input_fired_time: 0.4972091913, output_fired_time: 0.0000000000, propagate_forward_time: 17.8876781464, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9230976105
validation[          , genome 14846] predictions:    9820/  10000 (98.20%), best:    9861/10000 (98.61%), error:       588.88184, best error:       449.06290 on epoch:    29, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 230.1951904297s, input_fired_time: 4.7080140114, output_fired_time: 3.0386133194, propagate_forward_time: 89.7243423462, propagate_backward_time: 127.4402847290, weight_update_time: 0.3143522143, other_time: 5.2839279175
epoch time: 18.9512023926s, input_fired_time: 0.4866754115, output_fired_time: 0.0000000000, propagate_forward_time: 17.5425643921, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9219627380
validation[          , genome 14846] predictions:    9848/  10000 (98.48%), best:    9861/10000 (98.61%), error:       471.76718, best error:       449.06290 on epoch:    29, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 232.4140167236s, input_fired_time: 4.7731289864, output_fired_time: 3.0435037613, propagate_forward_time: 90.8885879517, propagate_backward_time: 128.2537384033, weight_update_time: 0.3205122948, other_time: 5.4550628662
epoch time: 19.3677692413s, input_fired_time: 0.5037938952, output_fired_time: 0.0000000000, propagate_forward_time: 17.9132022858, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9507732391
validation[          , genome 14846] predictions:    9878/  10000 (98.78%), best:    9878/10000 (98.78%), error:       431.15021, best error:       431.15021 on epoch:    39, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 227.5118865967s, input_fired_time: 4.7075667381, output_fired_time: 3.0029137135, propagate_forward_time: 88.6324310303, propagate_backward_time: 125.8520965576, weight_update_time: 0.3171281517, other_time: 5.3168792725
epoch time: 18.9217643738s, input_fired_time: 0.4911495149, output_fired_time: 0.0000000000, propagate_forward_time: 17.4896240234, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9409904480
validation[          , genome 14846] predictions:    9837/  10000 (98.37%), best:    9878/10000 (98.78%), error:       514.23456, best error:       431.15021 on epoch:    39, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 231.3751678467s, input_fired_time: 4.7280330658, output_fired_time: 3.0610125065, propagate_forward_time: 90.3432388306, propagate_backward_time: 127.8652572632, weight_update_time: 0.3165143430, other_time: 5.3776321411
epoch time: 19.1936206818s, input_fired_time: 0.4908873737, output_fired_time: 0.0000000000, propagate_forward_time: 17.7573184967, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9454154968
validation[          , genome 14846] predictions:    9835/  10000 (98.35%), best:    9878/10000 (98.78%), error:       512.21509, best error:       431.15021 on epoch:    39, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 229.1196136475s, input_fired_time: 4.7026586533, output_fired_time: 3.0353982449, propagate_forward_time: 89.6306381226, propagate_backward_time: 126.4724578857, weight_update_time: 0.3136184812, other_time: 5.2784576416
epoch time: 19.5930976868s, input_fired_time: 0.5013706088, output_fired_time: 0.0000000000, propagate_forward_time: 18.1387214661, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9530048370
validation[          , genome 14846] predictions:    9852/  10000 (98.52%), best:    9878/10000 (98.78%), error:       513.56818, best error:       431.15021 on epoch:    39, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 229.5810699463s, input_fired_time: 4.7567653656, output_fired_time: 3.0264103413, propagate_forward_time: 89.5300292969, propagate_backward_time: 126.9540176392, weight_update_time: 0.3163732290, other_time: 5.3138504028
epoch time: 18.9683399200s, input_fired_time: 0.5195560455, output_fired_time: 0.0000000000, propagate_forward_time: 17.4651260376, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9836578369
validation[          , genome 14846] predictions:    9865/  10000 (98.65%), best:    9878/10000 (98.78%), error:       454.53012, best error:       431.15021 on epoch:    39, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 232.3788604736s, input_fired_time: 4.7784481049, output_fired_time: 3.0728793144, propagate_forward_time: 90.5280456543, propagate_backward_time: 128.4744567871, weight_update_time: 0.3188343048, other_time: 5.5250396729
epoch time: 19.4639186859s, input_fired_time: 0.5074639320, output_fired_time: 0.0000000000, propagate_forward_time: 17.9361000061, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0203552246
validation[          , genome 14846] predictions:    9840/  10000 (98.40%), best:    9878/10000 (98.78%), error:       540.59180, best error:       431.15021 on epoch:    39, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 224.4689331055s, input_fired_time: 4.6643519402, output_fired_time: 2.9809520245, propagate_forward_time: 87.4219207764, propagate_backward_time: 124.1903305054, weight_update_time: 0.3104460835, other_time: 5.2113723755
epoch time: 18.9309158325s, input_fired_time: 0.4953947067, output_fired_time: 0.0000000000, propagate_forward_time: 17.5092296600, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9262905121
validation[          , genome 14846] predictions:    9846/  10000 (98.46%), best:    9878/10000 (98.78%), error:       489.15033, best error:       431.15021 on epoch:    39, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 228.1153717041s, input_fired_time: 4.6860308647, output_fired_time: 3.0305428505, propagate_forward_time: 89.0203933716, propagate_backward_time: 126.1268768311, weight_update_time: 0.3139413297, other_time: 5.2515106201
epoch time: 19.3158760071s, input_fired_time: 0.4875901043, output_fired_time: 0.0000000000, propagate_forward_time: 17.8922481537, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9360370636
validation[          , genome 14846] predictions:    9865/  10000 (98.65%), best:    9865/10000 (98.65%), error:       424.87064, best error:       424.87064 on epoch:    46, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

arguments:
	'../../projects/csgrid.org_csg/exact_client_0.33_x86_64-pc-linux-gnu'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/mnist_training_50k.bin'
boincified validation filename: '../../projects/csgrid.org_csg/mnist_validation_10k.bin'
boincified testing filename: '../../projects/csgrid.org_csg/mnist_testing_new.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1509704703_30_14846.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1509704703_30_14846_2_r1310964024_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.946025
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.00112181
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 4.48724e-05
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 47
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 46
read number_validation_images: 10000
read best_validation_predictions: 9865
read best_validation_error: 424.871
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 14846
read normal distribution: '1 -0.397717475891113 -0.728383421897888'
generator_str: '378397385'
read generator: 378397385
read generated_by_map:
1 crossover 1
reading 68 nodes.
reading 240 edges.
number input nodes: 1
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 4923 images.
reading image set with 5742 images.
reading image set with 4958 images.
reading image set with 5131 images.
reading image set with 4842 images.
reading image set with 4421 images.
reading image set with 4918 images.
reading image set with 5265 images.
reading image set with 4851 images.
reading image set with 4949 images.
image_size: 1x28x28 = 784
read 50000 images.
    class    0: 4923
    class    1: 5742
    class    2: 4958
    class    3: 5131
    class    4: 4842
    class    5: 4421
    class    6: 4918
    class    7: 5265
    class    8: 4851
    class    9: 4949
calculating averages and standard deviations for images
average pixel value for channel 0: 0.130530551075935
pixel variance for channel 0: 0.0948646068572998
pixel standard deviation for channel 0: 0.308000981807709
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 1x28x28 = 784
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 980 images.
reading image set with 1135 images.
reading image set with 1032 images.
reading image set with 1010 images.
reading image set with 982 images.
reading image set with 892 images.
reading image set with 958 images.
reading image set with 1028 images.
reading image set with 974 images.
reading image set with 1009 images.
image_size: 1x28x28 = 784
read 10000 images.
    class    0: 980
    class    1: 1135
    class    2: 1032
    class    3: 1010
    class    4: 982
    class    5: 892
    class    6: 958
    class    7: 1028
    class    8: 974
    class    9: 1009
loaded images
starting backpropagation!
epoch time: 231.158432006836s, input_fired_time: 4.86636161804199, output_fired_time: 3.05862951278687, propagate_forward_time: 89.787971496582, propagate_backward_time: 127.853630065918, weight_update_time: 0.325147807598114, other_time: 5.59183502197266
epoch time: 19.6885967254639s, input_fired_time: 0.504919290542603, output_fired_time: 0, propagate_forward_time: 18.21999168396, propagate_backward_time: 0, weight_update_time: 0, other_time: 0.963685989379883
validation[          , genome 14846] predictions:    9859/  10000 (98.59%), best:    9865/10000 (98.65%), error:       461.47122, best error:       424.87064 on epoch:    46, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 232.3482208252s, input_fired_time: 4.7955589294, output_fired_time: 3.0496368408, propagate_forward_time: 90.9051132202, propagate_backward_time: 128.0264892578, weight_update_time: 0.3179932535, other_time: 5.5714111328
epoch time: 19.2475700378s, input_fired_time: 0.4958611727, output_fired_time: 0.0000000000, propagate_forward_time: 17.7767257690, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9749832153
validation[          , genome 14846] predictions:    9874/  10000 (98.74%), best:    9874/10000 (98.74%), error:       420.72339, best error:       420.72339 on epoch:    48, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 228.0684051514s, input_fired_time: 4.7327494621, output_fired_time: 3.0116536617, propagate_forward_time: 88.9234390259, propagate_backward_time: 126.0818328857, weight_update_time: 0.3134401441, other_time: 5.3187408447
epoch time: 19.5947399139s, input_fired_time: 0.5105997324, output_fired_time: 0.0000000000, propagate_forward_time: 18.1168727875, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9672679901
validation[          , genome 14846] predictions:    9836/  10000 (98.36%), best:    9874/10000 (98.74%), error:       522.30859, best error:       420.72339 on epoch:    48, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 228.1314544678s, input_fired_time: 4.7644252777, output_fired_time: 3.0140624046, propagate_forward_time: 88.8857574463, propagate_backward_time: 126.0975112915, weight_update_time: 0.3165128231, other_time: 5.3696975708
epoch time: 20.2344837189s, input_fired_time: 0.5148851871, output_fired_time: 0.0000000000, propagate_forward_time: 18.7580471039, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9615516663
validation[          , genome 14846] predictions:    9878/  10000 (98.78%), best:    9878/10000 (98.78%), error:       401.16068, best error:       401.16068 on epoch:    50, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 237.7974853516s, input_fired_time: 4.8561067581, output_fired_time: 3.1099207401, propagate_forward_time: 93.1413497925, propagate_backward_time: 131.0883941650, weight_update_time: 0.3244386613, other_time: 5.6016998291
epoch time: 19.1892585754s, input_fired_time: 0.4912159741, output_fired_time: 0.0000000000, propagate_forward_time: 17.7814655304, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9165763855
validation[          , genome 14846] predictions:    9877/  10000 (98.77%), best:    9878/10000 (98.78%), error:       421.59756, best error:       401.16068 on epoch:    50, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 237.1836090088s, input_fired_time: 4.8414921761, output_fired_time: 3.1106364727, propagate_forward_time: 92.8082733154, propagate_backward_time: 130.9712066650, weight_update_time: 0.3253116012, other_time: 5.4519958496
epoch time: 20.3616561890s, input_fired_time: 0.5362084508, output_fired_time: 0.0000000000, propagate_forward_time: 18.8002948761, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0251522064
validation[          , genome 14846] predictions:    9860/  10000 (98.60%), best:    9878/10000 (98.78%), error:       456.42279, best error:       401.16068 on epoch:    50, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 250.4078521729s, input_fired_time: 5.0160312653, output_fired_time: 3.2564032078, propagate_forward_time: 98.5875701904, propagate_backward_time: 137.7123565674, weight_update_time: 0.3385489583, other_time: 5.8354797363
epoch time: 18.8823108673s, input_fired_time: 0.4872559607, output_fired_time: 0.0000000000, propagate_forward_time: 17.4498786926, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9451770782
validation[          , genome 14846] predictions:    9851/  10000 (98.51%), best:    9878/10000 (98.78%), error:       543.69312, best error:       401.16068 on epoch:    50, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 229.8157806396s, input_fired_time: 4.6979131699, output_fired_time: 3.0293068886, propagate_forward_time: 89.7873229980, propagate_backward_time: 127.0981063843, weight_update_time: 0.3120267987, other_time: 5.2031326294
epoch time: 19.4853153229s, input_fired_time: 0.4957388937, output_fired_time: 0.0000000000, propagate_forward_time: 18.0558395386, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9337368011
validation[          , genome 14846] predictions:    9859/  10000 (98.59%), best:    9878/10000 (98.78%), error:       489.89532, best error:       401.16068 on epoch:    50, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 228.0019073486s, input_fired_time: 4.6834311485, output_fired_time: 3.0056912899, propagate_forward_time: 89.1739349365, propagate_backward_time: 125.9190292358, weight_update_time: 0.3117825687, other_time: 5.2198257446
epoch time: 18.9205150604s, input_fired_time: 0.4901476204, output_fired_time: 0.0000000000, propagate_forward_time: 17.5018806458, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9284858704
validation[          , genome 14846] predictions:    9873/  10000 (98.73%), best:    9878/10000 (98.78%), error:       417.02359, best error:       401.16068 on epoch:    50, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 228.7718200684s, input_fired_time: 4.7120814323, output_fired_time: 3.0118808746, propagate_forward_time: 89.4193801880, propagate_backward_time: 126.3524780273, weight_update_time: 0.3114166558, other_time: 5.2760009766
epoch time: 18.8650665283s, input_fired_time: 0.4931980968, output_fired_time: 0.0000000000, propagate_forward_time: 17.4648170471, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9070510864
validation[          , genome 14846] predictions:    9848/  10000 (98.48%), best:    9878/10000 (98.78%), error:       505.40900, best error:       401.16068 on epoch:    50, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 227.8316345215s, input_fired_time: 4.6849274635, output_fired_time: 3.0029199123, propagate_forward_time: 88.9014434814, propagate_backward_time: 126.1009521484, weight_update_time: 0.3105386496, other_time: 5.1414031982
epoch time: 19.1895446777s, input_fired_time: 0.4938332140, output_fired_time: 0.0000000000, propagate_forward_time: 17.7757663727, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9199447632
validation[          , genome 14846] predictions:    9876/  10000 (98.76%), best:    9878/10000 (98.78%), error:       404.77185, best error:       401.16068 on epoch:    50, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 228.7635498047s, input_fired_time: 4.6961302757, output_fired_time: 3.0118103027, propagate_forward_time: 89.4060134888, propagate_backward_time: 126.3898468018, weight_update_time: 0.3129115701, other_time: 5.2597503662
epoch time: 20.4116191864s, input_fired_time: 0.5134151578, output_fired_time: 0.0000000000, propagate_forward_time: 18.8839530945, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0142517090
validation[          , genome 14846] predictions:    9853/  10000 (98.53%), best:    9878/10000 (98.78%), error:       464.21811, best error:       401.16068 on epoch:    50, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 230.2238159180s, input_fired_time: 4.6818389893, output_fired_time: 3.0141191483, propagate_forward_time: 89.9939651489, propagate_backward_time: 127.2960891724, weight_update_time: 0.3152125776, other_time: 5.2378158569
epoch time: 19.3805313110s, input_fired_time: 0.4904364645, output_fired_time: 0.0000000000, propagate_forward_time: 17.9802722931, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9098224640
validation[          , genome 14846] predictions:    9882/  10000 (98.82%), best:    9878/10000 (98.78%), error:       412.99078, best error:       401.16068 on epoch:    50, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 231.7224273682s, input_fired_time: 4.7104969025, output_fired_time: 3.0446565151, propagate_forward_time: 90.9028778076, propagate_backward_time: 127.8533782959, weight_update_time: 0.3141920865, other_time: 5.2110137939
epoch time: 19.5412921906s, input_fired_time: 0.4968017936, output_fired_time: 0.0000000000, propagate_forward_time: 18.1128692627, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9316215515
validation[          , genome 14846] predictions:    9858/  10000 (98.58%), best:    9878/10000 (98.78%), error:       490.21518, best error:       401.16068 on epoch:    50, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 228.9885864258s, input_fired_time: 4.6849031448, output_fired_time: 3.0127828121, propagate_forward_time: 89.5957946777, propagate_backward_time: 126.5010528564, weight_update_time: 0.3124437928, other_time: 5.1940460205
epoch time: 19.1944713593s, input_fired_time: 0.4874196649, output_fired_time: 0.0000000000, propagate_forward_time: 17.7974033356, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9096488953
validation[          , genome 14846] predictions:    9855/  10000 (98.55%), best:    9878/10000 (98.78%), error:       454.55402, best error:       401.16068 on epoch:    50, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 230.3773956299s, input_fired_time: 4.6915435791, output_fired_time: 3.0337011814, propagate_forward_time: 89.8883438110, propagate_backward_time: 127.6048583984, weight_update_time: 0.3131855130, other_time: 5.1589355469
epoch time: 19.7858581543s, input_fired_time: 0.5014094114, output_fired_time: 0.0000000000, propagate_forward_time: 18.3662471771, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9182014465
validation[          , genome 14846] predictions:    9871/  10000 (98.71%), best:    9878/10000 (98.78%), error:       446.70236, best error:       401.16068 on epoch:    50, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 231.9903564453s, input_fired_time: 4.7194986343, output_fired_time: 3.0524706841, propagate_forward_time: 90.7532119751, propagate_backward_time: 128.2280578613, weight_update_time: 0.3151670992, other_time: 5.2371215820
epoch time: 19.1335468292s, input_fired_time: 0.4913868904, output_fired_time: 0.0000000000, propagate_forward_time: 17.7144622803, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9276981354
validation[          , genome 14846] predictions:    9863/  10000 (98.63%), best:    9878/10000 (98.78%), error:       441.98535, best error:       401.16068 on epoch:    50, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 229.0516815186s, input_fired_time: 4.7097029686, output_fired_time: 3.0363976955, propagate_forward_time: 89.5587310791, propagate_backward_time: 126.5404891968, weight_update_time: 0.3115390241, other_time: 5.2063674927
epoch time: 18.9716243744s, input_fired_time: 0.4875661433, output_fired_time: 0.0000000000, propagate_forward_time: 17.5725517273, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9115066528
validation[          , genome 14846] predictions:    9877/  10000 (98.77%), best:    9877/10000 (98.77%), error:       392.51358, best error:       392.51358 on epoch:    64, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 224.6325378418s, input_fired_time: 4.6469225883, output_fired_time: 2.9818232059, propagate_forward_time: 87.6239318848, propagate_backward_time: 124.2390518188, weight_update_time: 0.3084832430, other_time: 5.1408004761
epoch time: 18.8229179382s, input_fired_time: 0.4846369922, output_fired_time: 0.0000000000, propagate_forward_time: 17.4198799133, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9184017181
validation[          , genome 14846] predictions:    9850/  10000 (98.50%), best:    9877/10000 (98.77%), error:       441.75278, best error:       392.51358 on epoch:    64, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 228.1274871826s, input_fired_time: 4.6774454117, output_fired_time: 3.0057973862, propagate_forward_time: 89.0515060425, propagate_backward_time: 126.1966171265, weight_update_time: 0.3114828467, other_time: 5.1961135864
epoch time: 19.1779098511s, input_fired_time: 0.4848924875, output_fired_time: 0.0000000000, propagate_forward_time: 17.7840404510, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9089775085
validation[          , genome 14846] predictions:    9880/  10000 (98.80%), best:    9877/10000 (98.77%), error:       395.92245, best error:       392.51358 on epoch:    64, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 226.3736114502s, input_fired_time: 4.7367162704, output_fired_time: 3.0114476681, propagate_forward_time: 88.4285430908, propagate_backward_time: 124.8746566772, weight_update_time: 0.3164836168, other_time: 5.3222579956
epoch time: 18.9352188110s, input_fired_time: 0.5216698647, output_fired_time: 0.0000000000, propagate_forward_time: 17.4353713989, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9781780243
validation[          , genome 14846] predictions:    9879/  10000 (98.79%), best:    9877/10000 (98.77%), error:       401.70093, best error:       392.51358 on epoch:    64, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 225.2279052734s, input_fired_time: 4.8596954346, output_fired_time: 3.0063993931, propagate_forward_time: 87.7717361450, propagate_backward_time: 123.9300460815, weight_update_time: 0.3282934129, other_time: 5.6600418091
epoch time: 18.8986358643s, input_fired_time: 0.5204141736, output_fired_time: 0.0000000000, propagate_forward_time: 17.3703441620, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0078773499
validation[          , genome 14846] predictions:    9871/  10000 (98.71%), best:    9877/10000 (98.77%), error:       419.10919, best error:       392.51358 on epoch:    64, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 227.3335876465s, input_fired_time: 4.8639426231, output_fired_time: 3.0275804996, propagate_forward_time: 88.6758651733, propagate_backward_time: 125.0747070312, weight_update_time: 0.3286710083, other_time: 5.6914978027
epoch time: 18.8625869751s, input_fired_time: 0.5158413649, output_fired_time: 0.0000000000, propagate_forward_time: 17.3719348907, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9748115540
validation[          , genome 14846] predictions:    9878/  10000 (98.78%), best:    9877/10000 (98.77%), error:       411.01605, best error:       392.51358 on epoch:    64, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 234.3471221924s, input_fired_time: 4.9144320488, output_fired_time: 3.1026120186, propagate_forward_time: 91.7021408081, propagate_backward_time: 128.9495544434, weight_update_time: 0.3328120410, other_time: 5.6783752441
epoch time: 19.2706050873s, input_fired_time: 0.5148792863, output_fired_time: 0.0000000000, propagate_forward_time: 17.7925662994, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9631595612
validation[          , genome 14846] predictions:    9874/  10000 (98.74%), best:    9877/10000 (98.77%), error:       418.28171, best error:       392.51358 on epoch:    64, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 234.1945190430s, input_fired_time: 4.8433027267, output_fired_time: 3.0859718323, propagate_forward_time: 91.7430801392, propagate_backward_time: 128.8843994141, weight_update_time: 0.3209033906, other_time: 5.6377563477
epoch time: 18.9700641632s, input_fired_time: 0.4915650785, output_fired_time: 0.0000000000, propagate_forward_time: 17.4756240845, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0028743744
validation[          , genome 14846] predictions:    9878/  10000 (98.78%), best:    9877/10000 (98.77%), error:       417.56842, best error:       392.51358 on epoch:    64, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 237.3125152588s, input_fired_time: 4.8171749115, output_fired_time: 3.1040186882, propagate_forward_time: 93.1998138428, propagate_backward_time: 130.6360321045, weight_update_time: 0.3196593523, other_time: 5.5554809570
epoch time: 18.7828273773s, input_fired_time: 0.4894953668, output_fired_time: 0.0000000000, propagate_forward_time: 17.3779506683, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9153804779
validation[          , genome 14846] predictions:    9875/  10000 (98.75%), best:    9877/10000 (98.77%), error:       405.14133, best error:       392.51358 on epoch:    64, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 230.3131866455s, input_fired_time: 4.7305393219, output_fired_time: 3.0339689255, propagate_forward_time: 90.2884292603, propagate_backward_time: 127.0097503662, weight_update_time: 0.3135882318, other_time: 5.2505035400
epoch time: 19.4312152863s, input_fired_time: 0.5033074021, output_fired_time: 0.0000000000, propagate_forward_time: 17.9868354797, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9410724640
validation[          , genome 14846] predictions:    9876/  10000 (98.76%), best:    9877/10000 (98.77%), error:       393.63562, best error:       392.51358 on epoch:    64, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 227.7537994385s, input_fired_time: 4.6965222359, output_fired_time: 3.0016887188, propagate_forward_time: 89.3074264526, propagate_backward_time: 125.4738388062, weight_update_time: 0.3109782040, other_time: 5.2743301392
epoch time: 19.0298137665s, input_fired_time: 0.4915331304, output_fired_time: 0.0000000000, propagate_forward_time: 17.6218814850, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9163990021
validation[          , genome 14846] predictions:    9871/  10000 (98.71%), best:    9877/10000 (98.77%), error:       407.59424, best error:       392.51358 on epoch:    64, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 229.6625976562s, input_fired_time: 4.7359523773, output_fired_time: 3.0216045380, propagate_forward_time: 90.2925720215, propagate_backward_time: 126.3762969971, weight_update_time: 0.3123296201, other_time: 5.2361755371
epoch time: 18.9532012939s, input_fired_time: 0.4935831428, output_fired_time: 0.0000000000, propagate_forward_time: 17.5406074524, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9190101624
validation[          , genome 14846] predictions:    9882/  10000 (98.82%), best:    9877/10000 (98.77%), error:       400.77374, best error:       392.51358 on epoch:    64, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 230.2127685547s, input_fired_time: 4.7362556458, output_fired_time: 3.0363025665, propagate_forward_time: 90.3429489136, propagate_backward_time: 126.8364028931, weight_update_time: 0.3116062880, other_time: 5.2608566284
epoch time: 19.0988731384s, input_fired_time: 0.4969983399, output_fired_time: 0.0000000000, propagate_forward_time: 17.6546421051, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9472332001
validation[          , genome 14846] predictions:    9883/  10000 (98.83%), best:    9883/10000 (98.83%), error:       391.45230, best error:       391.45230 on epoch:    76, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 228.8154754639s, input_fired_time: 4.7119040489, output_fired_time: 3.0135626793, propagate_forward_time: 89.5440521240, propagate_backward_time: 126.2357025146, weight_update_time: 0.3121841252, other_time: 5.3102569580
epoch time: 18.7401676178s, input_fired_time: 0.4823742509, output_fired_time: 0.0000000000, propagate_forward_time: 17.3623256683, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8954677582
validation[          , genome 14846] predictions:    9878/  10000 (98.78%), best:    9883/10000 (98.83%), error:       430.08954, best error:       391.45230 on epoch:    76, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 224.9194030762s, input_fired_time: 4.6705927849, output_fired_time: 2.9706647396, propagate_forward_time: 87.9776000977, propagate_backward_time: 124.1321792603, weight_update_time: 0.3088116646, other_time: 5.1683731079
epoch time: 19.2502593994s, input_fired_time: 0.4968004525, output_fired_time: 0.0000000000, propagate_forward_time: 17.8331432343, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9203147888
validation[          , genome 14846] predictions:    9872/  10000 (98.72%), best:    9883/10000 (98.83%), error:       401.71661, best error:       391.45230 on epoch:    76, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 232.2033996582s, input_fired_time: 4.7631287575, output_fired_time: 3.0500068665, propagate_forward_time: 91.3217544556, propagate_backward_time: 127.7417449951, weight_update_time: 0.3141769767, other_time: 5.3267669678
epoch time: 20.3155784607s, input_fired_time: 0.5172217488, output_fired_time: 0.0000000000, propagate_forward_time: 18.8212680817, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9770889282
validation[          , genome 14846] predictions:    9878/  10000 (98.78%), best:    9883/10000 (98.83%), error:       405.65768, best error:       391.45230 on epoch:    76, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 227.1905212402s, input_fired_time: 4.6849942207, output_fired_time: 2.9945068359, propagate_forward_time: 88.8057861328, propagate_backward_time: 125.5080413818, weight_update_time: 0.3105615973, other_time: 5.1971893311
epoch time: 18.8833580017s, input_fired_time: 0.4873721302, output_fired_time: 0.0000000000, propagate_forward_time: 17.4881076813, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9078788757
validation[          , genome 14846] predictions:    9881/  10000 (98.81%), best:    9883/10000 (98.83%), error:       409.97379, best error:       391.45230 on epoch:    76, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 224.9800567627s, input_fired_time: 4.6633687019, output_fired_time: 2.9665529728, propagate_forward_time: 87.9701080322, propagate_backward_time: 124.2273178101, weight_update_time: 0.3089030981, other_time: 5.1527023315
epoch time: 19.0254135132s, input_fired_time: 0.4940877855, output_fired_time: 0.0000000000, propagate_forward_time: 17.6115036011, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9198226929
validation[          , genome 14846] predictions:    9867/  10000 (98.67%), best:    9883/10000 (98.83%), error:       456.82376, best error:       391.45230 on epoch:    76, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 223.3407440186s, input_fired_time: 4.6443309784, output_fired_time: 2.9458799362, propagate_forward_time: 87.2157745361, propagate_backward_time: 123.3390579224, weight_update_time: 0.3073855042, other_time: 5.1957015991
epoch time: 18.7389488220s, input_fired_time: 0.4862933457, output_fired_time: 0.0000000000, propagate_forward_time: 17.3498458862, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9028091431
validation[          , genome 14846] predictions:    9874/  10000 (98.74%), best:    9883/10000 (98.83%), error:       423.60620, best error:       391.45230 on epoch:    76, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 223.5190124512s, input_fired_time: 4.6463508606, output_fired_time: 2.9552152157, propagate_forward_time: 87.3314666748, propagate_backward_time: 123.4883880615, weight_update_time: 0.3068318963, other_time: 5.0975952148
epoch time: 18.7730236053s, input_fired_time: 0.4853959978, output_fired_time: 0.0000000000, propagate_forward_time: 17.3909854889, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8966426849
validation[          , genome 14846] predictions:    9878/  10000 (98.78%), best:    9883/10000 (98.83%), error:       411.42844, best error:       391.45230 on epoch:    76, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 225.2308349609s, input_fired_time: 4.6767206192, output_fired_time: 2.9795043468, propagate_forward_time: 87.9915924072, propagate_backward_time: 124.4303970337, weight_update_time: 0.3088906705, other_time: 5.1526107788
epoch time: 18.7477035522s, input_fired_time: 0.4852429330, output_fired_time: 0.0000000000, propagate_forward_time: 17.3509597778, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9115009308
validation[          , genome 14846] predictions:    9883/  10000 (98.83%), best:    9883/10000 (98.83%), error:       401.70969, best error:       391.45230 on epoch:    76, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 223.9806671143s, input_fired_time: 4.6693544388, output_fired_time: 2.9584181309, propagate_forward_time: 87.6070327759, propagate_backward_time: 123.5847244263, weight_update_time: 0.3075667024, other_time: 5.1611251831
epoch time: 18.9099693298s, input_fired_time: 0.4947350323, output_fired_time: 0.0000000000, propagate_forward_time: 17.4959087372, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9193248749
validation[          , genome 14846] predictions:    9877/  10000 (98.77%), best:    9883/10000 (98.83%), error:       415.91885, best error:       391.45230 on epoch:    76, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 224.8703460693s, input_fired_time: 4.6743187904, output_fired_time: 2.9744884968, propagate_forward_time: 87.9021682739, propagate_backward_time: 124.1867446899, weight_update_time: 0.3081971109, other_time: 5.1326217651
epoch time: 18.7347755432s, input_fired_time: 0.4879412949, output_fired_time: 0.0000000000, propagate_forward_time: 17.3449325562, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9019012451
validation[          , genome 14846] predictions:    9882/  10000 (98.82%), best:    9883/10000 (98.83%), error:       395.33234, best error:       391.45230 on epoch:    76, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 222.8180847168s, input_fired_time: 4.6328525543, output_fired_time: 2.9499261379, propagate_forward_time: 87.0235519409, propagate_backward_time: 123.0524139404, weight_update_time: 0.3063400388, other_time: 5.1593475342
epoch time: 18.7900066376s, input_fired_time: 0.4865332246, output_fired_time: 0.0000000000, propagate_forward_time: 17.3766098022, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9268627167
validation[          , genome 14846] predictions:    9867/  10000 (98.67%), best:    9883/10000 (98.83%), error:       408.38177, best error:       391.45230 on epoch:    76, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 223.5545654297s, input_fired_time: 4.6393852234, output_fired_time: 2.9552412033, propagate_forward_time: 87.3460235596, propagate_backward_time: 123.4979476929, weight_update_time: 0.3068493903, other_time: 5.1159591675
epoch time: 18.7885017395s, input_fired_time: 0.4869806767, output_fired_time: 0.0000000000, propagate_forward_time: 17.3950290680, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9064922333
validation[          , genome 14846] predictions:    9882/  10000 (98.82%), best:    9883/10000 (98.83%), error:       410.66721, best error:       391.45230 on epoch:    76, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 223.7564239502s, input_fired_time: 4.6485781670, output_fired_time: 2.9583642483, propagate_forward_time: 87.4155349731, propagate_backward_time: 123.6035385132, weight_update_time: 0.3074702919, other_time: 5.1304092407
epoch time: 18.7748470306s, input_fired_time: 0.4880590141, output_fired_time: 0.0000000000, propagate_forward_time: 17.3650093079, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9217796326
validation[          , genome 14846] predictions:    9879/  10000 (98.79%), best:    9883/10000 (98.83%), error:       411.20126, best error:       391.45230 on epoch:    76, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 224.9810638428s, input_fired_time: 4.6853771210, output_fired_time: 2.9742727280, propagate_forward_time: 87.9350509644, propagate_backward_time: 124.1813201904, weight_update_time: 0.3088643253, other_time: 5.2050323486
epoch time: 19.1632118225s, input_fired_time: 0.4987097979, output_fired_time: 0.0000000000, propagate_forward_time: 17.7329330444, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9315681458
validation[          , genome 14846] predictions:    9875/  10000 (98.75%), best:    9883/10000 (98.83%), error:       398.67068, best error:       391.45230 on epoch:    76, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 225.1763000488s, input_fired_time: 4.6880240440, output_fired_time: 2.9709510803, propagate_forward_time: 88.1986846924, propagate_backward_time: 124.1750869751, weight_update_time: 0.3086636364, other_time: 5.1435623169
epoch time: 18.7959671021s, input_fired_time: 0.4909652174, output_fired_time: 0.0000000000, propagate_forward_time: 17.3957080841, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9092941284
validation[          , genome 14846] predictions:    9877/  10000 (98.77%), best:    9883/10000 (98.83%), error:       398.00476, best error:       391.45230 on epoch:    76, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 224.1984710693s, input_fired_time: 4.6683049202, output_fired_time: 2.9630751610, propagate_forward_time: 87.6547317505, propagate_backward_time: 123.7094879150, weight_update_time: 0.3078926206, other_time: 5.2028656006
epoch time: 18.8245296478s, input_fired_time: 0.4829571545, output_fired_time: 0.0000000000, propagate_forward_time: 17.4155750275, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9259967804
validation[          , genome 14846] predictions:    9881/  10000 (98.81%), best:    9883/10000 (98.83%), error:       411.59869, best error:       391.45230 on epoch:    76, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 223.8678741455s, input_fired_time: 4.6561088562, output_fired_time: 2.9567587376, propagate_forward_time: 87.4078979492, propagate_backward_time: 123.6477355957, weight_update_time: 0.3082299829, other_time: 5.1993713379
epoch time: 18.7394351959s, input_fired_time: 0.4846327901, output_fired_time: 0.0000000000, propagate_forward_time: 17.3515300751, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9032726288
validation[          , genome 14846] predictions:    9875/  10000 (98.75%), best:    9883/10000 (98.83%), error:       396.02921, best error:       391.45230 on epoch:    76, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 222.9966888428s, input_fired_time: 4.6606621742, output_fired_time: 2.9479341507, propagate_forward_time: 87.0639877319, propagate_backward_time: 123.2052078247, weight_update_time: 0.3082548976, other_time: 5.1188888550
epoch time: 19.1109848022s, input_fired_time: 0.4935762584, output_fired_time: 0.0000000000, propagate_forward_time: 17.7087421417, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9086666107
validation[          , genome 14846] predictions:    9870/  10000 (98.70%), best:    9883/10000 (98.83%), error:       430.05002, best error:       391.45230 on epoch:    76, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 223.0357818604s, input_fired_time: 4.6668796539, output_fired_time: 2.9465134144, propagate_forward_time: 87.1731796265, propagate_backward_time: 123.0711288452, weight_update_time: 0.3080431521, other_time: 5.1780776978
epoch time: 18.9650249481s, input_fired_time: 0.4920778573, output_fired_time: 0.0000000000, propagate_forward_time: 17.5430469513, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9298992157
validation[          , genome 14846] predictions:    9878/  10000 (98.78%), best:    9883/10000 (98.83%), error:       407.40591, best error:       391.45230 on epoch:    76, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 223.6185150146s, input_fired_time: 4.6772890091, output_fired_time: 2.9602823257, propagate_forward_time: 87.2300796509, propagate_backward_time: 123.5687332153, weight_update_time: 0.3083629012, other_time: 5.1821212769
epoch time: 19.0039634705s, input_fired_time: 0.4981580675, output_fired_time: 0.0000000000, propagate_forward_time: 17.5755748749, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9302310944
validation[          , genome 14846] predictions:    9880/  10000 (98.80%), best:    9883/10000 (98.83%), error:       394.47427, best error:       391.45230 on epoch:    76, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 227.2569732666s, input_fired_time: 4.7217378616, output_fired_time: 3.0105288029, propagate_forward_time: 88.8840179443, propagate_backward_time: 125.3942337036, weight_update_time: 0.3117572665, other_time: 5.2464523315
epoch time: 18.8618316650s, input_fired_time: 0.4931333661, output_fired_time: 0.0000000000, propagate_forward_time: 17.4346752167, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9340229034
validation[          , genome 14846] predictions:    9881/  10000 (98.81%), best:    9883/10000 (98.83%), error:       411.03442, best error:       391.45230 on epoch:    76, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 225.1198730469s, input_fired_time: 4.7007899284, output_fired_time: 2.9721021652, propagate_forward_time: 87.9684371948, propagate_backward_time: 124.2218322754, weight_update_time: 0.3101798892, other_time: 5.2567138672
epoch time: 18.8233814240s, input_fired_time: 0.4937912226, output_fired_time: 0.0000000000, propagate_forward_time: 17.4032878876, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9263019562
validation[          , genome 14846] predictions:    9870/  10000 (98.70%), best:    9883/10000 (98.83%), error:       429.47250, best error:       391.45230 on epoch:    76, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 225.1137084961s, input_fired_time: 4.7029786110, output_fired_time: 2.9722924232, propagate_forward_time: 88.0832901001, propagate_backward_time: 124.1457290649, weight_update_time: 0.3104702234, other_time: 5.2094345093
epoch time: 18.8242359161s, input_fired_time: 0.4938936234, output_fired_time: 0.0000000000, propagate_forward_time: 17.4129467010, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9173946381
validation[          , genome 14846] predictions:    9878/  10000 (98.78%), best:    9883/10000 (98.83%), error:       411.13562, best error:       391.45230 on epoch:    76, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 225.8558349609s, input_fired_time: 4.7186541557, output_fired_time: 2.9819014072, propagate_forward_time: 88.3596343994, propagate_backward_time: 124.5722961426, weight_update_time: 0.3102111518, other_time: 5.2233428955
epoch time: 19.1946868896s, input_fired_time: 0.4965812564, output_fired_time: 0.0000000000, propagate_forward_time: 17.7628421783, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9352626801
validation[          , genome 14846] predictions:    9877/  10000 (98.77%), best:    9883/10000 (98.83%), error:       414.39755, best error:       391.45230 on epoch:    76, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 94.6611328125s, input_fired_time: 2.4800817966, output_fired_time: 0.0000000000, propagate_forward_time: 87.5097427368, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.6713104248
best training[          , genome 14846] predictions:   49993/  50000 (99.99%), best:    9883/10000 (98.83%), error:       180.46933, best error:       391.45230 on epoch:    76, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 18.7746162415s, input_fired_time: 0.4853655398, output_fired_time: 0.0000000000, propagate_forward_time: 17.3580055237, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9312458038
   testing[          , genome 14846] predictions:    9894/  10000 (98.94%), best:    9883/10000 (98.83%), error:       338.84134, best error:       391.45230 on epoch:    76, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
11:14:06 (19859): called boinc_finish(0)

</stderr_txt>
]]>