Nameexact_genome_1512568488_45_2876_1
Workunit2585603
Created7 Dec 2017, 1:58:23 UTC
Sent7 Dec 2017, 1:58:54 UTC
Report deadline10 Dec 2017, 18:14:39 UTC
Received7 Dec 2017, 23:46:34 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID65413
Run time1 hours 32 min 10 sec
CPU time1 hours 32 min 10 sec
Validate stateValid
Credit919.40
Device peak FLOPS3.73 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.33
Peak working set size150.27 MB
Peak swap size151.10 MB
Peak disk usage1.06 MB

Stderr output

<core_client_version>7.6.31</core_client_version>
<![CDATA[
<stderr_txt>
, epoch:   13/100, mu: 0.7384625077, learning_rate: 0.0064167744, weight_decay: 0.0002566710

epoch time: 54.9496421814s, input_fired_time: 0.4652892947, output_fired_time: 0.3191228211, propagate_forward_time: 22.1845417023, propagate_backward_time: 30.1542053223, weight_update_time: 0.0902018473, other_time: 1.8264827728
epoch time: 4.4157214165s, input_fired_time: 0.0496836826, output_fired_time: 0.0000000000, propagate_forward_time: 4.0689516068, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2970862389
validation[          , genome  2876] predictions:    9552/  10000 (95.52%), best:    9577/10000 (95.77%), error:      1507.08838, best error:      1476.54138 on epoch:    12, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 58.3676452637s, input_fired_time: 0.4817575216, output_fired_time: 0.3356831968, propagate_forward_time: 23.6536445618, propagate_backward_time: 31.9703769684, weight_update_time: 0.0943392664, other_time: 1.9261837006
epoch time: 4.6688404083s, input_fired_time: 0.0512185097, output_fired_time: 0.0000000000, propagate_forward_time: 4.3111786842, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3064432144
validation[          , genome  2876] predictions:    9503/  10000 (95.03%), best:    9577/10000 (95.77%), error:      1654.70251, best error:      1476.54138 on epoch:    12, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 59.6873397827s, input_fired_time: 0.4876335561, output_fired_time: 0.3424511850, propagate_forward_time: 24.2040214539, propagate_backward_time: 32.6975746155, weight_update_time: 0.0960979313, other_time: 1.9556579590
epoch time: 3.8436779976s, input_fired_time: 0.0624897964, output_fired_time: 0.0000000000, propagate_forward_time: 3.5197443962, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2614438534
validation[          , genome  2876] predictions:    9535/  10000 (95.35%), best:    9577/10000 (95.77%), error:      1612.44861, best error:      1476.54138 on epoch:    12, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 46.2053146362s, input_fired_time: 0.4143608510, output_fired_time: 0.2760532200, propagate_forward_time: 18.6574516296, propagate_backward_time: 25.2746734619, weight_update_time: 0.0756504908, other_time: 1.5827751160
epoch time: 5.6543259621s, input_fired_time: 0.0590346232, output_fired_time: 0.0000000000, propagate_forward_time: 5.2313017845, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3639893532
validation[          , genome  2876] predictions:    9544/  10000 (95.44%), best:    9577/10000 (95.77%), error:      1538.00244, best error:      1476.54138 on epoch:    12, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 47.0927200317s, input_fired_time: 0.4221357107, output_fired_time: 0.2808717489, propagate_forward_time: 18.9630985260, propagate_backward_time: 25.8117389679, weight_update_time: 0.0771427602, other_time: 1.6148757935
epoch time: 3.7674145699s, input_fired_time: 0.0420653969, output_fired_time: 0.0000000000, propagate_forward_time: 3.4679107666, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2574384212
validation[          , genome  2876] predictions:    9527/  10000 (95.27%), best:    9577/10000 (95.77%), error:      1579.00281, best error:      1476.54138 on epoch:    12, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 48.2599983215s, input_fired_time: 0.4270674884, output_fired_time: 0.2898414433, propagate_forward_time: 19.4665107727, propagate_backward_time: 26.4281578064, weight_update_time: 0.0787336826, other_time: 1.6484222412
epoch time: 3.7903869152s, input_fired_time: 0.0430462696, output_fired_time: 0.0000000000, propagate_forward_time: 3.4882872105, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2590534687
validation[          , genome  2876] predictions:    9525/  10000 (95.25%), best:    9577/10000 (95.77%), error:      1574.43958, best error:      1476.54138 on epoch:    12, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 46.0265960693s, input_fired_time: 0.4165789187, output_fired_time: 0.2760389149, propagate_forward_time: 18.5393486023, propagate_backward_time: 25.2161560059, weight_update_time: 0.0753399059, other_time: 1.5784721375
epoch time: 4.0213761330s, input_fired_time: 0.0458333530, output_fired_time: 0.0000000000, propagate_forward_time: 3.7014720440, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2740707397
validation[          , genome  2876] predictions:    9574/  10000 (95.74%), best:    9574/10000 (95.74%), error:      1431.68616, best error:      1431.68616 on epoch:    20, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 54.8645820618s, input_fired_time: 0.4617146552, output_fired_time: 0.3194302917, propagate_forward_time: 22.1830253601, propagate_backward_time: 30.0765781403, weight_update_time: 0.0885915905, other_time: 1.8238315582
epoch time: 3.9382426739s, input_fired_time: 0.0442101210, output_fired_time: 0.0000000000, propagate_forward_time: 3.6248190403, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2692134380
validation[          , genome  2876] predictions:    9577/  10000 (95.77%), best:    9574/10000 (95.74%), error:      1472.99854, best error:      1431.68616 on epoch:    20, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 44.9790954590s, input_fired_time: 0.4093711972, output_fired_time: 0.2720451355, propagate_forward_time: 18.0703163147, propagate_backward_time: 24.6891441345, weight_update_time: 0.0733462274, other_time: 1.5382194519
epoch time: 3.9999344349s, input_fired_time: 0.0445636474, output_fired_time: 0.0000000000, propagate_forward_time: 3.6810538769, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2743170261
validation[          , genome  2876] predictions:    9574/  10000 (95.74%), best:    9574/10000 (95.74%), error:      1471.34607, best error:      1431.68616 on epoch:    20, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 45.2657928467s, input_fired_time: 0.4137440622, output_fired_time: 0.2716189623, propagate_forward_time: 18.2859630585, propagate_backward_time: 24.7399368286, weight_update_time: 0.0738698095, other_time: 1.5545291901
epoch time: 3.8824660778s, input_fired_time: 0.0438809171, output_fired_time: 0.0000000000, propagate_forward_time: 3.5758326054, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2627525330
validation[          , genome  2876] predictions:    9530/  10000 (95.30%), best:    9574/10000 (95.74%), error:      1517.80542, best error:      1431.68616 on epoch:    20, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 47.9934692383s, input_fired_time: 0.4306755066, output_fired_time: 0.2849610150, propagate_forward_time: 19.3745594025, propagate_backward_time: 26.2719783783, weight_update_time: 0.0794682130, other_time: 1.6312942505
epoch time: 3.7201774120s, input_fired_time: 0.0425781533, output_fired_time: 0.0000000000, propagate_forward_time: 3.4244418144, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2531573772
validation[          , genome  2876] predictions:    9550/  10000 (95.50%), best:    9574/10000 (95.74%), error:      1473.69788, best error:      1431.68616 on epoch:    20, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 54.7503547668s, input_fired_time: 0.4635704458, output_fired_time: 0.3186802864, propagate_forward_time: 22.1988716125, propagate_backward_time: 29.9400119781, weight_update_time: 0.0883279890, other_time: 1.8292217255
epoch time: 5.6522436142s, input_fired_time: 0.0600805357, output_fired_time: 0.0000000000, propagate_forward_time: 5.2266807556, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3654823303
validation[          , genome  2876] predictions:    9568/  10000 (95.68%), best:    9574/10000 (95.74%), error:      1461.82349, best error:      1431.68616 on epoch:    20, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 46.8393402100s, input_fired_time: 0.4245893657, output_fired_time: 0.2822949886, propagate_forward_time: 18.8906135559, propagate_backward_time: 25.6246433258, weight_update_time: 0.0762291104, other_time: 1.6171970367
epoch time: 3.7123107910s, input_fired_time: 0.0424078815, output_fired_time: 0.0000000000, propagate_forward_time: 3.4121680260, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2577347755
validation[          , genome  2876] predictions:    9532/  10000 (95.32%), best:    9574/10000 (95.74%), error:      1583.46008, best error:      1431.68616 on epoch:    20, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 47.1900253296s, input_fired_time: 0.4263409972, output_fired_time: 0.2826066613, propagate_forward_time: 19.0111103058, propagate_backward_time: 25.8315944672, weight_update_time: 0.0773228407, other_time: 1.6383705139
epoch time: 3.8054566383s, input_fired_time: 0.0459872447, output_fired_time: 0.0000000000, propagate_forward_time: 3.4985313416, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2609381676
validation[          , genome  2876] predictions:    9548/  10000 (95.48%), best:    9574/10000 (95.74%), error:      1492.11157, best error:      1431.68616 on epoch:    20, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 45.2012977600s, input_fired_time: 0.4169383049, output_fired_time: 0.2740488350, propagate_forward_time: 18.1863250732, propagate_backward_time: 24.7448558807, weight_update_time: 0.0743355155, other_time: 1.5791301727
epoch time: 3.7171571255s, input_fired_time: 0.0432455018, output_fired_time: 0.0000000000, propagate_forward_time: 3.4142687321, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2596428394
validation[          , genome  2876] predictions:    9541/  10000 (95.41%), best:    9574/10000 (95.74%), error:      1584.46240, best error:      1431.68616 on epoch:    20, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 46.9560890198s, input_fired_time: 0.4302314520, output_fired_time: 0.2807593942, propagate_forward_time: 18.9398174286, propagate_backward_time: 25.6527233124, weight_update_time: 0.0772907957, other_time: 1.6525573730
epoch time: 3.9450237751s, input_fired_time: 0.0449688174, output_fired_time: 0.0000000000, propagate_forward_time: 3.6268970966, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2731578350
validation[          , genome  2876] predictions:    9574/  10000 (95.74%), best:    9574/10000 (95.74%), error:      1420.53882, best error:      1420.53882 on epoch:    29, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 46.6365928650s, input_fired_time: 0.4381573200, output_fired_time: 0.2786132693, propagate_forward_time: 18.7802848816, propagate_backward_time: 25.5003986359, weight_update_time: 0.0762714222, other_time: 1.6391391754
epoch time: 3.8305647373s, input_fired_time: 0.0437311567, output_fired_time: 0.0000000000, propagate_forward_time: 3.5275962353, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2592372894
validation[          , genome  2876] predictions:    9577/  10000 (95.77%), best:    9574/10000 (95.74%), error:      1422.50293, best error:      1420.53882 on epoch:    29, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 51.9727745056s, input_fired_time: 0.4544543624, output_fired_time: 0.3047954738, propagate_forward_time: 20.9889621735, propagate_backward_time: 28.4223651886, weight_update_time: 0.0907703862, other_time: 1.8022003174
epoch time: 3.9367189407s, input_fired_time: 0.0451313928, output_fired_time: 0.0000000000, propagate_forward_time: 3.6189768314, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2726106644
validation[          , genome  2876] predictions:    9546/  10000 (95.46%), best:    9574/10000 (95.74%), error:      1484.08423, best error:      1420.53882 on epoch:    29, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 48.3853683472s, input_fired_time: 0.4322903156, output_fired_time: 0.2876060009, propagate_forward_time: 19.4963436127, propagate_backward_time: 26.4794330597, weight_update_time: 0.0785895661, other_time: 1.6896972656
epoch time: 3.8241548538s, input_fired_time: 0.0440468490, output_fired_time: 0.0000000000, propagate_forward_time: 3.5195057392, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2606022358
validation[          , genome  2876] predictions:    9545/  10000 (95.45%), best:    9574/10000 (95.74%), error:      1532.13428, best error:      1420.53882 on epoch:    29, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 48.4623489380s, input_fired_time: 0.4330129921, output_fired_time: 0.2881281078, propagate_forward_time: 19.5406532288, propagate_backward_time: 26.5024204254, weight_update_time: 0.0792093053, other_time: 1.6981334686
epoch time: 3.8428723812s, input_fired_time: 0.0443783887, output_fired_time: 0.0000000000, propagate_forward_time: 3.5335402489, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2649538517
validation[          , genome  2876] predictions:    9525/  10000 (95.25%), best:    9574/10000 (95.74%), error:      1540.71704, best error:      1420.53882 on epoch:    29, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 46.0392684937s, input_fired_time: 0.4214138985, output_fired_time: 0.2766903937, propagate_forward_time: 18.5629100800, propagate_backward_time: 25.1723175049, weight_update_time: 0.0753151551, other_time: 1.6059360504
epoch time: 3.7279009819s, input_fired_time: 0.0428772643, output_fired_time: 0.0000000000, propagate_forward_time: 3.4283411503, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2566826344
validation[          , genome  2876] predictions:    9517/  10000 (95.17%), best:    9574/10000 (95.74%), error:      1595.01257, best error:      1420.53882 on epoch:    29, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 49.2701148987s, input_fired_time: 0.4399140775, output_fired_time: 0.2932461500, propagate_forward_time: 19.9290580750, propagate_backward_time: 26.9365978241, weight_update_time: 0.0808348805, other_time: 1.6712970734
epoch time: 5.6420950890s, input_fired_time: 0.0606060401, output_fired_time: 0.0000000000, propagate_forward_time: 5.2182407379, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3632483482
validation[          , genome  2876] predictions:    9560/  10000 (95.60%), best:    9574/10000 (95.74%), error:      1436.30896, best error:      1420.53882 on epoch:    29, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 53.3967628479s, input_fired_time: 0.4647343755, output_fired_time: 0.3105369806, propagate_forward_time: 21.6046180725, propagate_backward_time: 29.2271270752, weight_update_time: 0.0873106346, other_time: 1.7897491455
epoch time: 5.6515021324s, input_fired_time: 0.0610115752, output_fired_time: 0.0000000000, propagate_forward_time: 5.2271490097, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3633413315
validation[          , genome  2876] predictions:    9534/  10000 (95.34%), best:    9574/10000 (95.74%), error:      1534.22803, best error:      1420.53882 on epoch:    29, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 55.5175209045s, input_fired_time: 0.4737918079, output_fired_time: 0.3236749768, propagate_forward_time: 22.4795131683, propagate_backward_time: 30.3932018280, weight_update_time: 0.0931623206, other_time: 1.8473377228
epoch time: 3.8364627361s, input_fired_time: 0.0443309844, output_fired_time: 0.0000000000, propagate_forward_time: 3.5309200287, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2612116337
validation[          , genome  2876] predictions:    9584/  10000 (95.84%), best:    9574/10000 (95.74%), error:      1435.45190, best error:      1420.53882 on epoch:    29, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 43.6072845459s, input_fired_time: 0.4081278443, output_fired_time: 0.2655309439, propagate_forward_time: 17.5535526276, propagate_backward_time: 23.8815174103, weight_update_time: 0.0717179626, other_time: 1.4985580444
epoch time: 3.8482539654s, input_fired_time: 0.0448508412, output_fired_time: 0.0000000000, propagate_forward_time: 3.5399372578, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2634658813
validation[          , genome  2876] predictions:    9527/  10000 (95.27%), best:    9574/10000 (95.74%), error:      1546.39795, best error:      1420.53882 on epoch:    29, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 46.5357780457s, input_fired_time: 0.4221056998, output_fired_time: 0.2775538564, propagate_forward_time: 18.7676334381, propagate_backward_time: 25.4826927185, weight_update_time: 0.0761890113, other_time: 1.5857944489
epoch time: 3.9059188366s, input_fired_time: 0.0453945212, output_fired_time: 0.0000000000, propagate_forward_time: 3.5965089798, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2640154362
validation[          , genome  2876] predictions:    9563/  10000 (95.63%), best:    9574/10000 (95.74%), error:      1443.65918, best error:      1420.53882 on epoch:    29, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 54.1679992676s, input_fired_time: 0.4618806839, output_fired_time: 0.3146279454, propagate_forward_time: 21.9665870667, propagate_backward_time: 29.6324539185, weight_update_time: 0.0873848572, other_time: 1.7924499512
epoch time: 3.8931896687s, input_fired_time: 0.0449698716, output_fired_time: 0.0000000000, propagate_forward_time: 3.5866558552, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2615640163
validation[          , genome  2876] predictions:    9581/  10000 (95.81%), best:    9581/10000 (95.81%), error:      1410.91760, best error:      1410.91760 on epoch:    40, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 52.6560897827s, input_fired_time: 0.4537909329, output_fired_time: 0.3088473082, propagate_forward_time: 21.3088626862, propagate_backward_time: 28.8286533356, weight_update_time: 0.0850352868, other_time: 1.7559356689
epoch time: 3.8966150284s, input_fired_time: 0.0451733135, output_fired_time: 0.0000000000, propagate_forward_time: 3.5901155472, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2613260746
validation[          , genome  2876] predictions:    9579/  10000 (95.79%), best:    9581/10000 (95.81%), error:      1454.07996, best error:      1410.91760 on epoch:    40, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 45.2082977295s, input_fired_time: 0.4136991799, output_fired_time: 0.2716158628, propagate_forward_time: 18.2247142792, propagate_backward_time: 24.7609100342, weight_update_time: 0.0734193102, other_time: 1.5373592377
epoch time: 3.9715960026s, input_fired_time: 0.0455146581, output_fired_time: 0.0000000000, propagate_forward_time: 3.6570372581, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2690441608
validation[          , genome  2876] predictions:    9573/  10000 (95.73%), best:    9581/10000 (95.81%), error:      1452.70386, best error:      1410.91760 on epoch:    40, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 49.9953689575s, input_fired_time: 0.4428234398, output_fired_time: 0.2957672179, propagate_forward_time: 20.2211799622, propagate_backward_time: 27.3543548584, weight_update_time: 0.0816740468, other_time: 1.6812400818
epoch time: 4.3418488503s, input_fired_time: 0.0495722368, output_fired_time: 0.0000000000, propagate_forward_time: 4.0038337708, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2884426117
validation[          , genome  2876] predictions:    9565/  10000 (95.65%), best:    9581/10000 (95.81%), error:      1471.19189, best error:      1410.91760 on epoch:    40, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 51.0681800842s, input_fired_time: 0.4470686316, output_fired_time: 0.2993811369, propagate_forward_time: 20.6402645111, propagate_backward_time: 27.9719066620, weight_update_time: 0.0828068182, other_time: 1.7095603943
epoch time: 4.8952188492s, input_fired_time: 0.0542092323, output_fired_time: 0.0000000000, propagate_forward_time: 4.5241274834, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3168821335
validation[          , genome  2876] predictions:    9535/  10000 (95.35%), best:    9581/10000 (95.81%), error:      1556.19592, best error:      1410.91760 on epoch:    40, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 53.4459800720s, input_fired_time: 0.4578744769, output_fired_time: 0.3099104762, propagate_forward_time: 21.6325893402, propagate_backward_time: 29.3180675507, weight_update_time: 0.0834025592, other_time: 1.7275390625
epoch time: 5.0188412666s, input_fired_time: 0.0540794656, output_fired_time: 0.0000000000, propagate_forward_time: 4.6395897865, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3251719475
validation[          , genome  2876] predictions:    9602/  10000 (96.02%), best:    9602/10000 (96.02%), error:      1381.99561, best error:      1381.99561 on epoch:    45, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 55.9019737244s, input_fired_time: 0.4716675878, output_fired_time: 0.3217503428, propagate_forward_time: 22.7117443085, propagate_backward_time: 30.6068248749, weight_update_time: 0.0879550502, other_time: 1.7899875641
epoch time: 3.7357447147s, input_fired_time: 0.0436013564, output_fired_time: 0.0000000000, propagate_forward_time: 3.4416093826, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2505340576
validation[          , genome  2876] predictions:    9542/  10000 (95.42%), best:    9602/10000 (96.02%), error:      1492.23560, best error:      1381.99561 on epoch:    45, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 52.5377044678s, input_fired_time: 0.4573527873, output_fired_time: 0.3019160330, propagate_forward_time: 21.2890071869, propagate_backward_time: 28.7848243713, weight_update_time: 0.0825681463, other_time: 1.7046070099
epoch time: 4.1240653992s, input_fired_time: 0.0457080565, output_fired_time: 0.0000000000, propagate_forward_time: 3.8051340580, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2732231617
validation[          , genome  2876] predictions:    9557/  10000 (95.57%), best:    9602/10000 (96.02%), error:      1466.51636, best error:      1381.99561 on epoch:    45, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 50.8686141968s, input_fired_time: 0.4427569211, output_fired_time: 0.2943134606, propagate_forward_time: 20.6160564423, propagate_backward_time: 27.8785953522, weight_update_time: 0.0786603913, other_time: 1.6368904114
epoch time: 4.3204154968s, input_fired_time: 0.0476434119, output_fired_time: 0.0000000000, propagate_forward_time: 3.9830281734, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2897441387
validation[          , genome  2876] predictions:    9590/  10000 (95.90%), best:    9590/10000 (95.90%), error:      1371.94092, best error:      1371.94092 on epoch:    48, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 54.7747764587s, input_fired_time: 0.4614377022, output_fired_time: 0.3145411015, propagate_forward_time: 22.1924839020, propagate_backward_time: 30.0748767853, weight_update_time: 0.0845278874, other_time: 1.7314376831
epoch time: 3.8770835400s, input_fired_time: 0.0440830328, output_fired_time: 0.0000000000, propagate_forward_time: 3.5708291531, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2621712685
validation[          , genome  2876] predictions:    9521/  10000 (95.21%), best:    9590/10000 (95.90%), error:      1552.93250, best error:      1371.94092 on epoch:    48, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 57.5842590332s, input_fired_time: 0.4763320982, output_fired_time: 0.3275896311, propagate_forward_time: 23.3395996094, propagate_backward_time: 31.6209735870, weight_update_time: 0.0887810364, other_time: 1.8197612762
epoch time: 4.2444362640s, input_fired_time: 0.0472429879, output_fired_time: 0.0000000000, propagate_forward_time: 3.9161229134, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2810702324
validation[          , genome  2876] predictions:    9584/  10000 (95.84%), best:    9590/10000 (95.90%), error:      1386.07593, best error:      1371.94092 on epoch:    48, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 49.0029220581s, input_fired_time: 0.4371840358, output_fired_time: 0.2865574062, propagate_forward_time: 19.8609790802, propagate_backward_time: 26.7906703949, weight_update_time: 0.0760870278, other_time: 1.6275329590
epoch time: 4.3938870430s, input_fired_time: 0.0490702726, output_fired_time: 0.0000000000, propagate_forward_time: 4.0567870140, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2880296707
validation[          , genome  2876] predictions:    9584/  10000 (95.84%), best:    9590/10000 (95.90%), error:      1399.25354, best error:      1371.94092 on epoch:    48, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 51.6633110046s, input_fired_time: 0.4507606328, output_fired_time: 0.2989686430, propagate_forward_time: 20.9375457764, propagate_backward_time: 28.2816982269, weight_update_time: 0.0802659020, other_time: 1.6943378448
epoch time: 5.1085662842s, input_fired_time: 0.0560039617, output_fired_time: 0.0000000000, propagate_forward_time: 4.7032847404, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3492774963
validation[          , genome  2876] predictions:    9573/  10000 (95.73%), best:    9590/10000 (95.90%), error:      1443.56970, best error:      1371.94092 on epoch:    48, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 58.9871864319s, input_fired_time: 0.4866909087, output_fired_time: 0.3455253541, propagate_forward_time: 23.9229431152, propagate_backward_time: 32.3634109497, weight_update_time: 0.0904412866, other_time: 1.8686180115
epoch time: 5.6342010498s, input_fired_time: 0.0588251241, output_fired_time: 0.0000000000, propagate_forward_time: 5.2188878059, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3564882278
validation[          , genome  2876] predictions:    9541/  10000 (95.41%), best:    9590/10000 (95.90%), error:      1507.32324, best error:      1371.94092 on epoch:    48, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 51.0220184326s, input_fired_time: 0.4469932318, output_fired_time: 0.2947832644, propagate_forward_time: 20.6361274719, propagate_backward_time: 27.9842300415, weight_update_time: 0.0793960541, other_time: 1.6598815918
epoch time: 4.2554125786s, input_fired_time: 0.0475938320, output_fired_time: 0.0000000000, propagate_forward_time: 3.9254033566, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2824156284
validation[          , genome  2876] predictions:    9570/  10000 (95.70%), best:    9590/10000 (95.90%), error:      1431.05383, best error:      1371.94092 on epoch:    48, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 50.0933494568s, input_fired_time: 0.4421661496, output_fired_time: 0.2898993492, propagate_forward_time: 20.2892456055, propagate_backward_time: 27.4496536255, weight_update_time: 0.0783132315, other_time: 1.6223869324
epoch time: 4.2801213264s, input_fired_time: 0.0481218733, output_fired_time: 0.0000000000, propagate_forward_time: 3.9409608841, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2910385132
validation[          , genome  2876] predictions:    9533/  10000 (95.33%), best:    9590/10000 (95.90%), error:      1554.45410, best error:      1371.94092 on epoch:    48, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 50.8821067810s, input_fired_time: 0.4456081390, output_fired_time: 0.2939783931, propagate_forward_time: 20.6227931976, propagate_backward_time: 27.8708438873, weight_update_time: 0.0790905580, other_time: 1.6488838196
epoch time: 5.0978837013s, input_fired_time: 0.0544038452, output_fired_time: 0.0000000000, propagate_forward_time: 4.7188143730, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3246655464
validation[          , genome  2876] predictions:    9569/  10000 (95.69%), best:    9590/10000 (95.90%), error:      1431.94434, best error:      1371.94092 on epoch:    48, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 61.2453193665s, input_fired_time: 0.5016425252, output_fired_time: 0.3440326154, propagate_forward_time: 24.8885040283, propagate_backward_time: 33.5974998474, weight_update_time: 0.0940381661, other_time: 1.9136390686
epoch time: 4.3119034767s, input_fired_time: 0.0484317951, output_fired_time: 0.0000000000, propagate_forward_time: 3.9784159660, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2850556374
validation[          , genome  2876] predictions:    9605/  10000 (96.05%), best:    9605/10000 (96.05%), error:      1350.83594, best error:      1350.83594 on epoch:    57, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 56.2561111450s, input_fired_time: 0.4768420458, output_fired_time: 0.3217459321, propagate_forward_time: 22.8432693481, propagate_backward_time: 30.8256816864, weight_update_time: 0.0872547925, other_time: 1.7885723114
epoch time: 4.1329865456s, input_fired_time: 0.0473240241, output_fired_time: 0.0000000000, propagate_forward_time: 3.8142392635, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2714231014
validation[          , genome  2876] predictions:    9549/  10000 (95.49%), best:    9605/10000 (96.05%), error:      1440.86523, best error:      1350.83594 on epoch:    57, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 48.8366661072s, input_fired_time: 0.4340653419, output_fired_time: 0.2860055268, propagate_forward_time: 19.7536411285, propagate_backward_time: 26.7802906036, weight_update_time: 0.0762973279, other_time: 1.5826606750
epoch time: 4.2364625931s, input_fired_time: 0.0476510637, output_fired_time: 0.0000000000, propagate_forward_time: 3.9085977077, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2802135944
validation[          , genome  2876] predictions:    9598/  10000 (95.98%), best:    9598/10000 (95.98%), error:      1341.22607, best error:      1341.22607 on epoch:    59, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 52.1934738159s, input_fired_time: 0.4594826102, output_fired_time: 0.3138422072, propagate_forward_time: 21.0944576263, propagate_backward_time: 28.6436176300, weight_update_time: 0.0815614611, other_time: 1.6820716858
epoch time: 5.6002578735s, input_fired_time: 0.0598631017, output_fired_time: 0.0000000000, propagate_forward_time: 5.1871719360, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3532228470
validation[          , genome  2876] predictions:    9598/  10000 (95.98%), best:    9598/10000 (95.98%), error:      1351.04602, best error:      1341.22607 on epoch:    59, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 45.2104530334s, input_fired_time: 0.4248602986, output_fired_time: 0.2699577212, propagate_forward_time: 18.2365074158, propagate_backward_time: 24.7147464752, weight_update_time: 0.0746907070, other_time: 1.5643787384
epoch time: 3.9085469246s, input_fired_time: 0.0470697246, output_fired_time: 0.0000000000, propagate_forward_time: 3.5964696407, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2650074959
validation[          , genome  2876] predictions:    9596/  10000 (95.96%), best:    9598/10000 (95.98%), error:      1429.44214, best error:      1341.22607 on epoch:    59, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 46.5295028687s, input_fired_time: 0.4332954288, output_fired_time: 0.2777523398, propagate_forward_time: 18.7772731781, propagate_backward_time: 25.4748382568, weight_update_time: 0.0768481418, other_time: 1.5663433075
epoch time: 3.7853829861s, input_fired_time: 0.0455155559, output_fired_time: 0.0000000000, propagate_forward_time: 3.4863538742, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2535135746
validation[          , genome  2876] predictions:    9534/  10000 (95.34%), best:    9598/10000 (95.98%), error:      1515.94458, best error:      1341.22607 on epoch:    59, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 46.3095741272s, input_fired_time: 0.4316912293, output_fired_time: 0.2750449479, propagate_forward_time: 18.7225894928, propagate_backward_time: 25.3292636871, weight_update_time: 0.0761435777, other_time: 1.5509872437
epoch time: 3.9587256908s, input_fired_time: 0.0468899459, output_fired_time: 0.0000000000, propagate_forward_time: 3.6489610672, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2628746033
validation[          , genome  2876] predictions:    9563/  10000 (95.63%), best:    9598/10000 (95.98%), error:      1461.36206, best error:      1341.22607 on epoch:    59, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 49.7334671021s, input_fired_time: 0.4511793554, output_fired_time: 0.2912597656, propagate_forward_time: 20.1122436523, propagate_backward_time: 27.2312545776, weight_update_time: 0.0807469785, other_time: 1.6475296021
epoch time: 3.8410613537s, input_fired_time: 0.0467271507, output_fired_time: 0.0000000000, propagate_forward_time: 3.5334215164, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2609126568
validation[          , genome  2876] predictions:    9567/  10000 (95.67%), best:    9598/10000 (95.98%), error:      1441.67969, best error:      1341.22607 on epoch:    59, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 46.7154006958s, input_fired_time: 0.4360237122, output_fired_time: 0.2752873898, propagate_forward_time: 18.9248104095, propagate_backward_time: 25.5201301575, weight_update_time: 0.0763903111, other_time: 1.5591487885
epoch time: 3.9299738407s, input_fired_time: 0.0471650176, output_fired_time: 0.0000000000, propagate_forward_time: 3.6239593029, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2588496208
validation[          , genome  2876] predictions:    9600/  10000 (96.00%), best:    9598/10000 (95.98%), error:      1409.38660, best error:      1341.22607 on epoch:    59, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 50.0639266968s, input_fired_time: 0.4542143643, output_fired_time: 0.2928175032, propagate_forward_time: 20.2124748230, propagate_backward_time: 27.4519100189, weight_update_time: 0.0813030601, other_time: 1.6525096893
epoch time: 3.9394528866s, input_fired_time: 0.0473296195, output_fired_time: 0.0000000000, propagate_forward_time: 3.6308319569, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2612912655
validation[          , genome  2876] predictions:    9612/  10000 (96.12%), best:    9598/10000 (95.98%), error:      1346.03259, best error:      1341.22607 on epoch:    59, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 49.6529731750s, input_fired_time: 0.4519947767, output_fired_time: 0.2920368314, propagate_forward_time: 20.0648212433, propagate_backward_time: 27.2054195404, weight_update_time: 0.0807932243, other_time: 1.6386985779
epoch time: 4.0148425102s, input_fired_time: 0.0491311215, output_fired_time: 0.0000000000, propagate_forward_time: 3.6903588772, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2753524780
validation[          , genome  2876] predictions:    9566/  10000 (95.66%), best:    9598/10000 (95.98%), error:      1509.43091, best error:      1341.22607 on epoch:    59, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 48.8092994690s, input_fired_time: 0.4465470612, output_fired_time: 0.2869099081, propagate_forward_time: 19.7129421234, propagate_backward_time: 26.7443370819, weight_update_time: 0.0794731304, other_time: 1.6185607910
epoch time: 3.9090490341s, input_fired_time: 0.0471608154, output_fired_time: 0.0000000000, propagate_forward_time: 3.6009726524, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2609155178
validation[          , genome  2876] predictions:    9623/  10000 (96.23%), best:    9623/10000 (96.23%), error:      1318.88599, best error:      1318.88599 on epoch:    68, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 45.2436103821s, input_fired_time: 0.4312082827, output_fired_time: 0.2687259316, propagate_forward_time: 18.2182636261, propagate_backward_time: 24.7985401154, weight_update_time: 0.0745113194, other_time: 1.5268707275
epoch time: 4.1139674187s, input_fired_time: 0.0498944446, output_fired_time: 0.0000000000, propagate_forward_time: 3.7869689465, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2771041393
validation[          , genome  2876] predictions:    9558/  10000 (95.58%), best:    9623/10000 (96.23%), error:      1446.48938, best error:      1318.88599 on epoch:    68, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 46.6520080566s, input_fired_time: 0.4403327405, output_fired_time: 0.2762755752, propagate_forward_time: 18.9000492096, propagate_backward_time: 25.4575042725, weight_update_time: 0.0766626373, other_time: 1.5778446198
epoch time: 4.0252127647s, input_fired_time: 0.0486483611, output_fired_time: 0.0000000000, propagate_forward_time: 3.7055828571, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2709815502
validation[          , genome  2876] predictions:    9542/  10000 (95.42%), best:    9623/10000 (96.23%), error:      1585.03760, best error:      1318.88599 on epoch:    68, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 46.3624038696s, input_fired_time: 0.4371475875, output_fired_time: 0.2741304338, propagate_forward_time: 18.7205543518, propagate_backward_time: 25.3809814453, weight_update_time: 0.0761200041, other_time: 1.5495872498
epoch time: 3.7847383022s, input_fired_time: 0.0457711741, output_fired_time: 0.0000000000, propagate_forward_time: 3.4824748039, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2564923763
validation[          , genome  2876] predictions:    9533/  10000 (95.33%), best:    9623/10000 (96.23%), error:      1510.13953, best error:      1318.88599 on epoch:    68, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 55.2149887085s, input_fired_time: 0.4834888577, output_fired_time: 0.3163818419, propagate_forward_time: 22.3349018097, propagate_backward_time: 30.2931594849, weight_update_time: 0.0879610255, other_time: 1.7870559692
epoch time: 3.8635239601s, input_fired_time: 0.0465648733, output_fired_time: 0.0000000000, propagate_forward_time: 3.5585768223, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2583823204
validation[          , genome  2876] predictions:    9586/  10000 (95.86%), best:    9623/10000 (96.23%), error:      1382.93542, best error:      1318.88599 on epoch:    68, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 44.9789161682s, input_fired_time: 0.4289496839, output_fired_time: 0.2671987712, propagate_forward_time: 18.1798820496, propagate_backward_time: 24.5936756134, weight_update_time: 0.0737829134, other_time: 1.5092067719
epoch time: 3.9312512875s, input_fired_time: 0.0472790785, output_fired_time: 0.0000000000, propagate_forward_time: 3.6197118759, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2642602921
validation[          , genome  2876] predictions:    9557/  10000 (95.57%), best:    9623/10000 (96.23%), error:      1469.11389, best error:      1318.88599 on epoch:    68, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 44.7869834900s, input_fired_time: 0.4290236831, output_fired_time: 0.2678851783, propagate_forward_time: 18.1209678650, propagate_backward_time: 24.4612102509, weight_update_time: 0.0737813115, other_time: 1.5078983307
epoch time: 4.0420317650s, input_fired_time: 0.0501092821, output_fired_time: 0.0000000000, propagate_forward_time: 3.7219376564, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2699847221
validation[          , genome  2876] predictions:    9578/  10000 (95.78%), best:    9623/10000 (96.23%), error:      1493.76160, best error:      1318.88599 on epoch:    68, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 52.9798126221s, input_fired_time: 0.4736159444, output_fired_time: 0.3059733212, propagate_forward_time: 21.4353275299, propagate_backward_time: 29.0352382660, weight_update_time: 0.0853628889, other_time: 1.7296562195
epoch time: 5.6491241455s, input_fired_time: 0.0599260703, output_fired_time: 0.0000000000, propagate_forward_time: 5.2335529327, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3556451797
validation[          , genome  2876] predictions:    9582/  10000 (95.82%), best:    9623/10000 (96.23%), error:      1388.89099, best error:      1318.88599 on epoch:    68, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 51.9892730713s, input_fired_time: 0.4662066698, output_fired_time: 0.3004611433, propagate_forward_time: 21.0223064423, propagate_backward_time: 28.5026645660, weight_update_time: 0.0828287974, other_time: 1.6976356506
epoch time: 3.8823239803s, input_fired_time: 0.0475771800, output_fired_time: 0.0000000000, propagate_forward_time: 3.5718901157, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2628567219
validation[          , genome  2876] predictions:    9545/  10000 (95.45%), best:    9623/10000 (96.23%), error:      1495.58203, best error:      1318.88599 on epoch:    68, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 49.1945877075s, input_fired_time: 0.4525864720, output_fired_time: 0.2877171338, propagate_forward_time: 19.8513584137, propagate_backward_time: 26.9421157837, weight_update_time: 0.0794389546, other_time: 1.6608104706
epoch time: 4.2675909996s, input_fired_time: 0.0504221208, output_fired_time: 0.0000000000, propagate_forward_time: 3.9336223602, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2835464478
validation[          , genome  2876] predictions:    9596/  10000 (95.96%), best:    9623/10000 (96.23%), error:      1366.43945, best error:      1318.88599 on epoch:    68, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 45.0661735535s, input_fired_time: 0.4323124886, output_fired_time: 0.2697481513, propagate_forward_time: 18.2726364136, propagate_backward_time: 24.5413417816, weight_update_time: 0.0742362440, other_time: 1.5501346588
epoch time: 3.8036277294s, input_fired_time: 0.0464012437, output_fired_time: 0.0000000000, propagate_forward_time: 3.5029771328, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2542493343
validation[          , genome  2876] predictions:    9551/  10000 (95.51%), best:    9623/10000 (96.23%), error:      1487.33093, best error:      1318.88599 on epoch:    68, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 44.4313621521s, input_fired_time: 0.4298200607, output_fired_time: 0.2666498721, propagate_forward_time: 17.9238185883, propagate_backward_time: 24.2636089325, weight_update_time: 0.0734404474, other_time: 1.5474624634
epoch time: 3.9187829494s, input_fired_time: 0.0474596545, output_fired_time: 0.0000000000, propagate_forward_time: 3.6070456505, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2642776966
validation[          , genome  2876] predictions:    9585/  10000 (95.85%), best:    9623/10000 (96.23%), error:      1401.08606, best error:      1318.88599 on epoch:    68, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 44.9393043518s, input_fired_time: 0.4330166280, output_fired_time: 0.2681438923, propagate_forward_time: 18.1217346191, propagate_backward_time: 24.5706100464, weight_update_time: 0.0738757253, other_time: 1.5457992554
epoch time: 3.8637204170s, input_fired_time: 0.0473763533, output_fired_time: 0.0000000000, propagate_forward_time: 3.5580928326, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2582511902
validation[          , genome  2876] predictions:    9559/  10000 (95.59%), best:    9623/10000 (96.23%), error:      1488.17737, best error:      1318.88599 on epoch:    68, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 46.1030731201s, input_fired_time: 0.4368626177, output_fired_time: 0.2742070258, propagate_forward_time: 18.5195293427, propagate_backward_time: 25.3029155731, weight_update_time: 0.0757221803, other_time: 1.5695571899
epoch time: 4.6460747719s, input_fired_time: 0.0544363968, output_fired_time: 0.0000000000, propagate_forward_time: 4.2857317924, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3059067726
validation[          , genome  2876] predictions:    9595/  10000 (95.95%), best:    9623/10000 (96.23%), error:      1401.17920, best error:      1318.88599 on epoch:    68, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 45.3714942932s, input_fired_time: 0.4361715913, output_fired_time: 0.2691480219, propagate_forward_time: 18.2590007782, propagate_backward_time: 24.8556880951, weight_update_time: 0.0752402321, other_time: 1.5514831543
epoch time: 3.8537335396s, input_fired_time: 0.0474887863, output_fired_time: 0.0000000000, propagate_forward_time: 3.5411100388, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2651348114
validation[          , genome  2876] predictions:    9573/  10000 (95.73%), best:    9623/10000 (96.23%), error:      1428.79077, best error:      1318.88599 on epoch:    68, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 45.7955474854s, input_fired_time: 0.4374831319, output_fired_time: 0.2727113366, propagate_forward_time: 18.4572277069, propagate_backward_time: 25.0623760223, weight_update_time: 0.0756662413, other_time: 1.5657463074
epoch time: 4.0010418892s, input_fired_time: 0.0484142937, output_fired_time: 0.0000000000, propagate_forward_time: 3.6811120510, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2715156078
validation[          , genome  2876] predictions:    9567/  10000 (95.67%), best:    9623/10000 (96.23%), error:      1447.53613, best error:      1318.88599 on epoch:    68, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 46.4817008972s, input_fired_time: 0.4407476187, output_fired_time: 0.2752473652, propagate_forward_time: 18.7255630493, propagate_backward_time: 25.4747428894, weight_update_time: 0.0758558288, other_time: 1.5654029846
epoch time: 4.5628433228s, input_fired_time: 0.0525794923, output_fired_time: 0.0000000000, propagate_forward_time: 4.2110242844, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2992396355
validation[          , genome  2876] predictions:    9513/  10000 (95.13%), best:    9623/10000 (96.23%), error:      1567.41125, best error:      1318.88599 on epoch:    68, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 48.8112716675s, input_fired_time: 0.4523531795, output_fired_time: 0.2852947116, propagate_forward_time: 19.7029895782, propagate_backward_time: 26.7359695435, weight_update_time: 0.0801427290, other_time: 1.6346645355
epoch time: 3.8566641808s, input_fired_time: 0.0472934507, output_fired_time: 0.0000000000, propagate_forward_time: 3.5504982471, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2588725090
validation[          , genome  2876] predictions:    9579/  10000 (95.79%), best:    9623/10000 (96.23%), error:      1384.17651, best error:      1318.88599 on epoch:    68, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 48.8343887329s, input_fired_time: 0.4566428363, output_fired_time: 0.2881880105, propagate_forward_time: 19.6962242126, propagate_backward_time: 26.7590045929, weight_update_time: 0.0794889331, other_time: 1.6343288422
epoch time: 3.8781435490s, input_fired_time: 0.0485655405, output_fired_time: 0.0000000000, propagate_forward_time: 3.5604906082, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2690873146
validation[          , genome  2876] predictions:    9539/  10000 (95.39%), best:    9623/10000 (96.23%), error:      1515.24194, best error:      1318.88599 on epoch:    68, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 48.6386795044s, input_fired_time: 0.4551998675, output_fired_time: 0.2850946188, propagate_forward_time: 19.6596603394, propagate_backward_time: 26.6124286652, weight_update_time: 0.0797539875, other_time: 1.6262950897
epoch time: 3.8993937969s, input_fired_time: 0.0479914583, output_fired_time: 0.0000000000, propagate_forward_time: 3.5911068916, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2602953911
validation[          , genome  2876] predictions:    9576/  10000 (95.76%), best:    9623/10000 (96.23%), error:      1433.33411, best error:      1318.88599 on epoch:    68, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 45.8284378052s, input_fired_time: 0.4358735681, output_fired_time: 0.2717849910, propagate_forward_time: 18.4498844147, propagate_backward_time: 25.1330871582, weight_update_time: 0.0754819065, other_time: 1.5378055573
epoch time: 5.2161655426s, input_fired_time: 0.0609537363, output_fired_time: 0.0000000000, propagate_forward_time: 4.8175601959, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3376517296
validation[          , genome  2876] predictions:    9588/  10000 (95.88%), best:    9623/10000 (96.23%), error:      1418.28479, best error:      1318.88599 on epoch:    68, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 52.3209800720s, input_fired_time: 0.4708367288, output_fired_time: 0.3032543361, propagate_forward_time: 21.1548995972, propagate_backward_time: 28.6568355560, weight_update_time: 0.0839721784, other_time: 1.7351551056
epoch time: 3.8962419033s, input_fired_time: 0.0470101275, output_fired_time: 0.0000000000, propagate_forward_time: 3.5848739147, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2643578053
validation[          , genome  2876] predictions:    9494/  10000 (94.94%), best:    9623/10000 (96.23%), error:      1650.15247, best error:      1318.88599 on epoch:    68, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 50.9244384766s, input_fired_time: 0.4615038633, output_fired_time: 0.2978147268, propagate_forward_time: 20.5878009796, propagate_backward_time: 27.9107818604, weight_update_time: 0.0805416405, other_time: 1.6665401459
epoch time: 3.8697347641s, input_fired_time: 0.0467589349, output_fired_time: 0.0000000000, propagate_forward_time: 3.5638804436, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2590954304
validation[          , genome  2876] predictions:    9593/  10000 (95.93%), best:    9623/10000 (96.23%), error:      1380.07056, best error:      1318.88599 on epoch:    68, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 48.6776733398s, input_fired_time: 0.4515826106, output_fired_time: 0.2852587104, propagate_forward_time: 19.7189655304, propagate_backward_time: 26.6166324615, weight_update_time: 0.0783092529, other_time: 1.6052322388
epoch time: 4.3165073395s, input_fired_time: 0.0520173013, output_fired_time: 0.0000000000, propagate_forward_time: 3.9771678448, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2873222828
validation[          , genome  2876] predictions:    9566/  10000 (95.66%), best:    9623/10000 (96.23%), error:      1499.38940, best error:      1318.88599 on epoch:    68, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 48.9153747559s, input_fired_time: 0.4570050836, output_fired_time: 0.2856052816, propagate_forward_time: 19.8043498993, propagate_backward_time: 26.7439918518, weight_update_time: 0.0803959742, other_time: 1.6244220734
epoch time: 4.1933507919s, input_fired_time: 0.0509804562, output_fired_time: 0.0000000000, propagate_forward_time: 3.8653948307, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2769753933
validation[          , genome  2876] predictions:    9583/  10000 (95.83%), best:    9623/10000 (96.23%), error:      1420.61182, best error:      1318.88599 on epoch:    68, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 60.2988662720s, input_fired_time: 0.5195987821, output_fired_time: 0.3426958919, propagate_forward_time: 24.4740180969, propagate_backward_time: 33.0405998230, weight_update_time: 0.0956399888, other_time: 1.9219512939
epoch time: 5.0442051888s, input_fired_time: 0.0577466562, output_fired_time: 0.0000000000, propagate_forward_time: 4.6585488319, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3279094696
validation[          , genome  2876] predictions:    9575/  10000 (95.75%), best:    9623/10000 (96.23%), error:      1416.63867, best error:      1318.88599 on epoch:    68, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 58.2200241089s, input_fired_time: 0.5068336129, output_fired_time: 0.3296487927, propagate_forward_time: 23.5900917053, propagate_backward_time: 31.9185752869, weight_update_time: 0.0915838033, other_time: 1.8748779297
epoch time: 5.6700396538s, input_fired_time: 0.0655575320, output_fired_time: 0.0000000000, propagate_forward_time: 5.2432475090, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3612346649
validation[          , genome  2876] predictions:    9566/  10000 (95.66%), best:    9623/10000 (96.23%), error:      1476.80225, best error:      1318.88599 on epoch:    68, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 49.1930160522s, input_fired_time: 0.4614039063, output_fired_time: 0.2886342406, propagate_forward_time: 19.8292179108, propagate_backward_time: 26.9774780273, weight_update_time: 0.0806870610, other_time: 1.6362819672
epoch time: 4.0637488365s, input_fired_time: 0.0500822514, output_fired_time: 0.0000000000, propagate_forward_time: 3.7397251129, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2739415169
validation[          , genome  2876] predictions:    9563/  10000 (95.63%), best:    9623/10000 (96.23%), error:      1469.41577, best error:      1318.88599 on epoch:    68, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 50.2056961060s, input_fired_time: 0.4623349905, output_fired_time: 0.2924511433, propagate_forward_time: 20.3078975677, propagate_backward_time: 27.4855918884, weight_update_time: 0.0804467350, other_time: 1.6574230194
epoch time: 3.8549671173s, input_fired_time: 0.0482126176, output_fired_time: 0.0000000000, propagate_forward_time: 3.5472478867, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2595067024
validation[          , genome  2876] predictions:    9564/  10000 (95.64%), best:    9623/10000 (96.23%), error:      1511.18958, best error:      1318.88599 on epoch:    68, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 51.1557044983s, input_fired_time: 0.4690295756, output_fired_time: 0.2954305112, propagate_forward_time: 20.6838226318, propagate_backward_time: 28.0280609131, weight_update_time: 0.0839483663, other_time: 1.6793632507
epoch time: 5.6027331352s, input_fired_time: 0.0637876093, output_fired_time: 0.0000000000, propagate_forward_time: 5.1819977760, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3569478989
validation[          , genome  2876] predictions:    9558/  10000 (95.58%), best:    9623/10000 (96.23%), error:      1476.71533, best error:      1318.88599 on epoch:    68, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 58.9831237793s, input_fired_time: 0.5157400370, output_fired_time: 0.3367068768, propagate_forward_time: 23.9013862610, propagate_backward_time: 32.3395118713, weight_update_time: 0.0941531286, other_time: 1.8897781372
epoch time: 4.2931566238s, input_fired_time: 0.0535191707, output_fired_time: 0.0000000000, propagate_forward_time: 3.9481501579, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2914872169
validation[          , genome  2876] predictions:    9571/  10000 (95.71%), best:    9623/10000 (96.23%), error:      1547.12488, best error:      1318.88599 on epoch:    68, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 47.5571365356s, input_fired_time: 0.4504492879, output_fired_time: 0.2818386257, propagate_forward_time: 19.1946182251, propagate_backward_time: 26.0490741730, weight_update_time: 0.0762926638, other_time: 1.5811557770
epoch time: 4.4961886406s, input_fired_time: 0.0544385128, output_fired_time: 0.0000000000, propagate_forward_time: 4.1402759552, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3014740944
validation[          , genome  2876] predictions:    9548/  10000 (95.48%), best:    9623/10000 (96.23%), error:      1506.67334, best error:      1318.88599 on epoch:    68, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 51.1742210388s, input_fired_time: 0.4723777473, output_fired_time: 0.2959640622, propagate_forward_time: 20.6721363068, propagate_backward_time: 28.0480175018, weight_update_time: 0.0829532668, other_time: 1.6857261658
epoch time: 4.1099934578s, input_fired_time: 0.0505729318, output_fired_time: 0.0000000000, propagate_forward_time: 3.7832484245, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2761721611
validation[          , genome  2876] predictions:    9589/  10000 (95.89%), best:    9623/10000 (96.23%), error:      1400.25342, best error:      1318.88599 on epoch:    68, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 21.1801242828s, input_fired_time: 0.2518562376, output_fired_time: 0.0000000000, propagate_forward_time: 19.4694900513, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4587783813
best training[          , genome  2876] predictions:   48890/  50000 (97.78%), best:    9623/10000 (96.23%), error:      3977.26392, best error:      1318.88599 on epoch:    68, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 4.3220272064s, input_fired_time: 0.0499583632, output_fired_time: 0.0000000000, propagate_forward_time: 3.9616796970, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3103892803
   testing[          , genome  2876] predictions:    9674/  10000 (96.74%), best:    9623/10000 (96.23%), error:      1166.11829, best error:      1318.88599 on epoch:    68, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
23:46:09 (36312): called boinc_finish(0)

</stderr_txt>
]]>