Nameexact_genome_1512568488_45_2240_0
Workunit2582407
Created6 Dec 2017, 22:45:36 UTC
Sent6 Dec 2017, 22:48:33 UTC
Report deadline9 Dec 2017, 22:08:18 UTC
Received7 Dec 2017, 0:20:56 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID54172
Run time1 hours 32 min 2 sec
CPU time1 hours 31 min 46 sec
Validate stateValid
Credit743.02
Device peak FLOPS3.27 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.33
Peak working set size149.38 MB
Peak swap size151.14 MB
Peak disk usage1.01 MB

Stderr output

<core_client_version>7.6.31</core_client_version>
<![CDATA[
<stderr_txt>
, epoch:   13/100, mu: 0.7384625077, learning_rate: 0.0064167744, weight_decay: 0.0002566710

epoch time: 50.8919830322s, input_fired_time: 0.4134605229, output_fired_time: 0.3030729294, propagate_forward_time: 19.6964874268, propagate_backward_time: 28.4345340729, weight_update_time: 0.0884528309, other_time: 2.0444278717
epoch time: 4.3475980759s, input_fired_time: 0.0466591939, output_fired_time: 0.0000000000, propagate_forward_time: 3.9292929173, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3716461658
validation[          , genome  2240] predictions:    9346/  10000 (93.46%), best:    9346/10000 (93.46%), error:      2261.83765, best error:      2261.83765 on epoch:    14, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 45.9451980591s, input_fired_time: 0.3932965994, output_fired_time: 0.2764174044, propagate_forward_time: 17.7426490784, propagate_backward_time: 25.5847682953, weight_update_time: 0.0812974423, other_time: 1.9480686188
epoch time: 4.3412165642s, input_fired_time: 0.0468738265, output_fired_time: 0.0000000000, propagate_forward_time: 3.9214463234, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3728961945
validation[          , genome  2240] predictions:    9347/  10000 (93.47%), best:    9347/10000 (93.47%), error:      2260.64062, best error:      2260.64062 on epoch:    15, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 46.9373741150s, input_fired_time: 0.3983989358, output_fired_time: 0.2856649160, propagate_forward_time: 18.1519165039, propagate_backward_time: 26.1203975677, weight_update_time: 0.0831216276, other_time: 1.9809970856
epoch time: 4.3403925896s, input_fired_time: 0.0459437519, output_fired_time: 0.0000000000, propagate_forward_time: 3.9237051010, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3707437515
validation[          , genome  2240] predictions:    9272/  10000 (92.72%), best:    9347/10000 (93.47%), error:      2401.08179, best error:      2260.64062 on epoch:    15, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 47.7047462463s, input_fired_time: 0.3944045305, output_fired_time: 0.2809345722, propagate_forward_time: 18.4163036346, propagate_backward_time: 26.6360988617, weight_update_time: 0.0835485011, other_time: 1.9770050049
epoch time: 4.3092312813s, input_fired_time: 0.0469512790, output_fired_time: 0.0000000000, propagate_forward_time: 3.8899664879, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3723134995
validation[          , genome  2240] predictions:    9320/  10000 (93.20%), best:    9347/10000 (93.47%), error:      2274.26733, best error:      2260.64062 on epoch:    15, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 50.3748130798s, input_fired_time: 0.4112212658, output_fired_time: 0.2954756320, propagate_forward_time: 19.4562931061, propagate_backward_time: 28.1503906250, weight_update_time: 0.0875015259, other_time: 2.0614337921
epoch time: 4.3102931976s, input_fired_time: 0.0462185107, output_fired_time: 0.0000000000, propagate_forward_time: 3.9002952576, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3637795448
validation[          , genome  2240] predictions:    9336/  10000 (93.36%), best:    9347/10000 (93.47%), error:      2325.43213, best error:      2260.64062 on epoch:    15, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 50.4435844421s, input_fired_time: 0.4121191800, output_fired_time: 0.3004888594, propagate_forward_time: 19.5589027405, propagate_backward_time: 28.1355667114, weight_update_time: 0.0871294588, other_time: 2.0365066528
epoch time: 4.3350610733s, input_fired_time: 0.0463666208, output_fired_time: 0.0000000000, propagate_forward_time: 3.9136686325, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3750257492
validation[          , genome  2240] predictions:    9323/  10000 (93.23%), best:    9347/10000 (93.47%), error:      2298.89331, best error:      2260.64062 on epoch:    15, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 50.4730491638s, input_fired_time: 0.4129727483, output_fired_time: 0.2972067297, propagate_forward_time: 19.5711727142, propagate_backward_time: 28.1513576508, weight_update_time: 0.0874256939, other_time: 2.0403404236
epoch time: 4.3309831619s, input_fired_time: 0.0467460230, output_fired_time: 0.0000000000, propagate_forward_time: 3.9101774693, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3740594387
validation[          , genome  2240] predictions:    9341/  10000 (93.41%), best:    9347/10000 (93.47%), error:      2282.74536, best error:      2260.64062 on epoch:    15, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 50.4415664673s, input_fired_time: 0.4095242918, output_fired_time: 0.2978128195, propagate_forward_time: 19.5583667755, propagate_backward_time: 28.1327190399, weight_update_time: 0.0873007774, other_time: 2.0431442261
epoch time: 4.3229317665s, input_fired_time: 0.0466857851, output_fired_time: 0.0000000000, propagate_forward_time: 3.9048852921, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3713607788
validation[          , genome  2240] predictions:    9284/  10000 (92.84%), best:    9347/10000 (93.47%), error:      2404.23706, best error:      2260.64062 on epoch:    15, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 50.4743423462s, input_fired_time: 0.4144781530, output_fired_time: 0.2967207730, propagate_forward_time: 19.5778160095, propagate_backward_time: 28.1415214539, weight_update_time: 0.0878798142, other_time: 2.0438041687
epoch time: 4.5892996788s, input_fired_time: 0.0497021191, output_fired_time: 0.0000000000, propagate_forward_time: 4.1481752396, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3914222717
validation[          , genome  2240] predictions:    9361/  10000 (93.61%), best:    9361/10000 (93.61%), error:      2207.86182, best error:      2207.86182 on epoch:    22, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 51.3724594116s, input_fired_time: 0.4335336387, output_fired_time: 0.3076723814, propagate_forward_time: 19.9113883972, propagate_backward_time: 28.5937309265, weight_update_time: 0.0895991027, other_time: 2.1261367798
epoch time: 4.3254046440s, input_fired_time: 0.0473838374, output_fired_time: 0.0000000000, propagate_forward_time: 3.9078612328, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3701596260
validation[          , genome  2240] predictions:    9341/  10000 (93.41%), best:    9361/10000 (93.61%), error:      2264.71069, best error:      2207.86182 on epoch:    22, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 49.8562393188s, input_fired_time: 0.4161162078, output_fired_time: 0.2977664769, propagate_forward_time: 19.2757949829, propagate_backward_time: 27.7969055176, weight_update_time: 0.0866672099, other_time: 2.0696563721
epoch time: 4.3414320946s, input_fired_time: 0.0471090041, output_fired_time: 0.0000000000, propagate_forward_time: 3.9247915745, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3695313931
validation[          , genome  2240] predictions:    9328/  10000 (93.28%), best:    9361/10000 (93.61%), error:      2289.49854, best error:      2207.86182 on epoch:    22, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 48.9041976929s, input_fired_time: 0.4207475781, output_fired_time: 0.2914823294, propagate_forward_time: 18.9044227600, propagate_backward_time: 27.1839351654, weight_update_time: 0.0859786049, other_time: 2.1036128998
epoch time: 4.3469977379s, input_fired_time: 0.0481237099, output_fired_time: 0.0000000000, propagate_forward_time: 3.9230344296, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3758394718
validation[          , genome  2240] predictions:    9340/  10000 (93.40%), best:    9361/10000 (93.61%), error:      2253.62646, best error:      2207.86182 on epoch:    22, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 50.2796287537s, input_fired_time: 0.4148342609, output_fired_time: 0.2982888818, propagate_forward_time: 19.4839725494, propagate_backward_time: 28.0294246674, weight_update_time: 0.0869104341, other_time: 2.0531082153
epoch time: 4.3123607635s, input_fired_time: 0.0464816093, output_fired_time: 0.0000000000, propagate_forward_time: 3.8982918262, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3675873280
validation[          , genome  2240] predictions:    9336/  10000 (93.36%), best:    9361/10000 (93.61%), error:      2263.32080, best error:      2207.86182 on epoch:    22, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 50.3026466370s, input_fired_time: 0.4125747085, output_fired_time: 0.2980435789, propagate_forward_time: 19.5012817383, propagate_backward_time: 28.0756111145, weight_update_time: 0.0869671702, other_time: 2.0151367188
epoch time: 4.3521471024s, input_fired_time: 0.0474638045, output_fired_time: 0.0000000000, propagate_forward_time: 3.9316322803, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3730509281
validation[          , genome  2240] predictions:    9372/  10000 (93.72%), best:    9372/10000 (93.72%), error:      2169.77002, best error:      2169.77002 on epoch:    27, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 50.3279953003s, input_fired_time: 0.4127403200, output_fired_time: 0.2979621589, propagate_forward_time: 19.5063571930, propagate_backward_time: 28.0913047791, weight_update_time: 0.0870210603, other_time: 2.0196323395
epoch time: 4.3097372055s, input_fired_time: 0.0476083457, output_fired_time: 0.0000000000, propagate_forward_time: 3.9016120434, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3605167866
validation[          , genome  2240] predictions:    9357/  10000 (93.57%), best:    9372/10000 (93.72%), error:      2175.79248, best error:      2169.77002 on epoch:    27, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 50.2952499390s, input_fired_time: 0.4138490260, output_fired_time: 0.2984118462, propagate_forward_time: 19.4971466064, propagate_backward_time: 28.0555152893, weight_update_time: 0.0871595070, other_time: 2.0303268433
epoch time: 4.3140139580s, input_fired_time: 0.0474595390, output_fired_time: 0.0000000000, propagate_forward_time: 3.8953304291, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3712239265
validation[          , genome  2240] predictions:    9359/  10000 (93.59%), best:    9372/10000 (93.72%), error:      2199.68457, best error:      2169.77002 on epoch:    27, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 50.3201103210s, input_fired_time: 0.4160057902, output_fired_time: 0.2998633981, propagate_forward_time: 19.4963531494, propagate_backward_time: 28.0683059692, weight_update_time: 0.0879302472, other_time: 2.0395851135
epoch time: 4.3104915619s, input_fired_time: 0.0468317904, output_fired_time: 0.0000000000, propagate_forward_time: 3.8998324871, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3638274670
validation[          , genome  2240] predictions:    9378/  10000 (93.78%), best:    9378/10000 (93.78%), error:      2166.75073, best error:      2166.75073 on epoch:    30, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 49.0931549072s, input_fired_time: 0.4111454487, output_fired_time: 0.2883443832, propagate_forward_time: 19.0775604248, propagate_backward_time: 27.3332118988, weight_update_time: 0.0863266215, other_time: 1.9828929901
epoch time: 4.3058738708s, input_fired_time: 0.0469646566, output_fired_time: 0.0000000000, propagate_forward_time: 3.8974282742, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3614809513
validation[          , genome  2240] predictions:    9357/  10000 (93.57%), best:    9378/10000 (93.78%), error:      2232.54712, best error:      2166.75073 on epoch:    30, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 50.1776199341s, input_fired_time: 0.4169108272, output_fired_time: 0.2993656993, propagate_forward_time: 19.4235172272, propagate_backward_time: 27.9982795715, weight_update_time: 0.0874601826, other_time: 2.0395450592
epoch time: 2.9214861393s, input_fired_time: 0.0377292894, output_fired_time: 0.0000000000, propagate_forward_time: 2.5840303898, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2997264862
validation[          , genome  2240] predictions:    9320/  10000 (93.20%), best:    9378/10000 (93.78%), error:      2227.11572, best error:      2166.75073 on epoch:    30, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 50.0702247620s, input_fired_time: 0.4183647037, output_fired_time: 0.2936126590, propagate_forward_time: 19.4348258972, propagate_backward_time: 27.8914413452, weight_update_time: 0.0868267268, other_time: 2.0319786072
epoch time: 4.3213868141s, input_fired_time: 0.0483167470, output_fired_time: 0.0000000000, propagate_forward_time: 3.9041435719, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3689262867
validation[          , genome  2240] predictions:    9322/  10000 (93.22%), best:    9378/10000 (93.78%), error:      2314.86572, best error:      2166.75073 on epoch:    30, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 50.5087013245s, input_fired_time: 0.4206394553, output_fired_time: 0.3008635044, propagate_forward_time: 19.5422687531, propagate_backward_time: 28.2003173828, weight_update_time: 0.0879830718, other_time: 2.0446109772
epoch time: 4.3191204071s, input_fired_time: 0.0476989523, output_fired_time: 0.0000000000, propagate_forward_time: 3.9033238888, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3680975437
validation[          , genome  2240] predictions:    9308/  10000 (93.08%), best:    9378/10000 (93.78%), error:      2325.14258, best error:      2166.75073 on epoch:    30, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 50.4373435974s, input_fired_time: 0.4193924367, output_fired_time: 0.3005500138, propagate_forward_time: 19.5252361298, propagate_backward_time: 28.1706352234, weight_update_time: 0.0879701152, other_time: 2.0215320587
epoch time: 4.3178935051s, input_fired_time: 0.0489741825, output_fired_time: 0.0000000000, propagate_forward_time: 3.9016456604, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3672738075
validation[          , genome  2240] predictions:    9361/  10000 (93.61%), best:    9361/10000 (93.61%), error:      2157.06250, best error:      2157.06250 on epoch:    35, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 50.0124473572s, input_fired_time: 0.4197059274, output_fired_time: 0.2980812788, propagate_forward_time: 19.3567256927, propagate_backward_time: 27.9261188507, weight_update_time: 0.0870573744, other_time: 2.0118179321
epoch time: 4.3192796707s, input_fired_time: 0.0481995940, output_fired_time: 0.0000000000, propagate_forward_time: 3.9025285244, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3685514927
validation[          , genome  2240] predictions:    9379/  10000 (93.79%), best:    9379/10000 (93.79%), error:      2132.51294, best error:      2132.51294 on epoch:    36, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 43.7331581116s, input_fired_time: 0.3922522366, output_fired_time: 0.2647564709, propagate_forward_time: 16.8989906311, propagate_backward_time: 24.2845172882, weight_update_time: 0.0781608149, other_time: 1.8926410675
epoch time: 4.3044614792s, input_fired_time: 0.0486466289, output_fired_time: 0.0000000000, propagate_forward_time: 3.8957853317, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3600296974
validation[          , genome  2240] predictions:    9355/  10000 (93.55%), best:    9379/10000 (93.79%), error:      2205.78247, best error:      2132.51294 on epoch:    36, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 50.3388099670s, input_fired_time: 0.4196344614, output_fired_time: 0.2969269156, propagate_forward_time: 19.5072383881, propagate_backward_time: 28.0795040131, weight_update_time: 0.0870417133, other_time: 2.0355033875
epoch time: 4.3162684441s, input_fired_time: 0.0479880609, output_fired_time: 0.0000000000, propagate_forward_time: 3.8984799385, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3698005676
validation[          , genome  2240] predictions:    9344/  10000 (93.44%), best:    9379/10000 (93.79%), error:      2167.47827, best error:      2132.51294 on epoch:    36, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 50.2782630920s, input_fired_time: 0.4185769856, output_fired_time: 0.2964742184, propagate_forward_time: 19.5068569183, propagate_backward_time: 28.0662593842, weight_update_time: 0.0866866112, other_time: 1.9900970459
epoch time: 4.3132228851s, input_fired_time: 0.0485455021, output_fired_time: 0.0000000000, propagate_forward_time: 3.8985185623, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3661589622
validation[          , genome  2240] predictions:    9363/  10000 (93.63%), best:    9379/10000 (93.79%), error:      2183.89282, best error:      2132.51294 on epoch:    36, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 49.0497817993s, input_fired_time: 0.4157161415, output_fired_time: 0.2938328683, propagate_forward_time: 19.0042915344, propagate_backward_time: 27.3178520203, weight_update_time: 0.0858090818, other_time: 2.0180892944
epoch time: 4.3179869652s, input_fired_time: 0.0487871133, output_fired_time: 0.0000000000, propagate_forward_time: 3.8950986862, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3741011620
validation[          , genome  2240] predictions:    9343/  10000 (93.43%), best:    9379/10000 (93.79%), error:      2246.39746, best error:      2132.51294 on epoch:    36, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 50.3159217834s, input_fired_time: 0.4230997860, output_fired_time: 0.2988228798, propagate_forward_time: 19.4855957031, propagate_backward_time: 28.0596904755, weight_update_time: 0.0877877846, other_time: 2.0487117767
epoch time: 4.3151531219s, input_fired_time: 0.0483913645, output_fired_time: 0.0000000000, propagate_forward_time: 3.8951597214, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3716020584
validation[          , genome  2240] predictions:    9385/  10000 (93.85%), best:    9379/10000 (93.79%), error:      2137.53223, best error:      2132.51294 on epoch:    36, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 50.1841392517s, input_fired_time: 0.4229379296, output_fired_time: 0.2933571339, propagate_forward_time: 19.5089855194, propagate_backward_time: 27.9415836334, weight_update_time: 0.0878002122, other_time: 2.0172729492
epoch time: 4.3066873550s, input_fired_time: 0.0481432267, output_fired_time: 0.0000000000, propagate_forward_time: 3.8933949471, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3651490211
validation[          , genome  2240] predictions:    9383/  10000 (93.83%), best:    9379/10000 (93.79%), error:      2216.83179, best error:      2132.51294 on epoch:    36, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 50.3120574951s, input_fired_time: 0.4229489863, output_fired_time: 0.2991711795, propagate_forward_time: 19.4914836884, propagate_backward_time: 28.0578727722, weight_update_time: 0.0875728205, other_time: 2.0405788422
epoch time: 4.3159899712s, input_fired_time: 0.0487270132, output_fired_time: 0.0000000000, propagate_forward_time: 3.8969175816, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3703453541
validation[          , genome  2240] predictions:    9369/  10000 (93.69%), best:    9379/10000 (93.79%), error:      2158.03735, best error:      2132.51294 on epoch:    36, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 49.3408126831s, input_fired_time: 0.4183797538, output_fired_time: 0.2953359485, propagate_forward_time: 19.1030197144, propagate_backward_time: 27.5051574707, weight_update_time: 0.0856975615, other_time: 2.0189170837
epoch time: 4.3307590485s, input_fired_time: 0.0486703329, output_fired_time: 0.0000000000, propagate_forward_time: 3.9124951363, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3695936203
validation[          , genome  2240] predictions:    9370/  10000 (93.70%), best:    9379/10000 (93.79%), error:      2155.11743, best error:      2132.51294 on epoch:    36, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 50.4332313538s, input_fired_time: 0.4206496775, output_fired_time: 0.2990638912, propagate_forward_time: 19.5547904968, propagate_backward_time: 28.1473293304, weight_update_time: 0.0868574828, other_time: 2.0113964081
epoch time: 4.3244018555s, input_fired_time: 0.0486697629, output_fired_time: 0.0000000000, propagate_forward_time: 3.9106640816, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3650679588
validation[          , genome  2240] predictions:    9358/  10000 (93.58%), best:    9379/10000 (93.79%), error:      2202.71826, best error:      2132.51294 on epoch:    36, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 50.2159881592s, input_fired_time: 0.4229605198, output_fired_time: 0.2952820659, propagate_forward_time: 19.4532775879, propagate_backward_time: 28.0238952637, weight_update_time: 0.0874868184, other_time: 2.0205726624
epoch time: 4.3224039078s, input_fired_time: 0.0497681163, output_fired_time: 0.0000000000, propagate_forward_time: 3.8977246284, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3749113083
validation[          , genome  2240] predictions:    9374/  10000 (93.74%), best:    9379/10000 (93.79%), error:      2144.71362, best error:      2132.51294 on epoch:    36, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 50.3952522278s, input_fired_time: 0.4241881371, output_fired_time: 0.2982915342, propagate_forward_time: 19.5006980896, propagate_backward_time: 28.1291236877, weight_update_time: 0.0880148262, other_time: 2.0429534912
epoch time: 4.3200688362s, input_fired_time: 0.0499700345, output_fired_time: 0.0000000000, propagate_forward_time: 3.9028537273, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3672449589
validation[          , genome  2240] predictions:    9385/  10000 (93.85%), best:    9385/10000 (93.85%), error:      2116.19043, best error:      2116.19043 on epoch:    47, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 50.3369102478s, input_fired_time: 0.4228079319, output_fired_time: 0.2960220873, propagate_forward_time: 19.4867286682, propagate_backward_time: 28.0981903076, weight_update_time: 0.0870977715, other_time: 2.0331611633
epoch time: 4.3147044182s, input_fired_time: 0.0486005470, output_fired_time: 0.0000000000, propagate_forward_time: 3.8980593681, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3680443764
validation[          , genome  2240] predictions:    9379/  10000 (93.79%), best:    9385/10000 (93.85%), error:      2185.76953, best error:      2116.19043 on epoch:    47, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 50.2941398621s, input_fired_time: 0.4216064811, output_fired_time: 0.2960507870, propagate_forward_time: 19.4847030640, propagate_backward_time: 28.0957069397, weight_update_time: 0.0871901363, other_time: 1.9960708618
epoch time: 4.3110752106s, input_fired_time: 0.0494119674, output_fired_time: 0.0000000000, propagate_forward_time: 3.8975622654, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3641011715
validation[          , genome  2240] predictions:    9376/  10000 (93.76%), best:    9385/10000 (93.85%), error:      2173.51562, best error:      2116.19043 on epoch:    47, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 50.1856040955s, input_fired_time: 0.4226341844, output_fired_time: 0.2921430171, propagate_forward_time: 19.4577693939, propagate_backward_time: 27.9930801392, weight_update_time: 0.0863160118, other_time: 2.0199756622
epoch time: 4.2923412323s, input_fired_time: 0.0495092906, output_fired_time: 0.0000000000, propagate_forward_time: 3.8766887188, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3661429882
validation[          , genome  2240] predictions:    9345/  10000 (93.45%), best:    9385/10000 (93.85%), error:      2232.57300, best error:      2116.19043 on epoch:    47, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 50.0639648438s, input_fired_time: 0.4188966155, output_fired_time: 0.2881020904, propagate_forward_time: 19.4691772461, propagate_backward_time: 27.8948307037, weight_update_time: 0.0876556113, other_time: 1.9929599762
epoch time: 4.3126735687s, input_fired_time: 0.0494917296, output_fired_time: 0.0000000000, propagate_forward_time: 3.9052102566, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3579714298
validation[          , genome  2240] predictions:    9376/  10000 (93.76%), best:    9385/10000 (93.85%), error:      2200.80420, best error:      2116.19043 on epoch:    47, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 50.5924835205s, input_fired_time: 0.4249382615, output_fired_time: 0.2991972864, propagate_forward_time: 19.6112194061, propagate_backward_time: 28.2255783081, weight_update_time: 0.0871664509, other_time: 2.0315494537
epoch time: 4.3323135376s, input_fired_time: 0.0496271849, output_fired_time: 0.0000000000, propagate_forward_time: 3.9127085209, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3699777126
validation[          , genome  2240] predictions:    9376/  10000 (93.76%), best:    9385/10000 (93.85%), error:      2153.05103, best error:      2116.19043 on epoch:    47, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 49.3538360596s, input_fired_time: 0.4241612256, output_fired_time: 0.2961878181, propagate_forward_time: 19.0516433716, propagate_backward_time: 27.5635452271, weight_update_time: 0.0861427933, other_time: 2.0182991028
epoch time: 3.2525391579s, input_fired_time: 0.0413135327, output_fired_time: 0.0000000000, propagate_forward_time: 2.8828887939, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3283367157
validation[          , genome  2240] predictions:    9357/  10000 (93.57%), best:    9385/10000 (93.85%), error:      2237.96606, best error:      2116.19043 on epoch:    47, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 50.2286949158s, input_fired_time: 0.4279952943, output_fired_time: 0.2969898283, propagate_forward_time: 19.4520587921, propagate_backward_time: 28.0153160095, weight_update_time: 0.0865407437, other_time: 2.0363368988
epoch time: 4.3294987679s, input_fired_time: 0.0500567369, output_fired_time: 0.0000000000, propagate_forward_time: 3.9062840939, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3731577396
validation[          , genome  2240] predictions:    9374/  10000 (93.74%), best:    9385/10000 (93.85%), error:      2145.30225, best error:      2116.19043 on epoch:    47, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 50.4210166931s, input_fired_time: 0.4294000268, output_fired_time: 0.2975154817, propagate_forward_time: 19.5200996399, propagate_backward_time: 28.1264152527, weight_update_time: 0.0884145498, other_time: 2.0475845337
epoch time: 4.3251628876s, input_fired_time: 0.0494473912, output_fired_time: 0.0000000000, propagate_forward_time: 3.9055912495, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3701241016
validation[          , genome  2240] predictions:    9352/  10000 (93.52%), best:    9385/10000 (93.85%), error:      2262.71045, best error:      2116.19043 on epoch:    47, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 50.3786430359s, input_fired_time: 0.4302579463, output_fired_time: 0.3011350036, propagate_forward_time: 19.4828929901, propagate_backward_time: 28.1343364716, weight_update_time: 0.0879830569, other_time: 2.0300178528
epoch time: 4.3134765625s, input_fired_time: 0.0497202128, output_fired_time: 0.0000000000, propagate_forward_time: 3.8994889259, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3642673492
validation[          , genome  2240] predictions:    9379/  10000 (93.79%), best:    9379/10000 (93.79%), error:      2081.78662, best error:      2081.78662 on epoch:    56, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 50.4910163879s, input_fired_time: 0.4291815162, output_fired_time: 0.3028377891, propagate_forward_time: 19.5302429199, propagate_backward_time: 28.2232856750, weight_update_time: 0.0879141986, other_time: 2.0054702759
epoch time: 4.3263459206s, input_fired_time: 0.0487792790, output_fired_time: 0.0000000000, propagate_forward_time: 3.9093341827, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3682322502
validation[          , genome  2240] predictions:    9368/  10000 (93.68%), best:    9379/10000 (93.79%), error:      2144.12427, best error:      2081.78662 on epoch:    56, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 47.2056198120s, input_fired_time: 0.4142742753, output_fired_time: 0.2860365212, propagate_forward_time: 18.2300376892, propagate_backward_time: 26.3182353973, weight_update_time: 0.0823188424, other_time: 1.9570331573
epoch time: 4.3206591606s, input_fired_time: 0.0503406040, output_fired_time: 0.0000000000, propagate_forward_time: 3.9062678814, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3640506268
validation[          , genome  2240] predictions:    9384/  10000 (93.84%), best:    9384/10000 (93.84%), error:      2079.43848, best error:      2079.43848 on epoch:    58, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 50.3025550842s, input_fired_time: 0.4267351627, output_fired_time: 0.2992540300, propagate_forward_time: 19.5125484467, propagate_backward_time: 28.0782833099, weight_update_time: 0.0866679475, other_time: 1.9857330322
epoch time: 3.1329531670s, input_fired_time: 0.0413052291, output_fired_time: 0.0000000000, propagate_forward_time: 2.7855880260, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3060598373
validation[          , genome  2240] predictions:    9371/  10000 (93.71%), best:    9384/10000 (93.84%), error:      2122.54810, best error:      2079.43848 on epoch:    58, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 47.7122230530s, input_fired_time: 0.4158184826, output_fired_time: 0.2854499519, propagate_forward_time: 18.4598503113, propagate_backward_time: 26.6087684631, weight_update_time: 0.0831653327, other_time: 1.9423370361
epoch time: 4.3148899078s, input_fired_time: 0.0494617857, output_fired_time: 0.0000000000, propagate_forward_time: 3.9013659954, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3640620708
validation[          , genome  2240] predictions:    9364/  10000 (93.64%), best:    9384/10000 (93.84%), error:      2173.30176, best error:      2079.43848 on epoch:    58, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 48.3965377808s, input_fired_time: 0.4196581542, output_fired_time: 0.2888202965, propagate_forward_time: 18.7244491577, propagate_backward_time: 27.0077075958, weight_update_time: 0.0845511183, other_time: 1.9559001923
epoch time: 4.3021345139s, input_fired_time: 0.0494576357, output_fired_time: 0.0000000000, propagate_forward_time: 3.8871531487, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3655238152
validation[          , genome  2240] predictions:    9329/  10000 (93.29%), best:    9384/10000 (93.84%), error:      2254.39429, best error:      2079.43848 on epoch:    58, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 50.1785125732s, input_fired_time: 0.4280188382, output_fired_time: 0.3004415333, propagate_forward_time: 19.4006156921, propagate_backward_time: 28.0501823425, weight_update_time: 0.0874026194, other_time: 1.9992523193
epoch time: 4.3016610146s, input_fired_time: 0.0507067479, output_fired_time: 0.0000000000, propagate_forward_time: 3.8884408474, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3625133038
validation[          , genome  2240] predictions:    9379/  10000 (93.79%), best:    9384/10000 (93.84%), error:      2122.14600, best error:      2079.43848 on epoch:    58, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 50.2818222046s, input_fired_time: 0.4317051768, output_fired_time: 0.3007419705, propagate_forward_time: 19.4617385864, propagate_backward_time: 28.0974426270, weight_update_time: 0.0877014846, other_time: 1.9901924133
epoch time: 4.3255815506s, input_fired_time: 0.0503774434, output_fired_time: 0.0000000000, propagate_forward_time: 3.9082725048, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3669316769
validation[          , genome  2240] predictions:    9401/  10000 (94.01%), best:    9384/10000 (93.84%), error:      2147.99121, best error:      2079.43848 on epoch:    58, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 50.5101127625s, input_fired_time: 0.4323020875, output_fired_time: 0.3022737503, propagate_forward_time: 19.5538330078, propagate_backward_time: 28.2207279205, weight_update_time: 0.0876686200, other_time: 2.0009784698
epoch time: 4.3323798180s, input_fired_time: 0.0501638949, output_fired_time: 0.0000000000, propagate_forward_time: 3.9179849625, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3642311096
validation[          , genome  2240] predictions:    9397/  10000 (93.97%), best:    9384/10000 (93.84%), error:      2139.70166, best error:      2079.43848 on epoch:    58, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 50.5831298828s, input_fired_time: 0.4333111644, output_fired_time: 0.3020243347, propagate_forward_time: 19.5832691193, propagate_backward_time: 28.2615489960, weight_update_time: 0.0875564888, other_time: 2.0029754639
epoch time: 4.3167090416s, input_fired_time: 0.0494795069, output_fired_time: 0.0000000000, propagate_forward_time: 3.9049572945, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3622722626
validation[          , genome  2240] predictions:    9339/  10000 (93.39%), best:    9384/10000 (93.84%), error:      2215.13428, best error:      2079.43848 on epoch:    58, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 50.2634086609s, input_fired_time: 0.4304702282, output_fired_time: 0.2927344143, propagate_forward_time: 19.5324153900, propagate_backward_time: 28.0187397003, weight_update_time: 0.0876894742, other_time: 1.9890480042
epoch time: 4.3155021667s, input_fired_time: 0.0509096868, output_fired_time: 0.0000000000, propagate_forward_time: 3.9058866501, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3587059975
validation[          , genome  2240] predictions:    9401/  10000 (94.01%), best:    9401/10000 (94.01%), error:      2068.30103, best error:      2068.30103 on epoch:    66, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 50.1741638184s, input_fired_time: 0.4271449447, output_fired_time: 0.2896837890, propagate_forward_time: 19.5175666809, propagate_backward_time: 27.9527301788, weight_update_time: 0.0878215134, other_time: 1.9870395660
epoch time: 4.3281788826s, input_fired_time: 0.0504708439, output_fired_time: 0.0000000000, propagate_forward_time: 3.9133846760, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3643233776
validation[          , genome  2240] predictions:    9363/  10000 (93.63%), best:    9401/10000 (94.01%), error:      2141.65747, best error:      2068.30103 on epoch:    66, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 50.6460609436s, input_fired_time: 0.4340910017, output_fired_time: 0.3036656082, propagate_forward_time: 19.5853786469, propagate_backward_time: 28.3020381927, weight_update_time: 0.0886834636, other_time: 2.0208892822
epoch time: 4.3256258965s, input_fired_time: 0.0506336503, output_fired_time: 0.0000000000, propagate_forward_time: 3.9113302231, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3636622429
validation[          , genome  2240] predictions:    9364/  10000 (93.64%), best:    9401/10000 (94.01%), error:      2174.14990, best error:      2068.30103 on epoch:    66, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 50.3988723755s, input_fired_time: 0.4337548912, output_fired_time: 0.3008790612, propagate_forward_time: 19.5633373260, propagate_backward_time: 28.1013469696, weight_update_time: 0.0876192078, other_time: 1.9995536804
epoch time: 4.3287158012s, input_fired_time: 0.0511564277, output_fired_time: 0.0000000000, propagate_forward_time: 3.9115478992, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3660113811
validation[          , genome  2240] predictions:    9371/  10000 (93.71%), best:    9401/10000 (94.01%), error:      2225.07812, best error:      2068.30103 on epoch:    66, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 50.5114784241s, input_fired_time: 0.4345635474, output_fired_time: 0.3024236560, propagate_forward_time: 19.5508460999, propagate_backward_time: 28.2053890228, weight_update_time: 0.0888311043, other_time: 2.0182552338
epoch time: 4.3193106651s, input_fired_time: 0.0518981256, output_fired_time: 0.0000000000, propagate_forward_time: 3.9001653194, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3672473431
validation[          , genome  2240] predictions:    9371/  10000 (93.71%), best:    9401/10000 (94.01%), error:      2126.39990, best error:      2068.30103 on epoch:    66, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 50.4093894958s, input_fired_time: 0.4328767359, output_fired_time: 0.3009282947, propagate_forward_time: 19.5216770172, propagate_backward_time: 28.1602191925, weight_update_time: 0.0877238810, other_time: 1.9936866760
epoch time: 4.3162560463s, input_fired_time: 0.0505733341, output_fired_time: 0.0000000000, propagate_forward_time: 3.9025094509, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3631732464
validation[          , genome  2240] predictions:    9378/  10000 (93.78%), best:    9401/10000 (94.01%), error:      2115.25269, best error:      2068.30103 on epoch:    66, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 50.5060997009s, input_fired_time: 0.4330288172, output_fired_time: 0.3004742861, propagate_forward_time: 19.5333309174, propagate_backward_time: 28.2373409271, weight_update_time: 0.0875762179, other_time: 2.0019226074
epoch time: 4.3194961548s, input_fired_time: 0.0501612164, output_fired_time: 0.0000000000, propagate_forward_time: 3.9065783024, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3627564907
validation[          , genome  2240] predictions:    9374/  10000 (93.74%), best:    9401/10000 (94.01%), error:      2099.09619, best error:      2068.30103 on epoch:    66, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 50.4211730957s, input_fired_time: 0.4323213100, output_fired_time: 0.2994097173, propagate_forward_time: 19.4985980988, propagate_backward_time: 28.1929378510, weight_update_time: 0.0877001733, other_time: 1.9979095459
epoch time: 4.3197226524s, input_fired_time: 0.0503616370, output_fired_time: 0.0000000000, propagate_forward_time: 3.9116022587, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3577587605
validation[          , genome  2240] predictions:    9386/  10000 (93.86%), best:    9401/10000 (94.01%), error:      2134.33447, best error:      2068.30103 on epoch:    66, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 50.3910446167s, input_fired_time: 0.4337872267, output_fired_time: 0.2994187474, propagate_forward_time: 19.5750923157, propagate_backward_time: 28.0853805542, weight_update_time: 0.0875751376, other_time: 1.9973640442
epoch time: 4.3178172112s, input_fired_time: 0.0508732684, output_fired_time: 0.0000000000, propagate_forward_time: 3.9064598083, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3604841232
validation[          , genome  2240] predictions:    9401/  10000 (94.01%), best:    9401/10000 (94.01%), error:      2113.37354, best error:      2068.30103 on epoch:    66, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 50.4045677185s, input_fired_time: 0.4358125925, output_fired_time: 0.2982574701, propagate_forward_time: 19.5607280731, propagate_backward_time: 28.1147956848, weight_update_time: 0.0876540393, other_time: 1.9949741364
epoch time: 4.3257870674s, input_fired_time: 0.0511772521, output_fired_time: 0.0000000000, propagate_forward_time: 3.9149408340, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3596692085
validation[          , genome  2240] predictions:    9372/  10000 (93.72%), best:    9401/10000 (94.01%), error:      2108.82202, best error:      2068.30103 on epoch:    66, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 50.4072837830s, input_fired_time: 0.4390437603, output_fired_time: 0.3014551103, propagate_forward_time: 19.4937591553, propagate_backward_time: 28.1574764252, weight_update_time: 0.0882629827, other_time: 2.0155467987
epoch time: 4.3151397705s, input_fired_time: 0.0513095260, output_fired_time: 0.0000000000, propagate_forward_time: 3.8969733715, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3668568134
validation[          , genome  2240] predictions:    9393/  10000 (93.93%), best:    9401/10000 (94.01%), error:      2100.06226, best error:      2068.30103 on epoch:    66, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 50.3429565430s, input_fired_time: 0.4364720285, output_fired_time: 0.2984406054, propagate_forward_time: 19.4809150696, propagate_backward_time: 28.1150989532, weight_update_time: 0.0883948356, other_time: 2.0120296478
epoch time: 4.3084626198s, input_fired_time: 0.0508576371, output_fired_time: 0.0000000000, propagate_forward_time: 3.9000413418, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3575637341
validation[          , genome  2240] predictions:    9394/  10000 (93.94%), best:    9401/10000 (94.01%), error:      2074.51831, best error:      2068.30103 on epoch:    66, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 50.5301208496s, input_fired_time: 0.4352191389, output_fired_time: 0.3012276590, propagate_forward_time: 19.5712375641, propagate_backward_time: 28.2282695770, weight_update_time: 0.0876270458, other_time: 1.9941673279
epoch time: 4.3321309090s, input_fired_time: 0.0515925139, output_fired_time: 0.0000000000, propagate_forward_time: 3.9164810181, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3640575409
validation[          , genome  2240] predictions:    9400/  10000 (94.00%), best:    9401/10000 (94.01%), error:      2109.82129, best error:      2068.30103 on epoch:    66, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 50.4374465942s, input_fired_time: 0.4366930127, output_fired_time: 0.3006281853, propagate_forward_time: 19.5392894745, propagate_backward_time: 28.1668834686, weight_update_time: 0.0877207741, other_time: 1.9939537048
epoch time: 4.3168692589s, input_fired_time: 0.0510578193, output_fired_time: 0.0000000000, propagate_forward_time: 3.9022760391, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3635354042
validation[          , genome  2240] predictions:    9393/  10000 (93.93%), best:    9401/10000 (94.01%), error:      2107.42725, best error:      2068.30103 on epoch:    66, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 50.4396896362s, input_fired_time: 0.4378995597, output_fired_time: 0.3016468883, propagate_forward_time: 19.5143871307, propagate_backward_time: 28.1825942993, weight_update_time: 0.0879558474, other_time: 2.0031604767
epoch time: 4.3097457886s, input_fired_time: 0.0510256439, output_fired_time: 0.0000000000, propagate_forward_time: 3.8981864452, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3605334759
validation[          , genome  2240] predictions:    9405/  10000 (94.05%), best:    9401/10000 (94.01%), error:      2080.47998, best error:      2068.30103 on epoch:    66, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 50.7474479675s, input_fired_time: 0.4417992830, output_fired_time: 0.3033990264, propagate_forward_time: 19.6912250519, propagate_backward_time: 28.3037414551, weight_update_time: 0.0879856423, other_time: 2.0072841644
epoch time: 4.3086271286s, input_fired_time: 0.0508126654, output_fired_time: 0.0000000000, propagate_forward_time: 3.8930587769, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3647556305
validation[          , genome  2240] predictions:    9373/  10000 (93.73%), best:    9401/10000 (94.01%), error:      2149.03101, best error:      2068.30103 on epoch:    66, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 51.7650604248s, input_fired_time: 0.4465244710, output_fired_time: 0.3117641807, propagate_forward_time: 20.0741653442, propagate_backward_time: 28.8809528351, weight_update_time: 0.0886977613, other_time: 2.0516529083
epoch time: 4.3303999901s, input_fired_time: 0.0514942780, output_fired_time: 0.0000000000, propagate_forward_time: 3.9148683548, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3640375137
validation[          , genome  2240] predictions:    9385/  10000 (93.85%), best:    9401/10000 (94.01%), error:      2110.22681, best error:      2068.30103 on epoch:    66, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 50.3345870972s, input_fired_time: 0.4370643795, output_fired_time: 0.2925097942, propagate_forward_time: 19.5785083771, propagate_backward_time: 28.0101928711, weight_update_time: 0.0883983225, other_time: 2.0163097382
epoch time: 4.3126139641s, input_fired_time: 0.0513878018, output_fired_time: 0.0000000000, propagate_forward_time: 3.8970515728, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3641746044
validation[          , genome  2240] predictions:    9373/  10000 (93.73%), best:    9401/10000 (94.01%), error:      2128.65088, best error:      2068.30103 on epoch:    66, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 50.3449134827s, input_fired_time: 0.4399053454, output_fired_time: 0.2995516658, propagate_forward_time: 19.4966316223, propagate_backward_time: 28.0871715546, weight_update_time: 0.0881399363, other_time: 2.0216503143
epoch time: 4.3479866982s, input_fired_time: 0.0520584397, output_fired_time: 0.0000000000, propagate_forward_time: 3.9319493771, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3639791012
validation[          , genome  2240] predictions:    9387/  10000 (93.87%), best:    9401/10000 (94.01%), error:      2118.31738, best error:      2068.30103 on epoch:    66, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 50.3115844727s, input_fired_time: 0.4367269874, output_fired_time: 0.2985445857, propagate_forward_time: 19.4960002899, propagate_backward_time: 28.0756683350, weight_update_time: 0.0875888169, other_time: 2.0046443939
epoch time: 4.3042464256s, input_fired_time: 0.0523723960, output_fired_time: 0.0000000000, propagate_forward_time: 3.8861892223, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3656847477
validation[          , genome  2240] predictions:    9393/  10000 (93.93%), best:    9401/10000 (94.01%), error:      2112.18896, best error:      2068.30103 on epoch:    66, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 50.7127876282s, input_fired_time: 0.4540600479, output_fired_time: 0.3009518385, propagate_forward_time: 19.6402912140, propagate_backward_time: 28.2806072235, weight_update_time: 0.0889027417, other_time: 2.0368766785
epoch time: 4.3240799904s, input_fired_time: 0.0520698465, output_fired_time: 0.0000000000, propagate_forward_time: 3.9078044891, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3642058372
validation[          , genome  2240] predictions:    9392/  10000 (93.92%), best:    9401/10000 (94.01%), error:      2105.22632, best error:      2068.30103 on epoch:    66, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 51.0984039307s, input_fired_time: 0.4514243007, output_fired_time: 0.3072404861, propagate_forward_time: 19.7664108276, propagate_backward_time: 28.5329074860, weight_update_time: 0.0894544423, other_time: 2.0404224396
epoch time: 4.3621158600s, input_fired_time: 0.0526669212, output_fired_time: 0.0000000000, propagate_forward_time: 3.9438433647, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3656053543
validation[          , genome  2240] predictions:    9401/  10000 (94.01%), best:    9401/10000 (94.01%), error:      2076.02490, best error:      2068.30103 on epoch:    66, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 50.4338302612s, input_fired_time: 0.4401066005, output_fired_time: 0.2974029183, propagate_forward_time: 19.5586853027, propagate_backward_time: 28.1362209320, weight_update_time: 0.0875774622, other_time: 2.0014171600
epoch time: 4.8653836250s, input_fired_time: 0.0625524372, output_fired_time: 0.0000000000, propagate_forward_time: 4.3953905106, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4074406624
validation[          , genome  2240] predictions:    9349/  10000 (93.49%), best:    9401/10000 (94.01%), error:      2207.81128, best error:      2068.30103 on epoch:    66, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 50.4873428345s, input_fired_time: 0.4406878054, output_fired_time: 0.3014999330, propagate_forward_time: 19.5569858551, propagate_backward_time: 28.1792488098, weight_update_time: 0.0878794938, other_time: 2.0089206696
epoch time: 4.3232231140s, input_fired_time: 0.0523771532, output_fired_time: 0.0000000000, propagate_forward_time: 3.9086980820, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3621478081
validation[          , genome  2240] predictions:    9379/  10000 (93.79%), best:    9401/10000 (94.01%), error:      2114.78516, best error:      2068.30103 on epoch:    66, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 50.3394203186s, input_fired_time: 0.4376866519, output_fired_time: 0.2988964319, propagate_forward_time: 19.5194454193, propagate_backward_time: 28.0857391357, weight_update_time: 0.0870046169, other_time: 1.9976520538
epoch time: 4.2956633568s, input_fired_time: 0.0512630343, output_fired_time: 0.0000000000, propagate_forward_time: 3.8825562000, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3618443012
validation[          , genome  2240] predictions:    9379/  10000 (93.79%), best:    9401/10000 (94.01%), error:      2129.28174, best error:      2068.30103 on epoch:    66, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 49.8691101074s, input_fired_time: 0.4347565174, output_fired_time: 0.2971333563, propagate_forward_time: 19.3076076508, propagate_backward_time: 27.8332672119, weight_update_time: 0.0870971829, other_time: 1.9963436127
epoch time: 4.3039102554s, input_fired_time: 0.0520968661, output_fired_time: 0.0000000000, propagate_forward_time: 3.8879003525, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3639130592
validation[          , genome  2240] predictions:    9398/  10000 (93.98%), best:    9398/10000 (93.98%), error:      2064.90527, best error:      2064.90527 on epoch:    91, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 50.2636337280s, input_fired_time: 0.4374854863, output_fired_time: 0.2998810410, propagate_forward_time: 19.4772911072, propagate_backward_time: 28.0417308807, weight_update_time: 0.0873071104, other_time: 2.0072460175
epoch time: 4.2524676323s, input_fired_time: 0.0520947613, output_fired_time: 0.0000000000, propagate_forward_time: 3.8345980644, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3657746315
validation[          , genome  2240] predictions:    9395/  10000 (93.95%), best:    9398/10000 (93.98%), error:      2090.21680, best error:      2064.90527 on epoch:    91, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 50.1471748352s, input_fired_time: 0.4364245236, output_fired_time: 0.2988723814, propagate_forward_time: 19.4050369263, propagate_backward_time: 28.0082626343, weight_update_time: 0.0869155079, other_time: 1.9985771179
epoch time: 4.3205704689s, input_fired_time: 0.0518970974, output_fired_time: 0.0000000000, propagate_forward_time: 3.9071903229, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3614830971
validation[          , genome  2240] predictions:    9392/  10000 (93.92%), best:    9392/10000 (93.92%), error:      2063.74829, best error:      2063.74829 on epoch:    93, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 50.7321853638s, input_fired_time: 0.4462779164, output_fired_time: 0.3014737666, propagate_forward_time: 19.6337223053, propagate_backward_time: 28.3286819458, weight_update_time: 0.0876473337, other_time: 2.0220279694
epoch time: 4.3003978729s, input_fired_time: 0.0525930338, output_fired_time: 0.0000000000, propagate_forward_time: 3.8805508614, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3672537804
validation[          , genome  2240] predictions:    9402/  10000 (94.02%), best:    9392/10000 (93.92%), error:      2078.84619, best error:      2063.74829 on epoch:    93, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 50.6825942993s, input_fired_time: 0.4437969923, output_fired_time: 0.2983797491, propagate_forward_time: 19.5941638947, propagate_backward_time: 28.3283691406, weight_update_time: 0.0872506723, other_time: 2.0178852081
epoch time: 4.3072743416s, input_fired_time: 0.0509879589, output_fired_time: 0.0000000000, propagate_forward_time: 3.8926887512, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3635978699
validation[          , genome  2240] predictions:    9385/  10000 (93.85%), best:    9392/10000 (93.92%), error:      2107.09937, best error:      2063.74829 on epoch:    93, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 50.3201332092s, input_fired_time: 0.4402234554, output_fired_time: 0.2990261316, propagate_forward_time: 19.4802703857, propagate_backward_time: 28.1055145264, weight_update_time: 0.0869618729, other_time: 1.9950981140
epoch time: 4.3267288208s, input_fired_time: 0.0531343706, output_fired_time: 0.0000000000, propagate_forward_time: 3.9072570801, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3663372993
validation[          , genome  2240] predictions:    9387/  10000 (93.87%), best:    9392/10000 (93.92%), error:      2101.26221, best error:      2063.74829 on epoch:    93, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 51.4192047119s, input_fired_time: 0.4557227790, output_fired_time: 0.3024059832, propagate_forward_time: 19.9248676300, propagate_backward_time: 28.6867160797, weight_update_time: 0.0876488015, other_time: 2.0494918823
epoch time: 4.3120770454s, input_fired_time: 0.0514153168, output_fired_time: 0.0000000000, propagate_forward_time: 3.9060001373, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3546614647
validation[          , genome  2240] predictions:    9402/  10000 (94.02%), best:    9402/10000 (94.02%), error:      2061.24780, best error:      2061.24780 on epoch:    97, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 50.2855300903s, input_fired_time: 0.4468215406, output_fired_time: 0.2930282354, propagate_forward_time: 19.5551338196, propagate_backward_time: 27.9721603394, weight_update_time: 0.0879255980, other_time: 2.0183830261
epoch time: 4.3510584831s, input_fired_time: 0.0567629747, output_fired_time: 0.0000000000, propagate_forward_time: 3.9318866730, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3624086380
validation[          , genome  2240] predictions:    9378/  10000 (93.78%), best:    9402/10000 (94.02%), error:      2117.09937, best error:      2061.24780 on epoch:    97, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 50.2586517334s, input_fired_time: 0.4415643811, output_fired_time: 0.2969092131, propagate_forward_time: 19.4671230316, propagate_backward_time: 28.0398693085, weight_update_time: 0.0880061984, other_time: 2.0131874084
epoch time: 4.3148527145s, input_fired_time: 0.0529476814, output_fired_time: 0.0000000000, propagate_forward_time: 3.8959004879, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3660047054
validation[          , genome  2240] predictions:    9388/  10000 (93.88%), best:    9402/10000 (94.02%), error:      2133.27173, best error:      2061.24780 on epoch:    97, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 50.0942573547s, input_fired_time: 0.4436170161, output_fired_time: 0.2987475395, propagate_forward_time: 19.3958282471, propagate_backward_time: 27.9512863159, weight_update_time: 0.0870935544, other_time: 2.0047760010
epoch time: 4.7019739151s, input_fired_time: 0.0576244481, output_fired_time: 0.0000000000, propagate_forward_time: 4.2435259819, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4008235931
validation[          , genome  2240] predictions:    9351/  10000 (93.51%), best:    9402/10000 (94.02%), error:      2171.45972, best error:      2061.24780 on epoch:    97, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 21.8556671143s, input_fired_time: 0.2708168030, output_fired_time: 0.0000000000, propagate_forward_time: 19.6877822876, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8970680237
best training[          , genome  2240] predictions:   47725/  50000 (95.45%), best:    9402/10000 (94.02%), error:      8282.47852, best error:      2061.24780 on epoch:    97, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 4.3216037750s, input_fired_time: 0.0520007238, output_fired_time: 0.0000000000, propagate_forward_time: 3.9035391808, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3660640717
   testing[          , genome  2240] predictions:    9416/  10000 (94.16%), best:    9402/10000 (94.02%), error:      2002.15771, best error:      2061.24780 on epoch:    97, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
08:20:38 (69844): called boinc_finish(0)

</stderr_txt>
]]>