Nameexact_genome_1509704703_28_14250_2
Workunit2356612
Created3 Dec 2017, 15:36:23 UTC
Sent3 Dec 2017, 15:56:15 UTC
Report deadline28 Dec 2017, 11:35:28 UTC
Received4 Dec 2017, 7:36:40 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID67174
Run time7 hours 31 min 33 sec
CPU time7 hours 31 min 33 sec
Validate stateValid
Credit6,204.73
Device peak FLOPS4.03 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.33
Peak working set size162.84 MB
Peak swap size164.62 MB
Peak disk usage2.28 MB

Stderr output

<core_client_version>7.6.31</core_client_version>
<![CDATA[
<stderr_txt>
ut_fired_time: 0.0000000000, propagate_forward_time: 18.8445091248, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8518562317
validation[          , genome 14250] predictions:    9772/  10000 (97.72%), best:    9806/10000 (98.06%), error:       750.15149, best error:       626.66815 on epoch:    10, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 244.8402709961s, input_fired_time: 4.2828307152, output_fired_time: 2.6983594894, propagate_forward_time: 93.4958114624, propagate_backward_time: 139.4561157227, weight_update_time: 0.3035537601, other_time: 4.9071350098
epoch time: 20.5019512177s, input_fired_time: 0.4492263496, output_fired_time: 0.0000000000, propagate_forward_time: 19.2067108154, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8460140228
validation[          , genome 14250] predictions:    9796/  10000 (97.96%), best:    9806/10000 (98.06%), error:       684.74078, best error:       626.66815 on epoch:    10, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 247.2886810303s, input_fired_time: 4.2895617485, output_fired_time: 2.7201085091, propagate_forward_time: 94.5990676880, propagate_backward_time: 140.8199462891, weight_update_time: 0.3048141301, other_time: 4.8599853516
epoch time: 20.0777111053s, input_fired_time: 0.4335399270, output_fired_time: 0.0000000000, propagate_forward_time: 18.8020420074, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8421287537
validation[          , genome 14250] predictions:    9791/  10000 (97.91%), best:    9806/10000 (98.06%), error:       695.05573, best error:       626.66815 on epoch:    10, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 247.3246154785s, input_fired_time: 4.2705607414, output_fired_time: 2.7416687012, propagate_forward_time: 94.4508056641, propagate_backward_time: 140.9730529785, weight_update_time: 0.3049801588, other_time: 4.8885345459
epoch time: 22.7758064270s, input_fired_time: 0.4829500020, output_fired_time: 0.0000000000, propagate_forward_time: 21.3868198395, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9060363770
validation[          , genome 14250] predictions:    9804/  10000 (98.04%), best:    9806/10000 (98.06%), error:       662.36597, best error:       626.66815 on epoch:    10, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 243.9758605957s, input_fired_time: 4.2721352577, output_fired_time: 2.6941778660, propagate_forward_time: 93.1900253296, propagate_backward_time: 138.9785614014, weight_update_time: 0.3009887636, other_time: 4.8409576416
epoch time: 21.7063312531s, input_fired_time: 0.4682263434, output_fired_time: 0.0000000000, propagate_forward_time: 20.3532257080, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8848800659
validation[          , genome 14250] predictions:    9824/  10000 (98.24%), best:    9824/10000 (98.24%), error:       608.74164, best error:       608.74164 on epoch:    18, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 246.9598388672s, input_fired_time: 4.2800259590, output_fired_time: 2.7325592041, propagate_forward_time: 94.3904037476, propagate_backward_time: 140.7308044434, weight_update_time: 0.3026895523, other_time: 4.8260498047
epoch time: 20.4172782898s, input_fired_time: 0.4432694316, output_fired_time: 0.0000000000, propagate_forward_time: 19.1318855286, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8421230316
validation[          , genome 14250] predictions:    9811/  10000 (98.11%), best:    9811/10000 (98.11%), error:       593.52130, best error:       593.52130 on epoch:    19, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 246.2986755371s, input_fired_time: 4.3129463196, output_fired_time: 2.7170495987, propagate_forward_time: 94.0674438477, propagate_backward_time: 140.2929534912, weight_update_time: 0.3046604395, other_time: 4.9082794189
epoch time: 22.3470764160s, input_fired_time: 0.4949593246, output_fired_time: 0.0000000000, propagate_forward_time: 20.9252223969, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9268951416
validation[          , genome 14250] predictions:    9809/  10000 (98.09%), best:    9811/10000 (98.11%), error:       601.37872, best error:       593.52130 on epoch:    19, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 246.7841033936s, input_fired_time: 4.2852964401, output_fired_time: 2.7488987446, propagate_forward_time: 94.4006500244, propagate_backward_time: 140.5147857666, weight_update_time: 0.3034107983, other_time: 4.8344726562
epoch time: 20.4344463348s, input_fired_time: 0.4445264935, output_fired_time: 0.0000000000, propagate_forward_time: 19.1487464905, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8411731720
validation[          , genome 14250] predictions:    9816/  10000 (98.16%), best:    9811/10000 (98.11%), error:       621.84302, best error:       593.52130 on epoch:    19, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 246.5976104736s, input_fired_time: 4.2884879112, output_fired_time: 2.7024877071, propagate_forward_time: 94.3884353638, propagate_backward_time: 140.3822021484, weight_update_time: 0.3044248819, other_time: 4.8359985352
epoch time: 19.9470691681s, input_fired_time: 0.4397330284, output_fired_time: 0.0000000000, propagate_forward_time: 18.6761817932, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8311538696
validation[          , genome 14250] predictions:    9796/  10000 (97.96%), best:    9811/10000 (98.11%), error:       650.09802, best error:       593.52130 on epoch:    19, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 241.5885314941s, input_fired_time: 4.2351469994, output_fired_time: 2.6595916748, propagate_forward_time: 92.1896514893, propagate_backward_time: 137.7211608887, weight_update_time: 0.3001898229, other_time: 4.7829742432
epoch time: 22.1643047333s, input_fired_time: 0.4744447172, output_fired_time: 0.0000000000, propagate_forward_time: 20.7981777191, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8916816711
validation[          , genome 14250] predictions:    9798/  10000 (97.98%), best:    9811/10000 (98.11%), error:       629.55573, best error:       593.52130 on epoch:    19, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 245.7500305176s, input_fired_time: 4.3099384308, output_fired_time: 2.7009742260, propagate_forward_time: 93.8663864136, propagate_backward_time: 139.9704589844, weight_update_time: 0.3040623367, other_time: 4.9022827148
epoch time: 19.9021377563s, input_fired_time: 0.4419073462, output_fired_time: 0.0000000000, propagate_forward_time: 18.6206684113, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8395614624
validation[          , genome 14250] predictions:    9819/  10000 (98.19%), best:    9819/10000 (98.19%), error:       535.11432, best error:       535.11432 on epoch:    24, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 244.2892456055s, input_fired_time: 4.2770314217, output_fired_time: 2.7010216713, propagate_forward_time: 93.3742294312, propagate_backward_time: 139.0927429199, weight_update_time: 0.3024916351, other_time: 4.8442077637
epoch time: 20.0853748322s, input_fired_time: 0.4418891668, output_fired_time: 0.0000000000, propagate_forward_time: 18.8106117249, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8328742981
validation[          , genome 14250] predictions:    9803/  10000 (98.03%), best:    9819/10000 (98.19%), error:       655.35590, best error:       535.11432 on epoch:    24, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 242.3759918213s, input_fired_time: 4.2559404373, output_fired_time: 2.6961414814, propagate_forward_time: 92.6344070435, propagate_backward_time: 137.9473114014, weight_update_time: 0.3015523553, other_time: 4.8422088623
epoch time: 20.0775070190s, input_fired_time: 0.4425247610, output_fired_time: 0.0000000000, propagate_forward_time: 18.7988662720, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8361167908
validation[          , genome 14250] predictions:    9829/  10000 (98.29%), best:    9819/10000 (98.19%), error:       591.64209, best error:       535.11432 on epoch:    24, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 247.3105316162s, input_fired_time: 4.3039512634, output_fired_time: 2.7217938900, propagate_forward_time: 94.4958801270, propagate_backward_time: 140.9544677734, weight_update_time: 0.3045191765, other_time: 4.8344421387
epoch time: 20.4757671356s, input_fired_time: 0.4484806359, output_fired_time: 0.0000000000, propagate_forward_time: 19.1953277588, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8319587708
validation[          , genome 14250] predictions:    9820/  10000 (98.20%), best:    9819/10000 (98.19%), error:       601.77545, best error:       535.11432 on epoch:    24, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 245.0021362305s, input_fired_time: 4.2938251495, output_fired_time: 2.6870131493, propagate_forward_time: 93.5692825317, propagate_backward_time: 139.5930786133, weight_update_time: 0.3026043177, other_time: 4.8589477539
epoch time: 20.4277992249s, input_fired_time: 0.4473435879, output_fired_time: 0.0000000000, propagate_forward_time: 19.1143798828, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8660755157
validation[          , genome 14250] predictions:    9818/  10000 (98.18%), best:    9819/10000 (98.19%), error:       574.84644, best error:       535.11432 on epoch:    24, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 249.7478790283s, input_fired_time: 4.3636264801, output_fired_time: 2.7453012466, propagate_forward_time: 95.5576248169, propagate_backward_time: 142.1088562012, weight_update_time: 0.3065283000, other_time: 4.9724731445
epoch time: 20.7139434814s, input_fired_time: 0.4565633237, output_fired_time: 0.0000000000, propagate_forward_time: 19.3951301575, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8622493744
validation[          , genome 14250] predictions:    9784/  10000 (97.84%), best:    9819/10000 (98.19%), error:       678.17780, best error:       535.11432 on epoch:    24, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 246.5657958984s, input_fired_time: 4.3168444633, output_fired_time: 2.7117197514, propagate_forward_time: 94.1514816284, propagate_backward_time: 140.4996795654, weight_update_time: 0.3057330251, other_time: 4.8860626221
epoch time: 19.8990535736s, input_fired_time: 0.4482013583, output_fired_time: 0.0000000000, propagate_forward_time: 18.6211795807, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8296718597
validation[          , genome 14250] predictions:    9805/  10000 (98.05%), best:    9819/10000 (98.19%), error:       650.92773, best error:       535.11432 on epoch:    24, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 245.3519897461s, input_fired_time: 4.2977519035, output_fired_time: 2.7206926346, propagate_forward_time: 93.6442337036, propagate_backward_time: 139.8207702637, weight_update_time: 0.3034795821, other_time: 4.8685607910
epoch time: 20.6504707336s, input_fired_time: 0.4504163563, output_fired_time: 0.0000000000, propagate_forward_time: 19.3421764374, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8578777313
validation[          , genome 14250] predictions:    9789/  10000 (97.89%), best:    9819/10000 (98.19%), error:       673.15100, best error:       535.11432 on epoch:    24, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 245.1492919922s, input_fired_time: 4.2770438194, output_fired_time: 2.7031919956, propagate_forward_time: 93.8261260986, propagate_backward_time: 139.5632476807, weight_update_time: 0.3023256660, other_time: 4.7796936035
epoch time: 20.5221519470s, input_fired_time: 0.4486220777, output_fired_time: 0.0000000000, propagate_forward_time: 19.2289848328, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8445453644
validation[          , genome 14250] predictions:    9829/  10000 (98.29%), best:    9819/10000 (98.19%), error:       577.70575, best error:       535.11432 on epoch:    24, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 246.2402496338s, input_fired_time: 4.2981715202, output_fired_time: 2.7375237942, propagate_forward_time: 94.4843673706, propagate_backward_time: 139.9110260010, weight_update_time: 0.3026449382, other_time: 4.8091583252
epoch time: 20.1139907837s, input_fired_time: 0.4476344883, output_fired_time: 0.0000000000, propagate_forward_time: 18.8308219910, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8355350494
validation[          , genome 14250] predictions:    9812/  10000 (98.12%), best:    9819/10000 (98.19%), error:       612.27527, best error:       535.11432 on epoch:    24, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 246.8182830811s, input_fired_time: 4.3006644249, output_fired_time: 2.7098112106, propagate_forward_time: 94.5227432251, propagate_backward_time: 140.4731445312, weight_update_time: 0.3036887944, other_time: 4.8119201660
epoch time: 20.3899726868s, input_fired_time: 0.4499685168, output_fired_time: 0.0000000000, propagate_forward_time: 19.1006565094, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8393478394
validation[          , genome 14250] predictions:    9820/  10000 (98.20%), best:    9819/10000 (98.19%), error:       575.99792, best error:       535.11432 on epoch:    24, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 248.2131652832s, input_fired_time: 4.3325848579, output_fired_time: 2.7247982025, propagate_forward_time: 95.0720367432, propagate_backward_time: 141.2378234863, weight_update_time: 0.3048021793, other_time: 4.8459320068
epoch time: 21.3697109222s, input_fired_time: 0.4800873399, output_fired_time: 0.0000000000, propagate_forward_time: 19.9939060211, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8957176208
validation[          , genome 14250] predictions:    9806/  10000 (98.06%), best:    9819/10000 (98.19%), error:       622.24847, best error:       535.11432 on epoch:    24, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 242.8338623047s, input_fired_time: 4.2809352875, output_fired_time: 2.6857280731, propagate_forward_time: 92.6100540161, propagate_backward_time: 138.4549102783, weight_update_time: 0.3008680344, other_time: 4.8022308350
epoch time: 20.4763031006s, input_fired_time: 0.4482549131, output_fired_time: 0.0000000000, propagate_forward_time: 19.1857376099, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8423099518
validation[          , genome 14250] predictions:    9808/  10000 (98.08%), best:    9819/10000 (98.19%), error:       569.70648, best error:       535.11432 on epoch:    24, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 248.3871612549s, input_fired_time: 4.3469400406, output_fired_time: 2.7385969162, propagate_forward_time: 94.9674835205, propagate_backward_time: 141.4378967285, weight_update_time: 0.3062427938, other_time: 4.8962402344
epoch time: 23.0392627716s, input_fired_time: 0.4901893437, output_fired_time: 0.0000000000, propagate_forward_time: 21.6380596161, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9110145569
validation[          , genome 14250] predictions:    9827/  10000 (98.27%), best:    9819/10000 (98.19%), error:       562.50885, best error:       535.11432 on epoch:    24, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 251.8281860352s, input_fired_time: 4.3755335808, output_fired_time: 2.7634673119, propagate_forward_time: 96.3362579346, propagate_backward_time: 143.4057312012, weight_update_time: 0.3085498810, other_time: 4.9471893311
epoch time: 20.5484027863s, input_fired_time: 0.4516905546, output_fired_time: 0.0000000000, propagate_forward_time: 19.2433910370, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8533210754
validation[          , genome 14250] predictions:    9813/  10000 (98.13%), best:    9819/10000 (98.19%), error:       621.69598, best error:       535.11432 on epoch:    24, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 244.6273040771s, input_fired_time: 4.3081116676, output_fired_time: 2.7058906555, propagate_forward_time: 93.5967636108, propagate_backward_time: 139.1979675293, weight_update_time: 0.3036392927, other_time: 4.8185729980
epoch time: 20.0017280579s, input_fired_time: 0.4778854847, output_fired_time: 0.0000000000, propagate_forward_time: 18.6242313385, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8996105194
validation[          , genome 14250] predictions:    9818/  10000 (98.18%), best:    9819/10000 (98.19%), error:       631.43481, best error:       535.11432 on epoch:    24, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 243.7768402100s, input_fired_time: 4.3512082100, output_fired_time: 2.6971709728, propagate_forward_time: 92.9795150757, propagate_backward_time: 138.7874603271, weight_update_time: 0.3077209592, other_time: 4.9614715576
epoch time: 20.0759010315s, input_fired_time: 0.4462203383, output_fired_time: 0.0000000000, propagate_forward_time: 18.8005371094, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8291435242
validation[          , genome 14250] predictions:    9829/  10000 (98.29%), best:    9819/10000 (98.19%), error:       560.43127, best error:       535.11432 on epoch:    24, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 247.0510406494s, input_fired_time: 4.3262262344, output_fired_time: 2.7258329391, propagate_forward_time: 94.4790115356, propagate_backward_time: 140.6636352539, weight_update_time: 0.3039928079, other_time: 4.8563232422
epoch time: 20.0153293610s, input_fired_time: 0.4445865452, output_fired_time: 0.0000000000, propagate_forward_time: 18.7356357574, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8351078033
validation[          , genome 14250] predictions:    9818/  10000 (98.18%), best:    9819/10000 (98.19%), error:       616.74219, best error:       535.11432 on epoch:    24, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 245.2707366943s, input_fired_time: 4.3335337639, output_fired_time: 2.7130362988, propagate_forward_time: 93.7793807983, propagate_backward_time: 139.5809631348, weight_update_time: 0.3031468093, other_time: 4.8638305664
epoch time: 20.1370334625s, input_fired_time: 0.4492517412, output_fired_time: 0.0000000000, propagate_forward_time: 18.8593463898, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8284358978
validation[          , genome 14250] predictions:    9822/  10000 (98.22%), best:    9819/10000 (98.19%), error:       598.13666, best error:       535.11432 on epoch:    24, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 249.8572235107s, input_fired_time: 4.3499164581, output_fired_time: 2.7346045971, propagate_forward_time: 95.8004226685, propagate_backward_time: 142.0745697021, weight_update_time: 0.3064609170, other_time: 4.8977203369
epoch time: 20.8344688416s, input_fired_time: 0.4558015466, output_fired_time: 0.0000000000, propagate_forward_time: 19.5258464813, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8528213501
validation[          , genome 14250] predictions:    9830/  10000 (98.30%), best:    9819/10000 (98.19%), error:       603.94763, best error:       535.11432 on epoch:    24, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 245.8482208252s, input_fired_time: 4.3097748756, output_fired_time: 2.7146453857, propagate_forward_time: 93.9981460571, propagate_backward_time: 140.0213165283, weight_update_time: 0.3026765585, other_time: 4.8043365479
epoch time: 20.9731178284s, input_fired_time: 0.4593678117, output_fired_time: 0.0000000000, propagate_forward_time: 19.6727905273, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8409595490
validation[          , genome 14250] predictions:    9799/  10000 (97.99%), best:    9819/10000 (98.19%), error:       636.89868, best error:       535.11432 on epoch:    24, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 249.7957458496s, input_fired_time: 4.3530416489, output_fired_time: 2.7378540039, propagate_forward_time: 95.2537002563, propagate_backward_time: 142.5212249756, weight_update_time: 0.3053879738, other_time: 4.9299163818
epoch time: 21.5411567688s, input_fired_time: 0.4690628946, output_fired_time: 0.0000000000, propagate_forward_time: 20.1916007996, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8804931641
validation[          , genome 14250] predictions:    9823/  10000 (98.23%), best:    9819/10000 (98.19%), error:       569.83893, best error:       535.11432 on epoch:    24, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 247.4590148926s, input_fired_time: 4.3340320587, output_fired_time: 2.7290165424, propagate_forward_time: 94.4889526367, propagate_backward_time: 141.0288848877, weight_update_time: 0.3048611581, other_time: 4.8781280518
epoch time: 20.2251815796s, input_fired_time: 0.4492065310, output_fired_time: 0.0000000000, propagate_forward_time: 18.9378547668, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8381195068
validation[          , genome 14250] predictions:    9838/  10000 (98.38%), best:    9819/10000 (98.19%), error:       575.43158, best error:       535.11432 on epoch:    24, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 245.8317260742s, input_fired_time: 4.3203854561, output_fired_time: 2.7181766033, propagate_forward_time: 94.0617828369, propagate_backward_time: 139.9025726318, weight_update_time: 0.3039647341, other_time: 4.8288116455
epoch time: 20.0141296387s, input_fired_time: 0.4504607916, output_fired_time: 0.0000000000, propagate_forward_time: 18.7237148285, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8399543762
validation[          , genome 14250] predictions:    9788/  10000 (97.88%), best:    9819/10000 (98.19%), error:       652.51813, best error:       535.11432 on epoch:    24, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 245.0270843506s, input_fired_time: 4.3384695053, output_fired_time: 2.7115123272, propagate_forward_time: 93.6337585449, propagate_backward_time: 139.4124450684, weight_update_time: 0.3037153184, other_time: 4.9308929443
epoch time: 20.6973342896s, input_fired_time: 0.4571003020, output_fired_time: 0.0000000000, propagate_forward_time: 19.3884258270, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8518085480
validation[          , genome 14250] predictions:    9832/  10000 (98.32%), best:    9819/10000 (98.19%), error:       582.77240, best error:       535.11432 on epoch:    24, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 245.5821838379s, input_fired_time: 4.3370919228, output_fired_time: 2.7133376598, propagate_forward_time: 93.7023468018, propagate_backward_time: 140.0028839111, weight_update_time: 0.3029161692, other_time: 4.8265228271
epoch time: 20.2881164551s, input_fired_time: 0.4551545084, output_fired_time: 0.0000000000, propagate_forward_time: 18.9953079224, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8376541138
validation[          , genome 14250] predictions:    9836/  10000 (98.36%), best:    9819/10000 (98.19%), error:       584.97198, best error:       535.11432 on epoch:    24, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 252.5841064453s, input_fired_time: 4.4653744698, output_fired_time: 2.7774777412, propagate_forward_time: 96.6251373291, propagate_backward_time: 143.6469268799, weight_update_time: 0.3102272451, other_time: 5.0691833496
epoch time: 21.4975566864s, input_fired_time: 0.4754067063, output_fired_time: 0.0000000000, propagate_forward_time: 20.1204605103, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9016895294
validation[          , genome 14250] predictions:    9834/  10000 (98.34%), best:    9819/10000 (98.19%), error:       548.19501, best error:       535.11432 on epoch:    24, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 246.8550872803s, input_fired_time: 4.3677153587, output_fired_time: 2.7361977100, propagate_forward_time: 94.5100708008, propagate_backward_time: 140.3464202881, weight_update_time: 0.3041306436, other_time: 4.8946838379
epoch time: 20.1984272003s, input_fired_time: 0.4545373917, output_fired_time: 0.0000000000, propagate_forward_time: 18.9036197662, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8402690887
validation[          , genome 14250] predictions:    9840/  10000 (98.40%), best:    9840/10000 (98.40%), error:       534.90387, best error:       534.90387 on epoch:    51, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 242.2681732178s, input_fired_time: 4.3003573418, output_fired_time: 2.6866497993, propagate_forward_time: 92.5986099243, propagate_backward_time: 137.8516693115, weight_update_time: 0.3008741736, other_time: 4.8308868408
epoch time: 20.2148418427s, input_fired_time: 0.4563830197, output_fired_time: 0.0000000000, propagate_forward_time: 18.9148197174, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8436393738
validation[          , genome 14250] predictions:    9847/  10000 (98.47%), best:    9840/10000 (98.40%), error:       546.44788, best error:       534.90387 on epoch:    51, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 247.6379241943s, input_fired_time: 4.3578643799, output_fired_time: 2.7385072708, propagate_forward_time: 94.9813461304, propagate_backward_time: 140.6366119385, weight_update_time: 0.3063571453, other_time: 4.9235992432
epoch time: 19.7518062592s, input_fired_time: 0.4443366230, output_fired_time: 0.0000000000, propagate_forward_time: 18.4779148102, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8295555115
validation[          , genome 14250] predictions:    9817/  10000 (98.17%), best:    9840/10000 (98.40%), error:       598.77032, best error:       534.90387 on epoch:    51, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 242.0461578369s, input_fired_time: 4.3807091713, output_fired_time: 2.6831731796, propagate_forward_time: 92.3246154785, propagate_backward_time: 137.6414794922, weight_update_time: 0.3082744181, other_time: 5.0161895752
epoch time: 20.4155521393s, input_fired_time: 0.4561529458, output_fired_time: 0.0000000000, propagate_forward_time: 19.1172313690, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8421669006
validation[          , genome 14250] predictions:    9829/  10000 (98.29%), best:    9840/10000 (98.40%), error:       568.33191, best error:       534.90387 on epoch:    51, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 247.0593566895s, input_fired_time: 4.3484368324, output_fired_time: 2.7321639061, propagate_forward_time: 94.6144714355, propagate_backward_time: 140.4598388672, weight_update_time: 0.3061529696, other_time: 4.9044494629
epoch time: 20.5929870605s, input_fired_time: 0.4578909576, output_fired_time: 0.0000000000, propagate_forward_time: 19.2768096924, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8582859039
validation[          , genome 14250] predictions:    9824/  10000 (98.24%), best:    9840/10000 (98.40%), error:       631.58331, best error:       534.90387 on epoch:    51, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 243.8519134521s, input_fired_time: 4.3244824409, output_fired_time: 2.7050509453, propagate_forward_time: 93.4058685303, propagate_backward_time: 138.5879821777, weight_update_time: 0.3032284677, other_time: 4.8285369873
epoch time: 20.2468795776s, input_fired_time: 0.4516633451, output_fired_time: 0.0000000000, propagate_forward_time: 18.9564418793, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8387737274
validation[          , genome 14250] predictions:    9811/  10000 (98.11%), best:    9840/10000 (98.40%), error:       605.95593, best error:       534.90387 on epoch:    51, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 245.5921325684s, input_fired_time: 4.3697547913, output_fired_time: 2.7134351730, propagate_forward_time: 94.0510330200, propagate_backward_time: 139.4780883789, weight_update_time: 0.3078744113, other_time: 4.9798278809
epoch time: 20.9491062164s, input_fired_time: 0.4653975964, output_fired_time: 0.0000000000, propagate_forward_time: 19.5908203125, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8928890228
validation[          , genome 14250] predictions:    9831/  10000 (98.31%), best:    9840/10000 (98.40%), error:       552.83380, best error:       534.90387 on epoch:    51, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 245.3052978516s, input_fired_time: 4.3267893791, output_fired_time: 2.7124545574, propagate_forward_time: 93.6970825195, propagate_backward_time: 139.6066894531, weight_update_time: 0.3049782813, other_time: 4.9622955322
epoch time: 20.1125698090s, input_fired_time: 0.4494261444, output_fired_time: 0.0000000000, propagate_forward_time: 18.8145637512, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8485794067
validation[          , genome 14250] predictions:    9826/  10000 (98.26%), best:    9840/10000 (98.40%), error:       586.81018, best error:       534.90387 on epoch:    51, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 242.7116699219s, input_fired_time: 4.2830333710, output_fired_time: 2.6836841106, propagate_forward_time: 92.8087692261, propagate_backward_time: 138.1108856201, weight_update_time: 0.3028209507, other_time: 4.8253021240
epoch time: 20.5352001190s, input_fired_time: 0.4871838689, output_fired_time: 0.0000000000, propagate_forward_time: 19.1332073212, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9148082733
validation[          , genome 14250] predictions:    9836/  10000 (98.36%), best:    9840/10000 (98.40%), error:       556.84131, best error:       534.90387 on epoch:    51, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 248.4983978271s, input_fired_time: 4.3787541389, output_fired_time: 2.7390429974, propagate_forward_time: 95.0860900879, propagate_backward_time: 141.3325042725, weight_update_time: 0.3050991297, other_time: 4.9620056152
epoch time: 20.3914642334s, input_fired_time: 0.4543190598, output_fired_time: 0.0000000000, propagate_forward_time: 19.0835285187, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8536167145
validation[          , genome 14250] predictions:    9794/  10000 (97.94%), best:    9840/10000 (98.40%), error:       674.86652, best error:       534.90387 on epoch:    51, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 245.8289794922s, input_fired_time: 4.3510785103, output_fired_time: 2.7186121941, propagate_forward_time: 94.1102523804, propagate_backward_time: 139.7396850586, weight_update_time: 0.3055520654, other_time: 4.9093627930
epoch time: 20.1456546783s, input_fired_time: 0.4551414549, output_fired_time: 0.0000000000, propagate_forward_time: 18.8515548706, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8389587402
validation[          , genome 14250] predictions:    9827/  10000 (98.27%), best:    9840/10000 (98.40%), error:       604.46075, best error:       534.90387 on epoch:    51, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 247.5332183838s, input_fired_time: 4.3819451332, output_fired_time: 2.7336773872, propagate_forward_time: 94.9555130005, propagate_backward_time: 140.4829101562, weight_update_time: 0.3083094656, other_time: 4.9791870117
epoch time: 20.7822208405s, input_fired_time: 0.4624969363, output_fired_time: 0.0000000000, propagate_forward_time: 19.4593868256, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8603363037
validation[          , genome 14250] predictions:    9829/  10000 (98.29%), best:    9840/10000 (98.40%), error:       572.73816, best error:       534.90387 on epoch:    51, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 245.4946746826s, input_fired_time: 4.3548827171, output_fired_time: 2.6994504929, propagate_forward_time: 93.9923553467, propagate_backward_time: 139.5405731201, weight_update_time: 0.3062142432, other_time: 4.9074096680
epoch time: 20.5874919891s, input_fired_time: 0.4624159038, output_fired_time: 0.0000000000, propagate_forward_time: 19.2537803650, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8712959290
validation[          , genome 14250] predictions:    9827/  10000 (98.27%), best:    9840/10000 (98.40%), error:       625.76117, best error:       534.90387 on epoch:    51, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 243.4783630371s, input_fired_time: 4.4632010460, output_fired_time: 2.7072424889, propagate_forward_time: 92.9789505005, propagate_backward_time: 138.0802154541, weight_update_time: 0.3179236352, other_time: 5.2487640381
epoch time: 19.9329776764s, input_fired_time: 0.4822854698, output_fired_time: 0.0000000000, propagate_forward_time: 18.5446472168, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9060459137
validation[          , genome 14250] predictions:    9836/  10000 (98.36%), best:    9840/10000 (98.40%), error:       598.63501, best error:       534.90387 on epoch:    51, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 240.4552459717s, input_fired_time: 4.4784746170, output_fired_time: 2.6827642918, propagate_forward_time: 91.7123718262, propagate_backward_time: 136.2180175781, weight_update_time: 0.3184875548, other_time: 5.3636169434
epoch time: 20.7982654572s, input_fired_time: 0.4915532470, output_fired_time: 0.0000000000, propagate_forward_time: 19.3850250244, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9216880798
validation[          , genome 14250] predictions:    9836/  10000 (98.36%), best:    9840/10000 (98.40%), error:       546.18378, best error:       534.90387 on epoch:    51, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 241.9090728760s, input_fired_time: 4.3610754013, output_fired_time: 2.6828114986, propagate_forward_time: 92.5772933960, propagate_backward_time: 137.2879180908, weight_update_time: 0.3067939878, other_time: 4.9999847412
epoch time: 20.0066604614s, input_fired_time: 0.4497126341, output_fired_time: 0.0000000000, propagate_forward_time: 18.7255058289, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8314418793
validation[          , genome 14250] predictions:    9826/  10000 (98.26%), best:    9840/10000 (98.40%), error:       602.12988, best error:       534.90387 on epoch:    51, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 242.5395050049s, input_fired_time: 4.3043527603, output_fired_time: 2.6920940876, propagate_forward_time: 92.9570312500, propagate_backward_time: 137.7958831787, weight_update_time: 0.3025055230, other_time: 4.7901458740
epoch time: 20.5031642914s, input_fired_time: 0.4583909214, output_fired_time: 0.0000000000, propagate_forward_time: 19.2047500610, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8400230408
validation[          , genome 14250] predictions:    9834/  10000 (98.34%), best:    9840/10000 (98.40%), error:       610.63293, best error:       534.90387 on epoch:    51, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 246.9843292236s, input_fired_time: 4.3676905632, output_fired_time: 2.7179825306, propagate_forward_time: 94.4017639160, propagate_backward_time: 140.5689392090, weight_update_time: 0.3046525419, other_time: 4.9279479980
epoch time: 20.7605991364s, input_fired_time: 0.4616304040, output_fired_time: 0.0000000000, propagate_forward_time: 19.4245624542, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8744068146
validation[          , genome 14250] predictions:    9832/  10000 (98.32%), best:    9840/10000 (98.40%), error:       573.76239, best error:       534.90387 on epoch:    51, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 244.9636230469s, input_fired_time: 4.3294911385, output_fired_time: 2.7101566792, propagate_forward_time: 93.7809295654, propagate_backward_time: 139.2934265137, weight_update_time: 0.3045572340, other_time: 4.8496093750
epoch time: 20.2493247986s, input_fired_time: 0.4538466036, output_fired_time: 0.0000000000, propagate_forward_time: 18.9581356049, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8373432159
validation[          , genome 14250] predictions:    9842/  10000 (98.42%), best:    9840/10000 (98.40%), error:       559.08600, best error:       534.90387 on epoch:    51, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 249.7445068359s, input_fired_time: 4.3954768181, output_fired_time: 2.7559657097, propagate_forward_time: 95.8666992188, propagate_backward_time: 141.7609558105, weight_update_time: 0.3108168840, other_time: 4.9654083252
epoch time: 21.2918968201s, input_fired_time: 0.4776589870, output_fired_time: 0.0000000000, propagate_forward_time: 19.9283733368, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8858642578
validation[          , genome 14250] predictions:    9836/  10000 (98.36%), best:    9840/10000 (98.40%), error:       590.33020, best error:       534.90387 on epoch:    51, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 247.4078979492s, input_fired_time: 4.3492937088, output_fired_time: 2.7073347569, propagate_forward_time: 95.0446395874, propagate_backward_time: 140.3404846191, weight_update_time: 0.3068165481, other_time: 4.9661560059
epoch time: 20.0128231049s, input_fired_time: 0.4463810623, output_fired_time: 0.0000000000, propagate_forward_time: 18.7261447906, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8402976990
validation[          , genome 14250] predictions:    9820/  10000 (98.20%), best:    9840/10000 (98.40%), error:       605.54688, best error:       534.90387 on epoch:    51, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 248.3158111572s, input_fired_time: 4.3550028801, output_fired_time: 2.7413043976, propagate_forward_time: 95.0190048218, propagate_backward_time: 141.3096466064, weight_update_time: 0.3069563210, other_time: 4.8908538818
epoch time: 20.6894416809s, input_fired_time: 0.4567649662, output_fired_time: 0.0000000000, propagate_forward_time: 19.3882350922, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8444423676
validation[          , genome 14250] predictions:    9842/  10000 (98.42%), best:    9840/10000 (98.40%), error:       552.47614, best error:       534.90387 on epoch:    51, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 248.2505645752s, input_fired_time: 4.3754930496, output_fired_time: 2.7454719543, propagate_forward_time: 95.2468948364, propagate_backward_time: 140.9349975586, weight_update_time: 0.3069539070, other_time: 4.9477233887
epoch time: 20.1964626312s, input_fired_time: 0.4536567926, output_fired_time: 0.0000000000, propagate_forward_time: 18.8971214294, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8456840515
validation[          , genome 14250] predictions:    9816/  10000 (98.16%), best:    9840/10000 (98.40%), error:       624.25494, best error:       534.90387 on epoch:    51, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 248.3759613037s, input_fired_time: 4.3608016968, output_fired_time: 2.7362072468, propagate_forward_time: 95.3940734863, propagate_backward_time: 140.9835205078, weight_update_time: 0.3062344193, other_time: 4.9013671875
epoch time: 20.8492183685s, input_fired_time: 0.4620293975, output_fired_time: 0.0000000000, propagate_forward_time: 19.5368309021, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8503589630
validation[          , genome 14250] predictions:    9811/  10000 (98.11%), best:    9840/10000 (98.40%), error:       624.65094, best error:       534.90387 on epoch:    51, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 248.8005065918s, input_fired_time: 4.3653926849, output_fired_time: 2.7454900742, propagate_forward_time: 94.9506912231, propagate_backward_time: 141.8227081299, weight_update_time: 0.3070744872, other_time: 4.9162445068
epoch time: 20.9228858948s, input_fired_time: 0.4669309855, output_fired_time: 0.0000000000, propagate_forward_time: 19.5821094513, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8738460541
validation[          , genome 14250] predictions:    9837/  10000 (98.37%), best:    9840/10000 (98.40%), error:       544.21619, best error:       534.90387 on epoch:    51, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 247.3979949951s, input_fired_time: 4.3476080894, output_fired_time: 2.7251334190, propagate_forward_time: 95.0102920532, propagate_backward_time: 140.3736114502, weight_update_time: 0.3066860437, other_time: 4.9413604736
epoch time: 19.9968147278s, input_fired_time: 0.4520493150, output_fired_time: 0.0000000000, propagate_forward_time: 18.7007598877, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8440055847
validation[          , genome 14250] predictions:    9828/  10000 (98.28%), best:    9840/10000 (98.40%), error:       578.14282, best error:       534.90387 on epoch:    51, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 251.3818054199s, input_fired_time: 4.4304165840, output_fired_time: 2.7606856823, propagate_forward_time: 96.4146728516, propagate_backward_time: 142.7177734375, weight_update_time: 0.3140228391, other_time: 5.0582580566
epoch time: 20.5140686035s, input_fired_time: 0.4852795899, output_fired_time: 0.0000000000, propagate_forward_time: 19.1175918579, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9111976624
validation[          , genome 14250] predictions:    9824/  10000 (98.24%), best:    9840/10000 (98.40%), error:       575.56219, best error:       534.90387 on epoch:    51, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 244.5800476074s, input_fired_time: 4.3154749870, output_fired_time: 2.6939058304, propagate_forward_time: 93.6441345215, propagate_backward_time: 139.0611877441, weight_update_time: 0.3031156659, other_time: 4.8653411865
epoch time: 20.0547370911s, input_fired_time: 0.4500624239, output_fired_time: 0.0000000000, propagate_forward_time: 18.7616672516, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8430080414
validation[          , genome 14250] predictions:    9840/  10000 (98.40%), best:    9840/10000 (98.40%), error:       548.37317, best error:       534.90387 on epoch:    51, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 245.3471374512s, input_fired_time: 4.3218674660, output_fired_time: 2.7186315060, propagate_forward_time: 94.0360031128, propagate_backward_time: 139.4183807373, weight_update_time: 0.3046829104, other_time: 4.8522491455
epoch time: 19.9168949127s, input_fired_time: 0.4506191015, output_fired_time: 0.0000000000, propagate_forward_time: 18.6326160431, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8336601257
validation[          , genome 14250] predictions:    9840/  10000 (98.40%), best:    9840/10000 (98.40%), error:       557.03534, best error:       534.90387 on epoch:    51, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 245.9405212402s, input_fired_time: 4.3353204727, output_fired_time: 2.7226810455, propagate_forward_time: 93.9480972290, propagate_backward_time: 139.9748840332, weight_update_time: 0.3056013882, other_time: 4.9595336914
epoch time: 20.7687168121s, input_fired_time: 0.4662846625, output_fired_time: 0.0000000000, propagate_forward_time: 19.4233684540, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8790645599
validation[          , genome 14250] predictions:    9850/  10000 (98.50%), best:    9840/10000 (98.40%), error:       542.39539, best error:       534.90387 on epoch:    51, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 248.3693389893s, input_fired_time: 4.3620395660, output_fired_time: 2.7348058224, propagate_forward_time: 95.0513610840, propagate_backward_time: 141.2130584717, weight_update_time: 0.3075016737, other_time: 5.0080718994
epoch time: 21.1872596741s, input_fired_time: 0.4741406441, output_fired_time: 0.0000000000, propagate_forward_time: 19.8277015686, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8854179382
validation[          , genome 14250] predictions:    9804/  10000 (98.04%), best:    9840/10000 (98.40%), error:       653.86823, best error:       534.90387 on epoch:    51, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 244.3551177979s, input_fired_time: 4.3346362114, output_fired_time: 2.7012994289, propagate_forward_time: 93.3357543945, propagate_backward_time: 139.0370483398, weight_update_time: 0.3063311279, other_time: 4.9463806152
epoch time: 21.7314968109s, input_fired_time: 0.4913536608, output_fired_time: 0.0000000000, propagate_forward_time: 20.3301124573, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9100303650
validation[          , genome 14250] predictions:    9834/  10000 (98.34%), best:    9840/10000 (98.40%), error:       560.76495, best error:       534.90387 on epoch:    51, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 245.2221221924s, input_fired_time: 4.3519988060, output_fired_time: 2.7182009220, propagate_forward_time: 94.2211532593, propagate_backward_time: 138.9966888428, weight_update_time: 0.3039194345, other_time: 4.9340667725
epoch time: 20.2493934631s, input_fired_time: 0.4623312950, output_fired_time: 0.0000000000, propagate_forward_time: 18.9286308289, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8584308624
validation[          , genome 14250] predictions:    9463/  10000 (94.63%), best:    9840/10000 (98.40%), error:      1825.03101, best error:       534.90387 on epoch:    51, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

resetting weights to those on epoch: 51
epoch time: 248.1655426025s, input_fired_time: 4.3830690384, output_fired_time: 2.7423815727, propagate_forward_time: 95.1513748169, propagate_backward_time: 140.9658966064, weight_update_time: 0.3067558408, other_time: 4.9228057861
epoch time: 20.6587810516s, input_fired_time: 0.4675567448, output_fired_time: 0.0000000000, propagate_forward_time: 19.3368778229, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8543472290
validation[          , genome 14250] predictions:    9851/  10000 (98.51%), best:    9851/10000 (98.51%), error:       478.61304, best error:       478.61304 on epoch:    84, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 242.6424407959s, input_fired_time: 4.3141636848, output_fired_time: 2.7006735802, propagate_forward_time: 92.7549362183, propagate_backward_time: 137.9639129639, weight_update_time: 0.3027710319, other_time: 4.9087677002
epoch time: 20.8059291840s, input_fired_time: 0.4635768533, output_fired_time: 0.0000000000, propagate_forward_time: 19.4813709259, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8609809875
validation[          , genome 14250] predictions:    9861/  10000 (98.61%), best:    9861/10000 (98.61%), error:       474.72888, best error:       474.72888 on epoch:    85, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 243.6094207764s, input_fired_time: 4.3062872887, output_fired_time: 2.7018461227, propagate_forward_time: 93.1761016846, propagate_backward_time: 138.5782470703, weight_update_time: 0.3026232123, other_time: 4.8469390869
epoch time: 20.2658557892s, input_fired_time: 0.4521365762, output_fired_time: 0.0000000000, propagate_forward_time: 18.9664001465, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8473186493
validation[          , genome 14250] predictions:    9858/  10000 (98.58%), best:    9861/10000 (98.61%), error:       479.75241, best error:       474.72888 on epoch:    85, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 242.7662506104s, input_fired_time: 4.3507781029, output_fired_time: 2.6899337769, propagate_forward_time: 92.8991012573, propagate_backward_time: 137.8068542480, weight_update_time: 0.3088767529, other_time: 5.0195617676
epoch time: 19.9076633453s, input_fired_time: 0.4782114029, output_fired_time: 0.0000000000, propagate_forward_time: 18.5357608795, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8936901093
validation[          , genome 14250] predictions:    9860/  10000 (98.60%), best:    9861/10000 (98.61%), error:       486.74155, best error:       474.72888 on epoch:    85, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 248.5408630371s, input_fired_time: 4.5214576721, output_fired_time: 2.7549738884, propagate_forward_time: 95.1258010864, propagate_backward_time: 140.7653045654, weight_update_time: 0.3211084008, other_time: 5.3733367920
epoch time: 23.1822471619s, input_fired_time: 0.5114548206, output_fired_time: 0.0000000000, propagate_forward_time: 21.7175445557, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9532470703
validation[          , genome 14250] predictions:    9861/  10000 (98.61%), best:    9861/10000 (98.61%), error:       473.97607, best error:       473.97607 on epoch:    88, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 254.8807678223s, input_fired_time: 4.4548468590, output_fired_time: 2.7985928059, propagate_forward_time: 98.0337524414, propagate_backward_time: 144.5401458740, weight_update_time: 0.3152150214, other_time: 5.0534210205
epoch time: 19.8782920837s, input_fired_time: 0.4776393771, output_fired_time: 0.0000000000, propagate_forward_time: 18.5126209259, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8880310059
validation[          , genome 14250] predictions:    9848/  10000 (98.48%), best:    9861/10000 (98.61%), error:       504.28439, best error:       473.97607 on epoch:    88, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 250.9672851562s, input_fired_time: 4.5013661385, output_fired_time: 2.7696743011, propagate_forward_time: 96.1900253296, propagate_backward_time: 142.0756988525, weight_update_time: 0.3230600655, other_time: 5.4305267334
epoch time: 21.2095413208s, input_fired_time: 0.4867798686, output_fired_time: 0.0000000000, propagate_forward_time: 19.7817707062, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9409904480
validation[          , genome 14250] predictions:    9855/  10000 (98.55%), best:    9861/10000 (98.61%), error:       487.26443, best error:       473.97607 on epoch:    88, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 249.3458709717s, input_fired_time: 4.3713717461, output_fired_time: 2.7461330891, propagate_forward_time: 95.4522705078, propagate_backward_time: 141.7653656006, weight_update_time: 0.3076740801, other_time: 5.0107269287
epoch time: 20.2008018494s, input_fired_time: 0.4567954540, output_fired_time: 0.0000000000, propagate_forward_time: 18.8928756714, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8511314392
validation[          , genome 14250] predictions:    9854/  10000 (98.54%), best:    9861/10000 (98.61%), error:       495.46973, best error:       473.97607 on epoch:    88, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 244.3863372803s, input_fired_time: 4.3494405746, output_fired_time: 2.7005987167, propagate_forward_time: 93.3694152832, propagate_backward_time: 138.9926605225, weight_update_time: 0.3088687360, other_time: 4.9742279053
epoch time: 21.2248077393s, input_fired_time: 0.4793210030, output_fired_time: 0.0000000000, propagate_forward_time: 19.8488521576, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8966350555
validation[          , genome 14250] predictions:    9846/  10000 (98.46%), best:    9861/10000 (98.61%), error:       507.80637, best error:       473.97607 on epoch:    88, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 249.3592071533s, input_fired_time: 4.3671817780, output_fired_time: 2.7481901646, propagate_forward_time: 95.3242034912, propagate_backward_time: 141.9064331055, weight_update_time: 0.3078441620, other_time: 5.0131988525
epoch time: 20.0635814667s, input_fired_time: 0.4561737776, output_fired_time: 0.0000000000, propagate_forward_time: 18.7459125519, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8614959717
validation[          , genome 14250] predictions:    9850/  10000 (98.50%), best:    9861/10000 (98.61%), error:       496.87665, best error:       473.97607 on epoch:    88, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 242.0035705566s, input_fired_time: 4.3278350830, output_fired_time: 2.6822838783, propagate_forward_time: 92.4395065308, propagate_backward_time: 137.6622924805, weight_update_time: 0.3016842604, other_time: 4.8916625977
epoch time: 20.3399105072s, input_fired_time: 0.4578303993, output_fired_time: 0.0000000000, propagate_forward_time: 19.0310955048, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8509845734
validation[          , genome 14250] predictions:    9853/  10000 (98.53%), best:    9861/10000 (98.61%), error:       498.77005, best error:       473.97607 on epoch:    88, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 245.9454650879s, input_fired_time: 4.3697657585, output_fired_time: 2.7161240578, propagate_forward_time: 93.9933547974, propagate_backward_time: 139.8350830078, weight_update_time: 0.3058860004, other_time: 5.0311279297
epoch time: 20.1541633606s, input_fired_time: 0.4546655715, output_fired_time: 0.0000000000, propagate_forward_time: 18.8284797668, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8710174561
validation[          , genome 14250] predictions:    9849/  10000 (98.49%), best:    9861/10000 (98.61%), error:       500.73077, best error:       473.97607 on epoch:    88, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 246.8406219482s, input_fired_time: 4.3385000229, output_fired_time: 2.7216050625, propagate_forward_time: 94.3869628906, propagate_backward_time: 140.5023040771, weight_update_time: 0.3070426881, other_time: 4.8912506104
epoch time: 21.8384418488s, input_fired_time: 0.4819192588, output_fired_time: 0.0000000000, propagate_forward_time: 20.4703121185, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8862113953
validation[          , genome 14250] predictions:    9851/  10000 (98.51%), best:    9861/10000 (98.61%), error:       514.96234, best error:       473.97607 on epoch:    88, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 244.5085754395s, input_fired_time: 4.3221411705, output_fired_time: 2.7016739845, propagate_forward_time: 93.5449676514, propagate_backward_time: 139.0657653809, weight_update_time: 0.3043349981, other_time: 4.8740234375
epoch time: 20.0706615448s, input_fired_time: 0.4522213936, output_fired_time: 0.0000000000, propagate_forward_time: 18.7730503082, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8453903198
validation[          , genome 14250] predictions:    9839/  10000 (98.39%), best:    9861/10000 (98.61%), error:       516.34277, best error:       473.97607 on epoch:    88, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 248.5639801025s, input_fired_time: 4.3490381241, output_fired_time: 2.7242558002, propagate_forward_time: 95.3483810425, propagate_backward_time: 141.2061157227, weight_update_time: 0.3071515858, other_time: 4.9361877441
epoch time: 20.0940723419s, input_fired_time: 0.4499808848, output_fired_time: 0.0000000000, propagate_forward_time: 18.7959747314, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8481159210
validation[          , genome 14250] predictions:    9830/  10000 (98.30%), best:    9861/10000 (98.61%), error:       532.51135, best error:       473.97607 on epoch:    88, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 248.0737152100s, input_fired_time: 4.3481264114, output_fired_time: 2.7309956551, propagate_forward_time: 95.0338897705, propagate_backward_time: 141.0361938477, weight_update_time: 0.3077556193, other_time: 4.9244995117
epoch time: 20.6610202789s, input_fired_time: 0.4699273407, output_fired_time: 0.0000000000, propagate_forward_time: 19.3173885345, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8737049103
validation[          , genome 14250] predictions:    9838/  10000 (98.38%), best:    9861/10000 (98.61%), error:       541.11279, best error:       473.97607 on epoch:    88, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 246.1709747314s, input_fired_time: 4.3246474266, output_fired_time: 2.7231340408, propagate_forward_time: 94.1408081055, propagate_backward_time: 140.0352935791, weight_update_time: 0.3065473139, other_time: 4.9470977783
epoch time: 20.6825218201s, input_fired_time: 0.4606772363, output_fired_time: 0.0000000000, propagate_forward_time: 19.3680973053, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8537464142
validation[          , genome 14250] predictions:    9828/  10000 (98.28%), best:    9861/10000 (98.61%), error:       568.56177, best error:       473.97607 on epoch:    88, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 103.6260070801s, input_fired_time: 2.3273048401, output_fired_time: 0.0000000000, propagate_forward_time: 96.9873352051, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.3113708496
best training[          , genome 14250] predictions:   49984/  50000 (99.97%), best:    9861/10000 (98.61%), error:       313.64957, best error:       473.97607 on epoch:    88, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 20.6328659058s, input_fired_time: 0.4506859183, output_fired_time: 0.0000000000, propagate_forward_time: 19.3206596375, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8615207672
   testing[          , genome 14250] predictions:    9862/  10000 (98.62%), best:    9861/10000 (98.61%), error:       492.07428, best error:       473.97607 on epoch:    88, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
07:36:26 (24529): called boinc_finish(0)

</stderr_txt>
]]>