Nameexact_genome_1511027515_34_12590_2
Workunit2456478
Created8 Dec 2017, 0:08:57 UTC
Sent8 Dec 2017, 0:12:43 UTC
Report deadline22 Dec 2017, 14:12:37 UTC
Received8 Dec 2017, 23:40:21 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID64142
Run time10 hours 53 min 50 sec
CPU time8 hours 16 min 42 sec
Validate stateValid
Credit3,645.82
Device peak FLOPS3.08 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size166.37 MB
Peak swap size169.28 MB
Peak disk usage3.96 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
060959356, weight_decay: 0.0002438374

epoch time: 566.4744262695s, input_fired_time: 13.3562927246, output_fired_time: 10.4013872147, propagate_forward_time: 214.4709167480, propagate_backward_time: 315.3061523438, weight_update_time: 0.6191042066, other_time: 12.9397277832
epoch time: 22.5259742737s, input_fired_time: 0.6763842106, output_fired_time: 0.0000000000, propagate_forward_time: 20.7417869568, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1078033447
validation[          , genome 12590] predictions:    9795/  10000 (97.95%), best:    9805/10000 (98.05%), error:       643.17212, best error:       611.08453 on epoch:    14, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 269.8939514160s, input_fired_time: 5.5400977135, output_fired_time: 5.1556653976, propagate_forward_time: 101.2570648193, propagate_backward_time: 151.7279357910, weight_update_time: 0.4184069037, other_time: 6.2131805420
epoch time: 23.9740943909s, input_fired_time: 0.6659578085, output_fired_time: 0.0000000000, propagate_forward_time: 22.0783691406, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2297668457
validation[          , genome 12590] predictions:    9773/  10000 (97.73%), best:    9805/10000 (98.05%), error:       691.52155, best error:       611.08453 on epoch:    14, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 273.8374938965s, input_fired_time: 5.7250318527, output_fired_time: 5.2381610870, propagate_forward_time: 103.0471878052, propagate_backward_time: 153.3841247559, weight_update_time: 0.4203397334, other_time: 6.4429931641
epoch time: 23.6954174042s, input_fired_time: 0.6631718278, output_fired_time: 0.0000000000, propagate_forward_time: 21.9343395233, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0979061127
validation[          , genome 12590] predictions:    9796/  10000 (97.96%), best:    9796/10000 (97.96%), error:       611.06830, best error:       611.06830 on epoch:    17, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 277.4357299805s, input_fired_time: 6.3362302780, output_fired_time: 5.1045022011, propagate_forward_time: 103.6171264648, propagate_backward_time: 155.9651947021, weight_update_time: 0.4225504696, other_time: 6.4126739502
epoch time: 24.4274692535s, input_fired_time: 0.7061927915, output_fired_time: 0.0000000000, propagate_forward_time: 22.5680084229, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1532688141
validation[          , genome 12590] predictions:    9803/  10000 (98.03%), best:    9803/10000 (98.03%), error:       603.25000, best error:       603.25000 on epoch:    18, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 272.7471618652s, input_fired_time: 5.9460225105, output_fired_time: 5.2142434120, propagate_forward_time: 101.8890609741, propagate_backward_time: 153.1912078857, weight_update_time: 0.4171195924, other_time: 6.5066375732
epoch time: 24.4323253632s, input_fired_time: 0.6923747659, output_fired_time: 0.0000000000, propagate_forward_time: 22.6084899902, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1314601898
validation[          , genome 12590] predictions:    9801/  10000 (98.01%), best:    9801/10000 (98.01%), error:       597.08002, best error:       597.08002 on epoch:    19, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 280.0557861328s, input_fired_time: 5.7851362228, output_fired_time: 5.3564014435, propagate_forward_time: 105.2123794556, propagate_backward_time: 157.0407562256, weight_update_time: 0.4208296835, other_time: 6.6611175537
epoch time: 26.1525306702s, input_fired_time: 0.7150660753, output_fired_time: 0.0000000000, propagate_forward_time: 24.1714401245, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2660236359
validation[          , genome 12590] predictions:    9818/  10000 (98.18%), best:    9818/10000 (98.18%), error:       574.55133, best error:       574.55133 on epoch:    20, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 281.3506774902s, input_fired_time: 5.6430158615, output_fired_time: 5.4847979546, propagate_forward_time: 105.8324356079, propagate_backward_time: 157.7285919189, weight_update_time: 0.4262913465, other_time: 6.6618499756
epoch time: 42.8690185547s, input_fired_time: 0.9291597009, output_fired_time: 0.0000000000, propagate_forward_time: 40.1547203064, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7851371765
validation[          , genome 12590] predictions:    9836/  10000 (98.36%), best:    9836/10000 (98.36%), error:       561.63300, best error:       561.63300 on epoch:    21, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 458.6950378418s, input_fired_time: 10.9703311920, output_fired_time: 7.7752118111, propagate_forward_time: 169.9182281494, propagate_backward_time: 259.6314392090, weight_update_time: 0.4480028152, other_time: 10.3998107910
epoch time: 47.1389808655s, input_fired_time: 1.4021549225, output_fired_time: 0.0000000000, propagate_forward_time: 43.3432273865, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3935966492
validation[          , genome 12590] predictions:    9816/  10000 (98.16%), best:    9836/10000 (98.36%), error:       599.09595, best error:       561.63300 on epoch:    21, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 506.8201904297s, input_fired_time: 9.2276430130, output_fired_time: 10.8297529221, propagate_forward_time: 194.6532745361, propagate_backward_time: 280.9580688477, weight_update_time: 0.6888707280, other_time: 11.1514892578
epoch time: 89.3509368896s, input_fired_time: 2.0284552574, output_fired_time: 0.0000000000, propagate_forward_time: 82.2979354858, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.0245437622
validation[          , genome 12590] predictions:    9807/  10000 (98.07%), best:    9836/10000 (98.36%), error:       616.33752, best error:       561.63300 on epoch:    21, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 865.9089965820s, input_fired_time: 20.4350833893, output_fired_time: 19.9482402802, propagate_forward_time: 323.1448669434, propagate_backward_time: 481.9616394043, weight_update_time: 1.1202353239, other_time: 20.4191894531
epoch time: 56.3333587646s, input_fired_time: 2.1886270046, output_fired_time: 0.0000000000, propagate_forward_time: 51.3560676575, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7886657715
validation[          , genome 12590] predictions:    9814/  10000 (98.14%), best:    9836/10000 (98.36%), error:       602.16791, best error:       561.63300 on epoch:    21, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 264.5833129883s, input_fired_time: 5.6200194359, output_fired_time: 5.1756186485, propagate_forward_time: 98.6816406250, propagate_backward_time: 148.8251953125, weight_update_time: 0.4149276614, other_time: 6.2808380127
epoch time: 23.0528793335s, input_fired_time: 0.7383300066, output_fired_time: 0.0000000000, propagate_forward_time: 21.2456951141, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0688533783
validation[          , genome 12590] predictions:    9791/  10000 (97.91%), best:    9836/10000 (98.36%), error:       641.49573, best error:       561.63300 on epoch:    21, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 266.2743530273s, input_fired_time: 5.7666468620, output_fired_time: 4.8851561546, propagate_forward_time: 99.6131362915, propagate_backward_time: 149.6375579834, weight_update_time: 0.4119119942, other_time: 6.3718719482
epoch time: 23.1946315765s, input_fired_time: 0.7782880664, output_fired_time: 0.0000000000, propagate_forward_time: 21.3077888489, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1085548401
validation[          , genome 12590] predictions:    9805/  10000 (98.05%), best:    9836/10000 (98.36%), error:       591.18683, best error:       561.63300 on epoch:    21, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 261.0307922363s, input_fired_time: 5.4457287788, output_fired_time: 4.8234233856, propagate_forward_time: 98.1038055420, propagate_backward_time: 146.2280578613, weight_update_time: 0.4103867114, other_time: 6.4297790527
epoch time: 21.1858062744s, input_fired_time: 0.6469686627, output_fired_time: 0.0000000000, propagate_forward_time: 19.4649810791, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0738563538
validation[          , genome 12590] predictions:    9780/  10000 (97.80%), best:    9836/10000 (98.36%), error:       740.07025, best error:       561.63300 on epoch:    21, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 262.3310852051s, input_fired_time: 5.6507949829, output_fired_time: 4.9658117294, propagate_forward_time: 98.3058013916, propagate_backward_time: 147.0140838623, weight_update_time: 0.4087978303, other_time: 6.3946075439
epoch time: 22.5318584442s, input_fired_time: 0.6700040102, output_fired_time: 0.0000000000, propagate_forward_time: 20.7562732697, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1055812836
validation[          , genome 12590] predictions:    9793/  10000 (97.93%), best:    9836/10000 (98.36%), error:       640.38049, best error:       561.63300 on epoch:    21, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 265.2887878418s, input_fired_time: 5.6366605759, output_fired_time: 5.0723571777, propagate_forward_time: 99.4580230713, propagate_backward_time: 148.6903839111, weight_update_time: 0.4126017392, other_time: 6.4313659668
epoch time: 24.1363487244s, input_fired_time: 0.7085172534, output_fired_time: 0.0000000000, propagate_forward_time: 22.2863941193, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1414375305
validation[          , genome 12590] predictions:    9784/  10000 (97.84%), best:    9836/10000 (98.36%), error:       695.94336, best error:       561.63300 on epoch:    21, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 259.4501342773s, input_fired_time: 5.5691237450, output_fired_time: 5.0927648544, propagate_forward_time: 97.4929122925, propagate_backward_time: 145.0372161865, weight_update_time: 0.4140202403, other_time: 6.2581329346
epoch time: 22.9240837097s, input_fired_time: 0.7288706303, output_fired_time: 0.0000000000, propagate_forward_time: 21.0424766541, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1527366638
validation[          , genome 12590] predictions:    9821/  10000 (98.21%), best:    9836/10000 (98.36%), error:       567.04547, best error:       561.63300 on epoch:    21, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 338.0549316406s, input_fired_time: 6.1410508156, output_fired_time: 6.4919180870, propagate_forward_time: 129.5534820557, propagate_backward_time: 188.4711608887, weight_update_time: 0.4482035041, other_time: 7.3973236084
epoch time: 37.2602767944s, input_fired_time: 1.0318152905, output_fired_time: 0.0000000000, propagate_forward_time: 34.4608154297, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7676467896
validation[          , genome 12590] predictions:    9837/  10000 (98.37%), best:    9837/10000 (98.37%), error:       544.49347, best error:       544.49347 on epoch:    31, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 422.9612731934s, input_fired_time: 8.4380760193, output_fired_time: 8.9708261490, propagate_forward_time: 161.0082397461, propagate_backward_time: 235.4185791016, weight_update_time: 0.9481956363, other_time: 9.1255493164
epoch time: 34.7059288025s, input_fired_time: 0.7497913837, output_fired_time: 0.0000000000, propagate_forward_time: 32.7304115295, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2257270813
validation[          , genome 12590] predictions:    9798/  10000 (97.98%), best:    9837/10000 (98.37%), error:       655.98627, best error:       544.49347 on epoch:    31, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 397.7180786133s, input_fired_time: 9.1701173782, output_fired_time: 7.7392458916, propagate_forward_time: 150.2946929932, propagate_backward_time: 220.6165618896, weight_update_time: 0.4498933256, other_time: 9.8974609375
epoch time: 35.6220932007s, input_fired_time: 0.8232178688, output_fired_time: 0.0000000000, propagate_forward_time: 33.5937652588, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2051086426
validation[          , genome 12590] predictions:    9806/  10000 (98.06%), best:    9837/10000 (98.37%), error:       650.61597, best error:       544.49347 on epoch:    31, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 408.3852844238s, input_fired_time: 8.4795055389, output_fired_time: 8.0278253555, propagate_forward_time: 154.9934234619, propagate_backward_time: 228.3625335693, weight_update_time: 0.4482263625, other_time: 8.5220031738
epoch time: 37.4511184692s, input_fired_time: 1.4308923483, output_fired_time: 0.0000000000, propagate_forward_time: 34.6530075073, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3672180176
validation[          , genome 12590] predictions:    9799/  10000 (97.99%), best:    9837/10000 (98.37%), error:       613.43689, best error:       544.49347 on epoch:    31, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 421.9610595703s, input_fired_time: 9.8477287292, output_fired_time: 7.8749241829, propagate_forward_time: 158.8628082275, propagate_backward_time: 235.2285003662, weight_update_time: 0.7449806333, other_time: 10.1470947266
epoch time: 35.0680809021s, input_fired_time: 1.0682195425, output_fired_time: 0.0000000000, propagate_forward_time: 32.7004623413, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2994003296
validation[          , genome 12590] predictions:    9836/  10000 (98.36%), best:    9836/10000 (98.36%), error:       519.53674, best error:       519.53674 on epoch:    35, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 396.0548706055s, input_fired_time: 8.4422721863, output_fired_time: 7.8513894081, propagate_forward_time: 150.9645996094, propagate_backward_time: 220.3855438232, weight_update_time: 0.5749680996, other_time: 8.4110870361
epoch time: 34.4026947021s, input_fired_time: 0.7504876852, output_fired_time: 0.0000000000, propagate_forward_time: 31.9205608368, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7316455841
validation[          , genome 12590] predictions:    9809/  10000 (98.09%), best:    9836/10000 (98.36%), error:       633.50696, best error:       519.53674 on epoch:    35, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 394.7871398926s, input_fired_time: 7.6341390610, output_fired_time: 7.3652892113, propagate_forward_time: 148.1282806396, propagate_backward_time: 221.2974395752, weight_update_time: 0.5116460323, other_time: 10.3619995117
epoch time: 35.8215675354s, input_fired_time: 0.8094927669, output_fired_time: 0.0000000000, propagate_forward_time: 33.8034706116, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2086029053
validation[          , genome 12590] predictions:    9785/  10000 (97.85%), best:    9836/10000 (98.36%), error:       693.54242, best error:       519.53674 on epoch:    35, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 410.0749511719s, input_fired_time: 8.3379335403, output_fired_time: 8.6179494858, propagate_forward_time: 155.5559387207, propagate_backward_time: 228.2628784180, weight_update_time: 0.4930482209, other_time: 9.3002624512
epoch time: 34.8630180359s, input_fired_time: 1.2544318438, output_fired_time: 0.0000000000, propagate_forward_time: 32.3581542969, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2504310608
validation[          , genome 12590] predictions:    9794/  10000 (97.94%), best:    9836/10000 (98.36%), error:       605.47870, best error:       519.53674 on epoch:    35, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 400.7849731445s, input_fired_time: 9.0555925369, output_fired_time: 7.0707240105, propagate_forward_time: 149.9322967529, propagate_backward_time: 225.4935150146, weight_update_time: 0.6975171566, other_time: 9.2328491211
epoch time: 35.3664779663s, input_fired_time: 1.0060112476, output_fired_time: 0.0000000000, propagate_forward_time: 32.3107986450, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0496673584
validation[          , genome 12590] predictions:    9814/  10000 (98.14%), best:    9836/10000 (98.36%), error:       571.28699, best error:       519.53674 on epoch:    35, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 396.2131042480s, input_fired_time: 8.0844125748, output_fired_time: 7.7855730057, propagate_forward_time: 150.0222473145, propagate_backward_time: 220.9126281738, weight_update_time: 1.0262829065, other_time: 9.4082336426
epoch time: 34.3632621765s, input_fired_time: 0.7497385740, output_fired_time: 0.0000000000, propagate_forward_time: 32.1249694824, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4885559082
validation[          , genome 12590] predictions:    9818/  10000 (98.18%), best:    9836/10000 (98.36%), error:       582.17108, best error:       519.53674 on epoch:    35, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 399.4176025391s, input_fired_time: 8.8238039017, output_fired_time: 7.8491535187, propagate_forward_time: 150.0119476318, propagate_backward_time: 224.3775787354, weight_update_time: 0.4478337169, other_time: 8.3551330566
epoch time: 34.5813903809s, input_fired_time: 1.2777872086, output_fired_time: 0.0000000000, propagate_forward_time: 31.5521888733, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7514152527
validation[          , genome 12590] predictions:    9797/  10000 (97.97%), best:    9836/10000 (98.36%), error:       619.48187, best error:       519.53674 on epoch:    35, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 367.8545227051s, input_fired_time: 6.9542088509, output_fired_time: 6.5323481560, propagate_forward_time: 138.8343353271, propagate_backward_time: 205.9284973145, weight_update_time: 0.6909090281, other_time: 9.6051177979
epoch time: 21.1517772675s, input_fired_time: 0.6577209234, output_fired_time: 0.0000000000, propagate_forward_time: 19.4234943390, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0705623627
validation[          , genome 12590] predictions:    9832/  10000 (98.32%), best:    9836/10000 (98.36%), error:       534.11975, best error:       519.53674 on epoch:    35, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 255.0893707275s, input_fired_time: 5.7749748230, output_fired_time: 4.9540395737, propagate_forward_time: 95.1212081909, propagate_backward_time: 143.0794982910, weight_update_time: 0.4021157324, other_time: 6.1596374512
epoch time: 21.9574203491s, input_fired_time: 0.7202218175, output_fired_time: 0.0000000000, propagate_forward_time: 20.1488666534, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0883312225
validation[          , genome 12590] predictions:    9811/  10000 (98.11%), best:    9836/10000 (98.36%), error:       587.54041, best error:       519.53674 on epoch:    35, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 246.5568237305s, input_fired_time: 5.4165568352, output_fired_time: 4.8132643700, propagate_forward_time: 91.9818725586, propagate_backward_time: 138.3183135986, weight_update_time: 0.4025717080, other_time: 6.0268249512
epoch time: 22.0143852234s, input_fired_time: 0.6736751199, output_fired_time: 0.0000000000, propagate_forward_time: 20.2436637878, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0970458984
validation[          , genome 12590] predictions:    9836/  10000 (98.36%), best:    9836/10000 (98.36%), error:       516.43250, best error:       516.43250 on epoch:    44, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 251.2325897217s, input_fired_time: 5.5254302025, output_fired_time: 4.8664007187, propagate_forward_time: 93.8926315308, propagate_backward_time: 140.7339630127, weight_update_time: 0.4481627047, other_time: 6.2141571045
epoch time: 24.0711765289s, input_fired_time: 0.8076291680, output_fired_time: 0.0000000000, propagate_forward_time: 22.1378364563, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1257114410
validation[          , genome 12590] predictions:    9813/  10000 (98.13%), best:    9836/10000 (98.36%), error:       549.76257, best error:       516.43250 on epoch:    44, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 252.9567565918s, input_fired_time: 5.4724593163, output_fired_time: 4.8196578026, propagate_forward_time: 94.7965393066, propagate_backward_time: 141.7480163574, weight_update_time: 0.4061007798, other_time: 6.1200866699
epoch time: 22.9363384247s, input_fired_time: 0.7104919553, output_fired_time: 0.0000000000, propagate_forward_time: 21.0887870789, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1370601654
validation[          , genome 12590] predictions:    9825/  10000 (98.25%), best:    9836/10000 (98.36%), error:       533.00262, best error:       516.43250 on epoch:    44, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 252.4789428711s, input_fired_time: 5.5477228165, output_fired_time: 4.9260792732, propagate_forward_time: 94.3541641235, propagate_backward_time: 141.4821929932, weight_update_time: 0.4069555104, other_time: 6.1687774658
epoch time: 21.1130294800s, input_fired_time: 0.6566053629, output_fired_time: 0.0000000000, propagate_forward_time: 19.3809585571, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0754661560
validation[          , genome 12590] predictions:    9818/  10000 (98.18%), best:    9836/10000 (98.36%), error:       559.95703, best error:       516.43250 on epoch:    44, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 246.5526123047s, input_fired_time: 5.4388227463, output_fired_time: 4.7769842148, propagate_forward_time: 92.0985183716, propagate_backward_time: 138.2248687744, weight_update_time: 0.4048025310, other_time: 6.0134124756
epoch time: 20.9565715790s, input_fired_time: 0.6524953246, output_fired_time: 0.0000000000, propagate_forward_time: 19.2380943298, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0659828186
validation[          , genome 12590] predictions:    9824/  10000 (98.24%), best:    9836/10000 (98.36%), error:       518.95770, best error:       516.43250 on epoch:    44, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 245.8101196289s, input_fired_time: 5.4182009697, output_fired_time: 4.7702593803, propagate_forward_time: 91.5946273804, propagate_backward_time: 138.0014953613, weight_update_time: 0.4061407447, other_time: 6.0255432129
epoch time: 21.1820926666s, input_fired_time: 0.6595182419, output_fired_time: 0.0000000000, propagate_forward_time: 19.4536037445, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0689716339
validation[          , genome 12590] predictions:    9833/  10000 (98.33%), best:    9833/10000 (98.33%), error:       499.80289, best error:       499.80289 on epoch:    49, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 241.4659423828s, input_fired_time: 5.3529639244, output_fired_time: 4.6683588028, propagate_forward_time: 89.9270095825, propagate_backward_time: 135.5379028320, weight_update_time: 0.4019443691, other_time: 5.9797058105
epoch time: 21.2676429749s, input_fired_time: 0.6572165489, output_fired_time: 0.0000000000, propagate_forward_time: 19.5325527191, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0778732300
validation[          , genome 12590] predictions:    9820/  10000 (98.20%), best:    9833/10000 (98.33%), error:       564.11035, best error:       499.80289 on epoch:    49, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 242.0428619385s, input_fired_time: 5.3572030067, output_fired_time: 4.7116780281, propagate_forward_time: 89.9231033325, propagate_backward_time: 136.0873718262, weight_update_time: 0.4015828669, other_time: 5.9635009766
epoch time: 21.3348751068s, input_fired_time: 0.6663734913, output_fired_time: 0.0000000000, propagate_forward_time: 19.5846996307, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0838012695
validation[          , genome 12590] predictions:    9822/  10000 (98.22%), best:    9833/10000 (98.33%), error:       574.31189, best error:       499.80289 on epoch:    49, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 240.4493103027s, input_fired_time: 5.3404664993, output_fired_time: 4.6551852226, propagate_forward_time: 89.3982162476, propagate_backward_time: 135.1316223145, weight_update_time: 0.3989555538, other_time: 5.9238281250
epoch time: 20.3999176025s, input_fired_time: 0.6434651017, output_fired_time: 0.0000000000, propagate_forward_time: 18.7182483673, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0382041931
validation[          , genome 12590] predictions:    9826/  10000 (98.26%), best:    9833/10000 (98.33%), error:       552.48114, best error:       499.80289 on epoch:    49, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 239.9259185791s, input_fired_time: 5.3592023849, output_fired_time: 4.6908369064, propagate_forward_time: 89.4361267090, propagate_backward_time: 134.5156707764, weight_update_time: 0.3985651731, other_time: 5.9240722656
epoch time: 20.2813434601s, input_fired_time: 0.6370010972, output_fired_time: 0.0000000000, propagate_forward_time: 18.6028499603, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0414924622
validation[          , genome 12590] predictions:    9805/  10000 (98.05%), best:    9833/10000 (98.33%), error:       564.87280, best error:       499.80289 on epoch:    49, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 239.7122344971s, input_fired_time: 5.3340101242, output_fired_time: 4.6870770454, propagate_forward_time: 89.0224075317, propagate_backward_time: 134.7500305176, weight_update_time: 0.3976838589, other_time: 5.9187011719
epoch time: 20.5761146545s, input_fired_time: 0.6459914446, output_fired_time: 0.0000000000, propagate_forward_time: 18.8778343201, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0522880554
validation[          , genome 12590] predictions:    9819/  10000 (98.19%), best:    9833/10000 (98.33%), error:       577.14417, best error:       499.80289 on epoch:    49, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 237.6849975586s, input_fired_time: 5.3170690536, output_fired_time: 4.6004719734, propagate_forward_time: 88.5225296021, propagate_backward_time: 133.3320922852, weight_update_time: 0.3980289698, other_time: 5.9128417969
epoch time: 20.4711208344s, input_fired_time: 0.6416372657, output_fired_time: 0.0000000000, propagate_forward_time: 18.7837047577, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0457782745
validation[          , genome 12590] predictions:    9820/  10000 (98.20%), best:    9833/10000 (98.33%), error:       521.38098, best error:       499.80289 on epoch:    49, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 238.4829559326s, input_fired_time: 5.3112473488, output_fired_time: 4.6291813850, propagate_forward_time: 88.4858474731, propagate_backward_time: 134.1568603516, weight_update_time: 0.3962564170, other_time: 5.8998107910
epoch time: 20.2420215607s, input_fired_time: 0.6385371685, output_fired_time: 0.0000000000, propagate_forward_time: 18.5667400360, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0367450714
validation[          , genome 12590] predictions:    9846/  10000 (98.46%), best:    9846/10000 (98.46%), error:       492.10599, best error:       492.10599 on epoch:    56, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 238.0740051270s, input_fired_time: 5.3200311661, output_fired_time: 4.6577329636, propagate_forward_time: 88.2455215454, propagate_backward_time: 133.9747314453, weight_update_time: 0.3951792717, other_time: 5.8759765625
epoch time: 21.9524688721s, input_fired_time: 0.6749019623, output_fired_time: 0.0000000000, propagate_forward_time: 20.1807765961, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0967903137
validation[          , genome 12590] predictions:    9836/  10000 (98.36%), best:    9846/10000 (98.46%), error:       492.69312, best error:       492.10599 on epoch:    56, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 240.3761291504s, input_fired_time: 5.3245778084, output_fired_time: 4.6737928391, propagate_forward_time: 88.8480148315, propagate_backward_time: 135.6123809814, weight_update_time: 0.3977712691, other_time: 5.9173431396
epoch time: 20.4730930328s, input_fired_time: 0.6499707103, output_fired_time: 0.0000000000, propagate_forward_time: 18.7701988220, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0529232025
validation[          , genome 12590] predictions:    9830/  10000 (98.30%), best:    9846/10000 (98.46%), error:       545.13196, best error:       492.10599 on epoch:    56, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 236.1217498779s, input_fired_time: 5.3002920151, output_fired_time: 4.5784044266, propagate_forward_time: 87.6844177246, propagate_backward_time: 132.7030792236, weight_update_time: 0.3939748406, other_time: 5.8555603027
epoch time: 20.9449424744s, input_fired_time: 0.6553047299, output_fired_time: 0.0000000000, propagate_forward_time: 19.2195091248, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0701293945
validation[          , genome 12590] predictions:    9855/  10000 (98.55%), best:    9855/10000 (98.55%), error:       474.60782, best error:       474.60782 on epoch:    59, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 237.3153686523s, input_fired_time: 5.3037624359, output_fired_time: 4.6099362373, propagate_forward_time: 87.8910522461, propagate_backward_time: 133.6213684082, weight_update_time: 0.3955821395, other_time: 5.8892517090
epoch time: 20.3114395142s, input_fired_time: 0.6400567293, output_fired_time: 0.0000000000, propagate_forward_time: 18.6215648651, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0498180389
validation[          , genome 12590] predictions:    9827/  10000 (98.27%), best:    9855/10000 (98.55%), error:       524.01459, best error:       474.60782 on epoch:    59, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 237.0680847168s, input_fired_time: 5.3226547241, output_fired_time: 4.5676178932, propagate_forward_time: 88.6166915894, propagate_backward_time: 132.6591033936, weight_update_time: 0.3964407146, other_time: 5.9020233154
epoch time: 20.5111484528s, input_fired_time: 0.6469345689, output_fired_time: 0.0000000000, propagate_forward_time: 18.8105182648, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0536956787
validation[          , genome 12590] predictions:    9831/  10000 (98.31%), best:    9855/10000 (98.55%), error:       498.78226, best error:       474.60782 on epoch:    59, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 239.9708709717s, input_fired_time: 5.3625516891, output_fired_time: 4.6730976105, propagate_forward_time: 89.2994537354, propagate_backward_time: 134.7067108154, weight_update_time: 0.3977173865, other_time: 5.9290618896
epoch time: 20.5491676331s, input_fired_time: 0.6525629163, output_fired_time: 0.0000000000, propagate_forward_time: 18.8494758606, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0471286774
validation[          , genome 12590] predictions:    9806/  10000 (98.06%), best:    9855/10000 (98.55%), error:       569.26306, best error:       474.60782 on epoch:    59, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 239.7138214111s, input_fired_time: 5.3441939354, output_fired_time: 4.6807680130, propagate_forward_time: 88.7113952637, propagate_backward_time: 135.0645904541, weight_update_time: 0.3975558877, other_time: 5.9128723145
epoch time: 20.7701950073s, input_fired_time: 0.6548419595, output_fired_time: 0.0000000000, propagate_forward_time: 19.0545310974, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0608215332
validation[          , genome 12590] predictions:    9841/  10000 (98.41%), best:    9855/10000 (98.55%), error:       502.95035, best error:       474.60782 on epoch:    59, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 266.9210205078s, input_fired_time: 5.4723825455, output_fired_time: 4.8121032715, propagate_forward_time: 99.0906600952, propagate_backward_time: 150.9641113281, weight_update_time: 0.4095429480, other_time: 6.5817565918
epoch time: 32.3850326538s, input_fired_time: 0.9843915105, output_fired_time: 0.0000000000, propagate_forward_time: 30.2352867126, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1653537750
validation[          , genome 12590] predictions:    9846/  10000 (98.46%), best:    9855/10000 (98.55%), error:       514.82104, best error:       474.60782 on epoch:    59, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 372.1887512207s, input_fired_time: 6.3508853912, output_fired_time: 7.6297979355, propagate_forward_time: 142.8424682617, propagate_backward_time: 205.0969085693, weight_update_time: 0.4378676116, other_time: 10.2686920166
epoch time: 32.2158126831s, input_fired_time: 1.4787021875, output_fired_time: 0.0000000000, propagate_forward_time: 29.0563049316, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6808052063
validation[          , genome 12590] predictions:    9844/  10000 (98.44%), best:    9855/10000 (98.55%), error:       507.53976, best error:       474.60782 on epoch:    59, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 371.3868103027s, input_fired_time: 8.8566036224, output_fired_time: 6.8570613861, propagate_forward_time: 142.3364562988, propagate_backward_time: 205.0819091797, weight_update_time: 0.4370315671, other_time: 8.2547912598
epoch time: 32.3691101074s, input_fired_time: 0.7329820395, output_fired_time: 0.0000000000, propagate_forward_time: 30.2240600586, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4120674133
validation[          , genome 12590] predictions:    9847/  10000 (98.47%), best:    9855/10000 (98.55%), error:       495.58109, best error:       474.60782 on epoch:    59, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 371.5803527832s, input_fired_time: 8.1272907257, output_fired_time: 6.5920166969, propagate_forward_time: 141.1332855225, propagate_backward_time: 206.1717376709, weight_update_time: 0.7039547563, other_time: 9.5560302734
epoch time: 32.1802711487s, input_fired_time: 1.2281637192, output_fired_time: 0.0000000000, propagate_forward_time: 29.2796974182, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6724090576
validation[          , genome 12590] predictions:    9838/  10000 (98.38%), best:    9855/10000 (98.55%), error:       507.04715, best error:       474.60782 on epoch:    59, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 370.5619506836s, input_fired_time: 8.3716421127, output_fired_time: 6.8434128761, propagate_forward_time: 137.9382934570, propagate_backward_time: 207.9020996094, weight_update_time: 0.4366199970, other_time: 9.5065002441
epoch time: 32.9667472839s, input_fired_time: 1.2434682846, output_fired_time: 0.0000000000, propagate_forward_time: 30.2898750305, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4334030151
validation[          , genome 12590] predictions:    9825/  10000 (98.25%), best:    9855/10000 (98.55%), error:       522.47565, best error:       474.60782 on epoch:    59, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 370.6119384766s, input_fired_time: 9.1015319824, output_fired_time: 6.8400402069, propagate_forward_time: 135.7113800049, propagate_backward_time: 210.4634704590, weight_update_time: 0.4368494749, other_time: 8.4955291748
epoch time: 31.2591876984s, input_fired_time: 0.7131670713, output_fired_time: 0.0000000000, propagate_forward_time: 28.9002056122, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6458148956
validation[          , genome 12590] predictions:    9836/  10000 (98.36%), best:    9855/10000 (98.55%), error:       527.57715, best error:       474.60782 on epoch:    59, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 366.1856689453s, input_fired_time: 7.3040080070, output_fired_time: 6.7646651268, propagate_forward_time: 138.0214691162, propagate_backward_time: 206.6438140869, weight_update_time: 0.4346831143, other_time: 7.4516906738
epoch time: 31.9931106567s, input_fired_time: 0.9724192023, output_fired_time: 0.0000000000, propagate_forward_time: 29.6042747498, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4164161682
validation[          , genome 12590] predictions:    9844/  10000 (98.44%), best:    9855/10000 (98.55%), error:       485.73099, best error:       474.60782 on epoch:    59, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 366.3045654297s, input_fired_time: 6.8121385574, output_fired_time: 9.0251865387, propagate_forward_time: 139.8468933105, propagate_backward_time: 202.3640899658, weight_update_time: 0.4349761307, other_time: 8.2562713623
epoch time: 32.2732925415s, input_fired_time: 1.2363487482, output_fired_time: 0.0000000000, propagate_forward_time: 29.3730049133, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6639385223
validation[          , genome 12590] predictions:    9841/  10000 (98.41%), best:    9855/10000 (98.55%), error:       501.46216, best error:       474.60782 on epoch:    59, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 371.6133117676s, input_fired_time: 8.1491508484, output_fired_time: 6.3551130295, propagate_forward_time: 139.3556060791, propagate_backward_time: 209.2408905029, weight_update_time: 0.4370578229, other_time: 8.5125732422
epoch time: 33.5765037537s, input_fired_time: 1.0022242069, output_fired_time: 0.0000000000, propagate_forward_time: 31.1398468018, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4344329834
validation[          , genome 12590] predictions:    9785/  10000 (97.85%), best:    9855/10000 (98.55%), error:       654.91064, best error:       474.60782 on epoch:    59, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 367.4556884766s, input_fired_time: 8.6100254059, output_fired_time: 6.5402398109, propagate_forward_time: 136.2375946045, propagate_backward_time: 207.3267364502, weight_update_time: 0.6862537861, other_time: 8.7410888672
epoch time: 32.4531593323s, input_fired_time: 0.7335112691, output_fired_time: 0.0000000000, propagate_forward_time: 30.2935085297, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4261398315
validation[          , genome 12590] predictions:    9835/  10000 (98.35%), best:    9855/10000 (98.55%), error:       524.22571, best error:       474.60782 on epoch:    59, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 366.2963562012s, input_fired_time: 8.0571861267, output_fired_time: 7.5386590958, propagate_forward_time: 137.8885192871, propagate_backward_time: 205.1267700195, weight_update_time: 0.4329960048, other_time: 7.6852111816
epoch time: 31.9483623505s, input_fired_time: 0.9780217409, output_fired_time: 0.0000000000, propagate_forward_time: 29.8103332520, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1600074768
validation[          , genome 12590] predictions:    9843/  10000 (98.43%), best:    9855/10000 (98.55%), error:       497.45535, best error:       474.60782 on epoch:    59, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 351.7123718262s, input_fired_time: 8.1522884369, output_fired_time: 8.3524494171, propagate_forward_time: 128.4415130615, propagate_backward_time: 197.9927520752, weight_update_time: 0.4211216271, other_time: 8.7733764648
epoch time: 32.0159149170s, input_fired_time: 0.7280983925, output_fired_time: 0.0000000000, propagate_forward_time: 30.1334781647, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1543388367
validation[          , genome 12590] predictions:    9838/  10000 (98.38%), best:    9855/10000 (98.55%), error:       508.12283, best error:       474.60782 on epoch:    59, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 364.4047241211s, input_fired_time: 9.5538911819, output_fired_time: 6.5374403000, propagate_forward_time: 136.9378967285, propagate_backward_time: 203.7017669678, weight_update_time: 0.4317286015, other_time: 7.6737213135
epoch time: 32.2250518799s, input_fired_time: 0.9812099934, output_fired_time: 0.0000000000, propagate_forward_time: 29.8256835938, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4181575775
validation[          , genome 12590] predictions:    9824/  10000 (98.24%), best:    9855/10000 (98.55%), error:       547.21564, best error:       474.60782 on epoch:    59, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 364.5635070801s, input_fired_time: 6.7859654427, output_fired_time: 6.7587256432, propagate_forward_time: 137.2002410889, propagate_backward_time: 203.8750915527, weight_update_time: 0.4336396158, other_time: 9.9434661865
epoch time: 32.0993003845s, input_fired_time: 0.9791967273, output_fired_time: 0.0000000000, propagate_forward_time: 29.4588127136, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6612911224
validation[          , genome 12590] predictions:    9841/  10000 (98.41%), best:    9855/10000 (98.55%), error:       503.88702, best error:       474.60782 on epoch:    59, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 366.8706970215s, input_fired_time: 7.5701060295, output_fired_time: 7.2831954956, propagate_forward_time: 139.4541473389, propagate_backward_time: 204.3422088623, weight_update_time: 0.4338945150, other_time: 8.2210388184
epoch time: 32.2991561890s, input_fired_time: 1.2346442938, output_fired_time: 0.0000000000, propagate_forward_time: 29.3927154541, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6717967987
validation[          , genome 12590] predictions:    9841/  10000 (98.41%), best:    9855/10000 (98.55%), error:       479.24838, best error:       474.60782 on epoch:    59, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 366.5823669434s, input_fired_time: 7.8186101913, output_fired_time: 7.0911126137, propagate_forward_time: 137.4674224854, propagate_backward_time: 203.7787017822, weight_update_time: 0.9329815507, other_time: 10.4265136719
epoch time: 31.9785766602s, input_fired_time: 0.7286878824, output_fired_time: 0.0000000000, propagate_forward_time: 30.0911102295, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1587791443
validation[          , genome 12590] predictions:    9837/  10000 (98.37%), best:    9855/10000 (98.55%), error:       495.16592, best error:       474.60782 on epoch:    59, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 368.1693115234s, input_fired_time: 9.1019287109, output_fired_time: 8.0665264130, propagate_forward_time: 137.4098052979, propagate_backward_time: 206.3904418945, weight_update_time: 0.6844053864, other_time: 7.2006072998
epoch time: 32.2201881409s, input_fired_time: 0.7347269654, output_fired_time: 0.0000000000, propagate_forward_time: 30.3152294159, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1702308655
validation[          , genome 12590] predictions:    9849/  10000 (98.49%), best:    9849/10000 (98.49%), error:       473.28897, best error:       473.28897 on epoch:    80, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 369.6851196289s, input_fired_time: 7.6116824150, output_fired_time: 6.3221292496, propagate_forward_time: 136.5890808105, propagate_backward_time: 209.9317321777, weight_update_time: 0.9352464676, other_time: 9.2304687500
epoch time: 31.5302829742s, input_fired_time: 0.7225274444, output_fired_time: 0.0000000000, propagate_forward_time: 28.9108390808, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8969173431
validation[          , genome 12590] predictions:    9843/  10000 (98.43%), best:    9849/10000 (98.49%), error:       502.01956, best error:       473.28897 on epoch:    80, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 370.7725219727s, input_fired_time: 8.1193695068, output_fired_time: 8.8527011871, propagate_forward_time: 140.2919769287, propagate_backward_time: 205.0218658447, weight_update_time: 0.6852964759, other_time: 8.4866027832
epoch time: 31.2922019958s, input_fired_time: 0.7147698402, output_fired_time: 0.0000000000, propagate_forward_time: 29.4299468994, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1474857330
validation[          , genome 12590] predictions:    9840/  10000 (98.40%), best:    9849/10000 (98.49%), error:       516.94617, best error:       473.28897 on epoch:    80, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 372.4629821777s, input_fired_time: 8.4246606827, output_fired_time: 6.3657827377, propagate_forward_time: 141.5944061279, propagate_backward_time: 208.0360870361, weight_update_time: 0.6895995736, other_time: 8.0420532227
epoch time: 32.5779113770s, input_fired_time: 0.9928314090, output_fired_time: 0.0000000000, propagate_forward_time: 30.4124431610, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1726360321
validation[          , genome 12590] predictions:    9856/  10000 (98.56%), best:    9856/10000 (98.56%), error:       455.20514, best error:       455.20514 on epoch:    83, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 374.0471801758s, input_fired_time: 8.1462335587, output_fired_time: 7.1524391174, propagate_forward_time: 141.2946319580, propagate_backward_time: 208.4124450684, weight_update_time: 0.6890739202, other_time: 9.0414276123
epoch time: 32.7343482971s, input_fired_time: 0.9937003851, output_fired_time: 0.0000000000, propagate_forward_time: 30.3143291473, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4263191223
validation[          , genome 12590] predictions:    9840/  10000 (98.40%), best:    9856/10000 (98.56%), error:       493.86636, best error:       455.20514 on epoch:    83, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 381.0726623535s, input_fired_time: 7.9906001091, output_fired_time: 7.2384433746, propagate_forward_time: 145.2867279053, propagate_backward_time: 211.9318542480, weight_update_time: 0.6958510876, other_time: 8.6250457764
epoch time: 34.1788063049s, input_fired_time: 0.7644512057, output_fired_time: 0.0000000000, propagate_forward_time: 31.9585037231, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4558525085
validation[          , genome 12590] predictions:    9847/  10000 (98.47%), best:    9856/10000 (98.56%), error:       487.34216, best error:       455.20514 on epoch:    83, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 386.4433898926s, input_fired_time: 8.7813806534, output_fired_time: 7.7992057800, propagate_forward_time: 145.3192901611, propagate_backward_time: 216.1003112793, weight_update_time: 0.6974059343, other_time: 8.4432220459
epoch time: 34.1825256348s, input_fired_time: 1.0482207537, output_fired_time: 0.0000000000, propagate_forward_time: 31.4217185974, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7125854492
validation[          , genome 12590] predictions:    9841/  10000 (98.41%), best:    9856/10000 (98.56%), error:       478.93475, best error:       455.20514 on epoch:    83, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 399.1968688965s, input_fired_time: 8.0089578629, output_fired_time: 7.6900243759, propagate_forward_time: 151.2090454102, propagate_backward_time: 223.1519012451, weight_update_time: 0.4656671584, other_time: 9.1369171143
epoch time: 35.7429428101s, input_fired_time: 0.8240169883, output_fired_time: 0.0000000000, propagate_forward_time: 32.9175224304, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0014038086
validation[          , genome 12590] predictions:    9825/  10000 (98.25%), best:    9856/10000 (98.56%), error:       526.25525, best error:       455.20514 on epoch:    83, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 408.1970520020s, input_fired_time: 9.1450719833, output_fired_time: 8.0809574127, propagate_forward_time: 153.9317932129, propagate_backward_time: 229.6532592773, weight_update_time: 0.4632521868, other_time: 7.3859558105
epoch time: 35.8122711182s, input_fired_time: 1.0779941082, output_fired_time: 0.0000000000, propagate_forward_time: 33.2841682434, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4501075745
validation[          , genome 12590] predictions:    9839/  10000 (98.39%), best:    9856/10000 (98.56%), error:       486.97711, best error:       455.20514 on epoch:    83, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 416.7290344238s, input_fired_time: 7.7738852501, output_fired_time: 7.7553544044, propagate_forward_time: 159.3229675293, propagate_backward_time: 231.3289184570, weight_update_time: 0.4487293959, other_time: 10.5479125977
epoch time: 37.0499229431s, input_fired_time: 1.2987446785, output_fired_time: 0.0000000000, propagate_forward_time: 33.9174423218, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8337364197
validation[          , genome 12590] predictions:    9841/  10000 (98.41%), best:    9856/10000 (98.56%), error:       490.08710, best error:       455.20514 on epoch:    83, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 413.4527893066s, input_fired_time: 7.7276430130, output_fired_time: 7.9139556885, propagate_forward_time: 157.7645874023, propagate_backward_time: 229.9276428223, weight_update_time: 0.4474862516, other_time: 10.1189880371
epoch time: 36.7355804443s, input_fired_time: 1.2810628414, output_fired_time: 0.0000000000, propagate_forward_time: 33.3900070190, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0645103455
validation[          , genome 12590] predictions:    9838/  10000 (98.38%), best:    9856/10000 (98.56%), error:       498.71014, best error:       455.20514 on epoch:    83, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 413.7532348633s, input_fired_time: 9.3361186981, output_fired_time: 7.9896173477, propagate_forward_time: 156.5021209717, propagate_backward_time: 230.7095642090, weight_update_time: 0.9482528567, other_time: 9.2158050537
epoch time: 35.1549224854s, input_fired_time: 1.5175585747, output_fired_time: 0.0000000000, propagate_forward_time: 31.6643676758, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9729957581
validation[          , genome 12590] predictions:    9831/  10000 (98.31%), best:    9856/10000 (98.56%), error:       495.14822, best error:       455.20514 on epoch:    83, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 412.9477539063s, input_fired_time: 8.7212600708, output_fired_time: 7.9487948418, propagate_forward_time: 155.2053985596, propagate_backward_time: 232.0568542480, weight_update_time: 0.7453176975, other_time: 9.0154571533
epoch time: 36.8254890442s, input_fired_time: 1.0584052801, output_fired_time: 0.0000000000, propagate_forward_time: 34.4058532715, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3612289429
validation[          , genome 12590] predictions:    9814/  10000 (98.14%), best:    9856/10000 (98.56%), error:       555.23877, best error:       455.20514 on epoch:    83, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 418.9324951172s, input_fired_time: 8.4552259445, output_fired_time: 7.7387018204, propagate_forward_time: 159.1172332764, propagate_backward_time: 232.3894958496, weight_update_time: 1.2292757034, other_time: 11.2318267822
epoch time: 36.0943641663s, input_fired_time: 1.0469541550, output_fired_time: 0.0000000000, propagate_forward_time: 33.4795379639, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5678710938
validation[          , genome 12590] predictions:    9832/  10000 (98.32%), best:    9856/10000 (98.56%), error:       504.27057, best error:       455.20514 on epoch:    83, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 426.9819946289s, input_fired_time: 8.9790058136, output_fired_time: 7.9830961227, propagate_forward_time: 159.7235412598, propagate_backward_time: 240.5807495117, weight_update_time: 0.5267797709, other_time: 9.7156066895
epoch time: 39.4614143372s, input_fired_time: 1.3134082556, output_fired_time: 0.0000000000, propagate_forward_time: 36.7575111389, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3904953003
validation[          , genome 12590] predictions:    9839/  10000 (98.39%), best:    9856/10000 (98.56%), error:       497.79761, best error:       455.20514 on epoch:    83, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 417.9372558594s, input_fired_time: 9.4233827591, output_fired_time: 8.0962953568, propagate_forward_time: 157.9600372314, propagate_backward_time: 233.7432250977, weight_update_time: 0.5419149995, other_time: 8.7143402100
epoch time: 41.7486953735s, input_fired_time: 0.8627586961, output_fired_time: 0.0000000000, propagate_forward_time: 38.9589004517, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9270362854
validation[          , genome 12590] predictions:    9825/  10000 (98.25%), best:    9856/10000 (98.56%), error:       521.13190, best error:       455.20514 on epoch:    83, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 424.2927246094s, input_fired_time: 9.3030004501, output_fired_time: 8.2381477356, propagate_forward_time: 159.8574829102, propagate_backward_time: 236.2983703613, weight_update_time: 0.4946257472, other_time: 10.5957031250
epoch time: 36.0076751709s, input_fired_time: 1.0362993479, output_fired_time: 0.0000000000, propagate_forward_time: 33.6341247559, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3372497559
validation[          , genome 12590] predictions:    9839/  10000 (98.39%), best:    9856/10000 (98.56%), error:       493.71741, best error:       455.20514 on epoch:    83, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 433.2716064453s, input_fired_time: 8.9453802109, output_fired_time: 9.1787948608, propagate_forward_time: 166.4536132813, propagate_backward_time: 239.5961914063, weight_update_time: 0.7759043574, other_time: 9.0976257324
epoch time: 36.9337959290s, input_fired_time: 1.1597757339, output_fired_time: 0.0000000000, propagate_forward_time: 33.6767158508, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0973052979
validation[          , genome 12590] predictions:    9842/  10000 (98.42%), best:    9856/10000 (98.56%), error:       490.59927, best error:       455.20514 on epoch:    83, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 440.2169494629s, input_fired_time: 8.1464490891, output_fired_time: 9.9260330200, propagate_forward_time: 164.7387542725, propagate_backward_time: 248.2129364014, weight_update_time: 0.5097951889, other_time: 9.1927642822
epoch time: 36.7497100830s, input_fired_time: 1.4549095631, output_fired_time: 0.0000000000, propagate_forward_time: 34.0452766418, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2495231628
validation[          , genome 12590] predictions:    9832/  10000 (98.32%), best:    9856/10000 (98.56%), error:       511.99759, best error:       455.20514 on epoch:    83, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 435.3010559082s, input_fired_time: 7.2779736519, output_fired_time: 7.9779534340, propagate_forward_time: 166.1045074463, propagate_backward_time: 242.7958831787, weight_update_time: 0.9481539726, other_time: 11.1447143555
epoch time: 38.1124725342s, input_fired_time: 0.9205411077, output_fired_time: 0.0000000000, propagate_forward_time: 34.5851783752, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6067543030
validation[          , genome 12590] predictions:    9842/  10000 (98.42%), best:    9856/10000 (98.56%), error:       485.29636, best error:       455.20514 on epoch:    83, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 446.1296997070s, input_fired_time: 9.3483819962, output_fired_time: 7.5199527740, propagate_forward_time: 170.3380279541, propagate_backward_time: 247.5672149658, weight_update_time: 0.5492455363, other_time: 11.3561248779
epoch time: 38.2342224121s, input_fired_time: 1.0160429478, output_fired_time: 0.0000000000, propagate_forward_time: 35.0749015808, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1432762146
validation[          , genome 12590] predictions:    9846/  10000 (98.46%), best:    9856/10000 (98.56%), error:       494.55838, best error:       455.20514 on epoch:    83, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 190.3287811279s, input_fired_time: 6.6334595680, output_fired_time: 0.0000000000, propagate_forward_time: 175.6122283936, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.0830993652
best training[          , genome 12590] predictions:   49969/  50000 (99.94%), best:    9856/10000 (98.56%), error:       385.38943, best error:       455.20514 on epoch:    83, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 38.5351104736s, input_fired_time: 1.0088195801, output_fired_time: 0.0000000000, propagate_forward_time: 35.2572402954, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2690505981
   testing[          , genome 12590] predictions:    9869/  10000 (98.69%), best:    9856/10000 (98.56%), error:       370.23337, best error:       455.20514 on epoch:    83, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
23:48:11 (1700): called boinc_finish(0)

</stderr_txt>
]]>