Nameexact_genome_1512568488_44_5302_1
Workunit2597790
Created7 Dec 2017, 14:09:11 UTC
Sent7 Dec 2017, 14:17:22 UTC
Report deadline14 Dec 2017, 22:22:55 UTC
Received8 Dec 2017, 0:21:48 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID55108
Run time4 hours 0 min 36 sec
CPU time3 hours 55 min 46 sec
Validate stateValid
Credit1,834.30
Device peak FLOPS2.57 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size155.18 MB
Peak swap size158.52 MB
Peak disk usage1.69 MB

Stderr output

<core_client_version>7.8.2</core_client_version>
<![CDATA[
<stderr_txt>
54/  10000 (96.54%), best:    9661/10000 (96.61%), error:      1212.80847, best error:      1203.39697 on epoch:    13, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 138.9180145264s, input_fired_time: 1.6518657207, output_fired_time: 1.5076259375, propagate_forward_time: 52.9974632263, propagate_backward_time: 79.3438262939, weight_update_time: 0.1371606588, other_time: 3.4172210693
epoch time: 9.7873945236s, input_fired_time: 0.1952138543, output_fired_time: 0.0000000000, propagate_forward_time: 8.9969978333, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5951824188
validation[          , genome  5302] predictions:    9615/  10000 (96.15%), best:    9661/10000 (96.61%), error:      1244.66235, best error:      1203.39697 on epoch:    13, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 135.4129486084s, input_fired_time: 1.6234042645, output_fired_time: 1.4662443399, propagate_forward_time: 51.5169754028, propagate_backward_time: 76.4214553833, weight_update_time: 0.1374377757, other_time: 4.3848724365
epoch time: 10.1598873138s, input_fired_time: 0.1996151209, output_fired_time: 0.0000000000, propagate_forward_time: 9.3759613037, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5843105316
validation[          , genome  5302] predictions:    9663/  10000 (96.63%), best:    9663/10000 (96.63%), error:      1163.08289, best error:      1163.08289 on epoch:    16, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 145.2819976807s, input_fired_time: 1.7673184872, output_fired_time: 1.5618046522, propagate_forward_time: 54.6345787048, propagate_backward_time: 83.7022857666, weight_update_time: 0.1488919705, other_time: 3.6160125732
epoch time: 10.3012905121s, input_fired_time: 0.2021382302, output_fired_time: 0.0000000000, propagate_forward_time: 9.5032539368, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5958986282
validation[          , genome  5302] predictions:    9650/  10000 (96.50%), best:    9663/10000 (96.63%), error:      1210.85950, best error:      1163.08289 on epoch:    16, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 141.0732574463s, input_fired_time: 1.6875916719, output_fired_time: 1.5544573069, propagate_forward_time: 53.0850105286, propagate_backward_time: 81.2816390991, weight_update_time: 0.1379485875, other_time: 3.4645614624
epoch time: 11.9439125061s, input_fired_time: 0.2101627141, output_fired_time: 0.0000000000, propagate_forward_time: 10.0869293213, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6468200684
validation[          , genome  5302] predictions:    9448/  10000 (94.48%), best:    9663/10000 (96.63%), error:      1797.63306, best error:      1163.08289 on epoch:    16, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 137.4535522461s, input_fired_time: 1.6360164881, output_fired_time: 1.4808596373, propagate_forward_time: 48.5875358582, propagate_backward_time: 81.2816925049, weight_update_time: 0.1382793337, other_time: 4.4674377441
epoch time: 10.1985578537s, input_fired_time: 0.2042860985, output_fired_time: 0.0000000000, propagate_forward_time: 9.4016275406, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5926446915
validation[          , genome  5302] predictions:    9595/  10000 (95.95%), best:    9663/10000 (96.63%), error:      1351.81482, best error:      1163.08289 on epoch:    16, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 142.0625152588s, input_fired_time: 1.6872813702, output_fired_time: 1.5204323530, propagate_forward_time: 52.9805107117, propagate_backward_time: 82.4572982788, weight_update_time: 0.1541331708, other_time: 3.4169845581
epoch time: 10.1794900894s, input_fired_time: 0.2028732896, output_fired_time: 0.0000000000, propagate_forward_time: 9.3741302490, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6024866104
validation[          , genome  5302] predictions:    9509/  10000 (95.09%), best:    9663/10000 (96.63%), error:      1650.52856, best error:      1163.08289 on epoch:    16, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 136.2368621826s, input_fired_time: 1.6266701221, output_fired_time: 2.4897768497, propagate_forward_time: 50.0499038696, propagate_backward_time: 78.6992874146, weight_update_time: 0.1374162734, other_time: 3.3712310791
epoch time: 10.4436521530s, input_fired_time: 0.2009828985, output_fired_time: 0.0000000000, propagate_forward_time: 9.6597070694, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5829620361
validation[          , genome  5302] predictions:    9691/  10000 (96.91%), best:    9691/10000 (96.91%), error:      1080.31799, best error:      1080.31799 on epoch:    21, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 136.1428680420s, input_fired_time: 1.6277233362, output_fired_time: 1.4825733900, propagate_forward_time: 50.0496864319, propagate_backward_time: 79.6343307495, weight_update_time: 0.1376175135, other_time: 3.3485641479
epoch time: 11.4983043671s, input_fired_time: 0.2066977471, output_fired_time: 0.0000000000, propagate_forward_time: 10.6773195267, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6142873764
validation[          , genome  5302] predictions:    9629/  10000 (96.29%), best:    9691/10000 (96.91%), error:      1201.87817, best error:      1080.31799 on epoch:    21, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 134.9947967529s, input_fired_time: 1.6338295937, output_fired_time: 1.4645015001, propagate_forward_time: 50.5108222961, propagate_backward_time: 78.0241165161, weight_update_time: 0.1375710666, other_time: 3.3615188599
epoch time: 10.2936172485s, input_fired_time: 0.2029621601, output_fired_time: 0.0000000000, propagate_forward_time: 9.4896812439, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6009740829
validation[          , genome  5302] predictions:    9617/  10000 (96.17%), best:    9691/10000 (96.91%), error:      1269.51123, best error:      1080.31799 on epoch:    21, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 136.5348510742s, input_fired_time: 1.6357280016, output_fired_time: 1.4964834452, propagate_forward_time: 50.1378288269, propagate_backward_time: 79.8547821045, weight_update_time: 0.1378976405, other_time: 3.4100189209
epoch time: 10.2206945419s, input_fired_time: 0.2016509622, output_fired_time: 0.0000000000, propagate_forward_time: 9.4245738983, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5944700241
validation[          , genome  5302] predictions:    9715/  10000 (97.15%), best:    9715/10000 (97.15%), error:      1025.82568, best error:      1025.82568 on epoch:    24, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 135.7898254395s, input_fired_time: 1.6241979599, output_fired_time: 1.4661967754, propagate_forward_time: 50.7895660400, propagate_backward_time: 78.5620269775, weight_update_time: 0.1372370124, other_time: 3.3478393555
epoch time: 11.6451759338s, input_fired_time: 0.2093450427, output_fired_time: 0.0000000000, propagate_forward_time: 10.8196525574, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6161785126
validation[          , genome  5302] predictions:    9652/  10000 (96.52%), best:    9715/10000 (97.15%), error:      1219.49451, best error:      1025.82568 on epoch:    24, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 136.7520446777s, input_fired_time: 1.6327584982, output_fired_time: 1.4792294502, propagate_forward_time: 51.2478218079, propagate_backward_time: 77.9894866943, weight_update_time: 0.1389063597, other_time: 4.4027557373
epoch time: 11.0688915253s, input_fired_time: 0.2078525871, output_fired_time: 0.0000000000, propagate_forward_time: 10.2017889023, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6592502594
validation[          , genome  5302] predictions:    9640/  10000 (96.40%), best:    9715/10000 (97.15%), error:      1237.78247, best error:      1025.82568 on epoch:    24, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 137.1845550537s, input_fired_time: 1.6536753178, output_fired_time: 1.5089501143, propagate_forward_time: 51.7564392090, propagate_backward_time: 78.6403656006, weight_update_time: 0.1390616745, other_time: 3.6251220703
epoch time: 12.5471887589s, input_fired_time: 0.2082176954, output_fired_time: 0.0000000000, propagate_forward_time: 10.6945905685, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6443805695
validation[          , genome  5302] predictions:    9676/  10000 (96.76%), best:    9715/10000 (97.15%), error:      1036.20947, best error:      1025.82568 on epoch:    24, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 146.9070434570s, input_fired_time: 1.8130706549, output_fired_time: 1.5858548880, propagate_forward_time: 54.4883422852, propagate_backward_time: 85.3598327637, weight_update_time: 0.1378008723, other_time: 3.6599426270
epoch time: 11.4338445663s, input_fired_time: 0.2099710703, output_fired_time: 0.0000000000, propagate_forward_time: 10.6166591644, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6072139740
validation[          , genome  5302] predictions:    9602/  10000 (96.02%), best:    9715/10000 (97.15%), error:      1285.37622, best error:      1025.82568 on epoch:    24, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 136.1171112061s, input_fired_time: 1.6265165806, output_fired_time: 1.4674694538, propagate_forward_time: 49.8497734070, propagate_backward_time: 78.8880081177, weight_update_time: 0.1377886534, other_time: 4.2853469849
epoch time: 10.2195091248s, input_fired_time: 0.2009785920, output_fired_time: 0.0000000000, propagate_forward_time: 9.4245262146, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5940046310
validation[          , genome  5302] predictions:    9688/  10000 (96.88%), best:    9715/10000 (97.15%), error:      1079.66528, best error:      1025.82568 on epoch:    24, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 136.7306976318s, input_fired_time: 1.6327447891, output_fired_time: 1.4813418388, propagate_forward_time: 51.1661720276, propagate_backward_time: 79.0348739624, weight_update_time: 0.1412344575, other_time: 3.4155654907
epoch time: 10.4860906601s, input_fired_time: 0.2026054114, output_fired_time: 0.0000000000, propagate_forward_time: 9.7005739212, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5829114914
validation[          , genome  5302] predictions:    9674/  10000 (96.74%), best:    9715/10000 (97.15%), error:      1092.07410, best error:      1025.82568 on epoch:    24, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 142.1038970947s, input_fired_time: 1.6996133327, output_fired_time: 1.5198510885, propagate_forward_time: 54.0035057068, propagate_backward_time: 81.3791580200, weight_update_time: 0.1393607408, other_time: 3.5017623901
epoch time: 10.2941904068s, input_fired_time: 0.2034816742, output_fired_time: 0.0000000000, propagate_forward_time: 9.4824542999, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6082544327
validation[          , genome  5302] predictions:    9679/  10000 (96.79%), best:    9715/10000 (97.15%), error:      1113.89429, best error:      1025.82568 on epoch:    24, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 136.0534973145s, input_fired_time: 2.5442781448, output_fired_time: 1.4759662151, propagate_forward_time: 49.9645881653, propagate_backward_time: 78.7026214600, weight_update_time: 0.1373683959, other_time: 3.3660430908
epoch time: 10.2446441650s, input_fired_time: 0.2017003447, output_fired_time: 0.0000000000, propagate_forward_time: 9.4493103027, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5936336517
validation[          , genome  5302] predictions:    9693/  10000 (96.93%), best:    9715/10000 (97.15%), error:      1073.68884, best error:      1025.82568 on epoch:    24, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 135.7774963379s, input_fired_time: 1.6313892603, output_fired_time: 1.4696943760, propagate_forward_time: 49.8782958984, propagate_backward_time: 79.4215621948, weight_update_time: 0.1372916549, other_time: 3.3765487671
epoch time: 11.3300437927s, input_fired_time: 0.2057452947, output_fired_time: 0.0000000000, propagate_forward_time: 10.5119171143, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6123809814
validation[          , genome  5302] predictions:    9565/  10000 (95.65%), best:    9715/10000 (97.15%), error:      1385.71033, best error:      1025.82568 on epoch:    24, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 139.4174804688s, input_fired_time: 1.6829097271, output_fired_time: 1.5445084572, propagate_forward_time: 53.1760902405, propagate_backward_time: 79.5194625854, weight_update_time: 0.1377021521, other_time: 3.4945144653
epoch time: 10.4185447693s, input_fired_time: 0.2140077651, output_fired_time: 0.0000000000, propagate_forward_time: 9.6038846970, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6006526947
validation[          , genome  5302] predictions:    9653/  10000 (96.53%), best:    9715/10000 (97.15%), error:      1207.82092, best error:      1025.82568 on epoch:    24, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 136.5209655762s, input_fired_time: 1.6386984587, output_fired_time: 1.4735453129, propagate_forward_time: 49.0573501587, propagate_backward_time: 80.9487686157, weight_update_time: 0.1369647682, other_time: 3.4026031494
epoch time: 11.4237051010s, input_fired_time: 0.2059681565, output_fired_time: 0.0000000000, propagate_forward_time: 10.6167278290, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6010093689
validation[          , genome  5302] predictions:    9674/  10000 (96.74%), best:    9715/10000 (97.15%), error:      1114.91895, best error:      1025.82568 on epoch:    24, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 136.1463623047s, input_fired_time: 1.6413705349, output_fired_time: 1.4731372595, propagate_forward_time: 50.9627113342, propagate_backward_time: 77.7171020508, weight_update_time: 0.1370208263, other_time: 4.3520355225
epoch time: 10.4809865952s, input_fired_time: 0.2040598243, output_fired_time: 0.0000000000, propagate_forward_time: 9.6905679703, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5863590240
validation[          , genome  5302] predictions:    9693/  10000 (96.93%), best:    9715/10000 (97.15%), error:      1102.86743, best error:      1025.82568 on epoch:    24, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 136.1232147217s, input_fired_time: 1.6388602257, output_fired_time: 1.4719674587, propagate_forward_time: 51.0375671387, propagate_backward_time: 78.6071853638, weight_update_time: 0.1377856880, other_time: 3.3676376343
epoch time: 15.6858091354s, input_fired_time: 0.3210225403, output_fired_time: 0.0000000000, propagate_forward_time: 14.5559921265, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8087940216
validation[          , genome  5302] predictions:    9671/  10000 (96.71%), best:    9715/10000 (97.15%), error:      1165.22009, best error:      1025.82568 on epoch:    24, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 139.2644805908s, input_fired_time: 2.6788151264, output_fired_time: 1.5140841007, propagate_forward_time: 52.2014198303, propagate_backward_time: 79.4476928711, weight_update_time: 0.1378106475, other_time: 3.4224700928
epoch time: 10.2450103760s, input_fired_time: 0.2053425461, output_fired_time: 0.0000000000, propagate_forward_time: 9.4490346909, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5906333923
validation[          , genome  5302] predictions:    9694/  10000 (96.94%), best:    9715/10000 (97.15%), error:      1050.05933, best error:      1025.82568 on epoch:    24, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 135.7097320557s, input_fired_time: 1.6496779919, output_fired_time: 1.4766172171, propagate_forward_time: 50.3982467651, propagate_backward_time: 78.7761535645, weight_update_time: 0.1383453310, other_time: 3.4090347290
epoch time: 11.5611410141s, input_fired_time: 0.2094378918, output_fired_time: 0.0000000000, propagate_forward_time: 9.7340946198, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6176080704
validation[          , genome  5302] predictions:    9670/  10000 (96.70%), best:    9715/10000 (97.15%), error:      1142.43335, best error:      1025.82568 on epoch:    24, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 135.0044097900s, input_fired_time: 1.6361484528, output_fired_time: 1.4747182131, propagate_forward_time: 49.8013648987, propagate_backward_time: 78.6976013184, weight_update_time: 0.1428322196, other_time: 3.3945770264
epoch time: 11.6571922302s, input_fired_time: 0.2102261782, output_fired_time: 0.0000000000, propagate_forward_time: 10.8321352005, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6148309708
validation[          , genome  5302] predictions:    9676/  10000 (96.76%), best:    9715/10000 (97.15%), error:      1133.08203, best error:      1025.82568 on epoch:    24, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 137.6315460205s, input_fired_time: 1.6465449333, output_fired_time: 1.4904994965, propagate_forward_time: 50.5278091431, propagate_backward_time: 80.5993881226, weight_update_time: 0.1383311003, other_time: 3.3673095703
epoch time: 10.2140436172s, input_fired_time: 0.2025179714, output_fired_time: 0.0000000000, propagate_forward_time: 9.4259195328, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5856065750
validation[          , genome  5302] predictions:    9682/  10000 (96.82%), best:    9715/10000 (97.15%), error:      1079.28503, best error:      1025.82568 on epoch:    24, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 136.6884002686s, input_fired_time: 1.6994460821, output_fired_time: 1.4748749733, propagate_forward_time: 50.1764297485, propagate_backward_time: 79.9283294678, weight_update_time: 0.1378512681, other_time: 3.4093246460
epoch time: 11.6394214630s, input_fired_time: 0.2110569775, output_fired_time: 0.0000000000, propagate_forward_time: 10.8182497025, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6101150513
validation[          , genome  5302] predictions:    9710/  10000 (97.10%), best:    9710/10000 (97.10%), error:       978.31628, best error:       978.31628 on epoch:    42, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 136.6810913086s, input_fired_time: 1.6481213570, output_fired_time: 1.4843780994, propagate_forward_time: 50.0161590576, propagate_backward_time: 80.1295089722, weight_update_time: 0.1385545284, other_time: 3.4029312134
epoch time: 10.2824211121s, input_fired_time: 0.2065047622, output_fired_time: 0.0000000000, propagate_forward_time: 9.4825830460, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5933332443
validation[          , genome  5302] predictions:    9673/  10000 (96.73%), best:    9710/10000 (97.10%), error:      1115.27954, best error:       978.31628 on epoch:    42, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 142.1758422852s, input_fired_time: 1.6954623461, output_fired_time: 1.5224336386, propagate_forward_time: 52.3014755249, propagate_backward_time: 83.1210021973, weight_update_time: 0.1371685863, other_time: 3.5354690552
epoch time: 11.5084857941s, input_fired_time: 1.2191957235, output_fired_time: 0.0000000000, propagate_forward_time: 9.6781539917, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6111364365
validation[          , genome  5302] predictions:    9734/  10000 (97.34%), best:    9734/10000 (97.34%), error:       961.29657, best error:       961.29657 on epoch:    44, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 137.2264251709s, input_fired_time: 1.6514297724, output_fired_time: 1.4847489595, propagate_forward_time: 49.3833580017, propagate_backward_time: 81.3122558594, weight_update_time: 0.1471802592, other_time: 3.3946228027
epoch time: 10.3088922501s, input_fired_time: 0.2077377737, output_fired_time: 0.0000000000, propagate_forward_time: 9.5084342957, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5927200317
validation[          , genome  5302] predictions:    9682/  10000 (96.82%), best:    9734/10000 (97.34%), error:      1146.91907, best error:       961.29657 on epoch:    44, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 136.8664398193s, input_fired_time: 1.6578611135, output_fired_time: 1.4844610691, propagate_forward_time: 49.4841766357, propagate_backward_time: 80.8597946167, weight_update_time: 0.1382987797, other_time: 3.3801345825
epoch time: 11.5212135315s, input_fired_time: 0.2108311504, output_fired_time: 0.0000000000, propagate_forward_time: 10.6975936890, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6127891541
validation[          , genome  5302] predictions:    9704/  10000 (97.04%), best:    9734/10000 (97.34%), error:      1019.64386, best error:       961.29657 on epoch:    44, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 141.9707489014s, input_fired_time: 1.7190476656, output_fired_time: 1.5434361696, propagate_forward_time: 52.1267280579, propagate_backward_time: 82.0850067139, weight_update_time: 0.1374924928, other_time: 4.4965209961
epoch time: 10.4444646835s, input_fired_time: 0.2039971948, output_fired_time: 0.0000000000, propagate_forward_time: 9.6602554321, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5802116394
validation[          , genome  5302] predictions:    9713/  10000 (97.13%), best:    9734/10000 (97.34%), error:       977.95337, best error:       961.29657 on epoch:    44, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 138.2987060547s, input_fired_time: 1.6538801193, output_fired_time: 1.4978137016, propagate_forward_time: 49.8400878906, propagate_backward_time: 81.9128112793, weight_update_time: 0.1373665482, other_time: 3.3941040039
epoch time: 11.7788553238s, input_fired_time: 0.2133729309, output_fired_time: 0.0000000000, propagate_forward_time: 10.9552383423, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6102437973
validation[          , genome  5302] predictions:    9696/  10000 (96.96%), best:    9734/10000 (97.34%), error:      1048.84204, best error:       961.29657 on epoch:    44, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 136.4573059082s, input_fired_time: 1.6450647116, output_fired_time: 1.4782253504, propagate_forward_time: 49.0932540894, propagate_backward_time: 80.8462677002, weight_update_time: 0.1382143199, other_time: 3.3944931030
epoch time: 10.3494272232s, input_fired_time: 0.2053539008, output_fired_time: 0.0000000000, propagate_forward_time: 9.5497884750, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5942850113
validation[          , genome  5302] predictions:    9705/  10000 (97.05%), best:    9734/10000 (97.34%), error:      1055.84814, best error:       961.29657 on epoch:    44, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 136.3202209473s, input_fired_time: 1.6469910145, output_fired_time: 1.4798266888, propagate_forward_time: 51.0521583557, propagate_backward_time: 78.7793960571, weight_update_time: 0.1377393305, other_time: 3.3618545532
epoch time: 12.2604465485s, input_fired_time: 0.2106992304, output_fired_time: 0.0000000000, propagate_forward_time: 10.3762588501, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6734886169
validation[          , genome  5302] predictions:    9723/  10000 (97.23%), best:    9734/10000 (97.34%), error:      1012.96008, best error:       961.29657 on epoch:    44, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 140.4208374023s, input_fired_time: 1.7159590721, output_fired_time: 1.5308806896, propagate_forward_time: 53.4868049622, propagate_backward_time: 80.2358474731, weight_update_time: 0.1373502910, other_time: 3.4513473511
epoch time: 10.1691560745s, input_fired_time: 0.2041287273, output_fired_time: 0.0000000000, propagate_forward_time: 9.3600425720, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6049852371
validation[          , genome  5302] predictions:    9715/  10000 (97.15%), best:    9734/10000 (97.34%), error:      1030.73145, best error:       961.29657 on epoch:    44, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 137.0272827148s, input_fired_time: 1.6450821161, output_fired_time: 1.4794276953, propagate_forward_time: 50.3399620056, propagate_backward_time: 80.2062606812, weight_update_time: 0.1376444548, other_time: 3.3565444946
epoch time: 11.6463909149s, input_fired_time: 0.2109421343, output_fired_time: 0.0000000000, propagate_forward_time: 10.8162050247, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6192436218
validation[          , genome  5302] predictions:    9713/  10000 (97.13%), best:    9734/10000 (97.34%), error:      1016.12750, best error:       961.29657 on epoch:    44, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 143.8991394043s, input_fired_time: 1.7716240883, output_fired_time: 1.6100854874, propagate_forward_time: 53.7638435364, propagate_backward_time: 82.1982269287, weight_update_time: 0.1374875307, other_time: 4.5553588867
epoch time: 10.3422355652s, input_fired_time: 0.2068115771, output_fired_time: 0.0000000000, propagate_forward_time: 9.5368976593, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5985260010
validation[          , genome  5302] predictions:    9725/  10000 (97.25%), best:    9734/10000 (97.34%), error:       967.38477, best error:       961.29657 on epoch:    44, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 136.9368438721s, input_fired_time: 1.6593867540, output_fired_time: 1.4837315083, propagate_forward_time: 52.2848625183, propagate_backward_time: 78.0903472900, weight_update_time: 0.1384870559, other_time: 3.4185028076
epoch time: 12.1225728989s, input_fired_time: 0.2111097425, output_fired_time: 0.0000000000, propagate_forward_time: 11.3083553314, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6031074524
validation[          , genome  5302] predictions:    9611/  10000 (96.11%), best:    9734/10000 (97.34%), error:      1237.05188, best error:       961.29657 on epoch:    44, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 136.8538055420s, input_fired_time: 1.6414663792, output_fired_time: 1.5469764471, propagate_forward_time: 50.3058242798, propagate_backward_time: 80.0043029785, weight_update_time: 0.1376020163, other_time: 3.3552322388
epoch time: 10.3213720322s, input_fired_time: 0.2062838525, output_fired_time: 0.0000000000, propagate_forward_time: 9.5259332657, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5891551971
validation[          , genome  5302] predictions:    9688/  10000 (96.88%), best:    9734/10000 (97.34%), error:      1073.73450, best error:       961.29657 on epoch:    44, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 141.3244781494s, input_fired_time: 1.7105659246, output_fired_time: 1.5533902645, propagate_forward_time: 51.9282569885, propagate_backward_time: 81.7562713623, weight_update_time: 0.1529294550, other_time: 4.3759918213
epoch time: 11.7040777206s, input_fired_time: 0.2138591260, output_fired_time: 0.0000000000, propagate_forward_time: 10.8636398315, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6265783310
validation[          , genome  5302] predictions:    9668/  10000 (96.68%), best:    9734/10000 (97.34%), error:      1135.55713, best error:       961.29657 on epoch:    44, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 136.0859375000s, input_fired_time: 1.6487481594, output_fired_time: 2.5029978752, propagate_forward_time: 50.9568710327, propagate_backward_time: 76.5350494385, weight_update_time: 1.1475129128, other_time: 4.4422836304
epoch time: 10.1509876251s, input_fired_time: 0.2029709518, output_fired_time: 0.0000000000, propagate_forward_time: 9.3657541275, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5822629929
validation[          , genome  5302] predictions:    9677/  10000 (96.77%), best:    9734/10000 (97.34%), error:      1078.50146, best error:       961.29657 on epoch:    44, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 137.0791931152s, input_fired_time: 1.6407721043, output_fired_time: 1.5056811571, propagate_forward_time: 51.3194847107, propagate_backward_time: 79.2734756470, weight_update_time: 0.1376138031, other_time: 3.3397750854
epoch time: 11.5988273621s, input_fired_time: 0.2121917754, output_fired_time: 0.0000000000, propagate_forward_time: 10.7769498825, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6096858978
validation[          , genome  5302] predictions:    9726/  10000 (97.26%), best:    9734/10000 (97.34%), error:       992.87457, best error:       961.29657 on epoch:    44, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 138.5756988525s, input_fired_time: 1.7040121555, output_fired_time: 1.4886771441, propagate_forward_time: 50.8832969666, propagate_backward_time: 81.0381317139, weight_update_time: 0.1384195685, other_time: 3.4615783691
epoch time: 10.3038396835s, input_fired_time: 0.2073492110, output_fired_time: 0.0000000000, propagate_forward_time: 9.4999351501, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5965557098
validation[          , genome  5302] predictions:    9677/  10000 (96.77%), best:    9734/10000 (97.34%), error:      1096.35437, best error:       961.29657 on epoch:    44, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 136.8678894043s, input_fired_time: 2.6636879444, output_fired_time: 1.4879714251, propagate_forward_time: 49.2974319458, propagate_backward_time: 80.0248565674, weight_update_time: 0.1387176961, other_time: 3.3939437866
epoch time: 11.4744281769s, input_fired_time: 0.2114401013, output_fired_time: 0.0000000000, propagate_forward_time: 10.6488084793, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6141796112
validation[          , genome  5302] predictions:    9734/  10000 (97.34%), best:    9734/10000 (97.34%), error:       918.60724, best error:       918.60724 on epoch:    60, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 135.2475891113s, input_fired_time: 1.6484670639, output_fired_time: 1.4663873911, propagate_forward_time: 50.1104583740, propagate_backward_time: 78.6384429932, weight_update_time: 0.1377519220, other_time: 3.3838348389
epoch time: 11.4970283508s, input_fired_time: 0.2105414122, output_fired_time: 0.0000000000, propagate_forward_time: 10.6763429642, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6101436615
validation[          , genome  5302] predictions:    9591/  10000 (95.91%), best:    9734/10000 (97.34%), error:      1372.43323, best error:       918.60724 on epoch:    60, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 136.3537597656s, input_fired_time: 1.6620002985, output_fired_time: 1.4783879519, propagate_forward_time: 49.0184936523, propagate_backward_time: 80.8080215454, weight_update_time: 0.1381786466, other_time: 3.3868484497
epoch time: 10.2834777832s, input_fired_time: 0.2081096321, output_fired_time: 0.0000000000, propagate_forward_time: 9.4769573212, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5984106064
validation[          , genome  5302] predictions:    9699/  10000 (96.99%), best:    9734/10000 (97.34%), error:      1036.00549, best error:       918.60724 on epoch:    60, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 136.3190002441s, input_fired_time: 1.6467053890, output_fired_time: 2.4766676426, propagate_forward_time: 48.9713325500, propagate_backward_time: 79.8112335205, weight_update_time: 0.1375814378, other_time: 3.4130706787
epoch time: 11.4411163330s, input_fired_time: 0.2085973620, output_fired_time: 0.0000000000, propagate_forward_time: 10.6339340210, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5985851288
validation[          , genome  5302] predictions:    9693/  10000 (96.93%), best:    9734/10000 (97.34%), error:      1065.62842, best error:       918.60724 on epoch:    60, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 137.0254516602s, input_fired_time: 2.6771662235, output_fired_time: 1.4920663834, propagate_forward_time: 48.1769790649, propagate_backward_time: 79.2311401367, weight_update_time: 0.1382646561, other_time: 5.4480972290
epoch time: 10.2635974884s, input_fired_time: 0.2058767527, output_fired_time: 0.0000000000, propagate_forward_time: 9.4688272476, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5888938904
validation[          , genome  5302] predictions:    9719/  10000 (97.19%), best:    9734/10000 (97.34%), error:       931.35168, best error:       918.60724 on epoch:    60, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 136.7250213623s, input_fired_time: 1.6543751955, output_fired_time: 1.4907908440, propagate_forward_time: 52.2132873535, propagate_backward_time: 77.9911956787, weight_update_time: 0.1378130615, other_time: 3.3753814697
epoch time: 11.4220438004s, input_fired_time: 0.2103542089, output_fired_time: 0.0000000000, propagate_forward_time: 10.6053562164, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6063337326
validation[          , genome  5302] predictions:    9674/  10000 (96.74%), best:    9734/10000 (97.34%), error:      1067.18164, best error:       918.60724 on epoch:    60, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 134.4869232178s, input_fired_time: 1.6456372738, output_fired_time: 1.4733844995, propagate_forward_time: 50.6941261292, propagate_backward_time: 77.2399444580, weight_update_time: 0.1365258694, other_time: 3.4338378906
epoch time: 11.5808496475s, input_fired_time: 0.2116966397, output_fired_time: 0.0000000000, propagate_forward_time: 10.7564344406, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6127185822
validation[          , genome  5302] predictions:    9605/  10000 (96.05%), best:    9734/10000 (97.34%), error:      1355.44019, best error:       918.60724 on epoch:    60, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 137.2568511963s, input_fired_time: 1.6538501978, output_fired_time: 1.5017023087, propagate_forward_time: 50.4221611023, propagate_backward_time: 79.2643356323, weight_update_time: 0.1376904249, other_time: 4.4147872925
epoch time: 10.2789974213s, input_fired_time: 0.2058870494, output_fired_time: 0.0000000000, propagate_forward_time: 9.4816312790, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5914793015
validation[          , genome  5302] predictions:    9729/  10000 (97.29%), best:    9734/10000 (97.34%), error:       990.61438, best error:       918.60724 on epoch:    60, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 137.0868988037s, input_fired_time: 1.6724678278, output_fired_time: 2.3921751976, propagate_forward_time: 52.2825279236, propagate_backward_time: 77.3792724609, weight_update_time: 0.1382992864, other_time: 3.3604431152
epoch time: 11.6205148697s, input_fired_time: 0.2137242556, output_fired_time: 0.0000000000, propagate_forward_time: 10.7968816757, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6099090576
validation[          , genome  5302] predictions:    9734/  10000 (97.34%), best:    9734/10000 (97.34%), error:       957.88074, best error:       918.60724 on epoch:    60, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 135.9905395508s, input_fired_time: 1.6568857431, output_fired_time: 1.4806861877, propagate_forward_time: 52.3103332520, propagate_backward_time: 77.1621704102, weight_update_time: 0.1376269162, other_time: 3.3804626465
epoch time: 10.0419988632s, input_fired_time: 0.2052566111, output_fired_time: 0.0000000000, propagate_forward_time: 9.2392272949, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5975151062
validation[          , genome  5302] predictions:    9576/  10000 (95.76%), best:    9734/10000 (97.34%), error:      1383.66223, best error:       918.60724 on epoch:    60, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 135.9973602295s, input_fired_time: 1.6637169123, output_fired_time: 1.4765521288, propagate_forward_time: 49.3168067932, propagate_backward_time: 79.1630783081, weight_update_time: 0.1377450675, other_time: 4.3772201538
epoch time: 10.3346719742s, input_fired_time: 0.2070809603, output_fired_time: 0.0000000000, propagate_forward_time: 9.5345659256, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5930252075
validation[          , genome  5302] predictions:    9742/  10000 (97.42%), best:    9734/10000 (97.34%), error:       926.83911, best error:       918.60724 on epoch:    60, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 137.3365325928s, input_fired_time: 1.6701360941, output_fired_time: 1.5079667568, propagate_forward_time: 53.0064315796, propagate_backward_time: 77.7333221436, weight_update_time: 0.1465220451, other_time: 3.4186782837
epoch time: 14.3756551743s, input_fired_time: 0.2460222244, output_fired_time: 0.0000000000, propagate_forward_time: 13.3314857483, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7981472015
validation[          , genome  5302] predictions:    9724/  10000 (97.24%), best:    9734/10000 (97.34%), error:       962.48309, best error:       918.60724 on epoch:    60, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 139.5629119873s, input_fired_time: 1.6595010757, output_fired_time: 2.5458743572, propagate_forward_time: 51.1821060181, propagate_backward_time: 80.7776947021, weight_update_time: 0.1459701657, other_time: 3.3977432251
epoch time: 11.6666584015s, input_fired_time: 0.2341952771, output_fired_time: 0.0000000000, propagate_forward_time: 10.8098220825, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6226406097
validation[          , genome  5302] predictions:    9729/  10000 (97.29%), best:    9734/10000 (97.34%), error:       965.83948, best error:       918.60724 on epoch:    60, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 135.9169616699s, input_fired_time: 1.6480834484, output_fired_time: 1.4668349028, propagate_forward_time: 50.8656616211, propagate_backward_time: 78.5771942139, weight_update_time: 0.1375404298, other_time: 3.3591918945
epoch time: 10.5480146408s, input_fired_time: 0.2126432955, output_fired_time: 0.0000000000, propagate_forward_time: 9.7311172485, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6042537689
validation[          , genome  5302] predictions:    9717/  10000 (97.17%), best:    9734/10000 (97.34%), error:       983.51373, best error:       918.60724 on epoch:    60, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 139.5254669189s, input_fired_time: 1.6752240658, output_fired_time: 1.5228818655, propagate_forward_time: 52.9507446289, propagate_backward_time: 79.9344177246, weight_update_time: 0.1370877624, other_time: 3.4421997070
epoch time: 11.5873765945s, input_fired_time: 0.2129218578, output_fired_time: 0.0000000000, propagate_forward_time: 9.7568740845, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6175804138
validation[          , genome  5302] predictions:    9656/  10000 (96.56%), best:    9734/10000 (97.34%), error:      1139.92395, best error:       918.60724 on epoch:    60, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 138.8245239258s, input_fired_time: 1.6623806953, output_fired_time: 1.5255432129, propagate_forward_time: 53.8984489441, propagate_backward_time: 78.3817443848, weight_update_time: 0.1395112127, other_time: 3.3563995361
epoch time: 10.2005128860s, input_fired_time: 0.2058254182, output_fired_time: 0.0000000000, propagate_forward_time: 9.4112138748, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5834732056
validation[          , genome  5302] predictions:    9698/  10000 (96.98%), best:    9734/10000 (97.34%), error:      1044.18860, best error:       918.60724 on epoch:    60, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 135.8541259766s, input_fired_time: 1.6533752680, output_fired_time: 1.4742968082, propagate_forward_time: 52.7750549316, propagate_backward_time: 76.5847091675, weight_update_time: 0.1371841580, other_time: 3.3666763306
epoch time: 10.2991046906s, input_fired_time: 0.2097511888, output_fired_time: 0.0000000000, propagate_forward_time: 9.4898195267, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5995340347
validation[          , genome  5302] predictions:    9703/  10000 (97.03%), best:    9734/10000 (97.34%), error:       983.08081, best error:       918.60724 on epoch:    60, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 138.4131011963s, input_fired_time: 1.6947952509, output_fired_time: 1.5502197742, propagate_forward_time: 51.4339714050, propagate_backward_time: 80.3731918335, weight_update_time: 0.1377461255, other_time: 3.3609237671
epoch time: 11.5942754745s, input_fired_time: 0.2126134634, output_fired_time: 0.0000000000, propagate_forward_time: 10.7751007080, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6065616608
validation[          , genome  5302] predictions:    9704/  10000 (97.04%), best:    9734/10000 (97.34%), error:      1023.16754, best error:       918.60724 on epoch:    60, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 136.6276702881s, input_fired_time: 1.6664924622, output_fired_time: 1.4736931324, propagate_forward_time: 49.1693916321, propagate_backward_time: 80.9128875732, weight_update_time: 0.1376039386, other_time: 3.4052124023
epoch time: 10.1941013336s, input_fired_time: 0.2074654698, output_fired_time: 0.0000000000, propagate_forward_time: 9.3900899887, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5965461731
validation[          , genome  5302] predictions:    9737/  10000 (97.37%), best:    9734/10000 (97.34%), error:       921.20483, best error:       918.60724 on epoch:    60, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 144.0455474854s, input_fired_time: 1.7712789774, output_fired_time: 1.5059129000, propagate_forward_time: 53.4229011536, propagate_backward_time: 83.8066406250, weight_update_time: 0.1400239468, other_time: 3.5388031006
epoch time: 10.7589874268s, input_fired_time: 0.2066615820, output_fired_time: 0.0000000000, propagate_forward_time: 9.9676446915, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5846815109
validation[          , genome  5302] predictions:    9645/  10000 (96.45%), best:    9734/10000 (97.34%), error:      1154.22253, best error:       918.60724 on epoch:    60, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 136.4406738281s, input_fired_time: 1.6598408222, output_fired_time: 1.4804285765, propagate_forward_time: 53.0168952942, propagate_backward_time: 76.9027786255, weight_update_time: 0.1384942979, other_time: 3.3807449341
epoch time: 11.5307340622s, input_fired_time: 0.2116653770, output_fired_time: 0.0000000000, propagate_forward_time: 10.7190046310, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6000642776
validation[          , genome  5302] predictions:    9675/  10000 (96.75%), best:    9734/10000 (97.34%), error:      1090.79175, best error:       918.60724 on epoch:    60, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 134.5894165039s, input_fired_time: 1.6522606611, output_fired_time: 1.4754214287, propagate_forward_time: 49.7781143188, propagate_backward_time: 78.3084182739, weight_update_time: 0.1368547231, other_time: 3.3751983643
epoch time: 11.3781042099s, input_fired_time: 0.2136358619, output_fired_time: 0.0000000000, propagate_forward_time: 10.5491619110, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6153068542
validation[          , genome  5302] predictions:    9682/  10000 (96.82%), best:    9734/10000 (97.34%), error:      1070.86072, best error:       918.60724 on epoch:    60, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 137.6198883057s, input_fired_time: 1.6543173790, output_fired_time: 1.5101041794, propagate_forward_time: 50.7770118713, propagate_backward_time: 80.2865905762, weight_update_time: 0.1375667900, other_time: 3.3918762207
epoch time: 10.5715494156s, input_fired_time: 0.2066176236, output_fired_time: 0.0000000000, propagate_forward_time: 9.7502985001, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6146335602
validation[          , genome  5302] predictions:    9702/  10000 (97.02%), best:    9734/10000 (97.34%), error:       970.73499, best error:       918.60724 on epoch:    60, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 136.0079803467s, input_fired_time: 1.6695305109, output_fired_time: 1.4825828075, propagate_forward_time: 50.8190155029, propagate_backward_time: 78.6231155396, weight_update_time: 0.1369198561, other_time: 3.4137344360
epoch time: 11.4145603180s, input_fired_time: 0.2116532177, output_fired_time: 0.0000000000, propagate_forward_time: 10.5927410126, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6101665497
validation[          , genome  5302] predictions:    9674/  10000 (96.74%), best:    9734/10000 (97.34%), error:      1050.69287, best error:       918.60724 on epoch:    60, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 135.7929382324s, input_fired_time: 1.6585463285, output_fired_time: 1.4728727341, propagate_forward_time: 49.7353401184, propagate_backward_time: 79.4861755371, weight_update_time: 0.1383383572, other_time: 3.4400177002
epoch time: 10.2627229691s, input_fired_time: 0.2058440000, output_fired_time: 0.0000000000, propagate_forward_time: 9.4639396667, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5929393768
validation[          , genome  5302] predictions:    9734/  10000 (97.34%), best:    9734/10000 (97.34%), error:       957.49268, best error:       918.60724 on epoch:    60, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 136.4118957520s, input_fired_time: 1.6715785265, output_fired_time: 1.4829326868, propagate_forward_time: 50.1631736755, propagate_backward_time: 79.6928863525, weight_update_time: 0.1378810108, other_time: 3.4013214111
epoch time: 11.9100761414s, input_fired_time: 0.2117181718, output_fired_time: 0.0000000000, propagate_forward_time: 11.0691995621, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6291580200
validation[          , genome  5302] predictions:    9729/  10000 (97.29%), best:    9734/10000 (97.34%), error:       974.35712, best error:       918.60724 on epoch:    60, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 136.8382263184s, input_fired_time: 1.6729550362, output_fired_time: 1.4793777466, propagate_forward_time: 48.5535202026, propagate_backward_time: 81.6937103271, weight_update_time: 0.1507626474, other_time: 3.4386520386
epoch time: 11.5965614319s, input_fired_time: 0.2221352309, output_fired_time: 0.0000000000, propagate_forward_time: 9.7369585037, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6374673843
validation[          , genome  5302] predictions:    9141/  10000 (91.41%), best:    9734/10000 (97.34%), error:      3068.39697, best error:       918.60724 on epoch:    60, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

resetting weights to those on epoch: 60
epoch time: 135.5474243164s, input_fired_time: 1.6492928267, output_fired_time: 1.4693167210, propagate_forward_time: 50.8624954224, propagate_backward_time: 77.1831512451, weight_update_time: 0.1378283054, other_time: 4.3831710815
epoch time: 10.1460924149s, input_fired_time: 0.2060991079, output_fired_time: 0.0000000000, propagate_forward_time: 9.3492431641, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5907497406
validation[          , genome  5302] predictions:    9757/  10000 (97.57%), best:    9757/10000 (97.57%), error:       888.28870, best error:       888.28870 on epoch:    87, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 136.3505401611s, input_fired_time: 1.6493818760, output_fired_time: 1.4726185799, propagate_forward_time: 51.1552658081, propagate_backward_time: 78.7049255371, weight_update_time: 0.1380458027, other_time: 3.3683395386
epoch time: 12.0971174240s, input_fired_time: 0.2112260610, output_fired_time: 0.0000000000, propagate_forward_time: 11.2862529755, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5996379852
validation[          , genome  5302] predictions:    9753/  10000 (97.53%), best:    9753/10000 (97.53%), error:       883.25873, best error:       883.25873 on epoch:    88, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 139.7806243896s, input_fired_time: 1.6989216805, output_fired_time: 1.5716882944, propagate_forward_time: 49.4414253235, propagate_backward_time: 82.6141891479, weight_update_time: 0.1387597173, other_time: 4.4543991089
epoch time: 10.6310682297s, input_fired_time: 0.2043843418, output_fired_time: 0.0000000000, propagate_forward_time: 9.8430557251, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5836277008
validation[          , genome  5302] predictions:    9750/  10000 (97.50%), best:    9753/10000 (97.53%), error:       899.09204, best error:       883.25873 on epoch:    88, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 137.0255889893s, input_fired_time: 1.6640849113, output_fired_time: 1.4971112013, propagate_forward_time: 52.7430572510, propagate_backward_time: 77.7131652832, weight_update_time: 0.1377935261, other_time: 3.4081726074
epoch time: 11.6467542648s, input_fired_time: 0.2157196403, output_fired_time: 0.0000000000, propagate_forward_time: 9.8026552200, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6283798218
validation[          , genome  5302] predictions:    9748/  10000 (97.48%), best:    9753/10000 (97.53%), error:       902.47589, best error:       883.25873 on epoch:    88, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 136.1861267090s, input_fired_time: 1.6565743685, output_fired_time: 1.4739266634, propagate_forward_time: 48.1175346375, propagate_backward_time: 81.5582962036, weight_update_time: 0.1379356980, other_time: 3.3797988892
epoch time: 10.3593711853s, input_fired_time: 0.2083573639, output_fired_time: 0.0000000000, propagate_forward_time: 9.5611295700, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5898838043
validation[          , genome  5302] predictions:    9746/  10000 (97.46%), best:    9753/10000 (97.53%), error:       902.45947, best error:       883.25873 on epoch:    88, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 138.1105804443s, input_fired_time: 1.6577149630, output_fired_time: 2.5022964478, propagate_forward_time: 50.7746391296, propagate_backward_time: 78.7599639893, weight_update_time: 0.1377745569, other_time: 4.4159545898
epoch time: 14.0444002151s, input_fired_time: 0.2448421121, output_fired_time: 0.0000000000, propagate_forward_time: 13.0878524780, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7117052078
validation[          , genome  5302] predictions:    9738/  10000 (97.38%), best:    9753/10000 (97.53%), error:       931.64154, best error:       883.25873 on epoch:    88, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 137.4594421387s, input_fired_time: 1.6991645098, output_fired_time: 1.4820038080, propagate_forward_time: 50.5029754639, propagate_backward_time: 80.3850631714, weight_update_time: 0.1387029737, other_time: 3.3902359009
epoch time: 11.1216707230s, input_fired_time: 0.2709707320, output_fired_time: 0.0000000000, propagate_forward_time: 10.2021617889, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6485385895
validation[          , genome  5302] predictions:    9746/  10000 (97.46%), best:    9753/10000 (97.53%), error:       923.31915, best error:       883.25873 on epoch:    88, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 140.7480621338s, input_fired_time: 1.7215429544, output_fired_time: 1.5099546909, propagate_forward_time: 51.5777587891, propagate_backward_time: 82.4144515991, weight_update_time: 0.1546304226, other_time: 3.5243606567
epoch time: 11.5892553329s, input_fired_time: 0.2127860039, output_fired_time: 0.0000000000, propagate_forward_time: 10.7340145111, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6424551010
validation[          , genome  5302] predictions:    9749/  10000 (97.49%), best:    9753/10000 (97.53%), error:       913.89838, best error:       883.25873 on epoch:    88, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 136.6148834229s, input_fired_time: 1.6767262220, output_fired_time: 1.4696998596, propagate_forward_time: 51.3284378052, propagate_backward_time: 78.7454071045, weight_update_time: 0.1382650584, other_time: 3.3946151733
epoch time: 10.2133121490s, input_fired_time: 0.2087928057, output_fired_time: 0.0000000000, propagate_forward_time: 9.4074115753, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5971078873
validation[          , genome  5302] predictions:    9727/  10000 (97.27%), best:    9753/10000 (97.53%), error:       951.71185, best error:       883.25873 on epoch:    88, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 143.1870727539s, input_fired_time: 1.7395991087, output_fired_time: 1.5056868792, propagate_forward_time: 52.5658836365, propagate_backward_time: 83.7409973145, weight_update_time: 0.1384151131, other_time: 3.6349029541
epoch time: 11.2093620300s, input_fired_time: 0.2087664753, output_fired_time: 0.0000000000, propagate_forward_time: 10.3973588943, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6032361984
validation[          , genome  5302] predictions:    9740/  10000 (97.40%), best:    9753/10000 (97.53%), error:       909.54498, best error:       883.25873 on epoch:    88, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 137.1833648682s, input_fired_time: 1.6601889133, output_fired_time: 1.4882364273, propagate_forward_time: 50.5063743591, propagate_backward_time: 80.1473617554, weight_update_time: 0.1377754509, other_time: 3.3812026978
epoch time: 10.4017753601s, input_fired_time: 0.2100703120, output_fired_time: 0.0000000000, propagate_forward_time: 9.5935544968, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5981502533
validation[          , genome  5302] predictions:    9742/  10000 (97.42%), best:    9753/10000 (97.53%), error:       928.58179, best error:       883.25873 on epoch:    88, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 138.5203857422s, input_fired_time: 2.7161917686, output_fired_time: 1.5137158632, propagate_forward_time: 50.9125518799, propagate_backward_time: 80.0038909912, weight_update_time: 0.1379245073, other_time: 3.3740386963
epoch time: 16.7812061310s, input_fired_time: 0.2837971449, output_fired_time: 0.0000000000, propagate_forward_time: 15.5143918991, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9830179214
validation[          , genome  5302] predictions:    9753/  10000 (97.53%), best:    9753/10000 (97.53%), error:       925.00800, best error:       883.25873 on epoch:    88, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 152.0970153809s, input_fired_time: 1.8615261316, output_fired_time: 1.6318383217, propagate_forward_time: 55.7208366394, propagate_backward_time: 89.1420211792, weight_update_time: 0.1536368579, other_time: 3.7407913208
epoch time: 10.1514635086s, input_fired_time: 0.2058597058, output_fired_time: 0.0000000000, propagate_forward_time: 9.3561372757, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5894660950
validation[          , genome  5302] predictions:    9745/  10000 (97.45%), best:    9753/10000 (97.53%), error:       911.70789, best error:       883.25873 on epoch:    88, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 136.1269989014s, input_fired_time: 1.6741913557, output_fired_time: 1.4726469517, propagate_forward_time: 49.8683357239, propagate_backward_time: 79.7183990479, weight_update_time: 0.1374695599, other_time: 3.3934326172
epoch time: 11.3631553650s, input_fired_time: 0.2122669667, output_fired_time: 0.0000000000, propagate_forward_time: 10.5483207703, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6025676727
validation[          , genome  5302] predictions:    9733/  10000 (97.33%), best:    9753/10000 (97.53%), error:       931.23468, best error:       883.25873 on epoch:    88, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 54.0040893555s, input_fired_time: 1.0511807203, output_fired_time: 0.0000000000, propagate_forward_time: 49.7585601807, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.1943473816
best training[          , genome  5302] predictions:   49406/  50000 (98.81%), best:    9753/10000 (97.53%), error:      2402.43359, best error:       883.25873 on epoch:    88, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 11.5432262421s, input_fired_time: 0.2118657678, output_fired_time: 0.0000000000, propagate_forward_time: 10.7223024368, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6090583801
   testing[          , genome  5302] predictions:    9772/  10000 (97.72%), best:    9753/10000 (97.53%), error:       771.67358, best error:       883.25873 on epoch:    88, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
15:25:24 (11012): called boinc_finish(0)

</stderr_txt>
]]>