Nameexact_genome_1512568488_44_6640_0
Workunit2604488
Created7 Dec 2017, 21:02:42 UTC
Sent7 Dec 2017, 21:09:38 UTC
Report deadline18 Dec 2017, 17:47:24 UTC
Received8 Dec 2017, 14:41:57 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID55108
Run time5 hours 51 min 58 sec
CPU time5 hours 45 min 54 sec
Validate stateInitial
Credit0.00
Device peak FLOPS2.57 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size156.90 MB
Peak swap size160.16 MB
Peak disk usage2.12 MB

Stderr output

<core_client_version>7.8.2</core_client_version>
<![CDATA[
<stderr_txt>
53.69995 on epoch:    14, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 200.4558410645s, input_fired_time: 2.3523697853, output_fired_time: 2.1407217979, propagate_forward_time: 75.1261672974, propagate_backward_time: 115.7679901123, weight_update_time: 0.1802873015, other_time: 5.0685958862
epoch time: 18.8154144287s, input_fired_time: 0.4002086222, output_fired_time: 0.0000000000, propagate_forward_time: 17.5707206726, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8444843292
validation[          , genome  6640] predictions:    9685/  10000 (96.85%), best:    9742/10000 (97.42%), error:      1002.01129, best error:       853.69995 on epoch:    14, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 200.7904205322s, input_fired_time: 2.3407256603, output_fired_time: 2.1472594738, propagate_forward_time: 74.3512573242, propagate_backward_time: 117.8779754639, weight_update_time: 0.1803054363, other_time: 4.0731964111
epoch time: 16.1891422272s, input_fired_time: 0.2913928330, output_fired_time: 0.0000000000, propagate_forward_time: 15.1844100952, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7133388519
validation[          , genome  6640] predictions:    9699/  10000 (96.99%), best:    9742/10000 (97.42%), error:      1006.87122, best error:       853.69995 on epoch:    14, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 215.9718780518s, input_fired_time: 2.4598767757, output_fired_time: 2.2752921581, propagate_forward_time: 83.2418212891, propagate_backward_time: 123.7569656372, weight_update_time: 0.1885199249, other_time: 4.2379226685
epoch time: 15.0162076950s, input_fired_time: 0.2876660526, output_fired_time: 0.0000000000, propagate_forward_time: 14.0193500519, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7091913223
validation[          , genome  6640] predictions:    9746/  10000 (97.46%), best:    9746/10000 (97.46%), error:       847.40094, best error:       847.40094 on epoch:    17, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 207.6496582031s, input_fired_time: 2.4087409973, output_fired_time: 2.1950025558, propagate_forward_time: 77.0830764771, propagate_backward_time: 120.8019485474, weight_update_time: 0.1805516332, other_time: 5.1608886719
epoch time: 16.1074008942s, input_fired_time: 0.2928305864, output_fired_time: 0.0000000000, propagate_forward_time: 15.0988121033, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7157583237
validation[          , genome  6640] predictions:    9678/  10000 (96.78%), best:    9746/10000 (97.46%), error:      1007.06537, best error:       847.40094 on epoch:    17, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 198.6599273682s, input_fired_time: 2.3318157196, output_fired_time: 2.1102910042, propagate_forward_time: 74.3735885620, propagate_backward_time: 115.7951354980, weight_update_time: 0.1804575175, other_time: 4.0490951538
epoch time: 14.8686532974s, input_fired_time: 0.2864932120, output_fired_time: 0.0000000000, propagate_forward_time: 13.8554534912, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7267065048
validation[          , genome  6640] predictions:    9704/  10000 (97.04%), best:    9746/10000 (97.46%), error:      1068.39185, best error:       847.40094 on epoch:    17, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 200.8552246094s, input_fired_time: 2.3450098038, output_fired_time: 2.1367843151, propagate_forward_time: 74.0817184448, propagate_backward_time: 118.2288818359, weight_update_time: 0.1804237813, other_time: 4.0628280640
epoch time: 16.1138954163s, input_fired_time: 0.2945860326, output_fired_time: 0.0000000000, propagate_forward_time: 15.0900211334, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7292881012
validation[          , genome  6640] predictions:    9725/  10000 (97.25%), best:    9746/10000 (97.46%), error:       903.97046, best error:       847.40094 on epoch:    17, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 202.4971008301s, input_fired_time: 2.3938336372, output_fired_time: 2.1542496681, propagate_forward_time: 73.9265136719, propagate_backward_time: 119.9106369019, weight_update_time: 0.1803411990, other_time: 4.1118698120
epoch time: 16.1031036377s, input_fired_time: 0.2970358729, output_fired_time: 0.0000000000, propagate_forward_time: 14.0738554001, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7322120667
validation[          , genome  6640] predictions:    9662/  10000 (96.62%), best:    9746/10000 (97.46%), error:      1059.92749, best error:       847.40094 on epoch:    17, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 200.9381103516s, input_fired_time: 2.3434121609, output_fired_time: 2.1398761272, propagate_forward_time: 76.1967391968, propagate_backward_time: 116.1868972778, weight_update_time: 0.1805483103, other_time: 4.0711822510
epoch time: 19.1665306091s, input_fired_time: 0.3599389791, output_fired_time: 0.0000000000, propagate_forward_time: 17.9664173126, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8401737213
validation[          , genome  6640] predictions:    9762/  10000 (97.62%), best:    9762/10000 (97.62%), error:       796.78900, best error:       796.78900 on epoch:    22, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 199.7273712158s, input_fired_time: 2.3645148277, output_fired_time: 3.1330664158, propagate_forward_time: 75.8309173584, propagate_backward_time: 114.3218307495, weight_update_time: 0.1795269996, other_time: 4.0770339966
epoch time: 16.0783691406s, input_fired_time: 0.2949500382, output_fired_time: 0.0000000000, propagate_forward_time: 15.0609970093, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7224216461
validation[          , genome  6640] predictions:    9731/  10000 (97.31%), best:    9762/10000 (97.62%), error:       869.62488, best error:       796.78900 on epoch:    22, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 198.8907165527s, input_fired_time: 3.3548142910, output_fired_time: 2.1332306862, propagate_forward_time: 73.4197235107, propagate_backward_time: 115.8795700073, weight_update_time: 0.1806403250, other_time: 4.1033859253
epoch time: 16.3865547180s, input_fired_time: 1.3035356998, output_fired_time: 0.0000000000, propagate_forward_time: 14.3502502441, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7327690125
validation[          , genome  6640] predictions:    9725/  10000 (97.25%), best:    9762/10000 (97.62%), error:       905.19281, best error:       796.78900 on epoch:    22, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 200.3827056885s, input_fired_time: 2.3467187881, output_fired_time: 2.1334667206, propagate_forward_time: 72.1334304810, propagate_backward_time: 119.7021484375, weight_update_time: 0.1799926758, other_time: 4.0669326782
epoch time: 16.2045669556s, input_fired_time: 0.2961835265, output_fired_time: 0.0000000000, propagate_forward_time: 15.1718244553, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7365589142
validation[          , genome  6640] predictions:    9698/  10000 (96.98%), best:    9762/10000 (97.62%), error:       991.27618, best error:       796.78900 on epoch:    22, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 198.9796752930s, input_fired_time: 2.3396658897, output_fired_time: 2.1280148029, propagate_forward_time: 74.4380340576, propagate_backward_time: 116.0286102295, weight_update_time: 0.1794541031, other_time: 4.0453491211
epoch time: 15.3549699783s, input_fired_time: 0.2937445939, output_fired_time: 0.0000000000, propagate_forward_time: 14.3364744186, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7247505188
validation[          , genome  6640] predictions:    9755/  10000 (97.55%), best:    9762/10000 (97.62%), error:       884.47363, best error:       796.78900 on epoch:    22, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 209.4257659912s, input_fired_time: 2.4485588074, output_fired_time: 2.2407121658, propagate_forward_time: 79.5877990723, propagate_backward_time: 120.9536132813, weight_update_time: 0.1824830323, other_time: 4.1950836182
epoch time: 16.3524360657s, input_fired_time: 0.2978778481, output_fired_time: 0.0000000000, propagate_forward_time: 15.3306627274, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7238950729
validation[          , genome  6640] predictions:    9750/  10000 (97.50%), best:    9762/10000 (97.62%), error:       860.47467, best error:       796.78900 on epoch:    22, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 203.1587677002s, input_fired_time: 2.3755140305, output_fired_time: 2.1586818695, propagate_forward_time: 74.0903549194, propagate_backward_time: 120.4124984741, weight_update_time: 0.1796886921, other_time: 4.1217193604
epoch time: 16.5988445282s, input_fired_time: 0.2987214327, output_fired_time: 0.0000000000, propagate_forward_time: 15.5402994156, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7598237991
validation[          , genome  6640] predictions:    9675/  10000 (96.75%), best:    9762/10000 (97.62%), error:      1028.72241, best error:       796.78900 on epoch:    22, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 200.1319885254s, input_fired_time: 3.3471360207, output_fired_time: 2.1248893738, propagate_forward_time: 73.7242202759, propagate_backward_time: 116.8604660034, weight_update_time: 0.1812639534, other_time: 4.0752716064
epoch time: 14.8604049683s, input_fired_time: 0.2888384759, output_fired_time: 0.0000000000, propagate_forward_time: 13.8383655548, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7332010269
validation[          , genome  6640] predictions:    9631/  10000 (96.31%), best:    9762/10000 (97.62%), error:      1168.39050, best error:       796.78900 on epoch:    22, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 201.2582092285s, input_fired_time: 2.4332025051, output_fired_time: 2.1727664471, propagate_forward_time: 77.5188217163, propagate_backward_time: 115.0186996460, weight_update_time: 0.1802438349, other_time: 4.1147308350
epoch time: 16.8973655701s, input_fired_time: 0.3094898760, output_fired_time: 0.0000000000, propagate_forward_time: 15.7031545639, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8847208023
validation[          , genome  6640] predictions:    9741/  10000 (97.41%), best:    9762/10000 (97.62%), error:       862.92944, best error:       796.78900 on epoch:    22, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 207.4497375488s, input_fired_time: 2.3743157387, output_fired_time: 2.1917905807, propagate_forward_time: 79.4973907471, propagate_backward_time: 119.1039276123, weight_update_time: 0.2205293924, other_time: 4.2823181152
epoch time: 16.5740585327s, input_fired_time: 0.3020958602, output_fired_time: 0.0000000000, propagate_forward_time: 15.5151548386, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7568082809
validation[          , genome  6640] predictions:    9690/  10000 (96.90%), best:    9762/10000 (97.62%), error:      1054.77588, best error:       796.78900 on epoch:    22, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 203.9753265381s, input_fired_time: 2.5010766983, output_fired_time: 2.1597948074, propagate_forward_time: 74.3490982056, propagate_backward_time: 119.6655578613, weight_update_time: 0.1896764636, other_time: 5.2997970581
epoch time: 18.8899002075s, input_fired_time: 0.3773346841, output_fired_time: 0.0000000000, propagate_forward_time: 17.6848125458, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8277530670
validation[          , genome  6640] predictions:    9731/  10000 (97.31%), best:    9762/10000 (97.62%), error:       888.96405, best error:       796.78900 on epoch:    22, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 201.5315551758s, input_fired_time: 2.3628995419, output_fired_time: 2.2247920036, propagate_forward_time: 77.3066940308, propagate_backward_time: 115.5258712769, weight_update_time: 0.1804755330, other_time: 4.1112976074
epoch time: 16.6424522400s, input_fired_time: 0.3023240268, output_fired_time: 0.0000000000, propagate_forward_time: 15.6020383835, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7380895615
validation[          , genome  6640] predictions:    9728/  10000 (97.28%), best:    9762/10000 (97.62%), error:       899.80231, best error:       796.78900 on epoch:    22, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 204.5924224854s, input_fired_time: 2.5100295544, output_fired_time: 2.1757225990, propagate_forward_time: 76.5929794312, propagate_backward_time: 119.1349563599, weight_update_time: 0.1891974658, other_time: 4.1787414551
epoch time: 16.5051116943s, input_fired_time: 0.2972529531, output_fired_time: 0.0000000000, propagate_forward_time: 15.4766645432, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7311944962
validation[          , genome  6640] predictions:    9754/  10000 (97.54%), best:    9762/10000 (97.62%), error:       839.96716, best error:       796.78900 on epoch:    22, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 215.0564117432s, input_fired_time: 3.5248987675, output_fired_time: 2.3192403316, propagate_forward_time: 79.5904083252, propagate_backward_time: 125.2704696655, weight_update_time: 0.1814622432, other_time: 4.3513870239
epoch time: 20.9961872101s, input_fired_time: 0.3865748644, output_fired_time: 0.0000000000, propagate_forward_time: 19.6637172699, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9458942413
validation[          , genome  6640] predictions:    9741/  10000 (97.41%), best:    9762/10000 (97.62%), error:       881.75629, best error:       796.78900 on epoch:    22, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 201.7613525391s, input_fired_time: 2.4222004414, output_fired_time: 2.2268958092, propagate_forward_time: 75.4498138428, propagate_backward_time: 117.5392761230, weight_update_time: 0.1818536371, other_time: 4.1231689453
epoch time: 16.6855926514s, input_fired_time: 0.2953675389, output_fired_time: 0.0000000000, propagate_forward_time: 15.6421709061, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7480535507
validation[          , genome  6640] predictions:    9776/  10000 (97.76%), best:    9776/10000 (97.76%), error:       760.21210, best error:       760.21210 on epoch:    36, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 202.4204406738s, input_fired_time: 2.3599002361, output_fired_time: 2.1513562202, propagate_forward_time: 76.8827362061, propagate_backward_time: 116.9340133667, weight_update_time: 0.1813420057, other_time: 4.0924453735
epoch time: 16.3350334167s, input_fired_time: 0.2980132699, output_fired_time: 0.0000000000, propagate_forward_time: 15.3000087738, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7370109558
validation[          , genome  6640] predictions:    9758/  10000 (97.58%), best:    9776/10000 (97.76%), error:       815.73175, best error:       760.21210 on epoch:    36, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 201.0221405029s, input_fired_time: 2.3568780422, output_fired_time: 2.1309823990, propagate_forward_time: 75.2371520996, propagate_backward_time: 116.1935195923, weight_update_time: 0.1805161685, other_time: 5.1036148071
epoch time: 14.9293699265s, input_fired_time: 0.2904834151, output_fired_time: 0.0000000000, propagate_forward_time: 13.9284429550, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7104434967
validation[          , genome  6640] predictions:    9714/  10000 (97.14%), best:    9776/10000 (97.76%), error:       941.06433, best error:       760.21210 on epoch:    36, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 204.0524902344s, input_fired_time: 2.3482561111, output_fired_time: 2.1334199905, propagate_forward_time: 74.7248001099, propagate_backward_time: 120.7575302124, weight_update_time: 0.1803938597, other_time: 4.0884857178
epoch time: 15.4321565628s, input_fired_time: 0.2961229384, output_fired_time: 0.0000000000, propagate_forward_time: 14.3935165405, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7425174713
validation[          , genome  6640] predictions:    9751/  10000 (97.51%), best:    9776/10000 (97.76%), error:       824.51373, best error:       760.21210 on epoch:    36, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 206.5121154785s, input_fired_time: 2.4094781876, output_fired_time: 3.1687142849, propagate_forward_time: 75.9765853882, propagate_backward_time: 120.8763504028, weight_update_time: 0.1807243079, other_time: 4.0809783936
epoch time: 18.4906120300s, input_fired_time: 0.3167997003, output_fired_time: 0.0000000000, propagate_forward_time: 17.3367080688, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8371047974
validation[          , genome  6640] predictions:    9744/  10000 (97.44%), best:    9776/10000 (97.76%), error:       844.51361, best error:       760.21210 on epoch:    36, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 200.8056182861s, input_fired_time: 2.3632018566, output_fired_time: 2.1334440708, propagate_forward_time: 74.1308441162, propagate_backward_time: 118.1254425049, weight_update_time: 0.1858510673, other_time: 4.0526885986
epoch time: 18.6140632629s, input_fired_time: 0.3600200117, output_fired_time: 0.0000000000, propagate_forward_time: 17.4252014160, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8288421631
validation[          , genome  6640] predictions:    9686/  10000 (96.86%), best:    9776/10000 (97.76%), error:      1036.80469, best error:       760.21210 on epoch:    36, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 201.4679565430s, input_fired_time: 2.3534018993, output_fired_time: 3.1587426662, propagate_forward_time: 72.5677795410, propagate_backward_time: 119.3395767212, weight_update_time: 0.1811102629, other_time: 4.0484542847
epoch time: 16.0229644775s, input_fired_time: 0.2974459529, output_fired_time: 0.0000000000, propagate_forward_time: 14.9987316132, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7267866135
validation[          , genome  6640] predictions:    9779/  10000 (97.79%), best:    9776/10000 (97.76%), error:       772.05243, best error:       760.21210 on epoch:    36, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 200.0116424561s, input_fired_time: 2.3835887909, output_fired_time: 3.1418666840, propagate_forward_time: 74.8286895752, propagate_backward_time: 115.5716171265, weight_update_time: 0.1800771952, other_time: 4.0858840942
epoch time: 14.6978368759s, input_fired_time: 0.2903152704, output_fired_time: 0.0000000000, propagate_forward_time: 13.6964807510, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7110404968
validation[          , genome  6640] predictions:    9765/  10000 (97.65%), best:    9776/10000 (97.76%), error:       782.27716, best error:       760.21210 on epoch:    36, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 198.3032836914s, input_fired_time: 2.3409759998, output_fired_time: 2.1327025890, propagate_forward_time: 73.5449066162, propagate_backward_time: 116.2538833618, weight_update_time: 0.1803083569, other_time: 4.0308151245
epoch time: 16.0532398224s, input_fired_time: 0.3052304387, output_fired_time: 0.0000000000, propagate_forward_time: 14.9765958786, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7714138031
validation[          , genome  6640] predictions:    9720/  10000 (97.20%), best:    9776/10000 (97.76%), error:       907.21460, best error:       760.21210 on epoch:    36, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 199.4421234131s, input_fired_time: 2.3686835766, output_fired_time: 3.1472201347, propagate_forward_time: 72.5519561768, propagate_backward_time: 116.2899017334, weight_update_time: 0.1810620278, other_time: 5.0843658447
epoch time: 16.3674449921s, input_fired_time: 0.3007001281, output_fired_time: 0.0000000000, propagate_forward_time: 15.3390703201, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7276754379
validation[          , genome  6640] predictions:    9748/  10000 (97.48%), best:    9776/10000 (97.76%), error:       811.61597, best error:       760.21210 on epoch:    36, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 206.5291748047s, input_fired_time: 2.4530446529, output_fired_time: 2.2375864983, propagate_forward_time: 78.2685775757, propagate_backward_time: 119.4278030396, weight_update_time: 0.1803079695, other_time: 4.1421661377
epoch time: 16.6930637360s, input_fired_time: 0.3085178137, output_fired_time: 0.0000000000, propagate_forward_time: 15.6256723404, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7588739395
validation[          , genome  6640] predictions:    9721/  10000 (97.21%), best:    9776/10000 (97.76%), error:      1005.34418, best error:       760.21210 on epoch:    36, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 200.1407775879s, input_fired_time: 2.3610081673, output_fired_time: 2.1439385414, propagate_forward_time: 75.9033584595, propagate_backward_time: 115.6934432983, weight_update_time: 0.1796828508, other_time: 4.0390319824
epoch time: 16.2277240753s, input_fired_time: 0.2958717942, output_fired_time: 0.0000000000, propagate_forward_time: 15.2058897018, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7259626389
validation[          , genome  6640] predictions:    9778/  10000 (97.78%), best:    9776/10000 (97.76%), error:       766.91333, best error:       760.21210 on epoch:    36, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 201.5759887695s, input_fired_time: 2.3473217487, output_fired_time: 2.1532540321, propagate_forward_time: 75.3290710449, propagate_backward_time: 117.7025299072, weight_update_time: 0.1815721542, other_time: 4.0438079834
epoch time: 16.0214633942s, input_fired_time: 0.2934859991, output_fired_time: 0.0000000000, propagate_forward_time: 15.0130615234, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7149162292
validation[          , genome  6640] predictions:    9740/  10000 (97.40%), best:    9776/10000 (97.76%), error:       861.92053, best error:       760.21210 on epoch:    36, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 199.8946075439s, input_fired_time: 2.3653771877, output_fired_time: 2.1261343956, propagate_forward_time: 73.8121414185, propagate_backward_time: 117.5044555664, weight_update_time: 0.1809817553, other_time: 4.0865097046
epoch time: 16.2173748016s, input_fired_time: 0.2990400791, output_fired_time: 0.0000000000, propagate_forward_time: 15.1923198700, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7260150909
validation[          , genome  6640] predictions:    9727/  10000 (97.27%), best:    9776/10000 (97.76%), error:       877.99414, best error:       760.21210 on epoch:    36, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 201.8058929443s, input_fired_time: 2.3806865215, output_fired_time: 2.1505510807, propagate_forward_time: 76.5851135254, propagate_backward_time: 116.5441284180, weight_update_time: 0.1832478940, other_time: 4.1454010010
epoch time: 16.0676479340s, input_fired_time: 0.2959591746, output_fired_time: 0.0000000000, propagate_forward_time: 15.0354270935, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7362613678
validation[          , genome  6640] predictions:    9773/  10000 (97.73%), best:    9776/10000 (97.76%), error:       815.40564, best error:       760.21210 on epoch:    36, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 204.1101379395s, input_fired_time: 2.4242773056, output_fired_time: 3.2480568886, propagate_forward_time: 78.8189010620, propagate_backward_time: 115.5307922363, weight_update_time: 0.1829371452, other_time: 4.0881118774
epoch time: 16.2648811340s, input_fired_time: 0.2998287380, output_fired_time: 0.0000000000, propagate_forward_time: 15.2241134644, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7409391403
validation[          , genome  6640] predictions:    9775/  10000 (97.75%), best:    9776/10000 (97.76%), error:       780.55835, best error:       760.21210 on epoch:    36, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 199.6463165283s, input_fired_time: 2.3452594280, output_fired_time: 2.1137845516, propagate_forward_time: 73.5377120972, propagate_backward_time: 117.5909729004, weight_update_time: 0.1797664464, other_time: 4.0585861206
epoch time: 14.9453907013s, input_fired_time: 0.2954251468, output_fired_time: 0.0000000000, propagate_forward_time: 13.9317722321, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7181930542
validation[          , genome  6640] predictions:    9772/  10000 (97.72%), best:    9776/10000 (97.76%), error:       761.60284, best error:       760.21210 on epoch:    36, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 199.3956909180s, input_fired_time: 2.3584079742, output_fired_time: 2.1333596706, propagate_forward_time: 71.5650329590, propagate_backward_time: 119.2645187378, weight_update_time: 0.1805957407, other_time: 4.0743637085
epoch time: 15.8576526642s, input_fired_time: 0.2949808836, output_fired_time: 0.0000000000, propagate_forward_time: 14.8372821808, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7253894806
validation[          , genome  6640] predictions:    9749/  10000 (97.49%), best:    9776/10000 (97.76%), error:       846.73285, best error:       760.21210 on epoch:    36, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 199.1609039307s, input_fired_time: 2.3522911072, output_fired_time: 2.1323075294, propagate_forward_time: 74.4283447266, propagate_backward_time: 116.1047286987, weight_update_time: 0.1802057922, other_time: 4.1432266235
epoch time: 16.1911411285s, input_fired_time: 0.2965667546, output_fired_time: 0.0000000000, propagate_forward_time: 15.1623477936, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7322263718
validation[          , genome  6640] predictions:    9667/  10000 (96.67%), best:    9776/10000 (97.76%), error:      1072.58203, best error:       760.21210 on epoch:    36, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 197.4409790039s, input_fired_time: 2.3500635624, output_fired_time: 2.1407642365, propagate_forward_time: 72.6692657471, propagate_backward_time: 116.2149658203, weight_update_time: 0.1805067509, other_time: 4.0659179688
epoch time: 16.4993705750s, input_fired_time: 0.3649408519, output_fired_time: 0.0000000000, propagate_forward_time: 15.3015680313, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8328619003
validation[          , genome  6640] predictions:    9763/  10000 (97.63%), best:    9776/10000 (97.76%), error:       796.98785, best error:       760.21210 on epoch:    36, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 201.4351654053s, input_fired_time: 2.3609995842, output_fired_time: 2.1472268105, propagate_forward_time: 74.3524703979, propagate_backward_time: 118.5139541626, weight_update_time: 0.1795044392, other_time: 4.0605163574
epoch time: 16.1126842499s, input_fired_time: 0.2987189293, output_fired_time: 0.0000000000, propagate_forward_time: 15.0799913406, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7339735031
validation[          , genome  6640] predictions:    9778/  10000 (97.78%), best:    9776/10000 (97.76%), error:       779.00635, best error:       760.21210 on epoch:    36, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 204.2053833008s, input_fired_time: 2.4758715630, output_fired_time: 2.1686091423, propagate_forward_time: 75.7787246704, propagate_backward_time: 118.6249923706, weight_update_time: 0.1892574281, other_time: 5.1571807861
epoch time: 16.9191856384s, input_fired_time: 0.2990805805, output_fired_time: 0.0000000000, propagate_forward_time: 15.9044370651, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7156686783
validation[          , genome  6640] predictions:    9784/  10000 (97.84%), best:    9784/10000 (97.84%), error:       714.33478, best error:       714.33478 on epoch:    57, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 203.8609466553s, input_fired_time: 2.4394514561, output_fired_time: 2.1510612965, propagate_forward_time: 73.5085906982, propagate_backward_time: 121.6078872681, weight_update_time: 0.1897721589, other_time: 4.1539535522
epoch time: 16.6958599091s, input_fired_time: 0.3080706894, output_fired_time: 0.0000000000, propagate_forward_time: 15.6486215591, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7391672134
validation[          , genome  6640] predictions:    9774/  10000 (97.74%), best:    9784/10000 (97.84%), error:       729.55963, best error:       714.33478 on epoch:    57, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 199.0676269531s, input_fired_time: 2.3645536900, output_fired_time: 2.1311225891, propagate_forward_time: 73.3262557983, propagate_backward_time: 117.1257934570, weight_update_time: 0.1809774339, other_time: 4.1199111938
epoch time: 14.9143161774s, input_fired_time: 0.2922079563, output_fired_time: 0.0000000000, propagate_forward_time: 13.9096145630, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7124938965
validation[          , genome  6640] predictions:    9762/  10000 (97.62%), best:    9784/10000 (97.84%), error:       804.06372, best error:       714.33478 on epoch:    57, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 208.4307861328s, input_fired_time: 2.4467566013, output_fired_time: 2.2149014473, propagate_forward_time: 76.8231506348, propagate_backward_time: 122.7645874023, weight_update_time: 0.1999242008, other_time: 4.1813812256
epoch time: 17.2063026428s, input_fired_time: 0.3084186316, output_fired_time: 0.0000000000, propagate_forward_time: 16.1667213440, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7311630249
validation[          , genome  6640] predictions:    9777/  10000 (97.77%), best:    9784/10000 (97.84%), error:       782.11475, best error:       714.33478 on epoch:    57, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 202.2850189209s, input_fired_time: 2.3613853455, output_fired_time: 3.1447994709, propagate_forward_time: 77.8477401733, propagate_backward_time: 114.8283157349, weight_update_time: 0.1794971824, other_time: 4.1027679443
epoch time: 16.0912570953s, input_fired_time: 0.2990375757, output_fired_time: 0.0000000000, propagate_forward_time: 15.0612583160, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7309608459
validation[          , genome  6640] predictions:    9742/  10000 (97.42%), best:    9784/10000 (97.84%), error:       845.40948, best error:       714.33478 on epoch:    57, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 207.3509216309s, input_fired_time: 3.4983186722, output_fired_time: 2.2245895863, propagate_forward_time: 77.5543365479, propagate_backward_time: 119.8340530396, weight_update_time: 0.1937113106, other_time: 4.2396163940
epoch time: 16.1797847748s, input_fired_time: 0.2981974483, output_fired_time: 0.0000000000, propagate_forward_time: 15.1648502350, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7167367935
validation[          , genome  6640] predictions:    9659/  10000 (96.59%), best:    9784/10000 (97.84%), error:      1095.54749, best error:       714.33478 on epoch:    57, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 199.2541198730s, input_fired_time: 3.2628560066, output_fired_time: 2.1240959167, propagate_forward_time: 76.4568023682, propagate_backward_time: 113.3757705688, weight_update_time: 0.1788841933, other_time: 4.0345840454
epoch time: 16.2127914429s, input_fired_time: 0.3028703928, output_fired_time: 0.0000000000, propagate_forward_time: 15.1838502884, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7260704041
validation[          , genome  6640] predictions:    9759/  10000 (97.59%), best:    9784/10000 (97.84%), error:       791.05762, best error:       714.33478 on epoch:    57, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 203.6373443604s, input_fired_time: 2.4338791370, output_fired_time: 2.1890485287, propagate_forward_time: 76.2740325928, propagate_backward_time: 117.6581726074, weight_update_time: 0.1800763011, other_time: 5.0822143555
epoch time: 21.7807998657s, input_fired_time: 0.4030176699, output_fired_time: 0.0000000000, propagate_forward_time: 20.3679904938, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0097923279
validation[          , genome  6640] predictions:    9785/  10000 (97.85%), best:    9784/10000 (97.84%), error:       737.77118, best error:       714.33478 on epoch:    57, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 205.6354980469s, input_fired_time: 2.4696595669, output_fired_time: 3.2152481079, propagate_forward_time: 76.4319534302, propagate_backward_time: 118.2559280396, weight_update_time: 0.1806358099, other_time: 5.2627105713
epoch time: 16.1425819397s, input_fired_time: 0.2989227176, output_fired_time: 0.0000000000, propagate_forward_time: 15.1108398438, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7328195572
validation[          , genome  6640] predictions:    9749/  10000 (97.49%), best:    9784/10000 (97.84%), error:       830.92499, best error:       714.33478 on epoch:    57, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 198.8589477539s, input_fired_time: 2.8763585091, output_fired_time: 2.1199278831, propagate_forward_time: 71.7240295410, propagate_backward_time: 118.0534286499, weight_update_time: 0.1812662482, other_time: 4.0851974487
epoch time: 15.7055101395s, input_fired_time: 0.2962026596, output_fired_time: 0.0000000000, propagate_forward_time: 14.6908588409, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7184486389
validation[          , genome  6640] predictions:    9742/  10000 (97.42%), best:    9784/10000 (97.84%), error:       857.17584, best error:       714.33478 on epoch:    57, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 203.7941894531s, input_fired_time: 2.4354865551, output_fired_time: 2.1685919762, propagate_forward_time: 77.7765960693, propagate_backward_time: 117.2821807861, weight_update_time: 0.1820623875, other_time: 4.1313323975
epoch time: 18.5925407410s, input_fired_time: 0.4258677363, output_fired_time: 0.0000000000, propagate_forward_time: 17.3883323669, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7783412933
validation[          , genome  6640] predictions:    9739/  10000 (97.39%), best:    9784/10000 (97.84%), error:       855.49274, best error:       714.33478 on epoch:    57, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 210.9481658936s, input_fired_time: 3.5918381214, output_fired_time: 2.2373349667, propagate_forward_time: 79.7225341797, propagate_backward_time: 121.1482315063, weight_update_time: 0.1860229075, other_time: 4.2482223511
epoch time: 15.3667545319s, input_fired_time: 0.2966346145, output_fired_time: 0.0000000000, propagate_forward_time: 14.3687171936, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7014026642
validation[          , genome  6640] predictions:    9729/  10000 (97.29%), best:    9784/10000 (97.84%), error:       933.63647, best error:       714.33478 on epoch:    57, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 207.2152557373s, input_fired_time: 2.4571645260, output_fired_time: 2.2407462597, propagate_forward_time: 77.1340026855, propagate_backward_time: 120.2730789185, weight_update_time: 0.1881040186, other_time: 5.1102523804
epoch time: 16.2259674072s, input_fired_time: 0.3027951419, output_fired_time: 0.0000000000, propagate_forward_time: 15.1943063736, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7288656235
validation[          , genome  6640] predictions:    9735/  10000 (97.35%), best:    9784/10000 (97.84%), error:       912.34961, best error:       714.33478 on epoch:    57, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 202.6042480469s, input_fired_time: 2.4058520794, output_fired_time: 2.1591117382, propagate_forward_time: 75.9224166870, propagate_backward_time: 118.0126495361, weight_update_time: 0.1807281375, other_time: 4.1042098999
epoch time: 15.3861875534s, input_fired_time: 0.3098743558, output_fired_time: 0.0000000000, propagate_forward_time: 14.3300943375, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7462186813
validation[          , genome  6640] predictions:    9795/  10000 (97.95%), best:    9795/10000 (97.95%), error:       698.21106, best error:       698.21106 on epoch:    70, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 202.2999267578s, input_fired_time: 2.4198932648, output_fired_time: 2.2791559696, propagate_forward_time: 72.8695297241, propagate_backward_time: 120.4934921265, weight_update_time: 0.1814856529, other_time: 4.2378540039
epoch time: 14.9514465332s, input_fired_time: 0.2957174182, output_fired_time: 0.0000000000, propagate_forward_time: 13.9355545044, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7201747894
validation[          , genome  6640] predictions:    9777/  10000 (97.77%), best:    9795/10000 (97.95%), error:       746.25964, best error:       698.21106 on epoch:    70, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 209.1912078857s, input_fired_time: 2.5062868595, output_fired_time: 2.2509186268, propagate_forward_time: 77.7518234253, propagate_backward_time: 122.1870574951, weight_update_time: 0.1818767190, other_time: 4.4951248169
epoch time: 16.5734539032s, input_fired_time: 0.3047019243, output_fired_time: 0.0000000000, propagate_forward_time: 14.5375213623, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7312297821
validation[          , genome  6640] predictions:    9682/  10000 (96.82%), best:    9795/10000 (97.95%), error:      1031.99512, best error:       698.21106 on epoch:    70, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 201.1481018066s, input_fired_time: 2.3752632141, output_fired_time: 2.1435937881, propagate_forward_time: 77.3818130493, propagate_backward_time: 115.1506195068, weight_update_time: 0.1802581102, other_time: 4.0968093872
epoch time: 16.8793468475s, input_fired_time: 0.3068757057, output_fired_time: 0.0000000000, propagate_forward_time: 15.8103313446, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7621402740
validation[          , genome  6640] predictions:    9780/  10000 (97.80%), best:    9795/10000 (97.95%), error:       757.98615, best error:       698.21106 on epoch:    70, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 200.7152099609s, input_fired_time: 2.3814592361, output_fired_time: 2.1418952942, propagate_forward_time: 77.9595794678, propagate_backward_time: 114.0246582031, weight_update_time: 0.1817222536, other_time: 4.2076263428
epoch time: 14.8003005981s, input_fired_time: 0.2964552939, output_fired_time: 0.0000000000, propagate_forward_time: 13.7655057907, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7383394241
validation[          , genome  6640] predictions:    9783/  10000 (97.83%), best:    9795/10000 (97.95%), error:       781.60431, best error:       698.21106 on epoch:    70, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 202.2227020264s, input_fired_time: 2.3880519867, output_fired_time: 2.1375896931, propagate_forward_time: 76.3961029053, propagate_backward_time: 117.0560455322, weight_update_time: 0.1818976402, other_time: 4.2449188232
epoch time: 15.2040348053s, input_fired_time: 0.2967171669, output_fired_time: 0.0000000000, propagate_forward_time: 14.1373596191, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7699584961
validation[          , genome  6640] predictions:    9791/  10000 (97.91%), best:    9795/10000 (97.95%), error:       759.62268, best error:       698.21106 on epoch:    70, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 205.0786437988s, input_fired_time: 2.4181759357, output_fired_time: 2.1710031033, propagate_forward_time: 77.1650848389, propagate_backward_time: 119.0234222412, weight_update_time: 0.1820276231, other_time: 4.3009490967
epoch time: 14.7427330017s, input_fired_time: 0.2920497060, output_fired_time: 0.0000000000, propagate_forward_time: 13.6932497025, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7574338913
validation[          , genome  6640] predictions:    9765/  10000 (97.65%), best:    9795/10000 (97.95%), error:       776.32495, best error:       698.21106 on epoch:    70, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 198.4688110352s, input_fired_time: 2.3814570904, output_fired_time: 2.1216466427, propagate_forward_time: 74.3302841187, propagate_backward_time: 115.4134597778, weight_update_time: 0.1804262400, other_time: 4.2219696045
epoch time: 16.0800113678s, input_fired_time: 0.3013399243, output_fired_time: 0.0000000000, propagate_forward_time: 15.0305051804, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7481660843
validation[          , genome  6640] predictions:    9773/  10000 (97.73%), best:    9795/10000 (97.95%), error:       732.94507, best error:       698.21106 on epoch:    70, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 200.0539398193s, input_fired_time: 3.3935945034, output_fired_time: 3.1346430779, propagate_forward_time: 72.7365722656, propagate_backward_time: 116.4801177979, weight_update_time: 0.1816675216, other_time: 4.3090057373
epoch time: 16.0645408630s, input_fired_time: 0.2970647514, output_fired_time: 0.0000000000, propagate_forward_time: 14.9909191132, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7765569687
validation[          , genome  6640] predictions:    9786/  10000 (97.86%), best:    9795/10000 (97.95%), error:       741.56506, best error:       698.21106 on epoch:    70, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 198.7999877930s, input_fired_time: 2.3805730343, output_fired_time: 2.1394674778, propagate_forward_time: 75.4008102417, propagate_backward_time: 113.7086868286, weight_update_time: 0.1812140048, other_time: 5.1704559326
epoch time: 17.0235805511s, input_fired_time: 0.3173846900, output_fired_time: 0.0000000000, propagate_forward_time: 15.8774785995, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8287172318
validation[          , genome  6640] predictions:    9744/  10000 (97.44%), best:    9795/10000 (97.95%), error:       870.23914, best error:       698.21106 on epoch:    70, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 199.3826599121s, input_fired_time: 3.3806416988, output_fired_time: 2.1324481964, propagate_forward_time: 72.8379669189, propagate_backward_time: 116.7979125977, weight_update_time: 0.1808104217, other_time: 4.2336883545
epoch time: 17.3576412201s, input_fired_time: 0.3501376212, output_fired_time: 0.0000000000, propagate_forward_time: 15.2384481430, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7690553665
validation[          , genome  6640] predictions:    9757/  10000 (97.57%), best:    9795/10000 (97.95%), error:       821.49237, best error:       698.21106 on epoch:    70, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 199.7151336670s, input_fired_time: 2.3868708611, output_fired_time: 2.1295144558, propagate_forward_time: 73.9294738770, propagate_backward_time: 117.0128173828, weight_update_time: 0.1816009730, other_time: 4.2564544678
epoch time: 15.0234785080s, input_fired_time: 0.3017698824, output_fired_time: 0.0000000000, propagate_forward_time: 13.9350929260, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7866153717
validation[          , genome  6640] predictions:    9779/  10000 (97.79%), best:    9795/10000 (97.95%), error:       774.26544, best error:       698.21106 on epoch:    70, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 205.6303558350s, input_fired_time: 2.4507074356, output_fired_time: 2.2333326340, propagate_forward_time: 77.7655944824, propagate_backward_time: 117.7750930786, weight_update_time: 0.1832122356, other_time: 5.4056167603
epoch time: 14.8423709869s, input_fired_time: 0.2969263196, output_fired_time: 0.0000000000, propagate_forward_time: 13.7832412720, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7622032166
validation[          , genome  6640] predictions:    9795/  10000 (97.95%), best:    9795/10000 (97.95%), error:       697.57758, best error:       697.57758 on epoch:    82, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 199.5548706055s, input_fired_time: 2.3913776875, output_fired_time: 2.1388847828, propagate_forward_time: 74.6710205078, propagate_backward_time: 115.9717864990, weight_update_time: 0.1825490296, other_time: 4.3818054199
epoch time: 15.9858675003s, input_fired_time: 0.2984091043, output_fired_time: 0.0000000000, propagate_forward_time: 13.9145326614, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7729253769
validation[          , genome  6640] predictions:    9784/  10000 (97.84%), best:    9795/10000 (97.95%), error:       734.90607, best error:       697.57758 on epoch:    82, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 199.5295104980s, input_fired_time: 2.3990643024, output_fired_time: 2.1341805458, propagate_forward_time: 74.7298049927, propagate_backward_time: 115.9021148682, weight_update_time: 0.1830535829, other_time: 4.3643417358
epoch time: 16.1128273010s, input_fired_time: 0.3087117076, output_fired_time: 0.0000000000, propagate_forward_time: 15.0000476837, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8040676117
validation[          , genome  6640] predictions:    9781/  10000 (97.81%), best:    9795/10000 (97.95%), error:       727.31348, best error:       697.57758 on epoch:    82, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 198.8801116943s, input_fired_time: 2.3929963112, output_fired_time: 2.1428461075, propagate_forward_time: 73.4412078857, propagate_backward_time: 116.5000228882, weight_update_time: 0.1827264875, other_time: 4.4030380249
epoch time: 16.1152305603s, input_fired_time: 0.3025293052, output_fired_time: 0.0000000000, propagate_forward_time: 15.0471153259, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7655858994
validation[          , genome  6640] predictions:    9779/  10000 (97.79%), best:    9795/10000 (97.95%), error:       715.74048, best error:       697.57758 on epoch:    82, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 202.3817138672s, input_fired_time: 2.4397106171, output_fired_time: 3.2089102268, propagate_forward_time: 77.4674072266, propagate_backward_time: 114.7308883667, weight_update_time: 0.1847498566, other_time: 4.5347976685
epoch time: 16.0304851532s, input_fired_time: 0.3025889695, output_fired_time: 0.0000000000, propagate_forward_time: 13.9302701950, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7976255417
validation[          , genome  6640] predictions:    9769/  10000 (97.69%), best:    9795/10000 (97.95%), error:       766.15393, best error:       697.57758 on epoch:    82, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 204.9328155518s, input_fired_time: 2.4620134830, output_fired_time: 2.2134060860, propagate_forward_time: 77.0892028809, propagate_backward_time: 118.7556228638, weight_update_time: 0.1865011752, other_time: 4.4125595093
epoch time: 16.4804172516s, input_fired_time: 0.3040343821, output_fired_time: 0.0000000000, propagate_forward_time: 15.4358911514, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7404909134
validation[          , genome  6640] predictions:    9790/  10000 (97.90%), best:    9790/10000 (97.90%), error:       685.04749, best error:       685.04749 on epoch:    87, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 205.7770080566s, input_fired_time: 2.4371595383, output_fired_time: 2.2186298370, propagate_forward_time: 79.0662765503, propagate_backward_time: 117.7408676147, weight_update_time: 0.1816068739, other_time: 4.3140716553
epoch time: 17.5123081207s, input_fired_time: 0.3223151565, output_fired_time: 0.0000000000, propagate_forward_time: 16.3703517914, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8196411133
validation[          , genome  6640] predictions:    9795/  10000 (97.95%), best:    9790/10000 (97.90%), error:       705.29742, best error:       685.04749 on epoch:    87, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 199.3535614014s, input_fired_time: 2.3914577961, output_fired_time: 2.1430964470, propagate_forward_time: 73.6989593506, propagate_backward_time: 116.8403854370, weight_update_time: 0.1821479350, other_time: 4.2796554565
epoch time: 16.1690731049s, input_fired_time: 0.2995951772, output_fired_time: 0.0000000000, propagate_forward_time: 15.1399936676, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7294845581
validation[          , genome  6640] predictions:    9766/  10000 (97.66%), best:    9790/10000 (97.90%), error:       803.65802, best error:       685.04749 on epoch:    87, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 199.2638702393s, input_fired_time: 2.3901147842, output_fired_time: 2.1376512051, propagate_forward_time: 75.4569091797, propagate_backward_time: 114.8620834351, weight_update_time: 0.1836305410, other_time: 4.4171066284
epoch time: 16.1308536530s, input_fired_time: 0.3039758801, output_fired_time: 0.0000000000, propagate_forward_time: 14.9790573120, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8478202820
validation[          , genome  6640] predictions:    9796/  10000 (97.96%), best:    9790/10000 (97.90%), error:       718.81213, best error:       685.04749 on epoch:    87, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 201.9340209961s, input_fired_time: 2.4259090424, output_fired_time: 2.1690361500, propagate_forward_time: 72.9600372314, propagate_backward_time: 119.9890899658, weight_update_time: 0.1818145066, other_time: 4.3899536133
epoch time: 14.9665842056s, input_fired_time: 0.3066205978, output_fired_time: 0.0000000000, propagate_forward_time: 13.9175395966, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7424240112
validation[          , genome  6640] predictions:    9757/  10000 (97.57%), best:    9790/10000 (97.90%), error:       824.12897, best error:       685.04749 on epoch:    87, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 196.1217041016s, input_fired_time: 2.7961239815, output_fired_time: 2.1127729416, propagate_forward_time: 73.8418579102, propagate_backward_time: 113.0366210938, weight_update_time: 0.1822123379, other_time: 4.3343200684
epoch time: 16.2738780975s, input_fired_time: 0.3076053858, output_fired_time: 0.0000000000, propagate_forward_time: 15.1686754227, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7975969315
validation[          , genome  6640] predictions:    9792/  10000 (97.92%), best:    9790/10000 (97.90%), error:       744.34448, best error:       685.04749 on epoch:    87, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 199.0386199951s, input_fired_time: 2.3942368031, output_fired_time: 2.1295425892, propagate_forward_time: 75.3756866455, propagate_backward_time: 114.6984863281, weight_update_time: 0.1892757863, other_time: 4.4406585693
epoch time: 16.2954807281s, input_fired_time: 0.3073718250, output_fired_time: 0.0000000000, propagate_forward_time: 15.1795253754, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8085832596
validation[          , genome  6640] predictions:    9796/  10000 (97.96%), best:    9790/10000 (97.90%), error:       697.51349, best error:       685.04749 on epoch:    87, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 209.0538787842s, input_fired_time: 2.3882856369, output_fired_time: 2.1311998367, propagate_forward_time: 76.3386001587, propagate_backward_time: 123.8936233521, weight_update_time: 0.1819615662, other_time: 4.3021774292
epoch time: 16.3420448303s, input_fired_time: 0.3082989156, output_fired_time: 0.0000000000, propagate_forward_time: 15.2599687576, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7737779617
validation[          , genome  6640] predictions:    9798/  10000 (97.98%), best:    9790/10000 (97.90%), error:       728.58722, best error:       685.04749 on epoch:    87, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 198.2505493164s, input_fired_time: 2.3841505051, output_fired_time: 2.1212315559, propagate_forward_time: 75.0747833252, propagate_backward_time: 114.3737182617, weight_update_time: 0.1815203726, other_time: 4.2966613770
epoch time: 14.9486351013s, input_fired_time: 0.3002690673, output_fired_time: 0.0000000000, propagate_forward_time: 13.9048480988, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7435178757
validation[          , genome  6640] predictions:    9754/  10000 (97.54%), best:    9790/10000 (97.90%), error:       809.78619, best error:       685.04749 on epoch:    87, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 198.1056213379s, input_fired_time: 2.3878335953, output_fired_time: 2.1159694195, propagate_forward_time: 75.0640792847, propagate_backward_time: 114.2229614258, weight_update_time: 0.1808918267, other_time: 4.3147811890
epoch time: 16.2770862579s, input_fired_time: 0.3035390079, output_fired_time: 0.0000000000, propagate_forward_time: 15.1866388321, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7869081497
validation[          , genome  6640] predictions:    9795/  10000 (97.95%), best:    9790/10000 (97.90%), error:       703.83911, best error:       685.04749 on epoch:    87, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 204.0601959229s, input_fired_time: 2.4430599213, output_fired_time: 3.2101640701, propagate_forward_time: 74.2310943604, propagate_backward_time: 119.8323211670, weight_update_time: 0.1824519336, other_time: 4.3435668945
epoch time: 18.9402370453s, input_fired_time: 0.3460423946, output_fired_time: 0.0000000000, propagate_forward_time: 17.7293891907, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8648052216
validation[          , genome  6640] predictions:    9788/  10000 (97.88%), best:    9790/10000 (97.90%), error:       729.83771, best error:       685.04749 on epoch:    87, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 199.7538452148s, input_fired_time: 2.3939204216, output_fired_time: 2.1288557053, propagate_forward_time: 73.7695846558, propagate_backward_time: 116.2025222778, weight_update_time: 0.1816645861, other_time: 5.2589569092
epoch time: 17.7040805817s, input_fired_time: 0.3479370177, output_fired_time: 0.0000000000, propagate_forward_time: 16.5616569519, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7944869995
validation[          , genome  6640] predictions:    9791/  10000 (97.91%), best:    9790/10000 (97.90%), error:       717.08142, best error:       685.04749 on epoch:    87, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 201.2767028809s, input_fired_time: 2.4412181377, output_fired_time: 2.2037382126, propagate_forward_time: 74.1450271606, propagate_backward_time: 117.2327194214, weight_update_time: 0.1811582148, other_time: 5.2539978027
epoch time: 16.1815452576s, input_fired_time: 0.3025874496, output_fired_time: 0.0000000000, propagate_forward_time: 15.0910291672, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7879285812
validation[          , genome  6640] predictions:    9792/  10000 (97.92%), best:    9790/10000 (97.90%), error:       719.76685, best error:       685.04749 on epoch:    87, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 199.1218872070s, input_fired_time: 2.3758571148, output_fired_time: 3.1254506111, propagate_forward_time: 75.3549804688, propagate_backward_time: 114.1196594238, weight_update_time: 0.1800978035, other_time: 4.1459350586
epoch time: 16.1948738098s, input_fired_time: 0.3054639995, output_fired_time: 0.0000000000, propagate_forward_time: 15.1392135620, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7501964569
validation[          , genome  6640] predictions:    9800/  10000 (98.00%), best:    9790/10000 (97.90%), error:       703.36743, best error:       685.04749 on epoch:    87, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 79.7916488647s, input_fired_time: 1.5178451538, output_fired_time: 0.0000000000, propagate_forward_time: 74.3535003662, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9203033447
best training[          , genome  6640] predictions:   49822/  50000 (99.64%), best:    9790/10000 (97.90%), error:       979.33661, best error:       685.04749 on epoch:    87, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 16.2928390503s, input_fired_time: 0.3039739132, output_fired_time: 0.0000000000, propagate_forward_time: 15.2476205826, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7412443161
   testing[          , genome  6640] predictions:    9811/  10000 (98.11%), best:    9790/10000 (97.90%), error:       591.60510, best error:       685.04749 on epoch:    87, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
06:25:35 (11816): called boinc_finish(0)

</stderr_txt>
]]>