Nameexact_genome_1512568488_41_3514_2
Workunit2588826
Created7 Dec 2017, 6:16:19 UTC
Sent7 Dec 2017, 6:19:22 UTC
Report deadline14 Dec 2017, 6:31:17 UTC
Received7 Dec 2017, 19:47:35 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID55108
Run time3 hours 53 min 10 sec
CPU time3 hours 45 min 9 sec
Validate stateValid
Credit1,752.07
Device peak FLOPS2.57 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size154.63 MB
Peak swap size157.91 MB
Peak disk usage1.71 MB

Stderr output

<core_client_version>7.8.2</core_client_version>
<![CDATA[
<stderr_txt>
6169510
validation[          , genome  3514] predictions:    9582/  10000 (95.82%), best:    9612/10000 (96.12%), error:      1395.68701, best error:      1325.78979 on epoch:    11, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 129.9321746826s, input_fired_time: 1.5347292423, output_fired_time: 1.4115580320, propagate_forward_time: 47.4035835266, propagate_backward_time: 76.2459487915, weight_update_time: 0.1436564922, other_time: 3.3363571167
epoch time: 9.6430473328s, input_fired_time: 0.1896143854, output_fired_time: 0.0000000000, propagate_forward_time: 8.8823785782, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5710544586
validation[          , genome  3514] predictions:    9569/  10000 (95.69%), best:    9612/10000 (96.12%), error:      1460.42432, best error:      1325.78979 on epoch:    11, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 129.7192840576s, input_fired_time: 1.5592975616, output_fired_time: 1.3926061392, propagate_forward_time: 49.0484695435, propagate_backward_time: 74.3233261108, weight_update_time: 0.1446070373, other_time: 3.3955841064
epoch time: 9.4749565125s, input_fired_time: 0.1898289621, output_fired_time: 0.0000000000, propagate_forward_time: 8.7140083313, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5711193085
validation[          , genome  3514] predictions:    9607/  10000 (96.07%), best:    9612/10000 (96.12%), error:      1326.19031, best error:      1325.78979 on epoch:    11, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 130.1069183350s, input_fired_time: 1.5381200314, output_fired_time: 1.3862831593, propagate_forward_time: 47.6988220215, propagate_backward_time: 75.1544723511, weight_update_time: 0.1432420164, other_time: 4.3292236328
epoch time: 13.9400415421s, input_fired_time: 0.2426791042, output_fired_time: 0.0000000000, propagate_forward_time: 12.8844585419, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8129043579
validation[          , genome  3514] predictions:    9615/  10000 (96.15%), best:    9615/10000 (96.15%), error:      1311.25281, best error:      1311.25281 on epoch:    17, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 132.9817352295s, input_fired_time: 1.6042548418, output_fired_time: 1.4061710835, propagate_forward_time: 47.7402420044, propagate_backward_time: 78.8657760620, weight_update_time: 0.1450067759, other_time: 3.3652954102
epoch time: 10.7727174759s, input_fired_time: 0.1926159263, output_fired_time: 0.0000000000, propagate_forward_time: 9.9898033142, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5902986526
validation[          , genome  3514] predictions:    9612/  10000 (96.12%), best:    9615/10000 (96.15%), error:      1312.43469, best error:      1311.25281 on epoch:    17, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 129.6304626465s, input_fired_time: 1.5563319921, output_fired_time: 1.3999543190, propagate_forward_time: 46.9352226257, propagate_backward_time: 76.3444290161, weight_update_time: 0.1455536187, other_time: 3.3945236206
epoch time: 11.0371627808s, input_fired_time: 0.1983713657, output_fired_time: 0.0000000000, propagate_forward_time: 10.2412357330, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5975561142
validation[          , genome  3514] predictions:    9605/  10000 (96.05%), best:    9615/10000 (96.15%), error:      1326.54688, best error:      1311.25281 on epoch:    17, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 142.2051086426s, input_fired_time: 1.6926676035, output_fired_time: 1.5307438374, propagate_forward_time: 51.0925979614, propagate_backward_time: 83.2038269043, weight_update_time: 0.1595798284, other_time: 4.6852645874
epoch time: 9.4326257706s, input_fired_time: 0.1858705133, output_fired_time: 0.0000000000, propagate_forward_time: 8.6839742661, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5627813339
validation[          , genome  3514] predictions:    9609/  10000 (96.09%), best:    9615/10000 (96.15%), error:      1337.09717, best error:      1311.25281 on epoch:    17, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 130.4849090576s, input_fired_time: 1.5469692945, output_fired_time: 1.3869074583, propagate_forward_time: 49.7532806396, propagate_backward_time: 74.4624786377, weight_update_time: 0.1440982521, other_time: 3.3352737427
epoch time: 9.7871503830s, input_fired_time: 0.1921643317, output_fired_time: 0.0000000000, propagate_forward_time: 9.0051231384, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5898628235
validation[          , genome  3514] predictions:    9628/  10000 (96.28%), best:    9628/10000 (96.28%), error:      1250.02991, best error:      1250.02991 on epoch:    21, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 149.2277679443s, input_fired_time: 1.7244963646, output_fired_time: 1.6307774782, propagate_forward_time: 57.5921897888, propagate_backward_time: 84.5214385986, weight_update_time: 0.1816819012, other_time: 3.7588500977
epoch time: 9.7508401871s, input_fired_time: 0.1930235475, output_fired_time: 0.0000000000, propagate_forward_time: 8.9675731659, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5902433395
validation[          , genome  3514] predictions:    9584/  10000 (95.84%), best:    9628/10000 (96.28%), error:      1420.81006, best error:      1250.02991 on epoch:    21, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 130.7718658447s, input_fired_time: 1.5447456837, output_fired_time: 1.3936612606, propagate_forward_time: 48.8331336975, propagate_backward_time: 74.6484451294, weight_update_time: 0.1461797059, other_time: 4.3518905640
epoch time: 9.7046651840s, input_fired_time: 0.1914049536, output_fired_time: 0.0000000000, propagate_forward_time: 8.9377698898, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5754899979
validation[          , genome  3514] predictions:    9607/  10000 (96.07%), best:    9628/10000 (96.28%), error:      1357.56067, best error:      1250.02991 on epoch:    21, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 130.6719970703s, input_fired_time: 1.5619685650, output_fired_time: 2.4136071205, propagate_forward_time: 47.8878059387, propagate_backward_time: 75.4642715454, weight_update_time: 0.1441065669, other_time: 3.3443527222
epoch time: 9.8467483521s, input_fired_time: 0.1921048164, output_fired_time: 0.0000000000, propagate_forward_time: 9.0753927231, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5792512894
validation[          , genome  3514] predictions:    9639/  10000 (96.39%), best:    9639/10000 (96.39%), error:      1212.94922, best error:      1212.94922 on epoch:    24, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 129.6744079590s, input_fired_time: 1.5411835909, output_fired_time: 1.3847755194, propagate_forward_time: 45.5674781799, propagate_backward_time: 76.8460693359, weight_update_time: 0.1437790692, other_time: 4.3348999023
epoch time: 9.7463979721s, input_fired_time: 0.1931339502, output_fired_time: 0.0000000000, propagate_forward_time: 8.9633865356, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5898771286
validation[          , genome  3514] predictions:    9607/  10000 (96.07%), best:    9639/10000 (96.39%), error:      1257.94873, best error:      1212.94922 on epoch:    24, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 135.9636688232s, input_fired_time: 1.5950810909, output_fired_time: 1.4123141766, propagate_forward_time: 51.0294570923, propagate_backward_time: 78.2718276978, weight_update_time: 0.1438666135, other_time: 3.6549987793
epoch time: 10.9558801651s, input_fired_time: 0.1958868355, output_fired_time: 0.0000000000, propagate_forward_time: 10.1670522690, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5929412842
validation[          , genome  3514] predictions:    9614/  10000 (96.14%), best:    9639/10000 (96.39%), error:      1361.64368, best error:      1212.94922 on epoch:    24, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 128.7929534912s, input_fired_time: 1.5377836227, output_fired_time: 1.3988363743, propagate_forward_time: 46.5199432373, propagate_backward_time: 76.0273056030, weight_update_time: 0.1434312612, other_time: 3.3090896606
epoch time: 10.9441490173s, input_fired_time: 0.1943166405, output_fired_time: 0.0000000000, propagate_forward_time: 10.1648311615, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5850009918
validation[          , genome  3514] predictions:    9603/  10000 (96.03%), best:    9639/10000 (96.39%), error:      1325.88379, best error:      1212.94922 on epoch:    24, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 157.4635467529s, input_fired_time: 1.7870258093, output_fired_time: 1.7188400030, propagate_forward_time: 57.3269996643, propagate_backward_time: 92.5933151245, weight_update_time: 0.1948570013, other_time: 4.0373611450
epoch time: 11.1632337570s, input_fired_time: 0.2210967392, output_fired_time: 0.0000000000, propagate_forward_time: 10.2822751999, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6598615646
validation[          , genome  3514] predictions:    9597/  10000 (95.97%), best:    9639/10000 (96.39%), error:      1354.80005, best error:      1212.94922 on epoch:    24, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 130.0633087158s, input_fired_time: 1.5765192509, output_fired_time: 1.3945986032, propagate_forward_time: 48.5802955627, propagate_backward_time: 75.1562881470, weight_update_time: 0.1439614147, other_time: 3.3555984497
epoch time: 9.8006410599s, input_fired_time: 0.1940508187, output_fired_time: 0.0000000000, propagate_forward_time: 9.0248088837, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5817813873
validation[          , genome  3514] predictions:    9612/  10000 (96.12%), best:    9639/10000 (96.39%), error:      1258.57947, best error:      1212.94922 on epoch:    24, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 130.1728973389s, input_fired_time: 1.5462801456, output_fired_time: 1.3987836838, propagate_forward_time: 47.5206069946, propagate_backward_time: 75.3713531494, weight_update_time: 0.1434673816, other_time: 4.3358764648
epoch time: 9.6453237534s, input_fired_time: 0.1927997619, output_fired_time: 0.0000000000, propagate_forward_time: 8.8578319550, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5946922302
validation[          , genome  3514] predictions:    9591/  10000 (95.91%), best:    9639/10000 (96.39%), error:      1379.26880, best error:      1212.94922 on epoch:    24, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 130.1914520264s, input_fired_time: 1.5527324677, output_fired_time: 1.3928170204, propagate_forward_time: 49.5071983337, propagate_backward_time: 74.3760147095, weight_update_time: 0.1444238126, other_time: 3.3626937866
epoch time: 9.8232393265s, input_fired_time: 0.2038892508, output_fired_time: 0.0000000000, propagate_forward_time: 9.0225687027, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5967817307
validation[          , genome  3514] predictions:    9624/  10000 (96.24%), best:    9639/10000 (96.39%), error:      1265.70715, best error:      1212.94922 on epoch:    24, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 136.4502868652s, input_fired_time: 1.6535604000, output_fired_time: 1.4280706644, propagate_forward_time: 49.9086227417, propagate_backward_time: 80.0083007813, weight_update_time: 0.1510519534, other_time: 3.4517288208
epoch time: 11.0633239746s, input_fired_time: 0.1991943270, output_fired_time: 0.0000000000, propagate_forward_time: 10.2574453354, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6066846848
validation[          , genome  3514] predictions:    9654/  10000 (96.54%), best:    9639/10000 (96.39%), error:      1252.79773, best error:      1212.94922 on epoch:    24, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 128.0843811035s, input_fired_time: 2.5520467758, output_fired_time: 1.3882465363, propagate_forward_time: 45.9022369385, propagate_backward_time: 74.9213867188, weight_update_time: 0.1443162560, other_time: 3.3204650879
epoch time: 11.0162324905s, input_fired_time: 0.1980889291, output_fired_time: 0.0000000000, propagate_forward_time: 10.2192087173, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5989351273
validation[          , genome  3514] predictions:    9641/  10000 (96.41%), best:    9639/10000 (96.39%), error:      1217.41956, best error:      1212.94922 on epoch:    24, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 129.1524810791s, input_fired_time: 1.5486708879, output_fired_time: 1.3860690594, propagate_forward_time: 46.6360855103, propagate_backward_time: 75.2453460693, weight_update_time: 0.1440327615, other_time: 4.3363113403
epoch time: 11.0524568558s, input_fired_time: 0.2010416090, output_fired_time: 0.0000000000, propagate_forward_time: 10.2508630753, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6005525589
validation[          , genome  3514] predictions:    9650/  10000 (96.50%), best:    9650/10000 (96.50%), error:      1196.18591, best error:      1196.18591 on epoch:    34, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 131.6906738281s, input_fired_time: 2.5977241993, output_fired_time: 1.4115731716, propagate_forward_time: 49.9966583252, propagate_backward_time: 73.3223495483, weight_update_time: 0.1433080733, other_time: 4.3623733521
epoch time: 10.9602050781s, input_fired_time: 0.1973959506, output_fired_time: 0.0000000000, propagate_forward_time: 10.1627626419, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6000461578
validation[          , genome  3514] predictions:    9579/  10000 (95.79%), best:    9650/10000 (96.50%), error:      1407.88672, best error:      1196.18591 on epoch:    34, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 139.3815155029s, input_fired_time: 1.6576333046, output_fired_time: 1.4601994753, propagate_forward_time: 51.0278396606, propagate_backward_time: 80.7241668701, weight_update_time: 0.1520009041, other_time: 4.5116653442
epoch time: 9.7244396210s, input_fired_time: 0.1906206310, output_fired_time: 0.0000000000, propagate_forward_time: 8.9633855820, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5704336166
validation[          , genome  3514] predictions:    9623/  10000 (96.23%), best:    9650/10000 (96.50%), error:      1229.82275, best error:      1196.18591 on epoch:    34, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 131.1167144775s, input_fired_time: 1.5676156282, output_fired_time: 1.3964934349, propagate_forward_time: 48.0668869019, propagate_backward_time: 75.6972656250, weight_update_time: 0.1448464841, other_time: 4.3884506226
epoch time: 16.7547111511s, input_fired_time: 0.2821697593, output_fired_time: 0.0000000000, propagate_forward_time: 15.5276851654, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9448566437
validation[          , genome  3514] predictions:    9609/  10000 (96.09%), best:    9650/10000 (96.50%), error:      1274.79468, best error:      1196.18591 on epoch:    34, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 133.5070800781s, input_fired_time: 1.5797572136, output_fired_time: 1.4427163601, propagate_forward_time: 49.3591537476, propagate_backward_time: 77.7120056152, weight_update_time: 0.1434884518, other_time: 3.4134445190
epoch time: 11.1996240616s, input_fired_time: 0.2013010830, output_fired_time: 0.0000000000, propagate_forward_time: 10.3939886093, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6043348312
validation[          , genome  3514] predictions:    9643/  10000 (96.43%), best:    9650/10000 (96.50%), error:      1224.78015, best error:      1196.18591 on epoch:    34, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 139.8075408936s, input_fired_time: 1.6386847496, output_fired_time: 1.5060348511, propagate_forward_time: 50.7564125061, propagate_backward_time: 82.3738708496, weight_update_time: 0.1451387107, other_time: 3.5325317383
epoch time: 10.3049211502s, input_fired_time: 0.2052013874, output_fired_time: 0.0000000000, propagate_forward_time: 9.4675722122, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6321477890
validation[          , genome  3514] predictions:    9581/  10000 (95.81%), best:    9650/10000 (96.50%), error:      1400.62463, best error:      1196.18591 on epoch:    34, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 129.7189331055s, input_fired_time: 1.5555546284, output_fired_time: 2.4010019302, propagate_forward_time: 46.8907012939, propagate_backward_time: 75.5490570068, weight_update_time: 0.1438173354, other_time: 3.3226165771
epoch time: 10.9330654144s, input_fired_time: 0.1997241378, output_fired_time: 0.0000000000, propagate_forward_time: 10.1330490112, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6002922058
validation[          , genome  3514] predictions:    9606/  10000 (96.06%), best:    9650/10000 (96.50%), error:      1323.06726, best error:      1196.18591 on epoch:    34, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 129.6927490234s, input_fired_time: 1.5584013462, output_fired_time: 1.3914225101, propagate_forward_time: 45.8080482483, propagate_backward_time: 77.5752182007, weight_update_time: 0.1444926411, other_time: 3.3596572876
epoch time: 10.9478006363s, input_fired_time: 0.2014246732, output_fired_time: 0.0000000000, propagate_forward_time: 10.1484470367, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5979290009
validation[          , genome  3514] predictions:    9620/  10000 (96.20%), best:    9650/10000 (96.50%), error:      1288.28381, best error:      1196.18591 on epoch:    34, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 142.4567260742s, input_fired_time: 1.7587833405, output_fired_time: 1.5549861193, propagate_forward_time: 53.1820526123, propagate_backward_time: 82.3362884521, weight_update_time: 0.1583712101, other_time: 3.6246032715
epoch time: 15.7970190048s, input_fired_time: 0.3167686164, output_fired_time: 0.0000000000, propagate_forward_time: 14.6601209641, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8201293945
validation[          , genome  3514] predictions:    9652/  10000 (96.52%), best:    9650/10000 (96.50%), error:      1203.18030, best error:      1196.18591 on epoch:    34, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 161.2201080322s, input_fired_time: 1.8512078524, output_fired_time: 2.8051292896, propagate_forward_time: 59.8708457947, propagate_backward_time: 92.6373138428, weight_update_time: 0.1540201455, other_time: 4.0556030273
epoch time: 10.3170843124s, input_fired_time: 0.2037362307, output_fired_time: 0.0000000000, propagate_forward_time: 9.5251541138, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5881938934
validation[          , genome  3514] predictions:    9645/  10000 (96.45%), best:    9650/10000 (96.50%), error:      1216.62488, best error:      1196.18591 on epoch:    34, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 144.5752105713s, input_fired_time: 2.7313950062, output_fired_time: 1.5035238266, propagate_forward_time: 52.0391921997, propagate_backward_time: 84.6044616699, weight_update_time: 0.1584201753, other_time: 3.6966323853
epoch time: 11.1024465561s, input_fired_time: 0.2011085749, output_fired_time: 0.0000000000, propagate_forward_time: 10.3042516708, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5970859528
validation[          , genome  3514] predictions:    9645/  10000 (96.45%), best:    9650/10000 (96.50%), error:      1237.53601, best error:      1196.18591 on epoch:    34, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 129.0723266602s, input_fired_time: 1.5539510250, output_fired_time: 1.3875273466, propagate_forward_time: 47.5123214722, propagate_backward_time: 75.2932510376, weight_update_time: 0.1439893246, other_time: 3.3252792358
epoch time: 11.1921625137s, input_fired_time: 0.2018972933, output_fired_time: 0.0000000000, propagate_forward_time: 10.3879394531, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6023254395
validation[          , genome  3514] predictions:    9654/  10000 (96.54%), best:    9650/10000 (96.50%), error:      1208.88293, best error:      1196.18591 on epoch:    34, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 140.4982299805s, input_fired_time: 1.7030633688, output_fired_time: 1.5280648470, propagate_forward_time: 52.6526298523, propagate_backward_time: 80.0107955933, weight_update_time: 0.1575671136, other_time: 4.6036758423
epoch time: 10.9899673462s, input_fired_time: 0.2012747526, output_fired_time: 0.0000000000, propagate_forward_time: 10.1926813126, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5960111618
validation[          , genome  3514] predictions:    9623/  10000 (96.23%), best:    9650/10000 (96.50%), error:      1247.70691, best error:      1196.18591 on epoch:    34, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 128.7573242188s, input_fired_time: 1.5576778650, output_fired_time: 1.3883881569, propagate_forward_time: 46.6526031494, propagate_backward_time: 75.8346862793, weight_update_time: 0.1437874883, other_time: 3.3239669800
epoch time: 11.1139488220s, input_fired_time: 0.2011877596, output_fired_time: 0.0000000000, propagate_forward_time: 10.3136386871, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5991220474
validation[          , genome  3514] predictions:    9617/  10000 (96.17%), best:    9650/10000 (96.50%), error:      1254.83105, best error:      1196.18591 on epoch:    34, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 140.5385742188s, input_fired_time: 1.6882152557, output_fired_time: 1.4469162226, propagate_forward_time: 52.7633094788, propagate_backward_time: 80.0322647095, weight_update_time: 0.1533565521, other_time: 4.6078720093
epoch time: 19.1365013123s, input_fired_time: 0.3459866643, output_fired_time: 0.0000000000, propagate_forward_time: 17.7930717468, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9974422455
validation[          , genome  3514] predictions:    9652/  10000 (96.52%), best:    9650/10000 (96.50%), error:      1217.45337, best error:      1196.18591 on epoch:    34, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 129.0925750732s, input_fired_time: 1.5567914248, output_fired_time: 1.3818542957, propagate_forward_time: 49.7147254944, propagate_backward_time: 73.1073913574, weight_update_time: 0.1444936544, other_time: 3.3318176270
epoch time: 11.1139039993s, input_fired_time: 0.1991141587, output_fired_time: 0.0000000000, propagate_forward_time: 10.3188171387, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5959730148
validation[          , genome  3514] predictions:    9642/  10000 (96.42%), best:    9650/10000 (96.50%), error:      1229.73169, best error:      1196.18591 on epoch:    34, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 134.3541870117s, input_fired_time: 1.6523449421, output_fired_time: 1.4281140566, propagate_forward_time: 52.6258125305, propagate_backward_time: 75.2021331787, weight_update_time: 0.1531187147, other_time: 3.4457855225
epoch time: 11.1482810974s, input_fired_time: 0.1992197633, output_fired_time: 0.0000000000, propagate_forward_time: 10.3616542816, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5874071121
validation[          , genome  3514] predictions:    9620/  10000 (96.20%), best:    9650/10000 (96.50%), error:      1277.67273, best error:      1196.18591 on epoch:    34, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 128.8833007813s, input_fired_time: 1.5515459776, output_fired_time: 1.3889639378, propagate_forward_time: 47.5532341003, propagate_backward_time: 75.0563964844, weight_update_time: 0.1435900927, other_time: 3.3331604004
epoch time: 11.0123424530s, input_fired_time: 0.2176113725, output_fired_time: 0.0000000000, propagate_forward_time: 10.1728811264, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6218500137
validation[          , genome  3514] predictions:    9596/  10000 (95.96%), best:    9650/10000 (96.50%), error:      1337.13757, best error:      1196.18591 on epoch:    34, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 132.5023193359s, input_fired_time: 1.5983078480, output_fired_time: 1.4147857428, propagate_forward_time: 50.4746627808, propagate_backward_time: 75.6308898926, weight_update_time: 0.1441456974, other_time: 3.3836746216
epoch time: 9.7241096497s, input_fired_time: 0.1940830499, output_fired_time: 0.0000000000, propagate_forward_time: 8.9571552277, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5728712082
validation[          , genome  3514] predictions:    9654/  10000 (96.54%), best:    9654/10000 (96.54%), error:      1172.18335, best error:      1172.18335 on epoch:    52, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 130.5403442383s, input_fired_time: 1.5579195023, output_fired_time: 1.3933985233, propagate_forward_time: 48.6739044189, propagate_backward_time: 75.5861587524, weight_update_time: 0.1447091699, other_time: 3.3289566040
epoch time: 9.8697738647s, input_fired_time: 0.1963603646, output_fired_time: 0.0000000000, propagate_forward_time: 9.0916204453, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5817928314
validation[          , genome  3514] predictions:    9619/  10000 (96.19%), best:    9654/10000 (96.54%), error:      1307.28064, best error:      1172.18335 on epoch:    52, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 130.4792785645s, input_fired_time: 1.5625363588, output_fired_time: 1.3940622807, propagate_forward_time: 46.8197975159, propagate_backward_time: 77.3812103271, weight_update_time: 0.1447183639, other_time: 3.3216705322
epoch time: 9.9217195511s, input_fired_time: 0.1988043487, output_fired_time: 0.0000000000, propagate_forward_time: 9.1369857788, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5859298706
validation[          , genome  3514] predictions:    9637/  10000 (96.37%), best:    9654/10000 (96.54%), error:      1263.13342, best error:      1172.18335 on epoch:    52, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 137.5167236328s, input_fired_time: 1.6547981501, output_fired_time: 1.4463803768, propagate_forward_time: 51.4249572754, propagate_backward_time: 79.4712448120, weight_update_time: 0.1554125845, other_time: 3.5193405151
epoch time: 15.6030702591s, input_fired_time: 0.2919636071, output_fired_time: 0.0000000000, propagate_forward_time: 13.4331340790, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8779726028
validation[          , genome  3514] predictions:    9645/  10000 (96.45%), best:    9654/10000 (96.54%), error:      1209.54553, best error:      1172.18335 on epoch:    52, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 139.3900604248s, input_fired_time: 2.7586474419, output_fired_time: 1.4754451513, propagate_forward_time: 51.2614974976, propagate_backward_time: 80.4524078369, weight_update_time: 0.1523173600, other_time: 3.4420547485
epoch time: 9.8599300385s, input_fired_time: 0.1981949508, output_fired_time: 0.0000000000, propagate_forward_time: 9.0721607208, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5895748138
validation[          , genome  3514] predictions:    9587/  10000 (95.87%), best:    9654/10000 (96.54%), error:      1385.06201, best error:      1172.18335 on epoch:    52, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 130.9584350586s, input_fired_time: 1.5688989162, output_fired_time: 1.3984632492, propagate_forward_time: 49.0490951538, propagate_backward_time: 75.6040191650, weight_update_time: 0.1445845068, other_time: 3.3379669189
epoch time: 9.6777591705s, input_fired_time: 0.1950971037, output_fired_time: 0.0000000000, propagate_forward_time: 8.9026222229, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5800399780
validation[          , genome  3514] predictions:    9604/  10000 (96.04%), best:    9654/10000 (96.54%), error:      1321.01941, best error:      1172.18335 on epoch:    52, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 130.7422790527s, input_fired_time: 2.5757472515, output_fired_time: 1.3953347206, propagate_forward_time: 46.7819480896, propagate_backward_time: 76.6470108032, weight_update_time: 0.1445816010, other_time: 3.3422470093
epoch time: 10.9790658951s, input_fired_time: 0.2058117390, output_fired_time: 0.0000000000, propagate_forward_time: 10.1792058945, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5940485001
validation[          , genome  3514] predictions:    9638/  10000 (96.38%), best:    9654/10000 (96.54%), error:      1261.09998, best error:      1172.18335 on epoch:    52, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 128.6653900146s, input_fired_time: 1.5585893393, output_fired_time: 1.3983436823, propagate_forward_time: 47.3507957458, propagate_backward_time: 75.0233001709, weight_update_time: 0.1435142756, other_time: 3.3343658447
epoch time: 15.8651790619s, input_fired_time: 0.2917940021, output_fired_time: 0.0000000000, propagate_forward_time: 14.7116336823, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8617515564
validation[          , genome  3514] predictions:    9633/  10000 (96.33%), best:    9654/10000 (96.54%), error:      1233.30859, best error:      1172.18335 on epoch:    52, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 139.4663391113s, input_fired_time: 1.6878937483, output_fired_time: 1.4511632919, propagate_forward_time: 52.5860519409, propagate_backward_time: 80.2085266113, weight_update_time: 0.1458063275, other_time: 3.5327072144
epoch time: 9.9439048767s, input_fired_time: 0.1976217031, output_fired_time: 0.0000000000, propagate_forward_time: 9.1658792496, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5804042816
validation[          , genome  3514] predictions:    9656/  10000 (96.56%), best:    9654/10000 (96.54%), error:      1173.47461, best error:      1172.18335 on epoch:    52, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 131.8941497803s, input_fired_time: 1.5758755207, output_fired_time: 1.3991621733, propagate_forward_time: 49.4035263062, propagate_backward_time: 76.1086196899, weight_update_time: 0.1447751224, other_time: 3.4069671631
epoch time: 15.6586532593s, input_fired_time: 0.3244757652, output_fired_time: 0.0000000000, propagate_forward_time: 14.3849334717, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9492435455
validation[          , genome  3514] predictions:    9633/  10000 (96.33%), best:    9654/10000 (96.54%), error:      1254.25256, best error:      1172.18335 on epoch:    52, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 136.8110504150s, input_fired_time: 1.6205768585, output_fired_time: 1.4454016685, propagate_forward_time: 50.5437545776, propagate_backward_time: 77.6899414063, weight_update_time: 0.1486242563, other_time: 5.5113754272
epoch time: 9.8660097122s, input_fired_time: 0.1999440044, output_fired_time: 0.0000000000, propagate_forward_time: 9.0753774643, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5906887054
validation[          , genome  3514] predictions:    9644/  10000 (96.44%), best:    9654/10000 (96.54%), error:      1262.99316, best error:      1172.18335 on epoch:    52, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 136.4908752441s, input_fired_time: 2.6252455711, output_fired_time: 1.5285222530, propagate_forward_time: 50.9613418579, propagate_backward_time: 77.8952636719, weight_update_time: 0.1524007618, other_time: 3.4805068970
epoch time: 9.9488430023s, input_fired_time: 0.1975576878, output_fired_time: 0.0000000000, propagate_forward_time: 9.1657991409, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5854864120
validation[          , genome  3514] predictions:    9654/  10000 (96.54%), best:    9654/10000 (96.54%), error:      1179.15601, best error:      1172.18335 on epoch:    52, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 130.6401214600s, input_fired_time: 1.5713759661, output_fired_time: 1.3998402357, propagate_forward_time: 48.9001121521, propagate_backward_time: 75.4595260620, weight_update_time: 0.1447760761, other_time: 3.3092575073
epoch time: 11.2192268372s, input_fired_time: 0.2019476295, output_fired_time: 0.0000000000, propagate_forward_time: 10.4215021133, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5957775116
validation[          , genome  3514] predictions:    9646/  10000 (96.46%), best:    9654/10000 (96.54%), error:      1200.99646, best error:      1172.18335 on epoch:    52, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 129.2067718506s, input_fired_time: 1.5687735081, output_fired_time: 1.3942300081, propagate_forward_time: 48.7591171265, propagate_backward_time: 74.1473236084, weight_update_time: 0.1441363543, other_time: 3.3373260498
epoch time: 11.1389713287s, input_fired_time: 0.2030027658, output_fired_time: 0.0000000000, propagate_forward_time: 10.3383941650, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5975742340
validation[          , genome  3514] predictions:    9627/  10000 (96.27%), best:    9654/10000 (96.54%), error:      1250.59058, best error:      1172.18335 on epoch:    52, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 131.6222686768s, input_fired_time: 1.6180064678, output_fired_time: 1.4087193012, propagate_forward_time: 48.4806594849, propagate_backward_time: 76.7788925171, weight_update_time: 0.1442254335, other_time: 3.3359832764
epoch time: 13.1527776718s, input_fired_time: 1.2594751120, output_fired_time: 0.0000000000, propagate_forward_time: 11.1614313126, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7318716049
validation[          , genome  3514] predictions:    9645/  10000 (96.45%), best:    9654/10000 (96.54%), error:      1233.09802, best error:      1172.18335 on epoch:    52, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 141.0298004150s, input_fired_time: 1.6756362915, output_fired_time: 1.5523979664, propagate_forward_time: 50.9725723267, propagate_backward_time: 82.3109207153, weight_update_time: 0.1440230310, other_time: 4.5182647705
epoch time: 9.5598220825s, input_fired_time: 0.1940581352, output_fired_time: 0.0000000000, propagate_forward_time: 8.7901954651, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5755681992
validation[          , genome  3514] predictions:    9630/  10000 (96.30%), best:    9654/10000 (96.54%), error:      1250.42712, best error:      1172.18335 on epoch:    52, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 137.0029449463s, input_fired_time: 1.6411288977, output_fired_time: 1.4693586826, propagate_forward_time: 51.2801170349, propagate_backward_time: 79.1659851074, weight_update_time: 0.1516269296, other_time: 3.4463500977
epoch time: 10.9781780243s, input_fired_time: 0.1997974068, output_fired_time: 0.0000000000, propagate_forward_time: 10.1861066818, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5922737122
validation[          , genome  3514] predictions:    9651/  10000 (96.51%), best:    9654/10000 (96.54%), error:      1181.41992, best error:      1172.18335 on epoch:    52, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 143.2305908203s, input_fired_time: 1.7257648706, output_fired_time: 2.5919575691, propagate_forward_time: 53.2860603333, propagate_backward_time: 81.9789047241, weight_update_time: 0.1525289267, other_time: 3.6478958130
epoch time: 11.0368633270s, input_fired_time: 0.2033077031, output_fired_time: 0.0000000000, propagate_forward_time: 10.2300138474, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6035413742
validation[          , genome  3514] predictions:    9656/  10000 (96.56%), best:    9654/10000 (96.54%), error:      1240.53589, best error:      1172.18335 on epoch:    52, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 128.3214874268s, input_fired_time: 1.5645183325, output_fired_time: 1.3759869337, propagate_forward_time: 47.3726654053, propagate_backward_time: 74.6963653564, weight_update_time: 0.1429293305, other_time: 3.3119506836
epoch time: 11.1604232788s, input_fired_time: 0.2045118213, output_fired_time: 0.0000000000, propagate_forward_time: 10.3545904160, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6013212204
validation[          , genome  3514] predictions:    9658/  10000 (96.58%), best:    9654/10000 (96.54%), error:      1184.14746, best error:      1172.18335 on epoch:    52, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 128.6795959473s, input_fired_time: 1.5661019087, output_fired_time: 1.3847972155, propagate_forward_time: 47.4215316772, propagate_backward_time: 74.9841461182, weight_update_time: 0.1432356983, other_time: 3.3230209351
epoch time: 11.0477457047s, input_fired_time: 0.2015777230, output_fired_time: 0.0000000000, propagate_forward_time: 10.2507581711, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5954093933
validation[          , genome  3514] predictions:    9650/  10000 (96.50%), best:    9654/10000 (96.54%), error:      1189.06042, best error:      1172.18335 on epoch:    52, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 129.9661712646s, input_fired_time: 1.5822267532, output_fired_time: 1.3984988928, propagate_forward_time: 47.8731994629, propagate_backward_time: 75.6955413818, weight_update_time: 0.1448734105, other_time: 3.4167022705
epoch time: 11.2206306458s, input_fired_time: 0.2056744993, output_fired_time: 0.0000000000, propagate_forward_time: 10.4065742493, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6083822250
validation[          , genome  3514] predictions:    9601/  10000 (96.01%), best:    9654/10000 (96.54%), error:      1348.96924, best error:      1172.18335 on epoch:    52, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 129.2345275879s, input_fired_time: 1.5838661194, output_fired_time: 1.3930861950, propagate_forward_time: 47.6965446472, propagate_backward_time: 75.2264862061, weight_update_time: 0.1446691006, other_time: 3.3345489502
epoch time: 11.0913295746s, input_fired_time: 0.2080861628, output_fired_time: 0.0000000000, propagate_forward_time: 10.2709827423, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6122608185
validation[          , genome  3514] predictions:    9621/  10000 (96.21%), best:    9654/10000 (96.54%), error:      1334.19751, best error:      1172.18335 on epoch:    52, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 129.2108612061s, input_fired_time: 1.5733557940, output_fired_time: 1.3911945820, propagate_forward_time: 47.5237808228, propagate_backward_time: 75.3769302368, weight_update_time: 0.1443338543, other_time: 3.3455963135
epoch time: 11.0381832123s, input_fired_time: 0.2294456661, output_fired_time: 0.0000000000, propagate_forward_time: 10.2088279724, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5999097824
validation[          , genome  3514] predictions:    9658/  10000 (96.58%), best:    9654/10000 (96.54%), error:      1177.49414, best error:      1172.18335 on epoch:    52, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 141.9375610352s, input_fired_time: 1.7513221502, output_fired_time: 2.4844172001, propagate_forward_time: 52.0532836914, propagate_backward_time: 82.0330276489, weight_update_time: 0.1437156647, other_time: 3.6155014038
epoch time: 9.6997089386s, input_fired_time: 0.1995808333, output_fired_time: 0.0000000000, propagate_forward_time: 8.9105920792, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5895357132
validation[          , genome  3514] predictions:    9605/  10000 (96.05%), best:    9654/10000 (96.54%), error:      1308.16638, best error:      1172.18335 on epoch:    52, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 140.5921325684s, input_fired_time: 1.6578406096, output_fired_time: 2.5461988449, propagate_forward_time: 51.0674362183, propagate_backward_time: 80.7217178345, weight_update_time: 0.1453073621, other_time: 4.5989379883
epoch time: 11.1566305161s, input_fired_time: 0.2038945705, output_fired_time: 0.0000000000, propagate_forward_time: 10.3503379822, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6023979187
validation[          , genome  3514] predictions:    9675/  10000 (96.75%), best:    9675/10000 (96.75%), error:      1144.45801, best error:      1144.45801 on epoch:    76, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 129.0849761963s, input_fired_time: 1.5675696135, output_fired_time: 1.3882855177, propagate_forward_time: 48.6174125671, propagate_backward_time: 74.1935729980, weight_update_time: 0.1433100253, other_time: 3.3181457520
epoch time: 11.1413030624s, input_fired_time: 0.2060082853, output_fired_time: 0.0000000000, propagate_forward_time: 10.3258457184, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6094493866
validation[          , genome  3514] predictions:    9615/  10000 (96.15%), best:    9675/10000 (96.75%), error:      1336.52002, best error:      1144.45801 on epoch:    76, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 138.2764739990s, input_fired_time: 1.6330008507, output_fired_time: 1.4565864801, propagate_forward_time: 51.3901634216, propagate_backward_time: 80.0805892944, weight_update_time: 0.1609974355, other_time: 3.7161331177
epoch time: 9.9469890594s, input_fired_time: 0.2023122609, output_fired_time: 0.0000000000, propagate_forward_time: 9.1559696198, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5887069702
validation[          , genome  3514] predictions:    9652/  10000 (96.52%), best:    9675/10000 (96.75%), error:      1201.64685, best error:      1144.45801 on epoch:    76, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 131.0122070313s, input_fired_time: 1.5972820520, output_fired_time: 1.4012415409, propagate_forward_time: 48.0283164978, propagate_backward_time: 76.6323852539, weight_update_time: 0.1451187581, other_time: 3.3529815674
epoch time: 11.4425668716s, input_fired_time: 0.2111117691, output_fired_time: 0.0000000000, propagate_forward_time: 10.5749959946, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6564588547
validation[          , genome  3514] predictions:    9650/  10000 (96.50%), best:    9675/10000 (96.75%), error:      1203.83130, best error:      1144.45801 on epoch:    76, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 130.3952941895s, input_fired_time: 1.6502325535, output_fired_time: 1.4407173395, propagate_forward_time: 47.3863754272, propagate_backward_time: 75.5422210693, weight_update_time: 0.1443665326, other_time: 4.3757400513
epoch time: 10.8594608307s, input_fired_time: 0.2017658651, output_fired_time: 0.0000000000, propagate_forward_time: 10.0576934814, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6000013351
validation[          , genome  3514] predictions:    9640/  10000 (96.40%), best:    9675/10000 (96.75%), error:      1239.84949, best error:      1144.45801 on epoch:    76, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 133.4555206299s, input_fired_time: 1.6308785677, output_fired_time: 1.4397255182, propagate_forward_time: 49.3955268860, propagate_backward_time: 77.5603408813, weight_update_time: 0.1436720937, other_time: 3.4290542603
epoch time: 12.0646343231s, input_fired_time: 0.2181289494, output_fired_time: 0.0000000000, propagate_forward_time: 11.1729278564, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6735773087
validation[          , genome  3514] predictions:    9632/  10000 (96.32%), best:    9675/10000 (96.75%), error:      1235.03699, best error:      1144.45801 on epoch:    76, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 130.9709472656s, input_fired_time: 1.5949341059, output_fired_time: 1.4164638519, propagate_forward_time: 48.0674476624, propagate_backward_time: 76.5361862183, weight_update_time: 0.1445708722, other_time: 3.3559036255
epoch time: 13.4369029999s, input_fired_time: 0.2665284574, output_fired_time: 0.0000000000, propagate_forward_time: 12.3616523743, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8087224960
validation[          , genome  3514] predictions:    9625/  10000 (96.25%), best:    9675/10000 (96.75%), error:      1259.84326, best error:      1144.45801 on epoch:    76, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 141.7296600342s, input_fired_time: 1.6465841532, output_fired_time: 1.4945354462, propagate_forward_time: 52.9527587891, propagate_backward_time: 82.0372390747, weight_update_time: 0.1603617519, other_time: 3.5985336304
epoch time: 11.0155124664s, input_fired_time: 0.2053773403, output_fired_time: 0.0000000000, propagate_forward_time: 10.2211112976, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5890235901
validation[          , genome  3514] predictions:    9591/  10000 (95.91%), best:    9675/10000 (96.75%), error:      1361.56433, best error:      1144.45801 on epoch:    76, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 129.1572113037s, input_fired_time: 1.5747443438, output_fired_time: 2.4118511677, propagate_forward_time: 47.6524353027, propagate_backward_time: 74.2030334473, weight_update_time: 0.1434190720, other_time: 3.3151473999
epoch time: 11.1252079010s, input_fired_time: 0.2052146345, output_fired_time: 0.0000000000, propagate_forward_time: 10.3181447983, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6018486023
validation[          , genome  3514] predictions:    9652/  10000 (96.52%), best:    9675/10000 (96.75%), error:      1195.75464, best error:      1144.45801 on epoch:    76, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 129.0293426514s, input_fired_time: 1.5778833628, output_fired_time: 1.3955518007, propagate_forward_time: 46.5186996460, propagate_backward_time: 76.2138290405, weight_update_time: 0.1439869255, other_time: 3.3233795166
epoch time: 11.0796155930s, input_fired_time: 0.2039512694, output_fired_time: 0.0000000000, propagate_forward_time: 10.2615003586, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6141643524
validation[          , genome  3514] predictions:    9670/  10000 (96.70%), best:    9675/10000 (96.75%), error:      1146.92517, best error:      1144.45801 on epoch:    76, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 145.0864257813s, input_fired_time: 1.7283692360, output_fired_time: 1.5593782663, propagate_forward_time: 53.7636222839, propagate_backward_time: 84.3119506836, weight_update_time: 0.1613306999, other_time: 3.7231140137
epoch time: 11.1723346710s, input_fired_time: 0.2078100592, output_fired_time: 0.0000000000, propagate_forward_time: 10.3624973297, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6020269394
validation[          , genome  3514] predictions:    9667/  10000 (96.67%), best:    9675/10000 (96.75%), error:      1177.42651, best error:      1144.45801 on epoch:    76, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 138.6609954834s, input_fired_time: 1.6671727896, output_fired_time: 1.5340251923, propagate_forward_time: 52.0757980347, propagate_backward_time: 79.8980789185, weight_update_time: 0.1468573213, other_time: 3.4859161377
epoch time: 9.7884216309s, input_fired_time: 0.1995960027, output_fired_time: 0.0000000000, propagate_forward_time: 8.9905300140, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5982952118
validation[          , genome  3514] predictions:    9646/  10000 (96.46%), best:    9675/10000 (96.75%), error:      1224.33472, best error:      1144.45801 on epoch:    76, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 130.7632598877s, input_fired_time: 1.5877972841, output_fired_time: 1.3997634649, propagate_forward_time: 46.9492073059, propagate_backward_time: 76.4787139893, weight_update_time: 0.1446216553, other_time: 4.3477783203
epoch time: 9.7318372726s, input_fired_time: 0.2012146711, output_fired_time: 0.0000000000, propagate_forward_time: 8.9432783127, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5873441696
validation[          , genome  3514] predictions:    9652/  10000 (96.52%), best:    9675/10000 (96.75%), error:      1192.73706, best error:      1144.45801 on epoch:    76, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 130.1412506104s, input_fired_time: 1.5841844082, output_fired_time: 1.3930041790, propagate_forward_time: 46.6893310547, propagate_backward_time: 77.1301574707, weight_update_time: 0.1440518200, other_time: 3.3445739746
epoch time: 9.9229583740s, input_fired_time: 0.2022627890, output_fired_time: 0.0000000000, propagate_forward_time: 9.1306400299, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5900554657
validation[          , genome  3514] predictions:    9663/  10000 (96.63%), best:    9675/10000 (96.75%), error:      1189.38391, best error:      1144.45801 on epoch:    76, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 136.6019439697s, input_fired_time: 1.6308475733, output_fired_time: 1.4277577400, propagate_forward_time: 49.1084022522, propagate_backward_time: 80.9699249268, weight_update_time: 0.1439927965, other_time: 3.4650115967
epoch time: 11.1352930069s, input_fired_time: 0.2066899389, output_fired_time: 0.0000000000, propagate_forward_time: 10.3231153488, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6054878235
validation[          , genome  3514] predictions:    9650/  10000 (96.50%), best:    9675/10000 (96.75%), error:      1201.75146, best error:      1144.45801 on epoch:    76, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 129.2808227539s, input_fired_time: 1.5839320421, output_fired_time: 3.4068417549, propagate_forward_time: 46.7036895752, propagate_backward_time: 74.2453689575, weight_update_time: 0.1441892087, other_time: 3.3409881592
epoch time: 10.9851989746s, input_fired_time: 0.2051935494, output_fired_time: 0.0000000000, propagate_forward_time: 9.1735830307, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6064224243
validation[          , genome  3514] predictions:    9666/  10000 (96.66%), best:    9675/10000 (96.75%), error:      1166.09424, best error:      1144.45801 on epoch:    76, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 132.5999145508s, input_fired_time: 1.6121616364, output_fired_time: 1.4271417856, propagate_forward_time: 51.9793357849, propagate_backward_time: 74.1812973022, weight_update_time: 0.1530340910, other_time: 3.3999710083
epoch time: 11.0635652542s, input_fired_time: 0.2040036619, output_fired_time: 0.0000000000, propagate_forward_time: 10.2497396469, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6098222733
validation[          , genome  3514] predictions:    9673/  10000 (96.73%), best:    9675/10000 (96.75%), error:      1164.78381, best error:      1144.45801 on epoch:    76, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 129.2002258301s, input_fired_time: 1.6066982746, output_fired_time: 1.3899469376, propagate_forward_time: 48.7015495300, propagate_backward_time: 74.1707077026, weight_update_time: 0.1438745409, other_time: 3.3313217163
epoch time: 11.1189270020s, input_fired_time: 0.2069176733, output_fired_time: 0.0000000000, propagate_forward_time: 10.3145790100, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5974302292
validation[          , genome  3514] predictions:    9592/  10000 (95.92%), best:    9675/10000 (96.75%), error:      1359.19202, best error:      1144.45801 on epoch:    76, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 130.1208496094s, input_fired_time: 1.5900589228, output_fired_time: 1.3859734535, propagate_forward_time: 49.5682868958, propagate_backward_time: 74.2427597046, weight_update_time: 0.1439746767, other_time: 3.3337783813
epoch time: 9.8490352631s, input_fired_time: 0.2024422288, output_fired_time: 0.0000000000, propagate_forward_time: 9.0475912094, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5990018845
validation[          , genome  3514] predictions:    9672/  10000 (96.72%), best:    9675/10000 (96.75%), error:      1156.59009, best error:      1144.45801 on epoch:    76, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 131.4131469727s, input_fired_time: 1.5986620188, output_fired_time: 1.4032901525, propagate_forward_time: 49.9673461914, propagate_backward_time: 75.0570831299, weight_update_time: 0.1457711309, other_time: 3.3867645264
epoch time: 9.7844657898s, input_fired_time: 0.1993062496, output_fired_time: 0.0000000000, propagate_forward_time: 8.9955720901, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5895872116
validation[          , genome  3514] predictions:    9615/  10000 (96.15%), best:    9675/10000 (96.75%), error:      1236.79907, best error:      1144.45801 on epoch:    76, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 130.3942718506s, input_fired_time: 1.5894533396, output_fired_time: 1.3926472664, propagate_forward_time: 50.6786270142, propagate_backward_time: 73.3803634644, weight_update_time: 0.1447955966, other_time: 3.3531875610
epoch time: 9.9122543335s, input_fired_time: 0.2026953250, output_fired_time: 0.0000000000, propagate_forward_time: 9.1286544800, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5809049606
validation[          , genome  3514] predictions:    9655/  10000 (96.55%), best:    9675/10000 (96.75%), error:      1161.63245, best error:      1144.45801 on epoch:    76, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 129.5236358643s, input_fired_time: 1.5803030729, output_fired_time: 1.3834375143, propagate_forward_time: 50.2812767029, propagate_backward_time: 72.9591751099, weight_update_time: 0.1425300241, other_time: 3.3194503784
epoch time: 9.7771434784s, input_fired_time: 0.1979838163, output_fired_time: 0.0000000000, propagate_forward_time: 8.9986400604, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5805196762
validation[          , genome  3514] predictions:    9620/  10000 (96.20%), best:    9675/10000 (96.75%), error:      1283.00427, best error:      1144.45801 on epoch:    76, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 130.9604644775s, input_fired_time: 1.5881330967, output_fired_time: 1.3995684385, propagate_forward_time: 47.9526710510, propagate_backward_time: 75.6532974243, weight_update_time: 0.1454686821, other_time: 4.3667984009
epoch time: 9.7864599228s, input_fired_time: 0.2005641162, output_fired_time: 0.0000000000, propagate_forward_time: 9.0111541748, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5747413635
validation[          , genome  3514] predictions:    9660/  10000 (96.60%), best:    9675/10000 (96.75%), error:      1174.47070, best error:      1144.45801 on epoch:    76, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 130.5411682129s, input_fired_time: 1.6049112082, output_fired_time: 2.3989131451, propagate_forward_time: 48.7050323486, propagate_backward_time: 74.4852981567, weight_update_time: 0.1449896544, other_time: 3.3470230103
epoch time: 9.6360206604s, input_fired_time: 0.1995402873, output_fired_time: 0.0000000000, propagate_forward_time: 8.8591337204, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5773468018
validation[          , genome  3514] predictions:    9615/  10000 (96.15%), best:    9675/10000 (96.75%), error:      1316.86243, best error:      1144.45801 on epoch:    76, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 147.5576782227s, input_fired_time: 1.7367124557, output_fired_time: 1.5920600891, propagate_forward_time: 55.9805946350, propagate_backward_time: 84.4984970093, weight_update_time: 0.1513350606, other_time: 3.7498245239
epoch time: 9.9085464478s, input_fired_time: 0.2044698596, output_fired_time: 0.0000000000, propagate_forward_time: 9.1170215607, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5870552063
validation[          , genome  3514] predictions:    9657/  10000 (96.57%), best:    9675/10000 (96.75%), error:      1147.34460, best error:      1144.45801 on epoch:    76, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 52.8622627258s, input_fired_time: 1.0100015402, output_fired_time: 0.0000000000, propagate_forward_time: 48.7597312927, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0925292969
best training[          , genome  3514] predictions:   49124/  50000 (98.25%), best:    9675/10000 (96.75%), error:      3274.41968, best error:      1144.45801 on epoch:    76, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 9.8425121307s, input_fired_time: 0.1987735480, output_fired_time: 0.0000000000, propagate_forward_time: 9.0591974258, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5845413208
   testing[          , genome  3514] predictions:    9679/  10000 (96.79%), best:    9675/10000 (96.75%), error:      1082.95776, best error:      1144.45801 on epoch:    76, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
10:46:28 (11952): called boinc_finish(0)

</stderr_txt>
]]>