Nameexact_genome_1512568488_44_6196_1
Workunit2602284
Created7 Dec 2017, 18:31:07 UTC
Sent7 Dec 2017, 18:39:18 UTC
Report deadline13 Dec 2017, 23:23:57 UTC
Received8 Dec 2017, 11:28:29 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID55108
Run time3 hours 31 min 50 sec
CPU time3 hours 23 min 41 sec
Validate stateValid
Credit1,549.42
Device peak FLOPS2.57 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size154.29 MB
Peak swap size157.59 MB
Peak disk usage1.73 MB

Stderr output

<core_client_version>7.8.2</core_client_version>
<![CDATA[
<stderr_txt>
, weight_update_time: 0.0000000000, other_time: 0.5586557388
validation[          , genome  6196] predictions:    9655/  10000 (96.55%), best:    9655/10000 (96.55%), error:      1195.05420, best error:      1195.05420 on epoch:    14, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 117.0322113037s, input_fired_time: 1.0994112492, output_fired_time: 0.9808037281, propagate_forward_time: 42.7330780029, propagate_backward_time: 69.1616592407, weight_update_time: 0.1416746974, other_time: 3.0572586060
epoch time: 9.0076045990s, input_fired_time: 0.1391862631, output_fired_time: 0.0000000000, propagate_forward_time: 8.3365411758, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5318775177
validation[          , genome  6196] predictions:    9642/  10000 (96.42%), best:    9642/10000 (96.42%), error:      1180.55872, best error:      1180.55872 on epoch:    15, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 118.5152435303s, input_fired_time: 2.1143825054, output_fired_time: 0.9866130948, propagate_forward_time: 45.3740310669, propagate_backward_time: 66.9839782715, weight_update_time: 0.1422568560, other_time: 3.0562438965
epoch time: 8.9857530594s, input_fired_time: 0.1395893991, output_fired_time: 0.0000000000, propagate_forward_time: 8.3014745712, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5446891785
validation[          , genome  6196] predictions:    9666/  10000 (96.66%), best:    9666/10000 (96.66%), error:      1153.15576, best error:      1153.15576 on epoch:    16, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 132.7083282471s, input_fired_time: 1.1848323345, output_fired_time: 1.0540584326, propagate_forward_time: 48.9140968323, propagate_backward_time: 78.1227493286, weight_update_time: 0.1909390241, other_time: 3.4325942993
epoch time: 10.2444305420s, input_fired_time: 0.1430123001, output_fired_time: 0.0000000000, propagate_forward_time: 9.5479993820, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5534191132
validation[          , genome  6196] predictions:    9616/  10000 (96.16%), best:    9666/10000 (96.66%), error:      1279.85486, best error:      1153.15576 on epoch:    16, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 115.6797180176s, input_fired_time: 1.0880283117, output_fired_time: 0.9643635154, propagate_forward_time: 43.4764823914, propagate_backward_time: 67.1507949829, weight_update_time: 0.1400889009, other_time: 3.0000534058
epoch time: 10.1287994385s, input_fired_time: 0.1410007775, output_fired_time: 0.0000000000, propagate_forward_time: 9.4386529922, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5491456985
validation[          , genome  6196] predictions:    9665/  10000 (96.65%), best:    9666/10000 (96.66%), error:      1169.20129, best error:      1153.15576 on epoch:    16, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 121.5603942871s, input_fired_time: 1.1278697252, output_fired_time: 2.0397081375, propagate_forward_time: 46.4949035645, propagate_backward_time: 67.7753601074, weight_update_time: 0.1502838284, other_time: 4.1225509644
epoch time: 8.9230680466s, input_fired_time: 0.1372109354, output_fired_time: 0.0000000000, propagate_forward_time: 8.2587947845, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5270624161
validation[          , genome  6196] predictions:    9634/  10000 (96.34%), best:    9666/10000 (96.66%), error:      1242.88464, best error:      1153.15576 on epoch:    16, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 124.1463165283s, input_fired_time: 1.1624132395, output_fired_time: 0.9995888472, propagate_forward_time: 47.1040077209, propagate_backward_time: 71.6857452393, weight_update_time: 0.1431459039, other_time: 3.1945648193
epoch time: 8.9587411880s, input_fired_time: 0.1391662657, output_fired_time: 0.0000000000, propagate_forward_time: 8.2824773788, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5370979309
validation[          , genome  6196] predictions:    9567/  10000 (95.67%), best:    9666/10000 (96.66%), error:      1435.24902, best error:      1153.15576 on epoch:    16, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 117.4646453857s, input_fired_time: 1.1021095514, output_fired_time: 0.9673762321, propagate_forward_time: 41.8720626831, propagate_backward_time: 70.4853744507, weight_update_time: 0.1411504447, other_time: 3.0377197266
epoch time: 10.1166505814s, input_fired_time: 0.1415417343, output_fired_time: 0.0000000000, propagate_forward_time: 9.4297351837, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5453739166
validation[          , genome  6196] predictions:    9682/  10000 (96.82%), best:    9682/10000 (96.82%), error:      1128.90930, best error:      1128.90930 on epoch:    21, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 116.2397155762s, input_fired_time: 1.1013877392, output_fired_time: 0.9698427320, propagate_forward_time: 43.9048080444, propagate_backward_time: 67.2132034302, weight_update_time: 0.1412804872, other_time: 3.0504760742
epoch time: 10.0986099243s, input_fired_time: 0.1398503929, output_fired_time: 0.0000000000, propagate_forward_time: 9.4248161316, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5339431763
validation[          , genome  6196] predictions:    9578/  10000 (95.78%), best:    9682/10000 (96.82%), error:      1356.90405, best error:      1128.90930 on epoch:    21, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 117.5808486938s, input_fired_time: 1.1014027596, output_fired_time: 0.9971346855, propagate_forward_time: 45.9446372986, propagate_backward_time: 66.4885025024, weight_update_time: 0.1410741359, other_time: 3.0491714478
epoch time: 8.8650817871s, input_fired_time: 0.1384781301, output_fired_time: 0.0000000000, propagate_forward_time: 8.1906843185, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5359191895
validation[          , genome  6196] predictions:    9674/  10000 (96.74%), best:    9674/10000 (96.74%), error:      1093.09167, best error:      1093.09167 on epoch:    23, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 117.1286926270s, input_fired_time: 1.0973833799, output_fired_time: 0.9714511037, propagate_forward_time: 43.7327003479, propagate_backward_time: 68.3032455444, weight_update_time: 0.1424938291, other_time: 3.0239181519
epoch time: 9.9373111725s, input_fired_time: 0.1403571814, output_fired_time: 0.0000000000, propagate_forward_time: 9.2567768097, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5401773453
validation[          , genome  6196] predictions:    9683/  10000 (96.83%), best:    9683/10000 (96.83%), error:      1092.72363, best error:      1092.72363 on epoch:    24, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 117.3665618896s, input_fired_time: 1.1035850048, output_fired_time: 0.9726594090, propagate_forward_time: 42.9455375671, propagate_backward_time: 68.2977600098, weight_update_time: 1.1498675346, other_time: 4.0470275879
epoch time: 8.9721727371s, input_fired_time: 0.1384786218, output_fired_time: 0.0000000000, propagate_forward_time: 8.3006610870, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5330333710
validation[          , genome  6196] predictions:    9652/  10000 (96.52%), best:    9683/10000 (96.83%), error:      1104.99902, best error:      1092.72363 on epoch:    24, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 125.5425338745s, input_fired_time: 1.2055598497, output_fired_time: 1.0568869114, propagate_forward_time: 47.9401321411, propagate_backward_time: 72.1689605713, weight_update_time: 0.1432689577, other_time: 3.1709976196
epoch time: 10.0629930496s, input_fired_time: 0.1419243813, output_fired_time: 0.0000000000, propagate_forward_time: 8.4622726440, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4587955475
validation[          , genome  6196] predictions:    9659/  10000 (96.59%), best:    9683/10000 (96.83%), error:      1153.35291, best error:      1092.72363 on epoch:    24, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 117.7423019409s, input_fired_time: 1.1029976606, output_fired_time: 0.9763601422, propagate_forward_time: 43.0504760742, propagate_backward_time: 68.5504608154, weight_update_time: 0.1413624883, other_time: 4.0620117188
epoch time: 8.9122724533s, input_fired_time: 0.1412144005, output_fired_time: 0.0000000000, propagate_forward_time: 8.2271900177, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5438680649
validation[          , genome  6196] predictions:    9671/  10000 (96.71%), best:    9671/10000 (96.71%), error:      1085.49597, best error:      1085.49597 on epoch:    27, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 116.4237976074s, input_fired_time: 1.1063747406, output_fired_time: 0.9736829996, propagate_forward_time: 42.7588500977, propagate_backward_time: 68.5354232788, weight_update_time: 0.1432854980, other_time: 3.0494613647
epoch time: 8.8441429138s, input_fired_time: 0.1371679455, output_fired_time: 0.0000000000, propagate_forward_time: 8.1814527512, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5255222321
validation[          , genome  6196] predictions:    9576/  10000 (95.76%), best:    9671/10000 (96.71%), error:      1336.21375, best error:      1085.49597 on epoch:    27, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 117.0549621582s, input_fired_time: 1.1044733524, output_fired_time: 0.9704459310, propagate_forward_time: 45.6870269775, propagate_backward_time: 66.2585754395, weight_update_time: 0.1412653476, other_time: 3.0344390869
epoch time: 10.1989860535s, input_fired_time: 0.1419635266, output_fired_time: 0.0000000000, propagate_forward_time: 9.5136566162, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5433654785
validation[          , genome  6196] predictions:    9676/  10000 (96.76%), best:    9671/10000 (96.71%), error:      1110.27710, best error:      1085.49597 on epoch:    27, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 117.4978103638s, input_fired_time: 1.1054624319, output_fired_time: 0.9667955637, propagate_forward_time: 44.0241203308, propagate_backward_time: 68.3731842041, weight_update_time: 0.1415634006, other_time: 3.0282440186
epoch time: 8.8599195480s, input_fired_time: 0.1404274851, output_fired_time: 0.0000000000, propagate_forward_time: 8.1851425171, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5343494415
validation[          , genome  6196] predictions:    9621/  10000 (96.21%), best:    9671/10000 (96.71%), error:      1247.65991, best error:      1085.49597 on epoch:    27, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 122.9188079834s, input_fired_time: 1.1391659975, output_fired_time: 1.0066971779, propagate_forward_time: 45.8902130127, propagate_backward_time: 71.6885528564, weight_update_time: 0.1508163065, other_time: 3.1941757202
epoch time: 16.6587524414s, input_fired_time: 0.2007498741, output_fired_time: 0.0000000000, propagate_forward_time: 14.4496393204, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0083627701
validation[          , genome  6196] predictions:    9550/  10000 (95.50%), best:    9671/10000 (96.71%), error:      1509.06165, best error:      1085.49597 on epoch:    27, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 125.9589233398s, input_fired_time: 1.2090387344, output_fired_time: 1.0691813231, propagate_forward_time: 47.8039512634, propagate_backward_time: 72.6380691528, weight_update_time: 0.1501126289, other_time: 3.2386856079
epoch time: 9.1677913666s, input_fired_time: 0.1424331665, output_fired_time: 0.0000000000, propagate_forward_time: 8.4795103073, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5458478928
validation[          , genome  6196] predictions:    9674/  10000 (96.74%), best:    9671/10000 (96.71%), error:      1119.61914, best error:      1085.49597 on epoch:    27, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 126.6849517822s, input_fired_time: 1.2169495821, output_fired_time: 1.0247395039, propagate_forward_time: 48.4521675110, propagate_backward_time: 71.6710433960, weight_update_time: 0.1579855233, other_time: 4.3200454712
epoch time: 12.3792076111s, input_fired_time: 0.1870516539, output_fired_time: 0.0000000000, propagate_forward_time: 11.5308303833, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6613254547
validation[          , genome  6196] predictions:    9658/  10000 (96.58%), best:    9671/10000 (96.71%), error:      1173.30481, best error:      1085.49597 on epoch:    27, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 117.5875549316s, input_fired_time: 1.1041964293, output_fired_time: 0.9971583486, propagate_forward_time: 43.9287605286, propagate_backward_time: 68.5196838379, weight_update_time: 0.1424400359, other_time: 3.0377502441
epoch time: 9.0286302567s, input_fired_time: 0.1392541528, output_fired_time: 0.0000000000, propagate_forward_time: 8.3523979187, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5369777679
validation[          , genome  6196] predictions:    9616/  10000 (96.16%), best:    9671/10000 (96.71%), error:      1281.32886, best error:      1085.49597 on epoch:    27, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 123.5060653687s, input_fired_time: 1.1522467136, output_fired_time: 1.0261858702, propagate_forward_time: 46.2276496887, propagate_backward_time: 71.9905776978, weight_update_time: 0.1406700462, other_time: 3.1094131470
epoch time: 9.2032604218s, input_fired_time: 0.1424487531, output_fired_time: 0.0000000000, propagate_forward_time: 8.5121736526, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5486383438
validation[          , genome  6196] predictions:    9626/  10000 (96.26%), best:    9671/10000 (96.71%), error:      1257.66650, best error:      1085.49597 on epoch:    27, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 117.4830017090s, input_fired_time: 1.1052479744, output_fired_time: 1.9778255224, propagate_forward_time: 44.9203491211, propagate_backward_time: 66.3717803955, weight_update_time: 0.1414670199, other_time: 3.1077957153
epoch time: 14.9316349030s, input_fired_time: 0.1766292006, output_fired_time: 0.0000000000, propagate_forward_time: 13.9329395294, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8220663071
validation[          , genome  6196] predictions:    9661/  10000 (96.61%), best:    9671/10000 (96.71%), error:      1138.15771, best error:      1085.49597 on epoch:    27, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 121.8942413330s, input_fired_time: 1.1458327770, output_fired_time: 0.9922727942, propagate_forward_time: 46.5621719360, propagate_backward_time: 70.0372009277, weight_update_time: 0.1499685496, other_time: 3.1567611694
epoch time: 8.8655052185s, input_fired_time: 0.1391046792, output_fired_time: 0.0000000000, propagate_forward_time: 8.1934747696, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5329256058
validation[          , genome  6196] predictions:    9690/  10000 (96.90%), best:    9690/10000 (96.90%), error:      1064.17969, best error:      1064.17969 on epoch:    37, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 130.7776184082s, input_fired_time: 1.1819968224, output_fired_time: 2.0382788181, propagate_forward_time: 47.4310531616, propagate_backward_time: 75.7926712036, weight_update_time: 0.1488188505, other_time: 4.3336257935
epoch time: 8.9751701355s, input_fired_time: 0.1398982555, output_fired_time: 0.0000000000, propagate_forward_time: 8.2920751572, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5431966782
validation[          , genome  6196] predictions:    9687/  10000 (96.87%), best:    9687/10000 (96.87%), error:      1031.58105, best error:      1031.58105 on epoch:    38, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 132.9327392578s, input_fired_time: 1.2430099249, output_fired_time: 1.1102486849, propagate_forward_time: 51.5853004456, propagate_backward_time: 75.6973876953, weight_update_time: 0.1472116560, other_time: 3.2967987061
epoch time: 8.9390211105s, input_fired_time: 0.1374782473, output_fired_time: 0.0000000000, propagate_forward_time: 8.2761373520, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5254058838
validation[          , genome  6196] predictions:    9635/  10000 (96.35%), best:    9687/10000 (96.87%), error:      1173.97974, best error:      1031.58105 on epoch:    38, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 126.3928909302s, input_fired_time: 1.3055628538, output_fired_time: 1.0655976534, propagate_forward_time: 49.9176101685, propagate_backward_time: 70.8994979858, weight_update_time: 0.1497030109, other_time: 3.2046203613
epoch time: 10.2892818451s, input_fired_time: 0.1617869586, output_fired_time: 0.0000000000, propagate_forward_time: 9.5212802887, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6062145233
validation[          , genome  6196] predictions:    9602/  10000 (96.02%), best:    9687/10000 (96.87%), error:      1301.77039, best error:      1031.58105 on epoch:    38, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 116.9641342163s, input_fired_time: 1.1060082912, output_fired_time: 0.9928234816, propagate_forward_time: 44.7938156128, propagate_backward_time: 67.0314788818, weight_update_time: 0.1410463899, other_time: 3.0400085449
epoch time: 10.2054367065s, input_fired_time: 0.1439539492, output_fired_time: 0.0000000000, propagate_forward_time: 9.5157566071, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5457258224
validation[          , genome  6196] predictions:    9675/  10000 (96.75%), best:    9687/10000 (96.87%), error:      1074.24951, best error:      1031.58105 on epoch:    38, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 126.3755187988s, input_fired_time: 1.2093725204, output_fired_time: 1.0342804193, propagate_forward_time: 48.9839057922, propagate_backward_time: 71.7842559814, weight_update_time: 0.1533210129, other_time: 3.3637084961
epoch time: 8.9129714966s, input_fired_time: 0.1417035609, output_fired_time: 0.0000000000, propagate_forward_time: 8.2475662231, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5237016678
validation[          , genome  6196] predictions:    9656/  10000 (96.56%), best:    9687/10000 (96.87%), error:      1118.60022, best error:      1031.58105 on epoch:    38, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 117.8280944824s, input_fired_time: 1.1085470915, output_fired_time: 0.9740936160, propagate_forward_time: 44.1092491150, propagate_backward_time: 68.5976562500, weight_update_time: 0.1417315453, other_time: 3.0385589600
epoch time: 10.3281936646s, input_fired_time: 0.1442696005, output_fired_time: 0.0000000000, propagate_forward_time: 8.6249618530, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5589618683
validation[          , genome  6196] predictions:    9678/  10000 (96.78%), best:    9687/10000 (96.87%), error:      1071.23438, best error:      1031.58105 on epoch:    38, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 117.9213714600s, input_fired_time: 1.1110744476, output_fired_time: 0.9755579233, propagate_forward_time: 44.1062164307, propagate_backward_time: 68.6753158569, weight_update_time: 0.1425744444, other_time: 3.0532073975
epoch time: 8.8980941772s, input_fired_time: 0.1396284997, output_fired_time: 0.0000000000, propagate_forward_time: 8.2268476486, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5316181183
validation[          , genome  6196] predictions:    9672/  10000 (96.72%), best:    9687/10000 (96.87%), error:      1127.77356, best error:      1031.58105 on epoch:    38, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 117.0417938232s, input_fired_time: 1.1083271503, output_fired_time: 0.9674788117, propagate_forward_time: 46.6979103088, propagate_backward_time: 65.2348785400, weight_update_time: 0.1408019960, other_time: 3.0332031250
epoch time: 10.2497301102s, input_fired_time: 1.1537667513, output_fired_time: 0.0000000000, propagate_forward_time: 8.5493650436, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5465984344
validation[          , genome  6196] predictions:    9711/  10000 (97.11%), best:    9711/10000 (97.11%), error:      1027.72864, best error:      1027.72864 on epoch:    45, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 118.8336334229s, input_fired_time: 1.1687865257, output_fired_time: 0.9824445844, propagate_forward_time: 46.5031852722, propagate_backward_time: 67.1120758057, weight_update_time: 0.1419215351, other_time: 3.0671386719
epoch time: 8.8393850327s, input_fired_time: 0.1383129358, output_fired_time: 0.0000000000, propagate_forward_time: 8.1735677719, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5275039673
validation[          , genome  6196] predictions:    9682/  10000 (96.82%), best:    9711/10000 (97.11%), error:      1045.05676, best error:      1027.72864 on epoch:    45, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 117.2291412354s, input_fired_time: 1.1047773361, output_fired_time: 1.9783161879, propagate_forward_time: 42.9169044495, propagate_backward_time: 68.1985321045, weight_update_time: 0.1480767131, other_time: 3.0306091309
epoch time: 8.7271537781s, input_fired_time: 0.1374328583, output_fired_time: 0.0000000000, propagate_forward_time: 8.0727920532, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5169286728
validation[          , genome  6196] predictions:    9709/  10000 (97.09%), best:    9709/10000 (97.09%), error:      1011.73840, best error:      1011.73840 on epoch:    47, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 117.4792175293s, input_fired_time: 1.1434652805, output_fired_time: 0.9735903144, propagate_forward_time: 42.9538230896, propagate_backward_time: 69.3709487915, weight_update_time: 0.1413526535, other_time: 3.0373916626
epoch time: 10.0514383316s, input_fired_time: 0.1422645599, output_fired_time: 0.0000000000, propagate_forward_time: 9.3634252548, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5457487106
validation[          , genome  6196] predictions:    9668/  10000 (96.68%), best:    9709/10000 (97.09%), error:      1114.38745, best error:      1011.73840 on epoch:    47, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 117.6582489014s, input_fired_time: 1.1090081930, output_fired_time: 0.9839729071, propagate_forward_time: 42.0316772461, propagate_backward_time: 69.5004119873, weight_update_time: 0.1411799192, other_time: 4.0331802368
epoch time: 9.0142860413s, input_fired_time: 0.1441489011, output_fired_time: 0.0000000000, propagate_forward_time: 8.3252592087, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5448780060
validation[          , genome  6196] predictions:    9677/  10000 (96.77%), best:    9709/10000 (97.09%), error:      1095.03357, best error:      1011.73840 on epoch:    47, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 117.8001632690s, input_fired_time: 1.1132690907, output_fired_time: 0.9955144525, propagate_forward_time: 46.0175285339, propagate_backward_time: 66.6399230957, weight_update_time: 0.1411586404, other_time: 3.0339355469
epoch time: 8.8959445953s, input_fired_time: 0.1388734579, output_fired_time: 0.0000000000, propagate_forward_time: 8.2278099060, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5292615891
validation[          , genome  6196] predictions:    9673/  10000 (96.73%), best:    9709/10000 (97.09%), error:      1168.53918, best error:      1011.73840 on epoch:    47, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 118.5994338989s, input_fired_time: 1.1113765240, output_fired_time: 0.9763311148, propagate_forward_time: 43.3078689575, propagate_backward_time: 70.1199569702, weight_update_time: 0.1442649364, other_time: 3.0839004517
epoch time: 10.3311586380s, input_fired_time: 0.1458236873, output_fired_time: 0.0000000000, propagate_forward_time: 9.6268892288, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5584459305
validation[          , genome  6196] predictions:    9668/  10000 (96.68%), best:    9709/10000 (97.09%), error:      1106.10974, best error:      1011.73840 on epoch:    47, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 116.8037185669s, input_fired_time: 1.1027114391, output_fired_time: 0.9628260136, propagate_forward_time: 43.6657829285, propagate_backward_time: 68.0373611450, weight_update_time: 0.1401890814, other_time: 3.0350265503
epoch time: 8.8523979187s, input_fired_time: 0.1379689127, output_fired_time: 0.0000000000, propagate_forward_time: 8.1854152679, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5290136337
validation[          , genome  6196] predictions:    9686/  10000 (96.86%), best:    9709/10000 (97.09%), error:      1057.15198, best error:      1011.73840 on epoch:    47, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 126.3445892334s, input_fired_time: 1.3269764185, output_fired_time: 1.0570769310, propagate_forward_time: 45.4899330139, propagate_backward_time: 74.0770874023, weight_update_time: 0.1402917802, other_time: 4.3935241699
epoch time: 8.3822908401s, input_fired_time: 0.1333521754, output_fired_time: 0.0000000000, propagate_forward_time: 7.7409162521, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5080223083
validation[          , genome  6196] predictions:    9709/  10000 (97.09%), best:    9709/10000 (97.09%), error:      1050.90112, best error:      1011.73840 on epoch:    47, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 121.0046386719s, input_fired_time: 1.1345913410, output_fired_time: 1.0055713654, propagate_forward_time: 48.2227973938, propagate_backward_time: 67.4759750366, weight_update_time: 0.1436618567, other_time: 3.1657028198
epoch time: 10.2900037766s, input_fired_time: 0.1429380178, output_fired_time: 0.0000000000, propagate_forward_time: 9.5951795578, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5518865585
validation[          , genome  6196] predictions:    9689/  10000 (96.89%), best:    9709/10000 (97.09%), error:      1048.88892, best error:      1011.73840 on epoch:    47, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 120.7535400391s, input_fired_time: 1.1487804651, output_fired_time: 0.9845948219, propagate_forward_time: 46.1228103638, propagate_backward_time: 69.3735656738, weight_update_time: 0.1420789212, other_time: 3.1237869263
epoch time: 8.7350511551s, input_fired_time: 0.1388662010, output_fired_time: 0.0000000000, propagate_forward_time: 8.0649223328, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5312623978
validation[          , genome  6196] predictions:    9598/  10000 (95.98%), best:    9709/10000 (97.09%), error:      1343.93823, best error:      1011.73840 on epoch:    47, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 117.4415740967s, input_fired_time: 1.1088640690, output_fired_time: 0.9729077220, propagate_forward_time: 44.9041595459, propagate_backward_time: 67.4275665283, weight_update_time: 0.1406539232, other_time: 3.0280761719
epoch time: 8.9596586227s, input_fired_time: 0.1396407485, output_fired_time: 0.0000000000, propagate_forward_time: 8.2896213531, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5303964615
validation[          , genome  6196] predictions:    9707/  10000 (97.07%), best:    9707/10000 (97.07%), error:       978.19745, best error:       978.19745 on epoch:    56, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 124.6104965210s, input_fired_time: 2.1141817570, output_fired_time: 1.0514738560, propagate_forward_time: 47.1897621155, propagate_backward_time: 70.0710449219, weight_update_time: 0.1422207952, other_time: 4.1840362549
epoch time: 10.7949819565s, input_fired_time: 0.1637799144, output_fired_time: 0.0000000000, propagate_forward_time: 10.0437040329, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5874977112
validation[          , genome  6196] predictions:    9678/  10000 (96.78%), best:    9707/10000 (97.07%), error:      1059.89282, best error:       978.19745 on epoch:    56, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 127.1695556641s, input_fired_time: 2.2841320038, output_fired_time: 1.0631957054, propagate_forward_time: 48.1199035645, propagate_backward_time: 72.5238418579, weight_update_time: 0.1407470852, other_time: 3.1784820557
epoch time: 9.0659341812s, input_fired_time: 0.1408326626, output_fired_time: 0.0000000000, propagate_forward_time: 8.3991031647, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5259981155
validation[          , genome  6196] predictions:    9689/  10000 (96.89%), best:    9707/10000 (97.07%), error:      1126.79639, best error:       978.19745 on epoch:    56, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 119.6164169312s, input_fired_time: 1.1239731312, output_fired_time: 1.9899840355, propagate_forward_time: 44.6537361145, propagate_backward_time: 68.7279739380, weight_update_time: 0.1425808370, other_time: 3.1207504272
epoch time: 9.5362462997s, input_fired_time: 0.1372578442, output_fired_time: 0.0000000000, propagate_forward_time: 8.8769569397, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5220317841
validation[          , genome  6196] predictions:    9667/  10000 (96.67%), best:    9707/10000 (97.07%), error:      1157.65869, best error:       978.19745 on epoch:    56, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 116.1818084717s, input_fired_time: 1.1126211882, output_fired_time: 0.9698364735, propagate_forward_time: 43.7612037659, propagate_backward_time: 67.3271636963, weight_update_time: 0.1401965171, other_time: 3.0109863281
epoch time: 10.1750211716s, input_fired_time: 0.1441122890, output_fired_time: 0.0000000000, propagate_forward_time: 9.4807395935, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5501689911
validation[          , genome  6196] predictions:    9691/  10000 (96.91%), best:    9707/10000 (97.07%), error:      1091.18909, best error:       978.19745 on epoch:    56, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 117.8885421753s, input_fired_time: 2.1234533787, output_fired_time: 0.9721931815, propagate_forward_time: 45.0408210754, propagate_backward_time: 66.7137069702, weight_update_time: 0.1413389742, other_time: 3.0383682251
epoch time: 8.9133796692s, input_fired_time: 0.1405916810, output_fired_time: 0.0000000000, propagate_forward_time: 8.2336997986, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5390882492
validation[          , genome  6196] predictions:    9684/  10000 (96.84%), best:    9707/10000 (97.07%), error:      1100.15564, best error:       978.19745 on epoch:    56, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 129.9603881836s, input_fired_time: 1.2356019020, output_fired_time: 1.0336990356, propagate_forward_time: 49.4479942322, propagate_backward_time: 73.8896713257, weight_update_time: 0.1629481465, other_time: 4.3534317017
epoch time: 8.7685976028s, input_fired_time: 0.1390322745, output_fired_time: 0.0000000000, propagate_forward_time: 8.1080226898, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5215425491
validation[          , genome  6196] predictions:    9706/  10000 (97.06%), best:    9707/10000 (97.07%), error:      1007.19470, best error:       978.19745 on epoch:    56, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 117.3215332031s, input_fired_time: 1.1140594482, output_fired_time: 0.9720320702, propagate_forward_time: 44.8369636536, propagate_backward_time: 66.3529663086, weight_update_time: 0.1411446184, other_time: 4.0455169678
epoch time: 10.0961694717s, input_fired_time: 0.1492988318, output_fired_time: 0.0000000000, propagate_forward_time: 9.4125785828, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5342922211
validation[          , genome  6196] predictions:    9693/  10000 (96.93%), best:    9707/10000 (97.07%), error:      1025.69128, best error:       978.19745 on epoch:    56, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 125.5722656250s, input_fired_time: 1.2079437971, output_fired_time: 0.9890195131, propagate_forward_time: 48.2806091309, propagate_backward_time: 71.8959274292, weight_update_time: 0.1480276138, other_time: 3.1987609863
epoch time: 8.8452157974s, input_fired_time: 0.1385739446, output_fired_time: 0.0000000000, propagate_forward_time: 8.1761522293, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5304899216
validation[          , genome  6196] predictions:    9700/  10000 (97.00%), best:    9707/10000 (97.07%), error:      1000.82220, best error:       978.19745 on epoch:    56, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 117.9565200806s, input_fired_time: 1.1195880175, output_fired_time: 0.9736057520, propagate_forward_time: 43.1155776978, propagate_backward_time: 69.6662216187, weight_update_time: 0.1423970759, other_time: 3.0815277100
epoch time: 10.3637266159s, input_fired_time: 0.1464629620, output_fired_time: 0.0000000000, propagate_forward_time: 9.6638631821, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5534000397
validation[          , genome  6196] predictions:    9685/  10000 (96.85%), best:    9707/10000 (97.07%), error:      1068.45300, best error:       978.19745 on epoch:    56, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 116.6495056152s, input_fired_time: 2.1263930798, output_fired_time: 0.9696719050, propagate_forward_time: 42.6743087769, propagate_backward_time: 67.8526611328, weight_update_time: 0.1404099464, other_time: 3.0264663696
epoch time: 12.3945617676s, input_fired_time: 0.1650109589, output_fired_time: 0.0000000000, propagate_forward_time: 11.5021562576, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7273941040
validation[          , genome  6196] predictions:    9657/  10000 (96.57%), best:    9707/10000 (97.07%), error:      1163.60596, best error:       978.19745 on epoch:    56, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 120.7826232910s, input_fired_time: 1.1630685329, output_fired_time: 0.9942367077, propagate_forward_time: 45.0754928589, propagate_backward_time: 70.3603363037, weight_update_time: 0.1554416567, other_time: 3.1894836426
epoch time: 10.5575494766s, input_fired_time: 0.1821398437, output_fired_time: 0.0000000000, propagate_forward_time: 8.7827968597, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5926132202
validation[          , genome  6196] predictions:    9674/  10000 (96.74%), best:    9707/10000 (97.07%), error:      1099.38831, best error:       978.19745 on epoch:    56, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 117.4664306641s, input_fired_time: 1.1131228209, output_fired_time: 0.9750700593, propagate_forward_time: 44.9085197449, propagate_backward_time: 67.4400177002, weight_update_time: 0.1416748315, other_time: 3.0297088623
epoch time: 8.8672494888s, input_fired_time: 0.1409284770, output_fired_time: 0.0000000000, propagate_forward_time: 8.1903419495, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5359792709
validation[          , genome  6196] predictions:    9618/  10000 (96.18%), best:    9707/10000 (97.07%), error:      1293.73889, best error:       978.19745 on epoch:    56, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 116.8904876709s, input_fired_time: 2.1168091297, output_fired_time: 1.9806760550, propagate_forward_time: 42.6609458923, propagate_backward_time: 67.1377334595, weight_update_time: 0.1397377402, other_time: 2.9943313599
epoch time: 10.0398864746s, input_fired_time: 0.1446165890, output_fired_time: 0.0000000000, propagate_forward_time: 9.3417835236, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5534868240
validation[          , genome  6196] predictions:    9687/  10000 (96.87%), best:    9707/10000 (97.07%), error:      1053.25317, best error:       978.19745 on epoch:    56, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 119.6257400513s, input_fired_time: 2.1352088451, output_fired_time: 0.9925946593, propagate_forward_time: 43.6944274902, propagate_backward_time: 69.7289581299, weight_update_time: 0.1414285302, other_time: 3.0745544434
epoch time: 8.9909420013s, input_fired_time: 0.1413511932, output_fired_time: 0.0000000000, propagate_forward_time: 8.3114156723, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5381755829
validation[          , genome  6196] predictions:    9664/  10000 (96.64%), best:    9707/10000 (97.07%), error:      1117.45728, best error:       978.19745 on epoch:    56, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 116.9778671265s, input_fired_time: 1.1110693216, output_fired_time: 0.9665662646, propagate_forward_time: 43.7234344482, propagate_backward_time: 68.1591873169, weight_update_time: 0.1408718377, other_time: 3.0176086426
epoch time: 8.8475570679s, input_fired_time: 0.1391441971, output_fired_time: 0.0000000000, propagate_forward_time: 8.1832380295, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5251750946
validation[          , genome  6196] predictions:    9661/  10000 (96.61%), best:    9707/10000 (97.07%), error:      1157.14807, best error:       978.19745 on epoch:    56, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 117.0220794678s, input_fired_time: 1.1172144413, output_fired_time: 0.9676081538, propagate_forward_time: 43.8838996887, propagate_backward_time: 68.0066909790, weight_update_time: 0.1422285438, other_time: 3.0466690063
epoch time: 10.1287946701s, input_fired_time: 0.1440034211, output_fired_time: 0.0000000000, propagate_forward_time: 9.4444646835, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5403261185
validation[          , genome  6196] predictions:    9693/  10000 (96.93%), best:    9707/10000 (97.07%), error:      1044.85693, best error:       978.19745 on epoch:    56, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 131.2678680420s, input_fired_time: 1.3043512106, output_fired_time: 1.0614861250, propagate_forward_time: 47.2319183350, propagate_backward_time: 78.3238525391, weight_update_time: 0.1542753130, other_time: 3.3462524414
epoch time: 13.9341096878s, input_fired_time: 0.2140155137, output_fired_time: 0.0000000000, propagate_forward_time: 11.9874467850, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7326469421
validation[          , genome  6196] predictions:    9648/  10000 (96.48%), best:    9707/10000 (97.07%), error:      1121.40698, best error:       978.19745 on epoch:    56, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 123.2066268921s, input_fired_time: 1.1687427759, output_fired_time: 1.0251909494, propagate_forward_time: 44.1985397339, propagate_backward_time: 73.6606445313, weight_update_time: 0.1438667476, other_time: 3.1535110474
epoch time: 10.2784070969s, input_fired_time: 0.1567060202, output_fired_time: 0.0000000000, propagate_forward_time: 9.5814743042, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5402269363
validation[          , genome  6196] predictions:    9723/  10000 (97.23%), best:    9723/10000 (97.23%), error:       960.14581, best error:       960.14581 on epoch:    74, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 124.9734344482s, input_fired_time: 1.1692608595, output_fired_time: 2.0873403549, propagate_forward_time: 46.5985717773, propagate_backward_time: 71.9063568115, weight_update_time: 0.1623297185, other_time: 3.2119064331
epoch time: 9.8454532623s, input_fired_time: 0.1418100744, output_fired_time: 0.0000000000, propagate_forward_time: 9.1673526764, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5362901688
validation[          , genome  6196] predictions:    9687/  10000 (96.87%), best:    9723/10000 (97.23%), error:      1090.84326, best error:       960.14581 on epoch:    74, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 117.3175811768s, input_fired_time: 1.1225125790, output_fired_time: 0.9870523810, propagate_forward_time: 45.3191261292, propagate_backward_time: 66.8404769897, weight_update_time: 0.1421043724, other_time: 3.0484085083
epoch time: 10.5576105118s, input_fired_time: 0.1514060944, output_fired_time: 0.0000000000, propagate_forward_time: 9.8532495499, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5529546738
validation[          , genome  6196] predictions:    9708/  10000 (97.08%), best:    9723/10000 (97.23%), error:      1013.69580, best error:       960.14581 on epoch:    74, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 118.8644790649s, input_fired_time: 1.1448307037, output_fired_time: 0.9810141325, propagate_forward_time: 43.4170303345, propagate_backward_time: 70.2801589966, weight_update_time: 0.1414767504, other_time: 3.0414505005
epoch time: 9.0073671341s, input_fired_time: 0.1420935392, output_fired_time: 0.0000000000, propagate_forward_time: 8.3282804489, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5369930267
validation[          , genome  6196] predictions:    9638/  10000 (96.38%), best:    9723/10000 (97.23%), error:      1157.47131, best error:       960.14581 on epoch:    74, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 117.3303298950s, input_fired_time: 1.1142123938, output_fired_time: 0.9774467349, propagate_forward_time: 44.7666282654, propagate_backward_time: 67.4550247192, weight_update_time: 0.1407158971, other_time: 3.0170211792
epoch time: 10.1591720581s, input_fired_time: 0.1440609843, output_fired_time: 0.0000000000, propagate_forward_time: 8.4654693604, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5496416092
validation[          , genome  6196] predictions:    9657/  10000 (96.57%), best:    9723/10000 (97.23%), error:      1150.09546, best error:       960.14581 on epoch:    74, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 122.7555160522s, input_fired_time: 1.1699910164, output_fired_time: 1.0189234018, propagate_forward_time: 46.7404556274, propagate_backward_time: 70.4824066162, weight_update_time: 0.1518827677, other_time: 3.3437423706
epoch time: 9.0130920410s, input_fired_time: 0.1427650005, output_fired_time: 0.0000000000, propagate_forward_time: 8.3358879089, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5344390869
validation[          , genome  6196] predictions:    9710/  10000 (97.10%), best:    9723/10000 (97.23%), error:      1030.16724, best error:       960.14581 on epoch:    74, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 132.3615875244s, input_fired_time: 1.2683800459, output_fired_time: 1.0816154480, propagate_forward_time: 50.4188995361, propagate_backward_time: 76.2183380127, weight_update_time: 0.1693356335, other_time: 3.3743438721
epoch time: 16.7136783600s, input_fired_time: 0.2314424664, output_fired_time: 0.0000000000, propagate_forward_time: 15.5768604279, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9053745270
validation[          , genome  6196] predictions:    9656/  10000 (96.56%), best:    9723/10000 (97.23%), error:      1099.32373, best error:       960.14581 on epoch:    74, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 124.5911254883s, input_fired_time: 1.2044112682, output_fired_time: 1.0275336504, propagate_forward_time: 45.5740699768, propagate_backward_time: 73.5670089722, weight_update_time: 0.1487454474, other_time: 3.2181015015
epoch time: 10.3550624847s, input_fired_time: 0.1453805268, output_fired_time: 0.0000000000, propagate_forward_time: 9.6621160507, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5475654602
validation[          , genome  6196] predictions:    9689/  10000 (96.89%), best:    9723/10000 (97.23%), error:      1082.51160, best error:       960.14581 on epoch:    74, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 124.1043243408s, input_fired_time: 1.1781396866, output_fired_time: 1.0708448887, propagate_forward_time: 46.2733192444, propagate_backward_time: 72.4227142334, weight_update_time: 0.1472163051, other_time: 3.1593017578
epoch time: 8.9171600342s, input_fired_time: 0.1409235448, output_fired_time: 0.0000000000, propagate_forward_time: 8.2493162155, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5269203186
validation[          , genome  6196] predictions:    9688/  10000 (96.88%), best:    9723/10000 (97.23%), error:      1076.94641, best error:       960.14581 on epoch:    74, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 119.2970657349s, input_fired_time: 1.1715316772, output_fired_time: 0.9824141860, propagate_forward_time: 44.3912277222, propagate_backward_time: 69.6982116699, weight_update_time: 0.1415569633, other_time: 3.0536804199
epoch time: 10.4169988632s, input_fired_time: 0.1461032778, output_fired_time: 0.0000000000, propagate_forward_time: 9.7060689926, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5648269653
validation[          , genome  6196] predictions:    9695/  10000 (96.95%), best:    9723/10000 (97.23%), error:      1037.40393, best error:       960.14581 on epoch:    74, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 119.2982788086s, input_fired_time: 1.1252079010, output_fired_time: 0.9858455062, propagate_forward_time: 44.5969047546, propagate_backward_time: 69.5457305908, weight_update_time: 0.1420033425, other_time: 3.0445861816
epoch time: 9.5400667191s, input_fired_time: 0.1413770318, output_fired_time: 0.0000000000, propagate_forward_time: 8.8594045639, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5392847061
validation[          , genome  6196] predictions:    9669/  10000 (96.69%), best:    9723/10000 (97.23%), error:      1131.01880, best error:       960.14581 on epoch:    74, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 121.7008590698s, input_fired_time: 1.1659004688, output_fired_time: 0.9864811897, propagate_forward_time: 45.5125122070, propagate_backward_time: 69.9100875854, weight_update_time: 0.1550202221, other_time: 4.1258773804
epoch time: 10.2527818680s, input_fired_time: 0.1460871696, output_fired_time: 0.0000000000, propagate_forward_time: 9.5572624207, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5494327545
validation[          , genome  6196] predictions:    9676/  10000 (96.76%), best:    9723/10000 (97.23%), error:      1101.49365, best error:       960.14581 on epoch:    74, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 119.4844284058s, input_fired_time: 1.1231683493, output_fired_time: 0.9808588028, propagate_forward_time: 42.7322959900, propagate_backward_time: 70.5538177490, weight_update_time: 0.1414553672, other_time: 4.0942840576
epoch time: 9.0506725311s, input_fired_time: 0.1403449476, output_fired_time: 0.0000000000, propagate_forward_time: 8.3888816833, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5214462280
validation[          , genome  6196] predictions:    9683/  10000 (96.83%), best:    9723/10000 (97.23%), error:      1120.47498, best error:       960.14581 on epoch:    74, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 119.3056869507s, input_fired_time: 1.1218550205, output_fired_time: 0.9945737123, propagate_forward_time: 43.7924995422, propagate_backward_time: 70.3443069458, weight_update_time: 0.1417031139, other_time: 3.0524520874
epoch time: 12.4342641830s, input_fired_time: 0.1752491742, output_fired_time: 0.0000000000, propagate_forward_time: 11.5816411972, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6773738861
validation[          , genome  6196] predictions:    9713/  10000 (97.13%), best:    9723/10000 (97.23%), error:      1002.81226, best error:       960.14581 on epoch:    74, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 133.8274078369s, input_fired_time: 1.3301854134, output_fired_time: 1.1136565208, propagate_forward_time: 51.0187797546, propagate_backward_time: 76.9688949585, weight_update_time: 0.1503738612, other_time: 3.3958816528
epoch time: 8.8619289398s, input_fired_time: 0.1408673823, output_fired_time: 0.0000000000, propagate_forward_time: 8.1962261200, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5248355865
validation[          , genome  6196] predictions:    9655/  10000 (96.55%), best:    9723/10000 (97.23%), error:      1119.83667, best error:       960.14581 on epoch:    74, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 117.8091354370s, input_fired_time: 2.1313552856, output_fired_time: 0.9715856910, propagate_forward_time: 46.0423965454, propagate_backward_time: 65.6373596191, weight_update_time: 0.1407140493, other_time: 3.0264358521
epoch time: 10.4343318939s, input_fired_time: 0.1501374543, output_fired_time: 0.0000000000, propagate_forward_time: 9.7226285934, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5615653992
validation[          , genome  6196] predictions:    9687/  10000 (96.87%), best:    9723/10000 (97.23%), error:      1042.19531, best error:       960.14581 on epoch:    74, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 128.8954925537s, input_fired_time: 2.2140123844, output_fired_time: 1.0914506912, propagate_forward_time: 48.1879539490, propagate_backward_time: 72.1193389893, weight_update_time: 0.1459585726, other_time: 5.2827301025
epoch time: 10.0761394501s, input_fired_time: 0.1440247893, output_fired_time: 0.0000000000, propagate_forward_time: 9.3922042847, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5399103165
validation[          , genome  6196] predictions:    9676/  10000 (96.76%), best:    9723/10000 (97.23%), error:      1084.49939, best error:       960.14581 on epoch:    74, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 123.6666793823s, input_fired_time: 1.1809254885, output_fired_time: 1.0106029510, propagate_forward_time: 47.4108695984, propagate_backward_time: 70.8890304565, weight_update_time: 0.1486915946, other_time: 3.1752548218
epoch time: 9.0188331604s, input_fired_time: 0.1472639441, output_fired_time: 0.0000000000, propagate_forward_time: 8.3325977325, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5389719009
validation[          , genome  6196] predictions:    9701/  10000 (97.01%), best:    9723/10000 (97.23%), error:      1028.51318, best error:       960.14581 on epoch:    74, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 119.1475448608s, input_fired_time: 1.1320098639, output_fired_time: 0.9801934361, propagate_forward_time: 43.5995750427, propagate_backward_time: 69.2893295288, weight_update_time: 0.1510715038, other_time: 4.1464309692
epoch time: 10.3087911606s, input_fired_time: 0.1493951678, output_fired_time: 0.0000000000, propagate_forward_time: 9.5993185043, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5600776672
validation[          , genome  6196] predictions:    9674/  10000 (96.74%), best:    9723/10000 (97.23%), error:      1041.32288, best error:       960.14581 on epoch:    74, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 119.7606277466s, input_fired_time: 1.1789817810, output_fired_time: 0.9914256334, propagate_forward_time: 42.8129005432, propagate_backward_time: 70.6650009155, weight_update_time: 0.1429317296, other_time: 4.1123275757
epoch time: 9.4594964981s, input_fired_time: 0.1408116370, output_fired_time: 0.0000000000, propagate_forward_time: 8.7815494537, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5371351242
validation[          , genome  6196] predictions:    9694/  10000 (96.94%), best:    9723/10000 (97.23%), error:      1082.73694, best error:       960.14581 on epoch:    74, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 119.1669616699s, input_fired_time: 1.1402150393, output_fired_time: 2.0513279438, propagate_forward_time: 44.5792045593, propagate_backward_time: 68.3389205933, weight_update_time: 0.1410624832, other_time: 3.0572891235
epoch time: 10.1956596375s, input_fired_time: 0.1442212909, output_fired_time: 0.0000000000, propagate_forward_time: 9.5161542892, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5352840424
validation[          , genome  6196] predictions:    9662/  10000 (96.62%), best:    9723/10000 (97.23%), error:      1122.75281, best error:       960.14581 on epoch:    74, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 129.2310028076s, input_fired_time: 1.2272900343, output_fired_time: 1.0081171989, propagate_forward_time: 49.7561683655, propagate_backward_time: 73.9548110962, weight_update_time: 0.1489019096, other_time: 3.2846145630
epoch time: 11.2371912003s, input_fired_time: 0.1533286273, output_fired_time: 0.0000000000, propagate_forward_time: 10.4723033905, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6115589142
validation[          , genome  6196] predictions:    9665/  10000 (96.65%), best:    9723/10000 (97.23%), error:      1134.86072, best error:       960.14581 on epoch:    74, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 132.7105102539s, input_fired_time: 1.2805125713, output_fired_time: 1.0963765383, propagate_forward_time: 51.2972030640, propagate_backward_time: 75.6954193115, weight_update_time: 0.1479481906, other_time: 3.3409957886
epoch time: 10.6314201355s, input_fired_time: 0.1524342746, output_fired_time: 0.0000000000, propagate_forward_time: 9.9105634689, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5684223175
validation[          , genome  6196] predictions:    9722/  10000 (97.22%), best:    9723/10000 (97.23%), error:      1009.23486, best error:       960.14581 on epoch:    74, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 129.6912689209s, input_fired_time: 1.1839206219, output_fired_time: 1.0669672489, propagate_forward_time: 50.3802947998, propagate_backward_time: 73.6979751587, weight_update_time: 0.1565852165, other_time: 3.3621139526
epoch time: 10.2150421143s, input_fired_time: 0.1459503472, output_fired_time: 0.0000000000, propagate_forward_time: 9.5215597153, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5475320816
validation[          , genome  6196] predictions:    9696/  10000 (96.96%), best:    9723/10000 (97.23%), error:      1040.13000, best error:       960.14581 on epoch:    74, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 119.0150222778s, input_fired_time: 1.1538183689, output_fired_time: 1.0054687262, propagate_forward_time: 46.6874084473, propagate_backward_time: 67.0430145264, weight_update_time: 0.1439194083, other_time: 3.1253128052
epoch time: 8.9958429337s, input_fired_time: 0.1418125629, output_fired_time: 0.0000000000, propagate_forward_time: 8.3324689865, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5215616226
validation[          , genome  6196] predictions:    9698/  10000 (96.98%), best:    9723/10000 (97.23%), error:      1052.38599, best error:       960.14581 on epoch:    74, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 121.0278091431s, input_fired_time: 1.1604163647, output_fired_time: 0.9856373668, propagate_forward_time: 47.1446876526, propagate_backward_time: 67.6324920654, weight_update_time: 0.1549643576, other_time: 4.1045837402
epoch time: 9.2938728333s, input_fired_time: 0.1480101794, output_fired_time: 0.0000000000, propagate_forward_time: 8.5956897736, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5501728058
validation[          , genome  6196] predictions:    9701/  10000 (97.01%), best:    9723/10000 (97.23%), error:      1019.57245, best error:       960.14581 on epoch:    74, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 117.7073211670s, input_fired_time: 1.1378003359, output_fired_time: 1.9884914160, propagate_forward_time: 42.1202163696, propagate_backward_time: 69.3842620850, weight_update_time: 0.1418887526, other_time: 3.0765457153
epoch time: 8.9830284119s, input_fired_time: 0.1428812742, output_fired_time: 0.0000000000, propagate_forward_time: 8.3117408752, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5284061432
validation[          , genome  6196] predictions:    9701/  10000 (97.01%), best:    9723/10000 (97.23%), error:      1025.77698, best error:       960.14581 on epoch:    74, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 48.9487838745s, input_fired_time: 0.7283357382, output_fired_time: 0.0000000000, propagate_forward_time: 45.1994590759, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0209884644
best training[          , genome  6196] predictions:   49374/  50000 (98.75%), best:    9723/10000 (97.23%), error:      2251.42969, best error:       960.14581 on epoch:    74, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 9.0568046570s, input_fired_time: 0.1422225088, output_fired_time: 0.0000000000, propagate_forward_time: 8.3767671585, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5378150940
   testing[          , genome  6196] predictions:    9738/  10000 (97.38%), best:    9723/10000 (97.23%), error:       860.40387, best error:       960.14581 on epoch:    74, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
02:55:34 (11856): called boinc_finish(0)

</stderr_txt>
]]>