Nameexact_genome_1512568488_44_5756_1
Workunit2600084
Created7 Dec 2017, 16:16:24 UTC
Sent7 Dec 2017, 16:22:40 UTC
Report deadline13 Dec 2017, 14:57:17 UTC
Received9 Dec 2017, 4:18:38 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID57938
Run time3 hours 20 min 8 sec
CPU time3 hours 16 min 17 sec
Validate stateValid
Credit1,485.18
Device peak FLOPS2.90 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size153.81 MB
Peak swap size158.61 MB
Peak disk usage1.88 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
00, other_time: 0.5595655441
validation[          , genome  5756] predictions:    9721/  10000 (97.21%), best:    9721/10000 (97.21%), error:       992.46259, best error:       992.46259 on epoch:    14, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 106.3302536011s, input_fired_time: 1.3145898581, output_fired_time: 1.4151933193, propagate_forward_time: 39.4379463196, propagate_backward_time: 61.0796585083, weight_update_time: 0.1720739752, other_time: 3.0828628540
epoch time: 8.9275636673s, input_fired_time: 0.1602855623, output_fired_time: 0.0000000000, propagate_forward_time: 8.2290687561, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5382089615
validation[          , genome  5756] predictions:    9464/  10000 (94.64%), best:    9721/10000 (97.21%), error:      1686.90320, best error:       992.46259 on epoch:    14, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 107.0923614502s, input_fired_time: 1.3249256611, output_fired_time: 1.4286561012, propagate_forward_time: 39.7333641052, propagate_backward_time: 61.5074920654, weight_update_time: 0.1728983372, other_time: 3.0979156494
epoch time: 8.7012119293s, input_fired_time: 0.1615215093, output_fired_time: 0.0000000000, propagate_forward_time: 8.0021991730, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5374908447
validation[          , genome  5756] predictions:    9619/  10000 (96.19%), best:    9721/10000 (97.21%), error:      1283.91577, best error:       992.46259 on epoch:    14, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 107.7237854004s, input_fired_time: 1.3391098976, output_fired_time: 1.4441492558, propagate_forward_time: 39.8032264709, propagate_backward_time: 61.9612693787, weight_update_time: 0.1754183918, other_time: 3.1760292053
epoch time: 9.1842584610s, input_fired_time: 0.1716532558, output_fired_time: 0.0000000000, propagate_forward_time: 8.4353189468, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5772867203
validation[          , genome  5756] predictions:    9653/  10000 (96.53%), best:    9721/10000 (97.21%), error:      1199.96619, best error:       992.46259 on epoch:    14, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 107.4083938599s, input_fired_time: 1.3484655619, output_fired_time: 1.4426207542, propagate_forward_time: 39.5966224670, propagate_backward_time: 61.8343162537, weight_update_time: 0.1800887734, other_time: 3.1863746643
epoch time: 8.9276275635s, input_fired_time: 0.1609756351, output_fired_time: 0.0000000000, propagate_forward_time: 8.2294054031, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5372467041
validation[          , genome  5756] predictions:    9675/  10000 (96.75%), best:    9721/10000 (97.21%), error:      1056.11230, best error:       992.46259 on epoch:    14, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 108.7628173828s, input_fired_time: 1.3375405073, output_fired_time: 1.4387542009, propagate_forward_time: 40.4984512329, propagate_backward_time: 62.4029273987, weight_update_time: 0.1762535274, other_time: 3.0851478577
epoch time: 8.7674083710s, input_fired_time: 0.1633273363, output_fired_time: 0.0000000000, propagate_forward_time: 8.0688409805, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5352401733
validation[          , genome  5756] predictions:    9675/  10000 (96.75%), best:    9721/10000 (97.21%), error:      1100.82605, best error:       992.46259 on epoch:    14, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 108.4898910522s, input_fired_time: 1.3284121752, output_fired_time: 1.4428031445, propagate_forward_time: 40.3767662048, propagate_backward_time: 62.2953872681, weight_update_time: 0.1723057330, other_time: 3.0465164185
epoch time: 8.9449920654s, input_fired_time: 0.1634054035, output_fired_time: 0.0000000000, propagate_forward_time: 8.2475986481, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5339879990
validation[          , genome  5756] predictions:    9519/  10000 (95.19%), best:    9721/10000 (97.21%), error:      1575.66675, best error:       992.46259 on epoch:    14, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 107.7229156494s, input_fired_time: 1.3341503143, output_fired_time: 1.4313501120, propagate_forward_time: 40.0093612671, propagate_backward_time: 61.7930870056, weight_update_time: 0.1759473383, other_time: 3.1549644470
epoch time: 9.0704660416s, input_fired_time: 0.1712434739, output_fired_time: 0.0000000000, propagate_forward_time: 8.3195800781, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5796422958
validation[          , genome  5756] predictions:    9729/  10000 (97.29%), best:    9729/10000 (97.29%), error:       915.45660, best error:       915.45660 on epoch:    21, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 107.9297714233s, input_fired_time: 1.3463226557, output_fired_time: 1.4419026375, propagate_forward_time: 40.0851783752, propagate_backward_time: 61.8557128906, weight_update_time: 0.1769851148, other_time: 3.2006530762
epoch time: 8.7428855896s, input_fired_time: 0.1625613868, output_fired_time: 0.0000000000, propagate_forward_time: 8.0391349792, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5411891937
validation[          , genome  5756] predictions:    9715/  10000 (97.15%), best:    9729/10000 (97.29%), error:       988.88007, best error:       915.45660 on epoch:    21, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 107.4151382446s, input_fired_time: 1.3461234570, output_fired_time: 1.4356969595, propagate_forward_time: 39.6078186035, propagate_backward_time: 61.8284111023, weight_update_time: 0.1781735718, other_time: 3.1970863342
epoch time: 8.4683084488s, input_fired_time: 0.1575013697, output_fired_time: 0.0000000000, propagate_forward_time: 7.7937808037, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5170264244
validation[          , genome  5756] predictions:    9749/  10000 (97.49%), best:    9749/10000 (97.49%), error:       897.10431, best error:       897.10431 on epoch:    23, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 107.6840667725s, input_fired_time: 1.3243324757, output_fired_time: 1.4316543341, propagate_forward_time: 40.0262527466, propagate_backward_time: 61.8326911926, weight_update_time: 0.1738423556, other_time: 3.0691337585
epoch time: 8.9968452454s, input_fired_time: 0.1674099565, output_fired_time: 0.0000000000, propagate_forward_time: 8.2595157623, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5699195862
validation[          , genome  5756] predictions:    9681/  10000 (96.81%), best:    9749/10000 (97.49%), error:      1038.90540, best error:       897.10431 on epoch:    23, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 108.9676589966s, input_fired_time: 1.3539818525, output_fired_time: 1.4533013105, propagate_forward_time: 40.4514541626, propagate_backward_time: 62.5455703735, weight_update_time: 0.1799393147, other_time: 3.1633529663
epoch time: 8.9295473099s, input_fired_time: 0.1708115190, output_fired_time: 0.0000000000, propagate_forward_time: 8.1795196533, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5792160034
validation[          , genome  5756] predictions:    9740/  10000 (97.40%), best:    9740/10000 (97.40%), error:       894.88562, best error:       894.88562 on epoch:    25, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 108.6146697998s, input_fired_time: 1.3351494074, output_fired_time: 1.4437708855, propagate_forward_time: 40.3970451355, propagate_backward_time: 62.3520889282, weight_update_time: 0.1755313575, other_time: 3.0866165161
epoch time: 8.8561639786s, input_fired_time: 0.1637299359, output_fired_time: 0.0000000000, propagate_forward_time: 8.1495246887, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5429096222
validation[          , genome  5756] predictions:    9536/  10000 (95.36%), best:    9740/10000 (97.40%), error:      1551.20752, best error:       894.88562 on epoch:    25, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 106.3057022095s, input_fired_time: 1.3143892288, output_fired_time: 1.4289562702, propagate_forward_time: 39.1430320740, propagate_backward_time: 61.3061561584, weight_update_time: 0.1736428738, other_time: 3.1131706238
epoch time: 8.7926988602s, input_fired_time: 0.1627011001, output_fired_time: 0.0000000000, propagate_forward_time: 8.0684947968, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5615034103
validation[          , genome  5756] predictions:    9621/  10000 (96.21%), best:    9740/10000 (97.40%), error:      1352.76147, best error:       894.88562 on epoch:    25, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 107.9426040649s, input_fired_time: 1.3383338451, output_fired_time: 1.4389586449, propagate_forward_time: 40.0754470825, propagate_backward_time: 61.9009056091, weight_update_time: 0.1773256660, other_time: 3.1889610291
epoch time: 8.9251670837s, input_fired_time: 0.1618959308, output_fired_time: 0.0000000000, propagate_forward_time: 8.2288579941, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5344133377
validation[          , genome  5756] predictions:    9632/  10000 (96.32%), best:    9740/10000 (97.40%), error:      1240.87744, best error:       894.88562 on epoch:    25, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 108.2043609619s, input_fired_time: 1.3319312334, output_fired_time: 1.4375072718, propagate_forward_time: 40.4065055847, propagate_backward_time: 61.9612007141, weight_update_time: 0.1744444668, other_time: 3.0672111511
epoch time: 8.8015785217s, input_fired_time: 0.1628894955, output_fired_time: 0.0000000000, propagate_forward_time: 8.0795698166, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5591192245
validation[          , genome  5756] predictions:    9629/  10000 (96.29%), best:    9740/10000 (97.40%), error:      1189.11743, best error:       894.88562 on epoch:    25, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 107.9919128418s, input_fired_time: 1.3271241188, output_fired_time: 1.4362213612, propagate_forward_time: 40.2078208923, propagate_backward_time: 61.9457664490, weight_update_time: 0.1748336554, other_time: 3.0749855042
epoch time: 8.6976108551s, input_fired_time: 0.1630198509, output_fired_time: 0.0000000000, propagate_forward_time: 7.9768843651, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5577063560
validation[          , genome  5756] predictions:    9675/  10000 (96.75%), best:    9740/10000 (97.40%), error:      1065.40881, best error:       894.88562 on epoch:    25, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 106.1548538208s, input_fired_time: 1.3128966093, output_fired_time: 1.4156370163, propagate_forward_time: 39.3406143188, propagate_backward_time: 61.0065193176, weight_update_time: 0.1712036431, other_time: 3.0791893005
epoch time: 8.8069686890s, input_fired_time: 0.1609385908, output_fired_time: 0.0000000000, propagate_forward_time: 8.1114807129, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5345497131
validation[          , genome  5756] predictions:    9615/  10000 (96.15%), best:    9740/10000 (97.40%), error:      1252.67993, best error:       894.88562 on epoch:    25, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 108.1922760010s, input_fired_time: 1.3320938349, output_fired_time: 1.4412684441, propagate_forward_time: 40.2043533325, propagate_backward_time: 62.1325187683, weight_update_time: 0.1764547825, other_time: 3.0820426941
epoch time: 8.7857742310s, input_fired_time: 0.1648930311, output_fired_time: 0.0000000000, propagate_forward_time: 8.0771636963, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5437173843
validation[          , genome  5756] predictions:    9713/  10000 (97.13%), best:    9740/10000 (97.40%), error:      1015.71594, best error:       894.88562 on epoch:    25, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 107.8295135498s, input_fired_time: 1.3444191217, output_fired_time: 1.4345413446, propagate_forward_time: 39.9081230164, propagate_backward_time: 62.0016479492, weight_update_time: 0.1761552840, other_time: 3.1407775879
epoch time: 8.9321222305s, input_fired_time: 0.1660231501, output_fired_time: 0.0000000000, propagate_forward_time: 8.2028589249, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5632400513
validation[          , genome  5756] predictions:    9695/  10000 (96.95%), best:    9740/10000 (97.40%), error:      1078.05249, best error:       894.88562 on epoch:    25, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 108.4182205200s, input_fired_time: 1.3475861549, output_fired_time: 1.4449797869, propagate_forward_time: 40.2361907959, propagate_backward_time: 62.2139396667, weight_update_time: 0.1767903715, other_time: 3.1755256653
epoch time: 8.7141275406s, input_fired_time: 0.1647105664, output_fired_time: 0.0000000000, propagate_forward_time: 7.9828295708, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5665869713
validation[          , genome  5756] predictions:    9703/  10000 (97.03%), best:    9740/10000 (97.40%), error:       972.74658, best error:       894.88562 on epoch:    25, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 106.4145202637s, input_fired_time: 1.3249009848, output_fired_time: 1.4164384604, propagate_forward_time: 39.3968620300, propagate_backward_time: 61.2249259949, weight_update_time: 0.1723592132, other_time: 3.0513954163
epoch time: 8.9024648666s, input_fired_time: 0.1678013504, output_fired_time: 0.0000000000, propagate_forward_time: 8.1860332489, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5486307144
validation[          , genome  5756] predictions:    9575/  10000 (95.75%), best:    9740/10000 (97.40%), error:      1460.64673, best error:       894.88562 on epoch:    25, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 106.5270385742s, input_fired_time: 1.3187221289, output_fired_time: 1.4146187305, propagate_forward_time: 39.6213340759, propagate_backward_time: 61.1429481506, weight_update_time: 0.1715304404, other_time: 3.0294151306
epoch time: 8.7907714844s, input_fired_time: 0.1646096557, output_fired_time: 0.0000000000, propagate_forward_time: 8.0921659470, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5339956284
validation[          , genome  5756] predictions:    9702/  10000 (97.02%), best:    9740/10000 (97.40%), error:      1023.45679, best error:       894.88562 on epoch:    25, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 108.7678298950s, input_fired_time: 1.3452103138, output_fired_time: 1.4476770163, propagate_forward_time: 40.5522842407, propagate_backward_time: 62.3483772278, weight_update_time: 0.1753375679, other_time: 3.0742835999
epoch time: 8.3490161896s, input_fired_time: 0.1665020734, output_fired_time: 0.0000000000, propagate_forward_time: 7.5529751778, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6295390129
validation[          , genome  5756] predictions:    9721/  10000 (97.21%), best:    9740/10000 (97.40%), error:       927.15991, best error:       894.88562 on epoch:    25, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 107.4706802368s, input_fired_time: 1.3498843908, output_fired_time: 1.4187623262, propagate_forward_time: 39.9536781311, propagate_backward_time: 61.6634521484, weight_update_time: 0.1738170534, other_time: 3.0848999023
epoch time: 8.6726732254s, input_fired_time: 0.1724843383, output_fired_time: 0.0000000000, propagate_forward_time: 7.9214129448, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5787758827
validation[          , genome  5756] predictions:    9568/  10000 (95.68%), best:    9740/10000 (97.40%), error:      1424.41675, best error:       894.88562 on epoch:    25, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 106.7780227661s, input_fired_time: 1.3511235714, output_fired_time: 1.4261494875, propagate_forward_time: 39.5402526855, propagate_backward_time: 61.2980842590, weight_update_time: 0.1736496538, other_time: 3.1624183655
epoch time: 9.0078392029s, input_fired_time: 0.1742798835, output_fired_time: 0.0000000000, propagate_forward_time: 8.2650384903, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5685205460
validation[          , genome  5756] predictions:    9616/  10000 (96.16%), best:    9740/10000 (97.40%), error:      1282.45166, best error:       894.88562 on epoch:    25, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 107.2426223755s, input_fired_time: 1.3601144552, output_fired_time: 1.4319539070, propagate_forward_time: 39.7451248169, propagate_backward_time: 61.6307563782, weight_update_time: 0.1719964892, other_time: 3.0746726990
epoch time: 8.5135583878s, input_fired_time: 0.1643154919, output_fired_time: 0.0000000000, propagate_forward_time: 7.8070745468, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5421686172
validation[          , genome  5756] predictions:    9652/  10000 (96.52%), best:    9740/10000 (97.40%), error:      1180.28064, best error:       894.88562 on epoch:    25, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 107.2531433105s, input_fired_time: 1.3484431505, output_fired_time: 1.4270677567, propagate_forward_time: 39.7033004761, propagate_backward_time: 61.7051811218, weight_update_time: 0.1755259633, other_time: 3.0691490173
epoch time: 8.4853696823s, input_fired_time: 0.1657232046, output_fired_time: 0.0000000000, propagate_forward_time: 7.7469477654, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5726990700
validation[          , genome  5756] predictions:    9605/  10000 (96.05%), best:    9740/10000 (97.40%), error:      1238.10413, best error:       894.88562 on epoch:    25, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 107.5576095581s, input_fired_time: 1.3485354185, output_fired_time: 1.4230659008, propagate_forward_time: 39.9920082092, propagate_backward_time: 61.7248420715, weight_update_time: 0.1736768782, other_time: 3.0691642761
epoch time: 8.9081745148s, input_fired_time: 0.1690819561, output_fired_time: 0.0000000000, propagate_forward_time: 8.1703510284, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5687417984
validation[          , genome  5756] predictions:    9594/  10000 (95.94%), best:    9740/10000 (97.40%), error:      1349.00195, best error:       894.88562 on epoch:    25, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 108.6272583008s, input_fired_time: 1.3601353168, output_fired_time: 1.4417462349, propagate_forward_time: 40.4997673035, propagate_backward_time: 62.2446212769, weight_update_time: 0.1759290397, other_time: 3.0809860229
epoch time: 8.8835268021s, input_fired_time: 0.1679700762, output_fired_time: 0.0000000000, propagate_forward_time: 8.1547927856, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5607643127
validation[          , genome  5756] predictions:    9649/  10000 (96.49%), best:    9740/10000 (97.40%), error:      1144.67456, best error:       894.88562 on epoch:    25, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 106.5049819946s, input_fired_time: 1.3363907337, output_fired_time: 1.4165914059, propagate_forward_time: 39.5581665039, propagate_backward_time: 61.1477279663, weight_update_time: 0.1755549759, other_time: 3.0461120605
epoch time: 8.4346914291s, input_fired_time: 0.1615907252, output_fired_time: 0.0000000000, propagate_forward_time: 7.7401561737, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5329446793
validation[          , genome  5756] predictions:    9664/  10000 (96.64%), best:    9740/10000 (97.40%), error:      1122.20667, best error:       894.88562 on epoch:    25, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 107.0781097412s, input_fired_time: 1.3396688700, output_fired_time: 1.4270361662, propagate_forward_time: 39.5890502930, propagate_backward_time: 61.6049957275, weight_update_time: 0.1764186174, other_time: 3.1173629761
epoch time: 8.0759038925s, input_fired_time: 0.1601922661, output_fired_time: 0.0000000000, propagate_forward_time: 7.3471703529, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5685410500
validation[          , genome  5756] predictions:    9662/  10000 (96.62%), best:    9740/10000 (97.40%), error:      1100.62793, best error:       894.88562 on epoch:    25, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 107.2456893921s, input_fired_time: 1.3467990160, output_fired_time: 1.4242122173, propagate_forward_time: 39.8454399109, propagate_backward_time: 61.5374183655, weight_update_time: 0.1751068830, other_time: 3.0918235779
epoch time: 8.8332214355s, input_fired_time: 0.1715648770, output_fired_time: 0.0000000000, propagate_forward_time: 8.0944013596, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5672550201
validation[          , genome  5756] predictions:    9597/  10000 (95.97%), best:    9740/10000 (97.40%), error:      1360.37634, best error:       894.88562 on epoch:    25, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 108.4176406860s, input_fired_time: 1.3565713167, output_fired_time: 1.4353288412, propagate_forward_time: 40.3398056030, propagate_backward_time: 62.1873741150, weight_update_time: 0.1753211170, other_time: 3.0985603333
epoch time: 8.7057762146s, input_fired_time: 0.1644181460, output_fired_time: 0.0000000000, propagate_forward_time: 8.0053062439, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5360517502
validation[          , genome  5756] predictions:    9639/  10000 (96.39%), best:    9740/10000 (97.40%), error:      1259.61340, best error:       894.88562 on epoch:    25, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 106.5675735474s, input_fired_time: 1.3459005356, output_fired_time: 1.4242727757, propagate_forward_time: 39.3817443848, propagate_backward_time: 61.2833786011, weight_update_time: 0.1742083877, other_time: 3.1322784424
epoch time: 8.8495998383s, input_fired_time: 0.1669350415, output_fired_time: 0.0000000000, propagate_forward_time: 8.1282472610, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5544176102
validation[          , genome  5756] predictions:    9644/  10000 (96.44%), best:    9740/10000 (97.40%), error:      1222.55444, best error:       894.88562 on epoch:    25, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 106.9375000000s, input_fired_time: 1.3380017281, output_fired_time: 1.4257532358, propagate_forward_time: 39.6300659180, propagate_backward_time: 61.4288215637, weight_update_time: 0.1719423234, other_time: 3.1148567200
epoch time: 8.8424339294s, input_fired_time: 0.1688498259, output_fired_time: 0.0000000000, propagate_forward_time: 8.1110019684, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5625820160
validation[          , genome  5756] predictions:    9652/  10000 (96.52%), best:    9740/10000 (97.40%), error:      1153.38354, best error:       894.88562 on epoch:    25, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 108.6658020020s, input_fired_time: 1.3484636545, output_fired_time: 1.4505281448, propagate_forward_time: 40.4328994751, propagate_backward_time: 62.3088645935, weight_update_time: 0.1754684746, other_time: 3.1250419617
epoch time: 9.0207061768s, input_fired_time: 0.1729382426, output_fired_time: 0.0000000000, propagate_forward_time: 8.2727718353, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5749959946
validation[          , genome  5756] predictions:    9664/  10000 (96.64%), best:    9740/10000 (97.40%), error:      1151.06885, best error:       894.88562 on epoch:    25, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 107.4599685669s, input_fired_time: 1.3535921574, output_fired_time: 1.4256019592, propagate_forward_time: 39.8692283630, propagate_backward_time: 61.6660957336, weight_update_time: 0.1762187034, other_time: 3.1454429626
epoch time: 8.3929319382s, input_fired_time: 0.1638026834, output_fired_time: 0.0000000000, propagate_forward_time: 7.6669702530, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5621585846
validation[          , genome  5756] predictions:    9604/  10000 (96.04%), best:    9740/10000 (97.40%), error:      1333.80188, best error:       894.88562 on epoch:    25, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 108.2759094238s, input_fired_time: 1.3389374018, output_fired_time: 1.4321439266, propagate_forward_time: 40.4144897461, propagate_backward_time: 62.0765647888, weight_update_time: 0.1742856055, other_time: 3.0137748718
epoch time: 8.2985658646s, input_fired_time: 0.1632496715, output_fired_time: 0.0000000000, propagate_forward_time: 7.5689973831, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5663185120
validation[          , genome  5756] predictions:    9302/  10000 (93.02%), best:    9740/10000 (97.40%), error:      2239.26465, best error:       894.88562 on epoch:    25, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

resetting weights to those on epoch: 25
epoch time: 106.9884109497s, input_fired_time: 1.3269886971, output_fired_time: 1.4270520210, propagate_forward_time: 39.7191162109, propagate_backward_time: 61.4440155029, weight_update_time: 0.1731595397, other_time: 3.0712356567
epoch time: 8.6232404709s, input_fired_time: 0.1649363786, output_fired_time: 0.0000000000, propagate_forward_time: 7.9193997383, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5389046669
validation[          , genome  5756] predictions:    9700/  10000 (97.00%), best:    9740/10000 (97.40%), error:       965.07495, best error:       894.88562 on epoch:    25, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 106.9082031250s, input_fired_time: 1.3263072968, output_fired_time: 1.4283547401, propagate_forward_time: 39.5413436890, propagate_backward_time: 61.4954643250, weight_update_time: 0.1744177639, other_time: 3.1167335510
epoch time: 8.7708721161s, input_fired_time: 0.1630756706, output_fired_time: 0.0000000000, propagate_forward_time: 8.0754156113, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5323810577
validation[          , genome  5756] predictions:    9648/  10000 (96.48%), best:    9740/10000 (97.40%), error:      1167.56165, best error:       894.88562 on epoch:    25, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 107.3202667236s, input_fired_time: 1.3319247961, output_fired_time: 1.4271309376, propagate_forward_time: 39.8440551758, propagate_backward_time: 61.6390075684, weight_update_time: 0.1723735780, other_time: 3.0781478882
epoch time: 9.3036375046s, input_fired_time: 0.1746311486, output_fired_time: 0.0000000000, propagate_forward_time: 8.5517311096, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5772752762
validation[          , genome  5756] predictions:    9748/  10000 (97.48%), best:    9748/10000 (97.48%), error:       846.38239, best error:       846.38239 on epoch:    55, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 107.3140945435s, input_fired_time: 1.3361996412, output_fired_time: 1.4238336086, propagate_forward_time: 39.7757301331, propagate_backward_time: 61.7152862549, weight_update_time: 0.1733510047, other_time: 3.0630493164
epoch time: 8.7893419266s, input_fired_time: 0.1637267470, output_fired_time: 0.0000000000, propagate_forward_time: 8.0922765732, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5333385468
validation[          , genome  5756] predictions:    9603/  10000 (96.03%), best:    9748/10000 (97.48%), error:      1332.13147, best error:       846.38239 on epoch:    55, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 107.1362457275s, input_fired_time: 1.3548452854, output_fired_time: 1.4401190281, propagate_forward_time: 39.6412429810, propagate_backward_time: 61.5496101379, weight_update_time: 0.1762360930, other_time: 3.1504325867
epoch time: 8.5135612488s, input_fired_time: 0.1605096161, output_fired_time: 0.0000000000, propagate_forward_time: 7.8171501160, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5359010696
validation[          , genome  5756] predictions:    9614/  10000 (96.14%), best:    9748/10000 (97.48%), error:      1360.90625, best error:       846.38239 on epoch:    55, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 106.8303070068s, input_fired_time: 1.3201286793, output_fired_time: 1.4153186083, propagate_forward_time: 39.6380157471, propagate_backward_time: 61.4634552002, weight_update_time: 0.1711845845, other_time: 2.9933853149
epoch time: 8.9630632401s, input_fired_time: 0.1684927344, output_fired_time: 0.0000000000, propagate_forward_time: 8.2410898209, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5534811020
validation[          , genome  5756] predictions:    9584/  10000 (95.84%), best:    9748/10000 (97.48%), error:      1389.56311, best error:       846.38239 on epoch:    55, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 106.3703384399s, input_fired_time: 1.3383530378, output_fired_time: 1.4210162163, propagate_forward_time: 39.2203025818, propagate_backward_time: 61.2195968628, weight_update_time: 0.1753576994, other_time: 3.1710739136
epoch time: 8.7687931061s, input_fired_time: 0.1643668264, output_fired_time: 0.0000000000, propagate_forward_time: 8.0641546249, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5402717590
validation[          , genome  5756] predictions:    9634/  10000 (96.34%), best:    9748/10000 (97.48%), error:      1199.76135, best error:       846.38239 on epoch:    55, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 105.1746063232s, input_fired_time: 1.3103865385, output_fired_time: 1.4213719368, propagate_forward_time: 38.7440528870, propagate_backward_time: 60.5979156494, weight_update_time: 0.1697602123, other_time: 3.1008796692
epoch time: 8.7297105789s, input_fired_time: 0.1624672860, output_fired_time: 0.0000000000, propagate_forward_time: 8.0378370285, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5294065475
validation[          , genome  5756] predictions:    9633/  10000 (96.33%), best:    9748/10000 (97.48%), error:      1186.46313, best error:       846.38239 on epoch:    55, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 107.3929595947s, input_fired_time: 1.3352612257, output_fired_time: 1.4205293655, propagate_forward_time: 40.0563812256, propagate_backward_time: 61.5304870605, weight_update_time: 0.1736634523, other_time: 3.0503005981
epoch time: 8.7808513641s, input_fired_time: 0.1658567041, output_fired_time: 0.0000000000, propagate_forward_time: 8.0673198700, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5476751328
validation[          , genome  5756] predictions:    9633/  10000 (96.33%), best:    9748/10000 (97.48%), error:      1192.67041, best error:       846.38239 on epoch:    55, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 107.1749343872s, input_fired_time: 1.3407051563, output_fired_time: 1.4242516756, propagate_forward_time: 39.9021606445, propagate_backward_time: 61.3960418701, weight_update_time: 0.1743802279, other_time: 3.1117706299
epoch time: 9.1888389587s, input_fired_time: 0.1760357469, output_fired_time: 0.0000000000, propagate_forward_time: 8.4431304932, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5696725845
validation[          , genome  5756] predictions:    9621/  10000 (96.21%), best:    9748/10000 (97.48%), error:      1268.78552, best error:       846.38239 on epoch:    55, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 107.8635253906s, input_fired_time: 1.3514754772, output_fired_time: 1.4334734678, propagate_forward_time: 40.0594329834, propagate_backward_time: 61.8711891174, weight_update_time: 0.1761338264, other_time: 3.1479530334
epoch time: 8.5921106339s, input_fired_time: 0.1619731486, output_fired_time: 0.0000000000, propagate_forward_time: 7.8839683533, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5461692810
validation[          , genome  5756] predictions:    9625/  10000 (96.25%), best:    9748/10000 (97.48%), error:      1250.82080, best error:       846.38239 on epoch:    55, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 108.7438278198s, input_fired_time: 1.3384450674, output_fired_time: 1.4330620766, propagate_forward_time: 40.5617523193, propagate_backward_time: 62.3660469055, weight_update_time: 0.1738354117, other_time: 3.0445213318
epoch time: 8.8016796112s, input_fired_time: 0.1645708233, output_fired_time: 0.0000000000, propagate_forward_time: 8.0780792236, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5590295792
validation[          , genome  5756] predictions:    9672/  10000 (96.72%), best:    9748/10000 (97.48%), error:      1159.86829, best error:       846.38239 on epoch:    55, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 107.1870880127s, input_fired_time: 1.3298952579, output_fired_time: 1.4291164875, propagate_forward_time: 39.6467704773, propagate_backward_time: 61.6798820496, weight_update_time: 0.1740112454, other_time: 3.1014289856
epoch time: 9.0253229141s, input_fired_time: 0.1681169868, output_fired_time: 0.0000000000, propagate_forward_time: 8.2953834534, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5618228912
validation[          , genome  5756] predictions:    9650/  10000 (96.50%), best:    9748/10000 (97.48%), error:      1144.88220, best error:       846.38239 on epoch:    55, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 108.7811889648s, input_fired_time: 1.3490573168, output_fired_time: 1.4430491924, propagate_forward_time: 40.5800743103, propagate_backward_time: 62.3172912598, weight_update_time: 0.1753314286, other_time: 3.0917205811
epoch time: 8.9315013885s, input_fired_time: 0.1643694937, output_fired_time: 0.0000000000, propagate_forward_time: 8.2315196991, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5356121063
validation[          , genome  5756] predictions:    9634/  10000 (96.34%), best:    9748/10000 (97.48%), error:      1180.50378, best error:       846.38239 on epoch:    55, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 107.7896118164s, input_fired_time: 1.3580210209, output_fired_time: 1.4349161386, propagate_forward_time: 39.9018287659, propagate_backward_time: 61.8997688293, weight_update_time: 0.1758955270, other_time: 3.1950798035
epoch time: 8.5929927826s, input_fired_time: 0.1631782502, output_fired_time: 0.0000000000, propagate_forward_time: 7.8767290115, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5530853271
validation[          , genome  5756] predictions:    9672/  10000 (96.72%), best:    9748/10000 (97.48%), error:      1064.87781, best error:       846.38239 on epoch:    55, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 106.2500762939s, input_fired_time: 1.3250445127, output_fired_time: 1.4218704700, propagate_forward_time: 39.2855186462, propagate_backward_time: 61.1447296143, weight_update_time: 0.1709105074, other_time: 3.0729217529
epoch time: 8.3903036118s, input_fired_time: 0.1601463705, output_fired_time: 0.0000000000, propagate_forward_time: 7.6858825684, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5442743301
validation[          , genome  5756] predictions:    9617/  10000 (96.17%), best:    9748/10000 (97.48%), error:      1314.06506, best error:       846.38239 on epoch:    55, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 108.6384277344s, input_fired_time: 1.3474588394, output_fired_time: 1.4374541044, propagate_forward_time: 40.5050888062, propagate_backward_time: 62.2074661255, weight_update_time: 0.1774063855, other_time: 3.1409606934
epoch time: 8.8209781647s, input_fired_time: 0.1690862924, output_fired_time: 0.0000000000, propagate_forward_time: 8.0776224136, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5742692947
validation[          , genome  5756] predictions:    9641/  10000 (96.41%), best:    9748/10000 (97.48%), error:      1154.81665, best error:       846.38239 on epoch:    55, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 108.0591812134s, input_fired_time: 1.3422799110, output_fired_time: 1.4329946041, propagate_forward_time: 40.0666770935, propagate_backward_time: 62.0903015137, weight_update_time: 0.1755723655, other_time: 3.1269378662
epoch time: 8.8146228790s, input_fired_time: 0.1649087369, output_fired_time: 0.0000000000, propagate_forward_time: 8.1002168655, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5494976044
validation[          , genome  5756] predictions:    9667/  10000 (96.67%), best:    9748/10000 (97.48%), error:      1092.35425, best error:       846.38239 on epoch:    55, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 109.4352111816s, input_fired_time: 1.3527461290, output_fired_time: 1.4493478537, propagate_forward_time: 40.8036231995, propagate_backward_time: 62.7058944702, weight_update_time: 0.1772885174, other_time: 3.1236038208
epoch time: 8.2256116867s, input_fired_time: 0.1606805772, output_fired_time: 0.0000000000, propagate_forward_time: 7.4984502792, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5664806366
validation[          , genome  5756] predictions:    9664/  10000 (96.64%), best:    9748/10000 (97.48%), error:      1078.73315, best error:       846.38239 on epoch:    55, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 107.9237747192s, input_fired_time: 1.3333919048, output_fired_time: 1.4246895313, propagate_forward_time: 40.1681709290, propagate_backward_time: 61.9446640015, weight_update_time: 0.1754880100, other_time: 3.0528640747
epoch time: 8.4871063232s, input_fired_time: 0.1665783823, output_fired_time: 0.0000000000, propagate_forward_time: 7.7076320648, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6128959656
validation[          , genome  5756] predictions:    9670/  10000 (96.70%), best:    9748/10000 (97.48%), error:      1090.50513, best error:       846.38239 on epoch:    55, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 106.6489181519s, input_fired_time: 1.3325099945, output_fired_time: 1.4177306890, propagate_forward_time: 39.7459945679, propagate_backward_time: 61.1212387085, weight_update_time: 0.1710702926, other_time: 3.0314407349
epoch time: 9.0148334503s, input_fired_time: 0.1708235294, output_fired_time: 0.0000000000, propagate_forward_time: 8.2734451294, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5705652237
validation[          , genome  5756] predictions:    9646/  10000 (96.46%), best:    9748/10000 (97.48%), error:      1170.65955, best error:       846.38239 on epoch:    55, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 108.0861053467s, input_fired_time: 1.3420214653, output_fired_time: 1.4305777550, propagate_forward_time: 40.1796455383, propagate_backward_time: 62.0690345764, weight_update_time: 0.1735046208, other_time: 3.0648307800
epoch time: 9.0942106247s, input_fired_time: 0.1734676212, output_fired_time: 0.0000000000, propagate_forward_time: 8.3398818970, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5808610916
validation[          , genome  5756] predictions:    9665/  10000 (96.65%), best:    9748/10000 (97.48%), error:      1131.99536, best error:       846.38239 on epoch:    55, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 107.4524993896s, input_fired_time: 1.3368102312, output_fired_time: 1.4337424040, propagate_forward_time: 39.7886581421, propagate_backward_time: 61.8148345947, weight_update_time: 0.1722588837, other_time: 3.0784606934
epoch time: 8.8555698395s, input_fired_time: 0.1663365066, output_fired_time: 0.0000000000, propagate_forward_time: 8.1304893494, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5587444305
validation[          , genome  5756] predictions:    9636/  10000 (96.36%), best:    9748/10000 (97.48%), error:      1202.88269, best error:       846.38239 on epoch:    55, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 109.1106491089s, input_fired_time: 1.3568836451, output_fired_time: 1.4405791759, propagate_forward_time: 40.7266197205, propagate_backward_time: 62.4814567566, weight_update_time: 0.1746828705, other_time: 3.1051063538
epoch time: 8.3777933121s, input_fired_time: 0.1649390310, output_fired_time: 0.0000000000, propagate_forward_time: 7.6398296356, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5730247498
validation[          , genome  5756] predictions:    9674/  10000 (96.74%), best:    9748/10000 (97.48%), error:      1076.07239, best error:       846.38239 on epoch:    55, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 107.1968231201s, input_fired_time: 1.3348215818, output_fired_time: 1.4252885580, propagate_forward_time: 39.8267745972, propagate_backward_time: 61.5376510620, weight_update_time: 0.1728890389, other_time: 3.0722885132
epoch time: 8.0745296478s, input_fired_time: 0.1592268646, output_fired_time: 0.0000000000, propagate_forward_time: 7.3575763702, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5577263832
validation[          , genome  5756] predictions:    9675/  10000 (96.75%), best:    9748/10000 (97.48%), error:      1069.53979, best error:       846.38239 on epoch:    55, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 106.3808746338s, input_fired_time: 1.3328611851, output_fired_time: 1.4265594482, propagate_forward_time: 39.2670936584, propagate_backward_time: 61.2509613037, weight_update_time: 0.1723414063, other_time: 3.1033935547
epoch time: 8.6372423172s, input_fired_time: 0.1623663753, output_fired_time: 0.0000000000, propagate_forward_time: 7.9382100105, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5366663933
validation[          , genome  5756] predictions:    9604/  10000 (96.04%), best:    9748/10000 (97.48%), error:      1259.86829, best error:       846.38239 on epoch:    55, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 106.7780838013s, input_fired_time: 1.3345981836, output_fired_time: 1.4338254929, propagate_forward_time: 39.3592758179, propagate_backward_time: 61.5420188904, weight_update_time: 0.1735496670, other_time: 3.1083717346
epoch time: 8.6599597931s, input_fired_time: 0.1671978682, output_fired_time: 0.0000000000, propagate_forward_time: 7.9371781349, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5555834770
validation[          , genome  5756] predictions:    9684/  10000 (96.84%), best:    9748/10000 (97.48%), error:      1044.92810, best error:       846.38239 on epoch:    55, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 108.9943237305s, input_fired_time: 1.3556705713, output_fired_time: 1.4395451546, propagate_forward_time: 40.5592651367, propagate_backward_time: 62.5173339844, weight_update_time: 0.1805222332, other_time: 3.1225128174
epoch time: 8.9333143234s, input_fired_time: 0.1674688756, output_fired_time: 0.0000000000, propagate_forward_time: 8.2222013474, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5436439514
validation[          , genome  5756] predictions:    9674/  10000 (96.74%), best:    9748/10000 (97.48%), error:      1071.81055, best error:       846.38239 on epoch:    55, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 108.8631057739s, input_fired_time: 1.3609640598, output_fired_time: 1.4441447258, propagate_forward_time: 40.6328735352, propagate_backward_time: 62.2925491333, weight_update_time: 0.1765507311, other_time: 3.1325759888
epoch time: 7.9486646652s, input_fired_time: 0.1676317900, output_fired_time: 0.0000000000, propagate_forward_time: 7.1376333237, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6433997154
validation[          , genome  5756] predictions:    9687/  10000 (96.87%), best:    9748/10000 (97.48%), error:      1084.79102, best error:       846.38239 on epoch:    55, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 106.9491882324s, input_fired_time: 1.3373160362, output_fired_time: 1.4242632389, propagate_forward_time: 39.7264175415, propagate_backward_time: 61.3868103027, weight_update_time: 0.1728814244, other_time: 3.0743789673
epoch time: 9.0083169937s, input_fired_time: 0.1731859297, output_fired_time: 0.0000000000, propagate_forward_time: 8.2645177841, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5706129074
validation[          , genome  5756] predictions:    9666/  10000 (96.66%), best:    9748/10000 (97.48%), error:      1150.73401, best error:       846.38239 on epoch:    55, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 107.5722427368s, input_fired_time: 1.3253014088, output_fired_time: 1.4319587946, propagate_forward_time: 39.9928588867, propagate_backward_time: 61.7450752258, weight_update_time: 0.1738155782, other_time: 3.0770454407
epoch time: 9.1694250107s, input_fired_time: 0.1752846092, output_fired_time: 0.0000000000, propagate_forward_time: 8.4082183838, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5859222412
validation[          , genome  5756] predictions:    9557/  10000 (95.57%), best:    9748/10000 (97.48%), error:      1410.05444, best error:       846.38239 on epoch:    55, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 107.7686386108s, input_fired_time: 1.3299927711, output_fired_time: 1.4288065434, propagate_forward_time: 40.1120948792, propagate_backward_time: 61.8382301331, weight_update_time: 0.1725301743, other_time: 3.0595054626
epoch time: 8.9102087021s, input_fired_time: 0.1665734947, output_fired_time: 0.0000000000, propagate_forward_time: 8.1798162460, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5638189316
validation[          , genome  5756] predictions:    9613/  10000 (96.13%), best:    9748/10000 (97.48%), error:      1265.20898, best error:       846.38239 on epoch:    55, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 107.4452819824s, input_fired_time: 1.3350349665, output_fired_time: 1.4357177019, propagate_forward_time: 39.7873916626, propagate_backward_time: 61.8229675293, weight_update_time: 0.1737535894, other_time: 3.0641708374
epoch time: 8.4085435867s, input_fired_time: 0.1626689583, output_fired_time: 0.0000000000, propagate_forward_time: 7.6794285774, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5664458275
validation[          , genome  5756] predictions:    9663/  10000 (96.63%), best:    9748/10000 (97.48%), error:      1086.55688, best error:       846.38239 on epoch:    55, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 107.6496505737s, input_fired_time: 1.3458738327, output_fired_time: 1.4269294739, propagate_forward_time: 40.1660881042, propagate_backward_time: 61.6916770935, weight_update_time: 0.1721463203, other_time: 3.0190773010
epoch time: 9.1703424454s, input_fired_time: 0.1747065783, output_fired_time: 0.0000000000, propagate_forward_time: 8.4141025543, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5815334320
validation[          , genome  5756] predictions:    9676/  10000 (96.76%), best:    9748/10000 (97.48%), error:      1069.11743, best error:       846.38239 on epoch:    55, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 108.4723358154s, input_fired_time: 1.3386049271, output_fired_time: 1.4430484772, propagate_forward_time: 40.3131599426, propagate_backward_time: 62.3394279480, weight_update_time: 0.1729448587, other_time: 3.0380897522
epoch time: 8.8779554367s, input_fired_time: 0.1701990813, output_fired_time: 0.0000000000, propagate_forward_time: 8.1528463364, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5549097061
validation[          , genome  5756] predictions:    9676/  10000 (96.76%), best:    9748/10000 (97.48%), error:      1078.17883, best error:       846.38239 on epoch:    55, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 107.2427673340s, input_fired_time: 1.3363133669, output_fired_time: 1.4194926023, propagate_forward_time: 39.8769302368, propagate_backward_time: 61.5789031982, weight_update_time: 0.1714353710, other_time: 3.0311279297
epoch time: 8.8557929993s, input_fired_time: 0.1692823470, output_fired_time: 0.0000000000, propagate_forward_time: 8.1338500977, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5526609421
validation[          , genome  5756] predictions:    9700/  10000 (97.00%), best:    9748/10000 (97.48%), error:      1044.42456, best error:       846.38239 on epoch:    55, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 107.9917144775s, input_fired_time: 1.3442934752, output_fired_time: 1.4349818230, propagate_forward_time: 40.1476783752, propagate_backward_time: 61.9868240356, weight_update_time: 0.1741637290, other_time: 3.0779342651
epoch time: 9.0173463821s, input_fired_time: 0.1765347719, output_fired_time: 0.0000000000, propagate_forward_time: 8.2454118729, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5953998566
validation[          , genome  5756] predictions:    9693/  10000 (96.93%), best:    9748/10000 (97.48%), error:      1043.11157, best error:       846.38239 on epoch:    55, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 108.7638473511s, input_fired_time: 1.3474042416, output_fired_time: 1.4397354126, propagate_forward_time: 40.5025558472, propagate_backward_time: 62.4615974426, weight_update_time: 0.1736603677, other_time: 3.0125541687
epoch time: 8.0313663483s, input_fired_time: 0.1598821133, output_fired_time: 0.0000000000, propagate_forward_time: 7.3011894226, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5702948570
validation[          , genome  5756] predictions:    9115/  10000 (91.15%), best:    9748/10000 (97.48%), error:      3060.19043, best error:       846.38239 on epoch:    55, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

resetting weights to those on epoch: 55
epoch time: 106.7264480591s, input_fired_time: 1.3194493055, output_fired_time: 1.4200012684, propagate_forward_time: 39.5090637207, propagate_backward_time: 61.4228553772, weight_update_time: 0.1716657132, other_time: 3.0550804138
epoch time: 8.5457735062s, input_fired_time: 0.1615865976, output_fired_time: 0.0000000000, propagate_forward_time: 7.8294281960, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5547585487
validation[          , genome  5756] predictions:    9769/  10000 (97.69%), best:    9769/10000 (97.69%), error:       823.01801, best error:       823.01801 on epoch:    91, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 107.7464294434s, input_fired_time: 1.3279119730, output_fired_time: 1.4334796667, propagate_forward_time: 40.0154380798, propagate_backward_time: 61.9395713806, weight_update_time: 0.1725676060, other_time: 3.0300331116
epoch time: 8.7422227859s, input_fired_time: 0.1635129303, output_fired_time: 0.0000000000, propagate_forward_time: 8.0269117355, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5517978668
validation[          , genome  5756] predictions:    9778/  10000 (97.78%), best:    9778/10000 (97.78%), error:       749.71655, best error:       749.71655 on epoch:    92, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 108.4960784912s, input_fired_time: 1.3463170528, output_fired_time: 1.4368474483, propagate_forward_time: 40.4027099609, propagate_backward_time: 62.1774826050, weight_update_time: 0.1767271459, other_time: 3.1327285767
epoch time: 8.3100070953s, input_fired_time: 0.1652456820, output_fired_time: 0.0000000000, propagate_forward_time: 7.5129075050, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6318535805
validation[          , genome  5756] predictions:    9773/  10000 (97.73%), best:    9778/10000 (97.78%), error:       766.92603, best error:       749.71655 on epoch:    92, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 108.4321441650s, input_fired_time: 1.3379242420, output_fired_time: 1.4439227581, propagate_forward_time: 40.3278656006, propagate_backward_time: 62.2889862061, weight_update_time: 0.1741044670, other_time: 3.0334472656
epoch time: 8.8727998734s, input_fired_time: 0.1689948589, output_fired_time: 0.0000000000, propagate_forward_time: 8.1419401169, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5618648529
validation[          , genome  5756] predictions:    9768/  10000 (97.68%), best:    9778/10000 (97.78%), error:       767.57568, best error:       749.71655 on epoch:    92, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 108.1804580688s, input_fired_time: 1.3443583250, output_fired_time: 1.4319430590, propagate_forward_time: 40.2527694702, propagate_backward_time: 62.0804672241, weight_update_time: 0.1745222211, other_time: 3.0709152222
epoch time: 8.8627805710s, input_fired_time: 0.1637486666, output_fired_time: 0.0000000000, propagate_forward_time: 8.1700735092, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5289583206
validation[          , genome  5756] predictions:    9763/  10000 (97.63%), best:    9778/10000 (97.78%), error:       812.27692, best error:       749.71655 on epoch:    92, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 107.5886001587s, input_fired_time: 1.3307058811, output_fired_time: 1.4255421162, propagate_forward_time: 40.0303955078, propagate_backward_time: 61.7553138733, weight_update_time: 0.1739947200, other_time: 3.0466423035
epoch time: 8.9242334366s, input_fired_time: 0.1645333618, output_fired_time: 0.0000000000, propagate_forward_time: 8.2103366852, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5493631363
validation[          , genome  5756] predictions:    9778/  10000 (97.78%), best:    9778/10000 (97.78%), error:       764.75885, best error:       749.71655 on epoch:    92, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 108.6967163086s, input_fired_time: 1.3342642784, output_fired_time: 1.4320445061, propagate_forward_time: 40.5831069946, propagate_backward_time: 62.3629150391, weight_update_time: 0.1723762155, other_time: 2.9843826294
epoch time: 9.2356166840s, input_fired_time: 0.1744173616, output_fired_time: 0.0000000000, propagate_forward_time: 8.4955453873, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5656538010
validation[          , genome  5756] predictions:    9782/  10000 (97.82%), best:    9778/10000 (97.78%), error:       764.09320, best error:       749.71655 on epoch:    92, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 107.6874389648s, input_fired_time: 1.3381578922, output_fired_time: 1.4347707033, propagate_forward_time: 39.9723892212, propagate_backward_time: 61.8682022095, weight_update_time: 0.1739816815, other_time: 3.0739212036
epoch time: 8.6532726288s, input_fired_time: 0.1630635709, output_fired_time: 0.0000000000, propagate_forward_time: 7.9595971107, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5306115150
validation[          , genome  5756] predictions:    9786/  10000 (97.86%), best:    9778/10000 (97.78%), error:       753.85303, best error:       749.71655 on epoch:    92, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 107.2832565308s, input_fired_time: 1.3385015726, output_fired_time: 1.4267489910, propagate_forward_time: 39.9106521606, propagate_backward_time: 61.5619964600, weight_update_time: 0.1737240702, other_time: 3.0453567505
epoch time: 8.9879236221s, input_fired_time: 0.1659276932, output_fired_time: 0.0000000000, propagate_forward_time: 8.2929372787, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5290584564
validation[          , genome  5756] predictions:    9778/  10000 (97.78%), best:    9778/10000 (97.78%), error:       757.91321, best error:       749.71655 on epoch:    92, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 109.5374221802s, input_fired_time: 1.3438670635, output_fired_time: 1.4499241114, propagate_forward_time: 40.8656501770, propagate_backward_time: 62.8567047119, weight_update_time: 0.1743013859, other_time: 3.0212860107
epoch time: 8.5691337585s, input_fired_time: 0.1641284823, output_fired_time: 0.0000000000, propagate_forward_time: 7.8436079025, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5613975525
validation[          , genome  5756] predictions:    9785/  10000 (97.85%), best:    9778/10000 (97.78%), error:       768.93433, best error:       749.71655 on epoch:    92, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 41.8345108032s, input_fired_time: 0.8036274314, output_fired_time: 0.0000000000, propagate_forward_time: 38.2186317444, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8122520447
best training[          , genome  5756] predictions:   49417/  50000 (98.83%), best:    9778/10000 (97.78%), error:      2234.82910, best error:       749.71655 on epoch:    92, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 8.7481279373s, input_fired_time: 0.1619383395, output_fired_time: 0.0000000000, propagate_forward_time: 8.0526504517, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5335388184
   testing[          , genome  5756] predictions:    9815/  10000 (98.15%), best:    9778/10000 (97.78%), error:       675.41754, best error:       749.71655 on epoch:    92, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
12:18:12 (4948): called boinc_finish(0)

</stderr_txt>
]]>