Nameexact_genome_1512568488_41_6426_0
Workunit2603418
Created7 Dec 2017, 19:48:54 UTC
Sent7 Dec 2017, 19:51:38 UTC
Report deadline17 Dec 2017, 16:04:25 UTC
Received9 Dec 2017, 4:57:51 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID49051
Run time4 hours 52 min 4 sec
CPU time4 hours 51 min 34 sec
Validate stateValid
Credit2,460.55
Device peak FLOPS1.56 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size154.32 MB
Peak swap size159.18 MB
Peak disk usage2.02 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
), error:      1051.53918, best error:       854.80920 on epoch:    10, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 159.9210052490s, input_fired_time: 1.6693603992, output_fired_time: 1.5413823128, propagate_forward_time: 60.8068847656, propagate_backward_time: 92.6664199829, weight_update_time: 0.1620616317, other_time: 3.2369613647
epoch time: 12.8824176788s, input_fired_time: 0.2077916712, output_fired_time: 0.0000000000, propagate_forward_time: 12.0974864960, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5771398544
validation[          , genome  6426] predictions:    9756/  10000 (97.56%), best:    9756/10000 (97.56%), error:       820.12714, best error:       820.12714 on epoch:    15, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 159.8768463135s, input_fired_time: 1.6706329584, output_fired_time: 1.5454807281, propagate_forward_time: 60.7575302124, propagate_backward_time: 92.6744232178, weight_update_time: 0.1611947864, other_time: 3.2287673950
epoch time: 13.0564508438s, input_fired_time: 0.2089999914, output_fired_time: 0.0000000000, propagate_forward_time: 12.2635259628, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5839252472
validation[          , genome  6426] predictions:    9739/  10000 (97.39%), best:    9756/10000 (97.56%), error:       883.78442, best error:       820.12714 on epoch:    15, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 159.1166534424s, input_fired_time: 1.6679674387, output_fired_time: 1.5398504734, propagate_forward_time: 60.3364982605, propagate_backward_time: 92.3174972534, weight_update_time: 0.1619536132, other_time: 3.2548294067
epoch time: 12.8984918594s, input_fired_time: 0.2089595348, output_fired_time: 0.0000000000, propagate_forward_time: 12.0968799591, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5926523209
validation[          , genome  6426] predictions:    9752/  10000 (97.52%), best:    9756/10000 (97.56%), error:       841.15186, best error:       820.12714 on epoch:    15, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 159.4330902100s, input_fired_time: 1.6750323772, output_fired_time: 1.5437228680, propagate_forward_time: 60.6260719299, propagate_backward_time: 92.3278884888, weight_update_time: 0.1633529365, other_time: 3.2603836060
epoch time: 12.9521999359s, input_fired_time: 0.2097413242, output_fired_time: 0.0000000000, propagate_forward_time: 12.1672801971, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5751781464
validation[          , genome  6426] predictions:    9746/  10000 (97.46%), best:    9756/10000 (97.56%), error:       861.53186, best error:       820.12714 on epoch:    15, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 159.9307403564s, input_fired_time: 1.6760113239, output_fired_time: 1.5523872375, propagate_forward_time: 60.7692604065, propagate_backward_time: 92.6792602539, weight_update_time: 0.1615480483, other_time: 3.2538299561
epoch time: 12.5824165344s, input_fired_time: 0.2049874067, output_fired_time: 0.0000000000, propagate_forward_time: 11.7954664230, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5819625854
validation[          , genome  6426] predictions:    9656/  10000 (96.56%), best:    9756/10000 (97.56%), error:      1134.84192, best error:       820.12714 on epoch:    15, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 159.7768096924s, input_fired_time: 1.6750996113, output_fired_time: 1.5457106829, propagate_forward_time: 60.6150932312, propagate_backward_time: 92.6875305176, weight_update_time: 0.1615439653, other_time: 3.2533721924
epoch time: 12.6219244003s, input_fired_time: 0.2072960436, output_fired_time: 0.0000000000, propagate_forward_time: 11.8318948746, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5827331543
validation[          , genome  6426] predictions:    9760/  10000 (97.60%), best:    9756/10000 (97.56%), error:       827.71289, best error:       820.12714 on epoch:    15, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 159.1953125000s, input_fired_time: 1.6749951839, output_fired_time: 1.5446990728, propagate_forward_time: 60.4046020508, propagate_backward_time: 92.2968902588, weight_update_time: 0.1625234336, other_time: 3.2741394043
epoch time: 12.9295139313s, input_fired_time: 0.2077189088, output_fired_time: 0.0000000000, propagate_forward_time: 12.1459550858, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5758399963
validation[          , genome  6426] predictions:    9682/  10000 (96.82%), best:    9756/10000 (97.56%), error:      1015.37683, best error:       820.12714 on epoch:    15, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 159.4711303711s, input_fired_time: 1.6741684675, output_fired_time: 1.5373631716, propagate_forward_time: 60.7170448303, propagate_backward_time: 92.3024597168, weight_update_time: 0.1617165059, other_time: 3.2400970459
epoch time: 12.9774045944s, input_fired_time: 0.2086267471, output_fired_time: 0.0000000000, propagate_forward_time: 12.1871013641, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5816764832
validation[          , genome  6426] predictions:    9646/  10000 (96.46%), best:    9756/10000 (97.56%), error:      1180.17969, best error:       820.12714 on epoch:    15, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 159.6042327881s, input_fired_time: 1.6703699827, output_fired_time: 1.5452553034, propagate_forward_time: 60.6850128174, propagate_backward_time: 92.4803848267, weight_update_time: 0.1610345691, other_time: 3.2232131958
epoch time: 13.0010070801s, input_fired_time: 0.2075428069, output_fired_time: 0.0000000000, propagate_forward_time: 12.2222309113, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5712337494
validation[          , genome  6426] predictions:    9724/  10000 (97.24%), best:    9756/10000 (97.56%), error:       887.57867, best error:       820.12714 on epoch:    15, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 159.8419342041s, input_fired_time: 1.6778062582, output_fired_time: 1.5408983231, propagate_forward_time: 60.5900497437, propagate_backward_time: 92.7795639038, weight_update_time: 0.1623867452, other_time: 3.2536163330
epoch time: 12.9867095947s, input_fired_time: 0.2085970342, output_fired_time: 0.0000000000, propagate_forward_time: 12.2053432465, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5727691650
validation[          , genome  6426] predictions:    9679/  10000 (96.79%), best:    9756/10000 (97.56%), error:      1120.01697, best error:       820.12714 on epoch:    15, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 159.6914367676s, input_fired_time: 1.6805340052, output_fired_time: 1.5381710529, propagate_forward_time: 60.7260475159, propagate_backward_time: 92.4898986816, weight_update_time: 0.1625050306, other_time: 3.2567901611
epoch time: 13.0351266861s, input_fired_time: 0.2111616582, output_fired_time: 0.0000000000, propagate_forward_time: 12.2385349274, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5854301453
validation[          , genome  6426] predictions:    9695/  10000 (96.95%), best:    9756/10000 (97.56%), error:      1010.83630, best error:       820.12714 on epoch:    15, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 158.9767913818s, input_fired_time: 1.6730228662, output_fired_time: 1.5373373032, propagate_forward_time: 60.4118385315, propagate_backward_time: 92.1256103516, weight_update_time: 0.1612797827, other_time: 3.2289886475
epoch time: 13.0288515091s, input_fired_time: 0.2106752545, output_fired_time: 0.0000000000, propagate_forward_time: 12.2277164459, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5904598236
validation[          , genome  6426] predictions:    9681/  10000 (96.81%), best:    9756/10000 (97.56%), error:       994.70874, best error:       820.12714 on epoch:    15, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 159.1157684326s, input_fired_time: 1.6769063473, output_fired_time: 1.5373545885, propagate_forward_time: 60.2271537781, propagate_backward_time: 92.4010467529, weight_update_time: 0.1618700922, other_time: 3.2733001709
epoch time: 13.0370330811s, input_fired_time: 0.2102262080, output_fired_time: 0.0000000000, propagate_forward_time: 12.2533864975, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5734205246
validation[          , genome  6426] predictions:    9715/  10000 (97.15%), best:    9756/10000 (97.56%), error:       908.37689, best error:       820.12714 on epoch:    15, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 159.2441711426s, input_fired_time: 1.6774468422, output_fired_time: 1.5369787216, propagate_forward_time: 60.3350677490, propagate_backward_time: 92.4761276245, weight_update_time: 0.1608148962, other_time: 3.2185592651
epoch time: 12.7988424301s, input_fired_time: 0.2072765827, output_fired_time: 0.0000000000, propagate_forward_time: 12.0165405273, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5750255585
validation[          , genome  6426] predictions:    9706/  10000 (97.06%), best:    9756/10000 (97.56%), error:      1005.14215, best error:       820.12714 on epoch:    15, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 159.1941680908s, input_fired_time: 1.6734658480, output_fired_time: 1.5378873348, propagate_forward_time: 60.4175186157, propagate_backward_time: 92.3433532715, weight_update_time: 0.1608328372, other_time: 3.2219467163
epoch time: 12.8538045883s, input_fired_time: 0.2077471316, output_fired_time: 0.0000000000, propagate_forward_time: 12.0668439865, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5792131424
validation[          , genome  6426] predictions:    9717/  10000 (97.17%), best:    9756/10000 (97.56%), error:       896.50598, best error:       820.12714 on epoch:    15, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 159.0298767090s, input_fired_time: 1.6706442833, output_fired_time: 1.5320538282, propagate_forward_time: 60.3468208313, propagate_backward_time: 92.2602844238, weight_update_time: 0.1606207937, other_time: 3.2200775146
epoch time: 12.9732875824s, input_fired_time: 0.2096640319, output_fired_time: 0.0000000000, propagate_forward_time: 12.1824188232, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5812044144
validation[          , genome  6426] predictions:    9720/  10000 (97.20%), best:    9756/10000 (97.56%), error:       903.34949, best error:       820.12714 on epoch:    15, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 159.6446990967s, input_fired_time: 1.6770628691, output_fired_time: 1.5359929800, propagate_forward_time: 60.5388832092, propagate_backward_time: 92.6680679321, weight_update_time: 0.1616945118, other_time: 3.2246932983
epoch time: 12.6595249176s, input_fired_time: 0.2053995878, output_fired_time: 0.0000000000, propagate_forward_time: 11.8797788620, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5743465424
validation[          , genome  6426] predictions:    9729/  10000 (97.29%), best:    9756/10000 (97.56%), error:       851.52130, best error:       820.12714 on epoch:    15, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 159.1627197266s, input_fired_time: 1.6806728840, output_fired_time: 1.5379104614, propagate_forward_time: 60.4808044434, propagate_backward_time: 92.2381744385, weight_update_time: 0.1612654030, other_time: 3.2251434326
epoch time: 12.9380798340s, input_fired_time: 0.2102646530, output_fired_time: 0.0000000000, propagate_forward_time: 12.1528682709, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5749473572
validation[          , genome  6426] predictions:    9752/  10000 (97.52%), best:    9756/10000 (97.56%), error:       824.08026, best error:       820.12714 on epoch:    15, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 159.4121551514s, input_fired_time: 1.6745020151, output_fired_time: 1.5383825302, propagate_forward_time: 60.6610641479, propagate_backward_time: 92.3598480225, weight_update_time: 0.1599127501, other_time: 3.1783676147
epoch time: 13.0748271942s, input_fired_time: 0.2117442787, output_fired_time: 0.0000000000, propagate_forward_time: 12.2774686813, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5856142044
validation[          , genome  6426] predictions:    9692/  10000 (96.92%), best:    9756/10000 (97.56%), error:       994.93878, best error:       820.12714 on epoch:    15, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 159.7375030518s, input_fired_time: 1.6771566868, output_fired_time: 1.5448843241, propagate_forward_time: 60.6373481750, propagate_backward_time: 92.6697845459, weight_update_time: 0.1607391238, other_time: 3.2083282471
epoch time: 12.9557991028s, input_fired_time: 0.2078300714, output_fired_time: 0.0000000000, propagate_forward_time: 12.1874809265, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5604877472
validation[          , genome  6426] predictions:    9763/  10000 (97.63%), best:    9756/10000 (97.56%), error:       825.29456, best error:       820.12714 on epoch:    15, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 158.5885772705s, input_fired_time: 1.6763216257, output_fired_time: 1.5291774273, propagate_forward_time: 60.3933029175, propagate_backward_time: 91.7911453247, weight_update_time: 0.1600899249, other_time: 3.1986389160
epoch time: 13.0296859741s, input_fired_time: 0.2101965696, output_fired_time: 0.0000000000, propagate_forward_time: 12.2490329742, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5704565048
validation[          , genome  6426] predictions:    9673/  10000 (96.73%), best:    9756/10000 (97.56%), error:      1028.23462, best error:       820.12714 on epoch:    15, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 159.1068420410s, input_fired_time: 1.6742371321, output_fired_time: 1.5295232534, propagate_forward_time: 60.3757247925, propagate_backward_time: 92.3212814331, weight_update_time: 0.1606720239, other_time: 3.2060699463
epoch time: 13.0171194077s, input_fired_time: 0.2105165124, output_fired_time: 0.0000000000, propagate_forward_time: 12.2298755646, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5767269135
validation[          , genome  6426] predictions:    9750/  10000 (97.50%), best:    9750/10000 (97.50%), error:       789.48322, best error:       789.48322 on epoch:    36, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 160.0558624268s, input_fired_time: 1.6756396294, output_fired_time: 1.5483374596, propagate_forward_time: 60.7779884338, propagate_backward_time: 92.8551406860, weight_update_time: 0.1608210653, other_time: 3.1987533569
epoch time: 12.7064151764s, input_fired_time: 0.2086292803, output_fired_time: 0.0000000000, propagate_forward_time: 11.9205322266, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5772533417
validation[          , genome  6426] predictions:    9742/  10000 (97.42%), best:    9750/10000 (97.50%), error:       879.14117, best error:       789.48322 on epoch:    36, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 159.8946228027s, input_fired_time: 1.6819332838, output_fired_time: 1.5395720005, propagate_forward_time: 60.8046798706, propagate_backward_time: 92.6707000732, weight_update_time: 0.1602753252, other_time: 3.1977462769
epoch time: 12.9425468445s, input_fired_time: 0.2104755342, output_fired_time: 0.0000000000, propagate_forward_time: 12.1517829895, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5802879333
validation[          , genome  6426] predictions:    9647/  10000 (96.47%), best:    9750/10000 (97.50%), error:      1135.41052, best error:       789.48322 on epoch:    36, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 159.0577697754s, input_fired_time: 1.6733664274, output_fired_time: 1.5388911963, propagate_forward_time: 60.2901992798, propagate_backward_time: 92.3564682007, weight_update_time: 0.1603106111, other_time: 3.1988372803
epoch time: 12.8190727234s, input_fired_time: 0.2074470818, output_fired_time: 0.0000000000, propagate_forward_time: 12.0393075943, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5723180771
validation[          , genome  6426] predictions:    9767/  10000 (97.67%), best:    9767/10000 (97.67%), error:       759.07831, best error:       759.07831 on epoch:    39, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 160.2120208740s, input_fired_time: 1.6838370562, output_fired_time: 1.5471098423, propagate_forward_time: 60.8796806335, propagate_backward_time: 92.9129638672, weight_update_time: 0.1603832990, other_time: 3.1884307861
epoch time: 13.0205583572s, input_fired_time: 0.2126187980, output_fired_time: 0.0000000000, propagate_forward_time: 12.2310695648, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5768699646
validation[          , genome  6426] predictions:    9707/  10000 (97.07%), best:    9767/10000 (97.67%), error:       986.48962, best error:       759.07831 on epoch:    39, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 160.1221618652s, input_fired_time: 1.6838300228, output_fired_time: 1.5460727215, propagate_forward_time: 60.7943305969, propagate_backward_time: 92.8989868164, weight_update_time: 0.1606177390, other_time: 3.1989593506
epoch time: 12.9669933319s, input_fired_time: 0.2124488205, output_fired_time: 0.0000000000, propagate_forward_time: 12.1789426804, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5756015778
validation[          , genome  6426] predictions:    9691/  10000 (96.91%), best:    9767/10000 (97.67%), error:      1000.56799, best error:       759.07831 on epoch:    39, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 159.7466125488s, input_fired_time: 1.6815525293, output_fired_time: 1.5364623070, propagate_forward_time: 60.7731895447, propagate_backward_time: 92.5521850586, weight_update_time: 0.1607314795, other_time: 3.2032165527
epoch time: 12.9350738525s, input_fired_time: 0.2120018005, output_fired_time: 0.0000000000, propagate_forward_time: 12.1428651810, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5802068710
validation[          , genome  6426] predictions:    9777/  10000 (97.77%), best:    9777/10000 (97.77%), error:       758.54742, best error:       758.54742 on epoch:    42, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 159.9336547852s, input_fired_time: 1.6833152771, output_fired_time: 1.5388027430, propagate_forward_time: 60.7098312378, propagate_backward_time: 92.7870941162, weight_update_time: 0.1610801071, other_time: 3.2146072388
epoch time: 12.9331951141s, input_fired_time: 0.2098104805, output_fired_time: 0.0000000000, propagate_forward_time: 12.1564178467, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5669670105
validation[          , genome  6426] predictions:    9773/  10000 (97.73%), best:    9777/10000 (97.77%), error:       792.23785, best error:       758.54742 on epoch:    42, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 159.1473388672s, input_fired_time: 1.6815825701, output_fired_time: 1.5346688032, propagate_forward_time: 60.5066184998, propagate_backward_time: 92.2060241699, weight_update_time: 0.1604810804, other_time: 3.2184448242
epoch time: 12.9864406586s, input_fired_time: 0.2121088654, output_fired_time: 0.0000000000, propagate_forward_time: 12.1910877228, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5832443237
validation[          , genome  6426] predictions:    9719/  10000 (97.19%), best:    9777/10000 (97.77%), error:       949.60388, best error:       758.54742 on epoch:    42, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 159.4919433594s, input_fired_time: 1.6817085743, output_fired_time: 1.5370296240, propagate_forward_time: 60.5521507263, propagate_backward_time: 92.5137481689, weight_update_time: 0.1607718766, other_time: 3.2073059082
epoch time: 12.9489831924s, input_fired_time: 0.2106271088, output_fired_time: 0.0000000000, propagate_forward_time: 12.1686315536, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5697240829
validation[          , genome  6426] predictions:    9649/  10000 (96.49%), best:    9777/10000 (97.77%), error:      1068.98071, best error:       758.54742 on epoch:    42, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 160.2673187256s, input_fired_time: 1.6877599955, output_fired_time: 1.5499869585, propagate_forward_time: 60.8127517700, propagate_backward_time: 93.0021896362, weight_update_time: 0.1609177440, other_time: 3.2146301270
epoch time: 12.7303476334s, input_fired_time: 0.2081131935, output_fired_time: 0.0000000000, propagate_forward_time: 11.9588117599, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5634222031
validation[          , genome  6426] predictions:    9773/  10000 (97.73%), best:    9777/10000 (97.77%), error:       783.10431, best error:       758.54742 on epoch:    42, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 159.1513214111s, input_fired_time: 1.6799898148, output_fired_time: 1.5370312929, propagate_forward_time: 60.4584732056, propagate_backward_time: 92.2912139893, weight_update_time: 0.1596208662, other_time: 3.1846084595
epoch time: 12.9097995758s, input_fired_time: 0.2105830759, output_fired_time: 0.0000000000, propagate_forward_time: 12.1183223724, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5808944702
validation[          , genome  6426] predictions:    9670/  10000 (96.70%), best:    9777/10000 (97.77%), error:      1054.14734, best error:       758.54742 on epoch:    42, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 160.1647033691s, input_fired_time: 1.6909195185, output_fired_time: 1.5482232571, propagate_forward_time: 60.8740234375, propagate_backward_time: 92.8263549805, weight_update_time: 0.1609797776, other_time: 3.2251892090
epoch time: 12.4905147552s, input_fired_time: 0.2063974738, output_fired_time: 0.0000000000, propagate_forward_time: 11.7160291672, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5680885315
validation[          , genome  6426] predictions:    9774/  10000 (97.74%), best:    9777/10000 (97.77%), error:       762.62305, best error:       758.54742 on epoch:    42, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 159.5820922852s, input_fired_time: 1.6863929033, output_fired_time: 1.5400303602, propagate_forward_time: 60.4793357849, propagate_backward_time: 92.6584243774, weight_update_time: 0.1614154726, other_time: 3.2179183960
epoch time: 12.9191017151s, input_fired_time: 0.2097316235, output_fired_time: 0.0000000000, propagate_forward_time: 12.1463251114, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5630445480
validation[          , genome  6426] predictions:    9646/  10000 (96.46%), best:    9777/10000 (97.77%), error:      1190.75183, best error:       758.54742 on epoch:    42, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 160.4366607666s, input_fired_time: 1.6889672279, output_fired_time: 1.5446355343, propagate_forward_time: 61.0141754150, propagate_backward_time: 92.9723434448, weight_update_time: 0.1616786122, other_time: 3.2165451050
epoch time: 12.7342100143s, input_fired_time: 0.2101535350, output_fired_time: 0.0000000000, propagate_forward_time: 11.9484758377, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5755805969
validation[          , genome  6426] predictions:    9771/  10000 (97.71%), best:    9777/10000 (97.77%), error:       776.04266, best error:       758.54742 on epoch:    42, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 160.4002075195s, input_fired_time: 1.6935093403, output_fired_time: 1.5470561981, propagate_forward_time: 60.9544105530, propagate_backward_time: 92.9620742798, weight_update_time: 0.1622254550, other_time: 3.2431564331
epoch time: 12.8365335464s, input_fired_time: 0.2104945183, output_fired_time: 0.0000000000, propagate_forward_time: 12.0550680161, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5709714890
validation[          , genome  6426] predictions:    9771/  10000 (97.71%), best:    9777/10000 (97.77%), error:       794.13672, best error:       758.54742 on epoch:    42, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 160.2425231934s, input_fired_time: 1.6910011768, output_fired_time: 1.5430291891, propagate_forward_time: 60.9563674927, propagate_backward_time: 92.8576202393, weight_update_time: 0.1608957946, other_time: 3.1945114136
epoch time: 12.9814014435s, input_fired_time: 0.2118235677, output_fired_time: 0.0000000000, propagate_forward_time: 12.1972169876, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5723609924
validation[          , genome  6426] predictions:    9785/  10000 (97.85%), best:    9785/10000 (97.85%), error:       720.37805, best error:       720.37805 on epoch:    52, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 159.7014312744s, input_fired_time: 1.6906399727, output_fired_time: 1.5421293974, propagate_forward_time: 60.6577987671, propagate_backward_time: 92.6004714966, weight_update_time: 0.1611025780, other_time: 3.2103881836
epoch time: 12.9084320068s, input_fired_time: 0.2119664997, output_fired_time: 0.0000000000, propagate_forward_time: 12.1210145950, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5754508972
validation[          , genome  6426] predictions:    9695/  10000 (96.95%), best:    9785/10000 (97.85%), error:      1006.88110, best error:       720.37805 on epoch:    52, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 160.3250122070s, input_fired_time: 1.6866459846, output_fired_time: 1.5501688719, propagate_forward_time: 60.8695793152, propagate_backward_time: 93.0158386230, weight_update_time: 0.1612378061, other_time: 3.2027740479
epoch time: 12.9822320938s, input_fired_time: 0.2112962753, output_fired_time: 0.0000000000, propagate_forward_time: 12.2036752701, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5672607422
validation[          , genome  6426] predictions:    9748/  10000 (97.48%), best:    9785/10000 (97.85%), error:       825.95770, best error:       720.37805 on epoch:    52, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 160.1959686279s, input_fired_time: 1.6921272278, output_fired_time: 1.5447320938, propagate_forward_time: 60.8737068176, propagate_backward_time: 92.8621597290, weight_update_time: 0.1609100699, other_time: 3.2232437134
epoch time: 12.8191137314s, input_fired_time: 0.2117724270, output_fired_time: 0.0000000000, propagate_forward_time: 12.0307149887, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5766267776
validation[          , genome  6426] predictions:    9758/  10000 (97.58%), best:    9785/10000 (97.85%), error:       819.61591, best error:       720.37805 on epoch:    52, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 160.1796722412s, input_fired_time: 1.6969661713, output_fired_time: 1.5481387377, propagate_forward_time: 60.9273338318, propagate_backward_time: 92.7737350464, weight_update_time: 0.1618163884, other_time: 3.2334976196
epoch time: 12.9917907715s, input_fired_time: 0.2127764821, output_fired_time: 0.0000000000, propagate_forward_time: 12.2015762329, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5774383545
validation[          , genome  6426] predictions:    9776/  10000 (97.76%), best:    9785/10000 (97.85%), error:       729.72632, best error:       720.37805 on epoch:    52, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 159.6655578613s, input_fired_time: 1.6960309744, output_fired_time: 1.5422912836, propagate_forward_time: 60.6302833557, propagate_backward_time: 92.5656280518, weight_update_time: 0.1615778059, other_time: 3.2313232422
epoch time: 12.5576839447s, input_fired_time: 0.2084332108, output_fired_time: 0.0000000000, propagate_forward_time: 11.7740507126, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5752000809
validation[          , genome  6426] predictions:    9250/  10000 (92.50%), best:    9785/10000 (97.85%), error:      2628.07056, best error:       720.37805 on epoch:    52, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

resetting weights to those on epoch: 52
epoch time: 159.2756958008s, input_fired_time: 1.6885395050, output_fired_time: 1.5358383656, propagate_forward_time: 60.4874725342, propagate_backward_time: 92.3572769165, weight_update_time: 0.1604227126, other_time: 3.2065658569
epoch time: 13.0449867249s, input_fired_time: 0.2122240514, output_fired_time: 0.0000000000, propagate_forward_time: 12.2621307373, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5706319809
validation[          , genome  6426] predictions:    9779/  10000 (97.79%), best:    9785/10000 (97.85%), error:       735.36609, best error:       720.37805 on epoch:    52, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 157.8079528809s, input_fired_time: 1.6810282469, output_fired_time: 1.5308206081, propagate_forward_time: 59.8601417542, propagate_backward_time: 91.5409240723, weight_update_time: 0.1597381979, other_time: 3.1950378418
epoch time: 12.9791126251s, input_fired_time: 0.2119050175, output_fired_time: 0.0000000000, propagate_forward_time: 12.1947898865, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5724172592
validation[          , genome  6426] predictions:    9776/  10000 (97.76%), best:    9785/10000 (97.85%), error:       753.05469, best error:       720.37805 on epoch:    52, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 160.7126159668s, input_fired_time: 1.6927531958, output_fired_time: 1.5505280495, propagate_forward_time: 61.0782928467, propagate_backward_time: 93.1798095703, weight_update_time: 0.1611553133, other_time: 3.2112426758
epoch time: 12.9691543579s, input_fired_time: 0.2122496367, output_fired_time: 0.0000000000, propagate_forward_time: 12.1858444214, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5710601807
validation[          , genome  6426] predictions:    9709/  10000 (97.09%), best:    9785/10000 (97.85%), error:       964.27448, best error:       720.37805 on epoch:    52, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 158.8930358887s, input_fired_time: 1.6920974255, output_fired_time: 1.5363098383, propagate_forward_time: 60.2756958008, propagate_backward_time: 92.1569671631, weight_update_time: 0.1607549340, other_time: 3.2319641113
epoch time: 12.8007526398s, input_fired_time: 0.2121554017, output_fired_time: 0.0000000000, propagate_forward_time: 12.0136241913, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5749731064
validation[          , genome  6426] predictions:    9756/  10000 (97.56%), best:    9785/10000 (97.85%), error:       786.69159, best error:       720.37805 on epoch:    52, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 159.8545379639s, input_fired_time: 1.6947535276, output_fired_time: 1.5384882689, propagate_forward_time: 60.7420845032, propagate_backward_time: 92.6563644409, weight_update_time: 0.1612070799, other_time: 3.2228622437
epoch time: 12.9278535843s, input_fired_time: 0.2125460654, output_fired_time: 0.0000000000, propagate_forward_time: 12.1461610794, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5691461563
validation[          , genome  6426] predictions:    9729/  10000 (97.29%), best:    9785/10000 (97.85%), error:       884.06213, best error:       720.37805 on epoch:    52, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 159.9167785645s, input_fired_time: 1.6927287579, output_fired_time: 1.5433893204, propagate_forward_time: 60.7286376953, propagate_backward_time: 92.7343902588, weight_update_time: 0.1612859368, other_time: 3.2176208496
epoch time: 12.8144025803s, input_fired_time: 0.2105682194, output_fired_time: 0.0000000000, propagate_forward_time: 12.0373353958, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5664987564
validation[          , genome  6426] predictions:    9736/  10000 (97.36%), best:    9785/10000 (97.85%), error:       898.42822, best error:       720.37805 on epoch:    52, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 160.1896057129s, input_fired_time: 1.6932134628, output_fired_time: 1.5439183712, propagate_forward_time: 60.8087539673, propagate_backward_time: 92.9364089966, weight_update_time: 0.1613401771, other_time: 3.2073211670
epoch time: 12.8620910645s, input_fired_time: 0.2117591053, output_fired_time: 0.0000000000, propagate_forward_time: 12.0629596710, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5873718262
validation[          , genome  6426] predictions:    9706/  10000 (97.06%), best:    9785/10000 (97.85%), error:       974.51904, best error:       720.37805 on epoch:    52, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 160.1038970947s, input_fired_time: 1.6960583925, output_fired_time: 1.5430932045, propagate_forward_time: 60.8310546875, propagate_backward_time: 92.8021163940, weight_update_time: 0.1618798524, other_time: 3.2315750122
epoch time: 12.9434690475s, input_fired_time: 0.2118446380, output_fired_time: 0.0000000000, propagate_forward_time: 12.1666908264, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5649337769
validation[          , genome  6426] predictions:    9786/  10000 (97.86%), best:    9785/10000 (97.85%), error:       745.76208, best error:       720.37805 on epoch:    52, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 160.2104644775s, input_fired_time: 1.6988744736, output_fired_time: 1.5475494862, propagate_forward_time: 60.7230873108, propagate_backward_time: 92.9863128662, weight_update_time: 0.1619776636, other_time: 3.2546539307
epoch time: 12.8379716873s, input_fired_time: 0.2126096040, output_fired_time: 0.0000000000, propagate_forward_time: 12.0556936264, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5696687698
validation[          , genome  6426] predictions:    9790/  10000 (97.90%), best:    9785/10000 (97.85%), error:       767.51624, best error:       720.37805 on epoch:    52, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 159.6752166748s, input_fired_time: 1.6949312687, output_fired_time: 1.5369491577, propagate_forward_time: 60.6386756897, propagate_backward_time: 92.5837097168, weight_update_time: 0.1616863310, other_time: 3.2209472656
epoch time: 13.0639247894s, input_fired_time: 0.2146416754, output_fired_time: 0.0000000000, propagate_forward_time: 12.2707757950, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5785074234
validation[          , genome  6426] predictions:    9815/  10000 (98.15%), best:    9815/10000 (98.15%), error:       661.26147, best error:       661.26147 on epoch:    67, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 159.1034851074s, input_fired_time: 1.6901905537, output_fired_time: 1.5369020700, propagate_forward_time: 60.4503173828, propagate_backward_time: 92.2303009033, weight_update_time: 0.1604867280, other_time: 3.1957855225
epoch time: 13.0657682419s, input_fired_time: 0.2141194940, output_fired_time: 0.0000000000, propagate_forward_time: 12.2603998184, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5912485123
validation[          , genome  6426] predictions:    9705/  10000 (97.05%), best:    9815/10000 (98.15%), error:       974.82001, best error:       661.26147 on epoch:    67, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 159.0293884277s, input_fired_time: 1.6957494020, output_fired_time: 1.5418075323, propagate_forward_time: 60.3735809326, propagate_backward_time: 92.1792144775, weight_update_time: 0.1621486247, other_time: 3.2390289307
epoch time: 12.9669265747s, input_fired_time: 0.2142095566, output_fired_time: 0.0000000000, propagate_forward_time: 12.1677074432, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5850095749
validation[          , genome  6426] predictions:    9813/  10000 (98.13%), best:    9815/10000 (98.15%), error:       694.19275, best error:       661.26147 on epoch:    67, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 159.5709838867s, input_fired_time: 1.6928268671, output_fired_time: 1.5397105217, propagate_forward_time: 60.5942726135, propagate_backward_time: 92.5467834473, weight_update_time: 0.1609393209, other_time: 3.1974029541
epoch time: 13.0101270676s, input_fired_time: 0.2143764645, output_fired_time: 0.0000000000, propagate_forward_time: 12.2165260315, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5792245865
validation[          , genome  6426] predictions:    9776/  10000 (97.76%), best:    9815/10000 (98.15%), error:       797.09222, best error:       661.26147 on epoch:    67, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 159.9759674072s, input_fired_time: 1.7020967007, output_fired_time: 1.5482555628, propagate_forward_time: 60.7508659363, propagate_backward_time: 92.7278976440, weight_update_time: 0.1616509408, other_time: 3.2468490601
epoch time: 12.9647731781s, input_fired_time: 0.2130815834, output_fired_time: 0.0000000000, propagate_forward_time: 12.1835079193, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5681838989
validation[          , genome  6426] predictions:    9786/  10000 (97.86%), best:    9815/10000 (98.15%), error:       719.32483, best error:       661.26147 on epoch:    67, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 159.1659698486s, input_fired_time: 1.7001518011, output_fired_time: 1.5382088423, propagate_forward_time: 60.4629287720, propagate_backward_time: 92.2111587524, weight_update_time: 0.1612997204, other_time: 3.2535247803
epoch time: 12.9960947037s, input_fired_time: 0.2120248377, output_fired_time: 0.0000000000, propagate_forward_time: 12.2189817429, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5650882721
validation[          , genome  6426] predictions:    9795/  10000 (97.95%), best:    9815/10000 (98.15%), error:       722.83624, best error:       661.26147 on epoch:    67, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 160.0171508789s, input_fired_time: 1.7013508081, output_fired_time: 1.5416116714, propagate_forward_time: 60.8221435547, propagate_backward_time: 92.7193222046, weight_update_time: 0.1615004390, other_time: 3.2327194214
epoch time: 12.8750419617s, input_fired_time: 0.2117298990, output_fired_time: 0.0000000000, propagate_forward_time: 12.0918121338, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5714998245
validation[          , genome  6426] predictions:    9785/  10000 (97.85%), best:    9815/10000 (98.15%), error:       769.45398, best error:       661.26147 on epoch:    67, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 159.8729400635s, input_fired_time: 1.7058193684, output_fired_time: 1.5436979532, propagate_forward_time: 60.7642211914, propagate_backward_time: 92.6193771362, weight_update_time: 0.1617390662, other_time: 3.2398147583
epoch time: 13.0631809235s, input_fired_time: 0.2141824365, output_fired_time: 0.0000000000, propagate_forward_time: 12.2762537003, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5727443695
validation[          , genome  6426] predictions:    9778/  10000 (97.78%), best:    9815/10000 (98.15%), error:       742.02991, best error:       661.26147 on epoch:    67, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 158.8952331543s, input_fired_time: 1.6980352402, output_fired_time: 1.5329451561, propagate_forward_time: 60.3511581421, propagate_backward_time: 92.0809478760, weight_update_time: 0.1611133963, other_time: 3.2321548462
epoch time: 12.8869524002s, input_fired_time: 0.2130611390, output_fired_time: 0.0000000000, propagate_forward_time: 12.1003913879, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5734996796
validation[          , genome  6426] predictions:    9761/  10000 (97.61%), best:    9815/10000 (98.15%), error:       789.73871, best error:       661.26147 on epoch:    67, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 159.5526580811s, input_fired_time: 1.6935167313, output_fired_time: 1.5397964716, propagate_forward_time: 60.5615196228, propagate_backward_time: 92.5569229126, weight_update_time: 0.1605998427, other_time: 3.2009048462
epoch time: 12.7342348099s, input_fired_time: 0.2136099935, output_fired_time: 0.0000000000, propagate_forward_time: 11.9335193634, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5871057510
validation[          , genome  6426] predictions:    9784/  10000 (97.84%), best:    9815/10000 (98.15%), error:       745.87463, best error:       661.26147 on epoch:    67, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 158.4903717041s, input_fired_time: 1.6927142143, output_fired_time: 1.5326334238, propagate_forward_time: 60.1070861816, propagate_backward_time: 91.9287719727, weight_update_time: 0.1612536460, other_time: 3.2291564941
epoch time: 13.0805034637s, input_fired_time: 0.2147072405, output_fired_time: 0.0000000000, propagate_forward_time: 12.2899150848, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5758810043
validation[          , genome  6426] predictions:    9797/  10000 (97.97%), best:    9797/10000 (97.97%), error:       646.56323, best error:       646.56323 on epoch:    77, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 158.4948425293s, input_fired_time: 1.6951661110, output_fired_time: 1.5288206339, propagate_forward_time: 60.0821723938, propagate_backward_time: 91.9531555176, weight_update_time: 0.1609290689, other_time: 3.2355346680
epoch time: 12.6796216965s, input_fired_time: 0.2116321176, output_fired_time: 0.0000000000, propagate_forward_time: 11.8873682022, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5806217194
validation[          , genome  6426] predictions:    9802/  10000 (98.02%), best:    9797/10000 (97.97%), error:       682.95544, best error:       646.56323 on epoch:    77, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 159.0491333008s, input_fired_time: 1.6952111721, output_fired_time: 1.5309977531, propagate_forward_time: 60.3870239258, propagate_backward_time: 92.2289962769, weight_update_time: 0.1610371172, other_time: 3.2069168091
epoch time: 12.8098630905s, input_fired_time: 0.2129321098, output_fired_time: 0.0000000000, propagate_forward_time: 12.0120763779, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5848550797
validation[          , genome  6426] predictions:    9792/  10000 (97.92%), best:    9797/10000 (97.97%), error:       707.83203, best error:       646.56323 on epoch:    77, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 159.6375274658s, input_fired_time: 1.7013657093, output_fired_time: 1.5423905849, propagate_forward_time: 60.7004089355, propagate_backward_time: 92.4779891968, weight_update_time: 0.1613243520, other_time: 3.2153701782
epoch time: 12.8500099182s, input_fired_time: 0.2132198513, output_fired_time: 0.0000000000, propagate_forward_time: 12.0557889938, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5810012817
validation[          , genome  6426] predictions:    9785/  10000 (97.85%), best:    9797/10000 (97.97%), error:       738.26251, best error:       646.56323 on epoch:    77, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 157.7850799561s, input_fired_time: 1.6933934689, output_fired_time: 1.5281280279, propagate_forward_time: 59.8607826233, propagate_backward_time: 91.4601516724, weight_update_time: 0.1613883525, other_time: 3.2426376343
epoch time: 12.8413858414s, input_fired_time: 0.2135516405, output_fired_time: 0.0000000000, propagate_forward_time: 12.0494127274, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5784215927
validation[          , genome  6426] predictions:    9731/  10000 (97.31%), best:    9797/10000 (97.97%), error:       836.79883, best error:       646.56323 on epoch:    77, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 160.0623016357s, input_fired_time: 1.7096824646, output_fired_time: 1.5498617887, propagate_forward_time: 60.7986068726, propagate_backward_time: 92.7575531006, weight_update_time: 0.1621773243, other_time: 3.2465896606
epoch time: 13.0084362030s, input_fired_time: 0.2152832150, output_fired_time: 0.0000000000, propagate_forward_time: 12.2103538513, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5827989578
validation[          , genome  6426] predictions:    9791/  10000 (97.91%), best:    9797/10000 (97.97%), error:       687.21307, best error:       646.56323 on epoch:    77, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 159.6297607422s, input_fired_time: 1.7047821283, output_fired_time: 1.5441670418, propagate_forward_time: 60.6978340149, propagate_backward_time: 92.4420852661, weight_update_time: 0.1626058668, other_time: 3.2408828735
epoch time: 12.7756662369s, input_fired_time: 0.2119711041, output_fired_time: 0.0000000000, propagate_forward_time: 11.9932184219, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5704765320
validation[          , genome  6426] predictions:    9724/  10000 (97.24%), best:    9797/10000 (97.97%), error:       899.11548, best error:       646.56323 on epoch:    77, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 159.7344055176s, input_fired_time: 1.7048418522, output_fired_time: 1.5457061529, propagate_forward_time: 60.6804542542, propagate_backward_time: 92.5612869263, weight_update_time: 0.1614722311, other_time: 3.2421188354
epoch time: 13.0292654037s, input_fired_time: 0.2136908770, output_fired_time: 0.0000000000, propagate_forward_time: 12.2484502792, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5671243668
validation[          , genome  6426] predictions:    9700/  10000 (97.00%), best:    9797/10000 (97.97%), error:      1021.11224, best error:       646.56323 on epoch:    77, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 159.8235168457s, input_fired_time: 1.7008731365, output_fired_time: 1.5428397655, propagate_forward_time: 60.6635131836, propagate_backward_time: 92.6831054688, weight_update_time: 0.1616059542, other_time: 3.2331848145
epoch time: 12.9028854370s, input_fired_time: 0.2129520625, output_fired_time: 0.0000000000, propagate_forward_time: 12.1113691330, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5785646439
validation[          , genome  6426] predictions:    9746/  10000 (97.46%), best:    9797/10000 (97.97%), error:       816.78595, best error:       646.56323 on epoch:    77, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 159.2249145508s, input_fired_time: 1.6963348389, output_fired_time: 1.5421272516, propagate_forward_time: 60.4012451172, propagate_backward_time: 92.3613052368, weight_update_time: 0.1614872217, other_time: 3.2238998413
epoch time: 12.9549922943s, input_fired_time: 0.2130268216, output_fired_time: 0.0000000000, propagate_forward_time: 12.1739263535, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5680389404
validation[          , genome  6426] predictions:    9776/  10000 (97.76%), best:    9797/10000 (97.97%), error:       763.55231, best error:       646.56323 on epoch:    77, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 159.5614318848s, input_fired_time: 1.6978827715, output_fired_time: 1.5428082943, propagate_forward_time: 60.4975967407, propagate_backward_time: 92.6070327759, weight_update_time: 0.1607539207, other_time: 3.2161254883
epoch time: 13.0299921036s, input_fired_time: 0.2153758705, output_fired_time: 0.0000000000, propagate_forward_time: 12.2419242859, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5726919174
validation[          , genome  6426] predictions:    9790/  10000 (97.90%), best:    9797/10000 (97.97%), error:       724.42322, best error:       646.56323 on epoch:    77, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 160.1749725342s, input_fired_time: 1.7000529766, output_fired_time: 1.5436871052, propagate_forward_time: 60.8048171997, propagate_backward_time: 92.9152755737, weight_update_time: 0.1610094458, other_time: 3.2111358643
epoch time: 13.0195951462s, input_fired_time: 0.2165386379, output_fired_time: 0.0000000000, propagate_forward_time: 12.2093667984, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5936899185
validation[          , genome  6426] predictions:    9765/  10000 (97.65%), best:    9797/10000 (97.97%), error:       746.79352, best error:       646.56323 on epoch:    77, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 160.1796569824s, input_fired_time: 1.7077386379, output_fired_time: 1.5440526009, propagate_forward_time: 60.9777450562, propagate_backward_time: 92.7137145996, weight_update_time: 0.1621701568, other_time: 3.2364120483
epoch time: 12.9002151489s, input_fired_time: 0.2158079743, output_fired_time: 0.0000000000, propagate_forward_time: 12.1022396088, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5821676254
validation[          , genome  6426] predictions:    9756/  10000 (97.56%), best:    9797/10000 (97.97%), error:       784.97339, best error:       646.56323 on epoch:    77, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 160.1802978516s, input_fired_time: 1.7069104910, output_fired_time: 1.5461065769, propagate_forward_time: 60.8029403687, propagate_backward_time: 92.8765487671, weight_update_time: 0.1624732763, other_time: 3.2477874756
epoch time: 13.0220212936s, input_fired_time: 0.2169820070, output_fired_time: 0.0000000000, propagate_forward_time: 12.2239398956, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5810995102
validation[          , genome  6426] predictions:    9753/  10000 (97.53%), best:    9797/10000 (97.97%), error:       793.23505, best error:       646.56323 on epoch:    77, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 158.9905242920s, input_fired_time: 1.7060464621, output_fired_time: 1.5344681740, propagate_forward_time: 60.3273735046, propagate_backward_time: 92.1769332886, weight_update_time: 0.1611932963, other_time: 3.2457046509
epoch time: 12.9894113541s, input_fired_time: 0.2159631550, output_fired_time: 0.0000000000, propagate_forward_time: 12.1929721832, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5804758072
validation[          , genome  6426] predictions:    9786/  10000 (97.86%), best:    9797/10000 (97.97%), error:       717.12799, best error:       646.56323 on epoch:    77, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 159.6062927246s, input_fired_time: 1.7056809664, output_fired_time: 1.5415240526, propagate_forward_time: 60.6050415039, propagate_backward_time: 92.5388717651, weight_update_time: 0.1612439454, other_time: 3.2151718140
epoch time: 12.9717388153s, input_fired_time: 0.2160783559, output_fired_time: 0.0000000000, propagate_forward_time: 12.1800966263, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5755634308
validation[          , genome  6426] predictions:    9793/  10000 (97.93%), best:    9797/10000 (97.97%), error:       706.40027, best error:       646.56323 on epoch:    77, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 160.4349517822s, input_fired_time: 1.7128300667, output_fired_time: 1.5468633175, propagate_forward_time: 60.9787292480, propagate_backward_time: 92.9533996582, weight_update_time: 0.1632505059, other_time: 3.2431335449
epoch time: 12.4847126007s, input_fired_time: 0.2123120576, output_fired_time: 0.0000000000, propagate_forward_time: 11.6840543747, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5883464813
validation[          , genome  6426] predictions:    9792/  10000 (97.92%), best:    9797/10000 (97.97%), error:       694.90472, best error:       646.56323 on epoch:    77, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 159.7340698242s, input_fired_time: 1.7109545469, output_fired_time: 1.5469714403, propagate_forward_time: 60.5566101074, propagate_backward_time: 92.6864089966, weight_update_time: 0.1613438129, other_time: 3.2331314087
epoch time: 13.0754785538s, input_fired_time: 0.2164751440, output_fired_time: 0.0000000000, propagate_forward_time: 12.2832498550, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5757532120
validation[          , genome  6426] predictions:    9780/  10000 (97.80%), best:    9797/10000 (97.97%), error:       737.42627, best error:       646.56323 on epoch:    77, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 159.6795501709s, input_fired_time: 1.7104127407, output_fired_time: 1.5435298681, propagate_forward_time: 60.5888786316, propagate_backward_time: 92.5938186646, weight_update_time: 0.1620385796, other_time: 3.2428970337
epoch time: 12.9566297531s, input_fired_time: 0.2156754285, output_fired_time: 0.0000000000, propagate_forward_time: 12.1710271835, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5699272156
validation[          , genome  6426] predictions:    9759/  10000 (97.59%), best:    9797/10000 (97.97%), error:       754.41071, best error:       646.56323 on epoch:    77, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 159.7260131836s, input_fired_time: 1.7077164650, output_fired_time: 1.5394976139, propagate_forward_time: 60.6224746704, propagate_backward_time: 92.6375503540, weight_update_time: 0.1610775739, other_time: 3.2187652588
epoch time: 12.9539575577s, input_fired_time: 0.2156503201, output_fired_time: 0.0000000000, propagate_forward_time: 12.1657333374, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5725736618
validation[          , genome  6426] predictions:    9802/  10000 (98.02%), best:    9797/10000 (97.97%), error:       679.70514, best error:       646.56323 on epoch:    77, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 158.5140228271s, input_fired_time: 1.7115852833, output_fired_time: 1.5344618559, propagate_forward_time: 60.0656280518, propagate_backward_time: 91.9339218140, weight_update_time: 0.1622141898, other_time: 3.2684402466
epoch time: 12.9739313126s, input_fired_time: 0.2168545425, output_fired_time: 0.0000000000, propagate_forward_time: 12.1855783463, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5714988708
validation[          , genome  6426] predictions:    9797/  10000 (97.97%), best:    9797/10000 (97.97%), error:       683.85364, best error:       646.56323 on epoch:    77, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 159.0350189209s, input_fired_time: 1.7102924585, output_fired_time: 1.5337051153, propagate_forward_time: 60.3549880981, propagate_backward_time: 92.2124557495, weight_update_time: 0.1611246914, other_time: 3.2235717773
epoch time: 13.0313663483s, input_fired_time: 0.2181181610, output_fired_time: 0.0000000000, propagate_forward_time: 12.2301082611, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5831403732
validation[          , genome  6426] predictions:    9796/  10000 (97.96%), best:    9797/10000 (97.97%), error:       697.23157, best error:       646.56323 on epoch:    77, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 159.9031372070s, input_fired_time: 1.7208113670, output_fired_time: 1.5431925058, propagate_forward_time: 60.7641220093, propagate_backward_time: 92.6395721436, weight_update_time: 0.1620211601, other_time: 3.2354354858
epoch time: 12.6836872101s, input_fired_time: 0.2149857432, output_fired_time: 0.0000000000, propagate_forward_time: 11.8975200653, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5711812973
validation[          , genome  6426] predictions:    9812/  10000 (98.12%), best:    9812/10000 (98.12%), error:       643.44391, best error:       643.44391 on epoch:    99, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 159.5114898682s, input_fired_time: 1.7155375481, output_fired_time: 1.5382565260, propagate_forward_time: 60.5221138000, propagate_backward_time: 92.4724731445, weight_update_time: 0.1624773443, other_time: 3.2631225586
epoch time: 12.8223562241s, input_fired_time: 0.2158643007, output_fired_time: 0.0000000000, propagate_forward_time: 12.0321121216, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5743799210
validation[          , genome  6426] predictions:    9807/  10000 (98.07%), best:    9812/10000 (98.12%), error:       662.55652, best error:       643.44391 on epoch:    99, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 64.5028839111s, input_fired_time: 1.0880738497, output_fired_time: 0.0000000000, propagate_forward_time: 60.4136810303, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0011291504
best training[          , genome  6426] predictions:   49709/  50000 (99.42%), best:    9812/10000 (98.12%), error:      1276.73206, best error:       643.44391 on epoch:    99, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 12.9290266037s, input_fired_time: 0.2161541581, output_fired_time: 0.0000000000, propagate_forward_time: 12.1306924820, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5821800232
   testing[          , genome  6426] predictions:    9815/  10000 (98.15%), best:    9812/10000 (98.12%), error:       618.97430, best error:       643.44391 on epoch:    99, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
12:57:25 (5276): called boinc_finish(0)

</stderr_txt>
]]>