Nameexact_genome_1512568488_45_6598_1
Workunit2604205
Created7 Dec 2017, 20:49:10 UTC
Sent7 Dec 2017, 20:50:13 UTC
Report deadline15 Dec 2017, 11:09:17 UTC
Received8 Dec 2017, 13:54:38 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID66479
Run time4 hours 52 min 2 sec
CPU time4 hours 47 min 11 sec
Validate stateValid
Credit1,899.15
Device peak FLOPS2.49 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size155.75 MB
Peak swap size154.02 MB
Peak disk usage1.95 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
000 (97.30%), best:    9720/10000 (97.20%), error:       948.61163, best error:       931.98468 on epoch:    13, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 157.2773742676s, input_fired_time: 1.7646300793, output_fired_time: 1.7936713696, propagate_forward_time: 58.3267211914, propagate_backward_time: 91.6321868896, weight_update_time: 0.2323086709, other_time: 3.7601623535
epoch time: 12.7296457291s, input_fired_time: 0.2175441235, output_fired_time: 0.0000000000, propagate_forward_time: 11.8562383652, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6558628082
validation[          , genome  6598] predictions:    9688/  10000 (96.88%), best:    9720/10000 (97.20%), error:      1040.12000, best error:       931.98468 on epoch:    13, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 156.6780090332s, input_fired_time: 1.7615453005, output_fired_time: 1.7936222553, propagate_forward_time: 58.1086044312, propagate_backward_time: 91.3098220825, weight_update_time: 0.2300649434, other_time: 3.7044067383
epoch time: 12.3884687424s, input_fired_time: 0.2169658095, output_fired_time: 0.0000000000, propagate_forward_time: 11.5065107346, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6649923325
validation[          , genome  6598] predictions:    9728/  10000 (97.28%), best:    9728/10000 (97.28%), error:       865.70929, best error:       865.70929 on epoch:    16, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 157.5125732422s, input_fired_time: 1.7628276348, output_fired_time: 1.8010680676, propagate_forward_time: 58.3855781555, propagate_backward_time: 91.8275604248, weight_update_time: 0.2301859856, other_time: 3.7355346680
epoch time: 12.7945899963s, input_fired_time: 0.2204246372, output_fired_time: 0.0000000000, propagate_forward_time: 11.9021558762, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6720094681
validation[          , genome  6598] predictions:    9717/  10000 (97.17%), best:    9728/10000 (97.28%), error:       989.34314, best error:       865.70929 on epoch:    16, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 158.3497467041s, input_fired_time: 1.7789386511, output_fired_time: 1.8094117641, propagate_forward_time: 58.7780532837, propagate_backward_time: 92.2053222656, weight_update_time: 0.2337653935, other_time: 3.7780075073
epoch time: 11.8098878860s, input_fired_time: 0.2087357044, output_fired_time: 0.0000000000, propagate_forward_time: 10.9530572891, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6480951309
validation[          , genome  6598] predictions:    9749/  10000 (97.49%), best:    9728/10000 (97.28%), error:       873.14874, best error:       865.70929 on epoch:    16, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 158.2385559082s, input_fired_time: 1.7650768757, output_fired_time: 1.7992712259, propagate_forward_time: 58.4585800171, propagate_backward_time: 92.5221862793, weight_update_time: 0.2316654772, other_time: 3.6934432983
epoch time: 12.6849660873s, input_fired_time: 0.2216013223, output_fired_time: 0.0000000000, propagate_forward_time: 11.7657241821, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6976404190
validation[          , genome  6598] predictions:    9648/  10000 (96.48%), best:    9728/10000 (97.28%), error:      1180.09094, best error:       865.70929 on epoch:    16, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 156.5803375244s, input_fired_time: 1.7614831924, output_fired_time: 1.7891024351, propagate_forward_time: 57.8970298767, propagate_backward_time: 91.4269256592, weight_update_time: 0.2306994349, other_time: 3.7057800293
epoch time: 12.9312553406s, input_fired_time: 0.2234489769, output_fired_time: 0.0000000000, propagate_forward_time: 12.0445194244, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6632871628
validation[          , genome  6598] predictions:    9697/  10000 (96.97%), best:    9728/10000 (97.28%), error:      1002.66205, best error:       865.70929 on epoch:    16, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 158.0251464844s, input_fired_time: 1.7752441168, output_fired_time: 1.8003101349, propagate_forward_time: 58.6327705383, propagate_backward_time: 92.0507965088, weight_update_time: 0.2329539210, other_time: 3.7660369873
epoch time: 12.6136665344s, input_fired_time: 0.2215505987, output_fired_time: 0.0000000000, propagate_forward_time: 11.7182664871, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6738491058
validation[          , genome  6598] predictions:    9698/  10000 (96.98%), best:    9728/10000 (97.28%), error:       982.85864, best error:       865.70929 on epoch:    16, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 156.2338562012s, input_fired_time: 1.7638839483, output_fired_time: 1.7864637375, propagate_forward_time: 57.7912673950, propagate_backward_time: 91.1611633301, weight_update_time: 0.2298881859, other_time: 3.7310714722
epoch time: 12.3618183136s, input_fired_time: 0.2178650647, output_fired_time: 0.0000000000, propagate_forward_time: 11.4667024612, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6772508621
validation[          , genome  6598] predictions:    9710/  10000 (97.10%), best:    9728/10000 (97.28%), error:       928.19543, best error:       865.70929 on epoch:    16, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 156.4878082275s, input_fired_time: 1.7690497637, output_fired_time: 1.7834566832, propagate_forward_time: 58.0937271118, propagate_backward_time: 91.1087799072, weight_update_time: 0.2303445488, other_time: 3.7327957153
epoch time: 12.2782640457s, input_fired_time: 0.2134740055, output_fired_time: 0.0000000000, propagate_forward_time: 11.4226293564, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6421604156
validation[          , genome  6598] predictions:    9729/  10000 (97.29%), best:    9728/10000 (97.28%), error:       882.30475, best error:       865.70929 on epoch:    16, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 158.7013397217s, input_fired_time: 1.7747390270, output_fired_time: 1.8075358868, propagate_forward_time: 58.7449989319, propagate_backward_time: 92.6542587280, weight_update_time: 0.2324524671, other_time: 3.7198104858
epoch time: 12.8343238831s, input_fired_time: 0.2222771645, output_fired_time: 0.0000000000, propagate_forward_time: 11.9559316635, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6561155319
validation[          , genome  6598] predictions:    9736/  10000 (97.36%), best:    9736/10000 (97.36%), error:       859.55823, best error:       859.55823 on epoch:    24, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 158.5370941162s, input_fired_time: 1.7865349054, output_fired_time: 1.8145444393, propagate_forward_time: 59.0005340576, propagate_backward_time: 92.2238693237, weight_update_time: 0.2328323275, other_time: 3.7116165161
epoch time: 12.3688001633s, input_fired_time: 0.2174796760, output_fired_time: 0.0000000000, propagate_forward_time: 11.4933109283, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6580095291
validation[          , genome  6598] predictions:    9731/  10000 (97.31%), best:    9736/10000 (97.36%), error:       892.06940, best error:       859.55823 on epoch:    24, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 156.7621459961s, input_fired_time: 1.7815399170, output_fired_time: 1.7996221781, propagate_forward_time: 58.2102661133, propagate_backward_time: 91.1825790405, weight_update_time: 0.2318289578, other_time: 3.7881393433
epoch time: 12.7165966034s, input_fired_time: 0.2209361494, output_fired_time: 0.0000000000, propagate_forward_time: 11.8296108246, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6660499573
validation[          , genome  6598] predictions:    9720/  10000 (97.20%), best:    9736/10000 (97.36%), error:       921.08917, best error:       859.55823 on epoch:    24, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 157.3391723633s, input_fired_time: 1.7798867226, output_fired_time: 1.8076212406, propagate_forward_time: 58.6271400452, propagate_backward_time: 91.4109878540, weight_update_time: 0.2302010804, other_time: 3.7135391235
epoch time: 12.3348731995s, input_fired_time: 0.2169359326, output_fired_time: 0.0000000000, propagate_forward_time: 11.4611082077, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6568288803
validation[          , genome  6598] predictions:    9691/  10000 (96.91%), best:    9736/10000 (97.36%), error:       970.99506, best error:       859.55823 on epoch:    24, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 157.5293884277s, input_fired_time: 1.7778838873, output_fired_time: 1.7998489141, propagate_forward_time: 58.5084991455, propagate_backward_time: 91.6976089478, weight_update_time: 0.2314075530, other_time: 3.7455520630
epoch time: 12.4039392471s, input_fired_time: 0.2205083221, output_fired_time: 0.0000000000, propagate_forward_time: 11.5024461746, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6809844971
validation[          , genome  6598] predictions:    9712/  10000 (97.12%), best:    9736/10000 (97.36%), error:       919.95703, best error:       859.55823 on epoch:    24, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 157.1794891357s, input_fired_time: 1.7712793350, output_fired_time: 1.7975702286, propagate_forward_time: 58.2815856934, propagate_backward_time: 91.5801849365, weight_update_time: 0.2313683927, other_time: 3.7488555908
epoch time: 12.6976919174s, input_fired_time: 0.2212607265, output_fired_time: 0.0000000000, propagate_forward_time: 11.8144254684, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6620054245
validation[          , genome  6598] predictions:    9731/  10000 (97.31%), best:    9731/10000 (97.31%), error:       841.83405, best error:       841.83405 on epoch:    29, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 157.4983215332s, input_fired_time: 1.7778892517, output_fired_time: 1.7997727394, propagate_forward_time: 58.4865722656, propagate_backward_time: 91.7055053711, weight_update_time: 0.2310096622, other_time: 3.7285766602
epoch time: 12.7712516785s, input_fired_time: 0.2249292880, output_fired_time: 0.0000000000, propagate_forward_time: 11.8853435516, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6609792709
validation[          , genome  6598] predictions:    9726/  10000 (97.26%), best:    9731/10000 (97.31%), error:       875.40955, best error:       841.83405 on epoch:    29, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 157.6273498535s, input_fired_time: 1.7776982784, output_fired_time: 1.8003144264, propagate_forward_time: 58.5671653748, propagate_backward_time: 91.7575988770, weight_update_time: 0.2322441787, other_time: 3.7245788574
epoch time: 12.8534469604s, input_fired_time: 0.2233384997, output_fired_time: 0.0000000000, propagate_forward_time: 11.9598636627, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6702451706
validation[          , genome  6598] predictions:    9696/  10000 (96.96%), best:    9731/10000 (97.31%), error:       934.37134, best error:       841.83405 on epoch:    29, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 156.6434631348s, input_fired_time: 1.7728782892, output_fired_time: 1.7895755768, propagate_forward_time: 58.0424613953, propagate_backward_time: 91.3039550781, weight_update_time: 0.2303618342, other_time: 3.7345886230
epoch time: 12.6379346848s, input_fired_time: 0.2220220566, output_fired_time: 0.0000000000, propagate_forward_time: 11.7598133087, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6560993195
validation[          , genome  6598] predictions:    9750/  10000 (97.50%), best:    9731/10000 (97.31%), error:       863.03857, best error:       841.83405 on epoch:    29, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 158.0177459717s, input_fired_time: 1.7790119648, output_fired_time: 1.7995023727, propagate_forward_time: 58.7046241760, propagate_backward_time: 92.0094680786, weight_update_time: 0.2318582386, other_time: 3.7251510620
epoch time: 12.7798690796s, input_fired_time: 0.2241417170, output_fired_time: 0.0000000000, propagate_forward_time: 11.8927221298, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6630048752
validation[          , genome  6598] predictions:    9682/  10000 (96.82%), best:    9731/10000 (97.31%), error:       984.48450, best error:       841.83405 on epoch:    29, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 156.4846038818s, input_fired_time: 1.7775090933, output_fired_time: 1.7863302231, propagate_forward_time: 58.1198043823, propagate_backward_time: 91.0357437134, weight_update_time: 0.2316699475, other_time: 3.7652130127
epoch time: 12.2328920364s, input_fired_time: 0.2169639766, output_fired_time: 0.0000000000, propagate_forward_time: 11.3608245850, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6551036835
validation[          , genome  6598] predictions:    9699/  10000 (96.99%), best:    9731/10000 (97.31%), error:       993.09845, best error:       841.83405 on epoch:    29, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 157.5830383301s, input_fired_time: 1.7764751911, output_fired_time: 1.8032473326, propagate_forward_time: 58.1136131287, propagate_backward_time: 92.1182632446, weight_update_time: 0.2328656167, other_time: 3.7714309692
epoch time: 11.7659072876s, input_fired_time: 0.2129473686, output_fired_time: 0.0000000000, propagate_forward_time: 10.9139938354, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6389656067
validation[          , genome  6598] predictions:    9711/  10000 (97.11%), best:    9731/10000 (97.31%), error:       952.82104, best error:       841.83405 on epoch:    29, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 158.0733795166s, input_fired_time: 1.7807521820, output_fired_time: 1.8014355898, propagate_forward_time: 58.4367599487, propagate_backward_time: 92.3310928345, weight_update_time: 0.2326120883, other_time: 3.7233428955
epoch time: 12.6003227234s, input_fired_time: 0.2243424803, output_fired_time: 0.0000000000, propagate_forward_time: 11.6848230362, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6911573410
validation[          , genome  6598] predictions:    9735/  10000 (97.35%), best:    9731/10000 (97.31%), error:       898.24377, best error:       841.83405 on epoch:    29, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 157.8166656494s, input_fired_time: 1.7855812311, output_fired_time: 1.7962340117, propagate_forward_time: 58.5024108887, propagate_backward_time: 91.9843673706, weight_update_time: 0.2324181646, other_time: 3.7480697632
epoch time: 12.7669343948s, input_fired_time: 0.2253811508, output_fired_time: 0.0000000000, propagate_forward_time: 11.8745279312, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6670255661
validation[          , genome  6598] predictions:    9751/  10000 (97.51%), best:    9751/10000 (97.51%), error:       823.69403, best error:       823.69403 on epoch:    37, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 157.1547546387s, input_fired_time: 1.7978919744, output_fired_time: 1.7947639227, propagate_forward_time: 58.2335700989, propagate_backward_time: 91.5730438232, weight_update_time: 0.2326626182, other_time: 3.7554779053
epoch time: 12.4707603455s, input_fired_time: 0.2230018675, output_fired_time: 0.0000000000, propagate_forward_time: 11.5778264999, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6699323654
validation[          , genome  6598] predictions:    9678/  10000 (96.78%), best:    9751/10000 (97.51%), error:      1026.96118, best error:       823.69403 on epoch:    37, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 156.1697998047s, input_fired_time: 1.7767349482, output_fired_time: 1.7869198322, propagate_forward_time: 57.9127883911, propagate_backward_time: 90.9638442993, weight_update_time: 0.2296205163, other_time: 3.7295074463
epoch time: 12.0447874069s, input_fired_time: 0.2152869105, output_fired_time: 0.0000000000, propagate_forward_time: 11.1650676727, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6644325256
validation[          , genome  6598] predictions:    9745/  10000 (97.45%), best:    9751/10000 (97.51%), error:       849.28967, best error:       823.69403 on epoch:    37, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 157.4203491211s, input_fired_time: 1.7862597704, output_fired_time: 1.7947455645, propagate_forward_time: 58.4688148499, propagate_backward_time: 91.6466140747, weight_update_time: 0.2316368669, other_time: 3.7239303589
epoch time: 12.4845333099s, input_fired_time: 0.2214561999, output_fired_time: 0.0000000000, propagate_forward_time: 11.5978746414, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6652021408
validation[          , genome  6598] predictions:    9715/  10000 (97.15%), best:    9751/10000 (97.51%), error:       952.22357, best error:       823.69403 on epoch:    37, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 156.9676513672s, input_fired_time: 1.7851266861, output_fired_time: 1.8038375378, propagate_forward_time: 58.2747001648, propagate_backward_time: 91.3560638428, weight_update_time: 0.2309057564, other_time: 3.7479248047
epoch time: 12.5483541489s, input_fired_time: 0.2227312922, output_fired_time: 0.0000000000, propagate_forward_time: 11.6482419968, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6773805618
validation[          , genome  6598] predictions:    9726/  10000 (97.26%), best:    9751/10000 (97.51%), error:       879.47113, best error:       823.69403 on epoch:    37, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 157.8711547852s, input_fired_time: 1.7864077091, output_fired_time: 1.8139202595, propagate_forward_time: 58.4605407715, propagate_backward_time: 92.0926513672, weight_update_time: 0.2311801910, other_time: 3.7176361084
epoch time: 12.3240833282s, input_fired_time: 0.2200791389, output_fired_time: 0.0000000000, propagate_forward_time: 11.4389877319, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6650161743
validation[          , genome  6598] predictions:    9700/  10000 (97.00%), best:    9751/10000 (97.51%), error:       924.94147, best error:       823.69403 on epoch:    37, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 156.0833892822s, input_fired_time: 1.7726377249, output_fired_time: 1.7853025198, propagate_forward_time: 57.7165374756, propagate_backward_time: 91.0840835571, weight_update_time: 0.2288940102, other_time: 3.7248153687
epoch time: 12.5119295120s, input_fired_time: 0.2226217687, output_fired_time: 0.0000000000, propagate_forward_time: 11.6068181992, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6824893951
validation[          , genome  6598] predictions:    9717/  10000 (97.17%), best:    9751/10000 (97.51%), error:       903.58600, best error:       823.69403 on epoch:    37, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 155.8786773682s, input_fired_time: 1.7772309780, output_fired_time: 1.7795995474, propagate_forward_time: 57.8468894958, propagate_backward_time: 90.7271575928, weight_update_time: 0.2291976959, other_time: 3.7477874756
epoch time: 12.7269172668s, input_fired_time: 0.2252903283, output_fired_time: 0.0000000000, propagate_forward_time: 11.8387060165, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6629209518
validation[          , genome  6598] predictions:    9757/  10000 (97.57%), best:    9757/10000 (97.57%), error:       817.81268, best error:       817.81268 on epoch:    44, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 157.6286010742s, input_fired_time: 1.7917149067, output_fired_time: 1.8103846312, propagate_forward_time: 58.4904289246, propagate_backward_time: 91.8005523682, weight_update_time: 0.2322779894, other_time: 3.7355194092
epoch time: 12.4862537384s, input_fired_time: 0.2192261815, output_fired_time: 0.0000000000, propagate_forward_time: 11.5932292938, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6737985611
validation[          , genome  6598] predictions:    9722/  10000 (97.22%), best:    9757/10000 (97.57%), error:       925.35309, best error:       817.81268 on epoch:    44, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 156.4373016357s, input_fired_time: 1.7878695726, output_fired_time: 1.7876018286, propagate_forward_time: 58.1684036255, propagate_backward_time: 90.9443664551, weight_update_time: 0.2316698730, other_time: 3.7490615845
epoch time: 12.7270097733s, input_fired_time: 0.2255196124, output_fired_time: 0.0000000000, propagate_forward_time: 11.8350181580, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6664724350
validation[          , genome  6598] predictions:    9689/  10000 (96.89%), best:    9757/10000 (97.57%), error:       956.58142, best error:       817.81268 on epoch:    44, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 155.5720825195s, input_fired_time: 1.7737164497, output_fired_time: 1.7837072611, propagate_forward_time: 57.4824142456, propagate_backward_time: 90.7750625610, weight_update_time: 0.2294553220, other_time: 3.7571868896
epoch time: 12.7165861130s, input_fired_time: 0.2259345502, output_fired_time: 0.0000000000, propagate_forward_time: 11.7803974152, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7102537155
validation[          , genome  6598] predictions:    9718/  10000 (97.18%), best:    9757/10000 (97.57%), error:       904.47253, best error:       817.81268 on epoch:    44, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 156.5732269287s, input_fired_time: 1.7859486341, output_fired_time: 1.7939915657, propagate_forward_time: 57.9975929260, propagate_backward_time: 91.2784500122, weight_update_time: 0.2307277471, other_time: 3.7172470093
epoch time: 12.6288290024s, input_fired_time: 0.2222954035, output_fired_time: 0.0000000000, propagate_forward_time: 11.7501268387, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6564064026
validation[          , genome  6598] predictions:    9742/  10000 (97.42%), best:    9757/10000 (97.57%), error:       857.41370, best error:       817.81268 on epoch:    44, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 158.8153686523s, input_fired_time: 1.8015747070, output_fired_time: 1.8161644936, propagate_forward_time: 58.9294548035, propagate_backward_time: 92.5598297119, weight_update_time: 0.2338837683, other_time: 3.7083435059
epoch time: 12.6397409439s, input_fired_time: 0.2231336832, output_fired_time: 0.0000000000, propagate_forward_time: 11.7577505112, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6588563919
validation[          , genome  6598] predictions:    9722/  10000 (97.22%), best:    9757/10000 (97.57%), error:       884.79926, best error:       817.81268 on epoch:    44, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 158.0309143066s, input_fired_time: 1.7979775667, output_fired_time: 1.8004055023, propagate_forward_time: 58.6861839294, propagate_backward_time: 91.9827041626, weight_update_time: 0.2321404070, other_time: 3.7636489868
epoch time: 12.5974206924s, input_fired_time: 0.2219437063, output_fired_time: 0.0000000000, propagate_forward_time: 11.7188100815, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6566667557
validation[          , genome  6598] predictions:    9717/  10000 (97.17%), best:    9757/10000 (97.57%), error:       926.51343, best error:       817.81268 on epoch:    44, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 155.7501831055s, input_fired_time: 1.7814066410, output_fired_time: 1.7742879391, propagate_forward_time: 57.6732101440, propagate_backward_time: 90.7911529541, weight_update_time: 0.2307479382, other_time: 3.7301254272
epoch time: 12.4709358215s, input_fired_time: 0.2256945372, output_fired_time: 0.0000000000, propagate_forward_time: 11.5344009399, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7108402252
validation[          , genome  6598] predictions:    9722/  10000 (97.22%), best:    9757/10000 (97.57%), error:       929.81317, best error:       817.81268 on epoch:    44, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 156.0674896240s, input_fired_time: 1.7860671282, output_fired_time: 1.7789030075, propagate_forward_time: 57.5330886841, propagate_backward_time: 91.2322769165, weight_update_time: 0.2294010967, other_time: 3.7371520996
epoch time: 12.8725976944s, input_fired_time: 0.2257560492, output_fired_time: 0.0000000000, propagate_forward_time: 11.9876670837, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6591749191
validation[          , genome  6598] predictions:    9749/  10000 (97.49%), best:    9757/10000 (97.57%), error:       833.51471, best error:       817.81268 on epoch:    44, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 158.5912780762s, input_fired_time: 1.8036261797, output_fired_time: 1.8087463379, propagate_forward_time: 58.6381263733, propagate_backward_time: 92.5773925781, weight_update_time: 0.2323764563, other_time: 3.7633972168
epoch time: 12.8029165268s, input_fired_time: 0.2269438207, output_fired_time: 0.0000000000, propagate_forward_time: 11.9143905640, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6615819931
validation[          , genome  6598] predictions:    9730/  10000 (97.30%), best:    9757/10000 (97.57%), error:       887.35535, best error:       817.81268 on epoch:    44, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 157.4709472656s, input_fired_time: 1.7973023653, output_fired_time: 1.7944781780, propagate_forward_time: 58.3949279785, propagate_backward_time: 91.6791610718, weight_update_time: 0.2324689329, other_time: 3.8050765991
epoch time: 12.5900192261s, input_fired_time: 0.2233090401, output_fired_time: 0.0000000000, propagate_forward_time: 11.6947135925, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6719970703
validation[          , genome  6598] predictions:    9721/  10000 (97.21%), best:    9757/10000 (97.57%), error:       941.92108, best error:       817.81268 on epoch:    44, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 157.9205627441s, input_fired_time: 1.7961617708, output_fired_time: 1.8130064011, propagate_forward_time: 58.4085464478, propagate_backward_time: 92.1414031982, weight_update_time: 0.2315118015, other_time: 3.7614517212
epoch time: 12.8447313309s, input_fired_time: 0.2276752442, output_fired_time: 0.0000000000, propagate_forward_time: 11.9459400177, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6711158752
validation[          , genome  6598] predictions:    9755/  10000 (97.55%), best:    9755/10000 (97.55%), error:       796.77618, best error:       796.77618 on epoch:    55, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 157.6042785645s, input_fired_time: 1.7983881235, output_fired_time: 1.8101041317, propagate_forward_time: 58.4952735901, propagate_backward_time: 91.6943588257, weight_update_time: 0.2308667004, other_time: 3.8061599731
epoch time: 12.6628675461s, input_fired_time: 0.2267982364, output_fired_time: 0.0000000000, propagate_forward_time: 11.7353754044, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7006940842
validation[          , genome  6598] predictions:    9710/  10000 (97.10%), best:    9755/10000 (97.55%), error:       920.68384, best error:       796.77618 on epoch:    55, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 157.5150909424s, input_fired_time: 1.7982090712, output_fired_time: 1.7979036570, propagate_forward_time: 58.6055412292, propagate_backward_time: 91.6060943604, weight_update_time: 0.2317984700, other_time: 3.7073516846
epoch time: 12.6386489868s, input_fired_time: 0.2267897725, output_fired_time: 0.0000000000, propagate_forward_time: 11.7260208130, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6858386993
validation[          , genome  6598] predictions:    9700/  10000 (97.00%), best:    9755/10000 (97.55%), error:       982.55145, best error:       796.77618 on epoch:    55, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 158.0841064453s, input_fired_time: 1.8000119925, output_fired_time: 1.8055357933, propagate_forward_time: 58.4835128784, propagate_backward_time: 92.2635650635, weight_update_time: 0.2322990596, other_time: 3.7314682007
epoch time: 12.7743215561s, input_fired_time: 0.2248344272, output_fired_time: 0.0000000000, propagate_forward_time: 11.8858737946, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6636133194
validation[          , genome  6598] predictions:    9739/  10000 (97.39%), best:    9739/10000 (97.39%), error:       787.83331, best error:       787.83331 on epoch:    58, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 158.2743377686s, input_fired_time: 1.8020446301, output_fired_time: 1.8101162910, propagate_forward_time: 58.7949409485, propagate_backward_time: 92.1499481201, weight_update_time: 0.2328518629, other_time: 3.7172851563
epoch time: 12.5123300552s, input_fired_time: 0.2249612957, output_fired_time: 0.0000000000, propagate_forward_time: 11.5829277039, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7044410706
validation[          , genome  6598] predictions:    9745/  10000 (97.45%), best:    9739/10000 (97.39%), error:       807.07379, best error:       787.83331 on epoch:    58, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 157.6043243408s, input_fired_time: 1.8052566051, output_fired_time: 1.8105769157, propagate_forward_time: 58.7783813477, propagate_backward_time: 91.4201507568, weight_update_time: 0.2323933691, other_time: 3.7899627686
epoch time: 12.4657697678s, input_fired_time: 0.2243664116, output_fired_time: 0.0000000000, propagate_forward_time: 11.5733776093, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6680259705
validation[          , genome  6598] predictions:    9711/  10000 (97.11%), best:    9739/10000 (97.39%), error:       905.84973, best error:       787.83331 on epoch:    58, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 157.5868377686s, input_fired_time: 1.7995359898, output_fired_time: 1.7879154682, propagate_forward_time: 58.4107894897, propagate_backward_time: 91.8551483154, weight_update_time: 0.2326172888, other_time: 3.7334518433
epoch time: 12.7989377975s, input_fired_time: 0.2288545668, output_fired_time: 0.0000000000, propagate_forward_time: 11.8913516998, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6787319183
validation[          , genome  6598] predictions:    9729/  10000 (97.29%), best:    9739/10000 (97.39%), error:       863.97687, best error:       787.83331 on epoch:    58, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 156.6932830811s, input_fired_time: 1.7968876362, output_fired_time: 1.7794466019, propagate_forward_time: 57.8334999084, propagate_backward_time: 91.5367889404, weight_update_time: 0.2312071323, other_time: 3.7466583252
epoch time: 12.6806278229s, input_fired_time: 0.2263561040, output_fired_time: 0.0000000000, propagate_forward_time: 11.7933187485, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6609525681
validation[          , genome  6598] predictions:    9710/  10000 (97.10%), best:    9739/10000 (97.39%), error:       954.77557, best error:       787.83331 on epoch:    58, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 157.6209259033s, input_fired_time: 1.7998032570, output_fired_time: 1.8006904125, propagate_forward_time: 58.2904586792, propagate_backward_time: 91.9613189697, weight_update_time: 0.2315421551, other_time: 3.7686538696
epoch time: 12.4657630920s, input_fired_time: 0.2202856690, output_fired_time: 0.0000000000, propagate_forward_time: 11.5851640701, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6603136063
validation[          , genome  6598] predictions:    9713/  10000 (97.13%), best:    9739/10000 (97.39%), error:       925.99487, best error:       787.83331 on epoch:    58, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 158.7658996582s, input_fired_time: 1.8036206961, output_fired_time: 1.8047071695, propagate_forward_time: 58.9732475281, propagate_backward_time: 92.4250259399, weight_update_time: 0.2325785607, other_time: 3.7593002319
epoch time: 12.9062147141s, input_fired_time: 0.2284881920, output_fired_time: 0.0000000000, propagate_forward_time: 12.0127239227, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6650028229
validation[          , genome  6598] predictions:    9746/  10000 (97.46%), best:    9739/10000 (97.39%), error:       808.87183, best error:       787.83331 on epoch:    58, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 155.5135803223s, input_fired_time: 1.7920686007, output_fired_time: 1.7742850780, propagate_forward_time: 57.7204627991, propagate_backward_time: 90.4012756348, weight_update_time: 0.2297003567, other_time: 3.8254852295
epoch time: 12.8025178909s, input_fired_time: 0.2288894355, output_fired_time: 0.0000000000, propagate_forward_time: 11.9008302689, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6727981567
validation[          , genome  6598] predictions:    9727/  10000 (97.27%), best:    9739/10000 (97.39%), error:       873.62726, best error:       787.83331 on epoch:    58, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 157.5361175537s, input_fired_time: 1.8046317101, output_fired_time: 1.8105777502, propagate_forward_time: 58.3023223877, propagate_backward_time: 91.8581542969, weight_update_time: 0.2317868471, other_time: 3.7604370117
epoch time: 12.9001951218s, input_fired_time: 0.2288350463, output_fired_time: 0.0000000000, propagate_forward_time: 12.0050840378, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6662759781
validation[          , genome  6598] predictions:    9741/  10000 (97.41%), best:    9739/10000 (97.39%), error:       836.51648, best error:       787.83331 on epoch:    58, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 154.5695037842s, input_fired_time: 1.7747892141, output_fired_time: 1.7674340010, propagate_forward_time: 57.0018386841, propagate_backward_time: 90.2956466675, weight_update_time: 0.2279889733, other_time: 3.7297821045
epoch time: 12.3007555008s, input_fired_time: 0.2225870192, output_fired_time: 0.0000000000, propagate_forward_time: 11.3736009598, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7045679092
validation[          , genome  6598] predictions:    9737/  10000 (97.37%), best:    9739/10000 (97.39%), error:       845.67932, best error:       787.83331 on epoch:    58, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 158.4217224121s, input_fired_time: 1.8119826317, output_fired_time: 1.8153977394, propagate_forward_time: 58.5476684570, propagate_backward_time: 92.4621658325, weight_update_time: 0.2314526290, other_time: 3.7845077515
epoch time: 12.7932300568s, input_fired_time: 0.2281053364, output_fired_time: 0.0000000000, propagate_forward_time: 11.8877115250, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6774129868
validation[          , genome  6598] predictions:    9743/  10000 (97.43%), best:    9739/10000 (97.39%), error:       806.48438, best error:       787.83331 on epoch:    58, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 157.9644622803s, input_fired_time: 1.8084125519, output_fired_time: 1.7962218523, propagate_forward_time: 58.6271629333, propagate_backward_time: 91.9406204224, weight_update_time: 0.2325202972, other_time: 3.7920455933
epoch time: 12.7499523163s, input_fired_time: 0.2307196110, output_fired_time: 0.0000000000, propagate_forward_time: 11.8188447952, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7003879547
validation[          , genome  6598] predictions:    9747/  10000 (97.47%), best:    9739/10000 (97.39%), error:       815.09528, best error:       787.83331 on epoch:    58, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 158.0662231445s, input_fired_time: 1.8116078377, output_fired_time: 1.8107938766, propagate_forward_time: 58.5185966492, propagate_backward_time: 92.1703109741, weight_update_time: 0.2312509567, other_time: 3.7549057007
epoch time: 12.6357116699s, input_fired_time: 0.2260173410, output_fired_time: 0.0000000000, propagate_forward_time: 11.7340822220, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6756124496
validation[          , genome  6598] predictions:    9691/  10000 (96.91%), best:    9739/10000 (97.39%), error:       966.25562, best error:       787.83331 on epoch:    58, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 158.8860626221s, input_fired_time: 1.8087739944, output_fired_time: 1.8114898205, propagate_forward_time: 58.7311897278, propagate_backward_time: 92.7786254883, weight_update_time: 0.2340177149, other_time: 3.7559814453
epoch time: 11.8880453110s, input_fired_time: 0.2188949287, output_fired_time: 0.0000000000, propagate_forward_time: 11.0354433060, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6337070465
validation[          , genome  6598] predictions:    9725/  10000 (97.25%), best:    9739/10000 (97.39%), error:       867.11090, best error:       787.83331 on epoch:    58, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 157.3074798584s, input_fired_time: 1.8005832434, output_fired_time: 1.7826325893, propagate_forward_time: 58.3357200623, propagate_backward_time: 91.6475601196, weight_update_time: 0.2306204885, other_time: 3.7409744263
epoch time: 12.5429620743s, input_fired_time: 0.2283417434, output_fired_time: 0.0000000000, propagate_forward_time: 11.6476240158, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6669960022
validation[          , genome  6598] predictions:    9644/  10000 (96.44%), best:    9739/10000 (97.39%), error:      1151.88525, best error:       787.83331 on epoch:    58, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 159.8126068115s, input_fired_time: 1.8234063387, output_fired_time: 1.8252080679, propagate_forward_time: 59.3298988342, propagate_backward_time: 93.0894012451, weight_update_time: 0.2350356579, other_time: 3.7446899414
epoch time: 12.8133802414s, input_fired_time: 0.2288567871, output_fired_time: 0.0000000000, propagate_forward_time: 11.8936462402, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6908769608
validation[          , genome  6598] predictions:    9740/  10000 (97.40%), best:    9739/10000 (97.39%), error:       851.37219, best error:       787.83331 on epoch:    58, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 159.1261138916s, input_fired_time: 1.8155934811, output_fired_time: 1.8179410696, propagate_forward_time: 59.0192794800, propagate_backward_time: 92.7263031006, weight_update_time: 0.2334346473, other_time: 3.7469863892
epoch time: 12.3202123642s, input_fired_time: 0.2251077294, output_fired_time: 0.0000000000, propagate_forward_time: 11.4274177551, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6676864624
validation[          , genome  6598] predictions:    9747/  10000 (97.47%), best:    9747/10000 (97.47%), error:       786.85303, best error:       786.85303 on epoch:    74, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 158.7516479492s, input_fired_time: 1.8155930042, output_fired_time: 1.8186569214, propagate_forward_time: 58.8246307373, propagate_backward_time: 92.5387725830, weight_update_time: 0.2319404185, other_time: 3.7539978027
epoch time: 12.5087499619s, input_fired_time: 0.2271361351, output_fired_time: 0.0000000000, propagate_forward_time: 11.6071949005, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6744194031
validation[          , genome  6598] predictions:    9727/  10000 (97.27%), best:    9747/10000 (97.47%), error:       840.84143, best error:       786.85303 on epoch:    74, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 156.4539947510s, input_fired_time: 1.8118534088, output_fired_time: 1.7925046682, propagate_forward_time: 58.1625938416, propagate_backward_time: 90.9457092285, weight_update_time: 0.2300115824, other_time: 3.7413177490
epoch time: 12.8960657120s, input_fired_time: 0.2315761894, output_fired_time: 0.0000000000, propagate_forward_time: 11.9762563705, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6882333755
validation[          , genome  6598] predictions:    9717/  10000 (97.17%), best:    9747/10000 (97.47%), error:       917.28625, best error:       786.85303 on epoch:    74, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 158.4573059082s, input_fired_time: 1.8180931807, output_fired_time: 1.7995005846, propagate_forward_time: 58.8790588379, propagate_backward_time: 92.0897445679, weight_update_time: 0.2336554378, other_time: 3.8709030151
epoch time: 12.3239793777s, input_fired_time: 0.2271664292, output_fired_time: 0.0000000000, propagate_forward_time: 11.3975782394, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6992349625
validation[          , genome  6598] predictions:    9750/  10000 (97.50%), best:    9747/10000 (97.47%), error:       809.58044, best error:       786.85303 on epoch:    74, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 158.9565429688s, input_fired_time: 1.8120121956, output_fired_time: 1.8118951321, propagate_forward_time: 58.7845039368, propagate_backward_time: 92.7666320801, weight_update_time: 0.2327539176, other_time: 3.7815093994
epoch time: 12.5418567657s, input_fired_time: 0.2260586917, output_fired_time: 0.0000000000, propagate_forward_time: 11.6046705246, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7111272812
validation[          , genome  6598] predictions:    9705/  10000 (97.05%), best:    9747/10000 (97.47%), error:       978.20032, best error:       786.85303 on epoch:    74, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 158.1496124268s, input_fired_time: 1.8094969988, output_fired_time: 1.8111904860, propagate_forward_time: 58.4294052124, propagate_backward_time: 92.2856903076, weight_update_time: 0.2320570797, other_time: 3.8138351440
epoch time: 12.8044767380s, input_fired_time: 0.2305967361, output_fired_time: 0.0000000000, propagate_forward_time: 11.9099731445, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6639070511
validation[          , genome  6598] predictions:    9753/  10000 (97.53%), best:    9747/10000 (97.47%), error:       791.38910, best error:       786.85303 on epoch:    74, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 157.1119079590s, input_fired_time: 1.8098943233, output_fired_time: 1.7972453833, propagate_forward_time: 58.1495170593, propagate_backward_time: 91.6166534424, weight_update_time: 0.2313991785, other_time: 3.7386016846
epoch time: 12.8753614426s, input_fired_time: 0.2295963317, output_fired_time: 0.0000000000, propagate_forward_time: 11.9754257202, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6703395844
validation[          , genome  6598] predictions:    9714/  10000 (97.14%), best:    9747/10000 (97.47%), error:       868.85217, best error:       786.85303 on epoch:    74, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 158.2306060791s, input_fired_time: 1.8136485815, output_fired_time: 1.8087097406, propagate_forward_time: 58.6414680481, propagate_backward_time: 92.2067413330, weight_update_time: 0.2319401950, other_time: 3.7600402832
epoch time: 12.6345605850s, input_fired_time: 0.2291653603, output_fired_time: 0.0000000000, propagate_forward_time: 11.7301588058, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6752367020
validation[          , genome  6598] predictions:    9748/  10000 (97.48%), best:    9747/10000 (97.47%), error:       825.55542, best error:       786.85303 on epoch:    74, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 155.8406372070s, input_fired_time: 1.8015708923, output_fired_time: 1.7683141232, propagate_forward_time: 57.6753311157, propagate_backward_time: 90.8976593018, weight_update_time: 0.2286421508, other_time: 3.6977615356
epoch time: 12.5831174850s, input_fired_time: 0.2278003842, output_fired_time: 0.0000000000, propagate_forward_time: 11.6521587372, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7031583786
validation[          , genome  6598] predictions:    9660/  10000 (96.60%), best:    9747/10000 (97.47%), error:      1123.32861, best error:       786.85303 on epoch:    74, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 157.8513031006s, input_fired_time: 1.8175647259, output_fired_time: 1.8036310673, propagate_forward_time: 58.6927375793, propagate_backward_time: 91.7759704590, weight_update_time: 0.2322466820, other_time: 3.7613983154
epoch time: 12.8252630234s, input_fired_time: 0.2331709862, output_fired_time: 0.0000000000, propagate_forward_time: 11.9235277176, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6685647964
validation[          , genome  6598] predictions:    9761/  10000 (97.61%), best:    9747/10000 (97.47%), error:       818.25073, best error:       786.85303 on epoch:    74, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 157.4036254883s, input_fired_time: 1.8144577742, output_fired_time: 1.7979960442, propagate_forward_time: 58.2487258911, propagate_backward_time: 91.8461990356, weight_update_time: 0.2316520512, other_time: 3.6962585449
epoch time: 12.3716659546s, input_fired_time: 0.2254474461, output_fired_time: 0.0000000000, propagate_forward_time: 11.4990730286, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6471452713
validation[          , genome  6598] predictions:    9640/  10000 (96.40%), best:    9747/10000 (97.47%), error:      1153.63684, best error:       786.85303 on epoch:    74, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 157.8067779541s, input_fired_time: 1.8132702112, output_fired_time: 1.8079050779, propagate_forward_time: 58.3354454041, propagate_backward_time: 92.0600204468, weight_update_time: 0.2326350063, other_time: 3.7901382446
epoch time: 12.2329816818s, input_fired_time: 0.2261963338, output_fired_time: 0.0000000000, propagate_forward_time: 11.3506517410, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6561336517
validation[          , genome  6598] predictions:    9738/  10000 (97.38%), best:    9747/10000 (97.47%), error:       857.75775, best error:       786.85303 on epoch:    74, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 156.8444061279s, input_fired_time: 1.8122553825, output_fired_time: 1.7964988947, propagate_forward_time: 57.9200935364, propagate_backward_time: 91.5450210571, weight_update_time: 0.2310697734, other_time: 3.7705459595
epoch time: 12.8342123032s, input_fired_time: 0.2317510992, output_fired_time: 0.0000000000, propagate_forward_time: 11.8865022659, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7159585953
validation[          , genome  6598] predictions:    9723/  10000 (97.23%), best:    9747/10000 (97.47%), error:       892.76581, best error:       786.85303 on epoch:    74, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 155.2261657715s, input_fired_time: 1.8008140326, output_fired_time: 1.7801449299, propagate_forward_time: 57.6255531311, propagate_backward_time: 90.2810211182, weight_update_time: 0.2287675887, other_time: 3.7386322021
epoch time: 12.9372549057s, input_fired_time: 0.2321166396, output_fired_time: 0.0000000000, propagate_forward_time: 12.0374298096, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6677083969
validation[          , genome  6598] predictions:    9639/  10000 (96.39%), best:    9747/10000 (97.47%), error:      1165.78210, best error:       786.85303 on epoch:    74, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 154.8829650879s, input_fired_time: 1.7900366783, output_fired_time: 1.7757879496, propagate_forward_time: 57.2939300537, propagate_backward_time: 90.3358230591, weight_update_time: 0.2288195193, other_time: 3.6873855591
epoch time: 12.6963520050s, input_fired_time: 0.2230625153, output_fired_time: 0.0000000000, propagate_forward_time: 11.8109970093, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6622924805
validation[          , genome  6598] predictions:    9642/  10000 (96.42%), best:    9747/10000 (97.47%), error:      1185.47205, best error:       786.85303 on epoch:    74, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 155.5582885742s, input_fired_time: 1.7894378901, output_fired_time: 1.7786356211, propagate_forward_time: 57.7529220581, propagate_backward_time: 90.5528945923, weight_update_time: 0.2291588336, other_time: 3.6843872070
epoch time: 11.4058866501s, input_fired_time: 0.2116438150, output_fired_time: 0.0000000000, propagate_forward_time: 10.5336894989, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6605529785
validation[          , genome  6598] predictions:    9767/  10000 (97.67%), best:    9767/10000 (97.67%), error:       755.18958, best error:       755.18958 on epoch:    89, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 157.9854583740s, input_fired_time: 1.8186705112, output_fired_time: 1.7958068848, propagate_forward_time: 58.7364616394, propagate_backward_time: 91.9263000488, weight_update_time: 0.2319663316, other_time: 3.7082214355
epoch time: 12.8807706833s, input_fired_time: 0.2296546549, output_fired_time: 0.0000000000, propagate_forward_time: 11.9807310104, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6703853607
validation[          , genome  6598] predictions:    9743/  10000 (97.43%), best:    9767/10000 (97.67%), error:       849.84937, best error:       755.18958 on epoch:    89, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 157.2447052002s, input_fired_time: 1.8188806772, output_fired_time: 1.8000229597, propagate_forward_time: 58.2900886536, propagate_backward_time: 91.5989074707, weight_update_time: 0.2307194024, other_time: 3.7368164063
epoch time: 12.7251691818s, input_fired_time: 0.2326224595, output_fired_time: 0.0000000000, propagate_forward_time: 11.7831249237, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7094221115
validation[          , genome  6598] predictions:    9678/  10000 (96.78%), best:    9767/10000 (97.67%), error:      1040.50146, best error:       755.18958 on epoch:    89, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 155.2528839111s, input_fired_time: 1.8054728508, output_fired_time: 1.7772443295, propagate_forward_time: 57.4280509949, propagate_backward_time: 90.4937286377, weight_update_time: 0.2289906144, other_time: 3.7483978271
epoch time: 12.7819423676s, input_fired_time: 0.2311154306, output_fired_time: 0.0000000000, propagate_forward_time: 11.8607683182, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6900587082
validation[          , genome  6598] predictions:    9708/  10000 (97.08%), best:    9767/10000 (97.67%), error:       948.03949, best error:       755.18958 on epoch:    89, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 158.7443542480s, input_fired_time: 1.8278274536, output_fired_time: 1.8092824221, propagate_forward_time: 58.8279380798, propagate_backward_time: 92.4854049683, weight_update_time: 0.2319787443, other_time: 3.7939071655
epoch time: 10.9588537216s, input_fired_time: 0.2083199024, output_fired_time: 0.0000000000, propagate_forward_time: 10.1086988449, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6418352127
validation[          , genome  6598] predictions:    9725/  10000 (97.25%), best:    9767/10000 (97.67%), error:       880.11859, best error:       755.18958 on epoch:    89, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 153.6459960938s, input_fired_time: 1.7921069860, output_fired_time: 1.7531075478, propagate_forward_time: 56.6275138855, propagate_backward_time: 89.7526245117, weight_update_time: 0.2283414751, other_time: 3.7206268311
epoch time: 12.7912445068s, input_fired_time: 0.2286498845, output_fired_time: 0.0000000000, propagate_forward_time: 11.8960390091, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6665554047
validation[          , genome  6598] predictions:    9723/  10000 (97.23%), best:    9767/10000 (97.67%), error:       929.08533, best error:       755.18958 on epoch:    89, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 158.5891723633s, input_fired_time: 1.8293582201, output_fired_time: 1.8181426525, propagate_forward_time: 58.7888526917, propagate_backward_time: 92.3026123047, weight_update_time: 0.2321751714, other_time: 3.8502044678
epoch time: 12.8126983643s, input_fired_time: 0.2311611772, output_fired_time: 0.0000000000, propagate_forward_time: 11.9139499664, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6675872803
validation[          , genome  6598] predictions:    9703/  10000 (97.03%), best:    9767/10000 (97.67%), error:       905.78156, best error:       755.18958 on epoch:    89, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 159.2360229492s, input_fired_time: 1.8416484594, output_fired_time: 1.8186793327, propagate_forward_time: 59.1945686340, propagate_backward_time: 92.6167449951, weight_update_time: 0.2344225496, other_time: 3.7643890381
epoch time: 12.6787996292s, input_fired_time: 0.2306502014, output_fired_time: 0.0000000000, propagate_forward_time: 11.7723197937, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6758298874
validation[          , genome  6598] predictions:    9725/  10000 (97.25%), best:    9767/10000 (97.67%), error:       894.83911, best error:       755.18958 on epoch:    89, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 157.9423217773s, input_fired_time: 1.8209732771, output_fired_time: 1.8089213371, propagate_forward_time: 58.2938728333, propagate_backward_time: 92.2815856934, weight_update_time: 0.2318475097, other_time: 3.7369842529
epoch time: 12.9406032562s, input_fired_time: 0.2336286604, output_fired_time: 0.0000000000, propagate_forward_time: 12.0459585190, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6610164642
validation[          , genome  6598] predictions:    9719/  10000 (97.19%), best:    9767/10000 (97.67%), error:       917.17981, best error:       755.18958 on epoch:    89, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 158.1648254395s, input_fired_time: 1.8245295286, output_fired_time: 1.8048355579, propagate_forward_time: 58.6566658020, propagate_backward_time: 92.0732116699, weight_update_time: 0.2334536910, other_time: 3.8055877686
epoch time: 12.5833978653s, input_fired_time: 0.2284975499, output_fired_time: 0.0000000000, propagate_forward_time: 11.6748485565, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6800518036
validation[          , genome  6598] predictions:    9736/  10000 (97.36%), best:    9767/10000 (97.67%), error:       848.18494, best error:       755.18958 on epoch:    89, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 158.8913116455s, input_fired_time: 1.8335455656, output_fired_time: 1.8090040684, propagate_forward_time: 58.8850440979, propagate_backward_time: 92.5634460449, weight_update_time: 0.2342765331, other_time: 3.8002777100
epoch time: 12.5221815109s, input_fired_time: 0.2284486294, output_fired_time: 0.0000000000, propagate_forward_time: 11.6288776398, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6648550034
validation[          , genome  6598] predictions:    9767/  10000 (97.67%), best:    9767/10000 (97.67%), error:       809.28979, best error:       755.18958 on epoch:    89, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 152.9913330078s, input_fired_time: 1.7968071699, output_fired_time: 1.7489368916, propagate_forward_time: 56.8725166321, propagate_backward_time: 88.8891525269, weight_update_time: 0.2277404219, other_time: 3.6839218140
epoch time: 12.0315923691s, input_fired_time: 0.2260947824, output_fired_time: 0.0000000000, propagate_forward_time: 11.1446781158, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6608190536
validation[          , genome  6598] predictions:    9754/  10000 (97.54%), best:    9767/10000 (97.67%), error:       814.76611, best error:       755.18958 on epoch:    89, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 63.4259109497s, input_fired_time: 1.1471054554, output_fired_time: 0.0000000000, propagate_forward_time: 58.7583007813, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5205039978
best training[          , genome  6598] predictions:   49715/  50000 (99.43%), best:    9767/10000 (97.67%), error:      1267.03992, best error:       755.18958 on epoch:    89, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 12.2893981934s, input_fired_time: 0.2242244780, output_fired_time: 0.0000000000, propagate_forward_time: 11.3933601379, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6718139648
   testing[          , genome  6598] predictions:    9804/  10000 (98.04%), best:    9767/10000 (97.67%), error:       640.40216, best error:       755.18958 on epoch:    89, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
07:54:10 (1300): called boinc_finish(0)

</stderr_txt>
]]>