Nameexact_genome_1512568488_43_6356_0
Workunit2603062
Created7 Dec 2017, 19:19:52 UTC
Sent7 Dec 2017, 19:28:21 UTC
Report deadline16 Dec 2017, 10:43:13 UTC
Received9 Dec 2017, 12:25:12 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID62426
Run time5 hours 47 min 35 sec
CPU time5 hours 27 min 29 sec
Validate stateValid
Credit2,158.83
Device peak FLOPS2.98 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size154.11 MB
Peak swap size152.46 MB
Peak disk usage1.91 MB

Stderr output

<core_client_version>7.6.22</core_client_version>
<![CDATA[
<stderr_txt>
    942.15845 on epoch:    13, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 183.9431152344s, input_fired_time: 1.6221870184, output_fired_time: 1.7753789425, propagate_forward_time: 69.8684005737, propagate_backward_time: 106.8529357910, weight_update_time: 0.2169073522, other_time: 3.8242111206
epoch time: 16.7280750275s, input_fired_time: 0.2022878081, output_fired_time: 0.0000000000, propagate_forward_time: 15.9328842163, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5929031372
validation[          , genome  6356] predictions:    9696/  10000 (96.96%), best:    9719/10000 (97.19%), error:       979.01923, best error:       942.15845 on epoch:    13, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 182.3680114746s, input_fired_time: 1.5920109749, output_fired_time: 1.7501646280, propagate_forward_time: 69.9642486572, propagate_backward_time: 105.7416000366, weight_update_time: 0.2134827524, other_time: 3.3199844360
epoch time: 14.6827287674s, input_fired_time: 0.1964018047, output_fired_time: 0.0000000000, propagate_forward_time: 13.9095544815, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5767726898
validation[          , genome  6356] predictions:    9676/  10000 (96.76%), best:    9719/10000 (97.19%), error:      1047.54089, best error:       942.15845 on epoch:    13, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 187.1740417480s, input_fired_time: 1.6884883642, output_fired_time: 1.7605572939, propagate_forward_time: 71.8402252197, propagate_backward_time: 108.5789947510, weight_update_time: 0.2135127634, other_time: 3.3057708740
epoch time: 14.9122695923s, input_fired_time: 0.1956418306, output_fired_time: 0.0000000000, propagate_forward_time: 14.0972547531, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6193733215
validation[          , genome  6356] predictions:    9712/  10000 (97.12%), best:    9719/10000 (97.19%), error:       950.71832, best error:       942.15845 on epoch:    13, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 182.5136871338s, input_fired_time: 1.5994324684, output_fired_time: 1.7702252865, propagate_forward_time: 69.9813232422, propagate_backward_time: 105.8687133789, weight_update_time: 0.2139513195, other_time: 3.2940063477
epoch time: 14.6832923889s, input_fired_time: 0.1959449202, output_fired_time: 0.0000000000, propagate_forward_time: 13.9104013443, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5769462585
validation[          , genome  6356] predictions:    9693/  10000 (96.93%), best:    9719/10000 (97.19%), error:      1073.40637, best error:       942.15845 on epoch:    13, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 207.3240203857s, input_fired_time: 1.6615301371, output_fired_time: 1.8463137150, propagate_forward_time: 71.3552474976, propagate_backward_time: 129.1250762939, weight_update_time: 0.2131559998, other_time: 3.3358612061
epoch time: 17.1846771240s, input_fired_time: 0.1976121515, output_fired_time: 0.0000000000, propagate_forward_time: 16.4051990509, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5818653107
validation[          , genome  6356] predictions:    9671/  10000 (96.71%), best:    9719/10000 (97.19%), error:      1033.64441, best error:       942.15845 on epoch:    13, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 174.9812927246s, input_fired_time: 1.5605916977, output_fired_time: 1.7092503309, propagate_forward_time: 66.7073211670, propagate_backward_time: 101.7890625000, weight_update_time: 0.2139793336, other_time: 3.2150726318
epoch time: 17.0071926117s, input_fired_time: 0.2292365134, output_fired_time: 0.0000000000, propagate_forward_time: 16.1024990082, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6754570007
validation[          , genome  6356] predictions:    9723/  10000 (97.23%), best:    9723/10000 (97.23%), error:       937.12036, best error:       937.12036 on epoch:    20, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 181.8234405518s, input_fired_time: 1.6006884575, output_fired_time: 1.7697654963, propagate_forward_time: 69.8676071167, propagate_backward_time: 105.3719177246, weight_update_time: 0.2137117088, other_time: 3.2134628296
epoch time: 20.2430076599s, input_fired_time: 0.2613396049, output_fired_time: 0.0000000000, propagate_forward_time: 19.0796966553, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9019718170
validation[          , genome  6356] predictions:    9716/  10000 (97.16%), best:    9716/10000 (97.16%), error:       923.00061, best error:       923.00061 on epoch:    21, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 189.8357543945s, input_fired_time: 1.7976886034, output_fired_time: 1.8206502199, propagate_forward_time: 72.7234039307, propagate_backward_time: 109.9833602905, weight_update_time: 0.2145241052, other_time: 3.5106582642
epoch time: 15.8190536499s, input_fired_time: 0.1992586106, output_fired_time: 0.0000000000, propagate_forward_time: 14.9230051041, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6967897415
validation[          , genome  6356] predictions:    9652/  10000 (96.52%), best:    9716/10000 (97.16%), error:      1145.43335, best error:       923.00061 on epoch:    21, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 187.8815460205s, input_fired_time: 1.7109493017, output_fired_time: 1.8034963608, propagate_forward_time: 71.5510711670, propagate_backward_time: 109.5006484985, weight_update_time: 0.2125480473, other_time: 3.3153762817
epoch time: 23.5344257355s, input_fired_time: 0.2296723574, output_fired_time: 0.0000000000, propagate_forward_time: 22.3415489197, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9632053375
validation[          , genome  6356] predictions:    9677/  10000 (96.77%), best:    9716/10000 (97.16%), error:      1053.44348, best error:       923.00061 on epoch:    21, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 198.2723083496s, input_fired_time: 1.6911753416, output_fired_time: 1.7891913652, propagate_forward_time: 84.1786651611, propagate_backward_time: 107.3124313354, weight_update_time: 0.2443550527, other_time: 3.3008499146
epoch time: 14.4614219666s, input_fired_time: 0.1979008764, output_fired_time: 0.0000000000, propagate_forward_time: 13.6911106110, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5724105835
validation[          , genome  6356] predictions:    9709/  10000 (97.09%), best:    9716/10000 (97.16%), error:       993.12402, best error:       923.00061 on epoch:    21, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 181.1778869629s, input_fired_time: 1.6086853743, output_fired_time: 1.7601310015, propagate_forward_time: 69.4632797241, propagate_backward_time: 105.1121292114, weight_update_time: 0.2140127271, other_time: 3.2336578369
epoch time: 16.1981830597s, input_fired_time: 0.1956646591, output_fired_time: 0.0000000000, propagate_forward_time: 15.3683614731, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6341562271
validation[          , genome  6356] predictions:    9710/  10000 (97.10%), best:    9716/10000 (97.16%), error:       935.52228, best error:       923.00061 on epoch:    21, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 167.9360961914s, input_fired_time: 1.4995974302, output_fired_time: 1.6903765202, propagate_forward_time: 63.1462974548, propagate_backward_time: 98.2555770874, weight_update_time: 0.2068885863, other_time: 3.3442306519
epoch time: 14.4518413544s, input_fired_time: 0.1945540309, output_fired_time: 0.0000000000, propagate_forward_time: 13.6844911575, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5727958679
validation[          , genome  6356] predictions:    9634/  10000 (96.34%), best:    9716/10000 (97.16%), error:      1255.59631, best error:       923.00061 on epoch:    21, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 181.9844970703s, input_fired_time: 1.6137124300, output_fired_time: 1.7499628067, propagate_forward_time: 69.8533325195, propagate_backward_time: 105.5084991455, weight_update_time: 0.2140394449, other_time: 3.2589874268
epoch time: 14.4640026093s, input_fired_time: 0.1955330074, output_fired_time: 0.0000000000, propagate_forward_time: 13.6956214905, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5728483200
validation[          , genome  6356] predictions:    9752/  10000 (97.52%), best:    9752/10000 (97.52%), error:       878.33752, best error:       878.33752 on epoch:    27, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 192.2073211670s, input_fired_time: 1.6411666870, output_fired_time: 1.9074232578, propagate_forward_time: 73.5617218018, propagate_backward_time: 111.6220703125, weight_update_time: 0.2432609349, other_time: 3.4749450684
epoch time: 13.3953161240s, input_fired_time: 0.1761443466, output_fired_time: 0.0000000000, propagate_forward_time: 12.5827159882, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6364555359
validation[          , genome  6356] predictions:    9765/  10000 (97.65%), best:    9765/10000 (97.65%), error:       809.57715, best error:       809.57715 on epoch:    28, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 180.6206817627s, input_fired_time: 1.5809834003, output_fired_time: 1.7590703964, propagate_forward_time: 68.1679153442, propagate_backward_time: 105.8547821045, weight_update_time: 0.2126678377, other_time: 3.2579421997
epoch time: 26.0438652039s, input_fired_time: 0.3273020089, output_fired_time: 0.0000000000, propagate_forward_time: 24.7834281921, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9331340790
validation[          , genome  6356] predictions:    9622/  10000 (96.22%), best:    9765/10000 (97.65%), error:      1176.54700, best error:       809.57715 on epoch:    28, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 184.7457580566s, input_fired_time: 1.6289227009, output_fired_time: 1.8147325516, propagate_forward_time: 70.8165054321, propagate_backward_time: 107.2567214966, weight_update_time: 0.2138834745, other_time: 3.2288818359
epoch time: 16.3312721252s, input_fired_time: 0.1982333958, output_fired_time: 0.0000000000, propagate_forward_time: 15.4652194977, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6678199768
validation[          , genome  6356] predictions:    9704/  10000 (97.04%), best:    9765/10000 (97.65%), error:       959.54175, best error:       809.57715 on epoch:    28, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 186.4179534912s, input_fired_time: 1.6095087528, output_fired_time: 1.8180813789, propagate_forward_time: 71.4452590942, propagate_backward_time: 108.2489242554, weight_update_time: 0.2135783136, other_time: 3.2961730957
epoch time: 16.2877922058s, input_fired_time: 0.2302929610, output_fired_time: 0.0000000000, propagate_forward_time: 15.4184341431, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6390647888
validation[          , genome  6356] predictions:    9717/  10000 (97.17%), best:    9765/10000 (97.65%), error:       940.62201, best error:       809.57715 on epoch:    28, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 182.8014984131s, input_fired_time: 1.6062710285, output_fired_time: 1.7586925030, propagate_forward_time: 70.3705673218, propagate_backward_time: 105.8208923340, weight_update_time: 0.2140956521, other_time: 3.2450637817
epoch time: 15.6554965973s, input_fired_time: 0.1959860772, output_fired_time: 0.0000000000, propagate_forward_time: 14.8262004852, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6333103180
validation[          , genome  6356] predictions:    9742/  10000 (97.42%), best:    9765/10000 (97.65%), error:       871.99164, best error:       809.57715 on epoch:    28, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 185.5316162109s, input_fired_time: 1.5984423161, output_fired_time: 1.8491414785, propagate_forward_time: 71.3610000610, propagate_backward_time: 107.4260635376, weight_update_time: 0.2142196000, other_time: 3.2969665527
epoch time: 18.8288993835s, input_fired_time: 0.2897781134, output_fired_time: 0.0000000000, propagate_forward_time: 17.8028697968, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7362518311
validation[          , genome  6356] predictions:    9707/  10000 (97.07%), best:    9765/10000 (97.65%), error:       964.49829, best error:       809.57715 on epoch:    28, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 197.6371307373s, input_fired_time: 1.8454531431, output_fired_time: 1.9961624146, propagate_forward_time: 74.3261795044, propagate_backward_time: 116.0108642578, weight_update_time: 0.2439730167, other_time: 3.4584579468
epoch time: 16.0779304504s, input_fired_time: 0.1978743076, output_fired_time: 0.0000000000, propagate_forward_time: 15.2733688354, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6066875458
validation[          , genome  6356] predictions:    9721/  10000 (97.21%), best:    9765/10000 (97.65%), error:       970.79608, best error:       809.57715 on epoch:    28, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 181.8332672119s, input_fired_time: 1.6149429083, output_fired_time: 1.7974880934, propagate_forward_time: 69.9271316528, propagate_backward_time: 105.2610702515, weight_update_time: 0.2131613344, other_time: 3.2326354980
epoch time: 15.2643728256s, input_fired_time: 0.1990460753, output_fired_time: 0.0000000000, propagate_forward_time: 14.4565830231, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6087436676
validation[          , genome  6356] predictions:    9732/  10000 (97.32%), best:    9765/10000 (97.65%), error:       877.37695, best error:       809.57715 on epoch:    28, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 183.8691711426s, input_fired_time: 1.5935680866, output_fired_time: 1.7368968725, propagate_forward_time: 70.4788360596, propagate_backward_time: 106.8480072021, weight_update_time: 0.2130970657, other_time: 3.2118682861
epoch time: 30.3693542480s, input_fired_time: 0.4049650729, output_fired_time: 0.0000000000, propagate_forward_time: 28.8715782166, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0928115845
validation[          , genome  6356] predictions:    9744/  10000 (97.44%), best:    9765/10000 (97.65%), error:       852.13855, best error:       809.57715 on epoch:    28, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 156.5809783936s, input_fired_time: 1.4949814081, output_fired_time: 1.6038485765, propagate_forward_time: 58.2169189453, propagate_backward_time: 92.0760116577, weight_update_time: 0.2038751394, other_time: 3.1892166138
epoch time: 16.4511375427s, input_fired_time: 1.6003619432, output_fired_time: 0.0000000000, propagate_forward_time: 14.2768459320, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5739297867
validation[          , genome  6356] predictions:    9755/  10000 (97.55%), best:    9765/10000 (97.65%), error:       862.37988, best error:       809.57715 on epoch:    28, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 190.6242980957s, input_fired_time: 1.7298057079, output_fired_time: 1.9861695766, propagate_forward_time: 73.2190628052, propagate_backward_time: 110.3268661499, weight_update_time: 0.2135008126, other_time: 3.3623809814
epoch time: 15.7657604218s, input_fired_time: 0.1977192014, output_fired_time: 0.0000000000, propagate_forward_time: 14.9267435074, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6412973404
validation[          , genome  6356] predictions:    9692/  10000 (96.92%), best:    9765/10000 (97.65%), error:      1009.27008, best error:       809.57715 on epoch:    28, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 180.9139404297s, input_fired_time: 1.6026238203, output_fired_time: 1.7532012463, propagate_forward_time: 69.3788070679, propagate_backward_time: 104.9471359253, weight_update_time: 0.2134542763, other_time: 3.2321624756
epoch time: 22.3141365051s, input_fired_time: 0.2628850937, output_fired_time: 0.0000000000, propagate_forward_time: 21.1204967499, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9307537079
validation[          , genome  6356] predictions:    9734/  10000 (97.34%), best:    9765/10000 (97.65%), error:       929.50818, best error:       809.57715 on epoch:    28, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 193.0340118408s, input_fired_time: 1.6762553453, output_fired_time: 1.8065454960, propagate_forward_time: 77.0383911133, propagate_backward_time: 109.1485900879, weight_update_time: 0.2446627170, other_time: 3.3642272949
epoch time: 14.6402797699s, input_fired_time: 0.2005004287, output_fired_time: 0.0000000000, propagate_forward_time: 13.8563432693, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5834360123
validation[          , genome  6356] predictions:    9724/  10000 (97.24%), best:    9765/10000 (97.65%), error:       898.81396, best error:       809.57715 on epoch:    28, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 180.3182983398s, input_fired_time: 1.6339199543, output_fired_time: 1.7561428547, propagate_forward_time: 68.9936981201, propagate_backward_time: 104.6907043457, weight_update_time: 0.2138908654, other_time: 3.2438201904
epoch time: 14.7392292023s, input_fired_time: 0.2001474947, output_fired_time: 0.0000000000, propagate_forward_time: 13.9665098190, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5725717545
validation[          , genome  6356] predictions:    9733/  10000 (97.33%), best:    9765/10000 (97.65%), error:       870.94287, best error:       809.57715 on epoch:    28, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 181.8976593018s, input_fired_time: 1.6015648842, output_fired_time: 1.7488975525, propagate_forward_time: 69.7821273804, propagate_backward_time: 105.4991455078, weight_update_time: 0.2140324116, other_time: 3.2659225464
epoch time: 15.6097097397s, input_fired_time: 0.2006263435, output_fired_time: 0.0000000000, propagate_forward_time: 14.8278017044, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5812816620
validation[          , genome  6356] predictions:    9688/  10000 (96.88%), best:    9765/10000 (97.65%), error:      1034.30872, best error:       809.57715 on epoch:    28, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 181.5263519287s, input_fired_time: 1.6078253984, output_fired_time: 1.7432861328, propagate_forward_time: 69.7154083252, propagate_backward_time: 105.2154998779, weight_update_time: 0.2167944908, other_time: 3.2443389893
epoch time: 17.0858097076s, input_fired_time: 0.2000565827, output_fired_time: 0.0000000000, propagate_forward_time: 16.1533241272, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7324295044
validation[          , genome  6356] predictions:    9745/  10000 (97.45%), best:    9765/10000 (97.65%), error:       831.13080, best error:       809.57715 on epoch:    28, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 182.6255340576s, input_fired_time: 1.6195613146, output_fired_time: 1.7432833910, propagate_forward_time: 69.9408798218, propagate_backward_time: 106.1039047241, weight_update_time: 0.2131351680, other_time: 3.2178955078
epoch time: 15.8790016174s, input_fired_time: 0.2316695005, output_fired_time: 0.0000000000, propagate_forward_time: 15.0067300797, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6406021118
validation[          , genome  6356] predictions:    9723/  10000 (97.23%), best:    9765/10000 (97.65%), error:       932.58990, best error:       809.57715 on epoch:    28, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 186.3062591553s, input_fired_time: 1.6465554237, output_fired_time: 1.8066620827, propagate_forward_time: 71.7079162598, propagate_backward_time: 107.8093643188, weight_update_time: 0.2130828053, other_time: 3.3357620239
epoch time: 29.8046951294s, input_fired_time: 0.2318581045, output_fired_time: 0.0000000000, propagate_forward_time: 28.7942886353, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7785491943
validation[          , genome  6356] predictions:    9734/  10000 (97.34%), best:    9765/10000 (97.65%), error:       911.22620, best error:       809.57715 on epoch:    28, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 183.2103729248s, input_fired_time: 1.6489969492, output_fired_time: 1.7913612127, propagate_forward_time: 70.1153182983, propagate_backward_time: 106.3824996948, weight_update_time: 0.2178663015, other_time: 3.2721862793
epoch time: 14.6603212357s, input_fired_time: 0.2004381567, output_fired_time: 0.0000000000, propagate_forward_time: 13.8777866364, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5820960999
validation[          , genome  6356] predictions:    9766/  10000 (97.66%), best:    9766/10000 (97.66%), error:       794.45715, best error:       794.45715 on epoch:    46, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 181.7958526611s, input_fired_time: 1.6007736921, output_fired_time: 1.7472306490, propagate_forward_time: 69.5073013306, propagate_backward_time: 105.7038192749, weight_update_time: 0.2127940357, other_time: 3.2367248535
epoch time: 36.8502922058s, input_fired_time: 0.3597521782, output_fired_time: 0.0000000000, propagate_forward_time: 35.4676132202, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0229263306
validation[          , genome  6356] predictions:    9675/  10000 (96.75%), best:    9766/10000 (97.66%), error:       991.74725, best error:       794.45715 on epoch:    46, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 196.1799926758s, input_fired_time: 1.6818084717, output_fired_time: 1.9843535423, propagate_forward_time: 75.3350372314, propagate_backward_time: 113.6605529785, weight_update_time: 0.2144692987, other_time: 3.5182342529
epoch time: 16.4156150818s, input_fired_time: 0.2312706709, output_fired_time: 0.0000000000, propagate_forward_time: 15.5086755753, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6756696701
validation[          , genome  6356] predictions:    9738/  10000 (97.38%), best:    9766/10000 (97.66%), error:       916.93481, best error:       794.45715 on epoch:    46, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 181.6096038818s, input_fired_time: 1.6305364370, output_fired_time: 1.8152728081, propagate_forward_time: 69.4785995483, propagate_backward_time: 105.4571228027, weight_update_time: 0.2138223946, other_time: 3.2280654907
epoch time: 22.0335006714s, input_fired_time: 0.2655914724, output_fired_time: 0.0000000000, propagate_forward_time: 21.0629730225, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7049369812
validation[          , genome  6356] predictions:    9716/  10000 (97.16%), best:    9766/10000 (97.66%), error:       923.93439, best error:       794.45715 on epoch:    46, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 181.1992492676s, input_fired_time: 1.6129697561, output_fired_time: 1.7505767345, propagate_forward_time: 69.6639862061, propagate_backward_time: 104.9321975708, weight_update_time: 0.2136652321, other_time: 3.2395095825
epoch time: 20.6179218292s, input_fired_time: 0.2382202148, output_fired_time: 0.0000000000, propagate_forward_time: 19.5397720337, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8399295807
validation[          , genome  6356] predictions:    9714/  10000 (97.14%), best:    9766/10000 (97.66%), error:       984.18481, best error:       794.45715 on epoch:    46, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 163.1644439697s, input_fired_time: 1.5030106306, output_fired_time: 1.6141642332, propagate_forward_time: 61.2999038696, propagate_backward_time: 95.5072326660, weight_update_time: 0.2087770849, other_time: 3.2401351929
epoch time: 15.6178770065s, input_fired_time: 0.1990777254, output_fired_time: 0.0000000000, propagate_forward_time: 14.7824735641, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6363258362
validation[          , genome  6356] predictions:    9745/  10000 (97.45%), best:    9766/10000 (97.66%), error:       865.46051, best error:       794.45715 on epoch:    46, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 181.1506042480s, input_fired_time: 1.6064777374, output_fired_time: 1.7927908897, propagate_forward_time: 69.5886917114, propagate_backward_time: 104.9342956543, weight_update_time: 0.2131789774, other_time: 3.2283554077
epoch time: 15.4996299744s, input_fired_time: 0.2314208597, output_fired_time: 0.0000000000, propagate_forward_time: 14.6994524002, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5687570572
validation[          , genome  6356] predictions:    9688/  10000 (96.88%), best:    9766/10000 (97.66%), error:      1029.37024, best error:       794.45715 on epoch:    46, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 181.7640838623s, input_fired_time: 1.6111357212, output_fired_time: 1.7612276077, propagate_forward_time: 69.8799285889, propagate_backward_time: 105.2808303833, weight_update_time: 0.2133248299, other_time: 3.2309646606
epoch time: 15.6153726578s, input_fired_time: 0.2010902017, output_fired_time: 0.0000000000, propagate_forward_time: 14.7951784134, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6191043854
validation[          , genome  6356] predictions:    9753/  10000 (97.53%), best:    9766/10000 (97.66%), error:       850.22168, best error:       794.45715 on epoch:    46, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 180.9886474609s, input_fired_time: 1.6078460217, output_fired_time: 1.7518228292, propagate_forward_time: 69.4944458008, propagate_backward_time: 104.9024887085, weight_update_time: 0.2135663182, other_time: 3.2320480347
epoch time: 15.9790410995s, input_fired_time: 0.2023805827, output_fired_time: 0.0000000000, propagate_forward_time: 15.1245498657, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6521110535
validation[          , genome  6356] predictions:    9749/  10000 (97.49%), best:    9766/10000 (97.66%), error:       848.60767, best error:       794.45715 on epoch:    46, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 183.3236236572s, input_fired_time: 1.6117377281, output_fired_time: 1.8283370733, propagate_forward_time: 70.4919509888, propagate_backward_time: 106.1462936401, weight_update_time: 0.2141637653, other_time: 3.2453002930
epoch time: 16.1542968750s, input_fired_time: 0.2321714908, output_fired_time: 0.0000000000, propagate_forward_time: 15.3138704300, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6082553864
validation[          , genome  6356] predictions:    9736/  10000 (97.36%), best:    9766/10000 (97.66%), error:       901.75269, best error:       794.45715 on epoch:    46, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 193.4474945068s, input_fired_time: 1.6748018265, output_fired_time: 1.8752359152, propagate_forward_time: 74.4966735840, propagate_backward_time: 111.9986953735, weight_update_time: 0.2146377563, other_time: 3.4020919800
epoch time: 20.1463489532s, input_fired_time: 0.2320525646, output_fired_time: 0.0000000000, propagate_forward_time: 19.3095245361, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6047725677
validation[          , genome  6356] predictions:    9749/  10000 (97.49%), best:    9766/10000 (97.66%), error:       848.55853, best error:       794.45715 on epoch:    46, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 189.9506835938s, input_fired_time: 1.7069054842, output_fired_time: 1.8119413853, propagate_forward_time: 72.6893310547, propagate_backward_time: 110.3377227783, weight_update_time: 0.2134211659, other_time: 3.4047851563
epoch time: 28.9525108337s, input_fired_time: 0.3606179655, output_fired_time: 0.0000000000, propagate_forward_time: 27.5311985016, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0606937408
validation[          , genome  6356] predictions:    9772/  10000 (97.72%), best:    9772/10000 (97.72%), error:       775.63312, best error:       775.63312 on epoch:    57, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 181.7358551025s, input_fired_time: 1.6113156080, output_fired_time: 1.7522789240, propagate_forward_time: 69.8203964233, propagate_backward_time: 105.2849807739, weight_update_time: 0.2555069029, other_time: 3.2668914795
epoch time: 25.8869590759s, input_fired_time: 0.1997309327, output_fired_time: 0.0000000000, propagate_forward_time: 25.1174011230, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5698261261
validation[          , genome  6356] predictions:    9742/  10000 (97.42%), best:    9772/10000 (97.72%), error:       837.72705, best error:       775.63312 on epoch:    57, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 182.2829895020s, input_fired_time: 1.6448144913, output_fired_time: 1.7506732941, propagate_forward_time: 70.1061706543, propagate_backward_time: 105.5720062256, weight_update_time: 0.2131466717, other_time: 3.2093200684
epoch time: 16.5533008575s, input_fired_time: 0.2000054419, output_fired_time: 0.0000000000, propagate_forward_time: 15.7145404816, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6387557983
validation[          , genome  6356] predictions:    9753/  10000 (97.53%), best:    9772/10000 (97.72%), error:       856.55627, best error:       775.63312 on epoch:    57, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 182.3446044922s, input_fired_time: 1.6175183058, output_fired_time: 1.7863227129, propagate_forward_time: 70.0695266724, propagate_backward_time: 105.6525421143, weight_update_time: 0.2136014253, other_time: 3.2186965942
epoch time: 20.9461002350s, input_fired_time: 0.2953214645, output_fired_time: 0.0000000000, propagate_forward_time: 19.8918094635, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7589702606
validation[          , genome  6356] predictions:    9735/  10000 (97.35%), best:    9772/10000 (97.72%), error:       872.98743, best error:       775.63312 on epoch:    57, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 184.7224273682s, input_fired_time: 1.5953414440, output_fired_time: 1.7295343876, propagate_forward_time: 70.6297988892, propagate_backward_time: 107.4681930542, weight_update_time: 0.2139150798, other_time: 3.2995605469
epoch time: 14.6317968369s, input_fired_time: 0.2003052682, output_fired_time: 0.0000000000, propagate_forward_time: 13.8594770432, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5720148087
validation[          , genome  6356] predictions:    9787/  10000 (97.87%), best:    9772/10000 (97.72%), error:       778.38855, best error:       775.63312 on epoch:    57, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 187.4084167480s, input_fired_time: 1.6322830915, output_fired_time: 1.7917251587, propagate_forward_time: 71.5791931152, propagate_backward_time: 109.0115051270, weight_update_time: 0.2300851643, other_time: 3.3937072754
epoch time: 14.8211479187s, input_fired_time: 0.2009119689, output_fired_time: 0.0000000000, propagate_forward_time: 14.0443296432, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5759067535
validation[          , genome  6356] predictions:    9748/  10000 (97.48%), best:    9772/10000 (97.72%), error:       828.54413, best error:       775.63312 on epoch:    57, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 216.7842559814s, input_fired_time: 1.8195824623, output_fired_time: 1.8502807617, propagate_forward_time: 85.3945388794, propagate_backward_time: 122.6990661621, weight_update_time: 0.2176645398, other_time: 5.0207901001
epoch time: 14.6451025009s, input_fired_time: 0.2003368586, output_fired_time: 0.0000000000, propagate_forward_time: 13.8701219559, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5746440887
validation[          , genome  6356] predictions:    9750/  10000 (97.50%), best:    9772/10000 (97.72%), error:       828.53174, best error:       775.63312 on epoch:    57, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 190.6598968506s, input_fired_time: 1.6916397810, output_fired_time: 1.7938067913, propagate_forward_time: 72.8469085693, propagate_backward_time: 111.0075073242, weight_update_time: 0.2167783827, other_time: 3.3200378418
epoch time: 14.9958381653s, input_fired_time: 0.2011349201, output_fired_time: 0.0000000000, propagate_forward_time: 14.2185382843, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5761651993
validation[          , genome  6356] predictions:    9750/  10000 (97.50%), best:    9772/10000 (97.72%), error:       804.80420, best error:       775.63312 on epoch:    57, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 184.5597534180s, input_fired_time: 1.6177861691, output_fired_time: 1.8136512041, propagate_forward_time: 70.8145828247, propagate_backward_time: 107.0878982544, weight_update_time: 0.2137895226, other_time: 3.2258453369
epoch time: 14.7393846512s, input_fired_time: 0.2019594610, output_fired_time: 0.0000000000, propagate_forward_time: 13.9620113373, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5754137039
validation[          , genome  6356] predictions:    9785/  10000 (97.85%), best:    9772/10000 (97.72%), error:       784.13324, best error:       775.63312 on epoch:    57, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 184.8640441895s, input_fired_time: 1.6175006628, output_fired_time: 1.7947628498, propagate_forward_time: 71.1368331909, propagate_backward_time: 107.0719680786, weight_update_time: 0.2146434039, other_time: 3.2429656982
epoch time: 14.9969110489s, input_fired_time: 0.2011899352, output_fired_time: 0.0000000000, propagate_forward_time: 14.2183408737, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5773801804
validation[          , genome  6356] predictions:    9699/  10000 (96.99%), best:    9772/10000 (97.72%), error:      1016.85291, best error:       775.63312 on epoch:    57, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 189.4833526611s, input_fired_time: 1.6438925266, output_fired_time: 1.7613784075, propagate_forward_time: 72.7414550781, propagate_backward_time: 109.9037857056, weight_update_time: 0.2157159448, other_time: 3.4328384399
epoch time: 26.2091999054s, input_fired_time: 0.3598712981, output_fired_time: 0.0000000000, propagate_forward_time: 25.1067256927, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7426033020
validation[          , genome  6356] predictions:    9663/  10000 (96.63%), best:    9772/10000 (97.72%), error:      1090.67432, best error:       775.63312 on epoch:    57, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 208.6455383301s, input_fired_time: 1.8089237213, output_fired_time: 1.9439857006, propagate_forward_time: 83.8289337158, propagate_backward_time: 117.5229721069, weight_update_time: 0.2462562621, other_time: 3.5407180786
epoch time: 15.6128292084s, input_fired_time: 0.2341890931, output_fired_time: 0.0000000000, propagate_forward_time: 14.8015909195, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5770492554
validation[          , genome  6356] predictions:    9757/  10000 (97.57%), best:    9772/10000 (97.72%), error:       851.62897, best error:       775.63312 on epoch:    57, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 180.1902618408s, input_fired_time: 1.6099358797, output_fired_time: 1.7438945770, propagate_forward_time: 69.3446350098, propagate_backward_time: 104.3054046631, weight_update_time: 0.2124809474, other_time: 3.1863861084
epoch time: 16.3695507050s, input_fired_time: 0.2041740119, output_fired_time: 0.0000000000, propagate_forward_time: 15.5529804230, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6123962402
validation[          , genome  6356] predictions:    9752/  10000 (97.52%), best:    9772/10000 (97.72%), error:       797.51080, best error:       775.63312 on epoch:    57, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 182.7629852295s, input_fired_time: 1.6256661415, output_fired_time: 1.8309426308, propagate_forward_time: 69.9806518555, propagate_backward_time: 106.0568618774, weight_update_time: 0.2140229344, other_time: 3.2688522339
epoch time: 16.8692588806s, input_fired_time: 0.2309196442, output_fired_time: 0.0000000000, propagate_forward_time: 15.9243545532, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7139854431
validation[          , genome  6356] predictions:    9749/  10000 (97.49%), best:    9772/10000 (97.72%), error:       864.51575, best error:       775.63312 on epoch:    57, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 179.8482513428s, input_fired_time: 1.6079324484, output_fired_time: 1.7332805395, propagate_forward_time: 69.0257186890, propagate_backward_time: 104.2334594727, weight_update_time: 0.2132733017, other_time: 3.2478713989
epoch time: 14.9696598053s, input_fired_time: 0.2030943334, output_fired_time: 0.0000000000, propagate_forward_time: 14.1822032928, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5843620300
validation[          , genome  6356] predictions:    9703/  10000 (97.03%), best:    9772/10000 (97.72%), error:       947.47113, best error:       775.63312 on epoch:    57, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 193.0846099854s, input_fired_time: 1.7216624022, output_fired_time: 1.7673559189, propagate_forward_time: 70.3411254883, propagate_backward_time: 116.0154342651, weight_update_time: 0.2159411013, other_time: 3.2390365601
epoch time: 13.9564447403s, input_fired_time: 0.2442198545, output_fired_time: 0.0000000000, propagate_forward_time: 13.0971164703, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6151084900
validation[          , genome  6356] predictions:    9716/  10000 (97.16%), best:    9772/10000 (97.72%), error:       985.05994, best error:       775.63312 on epoch:    57, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 188.2399749756s, input_fired_time: 1.6222223043, output_fired_time: 1.7978291512, propagate_forward_time: 70.3888778687, propagate_backward_time: 111.1704025269, weight_update_time: 0.2141979486, other_time: 3.2606353760
epoch time: 18.1336593628s, input_fired_time: 0.3359034359, output_fired_time: 0.0000000000, propagate_forward_time: 17.0864810944, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7112751007
validation[          , genome  6356] predictions:    9762/  10000 (97.62%), best:    9772/10000 (97.72%), error:       811.65918, best error:       775.63312 on epoch:    57, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 182.2005462646s, input_fired_time: 1.6520944834, output_fired_time: 1.7915018797, propagate_forward_time: 69.8383178711, propagate_backward_time: 105.5884704590, weight_update_time: 0.2125820071, other_time: 3.3301544189
epoch time: 14.6253128052s, input_fired_time: 0.2044790089, output_fired_time: 0.0000000000, propagate_forward_time: 13.8473196030, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5735139847
validation[          , genome  6356] predictions:    9760/  10000 (97.60%), best:    9772/10000 (97.72%), error:       804.13336, best error:       775.63312 on epoch:    57, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 189.0855102539s, input_fired_time: 1.6252194643, output_fired_time: 1.8262820244, propagate_forward_time: 72.1812744141, propagate_backward_time: 110.1103134155, weight_update_time: 0.2155018449, other_time: 3.3424301147
epoch time: 17.4867210388s, input_fired_time: 0.2990698516, output_fired_time: 0.0000000000, propagate_forward_time: 16.4830627441, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7045879364
validation[          , genome  6356] predictions:    9746/  10000 (97.46%), best:    9772/10000 (97.72%), error:       822.66431, best error:       775.63312 on epoch:    57, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 158.0224456787s, input_fired_time: 1.5274358988, output_fired_time: 1.5819706917, propagate_forward_time: 58.6623878479, propagate_backward_time: 92.9329528809, weight_update_time: 0.2081747800, other_time: 3.3177032471
epoch time: 16.2587013245s, input_fired_time: 0.5345965028, output_fired_time: 0.0000000000, propagate_forward_time: 15.1420488358, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5820560455
validation[          , genome  6356] predictions:    9734/  10000 (97.34%), best:    9772/10000 (97.72%), error:       883.47845, best error:       775.63312 on epoch:    57, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 198.1592864990s, input_fired_time: 1.7924906015, output_fired_time: 1.8359992504, propagate_forward_time: 75.9699325562, propagate_backward_time: 115.1234741211, weight_update_time: 0.2250804156, other_time: 3.4373855591
epoch time: 14.9446153641s, input_fired_time: 0.2340977788, output_fired_time: 0.0000000000, propagate_forward_time: 14.1386213303, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5718965530
validation[          , genome  6356] predictions:    9750/  10000 (97.50%), best:    9772/10000 (97.72%), error:       834.37115, best error:       775.63312 on epoch:    57, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 181.3531494141s, input_fired_time: 1.6405882835, output_fired_time: 1.7638102770, propagate_forward_time: 69.5628585815, propagate_backward_time: 105.1335678101, weight_update_time: 0.2144139409, other_time: 3.2523193359
epoch time: 15.4964675903s, input_fired_time: 0.2049251497, output_fired_time: 0.0000000000, propagate_forward_time: 14.6800413132, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6115007401
validation[          , genome  6356] predictions:    9705/  10000 (97.05%), best:    9772/10000 (97.72%), error:       998.98328, best error:       775.63312 on epoch:    57, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 191.2675018311s, input_fired_time: 1.6242218018, output_fired_time: 1.7864792347, propagate_forward_time: 78.8546905518, propagate_backward_time: 105.7612152100, weight_update_time: 0.2124914229, other_time: 3.2408905029
epoch time: 15.4770040512s, input_fired_time: 0.2663833201, output_fired_time: 0.0000000000, propagate_forward_time: 14.6349439621, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5756769180
validation[          , genome  6356] predictions:    9728/  10000 (97.28%), best:    9772/10000 (97.72%), error:       863.88617, best error:       775.63312 on epoch:    57, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 181.6983184814s, input_fired_time: 1.6265758276, output_fired_time: 1.7619445324, propagate_forward_time: 69.9286193848, propagate_backward_time: 105.1812667847, weight_update_time: 0.2135169655, other_time: 3.1999130249
epoch time: 19.4544849396s, input_fired_time: 0.2698459029, output_fired_time: 0.0000000000, propagate_forward_time: 18.4506111145, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7340278625
validation[          , genome  6356] predictions:    9742/  10000 (97.42%), best:    9772/10000 (97.72%), error:       844.62000, best error:       775.63312 on epoch:    57, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 197.8644409180s, input_fired_time: 1.6690589190, output_fired_time: 1.8236782551, propagate_forward_time: 72.3245086670, propagate_backward_time: 118.6636352539, weight_update_time: 0.2812579870, other_time: 3.3835601807
epoch time: 17.5323295593s, input_fired_time: 0.2041960955, output_fired_time: 0.0000000000, propagate_forward_time: 16.6562881470, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6718444824
validation[          , genome  6356] predictions:    9758/  10000 (97.58%), best:    9772/10000 (97.72%), error:       785.15973, best error:       775.63312 on epoch:    57, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 183.6905975342s, input_fired_time: 1.6271163225, output_fired_time: 1.7610534430, propagate_forward_time: 70.5202331543, propagate_backward_time: 106.5110549927, weight_update_time: 0.2170413435, other_time: 3.2711410522
epoch time: 14.6910972595s, input_fired_time: 0.2129749209, output_fired_time: 0.0000000000, propagate_forward_time: 13.8952541351, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5828685760
validation[          , genome  6356] predictions:    9762/  10000 (97.62%), best:    9772/10000 (97.72%), error:       804.54144, best error:       775.63312 on epoch:    57, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 185.0478668213s, input_fired_time: 1.6901906729, output_fired_time: 1.8018877506, propagate_forward_time: 70.4535217285, propagate_backward_time: 107.7599563599, weight_update_time: 0.2151217610, other_time: 3.3423080444
epoch time: 15.6392459869s, input_fired_time: 0.2058528662, output_fired_time: 0.0000000000, propagate_forward_time: 14.7827796936, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6506137848
validation[          , genome  6356] predictions:    9751/  10000 (97.51%), best:    9772/10000 (97.72%), error:       876.26630, best error:       775.63312 on epoch:    57, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 188.1612548828s, input_fired_time: 1.7458902597, output_fired_time: 1.8281332254, propagate_forward_time: 72.0443191528, propagate_backward_time: 109.2285537720, weight_update_time: 0.2136986703, other_time: 3.3143463135
epoch time: 15.2248249054s, input_fired_time: 0.2365726978, output_fired_time: 0.0000000000, propagate_forward_time: 14.3648290634, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6234235764
validation[          , genome  6356] predictions:    9765/  10000 (97.65%), best:    9772/10000 (97.72%), error:       785.14526, best error:       775.63312 on epoch:    57, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 189.0448913574s, input_fired_time: 1.6861233711, output_fired_time: 1.8088543415, propagate_forward_time: 71.5742645264, propagate_backward_time: 110.6511535645, weight_update_time: 0.2238853872, other_time: 3.3244934082
epoch time: 33.4411201477s, input_fired_time: 0.2022061944, output_fired_time: 0.0000000000, propagate_forward_time: 32.6696548462, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5692596436
validation[          , genome  6356] predictions:    9716/  10000 (97.16%), best:    9772/10000 (97.72%), error:       955.74445, best error:       775.63312 on epoch:    57, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 183.6418457031s, input_fired_time: 1.6703341007, output_fired_time: 1.7632089853, propagate_forward_time: 70.5245132446, propagate_backward_time: 106.4654846191, weight_update_time: 0.2142865062, other_time: 3.2182998657
epoch time: 16.7472152710s, input_fired_time: 0.3020632863, output_fired_time: 0.0000000000, propagate_forward_time: 15.8011169434, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6440353394
validation[          , genome  6356] predictions:    9743/  10000 (97.43%), best:    9772/10000 (97.72%), error:       873.95685, best error:       775.63312 on epoch:    57, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 184.3050842285s, input_fired_time: 1.6915140152, output_fired_time: 1.7780386209, propagate_forward_time: 70.0833053589, propagate_backward_time: 107.3537368774, weight_update_time: 0.2132941484, other_time: 3.3984832764
epoch time: 18.5301437378s, input_fired_time: 0.2697896957, output_fired_time: 0.0000000000, propagate_forward_time: 17.4855213165, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7748317719
validation[          , genome  6356] predictions:    9774/  10000 (97.74%), best:    9774/10000 (97.74%), error:       766.05408, best error:       766.05408 on epoch:    87, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 197.5863647461s, input_fired_time: 1.7614322901, output_fired_time: 1.8607106209, propagate_forward_time: 74.5907211304, propagate_backward_time: 115.9099197388, weight_update_time: 0.2459233701, other_time: 3.4635772705
epoch time: 15.0669803619s, input_fired_time: 0.2061962932, output_fired_time: 0.0000000000, propagate_forward_time: 14.2739915848, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5867929459
validation[          , genome  6356] predictions:    9701/  10000 (97.01%), best:    9774/10000 (97.74%), error:       987.17303, best error:       766.05408 on epoch:    87, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 186.9162292480s, input_fired_time: 1.7702516317, output_fired_time: 1.7981798649, propagate_forward_time: 71.6292877197, propagate_backward_time: 108.3917770386, weight_update_time: 0.2137900442, other_time: 3.3267288208
epoch time: 15.3235311508s, input_fired_time: 0.2360083610, output_fired_time: 0.0000000000, propagate_forward_time: 14.5130281448, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5744943619
validation[          , genome  6356] predictions:    9753/  10000 (97.53%), best:    9774/10000 (97.74%), error:       835.76013, best error:       766.05408 on epoch:    87, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 183.6778717041s, input_fired_time: 1.6295223236, output_fired_time: 1.7663019896, propagate_forward_time: 70.4842834473, propagate_backward_time: 106.5428237915, weight_update_time: 0.2136547863, other_time: 3.2549514771
epoch time: 33.0979156494s, input_fired_time: 0.3364954889, output_fired_time: 0.0000000000, propagate_forward_time: 31.8514423370, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9099788666
validation[          , genome  6356] predictions:    9752/  10000 (97.52%), best:    9774/10000 (97.74%), error:       844.60516, best error:       766.05408 on epoch:    87, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 182.0237884521s, input_fired_time: 1.6423370838, output_fired_time: 1.7653841972, propagate_forward_time: 69.7703704834, propagate_backward_time: 105.5630722046, weight_update_time: 0.2136182189, other_time: 3.2826309204
epoch time: 15.6231117249s, input_fired_time: 0.2072113901, output_fired_time: 0.0000000000, propagate_forward_time: 14.8250360489, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5908641815
validation[          , genome  6356] predictions:    9761/  10000 (97.61%), best:    9774/10000 (97.74%), error:       807.55548, best error:       766.05408 on epoch:    87, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 181.9573211670s, input_fired_time: 1.6337749958, output_fired_time: 1.7802305222, propagate_forward_time: 69.9566497803, propagate_backward_time: 105.3649826050, weight_update_time: 0.2135323733, other_time: 3.2216873169
epoch time: 15.1041030884s, input_fired_time: 0.2371105105, output_fired_time: 0.0000000000, propagate_forward_time: 14.2890405655, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5779523849
validation[          , genome  6356] predictions:    9755/  10000 (97.55%), best:    9774/10000 (97.74%), error:       823.86011, best error:       766.05408 on epoch:    87, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 183.6886749268s, input_fired_time: 1.7000325918, output_fired_time: 1.7950317860, propagate_forward_time: 70.4772491455, propagate_backward_time: 106.4910964966, weight_update_time: 0.2131636292, other_time: 3.2252731323
epoch time: 15.4562492371s, input_fired_time: 0.2060149759, output_fired_time: 0.0000000000, propagate_forward_time: 14.6421794891, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6080551147
validation[          , genome  6356] predictions:    9761/  10000 (97.61%), best:    9774/10000 (97.74%), error:       836.77893, best error:       766.05408 on epoch:    87, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 187.6285247803s, input_fired_time: 1.6536881924, output_fired_time: 1.8923624754, propagate_forward_time: 71.8686065674, propagate_backward_time: 108.8237915039, weight_update_time: 0.2236595154, other_time: 3.3900756836
epoch time: 17.7517776489s, input_fired_time: 0.2066112608, output_fired_time: 0.0000000000, propagate_forward_time: 16.8204421997, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7247238159
validation[          , genome  6356] predictions:    9734/  10000 (97.34%), best:    9774/10000 (97.74%), error:       901.58862, best error:       766.05408 on epoch:    87, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 185.3477783203s, input_fired_time: 1.6686440706, output_fired_time: 1.7952802181, propagate_forward_time: 71.1313095093, propagate_backward_time: 107.3812484741, weight_update_time: 0.2148159742, other_time: 3.3713073730
epoch time: 19.7442131042s, input_fired_time: 0.2697094679, output_fired_time: 0.0000000000, propagate_forward_time: 18.6677188873, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8067855835
validation[          , genome  6356] predictions:    9741/  10000 (97.41%), best:    9774/10000 (97.74%), error:       880.69897, best error:       766.05408 on epoch:    87, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 195.7365570068s, input_fired_time: 1.7985099554, output_fired_time: 1.9593166113, propagate_forward_time: 75.1368789673, propagate_backward_time: 113.3988800049, weight_update_time: 0.2141492516, other_time: 3.4429702759
epoch time: 20.2303695679s, input_fired_time: 0.2685369849, output_fired_time: 0.0000000000, propagate_forward_time: 19.1208324432, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8409996033
validation[          , genome  6356] predictions:    9721/  10000 (97.21%), best:    9774/10000 (97.74%), error:       945.01959, best error:       766.05408 on epoch:    87, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 185.2557220459s, input_fired_time: 1.6774712801, output_fired_time: 1.8299735785, propagate_forward_time: 71.2292709351, propagate_backward_time: 107.2406692505, weight_update_time: 0.2140458524, other_time: 3.2783355713
epoch time: 17.0532398224s, input_fired_time: 0.2455490679, output_fired_time: 0.0000000000, propagate_forward_time: 16.1359176636, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6717739105
validation[          , genome  6356] predictions:    9742/  10000 (97.42%), best:    9774/10000 (97.74%), error:       848.23877, best error:       766.05408 on epoch:    87, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 187.3065643311s, input_fired_time: 1.6428376436, output_fired_time: 1.7909750938, propagate_forward_time: 72.2961578369, propagate_backward_time: 108.3430709839, weight_update_time: 0.2139138579, other_time: 3.2335281372
epoch time: 15.5396566391s, input_fired_time: 0.2055880427, output_fired_time: 0.0000000000, propagate_forward_time: 14.7213401794, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6127281189
validation[          , genome  6356] predictions:    9763/  10000 (97.63%), best:    9774/10000 (97.74%), error:       780.78308, best error:       766.05408 on epoch:    87, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 182.5258483887s, input_fired_time: 1.6691218615, output_fired_time: 1.7710390091, propagate_forward_time: 70.2723846436, propagate_backward_time: 105.5248489380, weight_update_time: 0.2227179706, other_time: 3.2884445190
epoch time: 19.8210144043s, input_fired_time: 0.3429245651, output_fired_time: 0.0000000000, propagate_forward_time: 18.7716617584, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7064285278
validation[          , genome  6356] predictions:    9751/  10000 (97.51%), best:    9774/10000 (97.74%), error:       828.54181, best error:       766.05408 on epoch:    87, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 191.7957153320s, input_fired_time: 1.8477094173, output_fired_time: 1.8996994495, propagate_forward_time: 73.4238891602, propagate_backward_time: 111.1971893311, weight_update_time: 0.2460149229, other_time: 3.4272308350
epoch time: 19.8091735840s, input_fired_time: 0.2673319876, output_fired_time: 0.0000000000, propagate_forward_time: 18.8743038177, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6675376892
validation[          , genome  6356] predictions:    9769/  10000 (97.69%), best:    9774/10000 (97.74%), error:       784.87720, best error:       766.05408 on epoch:    87, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 73.7794342041s, input_fired_time: 1.0141105652, output_fired_time: 0.0000000000, propagate_forward_time: 69.8110733032, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9542465210
best training[          , genome  6356] predictions:   49639/  50000 (99.28%), best:    9774/10000 (97.74%), error:      1535.41504, best error:       766.05408 on epoch:    87, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 15.1327686310s, input_fired_time: 0.2031724304, output_fired_time: 0.0000000000, propagate_forward_time: 14.3508806229, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5787153244
   testing[          , genome  6356] predictions:    9768/  10000 (97.68%), best:    9774/10000 (97.74%), error:       777.04932, best error:       766.05408 on epoch:    87, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
06:24:57 (5904): called boinc_finish(0)

</stderr_txt>
]]>