Nameexact_genome_1512568488_41_7100_2
Workunit2606812
Created8 Dec 2017, 0:04:14 UTC
Sent8 Dec 2017, 0:12:43 UTC
Report deadline18 Dec 2017, 15:04:23 UTC
Received8 Dec 2017, 18:12:36 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID64142
Run time6 hours 14 min 20 sec
CPU time5 hours 12 min 10 sec
Validate stateValid
Credit2,654.81
Device peak FLOPS3.08 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size157.00 MB
Peak swap size160.09 MB
Peak disk usage2.10 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
best error:       986.16687 on epoch:    14, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 299.1983032227s, input_fired_time: 3.7497389317, output_fired_time: 3.2440090179, propagate_forward_time: 115.2244567871, propagate_backward_time: 170.6836090088, weight_update_time: 0.7224215269, other_time: 6.2964935303
epoch time: 23.7598037720s, input_fired_time: 0.6832603216, output_fired_time: 0.0000000000, propagate_forward_time: 22.1905555725, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8859882355
validation[          , genome  7100] predictions:    9717/  10000 (97.17%), best:    9717/10000 (97.17%), error:       959.80811, best error:       959.80811 on epoch:    15, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 283.6239624023s, input_fired_time: 4.2043600082, output_fired_time: 2.8267307281, propagate_forward_time: 103.6081085205, propagate_backward_time: 167.4062347412, weight_update_time: 0.4565997124, other_time: 5.5785522461
epoch time: 26.6603050232s, input_fired_time: 0.8877413273, output_fired_time: 0.0000000000, propagate_forward_time: 24.4496383667, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3229255676
validation[          , genome  7100] predictions:    9694/  10000 (96.94%), best:    9717/10000 (97.17%), error:      1006.72021, best error:       959.80811 on epoch:    15, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 272.8654174805s, input_fired_time: 3.4195654392, output_fired_time: 2.5763690472, propagate_forward_time: 99.0083007813, propagate_backward_time: 160.9698791504, weight_update_time: 0.1757353842, other_time: 6.8913269043
epoch time: 20.7391433716s, input_fired_time: 0.7831902504, output_fired_time: 0.0000000000, propagate_forward_time: 19.2884483337, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6675052643
validation[          , genome  7100] predictions:    9686/  10000 (96.86%), best:    9717/10000 (97.17%), error:       967.27563, best error:       959.80811 on epoch:    15, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 265.0167236328s, input_fired_time: 2.8442809582, output_fired_time: 2.6717636585, propagate_forward_time: 98.5108108521, propagate_backward_time: 155.6549530029, weight_update_time: 0.1760830581, other_time: 5.3349456787
epoch time: 21.6799106598s, input_fired_time: 0.5297367573, output_fired_time: 0.0000000000, propagate_forward_time: 20.4381179810, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7120552063
validation[          , genome  7100] predictions:    9670/  10000 (96.70%), best:    9717/10000 (97.17%), error:      1061.53381, best error:       959.80811 on epoch:    15, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 274.0434875488s, input_fired_time: 2.8584926128, output_fired_time: 3.4732213020, propagate_forward_time: 104.0581436157, propagate_backward_time: 156.8658905029, weight_update_time: 0.2242285758, other_time: 6.7877349854
epoch time: 23.2848548889s, input_fired_time: 0.2844643295, output_fired_time: 0.0000000000, propagate_forward_time: 21.2800521851, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7203388214
validation[          , genome  7100] predictions:    9732/  10000 (97.32%), best:    9732/10000 (97.32%), error:       937.55066, best error:       937.55066 on epoch:    19, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 259.7405395508s, input_fired_time: 3.9490797520, output_fired_time: 2.5798051357, propagate_forward_time: 99.1367721558, propagate_backward_time: 148.9629058838, weight_update_time: 0.4262875319, other_time: 5.1119842529
epoch time: 22.4830703735s, input_fired_time: 0.2797599137, output_fired_time: 0.0000000000, propagate_forward_time: 21.1601734161, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0431365967
validation[          , genome  7100] predictions:    9703/  10000 (97.03%), best:    9732/10000 (97.32%), error:       967.71832, best error:       937.55066 on epoch:    19, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 266.8227539063s, input_fired_time: 3.6432688236, output_fired_time: 3.3739223480, propagate_forward_time: 99.5710144043, propagate_backward_time: 155.7669219971, weight_update_time: 0.1759970486, other_time: 4.4676055908
epoch time: 21.4833259583s, input_fired_time: 0.2803457677, output_fired_time: 0.0000000000, propagate_forward_time: 20.5190410614, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6839389801
validation[          , genome  7100] predictions:    9715/  10000 (97.15%), best:    9732/10000 (97.32%), error:       957.02338, best error:       937.55066 on epoch:    19, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 275.7711791992s, input_fired_time: 2.8028390408, output_fired_time: 4.2320361137, propagate_forward_time: 102.6734848022, propagate_backward_time: 159.3950653076, weight_update_time: 0.2227936089, other_time: 6.6677703857
epoch time: 20.0968208313s, input_fired_time: 0.7785946131, output_fired_time: 0.0000000000, propagate_forward_time: 18.6220722198, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6961536407
validation[          , genome  7100] predictions:    9724/  10000 (97.24%), best:    9724/10000 (97.24%), error:       907.19043, best error:       907.19043 on epoch:    22, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 269.8177795410s, input_fired_time: 2.4577395916, output_fired_time: 2.3677253723, propagate_forward_time: 98.0370864868, propagate_backward_time: 160.4735870361, weight_update_time: 0.4265751541, other_time: 6.4816436768
epoch time: 22.5267601013s, input_fired_time: 0.5294876695, output_fired_time: 0.0000000000, propagate_forward_time: 21.0323257446, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9649467468
validation[          , genome  7100] predictions:    9657/  10000 (96.57%), best:    9724/10000 (97.24%), error:      1081.47900, best error:       907.19043 on epoch:    22, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 204.2841949463s, input_fired_time: 2.2102358341, output_fired_time: 2.2355227470, propagate_forward_time: 77.5881958008, propagate_backward_time: 118.1947555542, weight_update_time: 0.1681572050, other_time: 4.0554885864
epoch time: 15.8098468781s, input_fired_time: 0.3071334362, output_fired_time: 0.0000000000, propagate_forward_time: 14.8295679092, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6731452942
validation[          , genome  7100] predictions:    9685/  10000 (96.85%), best:    9724/10000 (97.24%), error:      1037.56494, best error:       907.19043 on epoch:    22, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 183.3151245117s, input_fired_time: 2.1295139790, output_fired_time: 1.9461997747, propagate_forward_time: 68.5017852783, propagate_backward_time: 107.2101058960, weight_update_time: 0.1662372500, other_time: 3.5275192261
epoch time: 14.7653408051s, input_fired_time: 0.2770862877, output_fired_time: 0.0000000000, propagate_forward_time: 13.8285531998, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6597013474
validation[          , genome  7100] predictions:    9707/  10000 (97.07%), best:    9724/10000 (97.24%), error:       996.15802, best error:       907.19043 on epoch:    22, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 179.6027221680s, input_fired_time: 2.1288471222, output_fired_time: 1.9257283211, propagate_forward_time: 67.3353118896, propagate_backward_time: 104.6958465576, weight_update_time: 0.1678633243, other_time: 3.5169830322
epoch time: 13.0135784149s, input_fired_time: 0.2518514991, output_fired_time: 0.0000000000, propagate_forward_time: 12.1540327072, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6076946259
validation[          , genome  7100] predictions:    9674/  10000 (96.74%), best:    9724/10000 (97.24%), error:      1050.80444, best error:       907.19043 on epoch:    22, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 179.0454711914s, input_fired_time: 2.2841448784, output_fired_time: 1.9657880068, propagate_forward_time: 66.2447509766, propagate_backward_time: 104.8553695679, weight_update_time: 0.2404703498, other_time: 3.6954116821
epoch time: 14.0673103333s, input_fired_time: 0.2631678581, output_fired_time: 0.0000000000, propagate_forward_time: 13.1751451492, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6289968491
validation[          , genome  7100] predictions:    9697/  10000 (96.97%), best:    9724/10000 (97.24%), error:      1028.77307, best error:       907.19043 on epoch:    22, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 173.3747863770s, input_fired_time: 2.1319336891, output_fired_time: 1.9007270336, propagate_forward_time: 64.4488143921, propagate_backward_time: 101.3332519531, weight_update_time: 0.1625185311, other_time: 3.5600662231
epoch time: 13.3271303177s, input_fired_time: 0.2571307421, output_fired_time: 0.0000000000, propagate_forward_time: 12.4531745911, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6168251038
validation[          , genome  7100] predictions:    9768/  10000 (97.68%), best:    9768/10000 (97.68%), error:       808.18646, best error:       808.18646 on epoch:    28, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 174.5426177979s, input_fired_time: 2.0461223125, output_fired_time: 1.8060472012, propagate_forward_time: 64.7702865601, propagate_backward_time: 102.1694107056, weight_update_time: 0.1583359838, other_time: 3.7507476807
epoch time: 13.7713737488s, input_fired_time: 0.2644918859, output_fired_time: 0.0000000000, propagate_forward_time: 12.8759737015, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6309080124
validation[          , genome  7100] predictions:    9723/  10000 (97.23%), best:    9768/10000 (97.68%), error:       927.25256, best error:       808.18646 on epoch:    28, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 179.0707092285s, input_fired_time: 2.1622190475, output_fired_time: 1.9176508188, propagate_forward_time: 66.5049819946, propagate_backward_time: 104.8020935059, weight_update_time: 0.1642107219, other_time: 3.6837692261
epoch time: 15.5077018738s, input_fired_time: 0.3324789405, output_fired_time: 0.0000000000, propagate_forward_time: 14.5359439850, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6392793655
validation[          , genome  7100] predictions:    9720/  10000 (97.20%), best:    9768/10000 (97.68%), error:       880.31396, best error:       808.18646 on epoch:    28, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 173.6441040039s, input_fired_time: 2.0816452503, output_fired_time: 1.9277803898, propagate_forward_time: 64.5281753540, propagate_backward_time: 101.6949844360, weight_update_time: 0.1618693918, other_time: 3.4115142822
epoch time: 14.4693880081s, input_fired_time: 0.2736230195, output_fired_time: 0.0000000000, propagate_forward_time: 13.5434665680, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6522979736
validation[          , genome  7100] predictions:    9732/  10000 (97.32%), best:    9768/10000 (97.68%), error:       895.55573, best error:       808.18646 on epoch:    28, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 178.1654815674s, input_fired_time: 2.2523014545, output_fired_time: 1.9288661480, propagate_forward_time: 66.1051483154, propagate_backward_time: 104.2106628418, weight_update_time: 0.2079168558, other_time: 3.6685028076
epoch time: 14.0544223785s, input_fired_time: 0.2619205415, output_fired_time: 0.0000000000, propagate_forward_time: 13.1657257080, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6267757416
validation[          , genome  7100] predictions:    9681/  10000 (96.81%), best:    9768/10000 (97.68%), error:       999.77832, best error:       808.18646 on epoch:    28, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 174.3472747803s, input_fired_time: 2.1149685383, output_fired_time: 1.9982293844, propagate_forward_time: 65.1524276733, propagate_backward_time: 101.6397628784, weight_update_time: 0.1636803150, other_time: 3.4418792725
epoch time: 15.3244352341s, input_fired_time: 0.3255805671, output_fired_time: 0.0000000000, propagate_forward_time: 14.3114748001, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6873798370
validation[          , genome  7100] predictions:    9660/  10000 (96.60%), best:    9768/10000 (97.68%), error:      1118.45081, best error:       808.18646 on epoch:    28, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 171.5951385498s, input_fired_time: 2.0795319080, output_fired_time: 1.8465236425, propagate_forward_time: 63.7680702209, propagate_backward_time: 100.4402770996, weight_update_time: 0.1623122245, other_time: 3.4607391357
epoch time: 13.7636623383s, input_fired_time: 0.2561609149, output_fired_time: 0.0000000000, propagate_forward_time: 12.8933858871, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6141157150
validation[          , genome  7100] predictions:    9752/  10000 (97.52%), best:    9768/10000 (97.68%), error:       843.67676, best error:       808.18646 on epoch:    28, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 178.8757476807s, input_fired_time: 2.1619307995, output_fired_time: 1.8938337564, propagate_forward_time: 66.6506958008, propagate_backward_time: 104.4749679565, weight_update_time: 0.1609467417, other_time: 3.6943283081
epoch time: 13.4208841324s, input_fired_time: 0.2578224838, output_fired_time: 0.0000000000, propagate_forward_time: 12.5450077057, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6180543900
validation[          , genome  7100] predictions:    9737/  10000 (97.37%), best:    9768/10000 (97.68%), error:       868.43542, best error:       808.18646 on epoch:    28, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 174.3611907959s, input_fired_time: 2.0903906822, output_fired_time: 1.8520768881, propagate_forward_time: 64.8255844116, propagate_backward_time: 101.9652786255, weight_update_time: 0.1622190475, other_time: 3.6278533936
epoch time: 12.5129890442s, input_fired_time: 0.2444867194, output_fired_time: 0.0000000000, propagate_forward_time: 11.6785326004, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5899696350
validation[          , genome  7100] predictions:    9685/  10000 (96.85%), best:    9768/10000 (97.68%), error:      1091.49780, best error:       808.18646 on epoch:    28, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 178.4357147217s, input_fired_time: 2.1505949497, output_fired_time: 1.9861637354, propagate_forward_time: 66.4635467529, propagate_backward_time: 104.2894058228, weight_update_time: 0.1603400111, other_time: 3.5460128784
epoch time: 13.0838632584s, input_fired_time: 0.2535549402, output_fired_time: 0.0000000000, propagate_forward_time: 12.2200212479, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6102867126
validation[          , genome  7100] predictions:    9754/  10000 (97.54%), best:    9768/10000 (97.68%), error:       830.08759, best error:       808.18646 on epoch:    28, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 229.6225128174s, input_fired_time: 2.7249529362, output_fired_time: 2.5792005062, propagate_forward_time: 86.2484283447, propagate_backward_time: 134.4774475098, weight_update_time: 0.2593941092, other_time: 3.5924835205
epoch time: 24.5426082611s, input_fired_time: 0.3756524026, output_fired_time: 0.0000000000, propagate_forward_time: 23.2972965240, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8696594238
validation[          , genome  7100] predictions:    9728/  10000 (97.28%), best:    9768/10000 (97.68%), error:       898.78119, best error:       808.18646 on epoch:    28, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 279.3681030273s, input_fired_time: 3.7729401588, output_fired_time: 2.6267654896, propagate_forward_time: 105.3229141235, propagate_backward_time: 162.9241943359, weight_update_time: 0.1764456332, other_time: 4.7212829590
epoch time: 24.9787521362s, input_fired_time: 0.3936258852, output_fired_time: 0.0000000000, propagate_forward_time: 23.9151077271, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6700191498
validation[          , genome  7100] predictions:    9725/  10000 (97.25%), best:    9768/10000 (97.68%), error:       895.28210, best error:       808.18646 on epoch:    28, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 299.6262207031s, input_fired_time: 3.5095355511, output_fired_time: 3.2241129875, propagate_forward_time: 117.1338119507, propagate_backward_time: 169.5581359863, weight_update_time: 0.1755325794, other_time: 6.2006225586
epoch time: 34.4339294434s, input_fired_time: 0.3934763372, output_fired_time: 0.0000000000, propagate_forward_time: 32.4959945679, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5444602966
validation[          , genome  7100] predictions:    9693/  10000 (96.93%), best:    9768/10000 (97.68%), error:       963.09186, best error:       808.18646 on epoch:    28, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 360.8736267090s, input_fired_time: 3.4741747379, output_fired_time: 3.8879265785, propagate_forward_time: 130.8894653320, propagate_backward_time: 214.4611968994, weight_update_time: 0.5037612319, other_time: 8.1608428955
epoch time: 25.8820972443s, input_fired_time: 0.7829966545, output_fired_time: 0.0000000000, propagate_forward_time: 24.2912311554, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8078689575
validation[          , genome  7100] predictions:    9752/  10000 (97.52%), best:    9768/10000 (97.68%), error:       813.64258, best error:       808.18646 on epoch:    28, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 324.9932861328s, input_fired_time: 4.3787941933, output_fired_time: 2.7610764503, propagate_forward_time: 122.8013610840, propagate_backward_time: 190.7073364258, weight_update_time: 0.1757056862, other_time: 4.3447265625
epoch time: 23.6841659546s, input_fired_time: 0.2835150659, output_fired_time: 0.0000000000, propagate_forward_time: 22.3880615234, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0125885010
validation[          , genome  7100] predictions:    9714/  10000 (97.14%), best:    9768/10000 (97.68%), error:       963.32495, best error:       808.18646 on epoch:    28, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 256.3825378418s, input_fired_time: 2.8624608517, output_fired_time: 2.7252304554, propagate_forward_time: 96.9540023804, propagate_backward_time: 148.5688476563, weight_update_time: 0.1728646755, other_time: 5.2720031738
epoch time: 13.4730920792s, input_fired_time: 0.2533972561, output_fired_time: 0.0000000000, propagate_forward_time: 12.5045051575, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7151899338
validation[          , genome  7100] predictions:    9725/  10000 (97.25%), best:    9768/10000 (97.68%), error:       893.56238, best error:       808.18646 on epoch:    28, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 177.2320709229s, input_fired_time: 2.2224867344, output_fired_time: 1.8609080315, propagate_forward_time: 66.1751480103, propagate_backward_time: 103.3153228760, weight_update_time: 0.1633439064, other_time: 3.6582107544
epoch time: 14.6115360260s, input_fired_time: 0.2650054693, output_fired_time: 0.0000000000, propagate_forward_time: 13.7139663696, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6325645447
validation[          , genome  7100] predictions:    9778/  10000 (97.78%), best:    9778/10000 (97.78%), error:       760.50092, best error:       760.50092 on epoch:    44, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 176.7817382813s, input_fired_time: 2.1036887169, output_fired_time: 2.0565297604, propagate_forward_time: 65.8794174194, propagate_backward_time: 103.0816879272, weight_update_time: 0.1641206145, other_time: 3.6604156494
epoch time: 13.3599624634s, input_fired_time: 0.2598167956, output_fired_time: 0.0000000000, propagate_forward_time: 12.4787788391, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6213665009
validation[          , genome  7100] predictions:    9733/  10000 (97.33%), best:    9778/10000 (97.78%), error:       889.33502, best error:       760.50092 on epoch:    44, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 180.0336608887s, input_fired_time: 2.4989538193, output_fired_time: 1.9287747145, propagate_forward_time: 66.5448150635, propagate_backward_time: 105.2552185059, weight_update_time: 0.2859742939, other_time: 3.8059082031
epoch time: 15.5401525497s, input_fired_time: 0.2479382008, output_fired_time: 0.0000000000, propagate_forward_time: 14.5898571014, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7023572922
validation[          , genome  7100] predictions:    9725/  10000 (97.25%), best:    9778/10000 (97.78%), error:       926.16162, best error:       760.50092 on epoch:    44, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 179.6488800049s, input_fired_time: 2.1237361431, output_fired_time: 1.8826872110, propagate_forward_time: 67.6447677612, propagate_backward_time: 104.1734085083, weight_update_time: 0.3048505485, other_time: 3.8242797852
epoch time: 14.4145097733s, input_fired_time: 0.3560019135, output_fired_time: 0.0000000000, propagate_forward_time: 13.4380283356, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6204795837
validation[          , genome  7100] predictions:    9712/  10000 (97.12%), best:    9778/10000 (97.78%), error:       959.19421, best error:       760.50092 on epoch:    44, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 177.8977661133s, input_fired_time: 2.0928065777, output_fired_time: 1.9826424122, propagate_forward_time: 66.1396942139, propagate_backward_time: 103.9669494629, weight_update_time: 0.1622282565, other_time: 3.7156829834
epoch time: 14.8495197296s, input_fired_time: 0.2594783008, output_fired_time: 0.0000000000, propagate_forward_time: 13.8466167450, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7434244156
validation[          , genome  7100] predictions:    9746/  10000 (97.46%), best:    9778/10000 (97.78%), error:       835.07147, best error:       760.50092 on epoch:    44, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 183.2369384766s, input_fired_time: 2.0986924171, output_fired_time: 2.2844855785, propagate_forward_time: 68.6711730957, propagate_backward_time: 106.6355819702, weight_update_time: 0.1634259075, other_time: 3.5470046997
epoch time: 14.1234664917s, input_fired_time: 0.2663858831, output_fired_time: 0.0000000000, propagate_forward_time: 13.2255010605, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6315793991
validation[          , genome  7100] predictions:    9765/  10000 (97.65%), best:    9778/10000 (97.78%), error:       837.86615, best error:       760.50092 on epoch:    44, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 175.7887878418s, input_fired_time: 2.0936276913, output_fired_time: 1.8560183048, propagate_forward_time: 65.4687118530, propagate_backward_time: 102.8436508179, weight_update_time: 0.1621089578, other_time: 3.5267791748
epoch time: 13.0075740814s, input_fired_time: 0.2547508776, output_fired_time: 0.0000000000, propagate_forward_time: 12.1450700760, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6077528000
validation[          , genome  7100] predictions:    9741/  10000 (97.41%), best:    9778/10000 (97.78%), error:       866.88464, best error:       760.50092 on epoch:    44, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 181.1828613281s, input_fired_time: 2.2180550098, output_fired_time: 2.1286907196, propagate_forward_time: 67.5283126831, propagate_backward_time: 105.7182998657, weight_update_time: 0.1641007215, other_time: 3.5895080566
epoch time: 13.9347438812s, input_fired_time: 0.2500588894, output_fired_time: 0.0000000000, propagate_forward_time: 13.0940160751, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5906686783
validation[          , genome  7100] predictions:    9751/  10000 (97.51%), best:    9778/10000 (97.78%), error:       812.45343, best error:       760.50092 on epoch:    44, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 178.8182983398s, input_fired_time: 2.2045540810, output_fired_time: 1.9531067610, propagate_forward_time: 67.0470352173, propagate_backward_time: 104.1067276001, weight_update_time: 0.1602386236, other_time: 3.5068664551
epoch time: 14.2152118683s, input_fired_time: 0.2571583986, output_fired_time: 0.0000000000, propagate_forward_time: 13.3413000107, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6167535782
validation[          , genome  7100] predictions:    9756/  10000 (97.56%), best:    9778/10000 (97.78%), error:       789.99017, best error:       760.50092 on epoch:    44, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 246.6603240967s, input_fired_time: 2.6759638786, output_fired_time: 2.6134378910, propagate_forward_time: 89.3099212646, propagate_backward_time: 147.6168518066, weight_update_time: 0.1704965681, other_time: 4.4441528320
epoch time: 26.0448112488s, input_fired_time: 0.6410658360, output_fired_time: 0.0000000000, propagate_forward_time: 24.3596668243, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0440788269
validation[          , genome  7100] predictions:    9770/  10000 (97.70%), best:    9778/10000 (97.78%), error:       802.41150, best error:       760.50092 on epoch:    44, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 277.8241882324s, input_fired_time: 3.2323379517, output_fired_time: 3.5560386181, propagate_forward_time: 105.3269577026, propagate_backward_time: 160.8654785156, weight_update_time: 0.1776533276, other_time: 4.8433837891
epoch time: 22.1293277740s, input_fired_time: 0.3926903009, output_fired_time: 0.0000000000, propagate_forward_time: 20.5667190552, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1699180603
validation[          , genome  7100] predictions:    9755/  10000 (97.55%), best:    9778/10000 (97.78%), error:       835.52319, best error:       760.50092 on epoch:    44, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 270.6254882813s, input_fired_time: 3.4364817142, output_fired_time: 3.1406519413, propagate_forward_time: 102.7858810425, propagate_backward_time: 154.4216308594, weight_update_time: 0.5600665808, other_time: 6.8408203125
epoch time: 22.1036491394s, input_fired_time: 0.5358743072, output_fired_time: 0.0000000000, propagate_forward_time: 20.5348854065, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0328903198
validation[          , genome  7100] predictions:    9768/  10000 (97.68%), best:    9778/10000 (97.78%), error:       817.38080, best error:       760.50092 on epoch:    44, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 289.0762939453s, input_fired_time: 3.8768253326, output_fired_time: 2.6383352280, propagate_forward_time: 109.4283370972, propagate_backward_time: 166.4902191162, weight_update_time: 0.6761011481, other_time: 6.6425628662
epoch time: 23.7890872955s, input_fired_time: 0.3790161908, output_fired_time: 0.0000000000, propagate_forward_time: 22.6291408539, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7809295654
validation[          , genome  7100] predictions:    9750/  10000 (97.50%), best:    9778/10000 (97.78%), error:       833.19855, best error:       760.50092 on epoch:    44, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 278.1854553223s, input_fired_time: 4.1553230286, output_fired_time: 2.6446819305, propagate_forward_time: 101.5071105957, propagate_backward_time: 163.9819488525, weight_update_time: 0.1757512838, other_time: 5.8963775635
epoch time: 24.5014190674s, input_fired_time: 0.5041595101, output_fired_time: 0.0000000000, propagate_forward_time: 22.8131961823, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1840629578
validation[          , genome  7100] predictions:    9759/  10000 (97.59%), best:    9778/10000 (97.78%), error:       829.00885, best error:       760.50092 on epoch:    44, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 272.8030700684s, input_fired_time: 3.0799500942, output_fired_time: 3.8092689514, propagate_forward_time: 101.9328308105, propagate_backward_time: 160.2299652100, weight_update_time: 0.1756693572, other_time: 3.7510528564
epoch time: 22.3668441772s, input_fired_time: 0.5335811377, output_fired_time: 0.0000000000, propagate_forward_time: 20.9516315460, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8816318512
validation[          , genome  7100] predictions:    9699/  10000 (96.99%), best:    9778/10000 (97.78%), error:      1004.74451, best error:       760.50092 on epoch:    44, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 283.8130187988s, input_fired_time: 3.3217079639, output_fired_time: 3.1173956394, propagate_forward_time: 102.2078552246, propagate_backward_time: 168.5894775391, weight_update_time: 0.6761626601, other_time: 6.5765686035
epoch time: 24.2108726501s, input_fired_time: 0.3772225082, output_fired_time: 0.0000000000, propagate_forward_time: 22.0879898071, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7456607819
validation[          , genome  7100] predictions:    9732/  10000 (97.32%), best:    9778/10000 (97.78%), error:       904.59033, best error:       760.50092 on epoch:    44, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 266.9691467285s, input_fired_time: 2.7926731110, output_fired_time: 3.2801945210, propagate_forward_time: 97.6586227417, propagate_backward_time: 158.2669830322, weight_update_time: 0.1756616533, other_time: 4.9706878662
epoch time: 20.2438430786s, input_fired_time: 0.2851355672, output_fired_time: 0.0000000000, propagate_forward_time: 19.2902488708, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6684589386
validation[          , genome  7100] predictions:    9745/  10000 (97.45%), best:    9778/10000 (97.78%), error:       834.15143, best error:       760.50092 on epoch:    44, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 213.0381622314s, input_fired_time: 2.1519801617, output_fired_time: 2.1604993343, propagate_forward_time: 89.1955642700, propagate_backward_time: 114.1124572754, weight_update_time: 0.1686417311, other_time: 5.4176712036
epoch time: 13.1342926025s, input_fired_time: 0.2893851995, output_fired_time: 0.0000000000, propagate_forward_time: 12.1268157959, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7180919647
validation[          , genome  7100] predictions:    9730/  10000 (97.30%), best:    9778/10000 (97.78%), error:       957.06702, best error:       760.50092 on epoch:    44, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 169.0783843994s, input_fired_time: 2.1699044704, output_fired_time: 1.9042191505, propagate_forward_time: 62.8406372070, propagate_backward_time: 98.7761077881, weight_update_time: 0.1598822922, other_time: 3.3875122070
epoch time: 13.7587413788s, input_fired_time: 0.2543352842, output_fired_time: 0.0000000000, propagate_forward_time: 12.8566846848, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6477212906
validation[          , genome  7100] predictions:    9760/  10000 (97.60%), best:    9778/10000 (97.78%), error:       828.63800, best error:       760.50092 on epoch:    44, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 166.0136718750s, input_fired_time: 2.0612978935, output_fired_time: 1.7970291376, propagate_forward_time: 61.5926322937, propagate_backward_time: 97.2169876099, weight_update_time: 0.1577399820, other_time: 3.3457260132
epoch time: 15.1366147995s, input_fired_time: 0.2615964711, output_fired_time: 0.0000000000, propagate_forward_time: 14.1341152191, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7409029007
validation[          , genome  7100] predictions:    9718/  10000 (97.18%), best:    9778/10000 (97.78%), error:       910.49115, best error:       760.50092 on epoch:    44, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 170.1801452637s, input_fired_time: 2.0863885880, output_fired_time: 1.8631362915, propagate_forward_time: 63.2944183350, propagate_backward_time: 99.4833068848, weight_update_time: 0.1605484188, other_time: 3.4528961182
epoch time: 13.1323404312s, input_fired_time: 0.2576975226, output_fired_time: 0.0000000000, propagate_forward_time: 12.2680139542, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6066293716
validation[          , genome  7100] predictions:    9770/  10000 (97.70%), best:    9778/10000 (97.78%), error:       789.82874, best error:       760.50092 on epoch:    44, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 169.4628448486s, input_fired_time: 2.0696229935, output_fired_time: 1.8385199308, propagate_forward_time: 62.7958221436, propagate_backward_time: 99.3812026978, weight_update_time: 0.1586882621, other_time: 3.3776779175
epoch time: 12.9808025360s, input_fired_time: 0.2563720345, output_fired_time: 0.0000000000, propagate_forward_time: 12.1144466400, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6099834442
validation[          , genome  7100] predictions:    9752/  10000 (97.52%), best:    9778/10000 (97.78%), error:       866.42065, best error:       760.50092 on epoch:    44, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 171.8409729004s, input_fired_time: 2.1380782127, output_fired_time: 1.8628655672, propagate_forward_time: 64.0159606934, propagate_backward_time: 100.3055801392, weight_update_time: 0.1588361859, other_time: 3.5184860229
epoch time: 14.9894781113s, input_fired_time: 0.3048861921, output_fired_time: 0.0000000000, propagate_forward_time: 13.9759597778, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7086324692
validation[          , genome  7100] predictions:    9757/  10000 (97.57%), best:    9778/10000 (97.78%), error:       846.73358, best error:       760.50092 on epoch:    44, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 166.0909729004s, input_fired_time: 2.1359333992, output_fired_time: 1.8058614731, propagate_forward_time: 61.9303474426, propagate_backward_time: 96.8661422729, weight_update_time: 0.1569095999, other_time: 3.3526840210
epoch time: 13.5966978073s, input_fired_time: 0.2562394142, output_fired_time: 0.0000000000, propagate_forward_time: 12.7352533340, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6052045822
validation[          , genome  7100] predictions:    9770/  10000 (97.70%), best:    9778/10000 (97.78%), error:       784.88135, best error:       760.50092 on epoch:    44, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 171.9439544678s, input_fired_time: 2.1383156776, output_fired_time: 1.8778645992, propagate_forward_time: 63.8811111450, propagate_backward_time: 100.5928268433, weight_update_time: 0.1590927541, other_time: 3.4538269043
epoch time: 13.8156948090s, input_fired_time: 0.2644709349, output_fired_time: 0.0000000000, propagate_forward_time: 12.9257574081, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6254663467
validation[          , genome  7100] predictions:    9721/  10000 (97.21%), best:    9778/10000 (97.78%), error:       944.12274, best error:       760.50092 on epoch:    44, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 169.0137481689s, input_fired_time: 2.1429510117, output_fired_time: 1.8201560974, propagate_forward_time: 62.7738342285, propagate_backward_time: 98.8861694336, weight_update_time: 0.1604285687, other_time: 3.3906402588
epoch time: 14.4439001083s, input_fired_time: 0.2902566493, output_fired_time: 0.0000000000, propagate_forward_time: 13.4645490646, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6890945435
validation[          , genome  7100] predictions:    9731/  10000 (97.31%), best:    9778/10000 (97.78%), error:       900.42383, best error:       760.50092 on epoch:    44, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 170.2805633545s, input_fired_time: 2.1047043800, output_fired_time: 1.8975783587, propagate_forward_time: 63.5060729980, propagate_backward_time: 99.2708053589, weight_update_time: 0.1896981299, other_time: 3.5013961792
epoch time: 13.0696258545s, input_fired_time: 0.2610931396, output_fired_time: 0.0000000000, propagate_forward_time: 12.2011137009, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6074190140
validation[          , genome  7100] predictions:    9686/  10000 (96.86%), best:    9778/10000 (97.78%), error:       982.61920, best error:       760.50092 on epoch:    44, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 170.5646057129s, input_fired_time: 2.1708359718, output_fired_time: 1.8816941977, propagate_forward_time: 63.3835601807, propagate_backward_time: 99.6261520386, weight_update_time: 0.1756362766, other_time: 3.5023574829
epoch time: 14.9713735580s, input_fired_time: 0.2605764866, output_fired_time: 0.0000000000, propagate_forward_time: 13.9207038879, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7900934219
validation[          , genome  7100] predictions:    9754/  10000 (97.54%), best:    9778/10000 (97.78%), error:       820.19653, best error:       760.50092 on epoch:    44, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 166.9437408447s, input_fired_time: 2.0705990791, output_fired_time: 1.8067963123, propagate_forward_time: 61.9601516724, propagate_backward_time: 97.6554489136, weight_update_time: 0.1586565524, other_time: 3.4507446289
epoch time: 13.5087175369s, input_fired_time: 0.2519743443, output_fired_time: 0.0000000000, propagate_forward_time: 12.6285066605, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6282367706
validation[          , genome  7100] predictions:    9740/  10000 (97.40%), best:    9778/10000 (97.78%), error:       861.19165, best error:       760.50092 on epoch:    44, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 172.1782531738s, input_fired_time: 2.1093816757, output_fired_time: 1.8955163956, propagate_forward_time: 63.7936172485, propagate_backward_time: 100.8647842407, weight_update_time: 0.1611550897, other_time: 3.5149536133
epoch time: 13.5940408707s, input_fired_time: 0.2606185377, output_fired_time: 0.0000000000, propagate_forward_time: 12.7221155167, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6113071442
validation[          , genome  7100] predictions:    9761/  10000 (97.61%), best:    9778/10000 (97.78%), error:       802.05518, best error:       760.50092 on epoch:    44, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 172.1777191162s, input_fired_time: 2.1151885986, output_fired_time: 1.8900136948, propagate_forward_time: 64.1629028320, propagate_backward_time: 100.5637054443, weight_update_time: 0.1626552641, other_time: 3.4459075928
epoch time: 14.6376209259s, input_fired_time: 0.2752558291, output_fired_time: 0.0000000000, propagate_forward_time: 13.7235822678, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6387825012
validation[          , genome  7100] predictions:    9756/  10000 (97.56%), best:    9778/10000 (97.78%), error:       806.91974, best error:       760.50092 on epoch:    44, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 168.1249084473s, input_fired_time: 2.0899162292, output_fired_time: 1.8189294338, propagate_forward_time: 62.4878845215, propagate_backward_time: 98.3068161011, weight_update_time: 0.1595130414, other_time: 3.4213638306
epoch time: 13.0237188339s, input_fired_time: 0.2569915652, output_fired_time: 0.0000000000, propagate_forward_time: 12.1579008102, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6088266373
validation[          , genome  7100] predictions:    9742/  10000 (97.42%), best:    9778/10000 (97.78%), error:       850.37622, best error:       760.50092 on epoch:    44, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 165.7297515869s, input_fired_time: 2.0587449074, output_fired_time: 1.8163276911, propagate_forward_time: 61.5986900330, propagate_backward_time: 96.7986907959, weight_update_time: 0.1565803289, other_time: 3.4572906494
epoch time: 16.5817794800s, input_fired_time: 0.2649921179, output_fired_time: 0.0000000000, propagate_forward_time: 15.5222768784, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7945108414
validation[          , genome  7100] predictions:    9761/  10000 (97.61%), best:    9778/10000 (97.78%), error:       824.18823, best error:       760.50092 on epoch:    44, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 174.5555267334s, input_fired_time: 2.1283779144, output_fired_time: 1.9318000078, propagate_forward_time: 65.2362213135, propagate_backward_time: 101.7630538940, weight_update_time: 0.1620997041, other_time: 3.4960861206
epoch time: 14.2278728485s, input_fired_time: 0.2599160671, output_fired_time: 0.0000000000, propagate_forward_time: 13.3377742767, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6301822662
validation[          , genome  7100] predictions:    9761/  10000 (97.61%), best:    9778/10000 (97.78%), error:       798.17700, best error:       760.50092 on epoch:    44, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 174.5489196777s, input_fired_time: 2.1166713238, output_fired_time: 1.8463894129, propagate_forward_time: 65.1017761230, propagate_backward_time: 101.7836227417, weight_update_time: 0.1598408073, other_time: 3.7004623413
epoch time: 12.3222370148s, input_fired_time: 0.2513061166, output_fired_time: 0.0000000000, propagate_forward_time: 11.4848909378, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5860395432
validation[          , genome  7100] predictions:    9654/  10000 (96.54%), best:    9778/10000 (97.78%), error:      1117.22510, best error:       760.50092 on epoch:    44, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 165.3219604492s, input_fired_time: 2.0894680023, output_fired_time: 1.9009056091, propagate_forward_time: 61.3429794312, propagate_backward_time: 96.6902694702, weight_update_time: 0.1553581953, other_time: 3.2983398438
epoch time: 13.1603908539s, input_fired_time: 0.2617347538, output_fired_time: 0.0000000000, propagate_forward_time: 12.2848844528, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6137714386
validation[          , genome  7100] predictions:    9731/  10000 (97.31%), best:    9778/10000 (97.78%), error:       872.25623, best error:       760.50092 on epoch:    44, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 167.8349456787s, input_fired_time: 2.1419351101, output_fired_time: 1.7561310530, propagate_forward_time: 62.0771446228, propagate_backward_time: 98.3351135254, weight_update_time: 0.1546848863, other_time: 3.5246124268
epoch time: 13.3171987534s, input_fired_time: 0.2436321825, output_fired_time: 0.0000000000, propagate_forward_time: 12.4495325089, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6240339279
validation[          , genome  7100] predictions:    9763/  10000 (97.63%), best:    9778/10000 (97.78%), error:       798.51117, best error:       760.50092 on epoch:    44, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 169.0140838623s, input_fired_time: 2.1938650608, output_fired_time: 1.7912746668, propagate_forward_time: 62.5887985229, propagate_backward_time: 98.9887008667, weight_update_time: 0.1531243026, other_time: 3.4514465332
epoch time: 12.7778463364s, input_fired_time: 0.2469960749, output_fired_time: 0.0000000000, propagate_forward_time: 11.9447727203, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5860776901
validation[          , genome  7100] predictions:    9757/  10000 (97.57%), best:    9778/10000 (97.78%), error:       804.50854, best error:       760.50092 on epoch:    44, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 157.4919281006s, input_fired_time: 2.0030899048, output_fired_time: 1.7065244913, propagate_forward_time: 58.2444419861, propagate_backward_time: 92.2609405518, weight_update_time: 0.1516334563, other_time: 3.2769165039
epoch time: 12.9874639511s, input_fired_time: 0.2787472308, output_fired_time: 0.0000000000, propagate_forward_time: 12.1248216629, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5838947296
validation[          , genome  7100] predictions:    9735/  10000 (97.35%), best:    9778/10000 (97.78%), error:       908.79150, best error:       760.50092 on epoch:    44, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 161.4179382324s, input_fired_time: 2.0090072155, output_fired_time: 1.7967284918, propagate_forward_time: 59.6734466553, propagate_backward_time: 94.6225814819, weight_update_time: 0.1514152437, other_time: 3.3161849976
epoch time: 12.3894109726s, input_fired_time: 0.2482530326, output_fired_time: 0.0000000000, propagate_forward_time: 11.5558996201, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5852584839
validation[          , genome  7100] predictions:    9738/  10000 (97.38%), best:    9778/10000 (97.78%), error:       851.95972, best error:       760.50092 on epoch:    44, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 160.1671600342s, input_fired_time: 2.0693819523, output_fired_time: 1.7495689392, propagate_forward_time: 59.2454414368, propagate_backward_time: 93.8635330200, weight_update_time: 0.1517352313, other_time: 3.2392349243
epoch time: 12.6436071396s, input_fired_time: 0.2534863353, output_fired_time: 0.0000000000, propagate_forward_time: 11.7973556519, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5927648544
validation[          , genome  7100] predictions:    9752/  10000 (97.52%), best:    9778/10000 (97.78%), error:       834.75543, best error:       760.50092 on epoch:    44, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 157.2714843750s, input_fired_time: 2.0257961750, output_fired_time: 1.7262510061, propagate_forward_time: 58.1948814392, propagate_backward_time: 92.0564575195, weight_update_time: 0.1520398855, other_time: 3.2680816650
epoch time: 12.9309663773s, input_fired_time: 0.2522354424, output_fired_time: 0.0000000000, propagate_forward_time: 12.0870800018, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5916509628
validation[          , genome  7100] predictions:    9758/  10000 (97.58%), best:    9778/10000 (97.78%), error:       803.54260, best error:       760.50092 on epoch:    44, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 158.9008331299s, input_fired_time: 2.0580945015, output_fired_time: 1.7461729050, propagate_forward_time: 58.7073211670, propagate_backward_time: 92.9829025269, weight_update_time: 0.1516261697, other_time: 3.4063491821
epoch time: 12.2029972076s, input_fired_time: 0.2476406991, output_fired_time: 0.0000000000, propagate_forward_time: 11.3748817444, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5804748535
validation[          , genome  7100] predictions:    9769/  10000 (97.69%), best:    9778/10000 (97.78%), error:       762.53534, best error:       760.50092 on epoch:    44, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 161.5780181885s, input_fired_time: 2.0417749882, output_fired_time: 1.7432787418, propagate_forward_time: 59.7957382202, propagate_backward_time: 94.7169876099, weight_update_time: 0.1520936191, other_time: 3.2802276611
epoch time: 13.4677143097s, input_fired_time: 0.2476304770, output_fired_time: 0.0000000000, propagate_forward_time: 12.5951490402, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6249351501
validation[          , genome  7100] predictions:    9755/  10000 (97.55%), best:    9778/10000 (97.78%), error:       775.26215, best error:       760.50092 on epoch:    44, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 158.1017456055s, input_fired_time: 2.0295279026, output_fired_time: 1.7015392780, propagate_forward_time: 58.6133804321, propagate_backward_time: 92.4977493286, weight_update_time: 0.1503221393, other_time: 3.2595520020
epoch time: 12.4615793228s, input_fired_time: 0.2765107155, output_fired_time: 0.0000000000, propagate_forward_time: 11.6090822220, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5759859085
validation[          , genome  7100] predictions:    9761/  10000 (97.61%), best:    9778/10000 (97.78%), error:       795.34827, best error:       760.50092 on epoch:    44, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 160.1663208008s, input_fired_time: 2.0219049454, output_fired_time: 1.7435522079, propagate_forward_time: 59.3264007568, propagate_backward_time: 93.7570495605, weight_update_time: 0.1530613303, other_time: 3.3174133301
epoch time: 13.3163709641s, input_fired_time: 0.2477184981, output_fired_time: 0.0000000000, propagate_forward_time: 12.4619884491, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6066637039
validation[          , genome  7100] predictions:    9763/  10000 (97.63%), best:    9778/10000 (97.78%), error:       794.52600, best error:       760.50092 on epoch:    44, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 162.2519073486s, input_fired_time: 2.1882832050, output_fired_time: 1.7915146351, propagate_forward_time: 59.6167793274, propagate_backward_time: 95.3961410522, weight_update_time: 0.1504301429, other_time: 3.2591934204
epoch time: 12.2122669220s, input_fired_time: 0.2478429079, output_fired_time: 0.0000000000, propagate_forward_time: 11.3829002380, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5815238953
validation[          , genome  7100] predictions:    9750/  10000 (97.50%), best:    9778/10000 (97.78%), error:       819.52277, best error:       760.50092 on epoch:    44, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 159.1724548340s, input_fired_time: 2.0787327290, output_fired_time: 1.7164167166, propagate_forward_time: 58.7885208130, propagate_backward_time: 93.1994628906, weight_update_time: 0.1512544900, other_time: 3.3893203735
epoch time: 12.4326524734s, input_fired_time: 0.2769598365, output_fired_time: 0.0000000000, propagate_forward_time: 11.5296115875, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6260814667
validation[          , genome  7100] predictions:    9771/  10000 (97.71%), best:    9771/10000 (97.71%), error:       759.30939, best error:       759.30939 on epoch:    91, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 158.9212951660s, input_fired_time: 2.0397422314, output_fired_time: 1.7876837254, propagate_forward_time: 58.7734298706, propagate_backward_time: 93.0269088745, weight_update_time: 0.1525032371, other_time: 3.2935180664
epoch time: 12.8825912476s, input_fired_time: 0.2983156741, output_fired_time: 0.0000000000, propagate_forward_time: 11.9753293991, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6089458466
validation[          , genome  7100] predictions:    9759/  10000 (97.59%), best:    9771/10000 (97.71%), error:       817.82861, best error:       759.30939 on epoch:    91, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 159.1066131592s, input_fired_time: 2.0545227528, output_fired_time: 1.7281208038, propagate_forward_time: 58.8574752808, propagate_backward_time: 93.1237106323, weight_update_time: 0.1527690440, other_time: 3.3427886963
epoch time: 12.9097728729s, input_fired_time: 0.2568655312, output_fired_time: 0.0000000000, propagate_forward_time: 12.0539541245, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5989532471
validation[          , genome  7100] predictions:    9777/  10000 (97.77%), best:    9771/10000 (97.71%), error:       770.38708, best error:       759.30939 on epoch:    91, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 158.3911132813s, input_fired_time: 2.0213110447, output_fired_time: 1.7160189152, propagate_forward_time: 58.7255973816, propagate_backward_time: 92.6728134155, weight_update_time: 0.1517065912, other_time: 3.2553634644
epoch time: 13.1012010574s, input_fired_time: 0.2550366819, output_fired_time: 0.0000000000, propagate_forward_time: 12.2195081711, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6266565323
validation[          , genome  7100] predictions:    9706/  10000 (97.06%), best:    9771/10000 (97.71%), error:       949.00439, best error:       759.30939 on epoch:    91, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 160.0149536133s, input_fired_time: 2.0405852795, output_fired_time: 1.7915587425, propagate_forward_time: 59.1349868774, propagate_backward_time: 93.7171325684, weight_update_time: 0.1519948542, other_time: 3.3306808472
epoch time: 12.6226711273s, input_fired_time: 0.2534463406, output_fired_time: 0.0000000000, propagate_forward_time: 11.7787284851, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5904960632
validation[          , genome  7100] predictions:    9721/  10000 (97.21%), best:    9771/10000 (97.71%), error:       898.14093, best error:       759.30939 on epoch:    91, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 160.0889434814s, input_fired_time: 2.0309503078, output_fired_time: 1.7256380320, propagate_forward_time: 59.4947891235, propagate_backward_time: 93.5612487793, weight_update_time: 0.1521883607, other_time: 3.2763290405
epoch time: 12.6166696548s, input_fired_time: 0.2535318732, output_fired_time: 0.0000000000, propagate_forward_time: 11.7676849365, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5954532623
validation[          , genome  7100] predictions:    9759/  10000 (97.59%), best:    9771/10000 (97.71%), error:       826.21698, best error:       759.30939 on epoch:    91, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 162.3488464355s, input_fired_time: 2.0543274879, output_fired_time: 1.7406044006, propagate_forward_time: 60.2731475830, propagate_backward_time: 94.9944229126, weight_update_time: 0.1536091715, other_time: 3.2863540649
epoch time: 14.5931110382s, input_fired_time: 0.2617906034, output_fired_time: 0.0000000000, propagate_forward_time: 13.6636924744, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6676282883
validation[          , genome  7100] predictions:    9778/  10000 (97.78%), best:    9771/10000 (97.71%), error:       763.77863, best error:       759.30939 on epoch:    91, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 162.0247039795s, input_fired_time: 2.0422406197, output_fired_time: 1.7898411751, propagate_forward_time: 59.8594932556, propagate_backward_time: 94.9820251465, weight_update_time: 0.1534468979, other_time: 3.3511047363
epoch time: 12.9416933060s, input_fired_time: 0.2580374777, output_fired_time: 0.0000000000, propagate_forward_time: 12.0835332870, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6001224518
validation[          , genome  7100] predictions:    9772/  10000 (97.72%), best:    9771/10000 (97.71%), error:       774.57123, best error:       759.30939 on epoch:    91, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 218.9094085693s, input_fired_time: 2.9296507835, output_fired_time: 2.1811738014, propagate_forward_time: 81.7858123779, propagate_backward_time: 127.4779739380, weight_update_time: 0.1683123559, other_time: 4.5347976685
epoch time: 19.7028598785s, input_fired_time: 0.2843608856, output_fired_time: 0.0000000000, propagate_forward_time: 18.7571220398, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6613769531
validation[          , genome  7100] predictions:    9766/  10000 (97.66%), best:    9771/10000 (97.71%), error:       777.83075, best error:       759.30939 on epoch:    91, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 242.4029846191s, input_fired_time: 2.9650130272, output_fired_time: 1.9697208405, propagate_forward_time: 94.6943664551, propagate_backward_time: 138.1855468750, weight_update_time: 0.1711908281, other_time: 4.5883331299
epoch time: 19.6844253540s, input_fired_time: 0.7851168513, output_fired_time: 0.0000000000, propagate_forward_time: 18.2418556213, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6574535370
validation[          , genome  7100] predictions:    9745/  10000 (97.45%), best:    9771/10000 (97.71%), error:       854.37500, best error:       759.30939 on epoch:    91, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 94.8549118042s, input_fired_time: 2.1397850513, output_fired_time: 0.0000000000, propagate_forward_time: 88.6437683105, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0713577271
best training[          , genome  7100] predictions:   49658/  50000 (99.32%), best:    9771/10000 (97.71%), error:      1504.09155, best error:       759.30939 on epoch:    91, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 19.4597969055s, input_fired_time: 0.2774794698, output_fired_time: 0.0000000000, propagate_forward_time: 18.2572860718, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9250316620
   testing[          , genome  7100] predictions:    9797/  10000 (97.97%), best:    9771/10000 (97.71%), error:       676.47095, best error:       759.30939 on epoch:    91, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
18:24:37 (400): called boinc_finish(0)

</stderr_txt>
]]>