Nameexact_genome_1512568488_45_6923_0
Workunit2605810
Created7 Dec 2017, 22:45:08 UTC
Sent7 Dec 2017, 22:47:08 UTC
Report deadline15 Dec 2017, 19:24:02 UTC
Received8 Dec 2017, 6:06:31 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID69041
Run time1 hours 47 min 55 sec
CPU time1 hours 31 min
Validate stateValid
Credit1,964.74
Device peak FLOPS3.31 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34

Stderr output

<core_client_version>7.0.80</core_client_version>
<![CDATA[
<stderr_txt>
ation[          , genome  6923] predictions:    9717/  10000 (97.17%), best:    9717/10000 (97.17%), error:       972.49683, best error:       972.49683 on epoch:    14, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 126.3373184204s, input_fired_time: 0.6244773865, output_fired_time: 0.4899248183, propagate_forward_time: 54.7154541016, propagate_backward_time: 69.2082595825, weight_update_time: 0.0678228214, other_time: 1.2992095947
epoch time: 9.8728179932s, input_fired_time: 0.0718479156, output_fired_time: 0.0000000000, propagate_forward_time: 9.5719575882, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2290124893
validation[          , genome  6923] predictions:    9664/  10000 (96.64%), best:    9717/10000 (97.17%), error:      1045.89099, best error:       972.49683 on epoch:    14, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 126.1132812500s, input_fired_time: 4.5893778801, output_fired_time: 2.5147819519, propagate_forward_time: 39.2356452942, propagate_backward_time: 78.4795684814, weight_update_time: 0.0673532933, other_time: 1.2939147949
epoch time: 9.8094377518s, input_fired_time: 0.0706611276, output_fired_time: 0.0000000000, propagate_forward_time: 9.5135650635, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2252111435
validation[          , genome  6923] predictions:    9668/  10000 (96.68%), best:    9717/10000 (97.17%), error:      1074.31421, best error:       972.49683 on epoch:    14, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 127.4222488403s, input_fired_time: 0.6211944222, output_fired_time: 0.4858784080, propagate_forward_time: 49.7003669739, propagate_backward_time: 72.3545379639, weight_update_time: 0.0674375743, other_time: 4.2602691650
epoch time: 10.2201395035s, input_fired_time: 0.0752562806, output_fired_time: 0.0000000000, propagate_forward_time: 9.9135589600, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2313241959
validation[          , genome  6923] predictions:    9701/  10000 (97.01%), best:    9717/10000 (97.17%), error:       976.56927, best error:       972.49683 on epoch:    14, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 129.0045166016s, input_fired_time: 2.6974649429, output_fired_time: 0.5001340508, propagate_forward_time: 46.7877426147, propagate_backward_time: 73.6726303101, weight_update_time: 0.0692598224, other_time: 5.3465423584
epoch time: 9.9923896790s, input_fired_time: 0.0762744769, output_fired_time: 0.0000000000, propagate_forward_time: 6.7447733879, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.1713414192
validation[          , genome  6923] predictions:    9716/  10000 (97.16%), best:    9716/10000 (97.16%), error:       961.65186, best error:       961.65186 on epoch:    18, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 126.8297882080s, input_fired_time: 3.6949639320, output_fired_time: 0.4955191910, propagate_forward_time: 54.9775886536, propagate_backward_time: 59.4808006287, weight_update_time: 0.0681975186, other_time: 8.1809120178
epoch time: 10.0073776245s, input_fired_time: 0.0738346800, output_fired_time: 0.0000000000, propagate_forward_time: 9.7045297623, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2290134430
validation[          , genome  6923] predictions:    9756/  10000 (97.56%), best:    9756/10000 (97.56%), error:       838.63135, best error:       838.63135 on epoch:    19, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 126.8817520142s, input_fired_time: 2.5977263451, output_fired_time: 3.6466624737, propagate_forward_time: 44.9974136353, propagate_backward_time: 68.2025375366, weight_update_time: 0.0701282322, other_time: 7.4374160767
epoch time: 9.9729557037s, input_fired_time: 0.0732902065, output_fired_time: 0.0000000000, propagate_forward_time: 9.6669101715, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2327556610
validation[          , genome  6923] predictions:    9722/  10000 (97.22%), best:    9756/10000 (97.56%), error:       881.31494, best error:       838.63135 on epoch:    19, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 126.7773590088s, input_fired_time: 2.5822083950, output_fired_time: 0.4878213406, propagate_forward_time: 32.3251304626, propagate_backward_time: 90.0657348633, weight_update_time: 0.0695818886, other_time: 1.3164672852
epoch time: 10.1410303116s, input_fired_time: 2.1381461620, output_fired_time: 0.0000000000, propagate_forward_time: 7.7632598877, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2396240234
validation[          , genome  6923] predictions:    9738/  10000 (97.38%), best:    9756/10000 (97.56%), error:       883.20300, best error:       838.63135 on epoch:    19, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 127.8751449585s, input_fired_time: 2.6965768337, output_fired_time: 0.4901160300, propagate_forward_time: 45.8427276611, propagate_backward_time: 76.5381088257, weight_update_time: 0.0700704604, other_time: 2.3076171875
epoch time: 10.1211318970s, input_fired_time: 0.0728008077, output_fired_time: 0.0000000000, propagate_forward_time: 9.8144292831, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2339019775
validation[          , genome  6923] predictions:    9735/  10000 (97.35%), best:    9756/10000 (97.56%), error:       872.32318, best error:       838.63135 on epoch:    19, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 128.7864074707s, input_fired_time: 0.6442758441, output_fired_time: 0.4931802154, propagate_forward_time: 40.5607147217, propagate_backward_time: 85.7583923340, weight_update_time: 0.0694782585, other_time: 1.3298492432
epoch time: 10.2696142197s, input_fired_time: 0.0740964934, output_fired_time: 0.0000000000, propagate_forward_time: 7.8912158012, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3043017387
validation[          , genome  6923] predictions:    9727/  10000 (97.27%), best:    9756/10000 (97.56%), error:       936.57318, best error:       838.63135 on epoch:    19, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 128.1293182373s, input_fired_time: 0.6288849711, output_fired_time: 0.4939672947, propagate_forward_time: 35.5870246887, propagate_backward_time: 88.1463699341, weight_update_time: 0.0676034987, other_time: 3.2730789185
epoch time: 7.9992733002s, input_fired_time: 0.0725414529, output_fired_time: 0.0000000000, propagate_forward_time: 7.6867804527, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2399516106
validation[          , genome  6923] predictions:    9702/  10000 (97.02%), best:    9756/10000 (97.56%), error:       953.45740, best error:       838.63135 on epoch:    19, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 128.8628234863s, input_fired_time: 2.6000158787, output_fired_time: 0.4917755723, propagate_forward_time: 47.2273139954, propagate_backward_time: 74.2755508423, weight_update_time: 0.0708438829, other_time: 4.2681655884
epoch time: 10.0380887985s, input_fired_time: 0.0748683512, output_fired_time: 0.0000000000, propagate_forward_time: 9.7250289917, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2381916046
validation[          , genome  6923] predictions:    9711/  10000 (97.11%), best:    9756/10000 (97.56%), error:       963.56897, best error:       838.63135 on epoch:    19, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 127.7562026978s, input_fired_time: 0.6265513301, output_fired_time: 0.4888218641, propagate_forward_time: 43.8550338745, propagate_backward_time: 81.4633789063, weight_update_time: 0.0683281347, other_time: 1.3224182129
epoch time: 9.9268627167s, input_fired_time: 2.0537612438, output_fired_time: 0.0000000000, propagate_forward_time: 5.5787472725, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2943539619
validation[          , genome  6923] predictions:    9749/  10000 (97.49%), best:    9756/10000 (97.56%), error:       840.06891, best error:       838.63135 on epoch:    19, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 123.2727127075s, input_fired_time: 0.6212639809, output_fired_time: 0.4782571793, propagate_forward_time: 45.8796615601, propagate_backward_time: 70.8852233887, weight_update_time: 0.0668664426, other_time: 5.4083099365
epoch time: 9.8088493347s, input_fired_time: 0.0716365352, output_fired_time: 0.0000000000, propagate_forward_time: 9.5055742264, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2316389084
validation[          , genome  6923] predictions:    9728/  10000 (97.28%), best:    9756/10000 (97.56%), error:       893.95862, best error:       838.63135 on epoch:    19, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 126.7602081299s, input_fired_time: 3.6051390171, output_fired_time: 1.5263638496, propagate_forward_time: 41.0309410095, propagate_backward_time: 77.2890625000, weight_update_time: 0.0675986037, other_time: 3.3087005615
epoch time: 10.0582828522s, input_fired_time: 0.0727498308, output_fired_time: 0.0000000000, propagate_forward_time: 9.7588987350, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2266340256
validation[          , genome  6923] predictions:    9758/  10000 (97.58%), best:    9758/10000 (97.58%), error:       803.89325, best error:       803.89325 on epoch:    28, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 116.7374343872s, input_fired_time: 0.6132122874, output_fired_time: 0.4687799215, propagate_forward_time: 40.5504264832, propagate_backward_time: 73.8356781006, weight_update_time: 0.0667300522, other_time: 1.2693328857
epoch time: 10.1589698792s, input_fired_time: 0.0740489960, output_fired_time: 0.0000000000, propagate_forward_time: 9.8467845917, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2381362915
validation[          , genome  6923] predictions:    9735/  10000 (97.35%), best:    9758/10000 (97.58%), error:       887.99243, best error:       803.89325 on epoch:    28, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 126.4496078491s, input_fired_time: 2.5849175453, output_fired_time: 1.5712637901, propagate_forward_time: 46.6353759766, propagate_backward_time: 73.2618713379, weight_update_time: 0.0685351342, other_time: 2.3961791992
epoch time: 10.0430307388s, input_fired_time: 1.0525497198, output_fired_time: 0.0000000000, propagate_forward_time: 8.7590999603, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2313814163
validation[          , genome  6923] predictions:    9788/  10000 (97.88%), best:    9788/10000 (97.88%), error:       768.15771, best error:       768.15771 on epoch:    30, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 128.8084564209s, input_fired_time: 2.6691443920, output_fired_time: 0.4937955141, propagate_forward_time: 49.5353622437, propagate_backward_time: 74.8028182983, weight_update_time: 0.0682238638, other_time: 1.3073348999
epoch time: 9.9868888855s, input_fired_time: 0.0717723593, output_fired_time: 0.0000000000, propagate_forward_time: 9.6817312241, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2333850861
validation[          , genome  6923] predictions:    9727/  10000 (97.27%), best:    9788/10000 (97.88%), error:       934.30981, best error:       768.15771 on epoch:    30, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 124.7056503296s, input_fired_time: 0.6163097024, output_fired_time: 2.5443406105, propagate_forward_time: 47.2876853943, propagate_backward_time: 71.0008926392, weight_update_time: 0.0666507557, other_time: 3.2564163208
epoch time: 10.0911130905s, input_fired_time: 0.0727975965, output_fired_time: 0.0000000000, propagate_forward_time: 9.7932338715, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2250814438
validation[          , genome  6923] predictions:    9747/  10000 (97.47%), best:    9788/10000 (97.88%), error:       860.36005, best error:       768.15771 on epoch:    30, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 125.7070999146s, input_fired_time: 0.6232745647, output_fired_time: 4.5773410797, propagate_forward_time: 46.6328468323, propagate_backward_time: 69.5719223022, weight_update_time: 0.0660698935, other_time: 4.3017196655
epoch time: 10.0789384842s, input_fired_time: 0.0726839527, output_fired_time: 0.0000000000, propagate_forward_time: 9.7794809341, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2267732620
validation[          , genome  6923] predictions:    9683/  10000 (96.83%), best:    9788/10000 (97.88%), error:       992.78137, best error:       768.15771 on epoch:    30, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 125.8399658203s, input_fired_time: 1.6415959597, output_fired_time: 1.5281469822, propagate_forward_time: 53.5101280212, propagate_backward_time: 65.8167266846, weight_update_time: 0.0668768957, other_time: 3.3433685303
epoch time: 10.1248216629s, input_fired_time: 0.0718522742, output_fired_time: 0.0000000000, propagate_forward_time: 9.8305435181, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2224254608
validation[          , genome  6923] predictions:    9758/  10000 (97.58%), best:    9788/10000 (97.88%), error:       777.38037, best error:       768.15771 on epoch:    30, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 129.0223846436s, input_fired_time: 2.6560204029, output_fired_time: 0.4899772108, propagate_forward_time: 55.0742835999, propagate_backward_time: 68.4849624634, weight_update_time: 0.0688789338, other_time: 2.3171463013
epoch time: 12.1733398438s, input_fired_time: 2.0908989906, output_fired_time: 0.0000000000, propagate_forward_time: 9.8352756500, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2471656799
validation[          , genome  6923] predictions:    9721/  10000 (97.21%), best:    9788/10000 (97.88%), error:       947.24579, best error:       768.15771 on epoch:    30, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 129.9626159668s, input_fired_time: 3.6575562954, output_fired_time: 0.4946779311, propagate_forward_time: 45.7524681091, propagate_backward_time: 78.7120056152, weight_update_time: 0.0708405450, other_time: 1.3459167480
epoch time: 9.8694591522s, input_fired_time: 0.0732460171, output_fired_time: 0.0000000000, propagate_forward_time: 9.5662384033, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2299747467
validation[          , genome  6923] predictions:    9737/  10000 (97.37%), best:    9788/10000 (97.88%), error:       870.17157, best error:       768.15771 on epoch:    30, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 128.1248016357s, input_fired_time: 0.6283952594, output_fired_time: 0.4760736525, propagate_forward_time: 41.8529548645, propagate_backward_time: 81.8420944214, weight_update_time: 1.0865117311, other_time: 3.3252792358
epoch time: 9.9392805099s, input_fired_time: 0.0736620352, output_fired_time: 0.0000000000, propagate_forward_time: 9.6303911209, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2352275848
validation[          , genome  6923] predictions:    9700/  10000 (97.00%), best:    9788/10000 (97.88%), error:      1079.50867, best error:       768.15771 on epoch:    30, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 128.9526977539s, input_fired_time: 3.6706430912, output_fired_time: 0.4844798446, propagate_forward_time: 44.6562194824, propagate_backward_time: 76.7820129395, weight_update_time: 0.0677151456, other_time: 3.3593368530
epoch time: 10.2090339661s, input_fired_time: 0.0745619312, output_fired_time: 0.0000000000, propagate_forward_time: 8.9102659225, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2242059708
validation[          , genome  6923] predictions:    9751/  10000 (97.51%), best:    9788/10000 (97.88%), error:       866.50708, best error:       768.15771 on epoch:    30, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 169.7968597412s, input_fired_time: 2.8898720741, output_fired_time: 2.7195916176, propagate_forward_time: 50.9913673401, propagate_backward_time: 108.3768692017, weight_update_time: 0.0928308368, other_time: 4.8191604614
epoch time: 12.9873685837s, input_fired_time: 0.0904225856, output_fired_time: 0.0000000000, propagate_forward_time: 12.6090240479, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2879219055
validation[          , genome  6923] predictions:    9732/  10000 (97.32%), best:    9788/10000 (97.88%), error:       910.49640, best error:       768.15771 on epoch:    30, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 168.6432189941s, input_fired_time: 2.9009759426, output_fired_time: 0.6739652157, propagate_forward_time: 63.0636901855, propagate_backward_time: 98.1336746216, weight_update_time: 0.0929983035, other_time: 3.8709182739
epoch time: 12.1820201874s, input_fired_time: 0.0958880633, output_fired_time: 0.0000000000, propagate_forward_time: 11.7659120560, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3202199936
validation[          , genome  6923] predictions:    9744/  10000 (97.44%), best:    9788/10000 (97.88%), error:       841.14209, best error:       768.15771 on epoch:    30, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 161.6798706055s, input_fired_time: 1.9074236155, output_fired_time: 1.6019725800, propagate_forward_time: 54.6082801819, propagate_backward_time: 101.8667068481, weight_update_time: 0.0880193859, other_time: 1.6954879761
epoch time: 14.3951368332s, input_fired_time: 0.0956901386, output_fired_time: 0.0000000000, propagate_forward_time: 11.9409408569, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3585062027
validation[          , genome  6923] predictions:    9764/  10000 (97.64%), best:    9788/10000 (97.88%), error:       775.64301, best error:       768.15771 on epoch:    30, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 161.3927154541s, input_fired_time: 1.8009254932, output_fired_time: 0.6089869738, propagate_forward_time: 56.8253402710, propagate_backward_time: 100.4609909058, weight_update_time: 0.0877424628, other_time: 1.6964721680
epoch time: 13.3721618652s, input_fired_time: 0.1013848260, output_fired_time: 0.0000000000, propagate_forward_time: 10.8726511002, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3981256485
validation[          , genome  6923] predictions:    9724/  10000 (97.24%), best:    9788/10000 (97.88%), error:       901.36340, best error:       768.15771 on epoch:    30, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 157.7246856689s, input_fired_time: 0.8317232728, output_fired_time: 1.6730979681, propagate_forward_time: 62.2811813354, propagate_backward_time: 90.3295364380, weight_update_time: 0.0830268413, other_time: 2.6091461182
epoch time: 7.8110146523s, input_fired_time: 0.0748710483, output_fired_time: 0.0000000000, propagate_forward_time: 7.5084142685, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2277293205
validation[          , genome  6923] predictions:    9731/  10000 (97.31%), best:    9788/10000 (97.88%), error:       859.42072, best error:       768.15771 on epoch:    30, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 133.9064483643s, input_fired_time: 0.6726302505, output_fired_time: 1.5934436321, propagate_forward_time: 47.4592666626, propagate_backward_time: 80.7077484131, weight_update_time: 0.0692036301, other_time: 3.4733657837
epoch time: 13.2174873352s, input_fired_time: 0.0945201144, output_fired_time: 0.0000000000, propagate_forward_time: 10.7487020493, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3742647171
validation[          , genome  6923] predictions:    9566/  10000 (95.66%), best:    9788/10000 (97.88%), error:      1425.97034, best error:       768.15771 on epoch:    30, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 163.8242492676s, input_fired_time: 2.9068272114, output_fired_time: 2.5976068974, propagate_forward_time: 54.0473442078, propagate_backward_time: 99.4093933105, weight_update_time: 0.0932076722, other_time: 4.8630676270
epoch time: 12.3327875137s, input_fired_time: 0.1088233590, output_fired_time: 0.0000000000, propagate_forward_time: 11.9131031036, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3108606339
validation[          , genome  6923] predictions:    9717/  10000 (97.17%), best:    9788/10000 (97.88%), error:       930.02118, best error:       768.15771 on epoch:    30, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 163.9894714355s, input_fired_time: 0.8183602691, output_fired_time: 0.6509406567, propagate_forward_time: 54.6944007874, propagate_backward_time: 106.1009597778, weight_update_time: 0.0841040313, other_time: 1.7248153687
epoch time: 12.3193807602s, input_fired_time: 0.0953061059, output_fired_time: 0.0000000000, propagate_forward_time: 11.9224662781, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3016080856
validation[          , genome  6923] predictions:    9753/  10000 (97.53%), best:    9788/10000 (97.88%), error:       828.17358, best error:       768.15771 on epoch:    30, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 145.8463439941s, input_fired_time: 2.7836267948, output_fired_time: 0.5499665737, propagate_forward_time: 50.3927955627, propagate_backward_time: 88.6800384521, weight_update_time: 0.0735344589, other_time: 3.4399108887
epoch time: 10.9270009995s, input_fired_time: 2.1603982449, output_fired_time: 0.0000000000, propagate_forward_time: 5.5450301170, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2215723991
validation[          , genome  6923] predictions:    9757/  10000 (97.57%), best:    9788/10000 (97.88%), error:       803.04700, best error:       768.15771 on epoch:    30, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 157.9146881104s, input_fired_time: 3.9527459145, output_fired_time: 2.6989281178, propagate_forward_time: 61.2556495667, propagate_backward_time: 84.2620697021, weight_update_time: 0.0834336281, other_time: 5.7453002930
epoch time: 11.8214273453s, input_fired_time: 0.0959029719, output_fired_time: 0.0000000000, propagate_forward_time: 11.4365758896, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2889480591
validation[          , genome  6923] predictions:    9672/  10000 (96.72%), best:    9788/10000 (97.88%), error:      1005.87408, best error:       768.15771 on epoch:    30, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 157.2477416992s, input_fired_time: 0.8303998709, output_fired_time: 4.6999998093, propagate_forward_time: 54.0393981934, propagate_backward_time: 94.9866333008, weight_update_time: 0.0876142681, other_time: 2.6913146973
epoch time: 12.4575109482s, input_fired_time: 0.1052144244, output_fired_time: 0.0000000000, propagate_forward_time: 12.0513181686, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3009786606
validation[          , genome  6923] predictions:    9724/  10000 (97.24%), best:    9788/10000 (97.88%), error:       926.16339, best error:       768.15771 on epoch:    30, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 168.8663482666s, input_fired_time: 0.8308985233, output_fired_time: 2.6735191345, propagate_forward_time: 57.4532203674, propagate_backward_time: 105.2119979858, weight_update_time: 0.0798870623, other_time: 2.6967086792
epoch time: 12.3427724838s, input_fired_time: 0.1055048555, output_fired_time: 0.0000000000, propagate_forward_time: 11.9122314453, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3250360489
validation[          , genome  6923] predictions:    9726/  10000 (97.26%), best:    9788/10000 (97.88%), error:       861.86877, best error:       768.15771 on epoch:    30, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 158.9181976318s, input_fired_time: 1.7956385612, output_fired_time: 0.6325911283, propagate_forward_time: 57.5499191284, propagate_backward_time: 93.0984573364, weight_update_time: 0.0866236687, other_time: 5.8415985107
epoch time: 12.0979804993s, input_fired_time: 0.0928347707, output_fired_time: 0.0000000000, propagate_forward_time: 11.6741991043, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3309469223
validation[          , genome  6923] predictions:    9745/  10000 (97.45%), best:    9788/10000 (97.88%), error:       865.49365, best error:       768.15771 on epoch:    30, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 131.4151458740s, input_fired_time: 4.7882475853, output_fired_time: 2.4569034576, propagate_forward_time: 52.1483268738, propagate_backward_time: 70.6587448120, weight_update_time: 0.0719141737, other_time: 1.3629226685
epoch time: 10.2537879944s, input_fired_time: 0.0763203874, output_fired_time: 0.0000000000, propagate_forward_time: 9.9313688278, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2460985184
validation[          , genome  6923] predictions:    9725/  10000 (97.25%), best:    9788/10000 (97.88%), error:       930.87427, best error:       768.15771 on epoch:    30, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 170.8708038330s, input_fired_time: 3.8010694981, output_fired_time: 2.7222774029, propagate_forward_time: 55.4771499634, propagate_backward_time: 103.1134948730, weight_update_time: 2.1620099545, other_time: 5.7568130493
epoch time: 12.2266178131s, input_fired_time: 0.0954521820, output_fired_time: 0.0000000000, propagate_forward_time: 11.8127813339, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3183841705
validation[          , genome  6923] predictions:    9743/  10000 (97.43%), best:    9788/10000 (97.88%), error:       869.07977, best error:       768.15771 on epoch:    30, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 171.8141479492s, input_fired_time: 2.9236257076, output_fired_time: 1.6464277506, propagate_forward_time: 56.5232734680, propagate_backward_time: 106.9807968140, weight_update_time: 0.0961423740, other_time: 3.7400283813
epoch time: 13.5184793472s, input_fired_time: 0.1036711112, output_fired_time: 0.0000000000, propagate_forward_time: 11.0414838791, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3733243942
validation[          , genome  6923] predictions:    9728/  10000 (97.28%), best:    9788/10000 (97.88%), error:       885.48096, best error:       768.15771 on epoch:    30, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 166.0787811279s, input_fired_time: 0.8178589344, output_fired_time: 2.7088673115, propagate_forward_time: 59.2105979919, propagate_backward_time: 100.5011520386, weight_update_time: 1.1740044355, other_time: 2.8403091431
epoch time: 13.5303039551s, input_fired_time: 0.1045786589, output_fired_time: 0.0000000000, propagate_forward_time: 13.1128654480, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3128595352
validation[          , genome  6923] predictions:    9657/  10000 (96.57%), best:    9788/10000 (97.88%), error:      1042.90405, best error:       768.15771 on epoch:    30, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 166.0311126709s, input_fired_time: 1.9038455486, output_fired_time: 0.6471613646, propagate_forward_time: 65.9540023804, propagate_backward_time: 91.7401580811, weight_update_time: 0.0922350138, other_time: 5.7859573364
epoch time: 10.1959934235s, input_fired_time: 0.0770250112, output_fired_time: 0.0000000000, propagate_forward_time: 9.8824920654, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2364759445
validation[          , genome  6923] predictions:    9775/  10000 (97.75%), best:    9788/10000 (97.88%), error:       782.02966, best error:       768.15771 on epoch:    30, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 147.6723480225s, input_fired_time: 3.9054670334, output_fired_time: 0.5534739494, propagate_forward_time: 50.5028877258, propagate_backward_time: 89.2232284546, weight_update_time: 0.0849451572, other_time: 3.4872970581
epoch time: 13.2085189819s, input_fired_time: 0.1029656380, output_fired_time: 0.0000000000, propagate_forward_time: 12.8105812073, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2949724197
validation[          , genome  6923] predictions:    9748/  10000 (97.48%), best:    9788/10000 (97.88%), error:       825.74286, best error:       768.15771 on epoch:    30, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 164.8622589111s, input_fired_time: 4.7383027077, output_fired_time: 0.6655726433, propagate_forward_time: 59.2060089111, propagate_backward_time: 91.4986190796, weight_update_time: 2.1501505375, other_time: 8.7537612915
epoch time: 12.9508714676s, input_fired_time: 0.0962083340, output_fired_time: 0.0000000000, propagate_forward_time: 12.5799884796, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2746744156
validation[          , genome  6923] predictions:    9746/  10000 (97.46%), best:    9788/10000 (97.88%), error:       830.95557, best error:       768.15771 on epoch:    30, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 160.2859344482s, input_fired_time: 0.8333194256, output_fired_time: 0.6273976564, propagate_forward_time: 57.6039237976, propagate_backward_time: 97.6095581055, weight_update_time: 0.0920982510, other_time: 3.6117401123
epoch time: 10.0227527618s, input_fired_time: 0.0766660720, output_fired_time: 0.0000000000, propagate_forward_time: 9.7151088715, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2309780121
validation[          , genome  6923] predictions:    9769/  10000 (97.69%), best:    9788/10000 (97.88%), error:       802.88678, best error:       768.15771 on epoch:    30, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 143.8935394287s, input_fired_time: 0.7636494040, output_fired_time: 0.5484816432, propagate_forward_time: 55.0643577576, propagate_backward_time: 83.0648422241, weight_update_time: 0.0713422894, other_time: 4.4522018433
epoch time: 10.4187002182s, input_fired_time: 0.0871313140, output_fired_time: 0.0000000000, propagate_forward_time: 10.0869951248, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2445735931
validation[          , genome  6923] predictions:    9744/  10000 (97.44%), best:    9788/10000 (97.88%), error:       842.38397, best error:       768.15771 on epoch:    30, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 127.6958694458s, input_fired_time: 2.7022209167, output_fired_time: 0.5157602429, propagate_forward_time: 46.7815093994, propagate_backward_time: 74.2643661499, weight_update_time: 0.0717019066, other_time: 3.4320144653
epoch time: 10.2176017761s, input_fired_time: 0.0945710093, output_fired_time: 0.0000000000, propagate_forward_time: 8.8595008850, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2635297775
validation[          , genome  6923] predictions:    9752/  10000 (97.52%), best:    9788/10000 (97.88%), error:       837.49005, best error:       768.15771 on epoch:    30, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 172.1062011719s, input_fired_time: 5.8934774399, output_fired_time: 8.7021837234, propagate_forward_time: 63.0211753845, propagate_backward_time: 90.6422805786, weight_update_time: 0.1027578712, other_time: 3.8470840454
epoch time: 12.2331476212s, input_fired_time: 1.1266691685, output_fired_time: 0.0000000000, propagate_forward_time: 10.7894430161, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3170356750
validation[          , genome  6923] predictions:    9737/  10000 (97.37%), best:    9788/10000 (97.88%), error:       858.13495, best error:       768.15771 on epoch:    30, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 157.9162597656s, input_fired_time: 0.8024895191, output_fired_time: 0.5948728323, propagate_forward_time: 57.8045921326, propagate_backward_time: 93.9952239990, weight_update_time: 0.0887225196, other_time: 4.7190704346
epoch time: 10.1458492279s, input_fired_time: 0.0794456899, output_fired_time: 0.0000000000, propagate_forward_time: 7.8121271133, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2542762756
validation[          , genome  6923] predictions:    9760/  10000 (97.60%), best:    9788/10000 (97.88%), error:       816.66370, best error:       768.15771 on epoch:    30, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 134.9281158447s, input_fired_time: 0.6788973212, output_fired_time: 2.5403227806, propagate_forward_time: 46.5730705261, propagate_backward_time: 82.7601242065, weight_update_time: 0.0690285191, other_time: 2.3756942749
epoch time: 10.4671850204s, input_fired_time: 0.0829345658, output_fired_time: 0.0000000000, propagate_forward_time: 10.1081485748, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2761020660
validation[          , genome  6923] predictions:    9756/  10000 (97.56%), best:    9788/10000 (97.88%), error:       843.22778, best error:       768.15771 on epoch:    30, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 142.2689666748s, input_fired_time: 0.7458417416, output_fired_time: 1.5378593206, propagate_forward_time: 41.4287986755, propagate_backward_time: 93.1840820313, weight_update_time: 0.0707548261, other_time: 5.3723907471
epoch time: 10.2245626450s, input_fired_time: 0.0807375684, output_fired_time: 0.0000000000, propagate_forward_time: 9.9000787735, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2437467575
validation[          , genome  6923] predictions:    9723/  10000 (97.23%), best:    9788/10000 (97.88%), error:       914.61517, best error:       768.15771 on epoch:    30, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 139.9124908447s, input_fired_time: 1.7100386620, output_fired_time: 0.5366813540, propagate_forward_time: 48.1638107300, propagate_backward_time: 86.0625381470, weight_update_time: 0.0723440945, other_time: 3.4394226074
epoch time: 10.0876054764s, input_fired_time: 0.0776154548, output_fired_time: 0.0000000000, propagate_forward_time: 9.7663717270, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2436180115
validation[          , genome  6923] predictions:    9652/  10000 (96.52%), best:    9788/10000 (97.88%), error:      1090.32544, best error:       768.15771 on epoch:    30, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 130.3538818359s, input_fired_time: 0.6860456467, output_fired_time: 3.5149385929, propagate_forward_time: 47.9868354797, propagate_backward_time: 73.8042297363, weight_update_time: 0.0675024763, other_time: 4.3618316650
epoch time: 10.0190153122s, input_fired_time: 0.0784817114, output_fired_time: 0.0000000000, propagate_forward_time: 9.6989727020, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2415609360
validation[          , genome  6923] predictions:    9699/  10000 (96.99%), best:    9788/10000 (97.88%), error:       997.64056, best error:       768.15771 on epoch:    30, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 155.1619720459s, input_fired_time: 1.8113406897, output_fired_time: 0.6048432589, propagate_forward_time: 57.3436622620, propagate_backward_time: 90.7659072876, weight_update_time: 0.0826891437, other_time: 4.6362228394
epoch time: 13.4928245544s, input_fired_time: 0.1072343662, output_fired_time: 0.0000000000, propagate_forward_time: 13.0533895493, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3322010040
validation[          , genome  6923] predictions:    9769/  10000 (97.69%), best:    9769/10000 (97.69%), error:       760.42981, best error:       760.42981 on epoch:    68, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 172.4161529541s, input_fired_time: 0.8827917576, output_fired_time: 0.6685144901, propagate_forward_time: 63.1560173035, propagate_backward_time: 102.8226776123, weight_update_time: 0.0959929377, other_time: 4.8861389160
epoch time: 14.6108913422s, input_fired_time: 0.1162238196, output_fired_time: 0.0000000000, propagate_forward_time: 11.1722688675, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3223981857
validation[          , genome  6923] predictions:    9682/  10000 (96.82%), best:    9769/10000 (97.69%), error:      1006.52124, best error:       760.42981 on epoch:    68, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 171.9720306396s, input_fired_time: 0.8845204711, output_fired_time: 0.6731515527, propagate_forward_time: 71.8515853882, propagate_backward_time: 95.7132415771, weight_update_time: 0.0928964242, other_time: 2.8495254517
epoch time: 13.3112401962s, input_fired_time: 0.1020633802, output_fired_time: 0.0000000000, propagate_forward_time: 12.8969354630, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3122415543
validation[          , genome  6923] predictions:    9690/  10000 (96.90%), best:    9769/10000 (97.69%), error:       960.25409, best error:       760.42981 on epoch:    68, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 177.1650695801s, input_fired_time: 2.9351592064, output_fired_time: 0.7047380209, propagate_forward_time: 71.7009735107, propagate_backward_time: 98.9469375610, weight_update_time: 0.0921265781, other_time: 2.8772506714
epoch time: 14.3696012497s, input_fired_time: 0.1028289124, output_fired_time: 0.0000000000, propagate_forward_time: 10.9447898865, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3219823837
validation[          , genome  6923] predictions:    9754/  10000 (97.54%), best:    9769/10000 (97.69%), error:       833.69128, best error:       760.42981 on epoch:    68, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 168.6442718506s, input_fired_time: 0.8547558784, output_fired_time: 0.6349868774, propagate_forward_time: 63.3719291687, propagate_backward_time: 97.9414367676, weight_update_time: 0.0857869908, other_time: 5.8411712646
epoch time: 9.9938783646s, input_fired_time: 0.0772393569, output_fired_time: 0.0000000000, propagate_forward_time: 9.6739149094, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2427244186
validation[          , genome  6923] predictions:    9764/  10000 (97.64%), best:    9769/10000 (97.69%), error:       830.37622, best error:       760.42981 on epoch:    68, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 140.0646820068s, input_fired_time: 5.7218656540, output_fired_time: 0.5499502420, propagate_forward_time: 52.2408905029, propagate_backward_time: 79.0770874023, weight_update_time: 0.0736862794, other_time: 2.4748840332
epoch time: 12.4536218643s, input_fired_time: 0.1030897722, output_fired_time: 0.0000000000, propagate_forward_time: 10.0275478363, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3229846954
validation[          , genome  6923] predictions:    9735/  10000 (97.35%), best:    9769/10000 (97.69%), error:       851.12781, best error:       760.42981 on epoch:    68, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 170.1989288330s, input_fired_time: 0.8611902595, output_fired_time: 1.6659116745, propagate_forward_time: 66.4522094727, propagate_backward_time: 96.4302902222, weight_update_time: 0.1058902740, other_time: 4.7893295288
epoch time: 12.9972925186s, input_fired_time: 0.0967639685, output_fired_time: 0.0000000000, propagate_forward_time: 11.5965890884, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3039398193
validation[          , genome  6923] predictions:    9758/  10000 (97.58%), best:    9769/10000 (97.69%), error:       820.20313, best error:       760.42981 on epoch:    68, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 167.2324066162s, input_fired_time: 2.8460505009, output_fired_time: 3.6675591469, propagate_forward_time: 50.0642967224, propagate_backward_time: 108.8568191528, weight_update_time: 0.0955188423, other_time: 1.7976760864
epoch time: 12.2104892731s, input_fired_time: 0.1059112325, output_fired_time: 0.0000000000, propagate_forward_time: 11.7864723206, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3181056976
validation[          , genome  6923] predictions:    9712/  10000 (97.12%), best:    9769/10000 (97.69%), error:       892.45050, best error:       760.42981 on epoch:    68, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 152.6838836670s, input_fired_time: 4.7777237892, output_fired_time: 0.5845079422, propagate_forward_time: 56.8029899597, propagate_backward_time: 88.9084930420, weight_update_time: 0.0827501416, other_time: 1.6101684570
epoch time: 12.7241353989s, input_fired_time: 0.1144970357, output_fired_time: 0.0000000000, propagate_forward_time: 12.2780084610, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3316297531
validation[          , genome  6923] predictions:    9764/  10000 (97.64%), best:    9769/10000 (97.69%), error:       766.32715, best error:       760.42981 on epoch:    68, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 160.4240722656s, input_fired_time: 1.8193182945, output_fired_time: 2.5166237354, propagate_forward_time: 56.2212905884, propagate_backward_time: 96.1309509277, weight_update_time: 0.0866160393, other_time: 3.7358932495
epoch time: 13.6724262238s, input_fired_time: 0.1136977747, output_fired_time: 0.0000000000, propagate_forward_time: 13.2204589844, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3382692337
validation[          , genome  6923] predictions:    9772/  10000 (97.72%), best:    9769/10000 (97.69%), error:       774.07281, best error:       760.42981 on epoch:    68, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 156.8291320801s, input_fired_time: 0.8087993860, output_fired_time: 0.6180306673, propagate_forward_time: 68.4661712646, propagate_backward_time: 81.2690734863, weight_update_time: 0.0843429416, other_time: 5.6670684814
epoch time: 11.8910989761s, input_fired_time: 0.0925188959, output_fired_time: 0.0000000000, propagate_forward_time: 10.4933948517, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3051853180
validation[          , genome  6923] predictions:    9751/  10000 (97.51%), best:    9769/10000 (97.69%), error:       857.16840, best error:       760.42981 on epoch:    68, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 159.2602233887s, input_fired_time: 2.8286798000, output_fired_time: 1.6104408503, propagate_forward_time: 49.8463020325, propagate_backward_time: 101.4012908936, weight_update_time: 0.0861478969, other_time: 3.5735168457
epoch time: 11.9739799500s, input_fired_time: 0.1069837585, output_fired_time: 0.0000000000, propagate_forward_time: 11.5686750412, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2983207703
validation[          , genome  6923] predictions:    9723/  10000 (97.23%), best:    9769/10000 (97.69%), error:       924.38116, best error:       760.42981 on epoch:    68, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 157.5417327881s, input_fired_time: 0.8095771670, output_fired_time: 0.6443466544, propagate_forward_time: 56.5242118835, propagate_backward_time: 93.8831481934, weight_update_time: 0.0906906500, other_time: 5.6804504395
epoch time: 14.1220369339s, input_fired_time: 1.0987355709, output_fired_time: 0.0000000000, propagate_forward_time: 12.7231330872, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3001680374
validation[          , genome  6923] predictions:    9748/  10000 (97.48%), best:    9769/10000 (97.69%), error:       812.85419, best error:       760.42981 on epoch:    68, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 157.8893432617s, input_fired_time: 2.8024852276, output_fired_time: 0.6079137921, propagate_forward_time: 60.0513343811, propagate_backward_time: 92.7377777100, weight_update_time: 0.0973186269, other_time: 1.6898345947
epoch time: 12.0183973312s, input_fired_time: 0.1050631329, output_fired_time: 0.0000000000, propagate_forward_time: 11.6017637253, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3115701675
validation[          , genome  6923] predictions:    9752/  10000 (97.52%), best:    9769/10000 (97.69%), error:       828.10052, best error:       760.42981 on epoch:    68, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 152.8975982666s, input_fired_time: 0.7849680185, output_fired_time: 0.6116756797, propagate_forward_time: 47.9335136414, propagate_backward_time: 101.9677429199, weight_update_time: 0.0896415114, other_time: 1.5996856689
epoch time: 9.8949260712s, input_fired_time: 0.0793417692, output_fired_time: 0.0000000000, propagate_forward_time: 6.5755414963, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2400426865
validation[          , genome  6923] predictions:    9704/  10000 (97.04%), best:    9769/10000 (97.69%), error:       953.69843, best error:       760.42981 on epoch:    68, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 133.1315612793s, input_fired_time: 2.6850903034, output_fired_time: 0.5135560036, propagate_forward_time: 53.1441230774, propagate_backward_time: 75.4222259521, weight_update_time: 0.0715704411, other_time: 1.3665771484
epoch time: 13.2311992645s, input_fired_time: 0.1002161801, output_fired_time: 0.0000000000, propagate_forward_time: 11.8296537399, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3013296127
validation[          , genome  6923] predictions:    9767/  10000 (97.67%), best:    9769/10000 (97.69%), error:       826.70667, best error:       760.42981 on epoch:    68, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 160.7256317139s, input_fired_time: 0.8394653797, output_fired_time: 1.6617488861, propagate_forward_time: 52.3637847900, propagate_backward_time: 99.1219863892, weight_update_time: 0.0844606310, other_time: 6.7386550903
epoch time: 13.2534866333s, input_fired_time: 0.1036119685, output_fired_time: 0.0000000000, propagate_forward_time: 12.8230514526, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3268232346
validation[          , genome  6923] predictions:    9664/  10000 (96.64%), best:    9769/10000 (97.69%), error:      1144.08618, best error:       760.42981 on epoch:    68, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 161.7460784912s, input_fired_time: 0.8282970786, output_fired_time: 0.6193993092, propagate_forward_time: 59.2016525269, propagate_backward_time: 96.3660125732, weight_update_time: 0.0864831433, other_time: 4.7307205200
epoch time: 13.0309896469s, input_fired_time: 0.1012522057, output_fired_time: 0.0000000000, propagate_forward_time: 12.6254177094, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3043193817
validation[          , genome  6923] predictions:    9736/  10000 (97.36%), best:    9769/10000 (97.69%), error:       876.26721, best error:       760.42981 on epoch:    68, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 160.4803619385s, input_fired_time: 0.8615138531, output_fired_time: 0.6040331721, propagate_forward_time: 56.3208160400, propagate_backward_time: 98.9660797119, weight_update_time: 0.0872570947, other_time: 3.7279205322
epoch time: 12.7886886597s, input_fired_time: 1.1199383736, output_fired_time: 0.0000000000, propagate_forward_time: 9.3901548386, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2785959244
validation[          , genome  6923] predictions:    9708/  10000 (97.08%), best:    9769/10000 (97.69%), error:       939.54504, best error:       760.42981 on epoch:    68, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 157.3971710205s, input_fired_time: 0.7951624393, output_fired_time: 0.6143437624, propagate_forward_time: 52.7998733521, propagate_backward_time: 97.4896011353, weight_update_time: 0.0835857913, other_time: 5.6981811523
epoch time: 11.9035711288s, input_fired_time: 0.0961781442, output_fired_time: 0.0000000000, propagate_forward_time: 11.5288753510, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2785177231
validation[          , genome  6923] predictions:    9743/  10000 (97.43%), best:    9769/10000 (97.69%), error:       857.91248, best error:       760.42981 on epoch:    68, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 128.6793212891s, input_fired_time: 3.7059617043, output_fired_time: 2.5303335190, propagate_forward_time: 43.8712081909, propagate_backward_time: 75.2291870117, weight_update_time: 0.0681893155, other_time: 3.3426284790
epoch time: 10.1153297424s, input_fired_time: 0.0776183903, output_fired_time: 0.0000000000, propagate_forward_time: 9.8098363876, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2278747559
validation[          , genome  6923] predictions:    9751/  10000 (97.51%), best:    9769/10000 (97.69%), error:       829.12628, best error:       760.42981 on epoch:    68, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 126.2757415771s, input_fired_time: 0.6437337399, output_fired_time: 0.4882631600, propagate_forward_time: 50.6691017151, propagate_backward_time: 72.1551589966, weight_update_time: 0.0673540905, other_time: 2.3194808960
epoch time: 8.7689990997s, input_fired_time: 0.0770258904, output_fired_time: 0.0000000000, propagate_forward_time: 6.4885773659, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2033953667
validation[          , genome  6923] predictions:    9759/  10000 (97.59%), best:    9769/10000 (97.69%), error:       798.51093, best error:       760.42981 on epoch:    68, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 125.9880371094s, input_fired_time: 1.6533952951, output_fired_time: 0.4900754392, propagate_forward_time: 42.1830101013, propagate_backward_time: 78.4042205811, weight_update_time: 0.0663642883, other_time: 3.2573394775
epoch time: 11.0339059830s, input_fired_time: 0.0789527521, output_fired_time: 0.0000000000, propagate_forward_time: 10.7174949646, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2374582291
validation[          , genome  6923] predictions:    9763/  10000 (97.63%), best:    9769/10000 (97.69%), error:       808.07013, best error:       760.42981 on epoch:    68, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 127.6888351440s, input_fired_time: 6.6982631683, output_fired_time: 1.5076621771, propagate_forward_time: 48.8563728333, propagate_backward_time: 68.3102874756, weight_update_time: 0.0679905266, other_time: 2.3162536621
epoch time: 9.9888563156s, input_fired_time: 0.0795445815, output_fired_time: 0.0000000000, propagate_forward_time: 9.6752700806, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2340412140
validation[          , genome  6923] predictions:    9736/  10000 (97.36%), best:    9769/10000 (97.69%), error:       887.20636, best error:       760.42981 on epoch:    68, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 128.9880523682s, input_fired_time: 0.6579939127, output_fired_time: 3.4491543770, propagate_forward_time: 39.5854148865, propagate_backward_time: 80.9729461670, weight_update_time: 0.0688327700, other_time: 4.3225402832
epoch time: 9.9967622757s, input_fired_time: 0.0787682831, output_fired_time: 0.0000000000, propagate_forward_time: 7.6799769402, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2380166054
validation[          , genome  6923] predictions:    9757/  10000 (97.57%), best:    9769/10000 (97.69%), error:       871.17426, best error:       760.42981 on epoch:    68, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 128.0670471191s, input_fired_time: 0.6561107039, output_fired_time: 0.4962600172, propagate_forward_time: 52.5540657043, propagate_backward_time: 71.0518035889, weight_update_time: 0.0676723719, other_time: 3.3088073730
epoch time: 9.9782352448s, input_fired_time: 0.0781458914, output_fired_time: 0.0000000000, propagate_forward_time: 9.6667718887, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2333173752
validation[          , genome  6923] predictions:    9775/  10000 (97.75%), best:    9775/10000 (97.75%), error:       758.63007, best error:       758.63007 on epoch:    93, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 126.8408508301s, input_fired_time: 0.6591288447, output_fired_time: 0.4898567498, propagate_forward_time: 52.4111061096, propagate_backward_time: 67.9691085815, weight_update_time: 0.0671401247, other_time: 5.3116531372
epoch time: 9.9922571182s, input_fired_time: 0.0783554986, output_fired_time: 0.0000000000, propagate_forward_time: 9.6836156845, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2302856445
validation[          , genome  6923] predictions:    9766/  10000 (97.66%), best:    9775/10000 (97.75%), error:       819.67908, best error:       758.63007 on epoch:    93, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 127.5025253296s, input_fired_time: 0.6644173861, output_fired_time: 2.5062992573, propagate_forward_time: 53.5204658508, propagate_backward_time: 69.4832611084, weight_update_time: 0.0678960159, other_time: 1.3280792236
epoch time: 7.9233851433s, input_fired_time: 0.0778388232, output_fired_time: 0.0000000000, propagate_forward_time: 7.6125378609, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2330083847
validation[          , genome  6923] predictions:    9732/  10000 (97.32%), best:    9775/10000 (97.75%), error:       893.62878, best error:       758.63007 on epoch:    93, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 127.1449966431s, input_fired_time: 0.6640810966, output_fired_time: 0.4914044738, propagate_forward_time: 46.3854751587, propagate_backward_time: 77.2888641357, weight_update_time: 0.0684580728, other_time: 2.3151779175
epoch time: 10.0227947235s, input_fired_time: 0.0797232240, output_fired_time: 0.0000000000, propagate_forward_time: 9.7077627182, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2353086472
validation[          , genome  6923] predictions:    9734/  10000 (97.34%), best:    9775/10000 (97.75%), error:       848.63599, best error:       758.63007 on epoch:    93, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 129.5668945313s, input_fired_time: 2.6794013977, output_fired_time: 0.4989309907, propagate_forward_time: 51.4136047363, propagate_backward_time: 73.6570281982, weight_update_time: 0.0708827525, other_time: 1.3179321289
epoch time: 10.0028257370s, input_fired_time: 0.0789796337, output_fired_time: 0.0000000000, propagate_forward_time: 9.6920776367, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2317686081
validation[          , genome  6923] predictions:    9772/  10000 (97.72%), best:    9775/10000 (97.75%), error:       809.76300, best error:       758.63007 on epoch:    93, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 127.9853134155s, input_fired_time: 3.6621398926, output_fired_time: 1.4916131496, propagate_forward_time: 46.3581924438, propagate_backward_time: 75.1607818604, weight_update_time: 0.0683116615, other_time: 1.3125839233
epoch time: 10.0134296417s, input_fired_time: 0.0797662437, output_fired_time: 0.0000000000, propagate_forward_time: 9.6957044601, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2379589081
validation[          , genome  6923] predictions:    9748/  10000 (97.48%), best:    9775/10000 (97.75%), error:       850.71307, best error:       758.63007 on epoch:    93, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 127.7256088257s, input_fired_time: 2.6622154713, output_fired_time: 0.4924146831, propagate_forward_time: 51.3905792236, propagate_backward_time: 69.8732070923, weight_update_time: 0.0671261400, other_time: 3.3071899414
epoch time: 10.0548381805s, input_fired_time: 0.0810144842, output_fired_time: 0.0000000000, propagate_forward_time: 7.7257900238, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2480335236
validation[          , genome  6923] predictions:    9751/  10000 (97.51%), best:    9775/10000 (97.75%), error:       815.88336, best error:       758.63007 on epoch:    93, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 127.4336853027s, input_fired_time: 0.6578121185, output_fired_time: 0.4969888926, propagate_forward_time: 52.5990982056, propagate_backward_time: 70.3581619263, weight_update_time: 0.0677010044, other_time: 3.3216247559
epoch time: 10.1074771881s, input_fired_time: 0.0824512839, output_fired_time: 0.0000000000, propagate_forward_time: 7.7751936913, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2498326302
validation[          , genome  6923] predictions:    9756/  10000 (97.56%), best:    9775/10000 (97.75%), error:       833.01538, best error:       758.63007 on epoch:    93, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 49.9137878418s, input_fired_time: 1.4009073973, output_fired_time: 0.0000000000, propagate_forward_time: 47.2995491028, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2133331299
best training[          , genome  6923] predictions:   49688/  50000 (99.38%), best:    9775/10000 (97.75%), error:      1377.60498, best error:       758.63007 on epoch:    93, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 10.0373544693s, input_fired_time: 0.0778941214, output_fired_time: 0.0000000000, propagate_forward_time: 9.6900587082, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2694015503
   testing[          , genome  6923] predictions:    9770/  10000 (97.70%), best:    9775/10000 (97.75%), error:       731.16425, best error:       758.63007 on epoch:    93, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
23:31:05 (9140): called boinc_finish(0)

</stderr_txt>
]]>