Nameexact_genome_1512568488_41_5416_0
Workunit2598328
Created7 Dec 2017, 14:42:14 UTC
Sent7 Dec 2017, 14:45:17 UTC
Report deadline14 Dec 2017, 7:04:10 UTC
Received8 Dec 2017, 1:11:37 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID66858
Run time3 hours 26 min 8 sec
CPU time2 hours 44 min 43 sec
Validate stateValid
Credit1,669.95
Device peak FLOPS1.00 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size155.19 MB
Peak swap size152.72 MB
Peak disk usage1.84 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3985166550
validation[          , genome  5416] predictions:    9598/  10000 (95.98%), best:    9610/10000 (96.10%), error:      1428.60864, best error:      1306.03589 on epoch:    13, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 107.0392761230s, input_fired_time: 1.3153868914, output_fired_time: 1.4417319298, propagate_forward_time: 39.4376220703, propagate_backward_time: 62.0863914490, weight_update_time: 0.1507314146, other_time: 2.7581443787
epoch time: 9.9762773514s, input_fired_time: 0.1444591433, output_fired_time: 0.0000000000, propagate_forward_time: 9.3797397614, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4520788193
validation[          , genome  5416] predictions:    9588/  10000 (95.88%), best:    9610/10000 (96.10%), error:      1346.62708, best error:      1306.03589 on epoch:    13, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 144.8463287354s, input_fired_time: 1.4335632324, output_fired_time: 1.5606849194, propagate_forward_time: 55.3803482056, propagate_backward_time: 83.2855834961, weight_update_time: 0.2141508907, other_time: 3.1861495972
epoch time: 8.7873544693s, input_fired_time: 0.2584622204, output_fired_time: 0.0000000000, propagate_forward_time: 8.0185050964, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5103874207
validation[          , genome  5416] predictions:    9569/  10000 (95.69%), best:    9610/10000 (96.10%), error:      1401.09778, best error:      1306.03589 on epoch:    13, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 110.1199264526s, input_fired_time: 1.3161761761, output_fired_time: 1.3876191378, propagate_forward_time: 41.4595222473, propagate_backward_time: 63.3586845398, weight_update_time: 0.1514301747, other_time: 2.5979194641
epoch time: 23.7780284882s, input_fired_time: 0.2637874186, output_fired_time: 0.0000000000, propagate_forward_time: 22.8792304993, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6350097656
validation[          , genome  5416] predictions:    9594/  10000 (95.94%), best:    9610/10000 (96.10%), error:      1320.30762, best error:      1306.03589 on epoch:    13, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 119.5315628052s, input_fired_time: 1.2202181816, output_fired_time: 1.2683649063, propagate_forward_time: 40.6639442444, propagate_backward_time: 73.5479812622, weight_update_time: 0.1573584527, other_time: 2.8310623169
epoch time: 9.2979927063s, input_fired_time: 0.1442711204, output_fired_time: 0.0000000000, propagate_forward_time: 8.6705646515, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4831571579
validation[          , genome  5416] predictions:    9504/  10000 (95.04%), best:    9610/10000 (96.10%), error:      1565.25342, best error:      1306.03589 on epoch:    13, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 151.2139587402s, input_fired_time: 1.2419593334, output_fired_time: 1.4902635813, propagate_forward_time: 89.3418197632, propagate_backward_time: 56.4675712585, weight_update_time: 0.1332015395, other_time: 2.6723442078
epoch time: 8.5407772064s, input_fired_time: 0.2009495795, output_fired_time: 0.0000000000, propagate_forward_time: 7.8828048706, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4570226669
validation[          , genome  5416] predictions:    9548/  10000 (95.48%), best:    9610/10000 (96.10%), error:      1513.35022, best error:      1306.03589 on epoch:    13, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 93.0692977905s, input_fired_time: 1.1699448824, output_fired_time: 1.1599642038, propagate_forward_time: 34.7838249207, propagate_backward_time: 53.5908622742, weight_update_time: 0.1123798415, other_time: 2.3647003174
epoch time: 15.3521652222s, input_fired_time: 0.2812930942, output_fired_time: 0.0000000000, propagate_forward_time: 14.2918586731, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7790136337
validation[          , genome  5416] predictions:    9609/  10000 (96.09%), best:    9609/10000 (96.09%), error:      1273.66919, best error:      1273.66919 on epoch:    20, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 98.5770721436s, input_fired_time: 1.2724115849, output_fired_time: 1.3214426041, propagate_forward_time: 37.2845039368, propagate_backward_time: 56.2347221375, weight_update_time: 0.1132357270, other_time: 2.4639892578
epoch time: 9.3023090363s, input_fired_time: 0.1500806063, output_fired_time: 0.0000000000, propagate_forward_time: 8.5667037964, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5855245590
validation[          , genome  5416] predictions:    9609/  10000 (96.09%), best:    9609/10000 (96.09%), error:      1300.91077, best error:      1273.66919 on epoch:    20, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 115.3032531738s, input_fired_time: 1.5129283667, output_fired_time: 1.5031124353, propagate_forward_time: 43.6355972290, propagate_backward_time: 65.5566177368, weight_update_time: 0.1544795483, other_time: 3.0949935913
epoch time: 7.2602119446s, input_fired_time: 0.1463447958, output_fired_time: 0.0000000000, propagate_forward_time: 6.6920399666, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4218273163
validation[          , genome  5416] predictions:    9615/  10000 (96.15%), best:    9615/10000 (96.15%), error:      1254.85413, best error:      1254.85413 on epoch:    22, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 92.7058715820s, input_fired_time: 1.2156671286, output_fired_time: 1.4754796028, propagate_forward_time: 34.5484733582, propagate_backward_time: 53.1147346497, weight_update_time: 0.1141893938, other_time: 2.3515167236
epoch time: 7.9254260063s, input_fired_time: 0.1567067355, output_fired_time: 0.0000000000, propagate_forward_time: 7.3118877411, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4568314552
validation[          , genome  5416] predictions:    9593/  10000 (95.93%), best:    9615/10000 (96.15%), error:      1343.95923, best error:      1254.85413 on epoch:    22, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 99.2110595703s, input_fired_time: 1.5677491426, output_fired_time: 1.2326320410, propagate_forward_time: 36.8447265625, propagate_backward_time: 57.0204620361, weight_update_time: 0.1200120300, other_time: 2.5454864502
epoch time: 7.5472402573s, input_fired_time: 0.1562932581, output_fired_time: 0.0000000000, propagate_forward_time: 6.9317088127, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4592380524
validation[          , genome  5416] predictions:    9656/  10000 (96.56%), best:    9656/10000 (96.56%), error:      1180.85999, best error:      1180.85999 on epoch:    24, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 93.7110671997s, input_fired_time: 1.2212046385, output_fired_time: 1.2046509981, propagate_forward_time: 34.8747825623, propagate_backward_time: 53.9275894165, weight_update_time: 0.1179345101, other_time: 2.4828376770
epoch time: 10.6576328278s, input_fired_time: 0.2206914127, output_fired_time: 0.0000000000, propagate_forward_time: 9.8031139374, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6338272095
validation[          , genome  5416] predictions:    9554/  10000 (95.54%), best:    9656/10000 (96.56%), error:      1405.94116, best error:      1180.85999 on epoch:    24, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 116.5158538818s, input_fired_time: 1.3329606056, output_fired_time: 1.2904863358, propagate_forward_time: 49.9376144409, propagate_backward_time: 61.2398796082, weight_update_time: 0.2215341330, other_time: 2.7149085999
epoch time: 8.0533962250s, input_fired_time: 0.1552509665, output_fired_time: 0.0000000000, propagate_forward_time: 7.4589996338, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4391455650
validation[          , genome  5416] predictions:    9644/  10000 (96.44%), best:    9656/10000 (96.56%), error:      1239.29358, best error:      1180.85999 on epoch:    24, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 139.1433258057s, input_fired_time: 1.5574938059, output_fired_time: 1.3673093319, propagate_forward_time: 61.8887214661, propagate_backward_time: 71.7217178345, weight_update_time: 0.1122261211, other_time: 2.6080856323
epoch time: 15.8760633469s, input_fired_time: 0.2525051832, output_fired_time: 0.0000000000, propagate_forward_time: 14.7330942154, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8904638290
validation[          , genome  5416] predictions:    9616/  10000 (96.16%), best:    9656/10000 (96.56%), error:      1262.97290, best error:      1180.85999 on epoch:    24, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 105.4102478027s, input_fired_time: 1.3456699848, output_fired_time: 1.2841827869, propagate_forward_time: 39.9037399292, propagate_backward_time: 60.2438621521, weight_update_time: 0.1163366362, other_time: 2.6327934265
epoch time: 19.6937923431s, input_fired_time: 0.1424044222, output_fired_time: 0.0000000000, propagate_forward_time: 19.0372562408, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5141315460
validation[          , genome  5416] predictions:    9543/  10000 (95.43%), best:    9656/10000 (96.56%), error:      1521.33801, best error:      1180.85999 on epoch:    24, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 138.6632843018s, input_fired_time: 1.1883147955, output_fired_time: 1.2071316242, propagate_forward_time: 56.0819587708, propagate_backward_time: 77.7538909912, weight_update_time: 0.1147227585, other_time: 2.4319915771
epoch time: 12.6579055786s, input_fired_time: 0.2621537149, output_fired_time: 0.0000000000, propagate_forward_time: 11.3639268875, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0318250656
validation[          , genome  5416] predictions:    9636/  10000 (96.36%), best:    9636/10000 (96.36%), error:      1160.43091, best error:      1160.43091 on epoch:    29, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 145.9126739502s, input_fired_time: 1.6547114849, output_fired_time: 1.7414673567, propagate_forward_time: 51.3613014221, propagate_backward_time: 87.9529800415, weight_update_time: 0.1753032506, other_time: 3.2022171021
epoch time: 9.1876220703s, input_fired_time: 0.1996116042, output_fired_time: 0.0000000000, propagate_forward_time: 8.4519615173, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5360488892
validation[          , genome  5416] predictions:    9572/  10000 (95.72%), best:    9636/10000 (96.36%), error:      1339.57617, best error:      1160.43091 on epoch:    29, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 108.3251037598s, input_fired_time: 1.2786451578, output_fired_time: 1.1630601883, propagate_forward_time: 46.4031295776, propagate_backward_time: 57.0494995117, weight_update_time: 0.1210604087, other_time: 2.4307632446
epoch time: 7.5619916916s, input_fired_time: 0.1455889642, output_fired_time: 0.0000000000, propagate_forward_time: 6.9849991798, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4314036369
validation[          , genome  5416] predictions:    9612/  10000 (96.12%), best:    9636/10000 (96.36%), error:      1303.19714, best error:      1160.43091 on epoch:    29, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 123.5814514160s, input_fired_time: 2.4036583900, output_fired_time: 1.1911466122, propagate_forward_time: 58.9656791687, propagate_backward_time: 58.6055145264, weight_update_time: 0.1141146049, other_time: 2.4154548645
epoch time: 10.1801118851s, input_fired_time: 0.1773079336, output_fired_time: 0.0000000000, propagate_forward_time: 9.5234613419, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4793424606
validation[          , genome  5416] predictions:    9605/  10000 (96.05%), best:    9636/10000 (96.36%), error:      1289.95386, best error:      1160.43091 on epoch:    29, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 94.3225708008s, input_fired_time: 1.2142517567, output_fired_time: 1.1969374418, propagate_forward_time: 35.0835037231, propagate_backward_time: 54.4608230591, weight_update_time: 0.1135234907, other_time: 2.3670578003
epoch time: 7.3264818192s, input_fired_time: 0.1510490924, output_fired_time: 0.0000000000, propagate_forward_time: 6.7554879189, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4199447632
validation[          , genome  5416] predictions:    9629/  10000 (96.29%), best:    9636/10000 (96.36%), error:      1211.26135, best error:      1160.43091 on epoch:    29, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 98.3296737671s, input_fired_time: 1.2659271955, output_fired_time: 1.2055705786, propagate_forward_time: 37.3775329590, propagate_backward_time: 56.0228309631, weight_update_time: 0.1135083586, other_time: 2.4578056335
epoch time: 7.4199547768s, input_fired_time: 0.1559204906, output_fired_time: 0.0000000000, propagate_forward_time: 6.8439044952, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4201297760
validation[          , genome  5416] predictions:    9632/  10000 (96.32%), best:    9636/10000 (96.36%), error:      1250.52722, best error:      1160.43091 on epoch:    29, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 112.5849685669s, input_fired_time: 1.4251232147, output_fired_time: 1.7871792316, propagate_forward_time: 41.3101387024, propagate_backward_time: 65.3711853027, weight_update_time: 0.1535719186, other_time: 2.6913452148
epoch time: 9.5910968781s, input_fired_time: 0.1950163841, output_fired_time: 0.0000000000, propagate_forward_time: 8.6746530533, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7214269638
validation[          , genome  5416] predictions:    9633/  10000 (96.33%), best:    9636/10000 (96.36%), error:      1206.01514, best error:      1160.43091 on epoch:    29, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 100.7994766235s, input_fired_time: 1.4539330006, output_fired_time: 1.2807261944, propagate_forward_time: 37.4446411133, propagate_backward_time: 58.0406341553, weight_update_time: 0.1496038437, other_time: 2.5795440674
epoch time: 9.9146728516s, input_fired_time: 0.2231001258, output_fired_time: 0.0000000000, propagate_forward_time: 9.1480245590, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5435485840
validation[          , genome  5416] predictions:    9644/  10000 (96.44%), best:    9636/10000 (96.36%), error:      1186.51086, best error:      1160.43091 on epoch:    29, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 112.8067550659s, input_fired_time: 1.4224022627, output_fired_time: 1.2266747952, propagate_forward_time: 42.2813110352, propagate_backward_time: 65.1533508301, weight_update_time: 0.1113626733, other_time: 2.7230148315
epoch time: 12.4712648392s, input_fired_time: 0.1884179860, output_fired_time: 0.0000000000, propagate_forward_time: 11.5721044540, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7107419968
validation[          , genome  5416] predictions:    9629/  10000 (96.29%), best:    9636/10000 (96.36%), error:      1222.18945, best error:      1160.43091 on epoch:    29, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 118.9569625854s, input_fired_time: 1.5261923075, output_fired_time: 1.3112505674, propagate_forward_time: 40.1881027222, propagate_backward_time: 73.2153549194, weight_update_time: 0.1118905321, other_time: 2.7160644531
epoch time: 7.9806847572s, input_fired_time: 0.1520019919, output_fired_time: 0.0000000000, propagate_forward_time: 7.3724312782, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4562516212
validation[          , genome  5416] predictions:    9599/  10000 (95.99%), best:    9636/10000 (96.36%), error:      1335.24927, best error:      1160.43091 on epoch:    29, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 105.8601989746s, input_fired_time: 1.5200537443, output_fired_time: 1.1874239445, propagate_forward_time: 39.4979515076, propagate_backward_time: 61.1256713867, weight_update_time: 0.1113329828, other_time: 2.5291023254
epoch time: 10.4367628098s, input_fired_time: 0.2015156150, output_fired_time: 0.0000000000, propagate_forward_time: 9.6601705551, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5750770569
validation[          , genome  5416] predictions:    9595/  10000 (95.95%), best:    9636/10000 (96.36%), error:      1325.88757, best error:      1160.43091 on epoch:    29, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 127.2230987549s, input_fired_time: 1.2072812319, output_fired_time: 1.1638746262, propagate_forward_time: 35.5868911743, propagate_backward_time: 86.9204330444, weight_update_time: 0.1151652411, other_time: 2.3446197510
epoch time: 7.8737540245s, input_fired_time: 0.1480842233, output_fired_time: 0.0000000000, propagate_forward_time: 7.3000040054, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4256658554
validation[          , genome  5416] predictions:    9636/  10000 (96.36%), best:    9636/10000 (96.36%), error:      1255.21240, best error:      1160.43091 on epoch:    29, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 116.3110580444s, input_fired_time: 1.4522498846, output_fired_time: 1.5037683249, propagate_forward_time: 43.7918319702, propagate_backward_time: 66.7631759644, weight_update_time: 0.1508432627, other_time: 2.8000335693
epoch time: 8.4566421509s, input_fired_time: 0.1619337201, output_fired_time: 0.0000000000, propagate_forward_time: 7.8495364189, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4451718330
validation[          , genome  5416] predictions:    9668/  10000 (96.68%), best:    9668/10000 (96.68%), error:      1102.80029, best error:      1102.80029 on epoch:    41, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 96.2829589844s, input_fired_time: 1.3569853306, output_fired_time: 1.2113459110, propagate_forward_time: 35.7336158752, propagate_backward_time: 55.4797439575, weight_update_time: 0.1139599159, other_time: 2.5012626648
epoch time: 8.0791645050s, input_fired_time: 0.1476872712, output_fired_time: 0.0000000000, propagate_forward_time: 7.5068135262, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4246635437
validation[          , genome  5416] predictions:    9587/  10000 (95.87%), best:    9668/10000 (96.68%), error:      1347.62390, best error:      1102.80029 on epoch:    41, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 92.4468536377s, input_fired_time: 1.2126501799, output_fired_time: 1.1705856323, propagate_forward_time: 34.5755844116, propagate_backward_time: 53.1763420105, weight_update_time: 0.1108501107, other_time: 2.3116950989
epoch time: 15.0786132813s, input_fired_time: 0.3159882724, output_fired_time: 0.0000000000, propagate_forward_time: 14.0535631180, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7090616226
validation[          , genome  5416] predictions:    9636/  10000 (96.36%), best:    9668/10000 (96.68%), error:      1208.76868, best error:      1102.80029 on epoch:    41, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 137.0412292480s, input_fired_time: 1.4046645164, output_fired_time: 1.2294229269, propagate_forward_time: 37.4892311096, propagate_backward_time: 94.4068069458, weight_update_time: 0.1119551286, other_time: 2.5111160278
epoch time: 14.7220726013s, input_fired_time: 0.1463698000, output_fired_time: 0.0000000000, propagate_forward_time: 14.1669158936, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4087867737
validation[          , genome  5416] predictions:    9654/  10000 (96.54%), best:    9668/10000 (96.68%), error:      1194.81824, best error:      1102.80029 on epoch:    41, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 106.0315475464s, input_fired_time: 1.5158791542, output_fired_time: 1.4083675146, propagate_forward_time: 40.3975906372, propagate_backward_time: 59.9153327942, weight_update_time: 0.2100815624, other_time: 2.7943763733
epoch time: 9.0893583298s, input_fired_time: 0.1923598945, output_fired_time: 0.0000000000, propagate_forward_time: 8.3997678757, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4972305298
validation[          , genome  5416] predictions:    9636/  10000 (96.36%), best:    9668/10000 (96.68%), error:      1260.90088, best error:      1102.80029 on epoch:    41, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 98.3824157715s, input_fired_time: 1.4185371399, output_fired_time: 1.2068037987, propagate_forward_time: 36.8804397583, propagate_backward_time: 56.4521903992, weight_update_time: 0.1196558401, other_time: 2.4244499207
epoch time: 8.0880956650s, input_fired_time: 0.1670288444, output_fired_time: 0.0000000000, propagate_forward_time: 7.4741287231, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4469380379
validation[          , genome  5416] predictions:    9623/  10000 (96.23%), best:    9668/10000 (96.68%), error:      1192.59216, best error:      1102.80029 on epoch:    41, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 91.5321426392s, input_fired_time: 1.1874476671, output_fired_time: 1.1113269329, propagate_forward_time: 34.3715591431, propagate_backward_time: 52.5108566284, weight_update_time: 0.1554692388, other_time: 2.3509521484
epoch time: 9.9729070663s, input_fired_time: 0.2168936729, output_fired_time: 0.0000000000, propagate_forward_time: 9.2469024658, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5091114044
validation[          , genome  5416] predictions:    9620/  10000 (96.20%), best:    9668/10000 (96.68%), error:      1212.38953, best error:      1102.80029 on epoch:    41, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 98.5370407104s, input_fired_time: 1.3153188229, output_fired_time: 1.2113661766, propagate_forward_time: 36.5755348206, propagate_backward_time: 56.9875106812, weight_update_time: 0.1538673639, other_time: 2.4473152161
epoch time: 12.8959465027s, input_fired_time: 0.3629905283, output_fired_time: 0.0000000000, propagate_forward_time: 11.9553546906, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5776014328
validation[          , genome  5416] predictions:    9640/  10000 (96.40%), best:    9668/10000 (96.68%), error:      1205.47937, best error:      1102.80029 on epoch:    41, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 97.1020355225s, input_fired_time: 1.2117325068, output_fired_time: 1.2955935001, propagate_forward_time: 36.4477653503, propagate_backward_time: 55.7287826538, weight_update_time: 0.1148258671, other_time: 2.4181632996
epoch time: 15.4805870056s, input_fired_time: 0.3069491088, output_fired_time: 0.0000000000, propagate_forward_time: 14.3950080872, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7786302567
validation[          , genome  5416] predictions:    9632/  10000 (96.32%), best:    9668/10000 (96.68%), error:      1246.30469, best error:      1102.80029 on epoch:    41, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 138.5433502197s, input_fired_time: 1.4023367167, output_fired_time: 1.2224930525, propagate_forward_time: 61.3301734924, propagate_backward_time: 71.8448333740, weight_update_time: 0.1232426167, other_time: 2.7435150146
epoch time: 9.1583213806s, input_fired_time: 0.1575619131, output_fired_time: 0.0000000000, propagate_forward_time: 8.5215444565, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4792146683
validation[          , genome  5416] predictions:    9596/  10000 (95.96%), best:    9668/10000 (96.68%), error:      1302.68823, best error:      1102.80029 on epoch:    41, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 117.4624862671s, input_fired_time: 1.2897003889, output_fired_time: 1.3542715311, propagate_forward_time: 40.3897933960, propagate_backward_time: 71.7753829956, weight_update_time: 0.1137530953, other_time: 2.6533355713
epoch time: 11.1258630753s, input_fired_time: 0.2159428447, output_fired_time: 0.0000000000, propagate_forward_time: 10.3317079544, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5782127380
validation[          , genome  5416] predictions:    9636/  10000 (96.36%), best:    9668/10000 (96.68%), error:      1175.59583, best error:      1102.80029 on epoch:    41, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 127.7421493530s, input_fired_time: 1.5598312616, output_fired_time: 1.3101965189, propagate_forward_time: 39.6192741394, propagate_backward_time: 82.4988632202, weight_update_time: 0.1116496250, other_time: 2.7539901733
epoch time: 6.9800734520s, input_fired_time: 0.1438121945, output_fired_time: 0.0000000000, propagate_forward_time: 6.4341092110, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4021520615
validation[          , genome  5416] predictions:    9647/  10000 (96.47%), best:    9668/10000 (96.68%), error:      1140.31128, best error:      1102.80029 on epoch:    41, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 142.7304382324s, input_fired_time: 1.1687662601, output_fired_time: 1.0999068022, propagate_forward_time: 79.3565521240, propagate_backward_time: 58.8639678955, weight_update_time: 0.1078635156, other_time: 2.2412567139
epoch time: 16.5380229950s, input_fired_time: 0.2246580869, output_fired_time: 0.0000000000, propagate_forward_time: 15.4652013779, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8481626511
validation[          , genome  5416] predictions:    9657/  10000 (96.57%), best:    9668/10000 (96.68%), error:      1152.27563, best error:      1102.80029 on epoch:    41, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 102.3144760132s, input_fired_time: 1.2470619678, output_fired_time: 1.1543221474, propagate_forward_time: 38.2579116821, propagate_backward_time: 59.0080909729, weight_update_time: 0.1116313338, other_time: 2.6470909119
epoch time: 8.4446964264s, input_fired_time: 0.1481765956, output_fired_time: 0.0000000000, propagate_forward_time: 7.8564944267, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4400258064
validation[          , genome  5416] predictions:    9642/  10000 (96.42%), best:    9668/10000 (96.68%), error:      1138.52991, best error:      1102.80029 on epoch:    41, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 108.2750091553s, input_fired_time: 1.2742462158, output_fired_time: 1.3008887768, propagate_forward_time: 40.4576034546, propagate_backward_time: 62.6781234741, weight_update_time: 0.1124590337, other_time: 2.5641479492
epoch time: 9.2589464188s, input_fired_time: 0.1502978653, output_fired_time: 0.0000000000, propagate_forward_time: 8.5930919647, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5155563354
validation[          , genome  5416] predictions:    9640/  10000 (96.40%), best:    9668/10000 (96.68%), error:      1183.22607, best error:      1102.80029 on epoch:    41, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 100.7258987427s, input_fired_time: 1.2617149353, output_fired_time: 1.3334295750, propagate_forward_time: 37.1555480957, propagate_backward_time: 58.2538070679, weight_update_time: 0.1287652701, other_time: 2.7214050293
epoch time: 7.7428317070s, input_fired_time: 0.1581875235, output_fired_time: 0.0000000000, propagate_forward_time: 7.1525015831, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4321427345
validation[          , genome  5416] predictions:    9627/  10000 (96.27%), best:    9668/10000 (96.68%), error:      1192.61865, best error:      1102.80029 on epoch:    41, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 94.1661834717s, input_fired_time: 1.2255527973, output_fired_time: 1.1391849518, propagate_forward_time: 35.3541107178, propagate_backward_time: 53.8496170044, weight_update_time: 0.1145175174, other_time: 2.5977172852
epoch time: 8.9301347733s, input_fired_time: 0.1592191905, output_fired_time: 0.0000000000, propagate_forward_time: 8.2558593750, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5150566101
validation[          , genome  5416] predictions:    9661/  10000 (96.61%), best:    9668/10000 (96.68%), error:      1136.58008, best error:      1102.80029 on epoch:    41, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 94.1952972412s, input_fired_time: 1.4845978022, output_fired_time: 1.1544666290, propagate_forward_time: 35.0558319092, propagate_backward_time: 54.1361427307, weight_update_time: 0.1135371774, other_time: 2.3642616272
epoch time: 8.6891670227s, input_fired_time: 0.1668822914, output_fired_time: 0.0000000000, propagate_forward_time: 8.0293025970, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4929819107
validation[          , genome  5416] predictions:    9654/  10000 (96.54%), best:    9668/10000 (96.68%), error:      1154.57996, best error:      1102.80029 on epoch:    41, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 92.2378616333s, input_fired_time: 1.1896342039, output_fired_time: 1.1055333614, propagate_forward_time: 34.7070541382, propagate_backward_time: 52.9406623840, weight_update_time: 0.1099965870, other_time: 2.2949790955
epoch time: 7.5969729424s, input_fired_time: 0.1481145024, output_fired_time: 0.0000000000, propagate_forward_time: 6.9955062866, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4533519745
validation[          , genome  5416] predictions:    9655/  10000 (96.55%), best:    9668/10000 (96.68%), error:      1148.52515, best error:      1102.80029 on epoch:    41, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 90.2018966675s, input_fired_time: 1.1715627909, output_fired_time: 1.1030545235, propagate_forward_time: 33.5518951416, propagate_backward_time: 52.0240707397, weight_update_time: 0.1088919267, other_time: 2.3513107300
epoch time: 7.5978660583s, input_fired_time: 0.1570511609, output_fired_time: 0.0000000000, propagate_forward_time: 7.0226497650, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4181652069
validation[          , genome  5416] predictions:    9657/  10000 (96.57%), best:    9668/10000 (96.68%), error:      1160.14160, best error:      1102.80029 on epoch:    41, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 107.4616241455s, input_fired_time: 1.3725831509, output_fired_time: 1.2958358526, propagate_forward_time: 40.5555915833, propagate_backward_time: 61.7864875793, weight_update_time: 0.1161250025, other_time: 2.4511222839
epoch time: 10.6588811874s, input_fired_time: 0.2497112006, output_fired_time: 0.0000000000, propagate_forward_time: 9.6999626160, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7092075348
validation[          , genome  5416] predictions:    9649/  10000 (96.49%), best:    9668/10000 (96.68%), error:      1112.92639, best error:      1102.80029 on epoch:    41, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 97.3749771118s, input_fired_time: 1.2720066309, output_fired_time: 1.3034408092, propagate_forward_time: 36.3246726990, propagate_backward_time: 56.1476516724, weight_update_time: 0.1130925044, other_time: 2.3272056580
epoch time: 11.3375215530s, input_fired_time: 0.1832480282, output_fired_time: 0.0000000000, propagate_forward_time: 10.5081090927, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6461648941
validation[          , genome  5416] predictions:    9684/  10000 (96.84%), best:    9684/10000 (96.84%), error:      1064.35181, best error:      1064.35181 on epoch:    62, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 91.6123657227s, input_fired_time: 1.1885186434, output_fired_time: 1.1094646454, propagate_forward_time: 34.0460243225, propagate_backward_time: 52.8850936890, weight_update_time: 0.1116815507, other_time: 2.3832588196
epoch time: 15.8072748184s, input_fired_time: 0.4121674597, output_fired_time: 0.0000000000, propagate_forward_time: 14.1151943207, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2799129486
validation[          , genome  5416] predictions:    9646/  10000 (96.46%), best:    9684/10000 (96.84%), error:      1197.85498, best error:      1064.35181 on epoch:    62, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 97.2074966431s, input_fired_time: 1.2704973221, output_fired_time: 1.1624248028, propagate_forward_time: 36.5613975525, propagate_backward_time: 55.7378082275, weight_update_time: 0.1119290963, other_time: 2.4753684998
epoch time: 7.1432294846s, input_fired_time: 0.1452728063, output_fired_time: 0.0000000000, propagate_forward_time: 6.5862255096, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4117312431
validation[          , genome  5416] predictions:    9643/  10000 (96.43%), best:    9684/10000 (96.84%), error:      1121.34875, best error:      1064.35181 on epoch:    62, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 119.8576354980s, input_fired_time: 1.4487291574, output_fired_time: 1.5373814106, propagate_forward_time: 45.2614631653, propagate_backward_time: 68.5942077637, weight_update_time: 0.1365290284, other_time: 3.0158538818
epoch time: 7.8339767456s, input_fired_time: 0.1490908116, output_fired_time: 0.0000000000, propagate_forward_time: 7.2670707703, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4178152084
validation[          , genome  5416] predictions:    9653/  10000 (96.53%), best:    9684/10000 (96.84%), error:      1095.94446, best error:      1064.35181 on epoch:    62, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 99.1552581787s, input_fired_time: 1.2669373751, output_fired_time: 1.2339090109, propagate_forward_time: 37.1499481201, propagate_backward_time: 56.9907913208, weight_update_time: 0.1129394397, other_time: 2.5136718750
epoch time: 18.8087196350s, input_fired_time: 0.1440625787, output_fired_time: 0.0000000000, propagate_forward_time: 18.1996841431, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4649734497
validation[          , genome  5416] predictions:    9683/  10000 (96.83%), best:    9684/10000 (96.84%), error:      1078.02234, best error:      1064.35181 on epoch:    62, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 95.2796783447s, input_fired_time: 1.2079616785, output_fired_time: 1.1169712543, propagate_forward_time: 35.9763031006, propagate_backward_time: 54.4886093140, weight_update_time: 0.1129866242, other_time: 2.4898300171
epoch time: 9.2092561722s, input_fired_time: 0.1589819044, output_fired_time: 0.0000000000, propagate_forward_time: 8.5846214294, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4656524658
validation[          , genome  5416] predictions:    9590/  10000 (95.90%), best:    9684/10000 (96.84%), error:      1312.87622, best error:      1064.35181 on epoch:    62, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 103.0034637451s, input_fired_time: 1.2931649685, output_fired_time: 1.2250794172, propagate_forward_time: 40.3032913208, propagate_backward_time: 57.3569374084, weight_update_time: 0.1209430695, other_time: 2.8249855042
epoch time: 11.2601966858s, input_fired_time: 0.2191646546, output_fired_time: 0.0000000000, propagate_forward_time: 9.9694442749, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0715875626
validation[          , genome  5416] predictions:    9632/  10000 (96.32%), best:    9684/10000 (96.84%), error:      1142.40930, best error:      1064.35181 on epoch:    62, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 145.2454986572s, input_fired_time: 2.1533107758, output_fired_time: 1.5874340534, propagate_forward_time: 53.1213340759, propagate_backward_time: 85.0449295044, weight_update_time: 0.1462502033, other_time: 3.3384933472
epoch time: 15.6751995087s, input_fired_time: 0.1917251945, output_fired_time: 0.0000000000, propagate_forward_time: 14.6459884644, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8374862671
validation[          , genome  5416] predictions:    9685/  10000 (96.85%), best:    9685/10000 (96.85%), error:      1061.26160, best error:      1061.26160 on epoch:    69, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 108.9057540894s, input_fired_time: 1.3758200407, output_fired_time: 1.3683871031, propagate_forward_time: 41.2656402588, propagate_backward_time: 62.2300109863, weight_update_time: 0.1483266652, other_time: 2.6659011841
epoch time: 16.2570934296s, input_fired_time: 0.2264600098, output_fired_time: 0.0000000000, propagate_forward_time: 15.2437753677, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7868585587
validation[          , genome  5416] predictions:    9660/  10000 (96.60%), best:    9685/10000 (96.85%), error:      1119.25098, best error:      1061.26160 on epoch:    69, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 115.7036743164s, input_fired_time: 1.5361266136, output_fired_time: 1.5556778908, propagate_forward_time: 43.9040870667, propagate_backward_time: 65.6831817627, weight_update_time: 0.1457664669, other_time: 3.0245971680
epoch time: 11.1408185959s, input_fired_time: 0.2173801064, output_fired_time: 0.0000000000, propagate_forward_time: 10.3192529678, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6041851044
validation[          , genome  5416] predictions:    9609/  10000 (96.09%), best:    9685/10000 (96.85%), error:      1257.76892, best error:      1061.26160 on epoch:    69, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 119.3497467041s, input_fired_time: 1.5984116793, output_fired_time: 1.4141254425, propagate_forward_time: 45.2887725830, propagate_backward_time: 68.0529632568, weight_update_time: 0.1150798872, other_time: 2.9954757690
epoch time: 11.0902881622s, input_fired_time: 0.2265104651, output_fired_time: 0.0000000000, propagate_forward_time: 10.2730541229, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5907239914
validation[          , genome  5416] predictions:    9608/  10000 (96.08%), best:    9685/10000 (96.85%), error:      1240.08875, best error:      1061.26160 on epoch:    69, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 128.7991638184s, input_fired_time: 1.6208244562, output_fired_time: 1.4586119652, propagate_forward_time: 53.8775901794, propagate_backward_time: 68.7714462280, weight_update_time: 0.1147976592, other_time: 3.0706863403
epoch time: 12.7605295181s, input_fired_time: 0.3239576519, output_fired_time: 0.0000000000, propagate_forward_time: 11.9008817673, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5356903076
validation[          , genome  5416] predictions:    9654/  10000 (96.54%), best:    9685/10000 (96.85%), error:      1185.32861, best error:      1061.26160 on epoch:    69, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 123.4499130249s, input_fired_time: 1.6443647146, output_fired_time: 1.4963341951, propagate_forward_time: 46.5612831116, propagate_backward_time: 70.8972854614, weight_update_time: 0.1471639425, other_time: 2.8506393433
epoch time: 8.6072216034s, input_fired_time: 0.1607854217, output_fired_time: 0.0000000000, propagate_forward_time: 8.0027780533, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4436578751
validation[          , genome  5416] predictions:    9665/  10000 (96.65%), best:    9685/10000 (96.85%), error:      1098.22876, best error:      1061.26160 on epoch:    69, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 109.4000015259s, input_fired_time: 1.4544264078, output_fired_time: 1.3701381683, propagate_forward_time: 40.6308631897, propagate_backward_time: 63.1567649841, weight_update_time: 0.1151408777, other_time: 2.7877998352
epoch time: 12.0568809509s, input_fired_time: 0.2265580595, output_fired_time: 0.0000000000, propagate_forward_time: 11.2185468674, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6117763519
validation[          , genome  5416] predictions:    9673/  10000 (96.73%), best:    9685/10000 (96.85%), error:      1101.36121, best error:      1061.26160 on epoch:    69, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 111.1078872681s, input_fired_time: 1.4608520269, output_fired_time: 1.2076193094, propagate_forward_time: 41.2178344727, propagate_backward_time: 64.8017425537, weight_update_time: 0.1153873056, other_time: 2.4198379517
epoch time: 11.7563886642s, input_fired_time: 0.2460109890, output_fired_time: 0.0000000000, propagate_forward_time: 10.7454986572, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7648792267
validation[          , genome  5416] predictions:    9673/  10000 (96.73%), best:    9685/10000 (96.85%), error:      1092.19434, best error:      1061.26160 on epoch:    69, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 134.8360900879s, input_fired_time: 1.2051635981, output_fired_time: 1.1245102882, propagate_forward_time: 45.3570823669, propagate_backward_time: 84.6173324585, weight_update_time: 0.1199743077, other_time: 2.5319900513
epoch time: 7.5557312965s, input_fired_time: 0.1559394151, output_fired_time: 0.0000000000, propagate_forward_time: 6.9877562523, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4120354652
validation[          , genome  5416] predictions:    9666/  10000 (96.66%), best:    9685/10000 (96.85%), error:      1110.15613, best error:      1061.26160 on epoch:    69, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 113.6639404297s, input_fired_time: 1.4327895641, output_fired_time: 1.3942534924, propagate_forward_time: 42.3320770264, propagate_backward_time: 65.7384948730, weight_update_time: 0.1185892001, other_time: 2.7663192749
epoch time: 8.9822111130s, input_fired_time: 0.1863233298, output_fired_time: 0.0000000000, propagate_forward_time: 8.3088903427, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4869976044
validation[          , genome  5416] predictions:    9665/  10000 (96.65%), best:    9685/10000 (96.85%), error:      1110.44263, best error:      1061.26160 on epoch:    69, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 92.9084930420s, input_fired_time: 1.2103519440, output_fired_time: 1.1087623835, propagate_forward_time: 34.1775970459, propagate_backward_time: 54.1537551880, weight_update_time: 0.1109115183, other_time: 2.2580261230
epoch time: 11.9678697586s, input_fired_time: 0.1879116446, output_fired_time: 0.0000000000, propagate_forward_time: 11.1932954788, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5866622925
validation[          , genome  5416] predictions:    9607/  10000 (96.07%), best:    9685/10000 (96.85%), error:      1281.97437, best error:      1061.26160 on epoch:    69, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 134.2998809814s, input_fired_time: 1.5708229542, output_fired_time: 1.5233149529, propagate_forward_time: 46.7605209351, propagate_backward_time: 81.4790344238, weight_update_time: 0.1210473105, other_time: 2.9661941528
epoch time: 8.5983324051s, input_fired_time: 0.1597225815, output_fired_time: 0.0000000000, propagate_forward_time: 7.6182618141, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8203482628
validation[          , genome  5416] predictions:    9651/  10000 (96.51%), best:    9685/10000 (96.85%), error:      1143.84949, best error:      1061.26160 on epoch:    69, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 112.9571151733s, input_fired_time: 1.4347611666, output_fired_time: 1.3823379278, propagate_forward_time: 42.3760948181, propagate_backward_time: 64.5293731689, weight_update_time: 0.1176648289, other_time: 3.2345428467
epoch time: 7.5785784721s, input_fired_time: 0.1522027850, output_fired_time: 0.0000000000, propagate_forward_time: 6.9976091385, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4287667274
validation[          , genome  5416] predictions:    9667/  10000 (96.67%), best:    9685/10000 (96.85%), error:      1124.44080, best error:      1061.26160 on epoch:    69, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 101.3255310059s, input_fired_time: 1.3277686834, output_fired_time: 1.2778294086, propagate_forward_time: 37.8253898621, propagate_backward_time: 58.4302635193, weight_update_time: 0.1222862825, other_time: 2.4642791748
epoch time: 7.8092608452s, input_fired_time: 0.1777430773, output_fired_time: 0.0000000000, propagate_forward_time: 7.2032990456, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4282188416
validation[          , genome  5416] predictions:    9661/  10000 (96.61%), best:    9685/10000 (96.85%), error:      1095.15784, best error:      1061.26160 on epoch:    69, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 102.3274765015s, input_fired_time: 1.2354073524, output_fired_time: 1.2211046219, propagate_forward_time: 38.9348258972, propagate_backward_time: 58.2080574036, weight_update_time: 0.1180989519, other_time: 2.7280807495
epoch time: 7.8711924553s, input_fired_time: 0.1576058567, output_fired_time: 0.0000000000, propagate_forward_time: 7.2791223526, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4344644547
validation[          , genome  5416] predictions:    9667/  10000 (96.67%), best:    9667/10000 (96.67%), error:      1043.61353, best error:      1043.61353 on epoch:    83, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 97.0665359497s, input_fired_time: 1.2626810074, output_fired_time: 1.1791125536, propagate_forward_time: 36.6811103821, propagate_backward_time: 55.5647163391, weight_update_time: 0.1174482554, other_time: 2.3789138794
epoch time: 7.9160981178s, input_fired_time: 0.1532660127, output_fired_time: 0.0000000000, propagate_forward_time: 7.3490495682, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4137825966
validation[          , genome  5416] predictions:    9648/  10000 (96.48%), best:    9667/10000 (96.67%), error:      1091.68713, best error:      1043.61353 on epoch:    83, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 112.6989593506s, input_fired_time: 1.4643095732, output_fired_time: 1.2426083088, propagate_forward_time: 42.2913589478, propagate_backward_time: 64.9794158936, weight_update_time: 0.1513902396, other_time: 2.7212677002
epoch time: 7.1840195656s, input_fired_time: 0.1459038705, output_fired_time: 0.0000000000, propagate_forward_time: 6.6297779083, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4083375931
validation[          , genome  5416] predictions:    9667/  10000 (96.67%), best:    9667/10000 (96.67%), error:      1104.09961, best error:      1043.61353 on epoch:    83, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 184.9609375000s, input_fired_time: 1.6134405136, output_fired_time: 1.4007925987, propagate_forward_time: 56.7833366394, propagate_backward_time: 121.9443435669, weight_update_time: 0.1451133937, other_time: 3.2190322876
epoch time: 23.3659915924s, input_fired_time: 0.2696218789, output_fired_time: 0.0000000000, propagate_forward_time: 22.2991085052, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7972602844
validation[          , genome  5416] predictions:    9630/  10000 (96.30%), best:    9667/10000 (96.67%), error:      1229.40100, best error:      1043.61353 on epoch:    83, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 115.8704223633s, input_fired_time: 1.2882546186, output_fired_time: 1.1958191395, propagate_forward_time: 44.4130592346, propagate_backward_time: 66.4165725708, weight_update_time: 0.1164726466, other_time: 2.5567245483
epoch time: 7.4459633827s, input_fired_time: 0.1583110988, output_fired_time: 0.0000000000, propagate_forward_time: 6.8520226479, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4356298447
validation[          , genome  5416] predictions:    9648/  10000 (96.48%), best:    9667/10000 (96.67%), error:      1152.03088, best error:      1043.61353 on epoch:    83, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 120.0725936890s, input_fired_time: 1.4663580656, output_fired_time: 1.3200504780, propagate_forward_time: 40.8653564453, propagate_backward_time: 73.6327819824, weight_update_time: 0.1489168257, other_time: 2.7880477905
epoch time: 7.6825199127s, input_fired_time: 0.1485576481, output_fired_time: 0.0000000000, propagate_forward_time: 6.7242736816, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8096885681
validation[          , genome  5416] predictions:    9685/  10000 (96.85%), best:    9667/10000 (96.67%), error:      1055.20142, best error:      1043.61353 on epoch:    83, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 97.9297561646s, input_fired_time: 1.2693312168, output_fired_time: 1.2083914280, propagate_forward_time: 36.8071212769, propagate_backward_time: 56.2107543945, weight_update_time: 0.1152748093, other_time: 2.4341583252
epoch time: 7.5784544945s, input_fired_time: 0.1458007693, output_fired_time: 0.0000000000, propagate_forward_time: 7.0012440681, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4314098358
validation[          , genome  5416] predictions:    9640/  10000 (96.40%), best:    9667/10000 (96.67%), error:      1176.40015, best error:      1043.61353 on epoch:    83, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 98.0980300903s, input_fired_time: 1.2665287256, output_fired_time: 1.1827983856, propagate_forward_time: 36.5530128479, propagate_backward_time: 56.6576690674, weight_update_time: 0.1207163855, other_time: 2.4380226135
epoch time: 8.2049646378s, input_fired_time: 0.1786696166, output_fired_time: 0.0000000000, propagate_forward_time: 7.5769190788, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4493756294
validation[          , genome  5416] predictions:    9685/  10000 (96.85%), best:    9667/10000 (96.67%), error:      1064.04504, best error:      1043.61353 on epoch:    83, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 101.4239654541s, input_fired_time: 1.2947818041, output_fired_time: 1.1948112249, propagate_forward_time: 38.1457939148, propagate_backward_time: 58.2740936279, weight_update_time: 0.1202306598, other_time: 2.5144844055
epoch time: 20.5660095215s, input_fired_time: 10.5217094421, output_fired_time: 0.0000000000, propagate_forward_time: 9.3595571518, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.6847429276
validation[          , genome  5416] predictions:    9651/  10000 (96.51%), best:    9667/10000 (96.67%), error:      1166.17834, best error:      1043.61353 on epoch:    83, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 107.0842285156s, input_fired_time: 1.3726886511, output_fired_time: 1.3595995903, propagate_forward_time: 40.2869033813, propagate_backward_time: 61.5245132446, weight_update_time: 0.1145586446, other_time: 2.5405273438
epoch time: 6.7022891045s, input_fired_time: 0.1423954219, output_fired_time: 0.0000000000, propagate_forward_time: 6.1785922050, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3813014030
validation[          , genome  5416] predictions:    9670/  10000 (96.70%), best:    9667/10000 (96.67%), error:      1095.59375, best error:      1043.61353 on epoch:    83, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 98.9716567993s, input_fired_time: 1.3184421062, output_fired_time: 1.2055767775, propagate_forward_time: 36.6844596863, propagate_backward_time: 57.0646743774, weight_update_time: 0.1237183958, other_time: 2.6985054016
epoch time: 7.8114280701s, input_fired_time: 0.1561455131, output_fired_time: 0.0000000000, propagate_forward_time: 7.2138671875, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4414153099
validation[          , genome  5416] predictions:    9635/  10000 (96.35%), best:    9667/10000 (96.67%), error:      1163.36108, best error:      1043.61353 on epoch:    83, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 89.7023468018s, input_fired_time: 1.1998159885, output_fired_time: 1.1042088270, propagate_forward_time: 33.6080703735, propagate_backward_time: 51.5416488647, weight_update_time: 0.1093980744, other_time: 2.2486038208
epoch time: 7.2584304810s, input_fired_time: 0.1522232592, output_fired_time: 0.0000000000, propagate_forward_time: 6.6827502251, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4234571457
validation[          , genome  5416] predictions:    9662/  10000 (96.62%), best:    9667/10000 (96.67%), error:      1112.43860, best error:      1043.61353 on epoch:    83, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 89.3756256104s, input_fired_time: 1.1864372492, output_fired_time: 1.1024756432, propagate_forward_time: 33.4798660278, propagate_backward_time: 51.3655242920, weight_update_time: 0.1094280705, other_time: 2.2413177490
epoch time: 11.0280447006s, input_fired_time: 0.2153844684, output_fired_time: 0.0000000000, propagate_forward_time: 10.2391395569, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5735206604
validation[          , genome  5416] predictions:    9678/  10000 (96.78%), best:    9667/10000 (96.67%), error:      1096.91919, best error:      1043.61353 on epoch:    83, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 97.6465682983s, input_fired_time: 1.2961608171, output_fired_time: 1.3205677271, propagate_forward_time: 36.4631080627, propagate_backward_time: 56.1227722168, weight_update_time: 0.1354833245, other_time: 2.4439659119
epoch time: 7.1743898392s, input_fired_time: 0.1494097859, output_fired_time: 0.0000000000, propagate_forward_time: 6.6147398949, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4102401733
validation[          , genome  5416] predictions:    9672/  10000 (96.72%), best:    9667/10000 (96.67%), error:      1077.00256, best error:      1043.61353 on epoch:    83, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 97.8048248291s, input_fired_time: 1.2865362167, output_fired_time: 1.2095321417, propagate_forward_time: 36.1018371582, propagate_backward_time: 56.7399101257, weight_update_time: 0.1176081002, other_time: 2.4670066833
epoch time: 13.5157546997s, input_fired_time: 0.2500688136, output_fired_time: 0.0000000000, propagate_forward_time: 12.4383258820, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8273601532
validation[          , genome  5416] predictions:    9677/  10000 (96.77%), best:    9667/10000 (96.67%), error:      1076.64453, best error:      1043.61353 on epoch:    83, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 99.4062423706s, input_fired_time: 1.3666471243, output_fired_time: 1.1679846048, propagate_forward_time: 37.1593170166, propagate_backward_time: 57.2955055237, weight_update_time: 0.1350370497, other_time: 2.4167900085
epoch time: 15.0050792694s, input_fired_time: 0.3485143781, output_fired_time: 0.0000000000, propagate_forward_time: 13.7896547318, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.8669099808
validation[          , genome  5416] predictions:    9679/  10000 (96.79%), best:    9667/10000 (96.67%), error:      1062.77295, best error:      1043.61353 on epoch:    83, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 170.8327026367s, input_fired_time: 1.3185621500, output_fired_time: 1.3545881510, propagate_forward_time: 103.1191940308, propagate_backward_time: 62.5310249329, weight_update_time: 0.1103382185, other_time: 2.5093421936
epoch time: 17.0868530273s, input_fired_time: 0.3005270958, output_fired_time: 0.0000000000, propagate_forward_time: 15.8794832230, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9068422318
validation[          , genome  5416] predictions:    9689/  10000 (96.89%), best:    9689/10000 (96.89%), error:      1038.70898, best error:      1038.70898 on epoch:    99, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 223.1959533691s, input_fired_time: 1.9222440720, output_fired_time: 1.7231776714, propagate_forward_time: 96.2791519165, propagate_backward_time: 119.3393936157, weight_update_time: 0.2049953789, other_time: 3.9319915771
epoch time: 7.3619227409s, input_fired_time: 0.1504829377, output_fired_time: 0.0000000000, propagate_forward_time: 6.7997217178, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4117178917
validation[          , genome  5416] predictions:    9680/  10000 (96.80%), best:    9689/10000 (96.89%), error:      1061.59229, best error:      1038.70898 on epoch:    99, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 41.2841873169s, input_fired_time: 0.8400141001, output_fired_time: 0.0000000000, propagate_forward_time: 38.0449180603, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3992538452
best training[          , genome  5416] predictions:   49198/  50000 (98.40%), best:    9689/10000 (96.89%), error:      2928.28589, best error:      1038.70898 on epoch:    99, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 56.1058273315s, input_fired_time: 0.3902985454, output_fired_time: 0.0000000000, propagate_forward_time: 52.4474220276, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2681083679
   testing[          , genome  5416] predictions:    9724/  10000 (97.24%), best:    9689/10000 (96.89%), error:       915.99597, best error:      1038.70898 on epoch:    99, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
19:32:20 (9612): called boinc_finish(0)

</stderr_txt>
]]>