Nameexact_genome_1512568488_45_7097_1
Workunit2606704
Created7 Dec 2017, 23:49:15 UTC
Sent7 Dec 2017, 23:52:36 UTC
Report deadline17 Dec 2017, 18:16:03 UTC
Received8 Dec 2017, 14:47:49 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID64142
Run time4 hours 16 min 17 sec
CPU time3 hours 40 min 28 sec
Validate stateValid
Credit2,441.57
Device peak FLOPS3.08 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size156.05 MB
Peak swap size159.10 MB
Peak disk usage2.12 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
00, other_time: 0.4588165283
validation[          , genome  7097] predictions:    9750/  10000 (97.50%), best:    9750/10000 (97.50%), error:       876.34094, best error:       876.34094 on epoch:    14, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 182.2505035400s, input_fired_time: 1.4450043440, output_fired_time: 1.4970890284, propagate_forward_time: 68.5478286743, propagate_backward_time: 106.7213058472, weight_update_time: 0.3949249983, other_time: 4.0392761230
epoch time: 16.8498992920s, input_fired_time: 0.1985263526, output_fired_time: 0.0000000000, propagate_forward_time: 16.0967521667, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5546207428
validation[          , genome  7097] predictions:    9756/  10000 (97.56%), best:    9756/10000 (97.56%), error:       821.98755, best error:       821.98755 on epoch:    15, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 189.9254913330s, input_fired_time: 2.2311303616, output_fired_time: 1.5407978296, propagate_forward_time: 68.7175369263, propagate_backward_time: 114.3124847412, weight_update_time: 0.1499929279, other_time: 3.1235427856
epoch time: 13.8545074463s, input_fired_time: 0.1729500294, output_fired_time: 0.0000000000, propagate_forward_time: 13.1920022964, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4895553589
validation[          , genome  7097] predictions:    9739/  10000 (97.39%), best:    9756/10000 (97.56%), error:       894.58765, best error:       821.98755 on epoch:    15, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 185.6712188721s, input_fired_time: 1.4597488642, output_fired_time: 1.2647238970, propagate_forward_time: 68.2321319580, propagate_backward_time: 110.1390762329, weight_update_time: 0.3971677125, other_time: 4.5755386353
epoch time: 12.3414945602s, input_fired_time: 0.1612230241, output_fired_time: 0.0000000000, propagate_forward_time: 11.4711561203, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7091150284
validation[          , genome  7097] predictions:    9717/  10000 (97.17%), best:    9756/10000 (97.56%), error:       982.39545, best error:       821.98755 on epoch:    15, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 181.9722900391s, input_fired_time: 1.6921501160, output_fired_time: 1.7429718971, propagate_forward_time: 68.3497314453, propagate_backward_time: 106.9105682373, weight_update_time: 0.1440234482, other_time: 3.2768707275
epoch time: 14.6101322174s, input_fired_time: 0.1804104745, output_fired_time: 0.0000000000, propagate_forward_time: 13.9195299149, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5101919174
validation[          , genome  7097] predictions:    9646/  10000 (96.46%), best:    9756/10000 (97.56%), error:      1147.79761, best error:       821.98755 on epoch:    15, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 188.5850219727s, input_fired_time: 1.9756449461, output_fired_time: 2.2822284698, propagate_forward_time: 71.9581146240, propagate_backward_time: 107.2442245483, weight_update_time: 0.3992863297, other_time: 5.1248092651
epoch time: 16.2343482971s, input_fired_time: 0.1942751408, output_fired_time: 0.0000000000, propagate_forward_time: 15.2441005707, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7959728241
validation[          , genome  7097] predictions:    9751/  10000 (97.51%), best:    9756/10000 (97.56%), error:       846.47552, best error:       821.98755 on epoch:    15, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 189.8644561768s, input_fired_time: 2.2473204136, output_fired_time: 1.7839109898, propagate_forward_time: 68.9936065674, propagate_backward_time: 113.4702224731, weight_update_time: 0.1503451318, other_time: 3.3694076538
epoch time: 15.1813259125s, input_fired_time: 0.1850758940, output_fired_time: 0.0000000000, propagate_forward_time: 14.2198228836, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7764272690
validation[          , genome  7097] predictions:    9742/  10000 (97.42%), best:    9756/10000 (97.56%), error:       893.14581, best error:       821.98755 on epoch:    15, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 160.1288757324s, input_fired_time: 1.9052540064, output_fired_time: 1.4314775467, propagate_forward_time: 58.0809822083, propagate_backward_time: 95.5278167725, weight_update_time: 0.1380100101, other_time: 3.1833496094
epoch time: 9.6288299561s, input_fired_time: 0.1661977023, output_fired_time: 0.0000000000, propagate_forward_time: 8.9970159531, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4656162262
validation[          , genome  7097] predictions:    9766/  10000 (97.66%), best:    9766/10000 (97.66%), error:       792.55457, best error:       792.55457 on epoch:    21, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 123.7172012329s, input_fired_time: 1.3701837063, output_fired_time: 1.1340699196, propagate_forward_time: 45.4683494568, propagate_backward_time: 73.1465682983, weight_update_time: 0.1333343238, other_time: 2.5980300903
epoch time: 7.7582678795s, input_fired_time: 0.1451490372, output_fired_time: 0.0000000000, propagate_forward_time: 7.2038369179, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4092817307
validation[          , genome  7097] predictions:    9743/  10000 (97.43%), best:    9766/10000 (97.66%), error:       886.66724, best error:       792.55457 on epoch:    21, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 119.7140731812s, input_fired_time: 1.3508907557, output_fired_time: 1.1039830446, propagate_forward_time: 43.9254608154, propagate_backward_time: 70.8008956909, weight_update_time: 0.1291656643, other_time: 2.5328445435
epoch time: 7.1547379494s, input_fired_time: 0.1375165582, output_fired_time: 0.0000000000, propagate_forward_time: 6.6272416115, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3899798393
validation[          , genome  7097] predictions:    9780/  10000 (97.80%), best:    9780/10000 (97.80%), error:       740.46198, best error:       740.46198 on epoch:    23, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 115.4402999878s, input_fired_time: 1.3181786537, output_fired_time: 1.0715148449, propagate_forward_time: 41.9755744934, propagate_backward_time: 68.5854415894, weight_update_time: 0.1270715147, other_time: 2.4895858765
epoch time: 8.9354362488s, input_fired_time: 0.1581003219, output_fired_time: 0.0000000000, propagate_forward_time: 8.3333511353, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4439849854
validation[          , genome  7097] predictions:    9729/  10000 (97.29%), best:    9780/10000 (97.80%), error:       887.42316, best error:       740.46198 on epoch:    23, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 117.2056045532s, input_fired_time: 1.3269970417, output_fired_time: 1.0830693245, propagate_forward_time: 42.6343078613, propagate_backward_time: 69.6539077759, weight_update_time: 0.1275743395, other_time: 2.5073242188
epoch time: 10.1347341537s, input_fired_time: 0.1708784550, output_fired_time: 0.0000000000, propagate_forward_time: 9.4851369858, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4787187576
validation[          , genome  7097] predictions:    9747/  10000 (97.47%), best:    9780/10000 (97.80%), error:       831.61646, best error:       740.46198 on epoch:    23, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 116.7638015747s, input_fired_time: 1.3289206028, output_fired_time: 1.0731252432, propagate_forward_time: 42.5792465210, propagate_backward_time: 69.2717208862, weight_update_time: 0.1285911500, other_time: 2.5107879639
epoch time: 10.3357887268s, input_fired_time: 0.1727237850, output_fired_time: 0.0000000000, propagate_forward_time: 9.6791505814, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4839143753
validation[          , genome  7097] predictions:    9730/  10000 (97.30%), best:    9780/10000 (97.80%), error:       941.65375, best error:       740.46198 on epoch:    23, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 114.6867675781s, input_fired_time: 1.3173509836, output_fired_time: 1.0599434376, propagate_forward_time: 41.7623786926, propagate_backward_time: 68.0622482300, weight_update_time: 0.1261478961, other_time: 2.4848403931
epoch time: 9.1691322327s, input_fired_time: 0.1609414369, output_fired_time: 0.0000000000, propagate_forward_time: 8.5606727600, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4475183487
validation[          , genome  7097] predictions:    9772/  10000 (97.72%), best:    9780/10000 (97.80%), error:       777.15222, best error:       740.46198 on epoch:    23, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 114.4292068481s, input_fired_time: 1.3198920488, output_fired_time: 1.0546247959, propagate_forward_time: 41.6904563904, propagate_backward_time: 67.8836975098, weight_update_time: 0.1259916574, other_time: 2.4805297852
epoch time: 9.3280248642s, input_fired_time: 0.1635229290, output_fired_time: 0.0000000000, propagate_forward_time: 8.7123556137, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4521465302
validation[          , genome  7097] predictions:    9716/  10000 (97.16%), best:    9780/10000 (97.80%), error:       964.70618, best error:       740.46198 on epoch:    23, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 115.6570739746s, input_fired_time: 1.3292362690, output_fired_time: 1.0698958635, propagate_forward_time: 42.3452186584, propagate_backward_time: 68.4296875000, weight_update_time: 0.1259374321, other_time: 2.4830322266
epoch time: 8.1679468155s, input_fired_time: 0.1508482248, output_fired_time: 0.0000000000, propagate_forward_time: 7.5978813171, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4192171097
validation[          , genome  7097] predictions:    9749/  10000 (97.49%), best:    9780/10000 (97.80%), error:       856.32886, best error:       740.46198 on epoch:    23, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 116.3075561523s, input_fired_time: 1.3329449892, output_fired_time: 1.0784586668, propagate_forward_time: 42.5100021362, propagate_backward_time: 68.9003829956, weight_update_time: 0.1266107261, other_time: 2.4857635498
epoch time: 9.5665283203s, input_fired_time: 0.1658633947, output_fired_time: 0.0000000000, propagate_forward_time: 8.9398088455, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4608564377
validation[          , genome  7097] predictions:    9757/  10000 (97.57%), best:    9780/10000 (97.80%), error:       850.57263, best error:       740.46198 on epoch:    23, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 117.2926025391s, input_fired_time: 1.3376672268, output_fired_time: 1.0834220648, propagate_forward_time: 42.8326416016, propagate_backward_time: 69.5342330933, weight_update_time: 0.1273341775, other_time: 2.5046386719
epoch time: 8.9850006104s, input_fired_time: 0.1598001719, output_fired_time: 0.0000000000, propagate_forward_time: 8.3823575974, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4428424835
validation[          , genome  7097] predictions:    9756/  10000 (97.56%), best:    9780/10000 (97.80%), error:       824.27612, best error:       740.46198 on epoch:    23, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 118.8686904907s, input_fired_time: 1.3469833136, output_fired_time: 1.1003223658, propagate_forward_time: 43.3864555359, propagate_backward_time: 70.4997100830, weight_update_time: 0.1294544041, other_time: 2.5352172852
epoch time: 8.8889570236s, input_fired_time: 0.1585641354, output_fired_time: 0.0000000000, propagate_forward_time: 8.2881860733, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4422063828
validation[          , genome  7097] predictions:    9765/  10000 (97.65%), best:    9780/10000 (97.80%), error:       786.33813, best error:       740.46198 on epoch:    23, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 141.8761749268s, input_fired_time: 1.3870550394, output_fired_time: 1.1501213312, propagate_forward_time: 50.8392257690, propagate_backward_time: 85.6172790527, weight_update_time: 0.1351477802, other_time: 2.8824996948
epoch time: 15.5392999649s, input_fired_time: 0.4372391701, output_fired_time: 0.0000000000, propagate_forward_time: 14.3257589340, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7763013840
validation[          , genome  7097] predictions:    9739/  10000 (97.39%), best:    9780/10000 (97.80%), error:       863.43292, best error:       740.46198 on epoch:    23, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 169.1431274414s, input_fired_time: 1.4014301300, output_fired_time: 1.4141391516, propagate_forward_time: 62.0605354309, propagate_backward_time: 100.8659210205, weight_update_time: 0.1361627132, other_time: 3.4011077881
epoch time: 12.8475074768s, input_fired_time: 0.1668090820, output_fired_time: 0.0000000000, propagate_forward_time: 12.2149353027, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4657630920
validation[          , genome  7097] predictions:    9731/  10000 (97.31%), best:    9780/10000 (97.80%), error:       895.09979, best error:       740.46198 on epoch:    23, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 160.9916381836s, input_fired_time: 2.1143980026, output_fired_time: 1.1121443510, propagate_forward_time: 60.2940406799, propagate_backward_time: 93.8960723877, weight_update_time: 0.1310994625, other_time: 3.5749969482
epoch time: 14.1463537216s, input_fired_time: 0.1786737442, output_fired_time: 0.0000000000, propagate_forward_time: 13.2192583084, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7484216690
validation[          , genome  7097] predictions:    9698/  10000 (96.98%), best:    9780/10000 (97.80%), error:       952.48779, best error:       740.46198 on epoch:    23, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 142.6005249023s, input_fired_time: 1.8493289948, output_fired_time: 1.0741312504, propagate_forward_time: 51.9207344055, propagate_backward_time: 85.0063018799, weight_update_time: 0.1267402619, other_time: 2.7500305176
epoch time: 8.3813409805s, input_fired_time: 0.1527062804, output_fired_time: 0.0000000000, propagate_forward_time: 7.8031182289, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4255166054
validation[          , genome  7097] predictions:    9754/  10000 (97.54%), best:    9780/10000 (97.80%), error:       808.62421, best error:       740.46198 on epoch:    23, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 117.0814590454s, input_fired_time: 1.3373626471, output_fired_time: 1.0876923800, propagate_forward_time: 42.5288391113, propagate_backward_time: 69.6237640381, weight_update_time: 0.1272998750, other_time: 2.5037994385
epoch time: 10.0694046021s, input_fired_time: 0.1718942970, output_fired_time: 0.0000000000, propagate_forward_time: 9.4224338531, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4750766754
validation[          , genome  7097] predictions:    9778/  10000 (97.78%), best:    9780/10000 (97.80%), error:       774.01508, best error:       740.46198 on epoch:    23, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 112.1972198486s, input_fired_time: 1.3107717037, output_fired_time: 1.0418199301, propagate_forward_time: 40.7908363342, propagate_backward_time: 66.6141281128, weight_update_time: 0.1229923517, other_time: 2.4396743774
epoch time: 8.7246332169s, input_fired_time: 0.1564603299, output_fired_time: 0.0000000000, propagate_forward_time: 8.1323356628, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4358367920
validation[          , genome  7097] predictions:    9759/  10000 (97.59%), best:    9780/10000 (97.80%), error:       801.84210, best error:       740.46198 on epoch:    23, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 112.4541854858s, input_fired_time: 1.3103826046, output_fired_time: 1.0430494547, propagate_forward_time: 40.6713066101, propagate_backward_time: 66.9826889038, weight_update_time: 0.1241981983, other_time: 2.4467544556
epoch time: 8.1376523972s, input_fired_time: 0.1513729692, output_fired_time: 0.0000000000, propagate_forward_time: 7.5657510757, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4205284119
validation[          , genome  7097] predictions:    9760/  10000 (97.60%), best:    9780/10000 (97.80%), error:       787.73541, best error:       740.46198 on epoch:    23, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 114.6707458496s, input_fired_time: 1.3304400444, output_fired_time: 1.0695487261, propagate_forward_time: 41.9051361084, propagate_backward_time: 67.8944931030, weight_update_time: 0.1255718619, other_time: 2.4711303711
epoch time: 8.0020885468s, input_fired_time: 0.1501652449, output_fired_time: 0.0000000000, propagate_forward_time: 7.4370365143, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4148869514
validation[          , genome  7097] predictions:    9759/  10000 (97.59%), best:    9780/10000 (97.80%), error:       820.13086, best error:       740.46198 on epoch:    23, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 115.9840850830s, input_fired_time: 1.3376106024, output_fired_time: 1.0751039982, propagate_forward_time: 42.4134483337, propagate_backward_time: 68.6651916504, weight_update_time: 0.1265072972, other_time: 2.4927368164
epoch time: 8.9231634140s, input_fired_time: 0.1584945023, output_fired_time: 0.0000000000, propagate_forward_time: 8.3216304779, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4430379868
validation[          , genome  7097] predictions:    9703/  10000 (97.03%), best:    9780/10000 (97.80%), error:       937.44971, best error:       740.46198 on epoch:    23, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 115.1864852905s, input_fired_time: 1.3303672075, output_fired_time: 1.0642913580, propagate_forward_time: 41.9800224304, propagate_backward_time: 68.3260955811, weight_update_time: 0.1263762414, other_time: 2.4857025146
epoch time: 8.6592283249s, input_fired_time: 0.1584878415, output_fired_time: 0.0000000000, propagate_forward_time: 8.0651388168, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4356012344
validation[          , genome  7097] predictions:    9751/  10000 (97.51%), best:    9780/10000 (97.80%), error:       830.92883, best error:       740.46198 on epoch:    23, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 113.2250061035s, input_fired_time: 1.3170090914, output_fired_time: 1.0532851219, propagate_forward_time: 41.0744819641, propagate_backward_time: 67.3205413818, weight_update_time: 0.1244198382, other_time: 2.4596862793
epoch time: 7.9857926369s, input_fired_time: 0.1488104165, output_fired_time: 0.0000000000, propagate_forward_time: 7.4231195450, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4138627052
validation[          , genome  7097] predictions:    9759/  10000 (97.59%), best:    9780/10000 (97.80%), error:       798.61639, best error:       740.46198 on epoch:    23, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 120.9220199585s, input_fired_time: 1.3688566685, output_fired_time: 1.1230738163, propagate_forward_time: 44.3375244141, propagate_backward_time: 71.5371932983, weight_update_time: 0.1306616366, other_time: 2.5553665161
epoch time: 8.5641088486s, input_fired_time: 0.1560876071, output_fired_time: 0.0000000000, propagate_forward_time: 7.9757709503, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4322500229
validation[          , genome  7097] predictions:    9763/  10000 (97.63%), best:    9780/10000 (97.80%), error:       833.82257, best error:       740.46198 on epoch:    23, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 121.2454071045s, input_fired_time: 1.3686797619, output_fired_time: 1.1136461496, propagate_forward_time: 44.3904151917, propagate_backward_time: 71.8142700195, weight_update_time: 0.1309550405, other_time: 2.5583953857
epoch time: 9.5052270889s, input_fired_time: 0.1668260098, output_fired_time: 0.0000000000, propagate_forward_time: 8.8798208237, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4585800171
validation[          , genome  7097] predictions:    9783/  10000 (97.83%), best:    9780/10000 (97.80%), error:       758.68170, best error:       740.46198 on epoch:    23, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 121.9344787598s, input_fired_time: 1.3765243292, output_fired_time: 1.1227326393, propagate_forward_time: 44.8373832703, propagate_backward_time: 72.0336074829, weight_update_time: 0.1314681023, other_time: 2.5642318726
epoch time: 10.3957967758s, input_fired_time: 0.1769754738, output_fired_time: 0.0000000000, propagate_forward_time: 9.7358589172, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4829626083
validation[          , genome  7097] predictions:    9769/  10000 (97.69%), best:    9780/10000 (97.80%), error:       792.53467, best error:       740.46198 on epoch:    23, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 119.2777862549s, input_fired_time: 1.3613429070, output_fired_time: 1.0978533030, propagate_forward_time: 43.7553863525, propagate_backward_time: 70.5343246460, weight_update_time: 0.1291430742, other_time: 2.5288772583
epoch time: 9.6750574112s, input_fired_time: 0.1704525203, output_fired_time: 0.0000000000, propagate_forward_time: 9.0410528183, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4635524750
validation[          , genome  7097] predictions:    9764/  10000 (97.64%), best:    9780/10000 (97.80%), error:       832.43658, best error:       740.46198 on epoch:    23, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 119.7961425781s, input_fired_time: 1.3577938080, output_fired_time: 1.1015160084, propagate_forward_time: 43.6662559509, propagate_backward_time: 71.1280593872, weight_update_time: 0.1300544292, other_time: 2.5425186157
epoch time: 10.1619510651s, input_fired_time: 0.1751516759, output_fired_time: 0.0000000000, propagate_forward_time: 9.5080289841, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4787702560
validation[          , genome  7097] predictions:    9770/  10000 (97.70%), best:    9780/10000 (97.80%), error:       807.03558, best error:       740.46198 on epoch:    23, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 120.4880065918s, input_fired_time: 1.3685513735, output_fired_time: 1.1096106768, propagate_forward_time: 44.1787681580, propagate_backward_time: 71.2903518677, weight_update_time: 0.1298425049, other_time: 2.5407180786
epoch time: 9.3941650391s, input_fired_time: 0.1668413132, output_fired_time: 0.0000000000, propagate_forward_time: 8.7746925354, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4526309967
validation[          , genome  7097] predictions:    9645/  10000 (96.45%), best:    9780/10000 (97.80%), error:      1104.25073, best error:       740.46198 on epoch:    23, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 122.3604049683s, input_fired_time: 1.3809920549, output_fired_time: 1.1263673306, propagate_forward_time: 44.8535232544, propagate_backward_time: 72.4452362061, weight_update_time: 0.1307559013, other_time: 2.5542907715
epoch time: 9.2055778503s, input_fired_time: 0.1643913388, output_fired_time: 0.0000000000, propagate_forward_time: 8.5932035446, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4479827881
validation[          , genome  7097] predictions:    9755/  10000 (97.55%), best:    9780/10000 (97.80%), error:       821.28766, best error:       740.46198 on epoch:    23, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 123.1262969971s, input_fired_time: 1.3843979836, output_fired_time: 1.1318892241, propagate_forward_time: 45.1752471924, propagate_backward_time: 72.8534927368, weight_update_time: 0.1324158162, other_time: 2.5812683105
epoch time: 9.4545011520s, input_fired_time: 0.1667030454, output_fired_time: 0.0000000000, propagate_forward_time: 8.8314027786, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4563951492
validation[          , genome  7097] predictions:    9738/  10000 (97.38%), best:    9780/10000 (97.80%), error:       860.00256, best error:       740.46198 on epoch:    23, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 123.3884429932s, input_fired_time: 1.3882635832, output_fired_time: 1.1257300377, propagate_forward_time: 45.4507904053, propagate_backward_time: 72.8252944946, weight_update_time: 0.1335682720, other_time: 2.5983657837
epoch time: 9.2574939728s, input_fired_time: 0.1645746082, output_fired_time: 0.0000000000, propagate_forward_time: 8.6420459747, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4508733749
validation[          , genome  7097] predictions:    9779/  10000 (97.79%), best:    9780/10000 (97.80%), error:       769.30811, best error:       740.46198 on epoch:    23, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 122.8528671265s, input_fired_time: 1.3842135668, output_fired_time: 1.1264417171, propagate_forward_time: 45.1364555359, propagate_backward_time: 72.6156158447, weight_update_time: 0.1333036274, other_time: 2.5901336670
epoch time: 9.8017244339s, input_fired_time: 0.1710233539, output_fired_time: 0.0000000000, propagate_forward_time: 9.1657791138, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4649219513
validation[          , genome  7097] predictions:    9775/  10000 (97.75%), best:    9780/10000 (97.80%), error:       784.59851, best error:       740.46198 on epoch:    23, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 128.1247711182s, input_fired_time: 1.4178593159, output_fired_time: 1.1632757187, propagate_forward_time: 47.1947479248, propagate_backward_time: 75.6932220459, weight_update_time: 0.1373587251, other_time: 2.6556625366
epoch time: 9.9356222153s, input_fired_time: 0.1727790236, output_fired_time: 0.0000000000, propagate_forward_time: 9.2928009033, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4700422287
validation[          , genome  7097] predictions:    9752/  10000 (97.52%), best:    9780/10000 (97.80%), error:       847.60687, best error:       740.46198 on epoch:    23, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 126.7305603027s, input_fired_time: 1.4093710184, output_fired_time: 1.1595209837, propagate_forward_time: 46.5316238403, propagate_backward_time: 74.9960632324, weight_update_time: 0.1360935569, other_time: 2.6339797974
epoch time: 9.3582935333s, input_fired_time: 0.1665458083, output_fired_time: 0.0000000000, propagate_forward_time: 8.7365303040, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4552173615
validation[          , genome  7097] predictions:    9698/  10000 (96.98%), best:    9780/10000 (97.80%), error:      1023.43011, best error:       740.46198 on epoch:    23, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 128.6697540283s, input_fired_time: 1.4206727743, output_fired_time: 1.1770530939, propagate_forward_time: 47.4632606506, propagate_backward_time: 75.9362182617, weight_update_time: 0.1378170103, other_time: 2.6725463867
epoch time: 9.1321125031s, input_fired_time: 0.1642177552, output_fired_time: 0.0000000000, propagate_forward_time: 8.5197725296, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4481220245
validation[          , genome  7097] predictions:    9755/  10000 (97.55%), best:    9780/10000 (97.80%), error:       882.95972, best error:       740.46198 on epoch:    23, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 177.2146301270s, input_fired_time: 1.7490413189, output_fired_time: 2.0228934288, propagate_forward_time: 64.0242919922, propagate_backward_time: 105.5763473511, weight_update_time: 0.1481020898, other_time: 3.8420639038
epoch time: 15.7524585724s, input_fired_time: 0.4440923631, output_fired_time: 0.0000000000, propagate_forward_time: 14.7772493362, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5311164856
validation[          , genome  7097] predictions:    9755/  10000 (97.55%), best:    9780/10000 (97.80%), error:       847.11017, best error:       740.46198 on epoch:    23, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 194.0978851318s, input_fired_time: 2.0314671993, output_fired_time: 1.3193801641, propagate_forward_time: 71.3408355713, propagate_backward_time: 115.2420501709, weight_update_time: 0.1529385746, other_time: 4.1641540527
epoch time: 14.6383323669s, input_fired_time: 0.4372150898, output_fired_time: 0.0000000000, propagate_forward_time: 13.6888504028, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5122671127
validation[          , genome  7097] predictions:    9749/  10000 (97.49%), best:    9780/10000 (97.80%), error:       833.60077, best error:       740.46198 on epoch:    23, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 178.7972869873s, input_fired_time: 2.4659154415, output_fired_time: 1.4725276232, propagate_forward_time: 66.6676177979, propagate_backward_time: 104.1872482300, weight_update_time: 0.1425074339, other_time: 4.0039749146
epoch time: 12.7963438034s, input_fired_time: 0.4200268388, output_fired_time: 0.0000000000, propagate_forward_time: 11.9091806412, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4671363831
validation[          , genome  7097] predictions:    9751/  10000 (97.51%), best:    9780/10000 (97.80%), error:       843.08240, best error:       740.46198 on epoch:    23, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 176.4904632568s, input_fired_time: 2.4609997272, output_fired_time: 1.4737368822, propagate_forward_time: 64.2559051514, propagate_backward_time: 104.7986755371, weight_update_time: 0.1419376135, other_time: 3.5011444092
epoch time: 12.4069490433s, input_fired_time: 0.1703833938, output_fired_time: 0.0000000000, propagate_forward_time: 11.7743988037, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4621667862
validation[          , genome  7097] predictions:    9757/  10000 (97.57%), best:    9780/10000 (97.80%), error:       826.09625, best error:       740.46198 on epoch:    23, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 171.5280609131s, input_fired_time: 2.1880488396, output_fired_time: 2.4259428978, propagate_forward_time: 63.7824935913, propagate_backward_time: 99.6862411499, weight_update_time: 0.1384846270, other_time: 3.4453277588
epoch time: 15.9326848984s, input_fired_time: 0.1961050928, output_fired_time: 0.0000000000, propagate_forward_time: 14.7017955780, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0347843170
validation[          , genome  7097] predictions:    9760/  10000 (97.60%), best:    9780/10000 (97.80%), error:       831.37268, best error:       740.46198 on epoch:    23, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 177.8600158691s, input_fired_time: 1.7083591223, output_fired_time: 1.7172517776, propagate_forward_time: 66.9247665405, propagate_backward_time: 104.5090255737, weight_update_time: 0.1423701644, other_time: 3.0006103516
epoch time: 13.9667148590s, input_fired_time: 0.1798862219, output_fired_time: 0.0000000000, propagate_forward_time: 13.2935962677, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4932327271
validation[          , genome  7097] predictions:    9778/  10000 (97.78%), best:    9780/10000 (97.80%), error:       776.92261, best error:       740.46198 on epoch:    23, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 179.1054992676s, input_fired_time: 1.9665268660, output_fired_time: 1.7239657640, propagate_forward_time: 67.6256408691, propagate_backward_time: 104.2792282104, weight_update_time: 0.1431976408, other_time: 3.5101394653
epoch time: 12.4505472183s, input_fired_time: 0.1689737886, output_fired_time: 0.0000000000, propagate_forward_time: 11.8198127747, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4617605209
validation[          , genome  7097] predictions:    9742/  10000 (97.42%), best:    9780/10000 (97.80%), error:       922.60480, best error:       740.46198 on epoch:    23, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 181.6958465576s, input_fired_time: 2.7291576862, output_fired_time: 1.2425945997, propagate_forward_time: 66.4703445435, propagate_backward_time: 108.2139816284, weight_update_time: 0.1447863728, other_time: 3.0397644043
epoch time: 12.3788948059s, input_fired_time: 0.1656539440, output_fired_time: 0.0000000000, propagate_forward_time: 11.7610263824, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4522142410
validation[          , genome  7097] predictions:    9767/  10000 (97.67%), best:    9780/10000 (97.80%), error:       822.52917, best error:       740.46198 on epoch:    23, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 177.7266082764s, input_fired_time: 1.7119648457, output_fired_time: 1.4708266258, propagate_forward_time: 65.7723083496, propagate_backward_time: 104.7752685547, weight_update_time: 0.1423917264, other_time: 3.9962463379
epoch time: 13.5060606003s, input_fired_time: 0.1776641309, output_fired_time: 0.0000000000, propagate_forward_time: 12.8405714035, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4878253937
validation[          , genome  7097] predictions:    9713/  10000 (97.13%), best:    9780/10000 (97.80%), error:      1000.77252, best error:       740.46198 on epoch:    23, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 169.9073333740s, input_fired_time: 1.6752706766, output_fired_time: 1.1757587194, propagate_forward_time: 65.5684509277, propagate_backward_time: 97.3243713379, weight_update_time: 0.3866923153, other_time: 4.1634674072
epoch time: 14.8625040054s, input_fired_time: 0.1879042685, output_fired_time: 0.0000000000, propagate_forward_time: 13.9134588242, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7611408234
validation[          , genome  7097] predictions:    9766/  10000 (97.66%), best:    9780/10000 (97.80%), error:       858.15186, best error:       740.46198 on epoch:    23, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 168.1573333740s, input_fired_time: 1.9163928032, output_fired_time: 1.4061118364, propagate_forward_time: 61.8945579529, propagate_backward_time: 99.5508804321, weight_update_time: 0.1353802681, other_time: 3.3893814087
epoch time: 14.6363124847s, input_fired_time: 0.1866744161, output_fired_time: 0.0000000000, propagate_forward_time: 13.9435329437, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5061054230
validation[          , genome  7097] predictions:    9727/  10000 (97.27%), best:    9780/10000 (97.80%), error:       913.40601, best error:       740.46198 on epoch:    23, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 164.9413909912s, input_fired_time: 2.1550464630, output_fired_time: 2.1417081356, propagate_forward_time: 59.0285758972, propagate_backward_time: 98.0061035156, weight_update_time: 0.1333184838, other_time: 3.6099548340
epoch time: 12.9459724426s, input_fired_time: 0.1722301841, output_fired_time: 0.0000000000, propagate_forward_time: 12.3033828735, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4703598022
validation[          , genome  7097] predictions:    9762/  10000 (97.62%), best:    9780/10000 (97.80%), error:       771.28143, best error:       740.46198 on epoch:    23, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 167.7407379150s, input_fired_time: 1.6648027897, output_fired_time: 1.6538379192, propagate_forward_time: 61.4703407288, propagate_backward_time: 100.0504531860, weight_update_time: 0.1353880614, other_time: 2.9012985229
epoch time: 12.4688863754s, input_fired_time: 0.4204461873, output_fired_time: 0.0000000000, propagate_forward_time: 11.5881748199, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4602651596
validation[          , genome  7097] predictions:    9783/  10000 (97.83%), best:    9780/10000 (97.80%), error:       755.89404, best error:       740.46198 on epoch:    23, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 175.4341735840s, input_fired_time: 1.7065501213, output_fired_time: 1.7009183168, propagate_forward_time: 65.7715988159, propagate_backward_time: 102.5318756104, weight_update_time: 0.1405188292, other_time: 3.7232437134
epoch time: 14.3751182556s, input_fired_time: 0.1860748380, output_fired_time: 0.0000000000, propagate_forward_time: 13.4337129593, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7553300858
validation[          , genome  7097] predictions:    9769/  10000 (97.69%), best:    9780/10000 (97.80%), error:       844.46228, best error:       740.46198 on epoch:    23, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 163.9124450684s, input_fired_time: 1.6543588638, output_fired_time: 1.3819144964, propagate_forward_time: 61.0153579712, propagate_backward_time: 96.0019226074, weight_update_time: 0.3835236728, other_time: 3.8588943481
epoch time: 10.3829984665s, input_fired_time: 0.1502578706, output_fired_time: 0.0000000000, propagate_forward_time: 9.8269891739, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4057512283
validation[          , genome  7097] predictions:    9779/  10000 (97.79%), best:    9780/10000 (97.80%), error:       763.88037, best error:       740.46198 on epoch:    23, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 174.3980255127s, input_fired_time: 2.1987543106, output_fired_time: 1.1960048676, propagate_forward_time: 63.1951065063, propagate_backward_time: 104.0946807861, weight_update_time: 0.1400876492, other_time: 3.7134780884
epoch time: 14.0002775192s, input_fired_time: 0.1806930900, output_fired_time: 0.0000000000, propagate_forward_time: 13.0763473511, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7432374954
validation[          , genome  7097] predictions:    9770/  10000 (97.70%), best:    9780/10000 (97.80%), error:       804.57111, best error:       740.46198 on epoch:    23, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 132.9439849854s, input_fired_time: 1.5650292635, output_fired_time: 1.5170511007, propagate_forward_time: 47.7924232483, propagate_backward_time: 78.9118728638, weight_update_time: 0.1209121570, other_time: 3.1576156616
epoch time: 7.1390509605s, input_fired_time: 0.1449959576, output_fired_time: 0.0000000000, propagate_forward_time: 6.6040802002, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3899745941
validation[          , genome  7097] predictions:    9780/  10000 (97.80%), best:    9780/10000 (97.80%), error:       774.35651, best error:       740.46198 on epoch:    23, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 104.2360763550s, input_fired_time: 1.2844130993, output_fired_time: 0.9709298015, propagate_forward_time: 37.5567169189, propagate_backward_time: 62.0758552551, weight_update_time: 0.1177202165, other_time: 2.3481559753
epoch time: 7.1588973999s, input_fired_time: 0.1456226856, output_fired_time: 0.0000000000, propagate_forward_time: 6.6226277351, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3906469345
validation[          , genome  7097] predictions:    9794/  10000 (97.94%), best:    9780/10000 (97.80%), error:       747.62122, best error:       740.46198 on epoch:    23, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 100.4814682007s, input_fired_time: 1.2602553368, output_fired_time: 0.9444987774, propagate_forward_time: 35.8221549988, propagate_backward_time: 60.1679420471, weight_update_time: 0.1133201197, other_time: 2.2866210938
epoch time: 8.9424791336s, input_fired_time: 0.1646591127, output_fired_time: 0.0000000000, propagate_forward_time: 8.3333692551, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4444503784
validation[          , genome  7097] predictions:    9775/  10000 (97.75%), best:    9780/10000 (97.80%), error:       777.78082, best error:       740.46198 on epoch:    23, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 112.4179382324s, input_fired_time: 1.3365683556, output_fired_time: 1.0433412790, propagate_forward_time: 40.8601379395, propagate_backward_time: 66.7301177979, weight_update_time: 0.1239497885, other_time: 2.4477691650
epoch time: 8.6013402939s, input_fired_time: 0.1604150534, output_fired_time: 0.0000000000, propagate_forward_time: 8.0055627823, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4353628159
validation[          , genome  7097] predictions:    9699/  10000 (96.99%), best:    9780/10000 (97.80%), error:       986.83472, best error:       740.46198 on epoch:    23, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 101.0244293213s, input_fired_time: 1.2680474520, output_fired_time: 0.9511463046, propagate_forward_time: 36.2114868164, propagate_backward_time: 60.3029747009, weight_update_time: 0.1138002947, other_time: 2.2907676697
epoch time: 7.1350960732s, input_fired_time: 0.1447020322, output_fired_time: 0.0000000000, propagate_forward_time: 6.6011619568, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3892321587
validation[          , genome  7097] predictions:    9797/  10000 (97.97%), best:    9780/10000 (97.80%), error:       760.88904, best error:       740.46198 on epoch:    23, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 105.0422973633s, input_fired_time: 1.2927420139, output_fired_time: 0.9825080037, propagate_forward_time: 37.7885360718, propagate_backward_time: 62.6344642639, weight_update_time: 0.1175179258, other_time: 2.3440513611
epoch time: 7.8820881844s, input_fired_time: 0.1535695344, output_fired_time: 0.0000000000, propagate_forward_time: 7.3167362213, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4117822647
validation[          , genome  7097] predictions:    9772/  10000 (97.72%), best:    9780/10000 (97.80%), error:       811.11279, best error:       740.46198 on epoch:    23, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 100.3558731079s, input_fired_time: 1.2607586384, output_fired_time: 0.9437693357, propagate_forward_time: 35.7969284058, propagate_backward_time: 60.0771026611, weight_update_time: 0.1132847145, other_time: 2.2773132324
epoch time: 8.1368694305s, input_fired_time: 0.1566820294, output_fired_time: 0.0000000000, propagate_forward_time: 7.5628166199, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4173707962
validation[          , genome  7097] predictions:    9787/  10000 (97.87%), best:    9780/10000 (97.80%), error:       755.56195, best error:       740.46198 on epoch:    23, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 96.9706039429s, input_fired_time: 1.2441798449, output_fired_time: 0.9150508642, propagate_forward_time: 34.4381370544, propagate_backward_time: 58.1419525146, weight_update_time: 0.1104472280, other_time: 2.2312812805
epoch time: 10.3904457092s, input_fired_time: 0.1823950857, output_fired_time: 0.0000000000, propagate_forward_time: 9.7235450745, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4845056534
validation[          , genome  7097] predictions:    9773/  10000 (97.73%), best:    9780/10000 (97.80%), error:       802.57892, best error:       740.46198 on epoch:    23, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 106.5038070679s, input_fired_time: 1.3075149059, output_fired_time: 0.9963572025, propagate_forward_time: 38.3875465393, propagate_backward_time: 63.4644355774, weight_update_time: 0.1176239699, other_time: 2.3479423523
epoch time: 8.6881341934s, input_fired_time: 0.1627139896, output_fired_time: 0.0000000000, propagate_forward_time: 8.0923452377, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4330749512
validation[          , genome  7097] predictions:    9787/  10000 (97.87%), best:    9780/10000 (97.80%), error:       747.30066, best error:       740.46198 on epoch:    23, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 102.8528976440s, input_fired_time: 1.2826597691, output_fired_time: 0.9646710753, propagate_forward_time: 36.8712387085, propagate_backward_time: 61.4379692078, weight_update_time: 0.1143803969, other_time: 2.2963600159
epoch time: 7.1332750320s, input_fired_time: 0.1457327157, output_fired_time: 0.0000000000, propagate_forward_time: 6.6002802849, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3872618675
validation[          , genome  7097] predictions:    9767/  10000 (97.67%), best:    9780/10000 (97.80%), error:       811.90521, best error:       740.46198 on epoch:    23, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 98.2080917358s, input_fired_time: 1.2515618801, output_fired_time: 0.9243077040, propagate_forward_time: 34.9591598511, propagate_backward_time: 58.8306770325, weight_update_time: 0.1111619771, other_time: 2.2423820496
epoch time: 7.1424994469s, input_fired_time: 0.1475518942, output_fired_time: 0.0000000000, propagate_forward_time: 6.6067867279, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3881607056
validation[          , genome  7097] predictions:    9776/  10000 (97.76%), best:    9780/10000 (97.80%), error:       778.92780, best error:       740.46198 on epoch:    23, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 105.7648773193s, input_fired_time: 1.3008475304, output_fired_time: 0.9865748286, propagate_forward_time: 38.1390762329, propagate_backward_time: 62.9998321533, weight_update_time: 0.1175948828, other_time: 2.3385467529
epoch time: 7.5159630775s, input_fired_time: 0.1511011124, output_fired_time: 0.0000000000, propagate_forward_time: 6.9685111046, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3963508606
validation[          , genome  7097] predictions:    9797/  10000 (97.97%), best:    9780/10000 (97.80%), error:       743.70697, best error:       740.46198 on epoch:    23, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 98.9573287964s, input_fired_time: 1.2645561695, output_fired_time: 0.9313739538, propagate_forward_time: 35.2358589172, propagate_backward_time: 59.2815437317, weight_update_time: 0.1112516001, other_time: 2.2439956665
epoch time: 7.1331768036s, input_fired_time: 0.1460225135, output_fired_time: 0.0000000000, propagate_forward_time: 6.6008739471, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3862805367
validation[          , genome  7097] predictions:    9804/  10000 (98.04%), best:    9780/10000 (97.80%), error:       742.24530, best error:       740.46198 on epoch:    23, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 96.8249893188s, input_fired_time: 1.2465050220, output_fired_time: 0.9144924879, propagate_forward_time: 34.4042320251, propagate_backward_time: 58.0432815552, weight_update_time: 0.1096955687, other_time: 2.2164802551
epoch time: 7.1337213516s, input_fired_time: 0.1470813304, output_fired_time: 0.0000000000, propagate_forward_time: 6.6003875732, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3862524033
validation[          , genome  7097] predictions:    9755/  10000 (97.55%), best:    9780/10000 (97.80%), error:       845.70245, best error:       740.46198 on epoch:    23, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 96.6627273560s, input_fired_time: 1.2490018606, output_fired_time: 0.9143251777, propagate_forward_time: 34.3422775269, propagate_backward_time: 57.9350891113, weight_update_time: 0.1094180346, other_time: 2.2220382690
epoch time: 7.1327404976s, input_fired_time: 0.1468458027, output_fired_time: 0.0000000000, propagate_forward_time: 6.5993833542, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3865113258
validation[          , genome  7097] predictions:    9783/  10000 (97.83%), best:    9780/10000 (97.80%), error:       791.62653, best error:       740.46198 on epoch:    23, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 99.7354354858s, input_fired_time: 1.2628041506, output_fired_time: 0.9420138597, propagate_forward_time: 35.5086288452, propagate_backward_time: 59.7707862854, weight_update_time: 0.1117333323, other_time: 2.2512016296
epoch time: 7.1370563507s, input_fired_time: 0.1475324482, output_fired_time: 0.0000000000, propagate_forward_time: 6.6024765968, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3870472908
validation[          , genome  7097] predictions:    9780/  10000 (97.80%), best:    9780/10000 (97.80%), error:       791.77759, best error:       740.46198 on epoch:    23, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 94.8732757568s, input_fired_time: 1.2391465902, output_fired_time: 0.8985170722, propagate_forward_time: 33.5857810974, propagate_backward_time: 56.9601898193, weight_update_time: 0.1078989282, other_time: 2.1896476746
epoch time: 7.1325535774s, input_fired_time: 0.1462437510, output_fired_time: 0.0000000000, propagate_forward_time: 6.5994362831, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3868737221
validation[          , genome  7097] predictions:    9805/  10000 (98.05%), best:    9805/10000 (98.05%), error:       711.95294, best error:       711.95294 on epoch:    89, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 105.4455947876s, input_fired_time: 1.3008131981, output_fired_time: 0.9849886298, propagate_forward_time: 37.8626213074, propagate_backward_time: 62.9699821472, weight_update_time: 0.1167956442, other_time: 2.3271980286
epoch time: 7.5021729469s, input_fired_time: 0.1506864429, output_fired_time: 0.0000000000, propagate_forward_time: 6.9537911415, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3976955414
validation[          , genome  7097] predictions:    9781/  10000 (97.81%), best:    9805/10000 (98.05%), error:       743.12848, best error:       711.95294 on epoch:    89, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 146.4610290527s, input_fired_time: 1.6252106428, output_fired_time: 1.3341196775, propagate_forward_time: 52.8842544556, propagate_backward_time: 88.1034164429, weight_update_time: 0.1280914098, other_time: 2.5140228271
epoch time: 13.2558269501s, input_fired_time: 0.1795333624, output_fired_time: 0.0000000000, propagate_forward_time: 12.6000413895, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4762525558
validation[          , genome  7097] predictions:    9750/  10000 (97.50%), best:    9805/10000 (98.05%), error:       872.95422, best error:       711.95294 on epoch:    89, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 154.1436309814s, input_fired_time: 1.6186878681, output_fired_time: 1.5706026554, propagate_forward_time: 57.0658683777, propagate_backward_time: 90.6425170898, weight_update_time: 0.1265394986, other_time: 3.2459564209
epoch time: 9.3958702087s, input_fired_time: 0.1470992565, output_fired_time: 0.0000000000, propagate_forward_time: 8.8579587936, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3908119202
validation[          , genome  7097] predictions:    9790/  10000 (97.90%), best:    9805/10000 (98.05%), error:       773.64587, best error:       711.95294 on epoch:    89, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 149.1567230225s, input_fired_time: 1.3481305838, output_fired_time: 1.7891319990, propagate_forward_time: 58.8931083679, propagate_backward_time: 83.6793518066, weight_update_time: 0.1233015954, other_time: 3.4469909668
epoch time: 9.7466926575s, input_fired_time: 0.1485236734, output_fired_time: 0.0000000000, propagate_forward_time: 9.2027359009, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3954334259
validation[          , genome  7097] predictions:    9769/  10000 (97.69%), best:    9805/10000 (98.05%), error:       794.96857, best error:       711.95294 on epoch:    89, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 149.9276428223s, input_fired_time: 1.3531070948, output_fired_time: 1.2973307371, propagate_forward_time: 52.3134346008, propagate_backward_time: 91.5060119629, weight_update_time: 0.1237895787, other_time: 3.4577636719
epoch time: 13.3608932495s, input_fired_time: 0.4322368801, output_fired_time: 0.0000000000, propagate_forward_time: 12.1953639984, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.7332925797
validation[          , genome  7097] predictions:    9765/  10000 (97.65%), best:    9805/10000 (98.05%), error:       794.16589, best error:       711.95294 on epoch:    89, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 149.4557495117s, input_fired_time: 1.6035209894, output_fired_time: 1.2947634459, propagate_forward_time: 52.2377586365, propagate_backward_time: 91.6209793091, weight_update_time: 0.1234648824, other_time: 2.6987228394
epoch time: 11.0596694946s, input_fired_time: 0.1609972268, output_fired_time: 0.0000000000, propagate_forward_time: 10.4706268311, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4280452728
validation[          , genome  7097] predictions:    9736/  10000 (97.36%), best:    9805/10000 (98.05%), error:       914.31494, best error:       711.95294 on epoch:    89, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 160.3399658203s, input_fired_time: 1.4047713280, output_fired_time: 1.6074380875, propagate_forward_time: 60.2913055420, propagate_backward_time: 93.9874649048, weight_update_time: 0.1298332214, other_time: 3.0489883423
epoch time: 10.9925251007s, input_fired_time: 0.4117600918, output_fired_time: 0.0000000000, propagate_forward_time: 9.6560478210, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9247169495
validation[          , genome  7097] predictions:    9727/  10000 (97.27%), best:    9805/10000 (98.05%), error:       931.53192, best error:       711.95294 on epoch:    89, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 150.5431365967s, input_fired_time: 1.8588764668, output_fired_time: 1.0480998755, propagate_forward_time: 56.7617607117, propagate_backward_time: 88.1643600464, weight_update_time: 0.1240081936, other_time: 2.7100448608
epoch time: 10.0224590302s, input_fired_time: 0.1523458213, output_fired_time: 0.0000000000, propagate_forward_time: 9.4681234360, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4019899368
validation[          , genome  7097] predictions:    9774/  10000 (97.74%), best:    9805/10000 (98.05%), error:       791.23883, best error:       711.95294 on epoch:    89, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 152.4114990234s, input_fired_time: 1.6166486740, output_fired_time: 1.8082387447, propagate_forward_time: 53.0186271667, propagate_backward_time: 92.9893188477, weight_update_time: 0.1254832149, other_time: 2.9786529541
epoch time: 10.3938694000s, input_fired_time: 0.1566118896, output_fired_time: 0.0000000000, propagate_forward_time: 8.5720348358, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6652231216
validation[          , genome  7097] predictions:    9758/  10000 (97.58%), best:    9805/10000 (98.05%), error:       862.62170, best error:       711.95294 on epoch:    89, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 146.1076049805s, input_fired_time: 1.3336932659, output_fired_time: 1.2705739737, propagate_forward_time: 53.6409530640, propagate_backward_time: 87.2077102661, weight_update_time: 0.1210067123, other_time: 2.6546783447
epoch time: 12.2289543152s, input_fired_time: 0.1722870022, output_fired_time: 0.0000000000, propagate_forward_time: 11.6027193069, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4539480209
validation[          , genome  7097] predictions:    9781/  10000 (97.81%), best:    9805/10000 (98.05%), error:       734.36053, best error:       711.95294 on epoch:    89, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 143.5397186279s, input_fired_time: 2.3235106468, output_fired_time: 1.0023565292, propagate_forward_time: 55.2183609009, propagate_backward_time: 81.8669128418, weight_update_time: 0.3692137897, other_time: 3.1285781860
epoch time: 10.9893178940s, input_fired_time: 0.1610668600, output_fired_time: 0.0000000000, propagate_forward_time: 10.4049148560, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4233360291
validation[          , genome  7097] predictions:    9749/  10000 (97.49%), best:    9805/10000 (98.05%), error:       815.15973, best error:       711.95294 on epoch:    89, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 54.6300125122s, input_fired_time: 0.7983075380, output_fired_time: 0.0000000000, propagate_forward_time: 50.1455650330, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6861381531
best training[          , genome  7097] predictions:   49806/  50000 (99.61%), best:    9805/10000 (98.05%), error:       985.85693, best error:       711.95294 on epoch:    89, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 12.0796680450s, input_fired_time: 0.1663742661, output_fired_time: 0.0000000000, propagate_forward_time: 10.9625492096, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.9507446289
   testing[          , genome  7097] predictions:    9817/  10000 (98.17%), best:    9805/10000 (98.05%), error:       615.51794, best error:       711.95294 on epoch:    89, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
15:41:15 (10024): called boinc_finish(0)

</stderr_txt>
]]>