Nameexact_genome_1512568488_43_6578_0
Workunit2604164
Created7 Dec 2017, 20:40:06 UTC
Sent7 Dec 2017, 20:48:16 UTC
Report deadline16 Dec 2017, 8:40:33 UTC
Received9 Dec 2017, 1:49:15 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID52320
Run time4 hours 11 min 32 sec
CPU time4 hours 11 min 28 sec
Validate stateValid
Credit2,123.66
Device peak FLOPS2.93 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size154.88 MB
Peak swap size153.35 MB
Peak disk usage1.83 MB

Stderr output

<core_client_version>7.8.2</core_client_version>
<![CDATA[
<stderr_txt>
000 (96.81%), best:    9683/10000 (96.83%), error:      1083.64392, best error:      1028.30066 on epoch:    13, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 137.1250152588s, input_fired_time: 1.3522878885, output_fired_time: 1.2188845873, propagate_forward_time: 52.3837318420, propagate_backward_time: 79.3854446411, weight_update_time: 0.1550983489, other_time: 2.7846603394
epoch time: 11.1833114624s, input_fired_time: 0.1665755510, output_fired_time: 0.0000000000, propagate_forward_time: 10.5157546997, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5009813309
validation[          , genome  6578] predictions:    9625/  10000 (96.25%), best:    9683/10000 (96.83%), error:      1193.56982, best error:      1028.30066 on epoch:    13, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 136.9407501221s, input_fired_time: 1.3528060913, output_fired_time: 1.2127811909, propagate_forward_time: 52.4224281311, propagate_backward_time: 79.1678161621, weight_update_time: 0.1560517251, other_time: 2.7849273682
epoch time: 11.1157684326s, input_fired_time: 0.1661022007, output_fired_time: 0.0000000000, propagate_forward_time: 10.4523000717, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4973659515
validation[          , genome  6578] predictions:    9694/  10000 (96.94%), best:    9683/10000 (96.83%), error:      1038.40833, best error:      1028.30066 on epoch:    13, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 137.0921325684s, input_fired_time: 1.3375362158, output_fired_time: 1.2224862576, propagate_forward_time: 52.4608688354, propagate_backward_time: 79.3453598022, weight_update_time: 0.1546502560, other_time: 2.7258758545
epoch time: 11.1790838242s, input_fired_time: 0.1622890532, output_fired_time: 0.0000000000, propagate_forward_time: 10.5317907333, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4850044250
validation[          , genome  6578] predictions:    9705/  10000 (97.05%), best:    9705/10000 (97.05%), error:      1021.45331, best error:      1021.45331 on epoch:    17, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 136.8712615967s, input_fired_time: 1.3214242458, output_fired_time: 1.2239968777, propagate_forward_time: 52.4233779907, propagate_backward_time: 79.2292175293, weight_update_time: 0.1531424075, other_time: 2.6732406616
epoch time: 11.1249456406s, input_fired_time: 0.1619092822, output_fired_time: 0.0000000000, propagate_forward_time: 10.4789733887, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4840631485
validation[          , genome  6578] predictions:    9706/  10000 (97.06%), best:    9706/10000 (97.06%), error:      1003.50403, best error:      1003.50403 on epoch:    18, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 137.5178070068s, input_fired_time: 1.3551265001, output_fired_time: 1.2234621048, propagate_forward_time: 52.5963973999, propagate_backward_time: 79.5568466187, weight_update_time: 0.1554423422, other_time: 2.7859649658
epoch time: 11.2291002274s, input_fired_time: 0.1660744250, output_fired_time: 0.0000000000, propagate_forward_time: 10.5631990433, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4998264313
validation[          , genome  6578] predictions:    9568/  10000 (95.68%), best:    9706/10000 (97.06%), error:      1409.06860, best error:      1003.50403 on epoch:    18, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 136.6489562988s, input_fired_time: 1.3488644361, output_fired_time: 1.2173731327, propagate_forward_time: 52.2507553101, propagate_backward_time: 79.0605316162, weight_update_time: 0.1560705900, other_time: 2.7714309692
epoch time: 11.2130022049s, input_fired_time: 0.1669860035, output_fired_time: 0.0000000000, propagate_forward_time: 10.5449123383, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5011034012
validation[          , genome  6578] predictions:    9632/  10000 (96.32%), best:    9706/10000 (97.06%), error:      1233.01306, best error:      1003.50403 on epoch:    18, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 137.5150756836s, input_fired_time: 1.3534932137, output_fired_time: 1.2266272306, propagate_forward_time: 52.6320266724, propagate_backward_time: 79.5541000366, weight_update_time: 0.1545238644, other_time: 2.7488250732
epoch time: 11.2415733337s, input_fired_time: 0.1641308069, output_fired_time: 0.0000000000, propagate_forward_time: 10.5943412781, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4831008911
validation[          , genome  6578] predictions:    9635/  10000 (96.35%), best:    9706/10000 (97.06%), error:      1183.78662, best error:      1003.50403 on epoch:    18, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 137.1174621582s, input_fired_time: 1.3612136841, output_fired_time: 1.2169103622, propagate_forward_time: 52.4389266968, propagate_backward_time: 79.3114166260, weight_update_time: 0.1544999778, other_time: 2.7890090942
epoch time: 11.2250556946s, input_fired_time: 0.1669458151, output_fired_time: 0.0000000000, propagate_forward_time: 10.5582847595, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4998254776
validation[          , genome  6578] predictions:    9689/  10000 (96.89%), best:    9706/10000 (97.06%), error:      1044.39319, best error:      1003.50403 on epoch:    18, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 136.9808807373s, input_fired_time: 1.3613458872, output_fired_time: 1.2216179371, propagate_forward_time: 52.4874725342, propagate_backward_time: 79.1257629395, weight_update_time: 0.1559130549, other_time: 2.7846832275
epoch time: 11.1356954575s, input_fired_time: 0.1650667787, output_fired_time: 0.0000000000, propagate_forward_time: 10.4720230103, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4986057281
validation[          , genome  6578] predictions:    9649/  10000 (96.49%), best:    9706/10000 (97.06%), error:      1234.69629, best error:      1003.50403 on epoch:    18, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 137.1906280518s, input_fired_time: 1.3434605598, output_fired_time: 1.2200242281, propagate_forward_time: 52.4554672241, propagate_backward_time: 79.4331588745, weight_update_time: 0.1551991403, other_time: 2.7385101318
epoch time: 11.1634483337s, input_fired_time: 0.1640172601, output_fired_time: 0.0000000000, propagate_forward_time: 10.5162086487, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4832220078
validation[          , genome  6578] predictions:    9651/  10000 (96.51%), best:    9706/10000 (97.06%), error:      1174.52722, best error:      1003.50403 on epoch:    18, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 137.0020751953s, input_fired_time: 1.3588520288, output_fired_time: 1.2203397751, propagate_forward_time: 52.4633522034, propagate_backward_time: 79.1771011353, weight_update_time: 0.1553922743, other_time: 2.7824325562
epoch time: 11.1030902863s, input_fired_time: 0.1652832925, output_fired_time: 0.0000000000, propagate_forward_time: 10.4418029785, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4960041046
validation[          , genome  6578] predictions:    9686/  10000 (96.86%), best:    9706/10000 (97.06%), error:      1091.37573, best error:      1003.50403 on epoch:    18, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 137.4545593262s, input_fired_time: 1.3462275267, output_fired_time: 1.2241139412, propagate_forward_time: 52.6132774353, propagate_backward_time: 79.5470581055, weight_update_time: 0.1539607942, other_time: 2.7238769531
epoch time: 11.2451238632s, input_fired_time: 0.1661099494, output_fired_time: 0.0000000000, propagate_forward_time: 10.5947437286, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4842700958
validation[          , genome  6578] predictions:    9680/  10000 (96.80%), best:    9706/10000 (97.06%), error:      1054.81909, best error:      1003.50403 on epoch:    18, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 137.1604461670s, input_fired_time: 1.3328248262, output_fired_time: 1.2233026028, propagate_forward_time: 52.4990463257, propagate_backward_time: 79.4084701538, weight_update_time: 0.1528823227, other_time: 2.6968078613
epoch time: 11.1120786667s, input_fired_time: 0.1632748395, output_fired_time: 0.0000000000, propagate_forward_time: 10.4661684036, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4826354980
validation[          , genome  6578] predictions:    9701/  10000 (97.01%), best:    9706/10000 (97.06%), error:      1027.69104, best error:      1003.50403 on epoch:    18, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 138.2414550781s, input_fired_time: 1.3659806252, output_fired_time: 1.2300274372, propagate_forward_time: 52.9189071655, propagate_backward_time: 79.9385833740, weight_update_time: 0.1567959487, other_time: 2.7879562378
epoch time: 11.2584133148s, input_fired_time: 0.1660308987, output_fired_time: 0.0000000000, propagate_forward_time: 10.5929231644, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4994592667
validation[          , genome  6578] predictions:    9691/  10000 (96.91%), best:    9691/10000 (96.91%), error:       987.49567, best error:       987.49567 on epoch:    28, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 136.9113922119s, input_fired_time: 1.3675453663, output_fired_time: 1.2206819057, propagate_forward_time: 52.3734703064, propagate_backward_time: 79.1660766602, weight_update_time: 0.1565962881, other_time: 2.7836151123
epoch time: 11.1819267273s, input_fired_time: 0.1687467396, output_fired_time: 0.0000000000, propagate_forward_time: 10.5124349594, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5007448196
validation[          , genome  6578] predictions:    9670/  10000 (96.70%), best:    9691/10000 (96.91%), error:      1052.66724, best error:       987.49567 on epoch:    28, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 136.3856353760s, input_fired_time: 1.3586564064, output_fired_time: 1.2135486603, propagate_forward_time: 52.0535049438, propagate_backward_time: 78.9804153442, weight_update_time: 0.1539437473, other_time: 2.7795104980
epoch time: 11.2488241196s, input_fired_time: 0.1677744687, output_fired_time: 0.0000000000, propagate_forward_time: 10.5821180344, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4989318848
validation[          , genome  6578] predictions:    9727/  10000 (97.27%), best:    9727/10000 (97.27%), error:       974.86719, best error:       974.86719 on epoch:    30, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 138.2835540771s, input_fired_time: 1.3598040342, output_fired_time: 1.2284876108, propagate_forward_time: 52.9110717773, propagate_backward_time: 80.0056610107, weight_update_time: 0.1556054652, other_time: 2.7785339355
epoch time: 11.2352123260s, input_fired_time: 0.1653278470, output_fired_time: 0.0000000000, propagate_forward_time: 10.5874757767, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4824085236
validation[          , genome  6578] predictions:    9630/  10000 (96.30%), best:    9727/10000 (97.27%), error:      1224.97644, best error:       974.86719 on epoch:    30, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 137.1040344238s, input_fired_time: 1.3370176554, output_fired_time: 1.2174437046, propagate_forward_time: 52.4918556213, propagate_backward_time: 79.3612976074, weight_update_time: 0.1539800465, other_time: 2.6964263916
epoch time: 11.1357774734s, input_fired_time: 0.1635209024, output_fired_time: 0.0000000000, propagate_forward_time: 10.4908952713, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4813613892
validation[          , genome  6578] predictions:    9695/  10000 (96.95%), best:    9727/10000 (97.27%), error:       998.16180, best error:       974.86719 on epoch:    30, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 138.3001861572s, input_fired_time: 1.3657528162, output_fired_time: 1.2326445580, propagate_forward_time: 52.9183082581, propagate_backward_time: 79.9920730591, weight_update_time: 0.1583544761, other_time: 2.7914047241
epoch time: 11.2704753876s, input_fired_time: 0.1674413830, output_fired_time: 0.0000000000, propagate_forward_time: 10.6035566330, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4994773865
validation[          , genome  6578] predictions:    9623/  10000 (96.23%), best:    9727/10000 (97.27%), error:      1285.14600, best error:       974.86719 on epoch:    30, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 137.8653717041s, input_fired_time: 1.3519877195, output_fired_time: 1.2290210724, propagate_forward_time: 52.7894058228, propagate_backward_time: 79.7589645386, weight_update_time: 0.1546238214, other_time: 2.7359924316
epoch time: 11.1548805237s, input_fired_time: 0.1646439135, output_fired_time: 0.0000000000, propagate_forward_time: 10.5062694550, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4839668274
validation[          , genome  6578] predictions:    9707/  10000 (97.07%), best:    9727/10000 (97.27%), error:       986.70734, best error:       974.86719 on epoch:    30, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 137.5561676025s, input_fired_time: 1.3645907640, output_fired_time: 1.2264714241, propagate_forward_time: 52.6025238037, propagate_backward_time: 79.5781707764, weight_update_time: 0.1563575417, other_time: 2.7844085693
epoch time: 11.2388906479s, input_fired_time: 0.1683806479, output_fired_time: 0.0000000000, propagate_forward_time: 10.5710601807, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4994497299
validation[          , genome  6578] predictions:    9655/  10000 (96.55%), best:    9727/10000 (97.27%), error:      1125.43115, best error:       974.86719 on epoch:    30, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 137.5360260010s, input_fired_time: 1.3699406385, output_fired_time: 1.2193572521, propagate_forward_time: 52.6060638428, propagate_backward_time: 79.5550994873, weight_update_time: 0.1559775323, other_time: 2.7855682373
epoch time: 11.2068786621s, input_fired_time: 0.1686976105, output_fired_time: 0.0000000000, propagate_forward_time: 10.5391817093, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4989995956
validation[          , genome  6578] predictions:    9720/  10000 (97.20%), best:    9727/10000 (97.27%), error:       976.03229, best error:       974.86719 on epoch:    30, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 137.4074554443s, input_fired_time: 1.3318051100, output_fired_time: 1.2203702927, propagate_forward_time: 52.6153411865, propagate_backward_time: 79.5545272827, weight_update_time: 0.1536734700, other_time: 2.6854171753
epoch time: 11.2044658661s, input_fired_time: 0.1653555334, output_fired_time: 0.0000000000, propagate_forward_time: 10.5581922531, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4809179306
validation[          , genome  6578] predictions:    9669/  10000 (96.69%), best:    9727/10000 (97.27%), error:      1121.03687, best error:       974.86719 on epoch:    30, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 136.4311676025s, input_fired_time: 1.3516325951, output_fired_time: 1.2146892548, propagate_forward_time: 52.1080284119, propagate_backward_time: 79.0029907227, weight_update_time: 0.1537745148, other_time: 2.7538146973
epoch time: 11.0571632385s, input_fired_time: 0.1665557921, output_fired_time: 0.0000000000, propagate_forward_time: 10.3924684525, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4981393814
validation[          , genome  6578] predictions:    9700/  10000 (97.00%), best:    9727/10000 (97.27%), error:      1004.89532, best error:       974.86719 on epoch:    30, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 137.9822845459s, input_fired_time: 1.3452433348, output_fired_time: 1.2285163403, propagate_forward_time: 52.8229675293, propagate_backward_time: 79.8794479370, weight_update_time: 0.1548993140, other_time: 2.7061080933
epoch time: 11.0915927887s, input_fired_time: 0.1655614078, output_fired_time: 0.0000000000, propagate_forward_time: 10.4399290085, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4861021042
validation[          , genome  6578] predictions:    9720/  10000 (97.20%), best:    9720/10000 (97.20%), error:       948.75006, best error:       948.75006 on epoch:    39, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 137.6705932617s, input_fired_time: 1.3343001604, output_fired_time: 1.2266590595, propagate_forward_time: 52.7341194153, propagate_backward_time: 79.6905746460, weight_update_time: 0.1533354968, other_time: 2.6849441528
epoch time: 11.1048069000s, input_fired_time: 0.1651697159, output_fired_time: 0.0000000000, propagate_forward_time: 10.4556007385, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4840364456
validation[          , genome  6578] predictions:    9575/  10000 (95.75%), best:    9720/10000 (97.20%), error:      1430.72925, best error:       948.75006 on epoch:    39, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 136.8751220703s, input_fired_time: 1.3664093018, output_fired_time: 1.2117934227, propagate_forward_time: 52.3302001953, propagate_backward_time: 79.1822357178, weight_update_time: 0.1560914665, other_time: 2.7844848633
epoch time: 11.1503267288s, input_fired_time: 0.1679928303, output_fired_time: 0.0000000000, propagate_forward_time: 10.4829978943, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4993362427
validation[          , genome  6578] predictions:    9733/  10000 (97.33%), best:    9733/10000 (97.33%), error:       917.28955, best error:       917.28955 on epoch:    41, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 137.5938568115s, input_fired_time: 1.3385380507, output_fired_time: 1.2331339121, propagate_forward_time: 52.6556015015, propagate_backward_time: 79.6880035400, weight_update_time: 0.1532714218, other_time: 2.6785812378
epoch time: 11.2563648224s, input_fired_time: 0.1662277877, output_fired_time: 0.0000000000, propagate_forward_time: 10.6079387665, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4821987152
validation[          , genome  6578] predictions:    9663/  10000 (96.63%), best:    9733/10000 (97.33%), error:      1100.84985, best error:       917.28955 on epoch:    41, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 137.3206634521s, input_fired_time: 1.3328619003, output_fired_time: 1.2232851982, propagate_forward_time: 52.6293220520, propagate_backward_time: 79.4542999268, weight_update_time: 0.1545075625, other_time: 2.6809082031
epoch time: 11.1890897751s, input_fired_time: 0.1666369736, output_fired_time: 0.0000000000, propagate_forward_time: 10.5409450531, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4815073013
validation[          , genome  6578] predictions:    9692/  10000 (96.92%), best:    9733/10000 (97.33%), error:      1002.57330, best error:       917.28955 on epoch:    41, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 137.9380340576s, input_fired_time: 1.3678094149, output_fired_time: 1.2243634462, propagate_forward_time: 52.7637748718, propagate_backward_time: 79.7967224121, weight_update_time: 0.1557468474, other_time: 2.7853546143
epoch time: 11.2775468826s, input_fired_time: 0.1690089852, output_fired_time: 0.0000000000, propagate_forward_time: 10.6085643768, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4999732971
validation[          , genome  6578] predictions:    9687/  10000 (96.87%), best:    9733/10000 (97.33%), error:      1090.78455, best error:       917.28955 on epoch:    41, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 137.7419586182s, input_fired_time: 1.3686068058, output_fired_time: 1.2257943153, propagate_forward_time: 52.7063980103, propagate_backward_time: 79.6568450928, weight_update_time: 0.1576194018, other_time: 2.7843093872
epoch time: 11.1425199509s, input_fired_time: 0.1682567745, output_fired_time: 0.0000000000, propagate_forward_time: 10.4742145538, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5000486374
validation[          , genome  6578] predictions:    9687/  10000 (96.87%), best:    9733/10000 (97.33%), error:      1056.56250, best error:       917.28955 on epoch:    41, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 137.5507049561s, input_fired_time: 1.3521872759, output_fired_time: 1.2214772701, propagate_forward_time: 52.6660575867, propagate_backward_time: 79.5961761475, weight_update_time: 0.1534022540, other_time: 2.7147979736
epoch time: 11.2240037918s, input_fired_time: 0.1651001424, output_fired_time: 0.0000000000, propagate_forward_time: 10.5765771866, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4823265076
validation[          , genome  6578] predictions:    9719/  10000 (97.19%), best:    9733/10000 (97.33%), error:       952.64215, best error:       917.28955 on epoch:    41, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 137.0753936768s, input_fired_time: 1.3593031168, output_fired_time: 1.2194118500, propagate_forward_time: 52.4783096313, propagate_backward_time: 79.2815017700, weight_update_time: 0.1548656076, other_time: 2.7368774414
epoch time: 11.1119070053s, input_fired_time: 0.1640398502, output_fired_time: 0.0000000000, propagate_forward_time: 10.4651374817, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4827299118
validation[          , genome  6578] predictions:    9702/  10000 (97.02%), best:    9733/10000 (97.33%), error:       992.68970, best error:       917.28955 on epoch:    41, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 137.6265411377s, input_fired_time: 1.3401142359, output_fired_time: 1.2202903032, propagate_forward_time: 52.7301559448, propagate_backward_time: 79.6537399292, weight_update_time: 0.1537268907, other_time: 2.6822357178
epoch time: 11.1334943771s, input_fired_time: 0.1661667824, output_fired_time: 0.0000000000, propagate_forward_time: 10.4837961197, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4835309982
validation[          , genome  6578] predictions:    9713/  10000 (97.13%), best:    9733/10000 (97.33%), error:       964.01556, best error:       917.28955 on epoch:    41, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 137.4003143311s, input_fired_time: 1.3566441536, output_fired_time: 1.2259589434, propagate_forward_time: 52.5557479858, propagate_backward_time: 79.5428009033, weight_update_time: 0.1544452310, other_time: 2.7191696167
epoch time: 11.2350568771s, input_fired_time: 0.1678065211, output_fired_time: 0.0000000000, propagate_forward_time: 10.5786437988, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4886064529
validation[          , genome  6578] predictions:    9699/  10000 (96.99%), best:    9733/10000 (97.33%), error:      1000.29474, best error:       917.28955 on epoch:    41, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 137.0420379639s, input_fired_time: 1.3357683420, output_fired_time: 1.2226027250, propagate_forward_time: 52.4950637817, propagate_backward_time: 79.3082199097, weight_update_time: 0.1521250159, other_time: 2.6803894043
epoch time: 11.1154747009s, input_fired_time: 0.1662726104, output_fired_time: 0.0000000000, propagate_forward_time: 10.4662265778, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4829759598
validation[          , genome  6578] predictions:    9742/  10000 (97.42%), best:    9742/10000 (97.42%), error:       879.47321, best error:       879.47321 on epoch:    50, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 137.7958221436s, input_fired_time: 1.3709150553, output_fired_time: 1.2244545221, propagate_forward_time: 52.6603240967, propagate_backward_time: 79.7569122314, weight_update_time: 0.1556242257, other_time: 2.7832183838
epoch time: 11.2195892334s, input_fired_time: 0.1693938076, output_fired_time: 0.0000000000, propagate_forward_time: 10.5525035858, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4976921082
validation[          , genome  6578] predictions:    9743/  10000 (97.43%), best:    9743/10000 (97.43%), error:       844.79083, best error:       844.79083 on epoch:    51, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 138.1078033447s, input_fired_time: 1.3469569683, output_fired_time: 1.2318314314, propagate_forward_time: 52.8891983032, propagate_backward_time: 79.9617462158, weight_update_time: 0.1534546614, other_time: 2.6780776978
epoch time: 11.2748947144s, input_fired_time: 0.1664747000, output_fired_time: 0.0000000000, propagate_forward_time: 10.6236047745, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4848155975
validation[          , genome  6578] predictions:    9705/  10000 (97.05%), best:    9743/10000 (97.43%), error:      1006.88843, best error:       844.79083 on epoch:    51, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 137.2097167969s, input_fired_time: 1.3443412781, output_fired_time: 1.2255113125, propagate_forward_time: 52.5604515076, propagate_backward_time: 79.4062957764, weight_update_time: 0.1523581147, other_time: 2.6731109619
epoch time: 11.1773872375s, input_fired_time: 0.1669321507, output_fired_time: 0.0000000000, propagate_forward_time: 10.5269012451, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4835538864
validation[          , genome  6578] predictions:    9707/  10000 (97.07%), best:    9743/10000 (97.43%), error:       983.72113, best error:       844.79083 on epoch:    51, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 137.4774017334s, input_fired_time: 1.3484945297, output_fired_time: 1.2225799561, propagate_forward_time: 52.6987762451, propagate_backward_time: 79.5342178345, weight_update_time: 0.1527527720, other_time: 2.6733322144
epoch time: 11.1865711212s, input_fired_time: 0.1668791473, output_fired_time: 0.0000000000, propagate_forward_time: 10.5344152451, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4852771759
validation[          , genome  6578] predictions:    9704/  10000 (97.04%), best:    9743/10000 (97.43%), error:       986.37390, best error:       844.79083 on epoch:    51, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 137.8774261475s, input_fired_time: 1.3554358482, output_fired_time: 1.2302172184, propagate_forward_time: 52.7788276672, propagate_backward_time: 79.8128662109, weight_update_time: 0.1527519077, other_time: 2.7000732422
epoch time: 11.2173423767s, input_fired_time: 0.1665733457, output_fired_time: 0.0000000000, propagate_forward_time: 10.5678281784, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4829406738
validation[          , genome  6578] predictions:    9736/  10000 (97.36%), best:    9743/10000 (97.43%), error:       903.60205, best error:       844.79083 on epoch:    51, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 137.6559448242s, input_fired_time: 1.3455208540, output_fired_time: 1.2270621061, propagate_forward_time: 52.6944313049, propagate_backward_time: 79.7141799927, weight_update_time: 0.1550200433, other_time: 2.6747512817
epoch time: 11.2338409424s, input_fired_time: 0.1664293855, output_fired_time: 0.0000000000, propagate_forward_time: 10.5812778473, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4861335754
validation[          , genome  6578] predictions:    9728/  10000 (97.28%), best:    9743/10000 (97.43%), error:       916.70496, best error:       844.79083 on epoch:    51, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 136.8367462158s, input_fired_time: 1.3364583254, output_fired_time: 1.2167190313, propagate_forward_time: 52.4646568298, propagate_backward_time: 79.1467437744, weight_update_time: 0.1513164192, other_time: 2.6721649170
epoch time: 11.1446628571s, input_fired_time: 0.1660975218, output_fired_time: 0.0000000000, propagate_forward_time: 10.4962158203, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4823493958
validation[          , genome  6578] predictions:    9715/  10000 (97.15%), best:    9743/10000 (97.43%), error:       944.23248, best error:       844.79083 on epoch:    51, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 137.2131958008s, input_fired_time: 1.3833085299, output_fired_time: 1.2229939699, propagate_forward_time: 52.5687522888, propagate_backward_time: 79.2508544922, weight_update_time: 0.1555879712, other_time: 2.7872772217
epoch time: 11.2322320938s, input_fired_time: 0.1692836732, output_fired_time: 0.0000000000, propagate_forward_time: 10.5637836456, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4991645813
validation[          , genome  6578] predictions:    9709/  10000 (97.09%), best:    9743/10000 (97.43%), error:       995.00946, best error:       844.79083 on epoch:    51, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 137.5258331299s, input_fired_time: 1.3732618093, output_fired_time: 1.2184704542, propagate_forward_time: 52.5900115967, propagate_backward_time: 79.5596237183, weight_update_time: 0.1562046260, other_time: 2.7844619751
epoch time: 11.2086467743s, input_fired_time: 0.1705206335, output_fired_time: 0.0000000000, propagate_forward_time: 10.5407533646, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4973726273
validation[          , genome  6578] predictions:    9708/  10000 (97.08%), best:    9743/10000 (97.43%), error:       972.34351, best error:       844.79083 on epoch:    51, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 137.3392639160s, input_fired_time: 1.3738811016, output_fired_time: 1.2197248936, propagate_forward_time: 52.5469055176, propagate_backward_time: 79.4145050049, weight_update_time: 0.1549440175, other_time: 2.7842407227
epoch time: 11.1626882553s, input_fired_time: 0.1695519090, output_fired_time: 0.0000000000, propagate_forward_time: 10.4993610382, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4937753677
validation[          , genome  6578] predictions:    9647/  10000 (96.47%), best:    9743/10000 (97.43%), error:      1126.76184, best error:       844.79083 on epoch:    51, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 137.5345001221s, input_fired_time: 1.3724548817, output_fired_time: 1.2242602110, propagate_forward_time: 52.5633773804, propagate_backward_time: 79.5960006714, weight_update_time: 0.1560256928, other_time: 2.7784118652
epoch time: 11.0931568146s, input_fired_time: 0.1696313471, output_fired_time: 0.0000000000, propagate_forward_time: 10.4231615067, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5003643036
validation[          , genome  6578] predictions:    9723/  10000 (97.23%), best:    9743/10000 (97.43%), error:       939.89612, best error:       844.79083 on epoch:    51, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 136.5863952637s, input_fired_time: 1.3349851370, output_fired_time: 1.2112306356, propagate_forward_time: 52.3498878479, propagate_backward_time: 79.0166625977, weight_update_time: 0.1534558088, other_time: 2.6736297607
epoch time: 11.1742305756s, input_fired_time: 0.1669539064, output_fired_time: 0.0000000000, propagate_forward_time: 10.5228309631, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4844455719
validation[          , genome  6578] predictions:    9726/  10000 (97.26%), best:    9743/10000 (97.43%), error:       940.05579, best error:       844.79083 on epoch:    51, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 138.1527252197s, input_fired_time: 1.3803139925, output_fired_time: 1.2283020020, propagate_forward_time: 52.8055534363, propagate_backward_time: 79.9537506104, weight_update_time: 0.1559262425, other_time: 2.7848052979
epoch time: 11.2381677628s, input_fired_time: 0.1669988185, output_fired_time: 0.0000000000, propagate_forward_time: 10.5875453949, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4836235046
validation[          , genome  6578] predictions:    9727/  10000 (97.27%), best:    9743/10000 (97.43%), error:       879.42023, best error:       844.79083 on epoch:    51, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 138.0165100098s, input_fired_time: 1.3760780096, output_fired_time: 1.2272305489, propagate_forward_time: 52.8350105286, propagate_backward_time: 79.7922821045, weight_update_time: 0.1562969238, other_time: 2.7859039307
epoch time: 11.2292985916s, input_fired_time: 0.1707530320, output_fired_time: 0.0000000000, propagate_forward_time: 10.5614452362, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4970998764
validation[          , genome  6578] predictions:    9710/  10000 (97.10%), best:    9743/10000 (97.43%), error:       943.34857, best error:       844.79083 on epoch:    51, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 137.0206604004s, input_fired_time: 1.3601930141, output_fired_time: 1.2162485123, propagate_forward_time: 52.5131645203, propagate_backward_time: 79.1885910034, weight_update_time: 0.1539015025, other_time: 2.7424545288
epoch time: 11.1796722412s, input_fired_time: 0.1716705412, output_fired_time: 0.0000000000, propagate_forward_time: 10.5104131699, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4975881577
validation[          , genome  6578] predictions:    9735/  10000 (97.35%), best:    9743/10000 (97.43%), error:       902.89136, best error:       844.79083 on epoch:    51, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 137.1825714111s, input_fired_time: 1.3453761339, output_fired_time: 1.2217420340, propagate_forward_time: 52.4620895386, propagate_backward_time: 79.4771957397, weight_update_time: 0.1537903845, other_time: 2.6761627197
epoch time: 11.0619287491s, input_fired_time: 0.1668069810, output_fired_time: 0.0000000000, propagate_forward_time: 10.4135913849, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4815301895
validation[          , genome  6578] predictions:    9658/  10000 (96.58%), best:    9743/10000 (97.43%), error:      1088.75464, best error:       844.79083 on epoch:    51, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 137.2616882324s, input_fired_time: 1.3818917274, output_fired_time: 1.2204788923, propagate_forward_time: 52.5067138672, propagate_backward_time: 79.3706741333, weight_update_time: 0.1559581757, other_time: 2.7819290161
epoch time: 11.0982303619s, input_fired_time: 0.1713925302, output_fired_time: 0.0000000000, propagate_forward_time: 10.4305877686, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4962501526
validation[          , genome  6578] predictions:    9739/  10000 (97.39%), best:    9743/10000 (97.43%), error:       888.20074, best error:       844.79083 on epoch:    51, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 136.9917144775s, input_fired_time: 1.3810833693, output_fired_time: 1.2211639881, propagate_forward_time: 52.3083496094, propagate_backward_time: 79.3025817871, weight_update_time: 0.1546503007, other_time: 2.7785339355
epoch time: 11.1813983917s, input_fired_time: 0.1682862341, output_fired_time: 0.0000000000, propagate_forward_time: 10.5305986404, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4825134277
validation[          , genome  6578] predictions:    9746/  10000 (97.46%), best:    9746/10000 (97.46%), error:       830.63123, best error:       830.63123 on epoch:    68, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 137.1676330566s, input_fired_time: 1.3787583113, output_fired_time: 1.2162672281, propagate_forward_time: 52.5186424255, propagate_backward_time: 79.2729110718, weight_update_time: 0.1553742737, other_time: 2.7810592651
epoch time: 11.1439962387s, input_fired_time: 0.1701037586, output_fired_time: 0.0000000000, propagate_forward_time: 10.4762973785, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4975948334
validation[          , genome  6578] predictions:    9752/  10000 (97.52%), best:    9746/10000 (97.46%), error:       832.10553, best error:       830.63123 on epoch:    68, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 137.0487365723s, input_fired_time: 1.3763936758, output_fired_time: 1.2221548557, propagate_forward_time: 52.4585037231, propagate_backward_time: 79.2132186890, weight_update_time: 0.1538507342, other_time: 2.7784729004
epoch time: 11.1378564835s, input_fired_time: 0.1704096198, output_fired_time: 0.0000000000, propagate_forward_time: 10.4715032578, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4959440231
validation[          , genome  6578] predictions:    9719/  10000 (97.19%), best:    9746/10000 (97.46%), error:       925.07874, best error:       830.63123 on epoch:    68, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 137.4338226318s, input_fired_time: 1.3788897991, output_fired_time: 1.2204115391, propagate_forward_time: 52.5568962097, propagate_backward_time: 79.4938049316, weight_update_time: 0.1551978737, other_time: 2.7838134766
epoch time: 11.1546068192s, input_fired_time: 0.1706303954, output_fired_time: 0.0000000000, propagate_forward_time: 10.4876031876, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4963731766
validation[          , genome  6578] predictions:    9720/  10000 (97.20%), best:    9746/10000 (97.46%), error:       889.33398, best error:       830.63123 on epoch:    68, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 137.8512268066s, input_fired_time: 1.3603311777, output_fired_time: 1.2262846231, propagate_forward_time: 52.7878227234, propagate_backward_time: 79.7727355957, weight_update_time: 0.1536879390, other_time: 2.7040405273
epoch time: 11.2336950302s, input_fired_time: 0.1688637733, output_fired_time: 0.0000000000, propagate_forward_time: 10.5799417496, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4848890305
validation[          , genome  6578] predictions:    9730/  10000 (97.30%), best:    9746/10000 (97.46%), error:       875.68457, best error:       830.63123 on epoch:    68, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 137.7588958740s, input_fired_time: 1.3780512810, output_fired_time: 1.2280272245, propagate_forward_time: 52.6769104004, propagate_backward_time: 79.6950149536, weight_update_time: 0.1559615880, other_time: 2.7808914185
epoch time: 11.1589508057s, input_fired_time: 0.1722305268, output_fired_time: 0.0000000000, propagate_forward_time: 10.4889364243, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4977836609
validation[          , genome  6578] predictions:    9730/  10000 (97.30%), best:    9746/10000 (97.46%), error:       886.22192, best error:       830.63123 on epoch:    68, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 137.8836059570s, input_fired_time: 1.3854291439, output_fired_time: 1.2340457439, propagate_forward_time: 52.7297248840, propagate_backward_time: 79.7498626709, weight_update_time: 0.1563575864, other_time: 2.7845611572
epoch time: 11.2628498077s, input_fired_time: 0.1734876931, output_fired_time: 0.0000000000, propagate_forward_time: 10.5900411606, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4993209839
validation[          , genome  6578] predictions:    9711/  10000 (97.11%), best:    9746/10000 (97.46%), error:       931.25037, best error:       830.63123 on epoch:    68, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 137.8179016113s, input_fired_time: 1.3507367373, output_fired_time: 1.2287155390, propagate_forward_time: 52.7557449341, propagate_backward_time: 79.8016586304, weight_update_time: 0.1541589797, other_time: 2.6810455322
epoch time: 11.2335100174s, input_fired_time: 0.1705014259, output_fired_time: 0.0000000000, propagate_forward_time: 10.5799703598, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4830379486
validation[          , genome  6578] predictions:    9745/  10000 (97.45%), best:    9746/10000 (97.46%), error:       846.60858, best error:       830.63123 on epoch:    68, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 137.4019165039s, input_fired_time: 1.3846665621, output_fired_time: 1.2222304344, propagate_forward_time: 52.5966377258, propagate_backward_time: 79.4197921753, weight_update_time: 0.1565143764, other_time: 2.7785873413
epoch time: 11.1700181961s, input_fired_time: 0.1707919687, output_fired_time: 0.0000000000, propagate_forward_time: 10.5014476776, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4977788925
validation[          , genome  6578] predictions:    9706/  10000 (97.06%), best:    9746/10000 (97.46%), error:      1004.45715, best error:       830.63123 on epoch:    68, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 137.9900360107s, input_fired_time: 1.3869314194, output_fired_time: 1.2280391455, propagate_forward_time: 52.7888755798, propagate_backward_time: 79.8006210327, weight_update_time: 0.1575160474, other_time: 2.7855606079
epoch time: 11.2276992798s, input_fired_time: 0.1720665097, output_fired_time: 0.0000000000, propagate_forward_time: 10.5557136536, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4999189377
validation[          , genome  6578] predictions:    9629/  10000 (96.29%), best:    9746/10000 (97.46%), error:      1185.10303, best error:       830.63123 on epoch:    68, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 137.6945953369s, input_fired_time: 1.3878891468, output_fired_time: 1.2227641344, propagate_forward_time: 52.6742477417, propagate_backward_time: 79.6298217773, weight_update_time: 0.1547213197, other_time: 2.7798690796
epoch time: 11.2517366409s, input_fired_time: 0.1719734520, output_fired_time: 0.0000000000, propagate_forward_time: 10.5828647614, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4968986511
validation[          , genome  6578] predictions:    9731/  10000 (97.31%), best:    9746/10000 (97.46%), error:       907.34363, best error:       830.63123 on epoch:    68, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 137.9200134277s, input_fired_time: 1.3849720955, output_fired_time: 1.2261397839, propagate_forward_time: 52.7421455383, propagate_backward_time: 79.7819671631, weight_update_time: 0.1556980759, other_time: 2.7847900391
epoch time: 11.2148208618s, input_fired_time: 0.1718705148, output_fired_time: 0.0000000000, propagate_forward_time: 10.5462150574, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4967355728
validation[          , genome  6578] predictions:    9707/  10000 (97.07%), best:    9746/10000 (97.46%), error:       985.89813, best error:       830.63123 on epoch:    68, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 137.2181701660s, input_fired_time: 1.3535672426, output_fired_time: 1.2186694145, propagate_forward_time: 52.5613632202, propagate_backward_time: 79.3920974731, weight_update_time: 0.1546006501, other_time: 2.6924743652
epoch time: 11.1647672653s, input_fired_time: 0.1720883548, output_fired_time: 0.0000000000, propagate_forward_time: 10.4927091599, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4999694824
validation[          , genome  6578] predictions:    9718/  10000 (97.18%), best:    9746/10000 (97.46%), error:       932.61859, best error:       830.63123 on epoch:    68, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 137.9022216797s, input_fired_time: 1.3862508535, output_fired_time: 1.2277860641, propagate_forward_time: 52.7780609131, propagate_backward_time: 79.7273864746, weight_update_time: 0.1560073942, other_time: 2.7827453613
epoch time: 11.2070655823s, input_fired_time: 0.1719465107, output_fired_time: 0.0000000000, propagate_forward_time: 10.5365686417, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4985504150
validation[          , genome  6578] predictions:    9736/  10000 (97.36%), best:    9746/10000 (97.46%), error:       905.44525, best error:       830.63123 on epoch:    68, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 137.1486053467s, input_fired_time: 1.3505607843, output_fired_time: 1.2192444801, propagate_forward_time: 52.5662155151, propagate_backward_time: 79.3393707275, weight_update_time: 0.1524927169, other_time: 2.6732254028
epoch time: 11.1530656815s, input_fired_time: 0.1706355810, output_fired_time: 0.0000000000, propagate_forward_time: 10.4993362427, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4830942154
validation[          , genome  6578] predictions:    9734/  10000 (97.34%), best:    9746/10000 (97.46%), error:       889.08759, best error:       830.63123 on epoch:    68, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 136.1124420166s, input_fired_time: 1.3453108072, output_fired_time: 1.2113887072, propagate_forward_time: 51.9890556335, propagate_backward_time: 78.8944320679, weight_update_time: 0.1510673761, other_time: 2.6722488403
epoch time: 11.1532144547s, input_fired_time: 0.1692605466, output_fired_time: 0.0000000000, propagate_forward_time: 10.5023746490, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4815788269
validation[          , genome  6578] predictions:    9739/  10000 (97.39%), best:    9746/10000 (97.46%), error:       887.22174, best error:       830.63123 on epoch:    68, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 137.6371154785s, input_fired_time: 1.3930735588, output_fired_time: 1.2253807783, propagate_forward_time: 52.7122993469, propagate_backward_time: 79.5255126953, weight_update_time: 0.1560522318, other_time: 2.7808532715
epoch time: 11.2427759171s, input_fired_time: 0.1729610115, output_fired_time: 0.0000000000, propagate_forward_time: 10.5703296661, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4994850159
validation[          , genome  6578] predictions:    9743/  10000 (97.43%), best:    9746/10000 (97.46%), error:       862.25757, best error:       830.63123 on epoch:    68, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 136.7702026367s, input_fired_time: 1.3839286566, output_fired_time: 1.2215899229, propagate_forward_time: 52.1831588745, propagate_backward_time: 79.2000274658, weight_update_time: 0.1538647860, other_time: 2.7815017700
epoch time: 11.0952882767s, input_fired_time: 0.1729712784, output_fired_time: 0.0000000000, propagate_forward_time: 10.4247961044, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4975204468
validation[          , genome  6578] predictions:    9765/  10000 (97.65%), best:    9746/10000 (97.46%), error:       839.44592, best error:       830.63123 on epoch:    68, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 137.7574615479s, input_fired_time: 1.3832639456, output_fired_time: 1.2240262032, propagate_forward_time: 52.7100601196, propagate_backward_time: 79.7011718750, weight_update_time: 0.1557676494, other_time: 2.7389297485
epoch time: 11.2129001617s, input_fired_time: 0.1699974388, output_fired_time: 0.0000000000, propagate_forward_time: 10.5599060059, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4829969406
validation[          , genome  6578] predictions:    9737/  10000 (97.37%), best:    9746/10000 (97.46%), error:       872.76178, best error:       830.63123 on epoch:    68, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 137.0086517334s, input_fired_time: 1.3543237448, output_fired_time: 1.2223464251, propagate_forward_time: 52.5066184998, propagate_backward_time: 79.2616348267, weight_update_time: 0.1526879370, other_time: 2.6637191772
epoch time: 11.0765085220s, input_fired_time: 0.1697624773, output_fired_time: 0.0000000000, propagate_forward_time: 10.4234809875, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4832649231
validation[          , genome  6578] predictions:    9701/  10000 (97.01%), best:    9746/10000 (97.46%), error:       981.40613, best error:       830.63123 on epoch:    68, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 136.8928375244s, input_fired_time: 1.3842983246, output_fired_time: 1.2138539553, propagate_forward_time: 52.3580551147, propagate_backward_time: 79.1596298218, weight_update_time: 0.1542917192, other_time: 2.7770080566
epoch time: 11.0906171799s, input_fired_time: 0.1718692034, output_fired_time: 0.0000000000, propagate_forward_time: 10.4190731049, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4996747971
validation[          , genome  6578] predictions:    9666/  10000 (96.66%), best:    9746/10000 (97.46%), error:      1049.32275, best error:       830.63123 on epoch:    68, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 137.3208465576s, input_fired_time: 1.3623613119, output_fired_time: 1.2207285166, propagate_forward_time: 52.6024513245, propagate_backward_time: 79.4577255249, weight_update_time: 0.1528595835, other_time: 2.6775741577
epoch time: 11.1653575897s, input_fired_time: 0.1711665392, output_fired_time: 0.0000000000, propagate_forward_time: 10.5122833252, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4819078445
validation[          , genome  6578] predictions:    9727/  10000 (97.27%), best:    9746/10000 (97.46%), error:       904.99536, best error:       830.63123 on epoch:    68, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 138.3764801025s, input_fired_time: 1.3838882446, output_fired_time: 1.2355891466, propagate_forward_time: 52.9639205933, propagate_backward_time: 80.0577468872, weight_update_time: 0.1546708494, other_time: 2.7353210449
epoch time: 11.2411918640s, input_fired_time: 0.1716756970, output_fired_time: 0.0000000000, propagate_forward_time: 10.5838804245, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4856357574
validation[          , genome  6578] predictions:    9692/  10000 (96.92%), best:    9746/10000 (97.46%), error:       995.11768, best error:       830.63123 on epoch:    68, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 137.4244079590s, input_fired_time: 1.3879718781, output_fired_time: 1.2198579311, propagate_forward_time: 52.6130027771, propagate_backward_time: 79.4464035034, weight_update_time: 0.1549201906, other_time: 2.7571640015
epoch time: 11.1108961105s, input_fired_time: 0.1739263684, output_fired_time: 0.0000000000, propagate_forward_time: 10.4386901855, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4982795715
validation[          , genome  6578] predictions:    9728/  10000 (97.28%), best:    9746/10000 (97.46%), error:       877.70343, best error:       830.63123 on epoch:    68, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 137.2201080322s, input_fired_time: 1.3599817753, output_fired_time: 1.2160410881, propagate_forward_time: 52.5655403137, propagate_backward_time: 79.3957290649, weight_update_time: 0.1514974982, other_time: 2.6828231812
epoch time: 11.1712074280s, input_fired_time: 0.1723010391, output_fired_time: 0.0000000000, propagate_forward_time: 10.5163288116, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4825773239
validation[          , genome  6578] predictions:    9715/  10000 (97.15%), best:    9746/10000 (97.46%), error:       939.27179, best error:       830.63123 on epoch:    68, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 137.5806121826s, input_fired_time: 1.3655415773, output_fired_time: 1.2235871553, propagate_forward_time: 52.7132225037, propagate_backward_time: 79.5847549438, weight_update_time: 0.1531658471, other_time: 2.6935043335
epoch time: 11.1411676407s, input_fired_time: 0.1717645675, output_fired_time: 0.0000000000, propagate_forward_time: 10.4883632660, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4810400009
validation[          , genome  6578] predictions:    9713/  10000 (97.13%), best:    9746/10000 (97.46%), error:       899.80902, best error:       830.63123 on epoch:    68, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 137.5358428955s, input_fired_time: 1.3666248322, output_fired_time: 1.2236334085, propagate_forward_time: 52.7166328430, propagate_backward_time: 79.5409240723, weight_update_time: 0.1531249732, other_time: 2.6880340576
epoch time: 11.0421514511s, input_fired_time: 0.1700871140, output_fired_time: 0.0000000000, propagate_forward_time: 10.3892812729, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4827833176
validation[          , genome  6578] predictions:    9744/  10000 (97.44%), best:    9746/10000 (97.46%), error:       881.55975, best error:       830.63123 on epoch:    68, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 137.5987701416s, input_fired_time: 1.3924738169, output_fired_time: 1.2215592861, propagate_forward_time: 52.6731147766, propagate_backward_time: 79.5351638794, weight_update_time: 0.1581172645, other_time: 2.7764663696
epoch time: 11.2143402100s, input_fired_time: 0.1739584059, output_fired_time: 0.0000000000, propagate_forward_time: 10.5421695709, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4982118607
validation[          , genome  6578] predictions:    9684/  10000 (96.84%), best:    9746/10000 (97.46%), error:      1032.07666, best error:       830.63123 on epoch:    68, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 137.3834228516s, input_fired_time: 1.3689988852, output_fired_time: 1.2206742764, propagate_forward_time: 52.6124534607, propagate_backward_time: 79.4867706299, weight_update_time: 0.1542778015, other_time: 2.6945190430
epoch time: 11.1607208252s, input_fired_time: 0.1707453728, output_fired_time: 0.0000000000, propagate_forward_time: 10.5077428818, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4822320938
validation[          , genome  6578] predictions:    9710/  10000 (97.10%), best:    9746/10000 (97.46%), error:       934.89160, best error:       830.63123 on epoch:    68, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 138.1607513428s, input_fired_time: 1.4000403881, output_fired_time: 1.2316112518, propagate_forward_time: 52.8303527832, propagate_backward_time: 79.9131240845, weight_update_time: 0.1552696675, other_time: 2.7856216431
epoch time: 11.2376327515s, input_fired_time: 0.1742257327, output_fired_time: 0.0000000000, propagate_forward_time: 10.5654535294, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4979534149
validation[          , genome  6578] predictions:    9710/  10000 (97.10%), best:    9746/10000 (97.46%), error:       922.00824, best error:       830.63123 on epoch:    68, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 137.8250274658s, input_fired_time: 1.3943092823, output_fired_time: 1.2228767872, propagate_forward_time: 52.6671562195, propagate_backward_time: 79.7576599121, weight_update_time: 0.1568270326, other_time: 2.7830352783
epoch time: 11.2490463257s, input_fired_time: 0.1733565480, output_fired_time: 0.0000000000, propagate_forward_time: 10.5764617920, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4992275238
validation[          , genome  6578] predictions:    9733/  10000 (97.33%), best:    9746/10000 (97.46%), error:       860.62823, best error:       830.63123 on epoch:    68, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 137.6918029785s, input_fired_time: 1.3786325455, output_fired_time: 1.2245086432, propagate_forward_time: 52.7318344116, propagate_backward_time: 79.6377563477, weight_update_time: 0.1550869346, other_time: 2.7190780640
epoch time: 11.2624073029s, input_fired_time: 0.1707978845, output_fired_time: 0.0000000000, propagate_forward_time: 10.6083440781, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4832649231
validation[          , genome  6578] predictions:    9740/  10000 (97.40%), best:    9746/10000 (97.46%), error:       843.20532, best error:       830.63123 on epoch:    68, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 137.9721069336s, input_fired_time: 1.3972492218, output_fired_time: 1.2295336723, propagate_forward_time: 52.7306404114, propagate_backward_time: 79.8295440674, weight_update_time: 0.1550979912, other_time: 2.7851409912
epoch time: 11.2978916168s, input_fired_time: 0.1750386804, output_fired_time: 0.0000000000, propagate_forward_time: 10.6213960648, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.5014572144
validation[          , genome  6578] predictions:    9716/  10000 (97.16%), best:    9746/10000 (97.46%), error:       917.32434, best error:       830.63123 on epoch:    68, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 56.0944061279s, input_fired_time: 0.8442021608, output_fired_time: 0.0000000000, propagate_forward_time: 52.7426071167, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5075950623
best training[          , genome  6578] predictions:   49474/  50000 (98.95%), best:    9746/10000 (97.46%), error:      2110.59326, best error:       830.63123 on epoch:    68, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 11.1829452515s, input_fired_time: 0.1664840877, output_fired_time: 0.0000000000, propagate_forward_time: 10.5320940018, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4843673706
   testing[          , genome  6578] predictions:    9770/  10000 (97.70%), best:    9746/10000 (97.46%), error:       758.21643, best error:       830.63123 on epoch:    68, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
09:48:49 (3836): called boinc_finish(0)

</stderr_txt>
]]>