Nameexact_genome_1512568488_45_7150_0
Workunit2606997
Created8 Dec 2017, 0:10:38 UTC
Sent8 Dec 2017, 0:13:11 UTC
Report deadline14 Dec 2017, 0:01:04 UTC
Received8 Dec 2017, 20:17:11 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID38872
Run time2 hours 10 min 47 sec
CPU time2 hours 3 min 33 sec
Validate stateValid
Credit1,497.90
Device peak FLOPS4.61 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size154.06 MB
Peak swap size157.13 MB
Peak disk usage1.78 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3222947121
validation[          , genome  7150] predictions:    9700/  10000 (97.00%), best:    9722/10000 (97.22%), error:      1014.16241, best error:       948.40039 on epoch:    13, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 70.6751937866s, input_fired_time: 0.6266086102, output_fired_time: 0.5850808620, propagate_forward_time: 26.8276138306, propagate_backward_time: 40.6782150269, weight_update_time: 0.1042721048, other_time: 1.9576721191
epoch time: 5.6983528137s, input_fired_time: 0.0779490620, output_fired_time: 0.0000000000, propagate_forward_time: 5.2869606018, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3334431648
validation[          , genome  7150] predictions:    9682/  10000 (96.82%), best:    9722/10000 (97.22%), error:       975.35321, best error:       948.40039 on epoch:    13, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 71.2734603882s, input_fired_time: 0.6325249672, output_fired_time: 0.5837185383, propagate_forward_time: 26.8492050171, propagate_backward_time: 41.3411178589, weight_update_time: 0.1029051617, other_time: 1.8668975830
epoch time: 5.9627938271s, input_fired_time: 0.0826760232, output_fired_time: 0.0000000000, propagate_forward_time: 5.5328087807, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3473091125
validation[          , genome  7150] predictions:    9691/  10000 (96.91%), best:    9722/10000 (97.22%), error:      1003.26105, best error:       948.40039 on epoch:    13, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 70.9954452515s, input_fired_time: 0.6315509081, output_fired_time: 0.5742971301, propagate_forward_time: 26.7876586914, propagate_backward_time: 41.1325187683, weight_update_time: 0.1019134521, other_time: 1.8694190979
epoch time: 5.7573313713s, input_fired_time: 0.0785441175, output_fired_time: 0.0000000000, propagate_forward_time: 5.3601331711, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3186540604
validation[          , genome  7150] predictions:    9707/  10000 (97.07%), best:    9722/10000 (97.22%), error:       969.92072, best error:       948.40039 on epoch:    13, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 71.0486145020s, input_fired_time: 0.6357961297, output_fired_time: 0.5783195496, propagate_forward_time: 26.7591342926, propagate_backward_time: 41.1689529419, weight_update_time: 0.1045867875, other_time: 1.9064178467
epoch time: 5.7692193985s, input_fired_time: 0.0766096860, output_fired_time: 0.0000000000, propagate_forward_time: 5.3638815880, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3287281990
validation[          , genome  7150] predictions:    9716/  10000 (97.16%), best:    9716/10000 (97.16%), error:       904.83521, best error:       904.83521 on epoch:    24, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 70.7203445435s, input_fired_time: 0.6327677965, output_fired_time: 0.5742648840, propagate_forward_time: 26.7685699463, propagate_backward_time: 40.8505973816, weight_update_time: 0.1001154035, other_time: 1.8941459656
epoch time: 5.7754049301s, input_fired_time: 0.0800843239, output_fired_time: 0.0000000000, propagate_forward_time: 5.3610882759, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3342323303
validation[          , genome  7150] predictions:    9698/  10000 (96.98%), best:    9716/10000 (97.16%), error:       973.54462, best error:       904.83521 on epoch:    24, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 71.0429000854s, input_fired_time: 0.6330814958, output_fired_time: 0.5813629627, propagate_forward_time: 27.0735683441, propagate_backward_time: 40.8839454651, weight_update_time: 0.1026974618, other_time: 1.8709449768
epoch time: 5.6987481117s, input_fired_time: 0.0785525367, output_fired_time: 0.0000000000, propagate_forward_time: 5.2734384537, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3467569351
validation[          , genome  7150] predictions:    9709/  10000 (97.09%), best:    9716/10000 (97.16%), error:       930.27295, best error:       904.83521 on epoch:    24, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 70.9310226440s, input_fired_time: 0.6480009556, output_fired_time: 0.5914462805, propagate_forward_time: 26.7693405151, propagate_backward_time: 40.9961700439, weight_update_time: 0.1021969095, other_time: 1.9260635376
epoch time: 5.6799697876s, input_fired_time: 0.0767931566, output_fired_time: 0.0000000000, propagate_forward_time: 5.2805862427, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3225903511
validation[          , genome  7150] predictions:    9737/  10000 (97.37%), best:    9737/10000 (97.37%), error:       827.65662, best error:       827.65662 on epoch:    27, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 71.6167297363s, input_fired_time: 0.6383741498, output_fired_time: 0.5844376683, propagate_forward_time: 27.3727569580, propagate_backward_time: 41.1423950195, weight_update_time: 0.1029754505, other_time: 1.8787689209
epoch time: 5.8066959381s, input_fired_time: 0.0825756490, output_fired_time: 0.0000000000, propagate_forward_time: 5.3776483536, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3464717865
validation[          , genome  7150] predictions:    9720/  10000 (97.20%), best:    9737/10000 (97.37%), error:       980.91052, best error:       827.65662 on epoch:    27, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 70.6336441040s, input_fired_time: 0.6400468349, output_fired_time: 0.5751401186, propagate_forward_time: 26.7972488403, propagate_backward_time: 40.7451972961, weight_update_time: 0.1031012312, other_time: 1.8760108948
epoch time: 5.7748413086s, input_fired_time: 0.0797019005, output_fired_time: 0.0000000000, propagate_forward_time: 5.3671889305, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3279504776
validation[          , genome  7150] predictions:    9671/  10000 (96.71%), best:    9737/10000 (97.37%), error:      1040.73206, best error:       827.65662 on epoch:    27, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 70.7616806030s, input_fired_time: 0.6360241175, output_fired_time: 0.5794444680, propagate_forward_time: 26.7992706299, propagate_backward_time: 40.8561134338, weight_update_time: 0.1008428708, other_time: 1.8908271790
epoch time: 5.7365865707s, input_fired_time: 0.0807885453, output_fired_time: 0.0000000000, propagate_forward_time: 5.3226838112, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3331141472
validation[          , genome  7150] predictions:    9705/  10000 (97.05%), best:    9737/10000 (97.37%), error:       931.21179, best error:       827.65662 on epoch:    27, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 70.9764938354s, input_fired_time: 0.6348567605, output_fired_time: 0.5748980045, propagate_forward_time: 26.8208293915, propagate_backward_time: 41.0824813843, weight_update_time: 0.1034509614, other_time: 1.8634262085
epoch time: 5.7420845032s, input_fired_time: 0.0796880201, output_fired_time: 0.0000000000, propagate_forward_time: 5.3326482773, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3297481537
validation[          , genome  7150] predictions:    9657/  10000 (96.57%), best:    9737/10000 (97.37%), error:      1084.28906, best error:       827.65662 on epoch:    27, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 71.1943130493s, input_fired_time: 0.6362732053, output_fired_time: 0.5904706717, propagate_forward_time: 26.8830299377, propagate_backward_time: 41.1546821594, weight_update_time: 0.1059471592, other_time: 1.9298553467
epoch time: 5.9080004692s, input_fired_time: 0.0784411430, output_fired_time: 0.0000000000, propagate_forward_time: 5.4707679749, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3587913513
validation[          , genome  7150] predictions:    9712/  10000 (97.12%), best:    9737/10000 (97.37%), error:       923.69281, best error:       827.65662 on epoch:    27, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 71.0456008911s, input_fired_time: 0.6352984309, output_fired_time: 0.5776797533, propagate_forward_time: 26.9432716370, propagate_backward_time: 40.9681663513, weight_update_time: 0.1007560343, other_time: 1.9211807251
epoch time: 5.7496519089s, input_fired_time: 0.0793001354, output_fired_time: 0.0000000000, propagate_forward_time: 5.3260440826, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3443078995
validation[          , genome  7150] predictions:    9707/  10000 (97.07%), best:    9737/10000 (97.37%), error:       941.07654, best error:       827.65662 on epoch:    27, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 71.3611602783s, input_fired_time: 0.6767920256, output_fired_time: 0.5809636712, propagate_forward_time: 26.9711608887, propagate_backward_time: 41.2481880188, weight_update_time: 0.1025573462, other_time: 1.8840599060
epoch time: 5.7358636856s, input_fired_time: 0.0806087106, output_fired_time: 0.0000000000, propagate_forward_time: 5.3193845749, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3358702660
validation[          , genome  7150] predictions:    9689/  10000 (96.89%), best:    9737/10000 (97.37%), error:       988.52582, best error:       827.65662 on epoch:    27, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 71.2254333496s, input_fired_time: 0.6346147060, output_fired_time: 0.5775640011, propagate_forward_time: 27.1084117889, propagate_backward_time: 41.0299644470, weight_update_time: 0.1009298116, other_time: 1.8748817444
epoch time: 5.7492384911s, input_fired_time: 0.0799379796, output_fired_time: 0.0000000000, propagate_forward_time: 5.3514819145, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3178186417
validation[          , genome  7150] predictions:    9669/  10000 (96.69%), best:    9737/10000 (97.37%), error:      1139.81897, best error:       827.65662 on epoch:    27, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 70.7347793579s, input_fired_time: 0.6328917742, output_fired_time: 0.5702989101, propagate_forward_time: 26.8281040192, propagate_backward_time: 40.8350982666, weight_update_time: 0.1009286642, other_time: 1.8683929443
epoch time: 5.7225565910s, input_fired_time: 0.0772542208, output_fired_time: 0.0000000000, propagate_forward_time: 5.3131589890, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3321433067
validation[          , genome  7150] predictions:    9691/  10000 (96.91%), best:    9737/10000 (97.37%), error:      1001.67487, best error:       827.65662 on epoch:    27, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 69.9882888794s, input_fired_time: 0.6426201463, output_fired_time: 0.5725518465, propagate_forward_time: 26.3808937073, propagate_backward_time: 40.5125045776, weight_update_time: 0.1031616032, other_time: 1.8797111511
epoch time: 5.7209458351s, input_fired_time: 0.0793329328, output_fired_time: 0.0000000000, propagate_forward_time: 5.3168296814, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3247833252
validation[          , genome  7150] predictions:    9722/  10000 (97.22%), best:    9737/10000 (97.37%), error:       927.54523, best error:       827.65662 on epoch:    27, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 70.0784606934s, input_fired_time: 0.6645437479, output_fired_time: 0.5834783912, propagate_forward_time: 26.4965305328, propagate_backward_time: 40.4771881104, weight_update_time: 0.0984291956, other_time: 1.8567199707
epoch time: 5.3003706932s, input_fired_time: 0.0776729062, output_fired_time: 0.0000000000, propagate_forward_time: 4.8691740036, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3535237312
validation[          , genome  7150] predictions:    9735/  10000 (97.35%), best:    9735/10000 (97.35%), error:       807.12170, best error:       807.12170 on epoch:    38, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 68.6175079346s, input_fired_time: 0.6835871935, output_fired_time: 0.5795732737, propagate_forward_time: 25.3511886597, propagate_backward_time: 39.9976577759, weight_update_time: 0.1040101796, other_time: 2.0055007935
epoch time: 5.7114658356s, input_fired_time: 0.1174293980, output_fired_time: 0.0000000000, propagate_forward_time: 5.2415442467, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3524923325
validation[          , genome  7150] predictions:    9692/  10000 (96.92%), best:    9735/10000 (97.35%), error:       968.95026, best error:       807.12170 on epoch:    38, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 69.1847534180s, input_fired_time: 0.6369131207, output_fired_time: 0.5625547767, propagate_forward_time: 26.3011913300, propagate_backward_time: 39.8785972595, weight_update_time: 0.0985132679, other_time: 1.8055000305
epoch time: 5.5312380791s, input_fired_time: 0.0768054724, output_fired_time: 0.0000000000, propagate_forward_time: 5.1436882019, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3107442856
validation[          , genome  7150] predictions:    9678/  10000 (96.78%), best:    9735/10000 (97.35%), error:      1030.64636, best error:       807.12170 on epoch:    38, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 70.8681030273s, input_fired_time: 0.6348608136, output_fired_time: 0.5868939757, propagate_forward_time: 26.9645595551, propagate_backward_time: 40.7802925110, weight_update_time: 0.1028577015, other_time: 1.9015007019
epoch time: 5.8084511757s, input_fired_time: 0.0804225951, output_fired_time: 0.0000000000, propagate_forward_time: 5.4058461189, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3221826553
validation[          , genome  7150] predictions:    9739/  10000 (97.39%), best:    9735/10000 (97.35%), error:       919.91339, best error:       807.12170 on epoch:    38, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 70.8435821533s, input_fired_time: 0.6379863620, output_fired_time: 0.5912328959, propagate_forward_time: 26.9129314423, propagate_backward_time: 40.8172683716, weight_update_time: 0.1032418609, other_time: 1.8841629028
epoch time: 5.4462604523s, input_fired_time: 0.0772927627, output_fired_time: 0.0000000000, propagate_forward_time: 5.0631418228, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3058257103
validation[          , genome  7150] predictions:    9688/  10000 (96.88%), best:    9735/10000 (97.35%), error:      1072.00903, best error:       807.12170 on epoch:    38, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 70.4592590332s, input_fired_time: 0.6354621649, output_fired_time: 0.5739924312, propagate_forward_time: 26.8148918152, propagate_backward_time: 40.6114006042, weight_update_time: 0.1001449600, other_time: 1.8235168457
epoch time: 5.7372102737s, input_fired_time: 0.0797675177, output_fired_time: 0.0000000000, propagate_forward_time: 5.3435282707, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3139142990
validation[          , genome  7150] predictions:    9711/  10000 (97.11%), best:    9735/10000 (97.35%), error:       921.80811, best error:       807.12170 on epoch:    38, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 69.9392471313s, input_fired_time: 0.6307513714, output_fired_time: 0.5695086718, propagate_forward_time: 26.7360820770, propagate_backward_time: 40.1608810425, weight_update_time: 0.0991561189, other_time: 1.8420181274
epoch time: 5.7052888870s, input_fired_time: 0.0799840763, output_fired_time: 0.0000000000, propagate_forward_time: 5.3039903641, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3213143349
validation[          , genome  7150] predictions:    9748/  10000 (97.48%), best:    9735/10000 (97.35%), error:       820.72260, best error:       807.12170 on epoch:    38, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 69.3747634888s, input_fired_time: 0.6282325387, output_fired_time: 0.5668713450, propagate_forward_time: 26.2329101563, propagate_backward_time: 40.1197853088, weight_update_time: 0.0974206850, other_time: 1.8269615173
epoch time: 5.7139596939s, input_fired_time: 0.0790787339, output_fired_time: 0.0000000000, propagate_forward_time: 5.3074188232, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3274621964
validation[          , genome  7150] predictions:    9679/  10000 (96.79%), best:    9735/10000 (97.35%), error:       952.86719, best error:       807.12170 on epoch:    38, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 70.3384170532s, input_fired_time: 0.6674758792, output_fired_time: 0.5818662047, propagate_forward_time: 26.4215564728, propagate_backward_time: 40.7664985657, weight_update_time: 0.1021447480, other_time: 1.9010276794
epoch time: 5.6160545349s, input_fired_time: 0.0856438205, output_fired_time: 0.0000000000, propagate_forward_time: 5.1833710670, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3470396996
validation[          , genome  7150] predictions:    9551/  10000 (95.51%), best:    9735/10000 (97.35%), error:      1344.76465, best error:       807.12170 on epoch:    38, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 68.3994293213s, input_fired_time: 0.7044099569, output_fired_time: 0.5952927470, propagate_forward_time: 25.2507305145, propagate_backward_time: 39.8939056396, weight_update_time: 0.1036114767, other_time: 1.9550933838
epoch time: 5.6076917648s, input_fired_time: 0.0831560567, output_fired_time: 0.0000000000, propagate_forward_time: 5.1456518173, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3788838387
validation[          , genome  7150] predictions:    9686/  10000 (96.86%), best:    9735/10000 (97.35%), error:       953.90912, best error:       807.12170 on epoch:    38, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 67.9131240845s, input_fired_time: 0.6862632036, output_fired_time: 0.5645666718, propagate_forward_time: 24.9937801361, propagate_backward_time: 39.6652412415, weight_update_time: 0.1013017818, other_time: 2.0032691956
epoch time: 5.1577405930s, input_fired_time: 0.0840261206, output_fired_time: 0.0000000000, propagate_forward_time: 4.7292776108, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3444366455
validation[          , genome  7150] predictions:    9736/  10000 (97.36%), best:    9735/10000 (97.35%), error:       853.46228, best error:       807.12170 on epoch:    38, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 64.2663497925s, input_fired_time: 0.6729995012, output_fired_time: 0.5355016589, propagate_forward_time: 23.4502830505, propagate_backward_time: 37.6934509277, weight_update_time: 0.0975792184, other_time: 1.9141120911
epoch time: 5.3262162209s, input_fired_time: 0.1001878902, output_fired_time: 0.0000000000, propagate_forward_time: 4.8823385239, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3436899185
validation[          , genome  7150] predictions:    9711/  10000 (97.11%), best:    9735/10000 (97.35%), error:       942.30023, best error:       807.12170 on epoch:    38, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 68.9244537354s, input_fired_time: 0.6513968110, output_fired_time: 0.6307886243, propagate_forward_time: 25.7666454315, propagate_backward_time: 39.9664344788, weight_update_time: 0.1029515415, other_time: 1.9091835022
epoch time: 5.7374358177s, input_fired_time: 0.0805521011, output_fired_time: 0.0000000000, propagate_forward_time: 5.3258895874, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3309941292
validation[          , genome  7150] predictions:    9682/  10000 (96.82%), best:    9735/10000 (97.35%), error:      1046.39514, best error:       807.12170 on epoch:    38, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 70.6327667236s, input_fired_time: 0.6323609352, output_fired_time: 0.5788016319, propagate_forward_time: 26.8212032318, propagate_backward_time: 40.7007522583, weight_update_time: 0.1019032001, other_time: 1.8996429443
epoch time: 5.8610954285s, input_fired_time: 0.0810716152, output_fired_time: 0.0000000000, propagate_forward_time: 5.4390068054, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3410167694
validation[          , genome  7150] predictions:    9686/  10000 (96.86%), best:    9735/10000 (97.35%), error:       954.99176, best error:       807.12170 on epoch:    38, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 70.3746490479s, input_fired_time: 0.6396663189, output_fired_time: 0.5885850787, propagate_forward_time: 26.6458396912, propagate_backward_time: 40.5953445435, weight_update_time: 0.1052064970, other_time: 1.9052162170
epoch time: 6.3896837234s, input_fired_time: 0.0904611349, output_fired_time: 0.0000000000, propagate_forward_time: 5.9270257950, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3721966743
validation[          , genome  7150] predictions:    9718/  10000 (97.18%), best:    9735/10000 (97.35%), error:       871.47821, best error:       807.12170 on epoch:    38, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 77.0203628540s, input_fired_time: 0.6896705031, output_fired_time: 0.6285790205, propagate_forward_time: 29.3005256653, propagate_backward_time: 44.3473396301, weight_update_time: 0.1082983837, other_time: 2.0542526245
epoch time: 6.2838339806s, input_fired_time: 0.0903731436, output_fired_time: 0.0000000000, propagate_forward_time: 5.8162202835, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3772406578
validation[          , genome  7150] predictions:    9751/  10000 (97.51%), best:    9735/10000 (97.35%), error:       819.78888, best error:       807.12170 on epoch:    38, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 72.6467514038s, input_fired_time: 0.6814081073, output_fired_time: 0.6040775776, propagate_forward_time: 27.6569862366, propagate_backward_time: 41.7445487976, weight_update_time: 0.1073911786, other_time: 1.9597244263
epoch time: 5.7902784348s, input_fired_time: 0.0816492587, output_fired_time: 0.0000000000, propagate_forward_time: 5.3781547546, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3304743767
validation[          , genome  7150] predictions:    9729/  10000 (97.29%), best:    9735/10000 (97.35%), error:       868.13068, best error:       807.12170 on epoch:    38, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 69.6086349487s, input_fired_time: 0.6363515258, output_fired_time: 0.5838257670, propagate_forward_time: 26.3762264252, propagate_backward_time: 40.1149749756, weight_update_time: 0.1035606265, other_time: 1.8972549438
epoch time: 5.5301556587s, input_fired_time: 0.0794188082, output_fired_time: 0.0000000000, propagate_forward_time: 5.1311426163, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3195943832
validation[          , genome  7150] predictions:    9742/  10000 (97.42%), best:    9735/10000 (97.35%), error:       859.29108, best error:       807.12170 on epoch:    38, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 67.9205322266s, input_fired_time: 0.6309323311, output_fired_time: 0.5512411594, propagate_forward_time: 25.5973720551, propagate_backward_time: 39.3502769470, weight_update_time: 0.0955480486, other_time: 1.7907066345
epoch time: 5.8584051132s, input_fired_time: 0.0834994540, output_fired_time: 0.0000000000, propagate_forward_time: 5.4330158234, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3418898582
validation[          , genome  7150] predictions:    9746/  10000 (97.46%), best:    9735/10000 (97.35%), error:       854.32251, best error:       807.12170 on epoch:    38, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 71.8165817261s, input_fired_time: 0.6364478469, output_fired_time: 0.5759258866, propagate_forward_time: 27.3016452789, propagate_backward_time: 41.4607658386, weight_update_time: 0.1003192738, other_time: 1.8418006897
epoch time: 5.9836320877s, input_fired_time: 0.0911131501, output_fired_time: 0.0000000000, propagate_forward_time: 5.5663094521, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3262095451
validation[          , genome  7150] predictions:    9758/  10000 (97.58%), best:    9735/10000 (97.35%), error:       814.41504, best error:       807.12170 on epoch:    38, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 75.0444564819s, input_fired_time: 0.8710421324, output_fired_time: 0.6144449711, propagate_forward_time: 28.3819942474, propagate_backward_time: 43.3255157471, weight_update_time: 0.1003063023, other_time: 1.8514556885
epoch time: 6.1647353172s, input_fired_time: 0.0815962628, output_fired_time: 0.0000000000, propagate_forward_time: 5.7633175850, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3198213577
validation[          , genome  7150] predictions:    9727/  10000 (97.27%), best:    9735/10000 (97.35%), error:       894.23218, best error:       807.12170 on epoch:    38, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 74.9898605347s, input_fired_time: 0.6367728710, output_fired_time: 0.6238141060, propagate_forward_time: 28.2631130219, propagate_backward_time: 43.4181900024, weight_update_time: 0.1016480625, other_time: 2.0479660034
epoch time: 6.3593158722s, input_fired_time: 0.0812336355, output_fired_time: 0.0000000000, propagate_forward_time: 5.9370856285, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3409967422
validation[          , genome  7150] predictions:    9716/  10000 (97.16%), best:    9735/10000 (97.35%), error:       908.46979, best error:       807.12170 on epoch:    38, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 76.5134811401s, input_fired_time: 0.6971929669, output_fired_time: 0.6047881842, propagate_forward_time: 28.9195098877, propagate_backward_time: 44.1783027649, weight_update_time: 0.1017384678, other_time: 2.1136894226
epoch time: 6.1133308411s, input_fired_time: 0.0823642612, output_fired_time: 0.0000000000, propagate_forward_time: 5.7005505562, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3304162025
validation[          , genome  7150] predictions:    9707/  10000 (97.07%), best:    9735/10000 (97.35%), error:       966.29706, best error:       807.12170 on epoch:    38, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 74.1381683350s, input_fired_time: 0.6388034225, output_fired_time: 0.5857875347, propagate_forward_time: 28.0921268463, propagate_backward_time: 42.8373031616, weight_update_time: 0.1029239148, other_time: 1.9841537476
epoch time: 7.0061855316s, input_fired_time: 0.0858214796, output_fired_time: 0.0000000000, propagate_forward_time: 6.4344549179, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.4859089851
validation[          , genome  7150] predictions:    9739/  10000 (97.39%), best:    9735/10000 (97.35%), error:       882.13641, best error:       807.12170 on epoch:    38, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 71.5258026123s, input_fired_time: 0.6558043957, output_fired_time: 0.5939581394, propagate_forward_time: 27.0996074677, propagate_backward_time: 41.2420921326, weight_update_time: 0.1026691496, other_time: 1.9343376160
epoch time: 6.0542116165s, input_fired_time: 0.0911580175, output_fired_time: 0.0000000000, propagate_forward_time: 5.6038899422, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3591637611
validation[          , genome  7150] predictions:    9733/  10000 (97.33%), best:    9735/10000 (97.35%), error:       876.14465, best error:       807.12170 on epoch:    38, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 73.6315078735s, input_fired_time: 0.6650323868, output_fired_time: 0.6027200222, propagate_forward_time: 27.9985523224, propagate_backward_time: 42.4087104797, weight_update_time: 0.1069530696, other_time: 1.9564933777
epoch time: 5.6961469650s, input_fired_time: 0.0822597295, output_fired_time: 0.0000000000, propagate_forward_time: 5.2731289864, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3407583237
validation[          , genome  7150] predictions:    9724/  10000 (97.24%), best:    9735/10000 (97.35%), error:       825.12744, best error:       807.12170 on epoch:    38, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 73.1233520508s, input_fired_time: 0.6684329510, output_fired_time: 0.6005998850, propagate_forward_time: 27.6650257111, propagate_backward_time: 42.2358589172, weight_update_time: 0.1110912636, other_time: 1.9534339905
epoch time: 6.4788084030s, input_fired_time: 0.0902578533, output_fired_time: 0.0000000000, propagate_forward_time: 6.0099954605, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3785552979
validation[          , genome  7150] predictions:    9766/  10000 (97.66%), best:    9766/10000 (97.66%), error:       783.36823, best error:       783.36823 on epoch:    64, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 83.7233276367s, input_fired_time: 0.7592274547, output_fired_time: 0.6615150571, propagate_forward_time: 31.3953247070, propagate_backward_time: 48.6338233948, weight_update_time: 0.1076729447, other_time: 2.2734413147
epoch time: 6.1804084778s, input_fired_time: 0.0877246335, output_fired_time: 0.0000000000, propagate_forward_time: 5.7386999130, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3539838791
validation[          , genome  7150] predictions:    9695/  10000 (96.95%), best:    9766/10000 (97.66%), error:       918.03137, best error:       783.36823 on epoch:    64, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 74.1391906738s, input_fired_time: 0.6758180857, output_fired_time: 0.6046153903, propagate_forward_time: 27.9878673553, propagate_backward_time: 42.8899421692, weight_update_time: 0.1082342118, other_time: 1.9809455872
epoch time: 6.1025047302s, input_fired_time: 0.0849824026, output_fired_time: 0.0000000000, propagate_forward_time: 5.6455264091, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3719959259
validation[          , genome  7150] predictions:    9702/  10000 (97.02%), best:    9766/10000 (97.66%), error:       941.58856, best error:       783.36823 on epoch:    64, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 75.0084381104s, input_fired_time: 0.6571191549, output_fired_time: 0.6290868521, propagate_forward_time: 27.8013477325, propagate_backward_time: 43.7733078003, weight_update_time: 0.3067171276, other_time: 2.1475753784
epoch time: 6.1013002396s, input_fired_time: 0.0882983506, output_fired_time: 0.0000000000, propagate_forward_time: 5.6535534859, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3594484329
validation[          , genome  7150] predictions:    9745/  10000 (97.45%), best:    9766/10000 (97.66%), error:       892.54291, best error:       783.36823 on epoch:    64, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 73.2187118530s, input_fired_time: 0.6646156311, output_fired_time: 0.5991277695, propagate_forward_time: 27.6757164001, propagate_backward_time: 42.3317642212, weight_update_time: 0.1023109257, other_time: 1.9474830627
epoch time: 5.7481651306s, input_fired_time: 0.0826320648, output_fired_time: 0.0000000000, propagate_forward_time: 5.3310518265, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3344812393
validation[          , genome  7150] predictions:    9759/  10000 (97.59%), best:    9766/10000 (97.66%), error:       815.50244, best error:       783.36823 on epoch:    64, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 70.1486511230s, input_fired_time: 0.6422215104, output_fired_time: 0.5832258463, propagate_forward_time: 26.6121196747, propagate_backward_time: 40.4311103821, weight_update_time: 0.1025000140, other_time: 1.8799705505
epoch time: 5.8190312386s, input_fired_time: 0.0821741968, output_fired_time: 0.0000000000, propagate_forward_time: 5.3986654282, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3381915092
validation[          , genome  7150] predictions:    9754/  10000 (97.54%), best:    9766/10000 (97.66%), error:       814.31317, best error:       783.36823 on epoch:    64, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 71.5524749756s, input_fired_time: 0.6383277774, output_fired_time: 0.5940810442, propagate_forward_time: 27.1431789398, propagate_backward_time: 41.2847671509, weight_update_time: 0.1021700054, other_time: 1.8921203613
epoch time: 5.8159594536s, input_fired_time: 0.0811673775, output_fired_time: 0.0000000000, propagate_forward_time: 5.4076542854, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3271379471
validation[          , genome  7150] predictions:    9753/  10000 (97.53%), best:    9766/10000 (97.66%), error:       789.48737, best error:       783.36823 on epoch:    64, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 71.1718368530s, input_fired_time: 0.6305334568, output_fired_time: 0.5704054236, propagate_forward_time: 27.1492309570, propagate_backward_time: 40.9808273315, weight_update_time: 0.1005482376, other_time: 1.8408432007
epoch time: 5.7427701950s, input_fired_time: 0.0814773366, output_fired_time: 0.0000000000, propagate_forward_time: 5.3297381401, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3315548897
validation[          , genome  7150] predictions:    9703/  10000 (97.03%), best:    9766/10000 (97.66%), error:       998.34222, best error:       783.36823 on epoch:    64, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 67.8226013184s, input_fired_time: 0.6244289279, output_fired_time: 0.5621185303, propagate_forward_time: 25.5805110931, propagate_backward_time: 39.2181205750, weight_update_time: 0.0995415971, other_time: 1.8374214172
epoch time: 5.3959903717s, input_fired_time: 0.0781607330, output_fired_time: 0.0000000000, propagate_forward_time: 5.0031375885, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3146920204
validation[          , genome  7150] predictions:    9688/  10000 (96.88%), best:    9766/10000 (97.66%), error:       995.99304, best error:       783.36823 on epoch:    64, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 67.2848205566s, input_fired_time: 0.6216989756, output_fired_time: 0.5543755889, propagate_forward_time: 25.3757343292, propagate_backward_time: 38.9173049927, weight_update_time: 0.1005267575, other_time: 1.8157119751
epoch time: 5.8803777695s, input_fired_time: 0.1124903634, output_fired_time: 0.0000000000, propagate_forward_time: 5.4462537766, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3216338158
validation[          , genome  7150] predictions:    9729/  10000 (97.29%), best:    9766/10000 (97.66%), error:       864.67560, best error:       783.36823 on epoch:    64, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 68.0387191772s, input_fired_time: 0.6226069927, output_fired_time: 0.5591538548, propagate_forward_time: 25.7293148041, propagate_backward_time: 39.3169479370, weight_update_time: 0.0977248996, other_time: 1.8106994629
epoch time: 5.3732180595s, input_fired_time: 0.0786763504, output_fired_time: 0.0000000000, propagate_forward_time: 4.9767408371, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3178009987
validation[          , genome  7150] predictions:    9739/  10000 (97.39%), best:    9766/10000 (97.66%), error:       879.08350, best error:       783.36823 on epoch:    64, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 67.9285202026s, input_fired_time: 0.6321660280, output_fired_time: 0.5686434507, propagate_forward_time: 25.6683559418, propagate_backward_time: 39.2074470520, weight_update_time: 0.1026840582, other_time: 1.8519096375
epoch time: 6.1911602020s, input_fired_time: 0.0847251937, output_fired_time: 0.0000000000, propagate_forward_time: 5.7606301308, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3458046913
validation[          , genome  7150] predictions:    9731/  10000 (97.31%), best:    9766/10000 (97.66%), error:       868.05853, best error:       783.36823 on epoch:    64, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 74.3496856689s, input_fired_time: 0.6708784103, output_fired_time: 0.6085327864, propagate_forward_time: 28.1690406799, propagate_backward_time: 42.9285888672, weight_update_time: 0.1088155136, other_time: 1.9726448059
epoch time: 6.1146841049s, input_fired_time: 0.0917609930, output_fired_time: 0.0000000000, propagate_forward_time: 5.6553635597, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3675594330
validation[          , genome  7150] predictions:    9745/  10000 (97.45%), best:    9766/10000 (97.66%), error:       830.12305, best error:       783.36823 on epoch:    64, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 71.3436050415s, input_fired_time: 0.6542147994, output_fired_time: 0.5890797973, propagate_forward_time: 26.9719448090, propagate_backward_time: 41.2330589294, weight_update_time: 0.1023128256, other_time: 1.8953056335
epoch time: 5.7385792732s, input_fired_time: 0.0811342895, output_fired_time: 0.0000000000, propagate_forward_time: 5.3276739120, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3297710419
validation[          , genome  7150] predictions:    9733/  10000 (97.33%), best:    9766/10000 (97.66%), error:       882.11151, best error:       783.36823 on epoch:    64, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 72.8710479736s, input_fired_time: 0.6612780690, output_fired_time: 0.5978147388, propagate_forward_time: 27.5784072876, propagate_backward_time: 42.1151771545, weight_update_time: 0.1036518961, other_time: 1.9183692932
epoch time: 5.7338371277s, input_fired_time: 0.0820377469, output_fired_time: 0.0000000000, propagate_forward_time: 5.3271927834, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3246064186
validation[          , genome  7150] predictions:    9752/  10000 (97.52%), best:    9766/10000 (97.66%), error:       785.97894, best error:       783.36823 on epoch:    64, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 70.5528793335s, input_fired_time: 0.6432098150, output_fired_time: 0.5808178186, propagate_forward_time: 26.7190628052, propagate_backward_time: 40.7286224365, weight_update_time: 0.1026696861, other_time: 1.8811645508
epoch time: 5.6672382355s, input_fired_time: 0.0812511146, output_fired_time: 0.0000000000, propagate_forward_time: 5.2565736771, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3294134140
validation[          , genome  7150] predictions:    9683/  10000 (96.83%), best:    9766/10000 (97.66%), error:      1023.44775, best error:       783.36823 on epoch:    64, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 69.0243148804s, input_fired_time: 0.6375933886, output_fired_time: 0.5647486448, propagate_forward_time: 26.1279582977, propagate_backward_time: 39.8505401611, weight_update_time: 0.1013207436, other_time: 1.8434677124
epoch time: 5.5608181953s, input_fired_time: 0.0809707418, output_fired_time: 0.0000000000, propagate_forward_time: 5.1549053192, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3249421120
validation[          , genome  7150] predictions:    9718/  10000 (97.18%), best:    9766/10000 (97.66%), error:       913.06470, best error:       783.36823 on epoch:    64, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 69.3443069458s, input_fired_time: 0.6344886422, output_fired_time: 0.5712913275, propagate_forward_time: 26.2972965240, propagate_backward_time: 39.9927253723, weight_update_time: 0.1003651023, other_time: 1.8485069275
epoch time: 5.5448184013s, input_fired_time: 0.0806322098, output_fired_time: 0.0000000000, propagate_forward_time: 5.1355886459, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3285975456
validation[          , genome  7150] predictions:    9778/  10000 (97.78%), best:    9778/10000 (97.78%), error:       760.63470, best error:       760.63470 on epoch:    81, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 69.1946182251s, input_fired_time: 0.6371654868, output_fired_time: 0.5668527484, propagate_forward_time: 26.2159843445, propagate_backward_time: 39.9406013489, weight_update_time: 0.1008945405, other_time: 1.8340072632
epoch time: 5.5717110634s, input_fired_time: 0.0811298117, output_fired_time: 0.0000000000, propagate_forward_time: 5.1565232277, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3340578079
validation[          , genome  7150] predictions:    9754/  10000 (97.54%), best:    9778/10000 (97.78%), error:       790.22180, best error:       760.63470 on epoch:    81, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 69.6647491455s, input_fired_time: 0.6391414404, output_fired_time: 0.5686568618, propagate_forward_time: 26.3914451599, propagate_backward_time: 40.2218551636, weight_update_time: 0.1002295464, other_time: 1.8436470032
epoch time: 5.7453446388s, input_fired_time: 0.0828506872, output_fired_time: 0.0000000000, propagate_forward_time: 5.3371572495, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3253369331
validation[          , genome  7150] predictions:    9729/  10000 (97.29%), best:    9778/10000 (97.78%), error:       864.57294, best error:       760.63470 on epoch:    81, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 70.1942520142s, input_fired_time: 0.6415404677, output_fired_time: 0.5755221248, propagate_forward_time: 26.5861225128, propagate_backward_time: 40.5127143860, weight_update_time: 0.1015394628, other_time: 1.8783531189
epoch time: 5.7085847855s, input_fired_time: 0.0839012191, output_fired_time: 0.0000000000, propagate_forward_time: 5.2946462631, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3300371170
validation[          , genome  7150] predictions:    9690/  10000 (96.90%), best:    9778/10000 (97.78%), error:       919.22650, best error:       760.63470 on epoch:    81, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 69.5955505371s, input_fired_time: 0.6387015581, output_fired_time: 0.5734193325, propagate_forward_time: 26.4013252258, propagate_backward_time: 40.1402854919, weight_update_time: 0.1012794301, other_time: 1.8418197632
epoch time: 5.5920286179s, input_fired_time: 0.0804969594, output_fired_time: 0.0000000000, propagate_forward_time: 5.1860823631, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3254494667
validation[          , genome  7150] predictions:    9742/  10000 (97.42%), best:    9778/10000 (97.78%), error:       848.30212, best error:       760.63470 on epoch:    81, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 69.2832412720s, input_fired_time: 0.6377311945, output_fired_time: 0.5718216896, propagate_forward_time: 26.2720489502, propagate_backward_time: 39.9559631348, weight_update_time: 0.1025775895, other_time: 1.8456726074
epoch time: 5.7115793228s, input_fired_time: 0.0822224542, output_fired_time: 0.0000000000, propagate_forward_time: 5.2965493202, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3328075409
validation[          , genome  7150] predictions:    9744/  10000 (97.44%), best:    9778/10000 (97.78%), error:       830.86505, best error:       760.63470 on epoch:    81, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 68.9157562256s, input_fired_time: 0.6354807615, output_fired_time: 0.5693306327, propagate_forward_time: 26.1510238647, propagate_backward_time: 39.7207641602, weight_update_time: 0.1018501520, other_time: 1.8391571045
epoch time: 5.6810154915s, input_fired_time: 0.0830789804, output_fired_time: 0.0000000000, propagate_forward_time: 5.2572932243, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3406434059
validation[          , genome  7150] predictions:    9761/  10000 (97.61%), best:    9778/10000 (97.78%), error:       801.78333, best error:       760.63470 on epoch:    81, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 69.3494186401s, input_fired_time: 0.6396516562, output_fired_time: 0.5744484663, propagate_forward_time: 26.2992038727, propagate_backward_time: 39.9924430847, weight_update_time: 0.1006834060, other_time: 1.8436775208
epoch time: 5.7047333717s, input_fired_time: 0.0824034363, output_fired_time: 0.0000000000, propagate_forward_time: 5.2907395363, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3315901756
validation[          , genome  7150] predictions:    9755/  10000 (97.55%), best:    9778/10000 (97.78%), error:       799.35303, best error:       760.63470 on epoch:    81, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 69.8475494385s, input_fired_time: 0.6436281204, output_fired_time: 0.5743284225, propagate_forward_time: 26.4918804169, propagate_backward_time: 40.2910995483, weight_update_time: 0.1012523025, other_time: 1.8466110229
epoch time: 5.7655010223s, input_fired_time: 0.0837602317, output_fired_time: 0.0000000000, propagate_forward_time: 5.3568387032, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3249020576
validation[          , genome  7150] predictions:    9756/  10000 (97.56%), best:    9778/10000 (97.78%), error:       815.06158, best error:       760.63470 on epoch:    81, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 69.9021606445s, input_fired_time: 0.6445520520, output_fired_time: 0.5782552958, propagate_forward_time: 26.4862213135, propagate_backward_time: 40.3326187134, weight_update_time: 0.1047031954, other_time: 1.8605117798
epoch time: 5.6277384758s, input_fired_time: 0.0812420994, output_fired_time: 0.0000000000, propagate_forward_time: 5.2189435959, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3275527954
validation[          , genome  7150] predictions:    9752/  10000 (97.52%), best:    9778/10000 (97.78%), error:       819.86700, best error:       760.63470 on epoch:    81, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 68.7793045044s, input_fired_time: 0.6381351352, output_fired_time: 0.5656733513, propagate_forward_time: 26.0507678986, propagate_backward_time: 39.6848335266, weight_update_time: 0.1001033485, other_time: 1.8398933411
epoch time: 5.6469163895s, input_fired_time: 0.0823393017, output_fired_time: 0.0000000000, propagate_forward_time: 5.2382054329, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3263716698
validation[          , genome  7150] predictions:    9733/  10000 (97.33%), best:    9778/10000 (97.78%), error:       817.18793, best error:       760.63470 on epoch:    81, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 68.9459381104s, input_fired_time: 0.6379992962, output_fired_time: 0.5670028925, propagate_forward_time: 26.0520324707, propagate_backward_time: 39.8345870972, weight_update_time: 0.1017128900, other_time: 1.8543167114
epoch time: 5.6101422310s, input_fired_time: 0.0830925703, output_fired_time: 0.0000000000, propagate_forward_time: 5.1966476440, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3304018974
validation[          , genome  7150] predictions:    9739/  10000 (97.39%), best:    9778/10000 (97.78%), error:       837.56525, best error:       760.63470 on epoch:    81, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/mnist_training_50k.bin'
boincified validation filename: '../../projects/csgrid.org_csg/mnist_validation_10k.bin'
boincified testing filename: '../../projects/csgrid.org_csg/mnist_testing_new.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1512568488_45_7150.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1512568488_45_7150_0_r1297335145_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.985846
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.000105975
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 4.23901e-06
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 93
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 81
read number_validation_images: 10000
read best_validation_predictions: 9778
read best_validation_error: 760.635
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 7150
read normal distribution: '1 0 0'
generator_str: '694921860'
read generator: 694921860
read generated_by_map:
1 disable_edge 1
reading 20 nodes.
reading 43 edges.
number input nodes: 1
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 4923 images.
reading image set with 5742 images.
reading image set with 4958 images.
reading image set with 5131 images.
reading image set with 4842 images.
reading image set with 4421 images.
reading image set with 4918 images.
reading image set with 5265 images.
reading image set with 4851 images.
reading image set with 4949 images.
image_size: 1x28x28 = 784
read 50000 images.
    class    0: 4923
    class    1: 5742
    class    2: 4958
    class    3: 5131
    class    4: 4842
    class    5: 4421
    class    6: 4918
    class    7: 5265
    class    8: 4851
    class    9: 4949
calculating averages and standard deviations for images
average pixel value for channel 0: 0.130530551075935
pixel variance for channel 0: 0.0948646068572998
pixel standard deviation for channel 0: 0.308000981807709
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 1x28x28 = 784
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 980 images.
reading image set with 1135 images.
reading image set with 1032 images.
reading image set with 1010 images.
reading image set with 982 images.
reading image set with 892 images.
reading image set with 958 images.
reading image set with 1028 images.
reading image set with 974 images.
reading image set with 1009 images.
image_size: 1x28x28 = 784
read 10000 images.
    class    0: 980
    class    1: 1135
    class    2: 1032
    class    3: 1010
    class    4: 982
    class    5: 892
    class    6: 958
    class    7: 1028
    class    8: 974
    class    9: 1009
loaded images
starting backpropagation!
epoch time: 70.0951538085938s, input_fired_time: 0.648725628852844, output_fired_time: 0.572008550167084, propagate_forward_time: 26.5489921569824, propagate_backward_time: 40.4788856506348, weight_update_time: 0.103828884661198, other_time: 1.84654235839844
epoch time: 5.81734132766724s, input_fired_time: 0.0842520743608475, output_fired_time: 0, propagate_forward_time: 5.41658687591553, propagate_backward_time: 0, weight_update_time: 0, other_time: 0.316502571105957
validation[          , genome  7150] predictions:    9740/  10000 (97.40%), best:    9778/10000 (97.78%), error:       861.77606, best error:       760.63470 on epoch:    81, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 70.4703674316s, input_fired_time: 0.6473227739, output_fired_time: 0.5751699209, propagate_forward_time: 26.7626094818, propagate_backward_time: 40.6343421936, weight_update_time: 0.1038298756, other_time: 1.8509178162
epoch time: 5.8564896584s, input_fired_time: 0.0841749609, output_fired_time: 0.0000000000, propagate_forward_time: 5.4349136353, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3374009132
validation[          , genome  7150] predictions:    9740/  10000 (97.40%), best:    9778/10000 (97.78%), error:       838.28461, best error:       760.63470 on epoch:    81, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 70.4582061768s, input_fired_time: 0.6443799138, output_fired_time: 0.5796694160, propagate_forward_time: 26.6986503601, propagate_backward_time: 40.6818809509, weight_update_time: 0.1030497253, other_time: 1.8536300659
epoch time: 5.8821692467s, input_fired_time: 0.0893177986, output_fired_time: 0.0000000000, propagate_forward_time: 5.4589424133, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3339090347
validation[          , genome  7150] predictions:    9715/  10000 (97.15%), best:    9778/10000 (97.78%), error:       965.35950, best error:       760.63470 on epoch:    81, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 70.3212280273s, input_fired_time: 0.6456890106, output_fired_time: 0.5742115974, propagate_forward_time: 26.7200813293, propagate_backward_time: 40.5581817627, weight_update_time: 0.1021754295, other_time: 1.8230628967
epoch time: 5.6438493729s, input_fired_time: 0.0824338794, output_fired_time: 0.0000000000, propagate_forward_time: 5.2435688972, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3178467751
validation[          , genome  7150] predictions:    9630/  10000 (96.30%), best:    9778/10000 (97.78%), error:      1230.88354, best error:       760.63470 on epoch:    81, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 70.3834152222s, input_fired_time: 0.6440842152, output_fired_time: 0.5754303336, propagate_forward_time: 26.7345371246, propagate_backward_time: 40.6041450500, weight_update_time: 0.1023775116, other_time: 1.8252220154
epoch time: 5.7560157776s, input_fired_time: 0.0843767449, output_fired_time: 0.0000000000, propagate_forward_time: 5.3438620567, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3277769089
validation[          , genome  7150] predictions:    9716/  10000 (97.16%), best:    9778/10000 (97.78%), error:       892.16199, best error:       760.63470 on epoch:    81, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 69.9544677734s, input_fired_time: 0.6460082531, output_fired_time: 0.5782666802, propagate_forward_time: 26.5182266235, propagate_backward_time: 40.3743476868, weight_update_time: 0.1022004634, other_time: 1.8376121521
epoch time: 5.7402019501s, input_fired_time: 0.0832174793, output_fired_time: 0.0000000000, propagate_forward_time: 5.3359799385, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3210043907
validation[          , genome  7150] predictions:    9584/  10000 (95.84%), best:    9778/10000 (97.78%), error:      1428.37048, best error:       760.63470 on epoch:    81, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 69.2474441528s, input_fired_time: 0.6407080889, output_fired_time: 0.5682336092, propagate_forward_time: 26.2754077911, propagate_backward_time: 39.9343185425, weight_update_time: 0.1043366790, other_time: 1.8287734985
epoch time: 5.6832013130s, input_fired_time: 0.0831957832, output_fired_time: 0.0000000000, propagate_forward_time: 5.2716822624, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3283233643
validation[          , genome  7150] predictions:    9761/  10000 (97.61%), best:    9778/10000 (97.78%), error:       823.22870, best error:       760.63470 on epoch:    81, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 70.0900421143s, input_fired_time: 0.6504774690, output_fired_time: 0.5728670955, propagate_forward_time: 26.5313472748, propagate_backward_time: 40.4648742676, weight_update_time: 0.1044633612, other_time: 1.8704757690
epoch time: 5.6474294662s, input_fired_time: 0.0838478580, output_fired_time: 0.0000000000, propagate_forward_time: 5.2327370644, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3308444023
validation[          , genome  7150] predictions:    9758/  10000 (97.58%), best:    9778/10000 (97.78%), error:       814.26276, best error:       760.63470 on epoch:    81, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 28.1698532104s, input_fired_time: 0.4077720046, output_fired_time: 0.0000000000, propagate_forward_time: 26.0685386658, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6935424805
best training[          , genome  7150] predictions:   49629/  50000 (99.26%), best:    9778/10000 (97.78%), error:      1552.02026, best error:       760.63470 on epoch:    81, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 5.7241306305s, input_fired_time: 0.0812701285, output_fired_time: 0.0000000000, propagate_forward_time: 5.3166995049, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.3261609077
   testing[          , genome  7150] predictions:    9780/  10000 (97.80%), best:    9778/10000 (97.78%), error:       771.86298, best error:       760.63470 on epoch:    81, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
11:23:49 (9668): called boinc_finish(0)

</stderr_txt>
]]>