Nameexact_genome_1512568488_41_6886_1
Workunit2605718
Created7 Dec 2017, 22:35:13 UTC
Sent7 Dec 2017, 22:41:43 UTC
Report deadline15 Dec 2017, 21:12:14 UTC
Received7 Dec 2017, 23:18:39 UTC
Server stateOver
OutcomeComputation error
Client stateCompute error
Exit status1 (0x1) Unknown error number
Computer ID69348
Run time3 min 14 sec
CPU time2 min 56 sec
Validate stateInvalid
Credit0.00
Device peak FLOPS4.46 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size155.42 MB
Peak swap size158.43 MB
Peak disk usage0.01 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<message>
Fonction incorrecte.
 (0x1) - exit code 1 (0x1)</message>
<stderr_txt>
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/mnist_training_50k.bin'
boincified validation filename: '../../projects/csgrid.org_csg/mnist_validation_10k.bin'
boincified testing filename: '../../projects/csgrid.org_csg/mnist_testing_new.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1512568488_41_6886.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1512568488_41_6886_1_r79328526_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from input file: '../../projects/csgrid.org_csg/exact_genome_1512568488_41_6886.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.5
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.0125
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 0.0005
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 0
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 0
read best_validation_error: 1e+07
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6886
read normal distribution: '1 0 0'
generator_str: '1116886378'
read generator: 1116886378
read generated_by_map:
1 disable_edge 1
reading 23 nodes.
reading 48 edges.
number input nodes: 1
number softmax nodes: 10
order_size: 0
parsed input file
loaded genome
loading images
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 4923 images.
reading image set with 5742 images.
reading image set with 4958 images.
reading image set with 5131 images.
reading image set with 4842 images.
reading image set with 4421 images.
reading image set with 4918 images.
reading image set with 5265 images.
reading image set with 4851 images.
reading image set with 4949 images.
image_size: 1x28x28 = 784
read 50000 images.
    class    0: 4923
    class    1: 5742
    class    2: 4958
    class    3: 5131
    class    4: 4842
    class    5: 4421
    class    6: 4918
    class    7: 5265
    class    8: 4851
    class    9: 4949
calculating averages and standard deviations for images
average pixel value for channel 0: 0.130530551075935
pixel variance for channel 0: 0.0948646068572998
pixel standard deviation for channel 0: 0.308000981807709
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 1x28x28 = 784
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 980 images.
reading image set with 1135 images.
reading image set with 1032 images.
reading image set with 1010 images.
reading image set with 982 images.
reading image set with 892 images.
reading image set with 958 images.
reading image set with 1028 images.
reading image set with 974 images.
reading image set with 1009 images.
image_size: 1x28x28 = 784
read 10000 images.
    class    0: 980
    class    1: 1135
    class    2: 1032
    class    3: 1010
    class    4: 982
    class    5: 892
    class    6: 958
    class    7: 1028
    class    8: 974
    class    9: 1009
loaded images
starting backpropagation!
generator min: 1, generator max: 2147483646
pre shuffle 1: 354796619
post shuffle 1: 805586383
epoch time: 57.9218902587891s, input_fired_time: 0.818617105484009, output_fired_time: 0.56824779510498, propagate_forward_time: 16.6479988098145, propagate_backward_time: 38.6882591247559, weight_update_time: 0.0537268780171871, other_time: 1.19876480102539
epoch time: 3.56857061386108s, input_fired_time: 0.0854108855128288, output_fired_time: 0, propagate_forward_time: 3.26813220977783, propagate_backward_time: 0, weight_update_time: 0, other_time: 0.215027570724487
validation[          , genome  6886] predictions:    9572/  10000 (95.72%), best:    9572/10000 (95.72%), error:      1392.97668, best error:      1392.97668 on epoch:     0, epoch:    0/100, mu: 0.5000000000, learning_rate: 0.0125000002, weight_decay: 0.0005000000

epoch time: 57.0279579163s, input_fired_time: 0.8139052987, output_fired_time: 0.5523773432, propagate_forward_time: 16.3096313477, propagate_backward_time: 38.1844253540, weight_update_time: 0.0586669445, other_time: 1.1676216125
epoch time: 3.7296628952s, input_fired_time: 0.0850865468, output_fired_time: 0.0000000000, propagate_forward_time: 3.4013476372, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2432286739
validation[          , genome  6886] predictions:    9621/  10000 (96.21%), best:    9621/10000 (96.21%), error:      1282.36646, best error:      1282.36646 on epoch:     1, epoch:    1/100, mu: 0.5245000124, learning_rate: 0.0118749999, weight_decay: 0.0004750000

epoch time: 59.7976608276s, input_fired_time: 0.8222466111, output_fired_time: 0.5737848878, propagate_forward_time: 17.2626609802, propagate_backward_time: 39.9169692993, weight_update_time: 0.0557421297, other_time: 1.2220001221
epoch time: 3.6300356388s, input_fired_time: 0.0855286643, output_fired_time: 0.0000000000, propagate_forward_time: 3.3315451145, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 0.2129619122
validation[          , genome  6886] predictions:    9578/  10000 (95.78%), best:    9621/10000 (96.21%), error:      1377.24561, best error:      1282.36646 on epoch:     1, epoch:    2/100, mu: 0.5477750301, learning_rate: 0.0112812500, weight_decay: 0.0004512500

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/mnist_training_50k.bin'
boincified validation filename: '../../projects/csgrid.org_csg/mnist_validation_10k.bin'
boincified testing filename: '../../projects/csgrid.org_csg/mnist_testing_new.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1512568488_41_6886.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1512568488_41_6886_1_r79328526_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.569886
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.0107172
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 0.000428687
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 3
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 1
read number_validation_images: 10000
read best_validation_predictions: 9621
read best_validation_error: 1282.37
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6886
read normal distribution: '1 0 0'
generator_str: '99664265'
read generator: 99664265
read generated_by_map:
1 disable_edge 1
reading 23 nodes.
reading 48 edges.
number input nodes: 1
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
Could not open '../../projects/csgrid.org_csg/mnist_training_50k.bin' for reading.
calculating averages and standard deviations for images
Could not open '../../projects/csgrid.org_csg/mnist_validation_10k.bin' for reading.
Could not open '../../projects/csgrid.org_csg/mnist_testing_new.bin' for reading.
ERROR: had error loading training images
00:17:47 (9492): called boinc_finish(1)

</stderr_txt>
]]>