[160608]glm_parser_configuration_config_run_spark_linearb

Machine: linearb

Branch: configuration

Command: project_path=$( cd "$( dirname "${BASH_SOURCE[0]}" )" && pwd )'/..'

source $MODULESHOME/init/bash module load natlang module load bigdata module load spark/1.6.1 module load NL/LANG/PYTHON/Anaconda-2.4.0

cd $project_path'/src' python setup.py build_ext --inplace

cd hvector python setup.py install --install-lib .

cd .. spark-submit --driver-memory 20g --executor-memory 20g --master 'local[*]' glm_parser.py config/default.config -s 8 -p ~/Daten/glm-parser-data/penn-wsj-deps/

Result: 06/08/2016 09:53:35 AM DEBUG: Initialize AveragePerceptronLearner ... 06/08/2016 09:53:40 AM DEBUG: Initialize ParallelPerceptronLearner ... 06/08/2016 09:53:43 AM DEBUG: Start evaluating ... 06/08/2016 09:53:43 AM INFO: Training time usage(seconds): 7.526403 06/08/2016 09:53:43 AM INFO: Feature count: 0 06/08/2016 09:56:21 AM DEBUG: Initialize AveragePerceptronLearner ... 06/08/2016 09:56:21 AM DEBUG: Starting sequential train ... 06/08/2016 09:56:21 AM DEBUG: Iteration: 0 06/08/2016 09:56:21 AM DEBUG: Data size: 0 06/08/2016 09:56:21 AM DEBUG: Iteration: 1 06/08/2016 09:56:21 AM DEBUG: Data size: 0 06/08/2016 09:56:21 AM DEBUG: Iteration: 2 06/08/2016 09:56:21 AM DEBUG: Data size: 0 06/08/2016 09:56:21 AM DEBUG: Iteration: 3 06/08/2016 09:56:21 AM DEBUG: Data size: 0 06/08/2016 09:56:21 AM DEBUG: Iteration: 4 06/08/2016 09:56:21 AM DEBUG: Data size: 0 06/08/2016 09:56:21 AM DEBUG: Start evaluating ... 06/08/2016 09:56:21 AM INFO: Training time usage(seconds): 0.001799 06/08/2016 09:56:21 AM INFO: Feature count: 0 06/08/2016 10:00:10 AM DEBUG: Initialize AveragePerceptronLearner ... 06/08/2016 10:00:24 AM DEBUG: Starting sequential train ... 06/08/2016 10:00:24 AM DEBUG: Iteration: 0 06/08/2016 10:00:24 AM DEBUG: Data size: 5938 06/08/2016 10:02:55 AM DEBUG: Initialize AveragePerceptronLearner ... 06/08/2016 10:02:58 AM DEBUG: Initialize ParallelPerceptronLearner ... 06/08/2016 10:36:22 AM DEBUG: Start evaluating ... 06/08/2016 10:43:43 AM INFO: Training time usage(seconds): 2007.416834 06/08/2016 10:43:43 AM INFO: Feature count: 2247516 06/08/2016 10:43:43 AM INFO: Unlabeled accuracy: 0.842076460011 (75397, 89537) 06/08/2016 10:43:43 AM INFO: Unlabeled attachment accuracy: 0.848444249135 (79159, 93299)