Module Expr Str Import alias ImportFrom alias ImportFrom alias ImportFrom alias ImportFrom alias ImportFrom alias ImportFrom alias Expr Call AttributeLoad NameLoad attr Str Str Str Expr Call AttributeLoad NameLoad attr Str Str Str Assign NameStore AttributeLoad NameLoad attr Assign NameStore Str Assign NameStore Str FunctionDef arguments args NameParam defaults body Assign NameStore Call AttributeLoad NameLoad attr NameLoad NameLoad NameLoad If AttributeLoad SubscriptLoad NameLoad Index Str attr body Assign SubscriptStore SubscriptLoad SubscriptLoad NameLoad Index Str Index Str Index Str AttributeLoad NameLoad attr Return NameLoad decorator_list FunctionDef arguments args NameParam defaults body Expr Str Assign NameStore SubscriptLoad SubscriptLoad AttributeLoad NameLoad attr Index Str Index Num Assign NameStore SubscriptLoad AttributeLoad NameLoad attr Index Str FunctionDef arguments args NameParam defaults body If UnaryOpNot Call AttributeLoad NameLoad attr NameLoad body Expr Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad NameLoad attr Str decorator_list FunctionDef arguments args NameParam defaults body Expr Call NameLoad NameLoad Expr Call AttributeLoad NameLoad attr Str Assign NameStore BinOpMod Str AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam defaults body Expr Call NameLoad NameLoad Assign NameStore BinOpMod Str AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr NameLoad decorator_list Assign NameStore BinOpAdd ListComp TupleLoad NameLoad ListLoad NameLoad Dict comprehension NameStore NameLoad ListLoad TupleLoad NameLoad ListLoad NameLoad Dict Expr Call AttributeLoad NameLoad attr NameLoad Call NameLoad NameLoad decorator_list FunctionDef arguments args NameParam defaults body Expr Str Assign NameStore SubscriptLoad SubscriptLoad AttributeLoad NameLoad attr Index Str Index Num Assign NameStore ListLoad Assign NameStore BinOpMod Str TupleLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign TupleStore NameStore NameStore Call AttributeLoad NameLoad attr NameLoad keyword NameLoad Assign NameStore Call AttributeLoad NameLoad attr Str NameLoad If CompareNotEq Call NameLoad NameLoad Num body Raise Call AttributeLoad AttributeLoad NameLoad attr attr Str Assign NameStore SubscriptLoad NameLoad Index Num Expr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr Str BinOpDiv Call NameLoad NameLoad Num Str Return NameLoad decorator_list FunctionDef arguments args NameParam defaults body Expr Str Assign NameStore SubscriptLoad SubscriptLoad AttributeLoad NameLoad attr Index Str Index Num Assign NameStore SubscriptLoad AttributeLoad NameLoad attr Index Str FunctionDef arguments args NameParam defaults body Expr Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad NameLoad attr Str decorator_list FunctionDef arguments args NameParam defaults body Expr Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad NameLoad attr Str Expr Call NameLoad NameLoad decorator_list FunctionDef arguments args NameParam defaults body Expr Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad NameLoad attr Str Expr Call NameLoad NameLoad decorator_list Assign NameStore BinOpAdd ListComp TupleLoad NameLoad ListLoad NameLoad Dict comprehension NameStore NameLoad ListLoad TupleLoad NameLoad ListLoad NameLoad Dict Expr Call AttributeLoad NameLoad attr NameLoad Call NameLoad NameLoad decorator_list
N/A N/A Runs the in-memory analytics benchmark of Cloudsuite.

More info: http://cloudsuite.ch/inmemoryanalytics/
 N/A re perfkitbenchmarker configs perfkitbenchmarker errors perfkitbenchmarker flags perfkitbenchmarker sample perfkitbenchmarker vm_util perfkitbenchmarker.linux_packages docker N/A N/A N/A flags DEFINE_string cloudsuite_in_memory_analytics_dataset /data/ml-latest-small Dataset to use for training. N/A N/A N/A flags DEFINE_string cloudsuite_in_memory_analytics_ratings_file /data/myratings.csv Ratings file to give the recommendation for. N/A FLAGS N/A flags FLAGS N/A BENCHMARK_NAME cloudsuite_in_memory_analytics N/A BENCHMARK_CONFIG 
cloudsuite_in_memory_analytics:
  description: >
    Run Cloudsuite in-memory analytics benchmark. Specify the number of worker
    VMs with --num_vms.
  vm_groups:
    master:
      vm_spec: *default_single_core
      vm_count: 1
    workers:
      vm_spec: *default_single_core
 GetConfig N/A N/A user_config N/A N/A N/A config N/A N/A configs LoadConfig BENCHMARK_CONFIG user_config BENCHMARK_NAME N/A N/A N/A FLAGS N/A num_vms present N/A N/A N/A N/A N/A config N/A vm_groups N/A workers N/A vm_count N/A FLAGS num_vms N/A config N/A Prepare N/A N/A benchmark_spec N/A N/A N/A Install docker. Pull images. Create datasets. Start master and workers.

  Args:
    benchmark_spec: The benchmark specification. Contains all data that is
        required to run the benchmark.
   N/A master N/A N/A N/A benchmark_spec vm_groups N/A master N/A 0 N/A workers N/A N/A benchmark_spec vm_groups N/A workers PrepareCommon N/A N/A vm N/A N/A N/A N/A N/A N/A docker IsInstalled vm N/A N/A N/A N/A vm Install docker N/A N/A N/A vm RemoteCommand sudo docker pull cloudsuite/spark N/A N/A N/A vm RemoteCommand sudo docker pull cloudsuite/movielens-dataset N/A N/A N/A vm RemoteCommand sudo docker create --name data cloudsuite/movielens-dataset N/A PrepareMaster N/A N/A vm N/A N/A N/A N/A PrepareCommon vm N/A N/A N/A vm RemoteCommand sudo docker pull cloudsuite/in-memory-analytics N/A start_master_cmd N/A sudo docker run -d --net host -e SPARK_MASTER_IP=%s --name spark-master cloudsuite/spark master N/A master internal_ip N/A N/A N/A vm RemoteCommand start_master_cmd N/A PrepareWorker N/A N/A vm N/A N/A N/A N/A PrepareCommon vm N/A start_worker_cmd N/A sudo docker run -d --net host --volumes-from data --name spark-worker cloudsuite/spark worker spark://%s:7077 N/A master internal_ip N/A N/A N/A vm RemoteCommand start_worker_cmd N/A N/A target_arg_tuples N/A N/A N/A PrepareWorker N/A vm N/A N/A vm workers N/A N/A PrepareMaster N/A master N/A N/A N/A N/A vm_util RunParallelThreads target_arg_tuples N/A len target_arg_tuples N/A Run N/A N/A benchmark_spec N/A N/A N/A Run the in-memory analytics benchmark.

  Args:
    benchmark_spec: The benchmark specification. Contains all data that is
        required to run the benchmark.

  Returns:
    A list of sample.Sample objects.
   N/A master N/A N/A N/A benchmark_spec vm_groups N/A master N/A 0 N/A results N/A N/A benchmark_cmd N/A sudo docker run --rm --net host --volumes-from data cloudsuite/in-memory-analytics %s %s --master spark://%s:7077 N/A N/A FLAGS cloudsuite_in_memory_analytics_dataset N/A FLAGS cloudsuite_in_memory_analytics_ratings_file N/A master internal_ip N/A N/A stdout _ N/A N/A master RemoteCommand benchmark_cmd should_log True N/A matches N/A N/A re findall Benchmark execution time: (\d+)ms stdout N/A N/A N/A len matches 1 N/A N/A N/A N/A N/A errors Benchmarks RunError Expected to find benchmark execution time N/A execution_time N/A matches N/A 0 N/A N/A N/A results append N/A N/A sample Sample Benchmark execution time N/A N/A float execution_time 1000 seconds N/A results N/A Cleanup N/A N/A benchmark_spec N/A N/A N/A Stop and remove docker containers. Remove images.

  Args:
    benchmark_spec: The benchmark specification. Contains all data that is
        required to run the benchmark.
   N/A master N/A N/A N/A benchmark_spec vm_groups N/A master N/A 0 N/A workers N/A N/A benchmark_spec vm_groups N/A workers CleanupCommon N/A N/A vm N/A N/A N/A N/A N/A vm RemoteCommand sudo docker rm -v data N/A N/A N/A vm RemoteCommand sudo docker rmi cloudsuite/movielens-dataset N/A N/A N/A vm RemoteCommand sudo docker rmi cloudsuite/spark N/A CleanupMaster N/A N/A vm N/A N/A N/A N/A N/A vm RemoteCommand sudo docker stop spark-master N/A N/A N/A vm RemoteCommand sudo docker rm spark-master N/A N/A N/A vm RemoteCommand sudo docker rmi cloudsuite/in-memory-analytics N/A N/A CleanupCommon vm N/A CleanupWorker N/A N/A vm N/A N/A N/A N/A N/A vm RemoteCommand sudo docker stop spark-worker N/A N/A N/A vm RemoteCommand sudo docker rm spark-worker N/A N/A CleanupCommon vm N/A N/A target_arg_tuples N/A N/A N/A CleanupWorker N/A vm N/A N/A vm workers N/A N/A CleanupMaster N/A master N/A N/A N/A N/A vm_util RunParallelThreads target_arg_tuples N/A len target_arg_tuples N/A