Module Import alias Import alias Import alias Import alias Import alias ImportFrom alias Import alias ImportFrom alias Import alias ImportFrom alias Import alias Assign NameStore BinOpAdd BinOpAdd Call AttributeLoad AttributeLoad NameLoad attr attr Str Str Str Call AttributeLoad AttributeLoad NameLoad attr attr Str Str FunctionDef arguments args NameParam defaults body Assign NameStore Str Assign NameStore Num Assign NameStore Num Assign NameStore Call AttributeLoad NameLoad attr Num Num NameLoad Assign NameStore Call AttributeLoad Call AttributeLoad NameLoad attr ListLoad NameLoad NameLoad attr Assign NameStore Num Assign NameStore Num Assign NameStore Num Assign NameStore Call NameLoad keyword NameLoad Assign NameStore NameLoad Assign NameStore NameLoad Assign NameStore Num Assign NameStore ListLoad Str Str Str Str Str Assign NameStore ListLoad For TupleStore NameStore NameStore Call NameLoad NameLoad body Assign NameStore Dict Assign SubscriptStore NameLoad Index Str NameLoad If CompareEq NameLoad Num body Assign SubscriptStore NameLoad Index Str Str orelse Assign SubscriptStore NameLoad Index Str NameLoad Assign SubscriptStore NameLoad Index Str Str Assign SubscriptStore NameLoad Index Str Dict Expr Call AttributeLoad NameLoad attr NameLoad Assign NameStore Dict Assign SubscriptStore NameLoad Index Str ListLoad For NameStore NameLoad body Expr Call AttributeLoad SubscriptLoad NameLoad Index Str attr Dict Str Str SubscriptLoad NameLoad Index Str BinOpDiv Num Call NameLoad NameLoad Assign NameStore Dict Assign SubscriptStore NameLoad Index Str Str Assign SubscriptStore NameLoad Index Str NameLoad Assign NameStore Dict Assign SubscriptStore NameLoad Index Str Dict Assign SubscriptStore SubscriptLoad NameLoad Index Str Index Str NameLoad Assign SubscriptStore SubscriptLoad NameLoad Index Str Index Str NameLoad Assign SubscriptStore SubscriptLoad NameLoad Index Str Index Str NameLoad Assign SubscriptStore SubscriptLoad NameLoad Index Str Index Str Str Assign SubscriptStore SubscriptLoad NameLoad Index Str Index Str NameLoad Assign SubscriptStore SubscriptLoad NameLoad Index Str Index Str NameLoad Assign SubscriptStore SubscriptLoad NameLoad Index Str Index Str Str Assign SubscriptStore SubscriptLoad NameLoad Index Str Index Str Str Assign SubscriptStore SubscriptLoad NameLoad Index Str Index Str Str Assign SubscriptStore SubscriptLoad NameLoad Index Str Index Str Str Assign SubscriptStore NameLoad Index Str NameLoad Assign SubscriptStore NameLoad Index Str Str Assign SubscriptStore NameLoad Index Str Str Assign NameStore ListLoad For NameStore Call NameLoad NameLoad body Assign NameStore BinOpAdd BinOpAdd Str NameLoad Str Assign NameStore Call AttributeLoad NameLoad attr NameLoad Call AttributeLoad NameLoad attr NameLoad keyword Dict Str Str Print Str AttributeLoad NameLoad attr AttributeLoad NameLoad attr If NameLoad body Assert CompareIs AttributeLoad NameLoad attr Num Assign NameStore Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign NameStore SubscriptLoad NameLoad Index Str Assign NameStore SubscriptLoad NameLoad Index Str Expr Call AttributeLoad NameLoad attr Dict Str Str NameLoad NameLoad Assign NameStore BinOpAdd BinOpAdd BinOpAdd BinOpAdd BinOpAdd Str NameLoad Str NameLoad Str NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad Print Str AttributeLoad NameLoad attr AttributeLoad NameLoad attr If NameLoad body Assert CompareIs AttributeLoad NameLoad attr Num Assign NameStore Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign NameStore ListLoad Assign NameStore ListLoad For NameStore Call NameLoad NameLoad body Assign NameStore BinOpMod Str Call AttributeLoad NameLoad attr BinOpPow Num Num Expr Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Assign NameStore SubscriptLoad NameLoad Index Str Assign NameStore SubscriptLoad NameLoad Index Str Expr Call AttributeLoad NameLoad attr TupleLoad NameLoad NameLoad NameLoad NameLoad NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad NameLoad For NameStore NameLoad body Print NameLoad decorator_list FunctionDef arguments args NameParam defaults body Assign TupleStore NameStore NameStore NameStore NameStore NameStore NameStore NameLoad Assign NameStore Num Assign NameStore ListLoad Assign NameStore ListLoad For NameStore Call NameLoad NameLoad body Print NameLoad NameLoad Assign NameStore Dict Assign SubscriptStore NameLoad Index Str NameLoad Assign SubscriptStore NameLoad Index Str NameLoad Assign SubscriptStore NameLoad Index Str Dict Assign SubscriptStore SubscriptLoad NameLoad Index Str Index Str NameLoad Assign NameStore BinOpAdd BinOpAdd Str NameLoad Str Assign TupleStore NameStore NameStore Call Call NameLoad AttributeLoad NameLoad attr NameLoad Call AttributeLoad NameLoad attr NameLoad keyword Dict Str Str Print Str AttributeLoad NameLoad attr AttributeLoad NameLoad attr If NameLoad body Assert CompareIs AttributeLoad NameLoad attr Num Print Str NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Print Assign NameStore Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign NameStore SubscriptLoad NameLoad Index Str Assign NameStore SubscriptLoad NameLoad Index Str Print NameLoad For NameStore NameLoad body If CompareEq SubscriptLoad NameLoad Index Str Str body Assign NameStore SubscriptLoad NameLoad Index Str orelse If CompareEq SubscriptLoad NameLoad Index Str Str body Assign NameStore SubscriptLoad NameLoad Index Str orelse If CompareEq SubscriptLoad NameLoad Index Str Str body Assign NameStore SubscriptLoad NameLoad Index Str Assign NameStore Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr BinOpMult NameLoad Call AttributeLoad NameLoad attr BinOpDiv Num Call AttributeLoad AttributeLoad NameLoad attr attr Assign NameStore BinOpSub Call NameLoad BinOpSub SubscriptLoad NameLoad Index NameLoad SubscriptLoad NameLoad Index NameLoad Call NameLoad BinOpSub SubscriptLoad NameLoad Index NameLoad SubscriptLoad NameLoad Index NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr If CompareLt NameLoad Num body Assign NameStore UnaryOpUSub NameLoad If CompareLt NameLoad Num body Assign NameStore NameLoad orelse Assign NameStore NameLoad Assign NameStore BinOpSub Call AttributeLoad NameLoad attr NameLoad Assign NameStore Dict Assign SubscriptStore NameLoad Index Str NameLoad Assign SubscriptStore NameLoad Index Str NameLoad Assign SubscriptStore NameLoad Index Str Dict Assign SubscriptStore SubscriptLoad NameLoad Index Str Index Str NameLoad Assign SubscriptStore SubscriptLoad NameLoad Index Str Index Str NameLoad Assign SubscriptStore SubscriptLoad NameLoad Index Str Index Str NameLoad Assign NameStore BinOpAdd BinOpAdd Str NameLoad Str Print Str NameLoad Assign TupleStore NameStore NameStore Call Call NameLoad AttributeLoad NameLoad attr NameLoad Call AttributeLoad NameLoad attr NameLoad keyword Dict Str Str Print Str AttributeLoad NameLoad attr AttributeLoad NameLoad attr If NameLoad body Assert CompareIs AttributeLoad NameLoad attr Num Print Str NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Print Assign NameStore Call NameLoad AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr Assign NameStore BinOpMod Str TupleLoad NameLoad SubscriptLoad NameLoad Index Call NameLoad BinOpMult Num NameLoad SubscriptLoad NameLoad Index Call NameLoad BinOpMult Num NameLoad SubscriptLoad NameLoad Index Call NameLoad BinOpMult Num NameLoad SubscriptLoad NameLoad Index Call NameLoad BinOpMult Num NameLoad SubscriptLoad NameLoad Index Call NameLoad BinOpMult Num NameLoad SubscriptLoad NameLoad Index Call NameLoad BinOpMult Num NameLoad Return NameLoad decorator_list FunctionDef arguments args NameParam defaults body Expr Str FunctionDef arguments args defaults vararg kwarg body Assign NameStore Call AttributeLoad NameLoad attr Assign NameStore Call NameLoad NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr If CompareEq Call NameLoad NameLoad NameLoad body Return BinOpAdd NameLoad TupleLoad BinOpSub NameLoad NameLoad orelse Return TupleLoad NameLoad BinOpSub NameLoad NameLoad decorator_list Return NameLoad decorator_list If CompareEq NameLoad Str body Print NameLoad Expr Call NameLoad NameLoad
N/A N/A numpy N/A numpy.random N/A random N/A json N/A time datetime datetime N/A requests scipy.linalg norm N/A time multiprocessing Pool N/A os N/A HOSTNAME N/A N/A N/A N/A N/A os environ get NEXT_BACKEND_GLOBAL_HOST localhost : N/A N/A N/A os environ get NEXT_BACKEND_GLOBAL_PORT 8000 run_all N/A N/A assert_200 N/A N/A N/A app_id PoolBasedTripletMDS N/A num_objects 30 N/A desired_dimension 2 N/A x N/A N/A numpy linspace 0 1 num_objects N/A X_true N/A N/A N/A N/A numpy vstack N/A x x transpose N/A total_pulls_per_client 100 N/A num_experiments 1 N/A num_clients 30 N/A pool N/A Pool processes num_clients N/A n num_objects N/A d desired_dimension N/A delta 0.01 N/A supported_alg_ids N/A RandomSampling RandomSampling UncertaintySampling CrowdKernel STE N/A alg_list N/A N/A N/A idx alg_id N/A enumerate supported_alg_ids N/A N/A alg_item N/A N/A N/A alg_item N/A alg_id alg_id N/A N/A idx 0 N/A N/A N/A alg_item N/A alg_label Test N/A N/A N/A alg_item N/A alg_label alg_id N/A N/A alg_item N/A test_alg_label Test N/A N/A alg_item N/A params N/A N/A N/A N/A alg_list append alg_item N/A params N/A N/A N/A params N/A proportions N/A N/A algorithm alg_list N/A N/A N/A N/A N/A params N/A proportions append N/A alg_label proportion N/A algorithm N/A alg_label N/A 1.0 N/A len alg_list N/A algorithm_management_settings N/A N/A N/A algorithm_management_settings N/A mode fixed_proportions N/A N/A algorithm_management_settings N/A params params N/A initExp_args_dict N/A N/A N/A initExp_args_dict N/A args N/A N/A N/A N/A initExp_args_dict N/A args N/A n n N/A N/A N/A initExp_args_dict N/A args N/A d d N/A N/A N/A initExp_args_dict N/A args N/A failure_probability delta N/A N/A N/A initExp_args_dict N/A args N/A participant_to_algorithm_management one_to_many N/A N/A N/A initExp_args_dict N/A args N/A algorithm_management_settings algorithm_management_settings N/A N/A N/A initExp_args_dict N/A args N/A alg_list alg_list N/A N/A N/A initExp_args_dict N/A args N/A instructions You want instructions, here are your test instructions N/A N/A N/A initExp_args_dict N/A args N/A debrief You want a debrief, here is your test debrief N/A N/A N/A initExp_args_dict N/A args N/A context_type text N/A N/A N/A initExp_args_dict N/A args N/A context Boom baby triplet works N/A N/A initExp_args_dict N/A app_id app_id N/A N/A initExp_args_dict N/A site_id replace this with working site id N/A N/A initExp_args_dict N/A site_key replace this with working site key N/A exp_info N/A N/A ell N/A range num_experiments N/A N/A url N/A N/A http:// HOSTNAME /api/experiment N/A response N/A N/A requests post url N/A N/A json dumps initExp_args_dict headers N/A content-type application/json N/A POST initExp response = N/A response text N/A response status_code N/A assert_200 N/A N/A N/A N/A response status_code 200 N/A initExp_response_dict N/A N/A json loads N/A response text N/A exp_uid N/A initExp_response_dict N/A exp_uid N/A exp_key N/A initExp_response_dict N/A exp_key N/A N/A N/A exp_info append N/A exp_uid exp_key exp_uid exp_key N/A url N/A N/A N/A N/A N/A http:// HOSTNAME /api/experiment/ exp_uid / exp_key N/A response N/A N/A requests get url N/A GET experiment response = N/A response text N/A response status_code N/A assert_200 N/A N/A N/A N/A response status_code 200 N/A initExp_response_dict N/A N/A json loads N/A response text N/A participants N/A N/A pool_args N/A N/A i N/A range num_clients N/A N/A participant_uid N/A %030x N/A N/A random randrange N/A 16 30 N/A N/A N/A participants append participant_uid N/A experiment N/A N/A N/A numpy random choice exp_info N/A exp_uid N/A experiment N/A exp_uid N/A exp_key N/A experiment N/A exp_key N/A N/A N/A pool_args append N/A exp_uid exp_key participant_uid total_pulls_per_client X_true assert_200 N/A results N/A N/A pool map simulate_one_client pool_args N/A result results N/A N/A result N/A simulate_one_client N/A N/A input_args N/A N/A N/A N/A exp_uid exp_key participant_uid total_pulls X_true assert_200 input_args N/A avg_response_time 1.0 N/A getQuery_times N/A N/A processAnswer_times N/A N/A t N/A range total_pulls N/A N/A t participant_uid N/A getQuery_args_dict N/A N/A N/A getQuery_args_dict N/A exp_uid exp_uid N/A N/A getQuery_args_dict N/A exp_key exp_key N/A N/A getQuery_args_dict N/A args N/A N/A N/A N/A getQuery_args_dict N/A args N/A participant_uid participant_uid N/A url N/A N/A http:// HOSTNAME /api/experiment/getQuery N/A N/A response dt N/A N/A timeit N/A requests post url N/A N/A json dumps getQuery_args_dict headers N/A content-type application/json N/A POST getQuery response =  N/A response text N/A response status_code N/A assert_200 N/A N/A N/A N/A response status_code 200 N/A POST getQuery duration =  dt N/A N/A N/A getQuery_times append dt N/A N/A query_dict N/A N/A json loads N/A response text N/A query_uid N/A query_dict N/A query_uid N/A targets N/A query_dict N/A target_indices N/A targets N/A target targets N/A N/A N/A N/A target N/A label center N/A N/A index_center N/A target N/A index N/A N/A N/A N/A target N/A label left N/A N/A index_left N/A target N/A index N/A N/A N/A N/A target N/A label right N/A N/A index_right N/A target N/A index N/A ts N/A N/A time time N/A N/A N/A time sleep N/A avg_response_time N/A N/A numpy log N/A 1.0 N/A N/A N/A numpy random rand N/A direction N/A N/A norm N/A N/A X_true N/A index_left N/A X_true N/A index_center N/A norm N/A N/A X_true N/A index_right N/A X_true N/A index_center N/A r N/A N/A N/A numpy random rand N/A N/A r 0.1 N/A N/A direction N/A direction N/A N/A direction 0.0 N/A N/A target_winner index_left N/A N/A target_winner index_right N/A response_time N/A N/A N/A time time ts N/A processAnswer_args_dict N/A N/A N/A processAnswer_args_dict N/A exp_uid exp_uid N/A N/A processAnswer_args_dict N/A exp_key exp_key N/A N/A processAnswer_args_dict N/A args N/A N/A N/A N/A processAnswer_args_dict N/A args N/A query_uid query_uid N/A N/A N/A processAnswer_args_dict N/A args N/A target_winner target_winner N/A N/A N/A processAnswer_args_dict N/A args N/A response_time response_time N/A url N/A N/A http:// HOSTNAME /api/experiment/processAnswer N/A POST processAnswer args =  processAnswer_args_dict N/A N/A response dt N/A N/A timeit N/A requests post url N/A N/A json dumps processAnswer_args_dict headers N/A content-type application/json N/A POST processAnswer response N/A response text N/A response status_code N/A assert_200 N/A N/A N/A N/A response status_code 200 N/A POST processAnswer duration =  dt N/A N/A N/A processAnswer_times append dt N/A N/A processAnswer_json_response N/A eval N/A response text N/A N/A N/A processAnswer_times sort N/A N/A N/A getQuery_times sort N/A return_str N/A %s 
	 getQuery	 : %f (5),    %f (50),    %f (95)
	 processAnswer	 : %f (5),    %f (50),    %f (95)
 N/A participant_uid N/A getQuery_times N/A N/A int N/A 0.05 total_pulls N/A getQuery_times N/A N/A int N/A 0.5 total_pulls N/A getQuery_times N/A N/A int N/A 0.95 total_pulls N/A processAnswer_times N/A N/A int N/A 0.05 total_pulls N/A processAnswer_times N/A N/A int N/A 0.5 total_pulls N/A processAnswer_times N/A N/A int N/A 0.95 total_pulls N/A return_str N/A timeit N/A N/A f N/A N/A N/A  
  Utility used to time the duration of code execution. This script can be composed with any other script.

  Usage::

    def f(n): 
      return n**n  

    def g(n): 
      return n,n**n 

    answer0,dt = timeit(f)(3)
    answer1,answer2,dt = timeit(g)(3)
   timed N/A N/A N/A args kw N/A N/A ts N/A N/A time time N/A result N/A f args kw N/A te N/A N/A time time N/A N/A N/A type result tuple N/A N/A N/A result N/A N/A te ts N/A N/A N/A result N/A te ts N/A N/A timed N/A N/A N/A __name__ __main__ N/A N/A HOSTNAME N/A N/A run_all False