Module Expr Str Import alias identifier Import alias Import alias FunctionDef arguments args NameParam defaults body Assign NameStore Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call AttributeLoad NameLoad attr Assign NameStore SubscriptLoad NameLoad Index Str Assign NameStore SubscriptLoad NameLoad Index Str Assign NameStore SubscriptLoad NameLoad Index Str Assign NameStore Call AttributeLoad NameLoad attr Str SubscriptLoad NameLoad Index Num Assign NameStore SubscriptLoad NameLoad Index Str Assign NameStore Call AttributeLoad NameLoad attr NameLoad Return Call NameLoad NameLoad NameLoad NameLoad NameLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam NameParam defaults body Expr Str Assign NameStore Call AttributeLoad NameLoad attr NameLoad keyword Str Assign NameStore NameStore NameStore NameStore NameLoad Assign NameStore NameStore NameLoad If CompareGt Call NameLoad NameLoad Num body Assign NameStore BinOpSub SubscriptLoad NameLoad Index Num NameLoad If CompareGtE Call NameLoad NameLoad NameLoad body Assign NameStore Call NameLoad NameLoad NameLoad If CompareIsNot NameLoad NameLoad body Assign TupleStore NameStore Call AttributeLoad NameLoad attr CompareGtE NameLoad NameLoad If CompareGt Call NameLoad NameLoad Num body Assign NameStore SubscriptLoad NameLoad Index Num Assign NameStore Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr NameLoad Num Num Assign NameStore SubscriptLoad NameLoad Index NameLoad Assign NameStore BinOpSub SubscriptLoad NameLoad Index NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad Assign NameStore SubscriptLoad NameLoad Slice NameLoad BinOpAdd NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad Assign NameStore BinOpDiv Call AttributeLoad NameLoad attr NameLoad BinOpSub Call AttributeLoad NameLoad attr NameLoad Num Return Dict Str Str Str Str Str Str Str Str NameLoad NameLoad NameLoad NameLoad Call NameLoad NameLoad Call NameLoad NameLoad NameLoad NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Assign NameStore Call AttributeLoad NameLoad attr NameLoad keyword Str Assign NameStore Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr NameLoad Num Num Return BinOpDiv BinOpSub SubscriptLoad NameLoad Slice NameLoad SubscriptLoad NameLoad Slice UnaryOpUSub NameLoad NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam defaults body Expr Str Import alias Assign NameStore Call NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad Assign NameStore SubscriptLoad Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr NameLoad Num Num Slice Num Assert CompareEq Call NameLoad NameLoad NameLoad Assign NameStore ListComp BinOpSub NameLoad NameLoad comprehension NameStore NameLoad Assign NameStore Call NameLoad NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad NameLoad Str NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad NameLoad Str NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad NameLoad Str NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad NameLoad Str NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad NameLoad Str NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad NameLoad Str NameLoad Return Dict Str Str Str Str Str Str Str NameLoad Call NameLoad NameLoad Call NameLoad NameLoad Call NameLoad NameLoad Call NameLoad NameLoad Call NameLoad NameLoad Call NameLoad NameLoad decorator_list FunctionDef arguments args NameParam defaults body Assign NameStore Call NameLoad AttributeLoad NameLoad attr Num Assign NameStore AttributeLoad NameLoad attr Assert CompareEq Call NameLoad NameLoad Call NameLoad NameLoad Assign NameStore BinOpBitAnd Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr NameLoad Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr NameLoad Assign NameStore SubscriptLoad NameLoad Index NameLoad Assign NameStore SubscriptLoad NameLoad Index NameLoad Return Dict Str Str NameLoad NameLoad decorator_list
N/A N/A This is the actual code we use to score people's solutions
server-side. The interfaces here are not yet stable, but we include
them so that people can reproduce our scoring calculations
independently.

We correspondly do not currently import this module.
 N/A numpy np N/A requests N/A gym score_from_remote N/A N/A url N/A N/A N/A result N/A N/A requests get url N/A parsed N/A N/A result json N/A episode_lengths N/A parsed N/A episode_lengths N/A episode_rewards N/A parsed N/A episode_rewards N/A timestamps N/A parsed N/A timestamps N/A initial_reset_timestamp N/A N/A parsed get initial_reset_timestamp N/A timestamps N/A 0 N/A env_id N/A parsed N/A env_id N/A spec N/A N/A gym spec env_id N/A N/A score_from_merged episode_lengths episode_rewards timestamps initial_reset_timestamp N/A spec trials N/A spec reward_threshold N/A score_from_merged N/A N/A episode_lengths episode_rewards timestamps initial_reset_timestamp trials reward_threshold N/A N/A N/A Method to calculate the score from merged monitor files.
     N/A episode_rewards N/A N/A np array episode_rewards dtype float64 N/A episode_t_value timestep_t_value mean error None N/A seconds_to_solve seconds_in_total None N/A N/A N/A len timestamps 0 N/A N/A seconds_in_total N/A N/A timestamps N/A -1 initial_reset_timestamp N/A N/A N/A len episode_rewards trials N/A N/A means N/A running_mean episode_rewards trials N/A N/A reward_threshold None N/A N/A N/A indexes_above_threshold N/A N/A np where N/A means reward_threshold N/A N/A N/A len indexes_above_threshold 0 N/A N/A episode_t_value N/A indexes_above_threshold N/A 0 N/A cumulative_timesteps N/A N/A np cumsum N/A N/A np insert episode_lengths 0 0 N/A timestep_t_value N/A cumulative_timesteps N/A episode_t_value N/A seconds_to_solve N/A N/A timestamps N/A episode_t_value initial_reset_timestamp N/A best_idx N/A N/A np argmax means N/A best_rewards N/A episode_rewards N/A best_idx N/A best_idx trials N/A mean N/A N/A np mean best_rewards N/A error N/A N/A N/A np std best_rewards N/A N/A N/A np sqrt trials 1 N/A N/A episode_t_value timestep_t_value mean error number_episodes number_timesteps seconds_to_solve seconds_in_total episode_t_value timestep_t_value mean error N/A len episode_rewards N/A sum episode_lengths seconds_to_solve seconds_in_total N/A running_mean N/A N/A x N N/A N/A N/A x N/A N/A np array x dtype float64 N/A cumsum N/A N/A np cumsum N/A N/A np insert x 0 0 N/A N/A N/A N/A cumsum N/A N N/A cumsum N/A N/A N N N/A compute_graph_stats N/A N/A episode_lengths episode_rewards timestamps initial_reset_timestamp buckets N/A N/A N/A Method to compute the aggregates for the graphs. N/A scipy N/A num_episodes N/A len episode_lengths N/A episode_rewards N/A N/A np array episode_rewards N/A episode_lengths N/A N/A np array episode_lengths N/A x_timestep N/A N/A N/A np cumsum N/A N/A np insert episode_lengths 0 0 N/A -1 N/A N/A N/A len x_timestep num_episodes N/A x_seconds N/A N/A timestamp initial_reset_timestamp N/A timestamp timestamps N/A x_episode N/A range num_episodes N/A x_timestep_y_reward N/A N/A N/A scipy stats binned_statistic x_timestep episode_rewards median buckets N/A x_timestep_y_length N/A N/A N/A scipy stats binned_statistic x_timestep episode_lengths median buckets N/A x_episode_y_reward N/A N/A N/A scipy stats binned_statistic x_episode episode_rewards median buckets N/A x_episode_y_length N/A N/A N/A scipy stats binned_statistic x_episode episode_lengths median buckets N/A x_seconds_y_reward N/A N/A N/A scipy stats binned_statistic x_seconds episode_rewards median buckets N/A x_seconds_y_length N/A N/A N/A scipy stats binned_statistic x_seconds episode_lengths median buckets N/A N/A initial_reset_timestamp x_timestep_y_reward x_timestep_y_length x_episode_y_reward x_episode_y_length x_seconds_y_length x_seconds_y_reward initial_reset_timestamp N/A graphable_binned_statistic x_timestep_y_reward N/A graphable_binned_statistic x_timestep_y_length N/A graphable_binned_statistic x_episode_y_reward N/A graphable_binned_statistic x_episode_y_length N/A graphable_binned_statistic x_seconds_y_length N/A graphable_binned_statistic x_seconds_y_reward N/A graphable_binned_statistic N/A N/A binned N/A N/A N/A x N/A running_mean N/A binned bin_edges 2 N/A y N/A binned statistic N/A N/A N/A len x N/A len y N/A valid N/A N/A N/A np logical_not N/A N/A np isnan x N/A N/A np logical_not N/A N/A np isnan y N/A x N/A x N/A valid N/A y N/A y N/A valid N/A N/A x y x y N/A