Module Expr Str Import alias Import alias Import alias Import alias Import alias Import alias Import alias Import alias Import alias identifier Import alias identifier ImportFrom alias alias ImportFrom alias Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Assign NameStore Num Assign NameStore Str Assign NameStore Str TryExcept body Import alias handlers ExceptHandler type NameLoad body Print Str Expr Call AttributeLoad NameLoad attr Num ClassDef bases AttributeLoad NameLoad attr body FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam defaults NameLoad body Import alias Assign NameStore Call AttributeLoad Str attr NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad keyword NameLoad Expr Call NameLoad NameLoad AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr decorator_list decorator_list Assign NameStore Call AttributeLoad NameLoad attr keyword Str Expr Call AttributeLoad NameLoad attr Str Str keyword Str keyword Str keyword Str keyword NameLoad Expr Call AttributeLoad NameLoad attr Str Str keyword Str keyword NameLoad keyword NameLoad Expr Call AttributeLoad NameLoad attr Str Str keyword Str keyword NameLoad keyword NameLoad Expr Call AttributeLoad NameLoad attr Str keyword Str keyword NameLoad Expr Call AttributeLoad NameLoad attr Str keyword Str keyword NameLoad Expr Call AttributeLoad NameLoad attr Str Str keyword BinOpMod Str NameLoad keyword NameLoad keyword Num Expr Call AttributeLoad NameLoad attr Str Str keyword Str keyword Str keyword Str Expr Call AttributeLoad NameLoad attr Str Str keyword Str keyword Str keyword NameLoad keyword Str Expr Call AttributeLoad NameLoad attr Str Str keyword Str keyword Str keyword Str keyword Str Expr Call AttributeLoad NameLoad attr Str Str keyword Str keyword Str keyword Num keyword NameLoad keyword Str Expr Call AttributeLoad NameLoad attr Str Str keyword Str keyword Str keyword Num keyword NameLoad keyword Str Expr Call AttributeLoad NameLoad attr Str Str keyword Str keyword Str keyword Num keyword NameLoad keyword Str Expr Call AttributeLoad NameLoad attr Str Str keyword Str keyword Str keyword Num keyword NameLoad keyword Str Expr Call AttributeLoad NameLoad attr Str Str keyword Str keyword Str keyword Num keyword NameLoad keyword Str Expr Call AttributeLoad NameLoad attr Str Str keyword Str keyword Str keyword Num keyword NameLoad keyword Str Expr Call AttributeLoad NameLoad attr Str Str keyword NameLoad keyword Str keyword Str Expr Call AttributeLoad NameLoad attr Str keyword Str keyword NameLoad keyword Str Expr Call AttributeLoad NameLoad attr Str Str keyword NameLoad keyword Str keyword Str FunctionDef arguments args NameParam NameParam defaults body Expr Str Assign NameStore Call NameLoad Call AttributeLoad NameLoad attr Assign NameStore Call NameLoad Call NameLoad NameLoad Call AttributeLoad Call AttributeLoad NameLoad attr NameLoad attr Assign AttributeStore NameLoad attr Call AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr Assign NameStore Call AttributeLoad Call AttributeLoad NameLoad attr SubscriptLoad NameLoad Index Str keyword Str attr Str Return NameLoad decorator_list FunctionDef arguments args NameParam defaults body Print BinOpMod Str NameLoad decorator_list FunctionDef arguments args defaults body Import alias Expr Call AttributeLoad NameLoad attr decorator_list FunctionDef arguments args defaults body Import alias Expr Call AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam defaults body ImportFrom alias ImportFrom alias ImportFrom alias ImportFrom alias alias alias alias Assign NameStore BoolOpOr AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr TryFinally body Expr Call NameLoad BinOpMod Str NameLoad Assign NameStore Call NameLoad NameLoad Expr Call NameLoad Str Assign AttributeStore NameLoad attr Call NameLoad AttributeLoad NameLoad attr Assign NameStore Call NameLoad NameLoad NameLoad NameLoad NameLoad NameLoad NameLoad NameLoad keyword NameLoad keyword NameLoad Assign NameStore AttributeLoad NameLoad attr Assign NameStore BoolOpOr AttributeLoad NameLoad attr SubscriptLoad AttributeLoad NameLoad attr Index Num Assign NameStore AttributeLoad NameLoad attr Assign TupleStore AttributeStore NameLoad attr AttributeStore NameLoad attr AttributeStore NameLoad attr AttributeStore NameLoad attr Call NameLoad NameLoad NameLoad AttributeLoad NameLoad attr Expr Call NameLoad BinOpMod Str TupleLoad NameLoad Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Str Expr Call NameLoad BinOpMod Str TupleLoad NameLoad Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Str Expr Call NameLoad Str Expr Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Expr Call NameLoad BinOpMod Str NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Expr Call NameLoad BinOpMod Str NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Expr Call NameLoad Str Assign NameStore Call NameLoad NameLoad NameLoad Assign NameStore Call NameLoad NameLoad NameLoad Expr Call NameLoad NameLoad NameLoad finalbody Expr Call AttributeLoad NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults Str body Expr Str FunctionDef arguments args NameParam defaults body Assign NameStore Call NameLoad NameLoad NameLoad Assign NameStore Call NameLoad Call NameLoad Num Assign NameStore Call NameLoad AttributeLoad NameLoad attr Assign SubscriptStore NameLoad Index Num Str Assign AttributeStore NameLoad attr NameLoad Assign SubscriptStore NameLoad Index Str Call NameLoad AttributeLoad NameLoad attr Return NameLoad decorator_list Return Call NameLoad NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Expr Str Assign TupleStore NameStore NameStore Call AttributeLoad NameLoad attr NameLoad Assign NameStore BinOpDiv SubscriptLoad NameLoad Index Str SubscriptLoad NameLoad Index Str Assign NameStore Call NameLoad Dict NameLoad NameLoad Str Str SubscriptLoad NameLoad Index Str SubscriptLoad NameLoad Index Str NameLoad AttributeLoad NameLoad attr keyword ListLoad NameLoad NameLoad Str Str Assign NameStore SubscriptLoad AttributeLoad NameLoad attr Index CompareGt SubscriptLoad NameLoad Index NameLoad AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad Call AttributeLoad Call AttributeLoad NameLoad attr attr Str attr Str Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body TryExcept body Assign NameStore Call AttributeLoad NameLoad attr NameLoad handlers ExceptHandler body Import alias Expr Call AttributeLoad NameLoad attr Assign NameStore Call NameLoad NameLoad NameLoad Assign NameStore AttributeLoad NameLoad attr Assign NameStore AttributeLoad NameLoad attr Assign NameStore NameStore Str TryExcept body Assign NameStore Call AttributeLoad AttributeLoad Call AttributeLoad NameLoad attr NameLoad attr attr handlers ExceptHandler type AttributeLoad AttributeLoad NameLoad attr attr body Pass TryExcept body Assign NameStore Call AttributeLoad AttributeLoad Call AttributeLoad NameLoad attr NameLoad attr attr handlers ExceptHandler type AttributeLoad AttributeLoad NameLoad attr attr body Pass Expr Call NameLoad NameLoad keyword NameLoad keyword NameLoad keyword NameLoad keyword NameLoad If AttributeLoad NameLoad attr body Expr Call NameLoad BinOpMod Str AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam defaults body Import alias Assign NameStore ListLoad Expr Call AttributeLoad NameLoad attr TryExcept body ImportFrom alias alias Expr Call AttributeLoad NameLoad attr Str Assign NameStore Call NameLoad Str Expr Call AttributeLoad NameLoad attr Num handlers ExceptHandler body Pass Assign NameStore BinOpAdd AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign NameStore ListLoad TryFinally body For NameStore Call NameLoad NameLoad body Expr Call AttributeLoad NameLoad attr Assign NameStore Call NameLoad TryExcept body Assign NameStore Call AttributeLoad NameLoad attr handlers ExceptHandler type NameLoad body Raise ExceptHandler type NameLoad name NameStore body Assign NameStore Str TryExcept body Assign NameStore Call AttributeLoad NameLoad attr Str If CompareIs NameLoad NameLoad body Assign NameStore Call NameLoad NameLoad handlers ExceptHandler body Pass Print BinOpMod Str TupleLoad AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr Str AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr finalbody Expr Call AttributeLoad NameLoad attr If NameLoad body Assign NameStore SubscriptLoad NameLoad Slice AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr Return Call NameLoad NameLoad keyword AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam defaults body Print BinOpMod Str TupleLoad Call NameLoad NameLoad AttributeLoad NameLoad attr Assign NameStore ListComp Call NameLoad NameLoad comprehension NameStore NameLoad Print Str Assign NameStore Call NameLoad NameLoad Assign AttributeStore NameLoad attr ListComp BinOpMod Str NameLoad comprehension NameStore Call NameLoad AttributeLoad NameLoad attr Assign TupleStore NameStore NameStore NameStore NameStore Call NameLoad NameLoad NameLoad keyword Str Expr Call NameLoad NameLoad keyword SubscriptLoad NameLoad Index Num keyword SubscriptLoad NameLoad Index Num If AttributeLoad NameLoad attr body Expr Call NameLoad BinOpMod Str AttributeLoad NameLoad attr Expr Call AttributeLoad Call NameLoad NameLoad attr AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam defaults NameLoad Str NameLoad Str body Assign NameStore Num Assign NameStore Num Assign NameStore Call AttributeLoad BinOpMod Str NameLoad attr Str AugAssignAdd NameStore BinOpMult BinOpMod Str NameLoad Call NameLoad AttributeLoad NameLoad attr AugAssignAdd NameStore Str Assign NameStore Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign NameStore BinOpAdd BinOpAdd BinOpAdd BinOpAdd BinOpAdd BinOpMult Str Call NameLoad NameLoad Str NameLoad Str BinOpMult Str Call NameLoad NameLoad Str Assign NameStore NameLoad Assign NameStore Str AugAssignAdd NameStore Str AugAssignAdd NameStore BinOpMod Str BoolOpOr AttributeLoad NameLoad attr Str AugAssignAdd NameStore BinOpMod Str AttributeLoad NameLoad attr AugAssignAdd NameStore Str AugAssignAdd NameStore NameLoad For NameStore Call NameLoad Call NameLoad NameLoad body Assign NameStore BinOpMod Str NameLoad AugAssignAdd NameStore BinOpMult BinOpMod Str BinOpSub NameLoad Num Call NameLoad AttributeLoad NameLoad attr AugAssignAdd NameStore Str AugAssignAdd NameStore Call AttributeLoad NameLoad attr SubscriptLoad AttributeLoad NameLoad attr Index NameLoad Call NameLoad AttributeLoad SubscriptLoad AttributeLoad NameLoad attr Index NameLoad attr AugAssignAdd NameStore BinOpAdd NameLoad Str AugAssignAdd NameStore Str AugAssignAdd NameStore BinOpMod Str AttributeLoad NameLoad attr If NameLoad body AugAssignAdd NameStore BinOpMod Str TupleLoad NameLoad NameLoad If NameLoad body AugAssignAdd NameStore BinOpMod Str TupleLoad NameLoad NameLoad Assign NameStore Str If AttributeLoad NameLoad attr body TryExcept body Assign AttributeStore AttributeLoad AttributeLoad NameLoad attr attr attr NameLoad handlers ExceptHandler body Pass AugAssignAdd NameStore BinOpAdd Call NameLoad AttributeLoad Call AttributeLoad AttributeLoad NameLoad attr attr attr Str AugAssignAdd NameStore NameLoad Assign NameStore Call NameLoad AttributeLoad NameLoad attr Str Expr Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr If UnaryOpNot AttributeLoad NameLoad attr body Expr Call NameLoad NameLoad If BoolOpAnd AttributeLoad NameLoad attr AttributeLoad NameLoad attr body Expr Call NameLoad NameLoad Expr Call NameLoad BinOpMod Str AttributeLoad NameLoad attr decorator_list FunctionDef arguments args defaults body ImportFrom alias If UnaryOpNot AttributeLoad NameLoad attr body Assign AttributeStore NameLoad attr Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Str Assign NameStore AttributeLoad AttributeLoad NameLoad attr attr If AttributeLoad NameLoad attr body Assign AttributeStore NameLoad attr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr If AttributeLoad NameLoad attr body Assign AttributeStore NameLoad attr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr If BoolOpAnd AttributeLoad NameLoad attr AttributeLoad NameLoad attr body Assign NameStore Call NameLoad Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign NameStore Call NameLoad Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Expr Call NameLoad NameLoad NameLoad Expr Call AttributeLoad NameLoad attr Num If CompareIsNot AttributeLoad NameLoad attr NameLoad body TryExcept body Import alias If Call NameLoad AttributeLoad NameLoad attr Str body Expr Call AttributeLoad Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr attr ListLoad AttributeLoad NameLoad attr Print BinOpMod Str AttributeLoad NameLoad attr handlers ExceptHandler type NameLoad body Print Str Expr Call AttributeLoad NameLoad attr Num Print Str Expr Call NameLoad BinOpMod Str AttributeLoad NameLoad attr If AttributeLoad NameLoad attr body Expr Call NameLoad BinOpMod Str AttributeLoad NameLoad attr Print Str Expr Call AttributeLoad NameLoad attr Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Assign NameStore ListComp NameLoad comprehension NameStore NameLoad Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr For NameStore NameLoad body Assign AttributeStore NameLoad attr AttributeLoad NameLoad attr If AttributeLoad NameLoad attr body Assign AttributeStore NameLoad attr AttributeLoad NameLoad attr If NameLoad body If AttributeLoad NameLoad attr body Expr Call NameLoad NameLoad orelse Expr Call NameLoad NameLoad orelse Print Str Expr Call AttributeLoad NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults NameLoad body ImportFrom alias ImportFrom alias ImportFrom alias identifier Assign NameStore BinOpMod Str TupleLoad NameLoad NameLoad Assign NameStore BinOpAdd NameLoad BinOpAdd BinOpAdd BinOpAdd Str Str BinOpMod Str NameLoad Str Expr Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call AttributeLoad Call NameLoad Str attr Expr Call AttributeLoad NameLoad attr Str Assign NameStore ListLoad Assign NameStore ListLoad Assign NameStore ListLoad Assign NameStore ListLoad For NameStore Call AttributeLoad NameLoad attr Str body If CompareNotIn Str SubscriptLoad Call AttributeLoad NameLoad attr Str Index Num body Continue Assign TupleStore NameStore NameStore NameStore NameStore NameStore Call AttributeLoad NameLoad attr Str Num Assign NameStore Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call NameLoad NameLoad Assign NameStore Call NameLoad NameLoad NameLoad Assign NameStore Call NameLoad NameLoad NameLoad Assign NameStore Call NameLoad NameLoad NameLoad Assign NameStore Call NameLoad NameLoad NameLoad Return TupleLoad SubscriptLoad NameLoad Slice Num SubscriptLoad NameLoad Slice Num SubscriptLoad NameLoad Slice Num SubscriptLoad NameLoad Slice Num decorator_list FunctionDef arguments args NameParam defaults body FunctionDef arguments args NameParam defaults body Return Call NameLoad NameLoad NameLoad decorator_list Return NameLoad decorator_list If CompareEq NameLoad Str body Assign NameStore Call AttributeLoad NameLoad attr If BoolOpAnd UnaryOpNot AttributeLoad NameLoad attr UnaryOpNot BoolOpAnd AttributeLoad NameLoad attr AttributeLoad NameLoad attr UnaryOpNot BoolOpAnd AttributeLoad NameLoad attr AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr Num orelse If BoolOpAnd BoolOpOr AttributeLoad NameLoad attr AttributeLoad NameLoad attr UnaryOpNot BoolOpAnd AttributeLoad NameLoad attr AttributeLoad NameLoad attr body Print Str Expr Call AttributeLoad NameLoad attr Num If BoolOpAnd BoolOpOr AttributeLoad NameLoad attr AttributeLoad NameLoad attr UnaryOpNot BoolOpAnd AttributeLoad NameLoad attr AttributeLoad NameLoad attr body If UnaryOpNot AttributeLoad NameLoad attr body Print Str Assign AttributeStore NameLoad attr SubscriptLoad Call AttributeLoad AttributeLoad NameLoad attr attr Str Index Num If UnaryOpNot AttributeLoad NameLoad attr body Print Str Assign AttributeStore NameLoad attr SubscriptLoad Call AttributeLoad AttributeLoad NameLoad attr attr Str Index Num Import alias Expr Call AttributeLoad NameLoad attr Str keyword NameLoad Expr Call AttributeLoad NameLoad attr Str keyword NameLoad If BoolOpAnd AttributeLoad NameLoad attr AttributeLoad NameLoad attr body Print Str Assign NameStore Call AttributeLoad NameLoad attr NameLoad For NameStore ListLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr body TryExcept body Assign NameStore Call AttributeLoad AttributeLoad Call AttributeLoad NameLoad attr NameLoad attr attr handlers ExceptHandler type AttributeLoad NameLoad attr body Print BinOpMod Str NameLoad Expr Call AttributeLoad NameLoad attr Num orelse Print BinOpMod Str TupleLoad NameLoad NameLoad Expr Call NameLoad
N/A N/A 
What
----
vbench is a library which can be used to benchmark the performance
of a codebase over time.
Although vbench can collect data over many commites, generate plots
and other niceties, for Pull-Requests the important thing is the
performance of the HEAD commit against a known-good baseline.

This script tries to automate the process of comparing these
two commits, and is meant to run out of the box on a fresh
clone.

How
---
These are the steps taken:
1) create a temp directory into which vbench will clone the temporary repo.
2) instantiate a vbench runner, using the local repo as the source repo.
3) perform a vbench run for the baseline commit, then the target commit.
4) pull the results for both commits from the db. use pandas to align
everything and calculate a ration for the timing information.
5) print the results to the log file and to stdout.

 N/A shutil N/A os N/A sys N/A argparse N/A tempfile N/A time N/A re N/A random N/A numpy np N/A pandas pd pandas DataFrame Series suite REPO_PATH N/A VB_DIR N/A N/A N/A os path dirname N/A N/A N/A os path dirname N/A N/A N/A os path abspath __file__ N/A DEFAULT_MIN_DURATION 0.01 N/A HEAD_COL head[ms] N/A BASE_COL base[ms] N/A N/A N/A git N/A N/A N/A Exception N/A N/A Error: Please install the `gitpython` package
 N/A N/A N/A sys exit 1 RevParseAction N/A N/A argparse Action N/A __call__ N/A N/A self parser namespace values option_string N/A None N/A N/A subprocess N/A cmd N/A N/A git rev-parse --short -verify {0}^{{commit}} format values N/A rev_parse N/A N/A subprocess check_output cmd shell True N/A N/A setattr namespace N/A self dest N/A N/A rev_parse strip N/A N/A N/A parser N/A N/A argparse ArgumentParser description Use vbench to measure and compare the performance of commits. N/A N/A N/A parser add_argument -H --head help Execute vbenches using the currently checked out copy. dest head action store_true default False N/A N/A N/A parser add_argument -b --base-commit help The commit serving as performance baseline  type str action RevParseAction N/A N/A N/A parser add_argument -t --target-commit help The commit to compare against the baseline (default: HEAD). type str action RevParseAction N/A N/A N/A parser add_argument --base-pickle help name of pickle file with timings data generated by a former `-H -d FILE` run. filename must be of the form <hash>-*.* or specify --base-commit seperately type str N/A N/A N/A parser add_argument --target-pickle help name of pickle file with timings data generated by a former `-H -d FILE` run filename must be of the form <hash>-*.* or specify --target-commit seperately type str N/A N/A N/A parser add_argument -m --min-duration help N/A Minimum duration (in ms) of baseline test for inclusion in report (default: %.3f). DEFAULT_MIN_DURATION type float default 0.01 N/A N/A N/A parser add_argument -o --output metavar <file> dest log_file help Path of file in which to save the textual report (default: vb_suite.log). N/A N/A N/A parser add_argument -d --outdf metavar FNAME dest outdf default None help Name of file to df.save() the result table into. Will overwrite N/A N/A N/A parser add_argument -r --regex metavar REGEX dest regex default help Regex pat, only tests whose name matches the regext will be run. N/A N/A N/A parser add_argument -s --seed metavar SEED dest seed default 1234 type int help Integer value to seed PRNG with N/A N/A N/A parser add_argument -n --repeats metavar N dest repeats default 3 type int help Number of times to run each vbench, result value is the best of N/A N/A N/A parser add_argument -c --ncalls metavar N dest ncalls default 3 type int help Number of calls to in each repetition of a vbench N/A N/A N/A parser add_argument -N --hrepeats metavar N dest hrepeats default 1 type int help implies -H, number of times to run the vbench suite on the head commit.
Each iteration will yield another column in the output N/A N/A N/A parser add_argument -a --affinity metavar a dest affinity default 1 type int help set processor affinity of process by default bind to cpu/core #1 only. Requires the "affinity" or "psutil" python module, will raise Warning otherwise N/A N/A N/A parser add_argument -u --burnin metavar u dest burnin default 1 type int help Number of extra iteration per benchmark to perform first, then throw away.  N/A N/A N/A parser add_argument -S --stats default False action store_true help when specified with -N, prints the output of describe() per vbench results.  N/A N/A N/A parser add_argument --temp-dir metavar PATH default None help Specify temp work dir to use. ccache depends on builds being invoked from consistent directory. N/A N/A N/A parser add_argument -q --quiet default False action store_true help Suppress report output to stdout.  get_results_df N/A N/A db rev N/A N/A N/A Takes a git commit hash and returns a Dataframe of benchmark results
     N/A bench N/A DataFrame N/A N/A db get_benchmarks N/A results N/A DataFrame N/A map list N/A N/A N/A N/A db get_rev_results rev values N/A N/A results columns N/A N/A N/A N/A db _results c keys N/A results N/A N/A N/A N/A results join N/A bench N/A name on checksum set_index checksum N/A results N/A prprint N/A N/A s N/A N/A N/A N/A *** %s s N/A pre_hook N/A N/A N/A N/A N/A gc N/A N/A N/A gc disable N/A post_hook N/A N/A N/A N/A N/A gc N/A N/A N/A gc enable N/A profile_comparative N/A N/A benchmarks N/A N/A vbench.api BenchmarkRunner vbench.db BenchmarkDB vbench.git GitRepo suite BUILD DB_PATH PREPARE dependencies N/A TMP_DIR N/A N/A args temp_dir N/A N/A tempfile mkdtemp N/A N/A N/A N/A prprint N/A Opening DB at '%s'...
 DB_PATH N/A db N/A BenchmarkDB DB_PATH N/A N/A prprint Initializing Runner... N/A N/A GitRepo _parse_commit_log N/A _parse_wrapper N/A args base_commit N/A runner N/A BenchmarkRunner benchmarks REPO_PATH REPO_PATH BUILD DB_PATH TMP_DIR PREPARE always_clean True module_dependencies dependencies N/A repo N/A runner repo N/A h_head N/A N/A args target_commit N/A N/A repo shas N/A -1 N/A h_baseline N/A args base_commit N/A N/A N/A repo shas N/A repo messages N/A repo timestamps N/A repo authors N/A _parse_commit_log None REPO_PATH N/A args base_commit N/A N/A prprint N/A Target [%s] : %s
 N/A h_head N/A N/A N/A repo messages get h_head N/A N/A prprint N/A Baseline [%s] : %s
 N/A h_baseline N/A N/A N/A repo messages get h_baseline N/A N/A prprint Removing any previous measurements for the commits. N/A N/A N/A db delete_rev_results h_baseline N/A N/A N/A db delete_rev_results h_head N/A N/A prprint N/A Running benchmarks for baseline [%s] h_baseline N/A N/A N/A runner _run_and_write_results h_baseline N/A N/A prprint N/A Running benchmarks for target [%s] h_head N/A N/A N/A runner _run_and_write_results h_head N/A N/A prprint Processing results... N/A head_res N/A get_results_df db h_head N/A baseline_res N/A get_results_df db h_baseline N/A N/A report_comparative head_res baseline_res N/A N/A N/A N/A shutil rmtree TMP_DIR N/A prep_pickle_for_total N/A N/A df agg_name N/A median N/A N/A 
    accepts a datafram resulting from invocation with -H -d o.pickle
    If multiple data columns are present (-N was used), the
    `agg_name` attr of the datafram will be used to reduce
    them to a single value per vbench, df.median is used by defa
    ult.

    Returns a datadrame of the form expected by prep_totals
     prep N/A N/A df N/A N/A N/A agg N/A getattr df agg_name N/A df N/A DataFrame N/A agg 1 N/A cols N/A list N/A df columns N/A N/A cols N/A 0 timing N/A N/A df columns cols N/A N/A df N/A name N/A list N/A df index N/A df N/A N/A N/A prep df N/A prep_totals N/A N/A head_res baseline_res N/A N/A N/A 
    Each argument should be a dataframe with  'timing' and 'name' columns
    where name is the name of the vbench.

    returns a 'totals' dataframe, suitable as input for print_report.
     N/A N/A head_res baseline_res N/A N/A head_res align baseline_res N/A ratio N/A N/A head_res N/A timing N/A baseline_res N/A timing N/A totals N/A DataFrame N/A HEAD_COL BASE_COL ratio name N/A head_res N/A timing N/A baseline_res N/A timing ratio N/A baseline_res name columns N/A HEAD_COL BASE_COL ratio name N/A totals N/A N/A totals ix N/A N/A N/A totals N/A HEAD_COL N/A args min_duration N/A totals N/A N/A N/A N/A N/A N/A totals dropna sort ratio set_index name N/A totals N/A report_comparative N/A N/A head_res baseline_res N/A N/A N/A N/A N/A r N/A N/A git Repo VB_DIR N/A N/A N/A N/A pdb N/A N/A N/A pdb set_trace N/A totals N/A prep_totals head_res baseline_res N/A h_head N/A args target_commit N/A h_baseline N/A args base_commit N/A h_msg b_msg Unknown N/A N/A N/A h_msg N/A N/A N/A N/A N/A r commit h_head message strip N/A N/A N/A N/A N/A git exc BadObject N/A N/A N/A N/A N/A b_msg N/A N/A N/A N/A N/A r commit h_baseline message strip N/A N/A N/A N/A N/A git exc BadObject N/A N/A N/A N/A print_report totals h_head h_head h_msg h_msg h_baseline h_baseline b_msg b_msg N/A N/A args outdf N/A N/A N/A prprint N/A The results DataFrame was written to '%s'
 N/A args outdf N/A N/A N/A totals save N/A args outdf N/A profile_head_single N/A N/A benchmark N/A N/A N/A gc N/A results N/A N/A N/A N/A gc collect N/A N/A ctypes cdll CDLL N/A N/A N/A cdll LoadLibrary libc.so.6 N/A libc N/A CDLL libc.so.6 N/A N/A N/A libc malloc_trim 0 N/A N/A N/A N/A N/A N N/A N/A args hrepeats N/A args burnin N/A results N/A N/A N/A N/A i N/A range N N/A N/A N/A N/A gc disable N/A d N/A dict N/A N/A N/A d N/A N/A benchmark run N/A N/A N/A KeyboardInterrupt N/A N/A N/A N/A Exception N/A e N/A N/A err N/A N/A N/A err N/A N/A d get traceback N/A N/A err None N/A N/A err N/A str e N/A N/A N/A N/A N/A N/A %s died with:
%s
Skipping...
 N/A N/A benchmark name err N/A N/A N/A results append N/A N/A d get timing N/A np nan N/A N/A N/A gc enable N/A N/A N/A gc collect N/A N/A N/A N/A gc enable N/A results N/A N/A results N/A results N/A N/A args burnin N/A N/A N/A N/A sys stdout write . N/A N/A N/A N/A sys stdout flush N/A N/A Series results name N/A benchmark name N/A profile_head N/A N/A benchmarks N/A N/A N/A N/A Performing %d benchmarks (%d runs each) N/A N/A len benchmarks N/A args hrepeats N/A ss N/A N/A profile_head_single b N/A b benchmarks N/A N/A results N/A DataFrame ss N/A N/A results columns N/A N/A #%d i N/A i N/A range N/A args hrepeats N/A N/A shas messages _ _ N/A _parse_commit_log None REPO_PATH base_commit HEAD^ N/A N/A print_report results h_head N/A shas N/A -1 h_msg N/A messages N/A -1 N/A N/A args outdf N/A N/A N/A prprint N/A The results DataFrame was written to '%s'
 N/A args outdf N/A N/A N/A N/A DataFrame results save N/A args outdf N/A print_report N/A N/A df h_head h_msg h_baseline b_msg N/A None None N/A N/A name_width 45 N/A col_width 10 N/A hdr N/A N/A N/A {:%s} name_width format Test name N/A hdr N/A N/A |{:^%d} col_width N/A len N/A df columns N/A hdr | N/A hdr N/A N/A hdr format N/A df columns N/A hdr N/A N/A N/A N/A N/A N/A - N/A len hdr hdr N/A - N/A len hdr N/A ftr hdr N/A s N/A s Invoked with :
 N/A s N/A --ncalls: %s
 N/A N/A args ncalls Auto N/A s N/A --repeats: %s
 N/A args repeats N/A s N/A s hdr N/A i N/A range N/A len df N/A N/A lfmt N/A {:%s} name_width N/A lfmt N/A N/A | {:%d.4f}  N/A col_width 2 N/A len N/A df columns N/A lfmt |
 N/A s N/A N/A lfmt format N/A N/A df index N/A i N/A list N/A N/A N/A df iloc N/A i values N/A s N/A ftr N/A s Ratio < 1.0 means the target commit is faster then the baseline.
 N/A s N/A Seed used: %d

 N/A args seed N/A h_head N/A N/A s N/A Target [%s] : %s
 N/A h_head h_msg N/A h_baseline N/A N/A s N/A Base   [%s] : %s

 N/A h_baseline b_msg N/A stats_footer N/A N/A args stats N/A N/A N/A N/A N/A N/A N/A pd options display expand_frame_repr False N/A N/A N/A N/A N/A stats_footer N/A N/A str N/A N/A N/A N/A df T describe T N/A s stats_footer N/A logfile N/A open N/A args log_file w N/A N/A N/A logfile write s N/A N/A N/A logfile close N/A N/A N/A args quiet N/A N/A N/A prprint s N/A N/A N/A args stats N/A args quiet N/A N/A N/A prprint stats_footer N/A N/A prprint N/A Results were also written to the logfile at '%s' N/A args log_file N/A main N/A N/A N/A N/A suite benchmarks N/A N/A N/A args log_file N/A N/A N/A args log_file N/A N/A N/A os path abspath N/A N/A N/A os path join REPO_PATH vb_suite.log N/A saved_dir N/A N/A os path curdir N/A N/A args outdf N/A N/A N/A args outdf N/A N/A N/A os path realpath N/A args outdf N/A N/A args log_file N/A N/A N/A args log_file N/A N/A N/A os path realpath N/A args log_file N/A N/A N/A random seed N/A args seed N/A N/A N/A N/A np random seed N/A args seed N/A N/A N/A args base_pickle N/A args target_pickle N/A N/A baseline_res N/A prep_pickle_for_total N/A N/A pd load N/A args base_pickle N/A target_res N/A prep_pickle_for_total N/A N/A pd load N/A args target_pickle N/A N/A report_comparative target_res baseline_res N/A N/A N/A sys exit 0 N/A N/A N/A args affinity None N/A N/A N/A N/A psutil N/A N/A hasattr N/A psutil Process set_cpu_affinity N/A N/A N/A N/A N/A N/A psutil Process N/A N/A os getpid set_cpu_affinity N/A N/A args affinity N/A N/A CPU affinity set to %d N/A args affinity N/A N/A N/A ImportError N/A N/A -a/--affinity specified, but the 'psutil' module is not available, aborting.
 N/A N/A N/A sys exit 1 N/A N/A N/A prprint N/A LOG_FILE = %s N/A args log_file N/A N/A args outdf N/A N/A N/A prprint N/A PICKE_FILE = %s N/A args outdf N/A N/A N/A N/A os chdir N/A N/A N/A os path dirname N/A N/A N/A os path abspath __file__ N/A benchmarks N/A x N/A x benchmarks N/A N/A re search N/A args regex N/A x name N/A b benchmarks N/A N/A N/A b repeat N/A args repeats N/A N/A args ncalls N/A N/A N/A b ncalls N/A args ncalls N/A benchmarks N/A N/A N/A args head N/A N/A N/A profile_head benchmarks N/A N/A N/A profile_comparative benchmarks N/A N/A No matching benchmarks N/A N/A N/A os chdir saved_dir N/A _parse_commit_log N/A N/A this repo_path base_commit N/A None N/A vbench.git _convert_timezones pandas Series dateutil parser dparser N/A git_cmd N/A git --git-dir=%s/.git --work-tree=%s  N/A repo_path repo_path N/A githist N/A git_cmd N/A N/A N/A log --graph --pretty=format: "::%h::%cd::%s::%an" N/A %s.. base_commit > githist.txt N/A N/A N/A os system githist N/A githist N/A N/A N/A open githist.txt read N/A N/A N/A os remove githist.txt N/A shas N/A N/A timestamps N/A N/A messages N/A N/A authors N/A N/A line N/A N/A githist split N/A N/A N/A * N/A N/A N/A line split :: N/A 0 N/A N/A N/A N/A _ sha stamp message author N/A N/A line split :: 4 N/A stamp N/A N/A dparser parse stamp N/A N/A N/A shas append sha N/A N/A N/A timestamps append stamp N/A N/A N/A messages append message N/A N/A N/A authors append author N/A timestamps N/A _convert_timezones timestamps N/A shas N/A Series shas timestamps N/A messages N/A Series messages shas N/A timestamps N/A Series timestamps shas N/A authors N/A Series authors shas N/A N/A N/A shas N/A -1 N/A messages N/A -1 N/A timestamps N/A -1 N/A authors N/A -1 N/A _parse_wrapper N/A N/A base_commit N/A N/A inner N/A N/A repo_path N/A N/A N/A N/A _parse_commit_log repo_path base_commit N/A N/A inner N/A N/A N/A __name__ __main__ N/A N/A args N/A N/A parser parse_args N/A N/A N/A N/A args head N/A N/A N/A args base_commit N/A args target_commit N/A N/A N/A args base_pickle N/A args target_pickle N/A N/A N/A N/A parser print_help N/A N/A N/A sys exit 1 N/A N/A N/A N/A N/A args base_pickle N/A args target_pickle N/A N/A N/A args base_pickle N/A args target_pickle N/A N/A Must specify Both --base-pickle and --target-pickle. N/A N/A N/A sys exit 1 N/A N/A N/A N/A args base_pickle N/A args target_pickle N/A N/A N/A args base_commit N/A args target_commit N/A N/A N/A N/A args base_commit N/A N/A base_commit not specified, Assuming base_pickle is named <commit>-foo.* N/A N/A args base_commit N/A N/A N/A N/A args base_pickle split - N/A 0 N/A N/A N/A args target_commit N/A N/A target_commit not specified, Assuming target_pickle is named <commit>-foo.* N/A N/A args target_commit N/A N/A N/A N/A args target_pickle split - N/A 0 N/A warnings N/A N/A N/A warnings filterwarnings ignore category FutureWarning N/A N/A N/A warnings filterwarnings ignore category DeprecationWarning N/A N/A N/A args base_commit N/A args target_commit N/A N/A Verifying specified commits exist in repo... N/A r N/A N/A git Repo VB_DIR N/A c N/A N/A args base_commit N/A args target_commit N/A N/A N/A N/A msg N/A N/A N/A N/A N/A r commit c message strip N/A N/A N/A N/A git BadObject N/A N/A N/A The commit '%s' was not found, aborting... c N/A N/A N/A sys exit 1 N/A N/A N/A %s: %s N/A c msg N/A N/A main