Module ImportFrom alias ImportFrom alias ImportFrom alias alias ImportFrom alias alias ClassDef bases NameLoad body FunctionDef arguments args NameParam defaults body Assign NameStore Call NameLoad Call NameLoad Str NameLoad ListLoad Str Str Assert CompareEq AttributeLoad NameLoad attr Str decorator_list FunctionDef arguments args NameParam defaults body Assign NameStore Call NameLoad Assign AttributeStore NameLoad attr Lambda arguments args NameParam NameParam defaults Num Assert CompareEq AttributeLoad Call NameLoad NameLoad Str Call AttributeLoad NameLoad attr ListLoad Str Str attr Num decorator_list FunctionDef arguments args NameParam defaults body Assign NameStore Call NameLoad Assign AttributeStore NameLoad attr Lambda arguments args NameParam NameParam defaults Num Assert CompareEq AttributeLoad Call NameLoad NameLoad Str Call AttributeLoad NameLoad attr ListLoad Str Str attr Num decorator_list FunctionDef arguments args NameParam defaults body Assign NameStore Call NameLoad Assign AttributeStore NameLoad attr Lambda arguments args defaults ListLoad Call NameLoad Call NameLoad Call NameLoad Assert CompareEq Call NameLoad Call AttributeLoad NameLoad attr NameLoad Num decorator_list FunctionDef arguments args NameParam defaults body Assert CompareEq Call NameLoad Call NameLoad Call NameLoad Str Call AttributeLoad NameLoad attr ListLoad Str Str Str decorator_list decorator_list ClassDef bases NameLoad body FunctionDef arguments args NameParam defaults body Assign NameStore Call NameLoad Assign AttributeStore AttributeLoad NameLoad attr attr Num Assert CompareEq AttributeLoad Call NameLoad Str NameLoad attr Num decorator_list FunctionDef arguments args NameParam defaults body Assign NameStore Call NameLoad Assign AttributeStore AttributeLoad NameLoad attr attr Num Assign AttributeStore AttributeLoad NameLoad attr attr Num Assert CompareEq AttributeLoad Call NameLoad Str NameLoad attr Num decorator_list FunctionDef arguments args NameParam defaults body Assign NameStore Call NameLoad Assign AttributeStore AttributeLoad NameLoad attr attr Num Assign AttributeStore AttributeLoad NameLoad attr attr Num Assert CompareEq AttributeLoad Call NameLoad Str NameLoad attr Num decorator_list FunctionDef arguments args NameParam defaults body Assign NameStore Call NameLoad Assign AttributeStore NameLoad attr Str Assign NameStore Call NameLoad Str NameLoad Assert CompareEq AttributeLoad NameLoad attr Str decorator_list FunctionDef arguments args NameParam defaults body Assign NameStore Call NameLoad Assign AttributeStore NameLoad attr Str Assign AttributeStore NameLoad attr Lambda arguments args NameParam defaults IfExp CompareEq NameLoad AttributeLoad NameLoad attr Num Num Assign AttributeStore NameLoad attr Lambda arguments args NameParam defaults Num Assign NameStore Call NameLoad Str NameLoad Assert CompareEq AttributeLoad NameLoad attr Num decorator_list FunctionDef arguments args NameParam defaults body Assign NameStore Dict Str Str Str Str Str Str Str TupleLoad Num Num TupleLoad Num Num TupleLoad Num Num TupleLoad Num Num TupleLoad Num Num TupleLoad Num Num TupleLoad Num Num Assign NameStore Call NameLoad Assign AttributeStore NameLoad attr Str Assign AttributeStore NameLoad attr Lambda arguments args NameParam defaults SubscriptLoad SubscriptLoad NameLoad Index NameLoad Index Num Assign AttributeStore NameLoad attr Lambda arguments args NameParam defaults SubscriptLoad SubscriptLoad NameLoad Index NameLoad Index Num Assign NameStore Call NameLoad Str NameLoad Assert CompareEq AttributeLoad NameLoad attr Str Assign NameStore Call NameLoad Str NameLoad Assert CompareEq Call NameLoad AttributeLoad NameLoad attr Num Num Assign NameStore Call NameLoad Str NameLoad Assert CompareEq Call NameLoad AttributeLoad NameLoad attr Num Num Assign NameStore Call NameLoad Str NameLoad Assert CompareEq Call NameLoad AttributeLoad NameLoad attr Num Num Assign NameStore Call NameLoad Str NameLoad Assert CompareEq Call NameLoad AttributeLoad NameLoad attr Num Num Assign NameStore Call NameLoad Str NameLoad Assert CompareEq Call NameLoad AttributeLoad NameLoad attr Num Num Assign NameStore Call NameLoad Str NameLoad Assert CompareEq AttributeLoad NameLoad attr Str decorator_list FunctionDef arguments args NameParam defaults body Assert CompareEq AttributeLoad Call NameLoad Str Call NameLoad attr Str decorator_list Call AttributeLoad NameLoad attr NameLoad Str Str FunctionDef arguments args NameParam defaults body Assert CompareEq AttributeLoad Call NameLoad Str Call NameLoad attr Str decorator_list Call AttributeLoad NameLoad attr NameLoad Str Num FunctionDef arguments args NameParam defaults body Assert CompareEq AttributeLoad Call NameLoad Str Call NameLoad attr Str decorator_list Call AttributeLoad NameLoad attr NameLoad Str Num FunctionDef arguments args NameParam defaults body Assert CompareEq AttributeLoad Call NameLoad Str Call NameLoad attr Str decorator_list Call AttributeLoad NameLoad attr NameLoad Str Num FunctionDef arguments args NameParam defaults body Assert CompareEq AttributeLoad Call NameLoad Str Call NameLoad attr Str decorator_list Call AttributeLoad NameLoad attr NameLoad Str Num FunctionDef arguments args NameParam defaults body Assert CompareEq AttributeLoad Call NameLoad Str Call NameLoad attr Str decorator_list Call AttributeLoad NameLoad attr NameLoad Str Num FunctionDef arguments args NameParam defaults body Assert CompareEq AttributeLoad Call NameLoad Str Call NameLoad attr Str decorator_list Call AttributeLoad NameLoad attr NameLoad Str Num FunctionDef arguments args NameParam defaults body Assert CompareEq AttributeLoad Call NameLoad Str Call NameLoad attr Str decorator_list Call AttributeLoad NameLoad attr NameLoad Str Num decorator_list
N/A unittest TestCase datetime datetime mock Mock patch cleaver.experiment Experiment VariantStat TestExperiment N/A TestCase N/A test_control N/A N/A self N/A N/A N/A experiment N/A Experiment N/A Mock show_promo datetime N/A True False N/A N/A N/A experiment control True N/A test_participants N/A N/A self N/A N/A N/A backend N/A Mock N/A N/A backend participants N/A N/A N/A name v N/A 50 N/A N/A N/A N/A Experiment backend show_promo N/A N/A datetime utcnow N/A True False participants 100 N/A test_conversions N/A N/A self N/A N/A N/A backend N/A Mock N/A N/A backend conversions N/A N/A N/A name v N/A 50 N/A N/A N/A N/A Experiment backend show_promo N/A N/A datetime utcnow N/A True False conversions 100 N/A test_all N/A N/A self N/A N/A N/A backend N/A Mock N/A N/A backend all_experiments N/A N/A N/A N/A N/A N/A Mock N/A Mock N/A Mock N/A N/A N/A len N/A N/A Experiment all backend 3 N/A test_rep N/A N/A self N/A N/A N/A N/A N/A repr N/A Experiment N/A Mock show_promo N/A N/A datetime utcnow N/A True False Experiment: show_promo <True|False> N/A N/A TestVariantStat N/A TestCase N/A test_participant_count N/A N/A self N/A N/A N/A experiment N/A Mock N/A N/A N/A experiment participants_for return_value 100 N/A N/A N/A N/A VariantStat red experiment participant_count 100 N/A test_conversion_rate N/A N/A self N/A N/A N/A experiment N/A Mock N/A N/A N/A experiment participants_for return_value 100 N/A N/A N/A experiment conversions_for return_value 10 N/A N/A N/A N/A VariantStat red experiment conversion_rate 0.1 N/A test_conversion_rate_with_no_participants N/A N/A self N/A N/A N/A experiment N/A Mock N/A N/A N/A experiment participants_for return_value 0 N/A N/A N/A experiment conversions_for return_value 0 N/A N/A N/A N/A VariantStat red experiment conversion_rate 0.0 N/A test_z_score_for_control N/A N/A self N/A N/A N/A experiment N/A Mock N/A N/A experiment control red N/A v N/A VariantStat red experiment N/A N/A N/A v z_score N/A N/A test_z_score_when_control_has_no_conversions N/A N/A self N/A N/A N/A e N/A Mock N/A N/A e control red N/A N/A e participants_for N/A N/A N/A x N/A N/A N/A x N/A e control 200 500 N/A N/A e conversions_for N/A N/A N/A x N/A 0 N/A v N/A VariantStat green e N/A N/A N/A v z_score 0 N/A test_z_score N/A N/A self N/A N/A N/A map_ N/A x a b c d e f N/A 182 35 N/A 180 45 N/A 189 28 N/A 188 61 N/A 188 188 N/A 188 214 N/A 188 215 N/A e N/A Mock N/A N/A e control x N/A N/A e participants_for N/A N/A N/A x N/A N/A N/A map_ N/A x N/A 0 N/A N/A e conversions_for N/A N/A N/A x N/A N/A N/A map_ N/A x N/A 1 N/A v N/A VariantStat x e N/A N/A N/A v z_score N/A N/A v N/A VariantStat a e N/A N/A N/A round N/A v z_score 3 1.325 N/A v N/A VariantStat b e N/A N/A N/A round N/A v z_score 3 -1.132 N/A v N/A VariantStat c e N/A N/A N/A round N/A v z_score 3 2.941 N/A v N/A VariantStat d e N/A N/A N/A round N/A v z_score 3 27.648 N/A v N/A VariantStat e e N/A N/A N/A round N/A v z_score 3 235.953 N/A v N/A VariantStat f e N/A N/A N/A v z_score Invalid N/A test_unknown_confidence N/A N/A self N/A N/A N/A N/A N/A N/A VariantStat x N/A Mock confidence_level N/A N/A N/A N/A patch object VariantStat z_score N/A test_no_change_confidence N/A N/A self N/A N/A N/A N/A N/A N/A VariantStat x N/A Mock confidence_level No Change N/A N/A N/A patch object VariantStat z_score 0.0 test_no_change_confidence_boundary N/A N/A self N/A N/A N/A N/A N/A N/A VariantStat x N/A Mock confidence_level No Confidence N/A N/A N/A patch object VariantStat z_score 1.649 test_95_confidence N/A N/A self N/A N/A N/A N/A N/A N/A VariantStat x N/A Mock confidence_level 95% Confidence N/A N/A N/A patch object VariantStat z_score 1.65 test_95_confidence_boundary N/A N/A self N/A N/A N/A N/A N/A N/A VariantStat x N/A Mock confidence_level 95% Confidence N/A N/A N/A patch object VariantStat z_score 2.329 test_99_confidence N/A N/A self N/A N/A N/A N/A N/A N/A VariantStat x N/A Mock confidence_level 99% Confidence N/A N/A N/A patch object VariantStat z_score 2.33 test_99_confidence_boundary N/A N/A self N/A N/A N/A N/A N/A N/A VariantStat x N/A Mock confidence_level 99% Confidence N/A N/A N/A patch object VariantStat z_score 3.079 test_99_point_9_confidence N/A N/A self N/A N/A N/A N/A N/A N/A VariantStat x N/A Mock confidence_level 99.9% Confidence N/A N/A N/A patch object VariantStat z_score 3.08 N/A