Module Expr Str Import alias Import alias Import alias Import alias ImportFrom alias ImportFrom alias ImportFrom alias ImportFrom alias ImportFrom alias ImportFrom alias identifier ImportFrom alias ImportFrom alias ClassDef bases NameLoad body Assign NameStore TupleLoad AttributeLoad NameLoad attr NameLoad Assign NameStore Num Assign NameStore BinOpMult BinOpMult Num Num Num Assign NameStore Str Expr Str FunctionDef arguments args NameParam NameParam NameParam defaults Str Str body Expr Call AttributeLoad Call NameLoad NameLoad NameLoad attr Assign AttributeStore NameLoad attr Call NameLoad NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr Str Str keyword AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults Str body Expr Call AttributeLoad NameLoad attr NameLoad NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults Str body Assign NameStore Str Assign NameStore Call AttributeLoad Call AttributeLoad AttributeLoad NameLoad attr attr attr keyword AttributeLoad NameLoad attr keyword NameLoad keyword NameLoad Assign NameStore Call AttributeLoad NameLoad attr Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults NameLoad body Assert BoolOpAnd AttributeLoad NameLoad attr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Expr Call AttributeLoad NameLoad attr Str Assign NameStore Call NameLoad NameLoad keyword AttributeLoad NameLoad attr keyword NameLoad If UnaryOpNot Call AttributeLoad NameLoad attr body Assign NameStore Call NameLoad NameLoad AttributeLoad NameLoad attr keyword NameLoad If CompareIs NameLoad NameLoad body Assign NameStore SubscriptLoad Call AttributeLoad Call AttributeLoad NameLoad attr Str attr Str Index Num Assign NameStore Call AttributeLoad Call AttributeLoad AttributeLoad NameLoad attr attr attr keyword AttributeLoad NameLoad attr keyword NameLoad keyword NameLoad Expr Call AttributeLoad NameLoad attr Call AttributeLoad Str attr NameLoad AttributeLoad NameLoad attr NameLoad Assign NameStore Num Assign NameStore NameLoad With Call AttributeLoad NameLoad attr Num Str NameStore body While CompareIs NameLoad NameLoad body Assign NameStore NameLoad TryExcept body Assign TupleStore NameStore NameStore Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr handlers ExceptHandler type NameLoad name NameStore body Assign NameStore NameLoad If CompareLt AttributeLoad AttributeLoad NameLoad attr attr Num body Raise ExceptHandler type AttributeLoad NameLoad attr name NameStore body Assign NameStore NameLoad If NameLoad body AugAssignAdd NameStore Num Expr Call AttributeLoad NameLoad attr NameLoad NameLoad orelse Assign NameStore Num Assign NameStore Call NameLoad NameLoad keyword Num Expr Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad NameLoad attr NameLoad Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults NameLoad body Expr Call AttributeLoad NameLoad attr Str If CompareIs NameLoad NameLoad body Assign NameStore Call AttributeLoad Str attr SubscriptLoad Call AttributeLoad Call AttributeLoad NameLoad attr Str attr Str Index Num With Call NameLoad NameLoad Str NameStore body Assign NameStore Call AttributeLoad Call AttributeLoad AttributeLoad NameLoad attr attr attr keyword AttributeLoad NameLoad attr keyword NameLoad Assign NameStore Call NameLoad NameLoad NameLoad keyword AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr Call AttributeLoad Str attr AttributeLoad NameLoad attr NameLoad NameLoad Assign NameStore Num Assign NameStore NameLoad With Call AttributeLoad NameLoad attr Num Str NameStore body While UnaryOpNot NameLoad body Assign NameStore NameLoad TryExcept body Assign TupleStore NameStore NameStore Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr handlers ExceptHandler type NameLoad name NameStore body Assign NameStore NameLoad If CompareLt AttributeLoad AttributeLoad NameLoad attr attr Num body Raise ExceptHandler type AttributeLoad NameLoad attr name NameStore body Assign NameStore NameLoad If NameLoad body AugAssignAdd NameStore Num Expr Call AttributeLoad NameLoad attr NameLoad NameLoad orelse Assign NameStore Num Expr Call AttributeLoad NameLoad attr Str decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults body If CompareGt NameLoad AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr Str Raise NameLoad Assign NameStore BinOpMult Call AttributeLoad NameLoad attr BinOpPow Num NameLoad Expr Call AttributeLoad NameLoad attr Str Call NameLoad Call NameLoad NameLoad NameLoad NameLoad Expr Call AttributeLoad NameLoad attr NameLoad decorator_list decorator_list
N/A N/A 
Command-line application that interacts with Google Cloud Storage

 N/A os N/A random N/A time N/A httplib2 googleapiclient discovery oauth2client.client GoogleCredentials apiclient.errors HttpError apiclient.http MediaFileUpload apiclient.http MediaIoBaseDownload json dumps json_dumps astropy.utils console logger get_logger PanStorage N/A object N/A N/A RETRYABLE_ERRORS N/A N/A httplib2 HttpLib2Error IOError N/A NUM_RETRIES 5 N/A CHUNKSIZE N/A N/A 2 1024 1024 N/A DEFAULT_MIMETYPE application/octet-stream N/A  Class for interacting with Google BigQuery  __init__ N/A N/A self project_id bucket N/A panoptes-survey panoptes-survey N/A N/A N/A N/A N/A super PanStorage self __init__ N/A N/A self logger N/A get_logger self N/A N/A self project_id project_id N/A N/A self bucket bucket N/A N/A self credentials N/A N/A GoogleCredentials get_application_default N/A N/A self storage N/A N/A discovery build storage v1 credentials N/A self credentials N/A log N/A N/A self msg color N/A default N/A N/A N/A N/A console color_print msg color N/A list_remote N/A N/A self prefix N/A PAN001/ N/A N/A fields_to_return nextPageToken,items(name,size,contentType) N/A req N/A N/A N/A N/A N/A self storage objects list bucket N/A self bucket fields fields_to_return prefix prefix N/A resp N/A N/A req execute N/A resp N/A upload N/A N/A self local_path remote_path N/A None N/A N/A N/A N/A self project_id N/A N/A N/A os path exists local_path N/A N/A N/A self log Building upload request... N/A media N/A MediaFileUpload local_path chunksize N/A self CHUNKSIZE resumable True N/A N/A N/A N/A media mimetype N/A N/A media N/A MediaFileUpload local_path N/A self DEFAULT_MIMETYPE resumable True N/A N/A remote_path None N/A N/A remote_path N/A N/A N/A N/A N/A local_path rsplit / split / N/A -1 N/A request N/A N/A N/A N/A N/A self storage objects insert bucket N/A self project_id name remote_path media_body media N/A N/A N/A self log N/A N/A Uploading file: %s to bucket: %s object: %s  format local_path N/A self project_id remote_path N/A progressless_iters 0 N/A response None N/A N/A N/A console ProgressBarOrSpinner 1.0 Upload status bar N/A N/A N/A response None N/A N/A error None N/A N/A N/A N/A progress response N/A N/A request next_chunk N/A N/A N/A bar update N/A N/A progress progress N/A N/A N/A HttpError N/A err N/A N/A error err N/A N/A N/A N/A err resp status 500 N/A N/A N/A N/A N/A self RETRYABLE_ERRORS N/A err N/A N/A error err N/A error N/A N/A progressless_iters 1 N/A N/A N/A self handle_progressless_iter error progressless_iters N/A N/A progressless_iters 0 N/A response_obj N/A json_dumps response indent 2 N/A N/A N/A self log 
Upload complete! N/A N/A N/A self log Uploaded Object: N/A N/A N/A self log response_obj N/A response_obj N/A download N/A N/A self remote_path local_path N/A None N/A N/A N/A N/A self log Building download request... N/A N/A local_path None N/A N/A local_path N/A N/A /var/panoptes/temp/{} format N/A N/A N/A N/A N/A remote_path rstrip / split / N/A -1 N/A N/A open local_path wb f N/A N/A request N/A N/A N/A N/A N/A self storage objects get_media bucket N/A self project_id object remote_path N/A media N/A MediaIoBaseDownload f request chunksize N/A self CHUNKSIZE N/A N/A N/A self log N/A N/A Downloading bucket: {} object: {} to file: {} format N/A self project_id remote_path local_path N/A progressless_iters 0 N/A done False N/A N/A N/A console ProgressBarOrSpinner 1.0 Download status bar N/A N/A N/A done N/A N/A error None N/A N/A N/A N/A progress done N/A N/A media next_chunk N/A N/A N/A bar update N/A N/A progress progress N/A N/A N/A HttpError N/A err N/A N/A error err N/A N/A N/A N/A err resp status 500 N/A N/A N/A N/A N/A self RETRYABLE_ERRORS N/A err N/A N/A error err N/A error N/A N/A progressless_iters 1 N/A N/A N/A self handle_progressless_iter error progressless_iters N/A N/A progressless_iters 0 N/A N/A N/A self log Download complete! N/A handle_progressless_iter N/A N/A self error progressless_iters N/A N/A N/A N/A progressless_iters N/A self NUM_RETRIES N/A N/A N/A N/A self log Failed to make progress for too many consecutive iterations. N/A error N/A sleeptime N/A N/A N/A random random N/A 2 progressless_iters N/A N/A N/A self log Caught exception ({}). Sleeping for {} seconds before retry #{}. N/A format N/A str error sleeptime progressless_iters N/A N/A N/A time sleep sleeptime N/A N/A