Module Assign NameStore Str Import alias ImportFrom alias Import alias ClassDef bases body Expr Str FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam NameParam NameParam NameParam NameParam defaults Str Str NameLoad Num Num body Assign AttributeStore NameLoad attr Call NameLoad NameLoad NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr keyword NameLoad keyword NameLoad keyword Str keyword NameLoad keyword NameLoad keyword NameLoad Assign AttributeStore NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam defaults body Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr ListLoad AttributeLoad NameLoad attr Assign NameStore ListComp NameLoad comprehension NameStore NameLoad CompareEq SubscriptLoad NameLoad Index Str Str If CompareEq Call NameLoad NameLoad Num body Raise Call NameLoad Str Assign NameStore Call AttributeLoad NameLoad attr SubscriptLoad SubscriptLoad NameLoad Index Num Index Str Assign NameStore Call AttributeLoad NameLoad attr NameLoad If CompareEq NameLoad NameLoad body Print Str Return Assign NameStore SubscriptLoad NameLoad Index Num Assign NameStore SubscriptLoad NameLoad Index Num Assign TupleStore NameStore NameStore Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr NameLoad NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad NameLoad attr NameLoad Return TupleLoad AttributeLoad NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam defaults body Assign NameStore BinOpMod Str TupleLoad Call AttributeLoad Str attr ListComp BinOpMod Str NameLoad comprehension NameStore Call NameLoad NameLoad NameLoad NameLoad Return TupleLoad NameLoad Str decorator_list FunctionDef arguments args NameParam NameParam defaults body Expr Str Assign NameStore ListLoad Str Str Str Str Str Assign NameStore NameLoad For NameStore NameLoad body Assign NameStore Call AttributeLoad NameLoad attr Str Assign NameStore ListComp Call NameLoad Call AttributeLoad NameLoad attr NameLoad NameLoad comprehension NameStore NameLoad If CompareEq Call NameLoad NameLoad Call NameLoad NameLoad body Continue Assign NameStore Num For NameStore Call NameLoad Call NameLoad SubscriptLoad NameLoad Slice Num Num body AugAssignAdd NameStore Call NameLoad BinOpSub SubscriptLoad NameLoad Index NameLoad SubscriptLoad NameLoad Index BinOpAdd NameLoad Num If CompareEq NameLoad Num body Return TupleLoad NameLoad SubscriptLoad NameLoad Index Num Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Expr Str Assign NameStore Lambda arguments args NameParam NameParam NameParam NameParam defaults NameLoad NameLoad Call AttributeLoad NameLoad attr NameLoad NameLoad For NameStore Call AttributeLoad AttributeLoad NameLoad attr attr ListLoad NameLoad NameLoad keyword NameLoad keyword NameLoad keyword NameLoad body If NameLoad body Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam defaults BinOpMult Num Num body Assign NameStore Str For NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad NameLoad keyword NameLoad keyword NameLoad body AugAssignAdd NameStore NameLoad If CompareGt Call NameLoad NameLoad NameLoad body Return NameLoad Return NameLoad decorator_list decorator_list
N/A N/A __author__ grund N/A re snakebite.client Client N/A pyhs2 Loader N/A N/A N/A 
    The idea of the loader is to provide a convenient interface to create a new table
    based on some input files
     __init__ N/A N/A self path name_node hive_server user hive_db password nn_port hive_port N/A root default None 8020 10000 N/A N/A N/A self _client N/A Client name_node nn_port N/A N/A self _db hive_db N/A N/A self _hive N/A N/A pyhs2 connect host hive_server port hive_port authMechanism PLAIN database hive_db user user password password N/A N/A self _path path N/A load N/A N/A self N/A N/A N/A files N/A N/A N/A self _client ls N/A N/A self _path N/A files N/A f N/A f files N/A N/A f N/A file_type f N/A N/A N/A len files 0 N/A N/A N/A Exception Cannot load empty directory N/A data N/A N/A self head N/A N/A files N/A 0 N/A path N/A res N/A N/A self check_separator data N/A N/A res None N/A N/A cant load data, cannot find a separator N/A N/A sep N/A res N/A 0 N/A num_cols N/A res N/A 1 N/A N/A table_statement table_name N/A N/A self _create_table N/A self _path sep num_cols N/A cursor N/A N/A N/A self _hive cursor N/A N/A N/A cursor execute table_statement N/A N/A N/A self _db table_name N/A _create_table N/A N/A self path sep count N/A N/A N/A buf N/A CREATE EXTERNAL TABLE pyxplorer_data (
    %s
    )ROW FORMAT DELIMITED FIELDS TERMINATED BY '%s'
    STORED AS TEXTFILE LOCATION '%s'
     N/A N/A N/A , join N/A N/A col_%d string x N/A x N/A range count sep path N/A N/A buf pyxplorer_data N/A check_separator N/A N/A self data N/A N/A N/A 
        THis method evaluates a list of separators on the input data to check which one
        is correct. This is done by first splitting the input by newline and then
        checking if the split by separator is equal for each input row except the last
        that might be incomplete due to the limited input data

        :param data: input data to check
        :return:
         N/A sep_list N/A \t ; , | \s+ N/A data_copy data N/A sep sep_list N/A N/A splitted N/A N/A data_copy split N/A parts N/A N/A len N/A N/A re split sep line N/A line splitted N/A N/A N/A sum parts N/A len splitted N/A N/A N/A diff 0 N/A i N/A range N/A len N/A parts N/A 1 -1 N/A N/A diff N/A abs N/A N/A parts N/A i N/A parts N/A N/A i 1 N/A N/A diff 0 N/A N/A N/A sep N/A parts N/A 0 N/A None N/A head N/A N/A self file_path N/A N/A N/A 
        Onlye read the first packets that come, try to max out at 1024kb

        :return: up to 1024b of the first block of the file
         N/A processor N/A N/A N/A path node tail_only append N/A True False N/A N/A self _handle_head path node N/A item N/A N/A N/A self _client _find_items N/A file_path processor include_toplevel True include_children False recurse False N/A N/A item N/A N/A item N/A _handle_head N/A N/A self path node upper N/A N/A 1024 1024 N/A N/A data N/A load N/A N/A N/A self _client _read_file path node tail_only False check_crc False N/A N/A data load N/A N/A N/A len data upper N/A N/A data N/A data N/A N/A