Package: aiaas-falcon-light
AIaaS Falcon-LightInstallation|Quickstart|DescriptionAIaaS_Falcon_Light is Generative AI - Logical & logging framework support AIaaS Falcon library:shield: InstallationEnsure you have therequestsandgoogle-api-corelibraries installed:pipinstallaiaas-falcon-lightif you want to install from sourcegitclonehttps://github.com/Praveengovianalytics/falcon_light&&cdfalcon_light
pipinstall-e.MethodsLightClass__init__ (config)Intialise the Falcon object with endpoint configs.Parameter:config: A object consisting parameter:api_key : API Keyapi_name: Name for endpointapi_endpoint: Type of endpoint ( can be azure, dev_quan, dev_full, prod)url: url of endpoint (eg:http://localhost:8443/)log_id: ID of log (Integer Number)use_pii: Activate Personal Identifier Information Limit Protection (Boolean)headers: header JSON for endpointlog_key: Auth Key to use the Applicationcurrent_pii()Check current Personal Identifier Information Protection activation statusswitch_pii()Switch current Personal Identifier Information Protection activation statuslist_models()List out models availableinitalise_pii()Download and intialise PII Protection.Note: This does not activate PII but initialise dependencieshealth()Check health of current endpointcreate_embedding(file_path)Create embeddings by sending files to the API.Parameter:file_path: Path to filegenerate_text(query="", context="", use_file=0, model="", chat_history=[], max_new_tokens: int = 200, temperature: float = 0, top_k: int = -1, frequency_penalty: int = 0, repetition_penalty: int = 1, presence_penalty: float = 0, fetch_k=100000, select_k=4, api_version='2023-05-15', guardrail={'jailbreak': False, 'moderation': False}, custom_guardrail=None)Generate text using LLM endpoint. Note: Some parameter of the endpoint is endpoint-specific.Parameter:query: a string of your promptuse_file: Whether to take file to context in generation. Only applies to dev_full and dev_quan. Need tocreate_embeddingbefore use.model: a string on the model to use. You can uselist_modelsto check for model available.chat_history: an array of chat history between user and bot. Only applies to dev_full and dev_quan. (Beta)max_new_token: maximum new token to generate. Must be integer.temperature: Float that controls the randomness of the sampling. Lower
values make the model more deterministic, while higher values make
the model more random. Zero means greedy sampling.top_k: Integer that controls the number of top tokens to consider.frequency_penalty: Float that penalizes new tokens based on their
frequency in the generated text so far.repetition_penalty: Float that penalizes new tokens based on whether
they appear in the prompt and the generated text so far.presence_penalty: Float that penalizes new tokens based on whether they
appear in the generated text so farfetch_k: Use for document retrival. Include how many element in searching. Only applies whenuse_fileis 1select k: Use to select number of document for document retrieval. Only applies whenuse_fileis 1api_version: Only applies for azure endpointguardrail: Whether to use the default jailbreak guardrail and moderation guardrailcustom_guardrail: Path to custom guardrail .yaml file. The format can be found in sample.yamlevaluate_parameter(config)Carry out grid search for parameterParameter:config: A dict. The dict must contain model and query. Parameter to grid search must be a list.model: a string of modelquery: a string of query**other parameter (eg: "temperature":list(np.arange(0,2,0.5))decrypt_hash(encrypted_data)Decret the configuration from experiment id.
Parameter:encrypted_data: a string of id:fire: Quickstartfrom aiaas_falcon import Falcon
model=Falcon(api_name="azure_1",protocol='https',host_name_port='example.com',api_key='API_KEY',api_endpoint='azure',log_key="KEY")
model.list_models()
model.generate_text_full(query="Hello, introduce yourself",model='gpt-35-turbo-0613-vanilla',api_version='2023-05-15')ConclusionAIaaS_Falcon_Light library simplifies interactions with the AIaaS Falcon, providing a straightforward way to perform various operations such as fact-checking and logging.Authors@Praveengovianalytics@zhuofanGoogle ColabGet start with aiaas_falconBadges