Deploy Model Endpoint for Codellama7b E2E Networks documentation Skip to content E2E Cloud Docs E2E Networks TIR Toggle navigation menu Login Sign Up E2E Networks documentation K Docs E2E Networks TIR Myaccount Getting Started with Myaccount SignUp Process for Indian Customers Customer validation Process for Indian Customers SignUp Process for International Customers Customer Validation Process for International Process Customer Validation Process for Contact Persons Domestic Customer Validation Process FAQs International Customer Validation Process FAQs Sign In Process Release Notes Compute Nodes Virtual Compute Nodes Monitoring 1Click Deployment Active Directory GPU GPU Cloud EQS Introduction Appliance Load Balancer Appliance Auto Scaling Introduction Concepts Define Scale Groups FaaS Function as a Service FaaS Network CDN VPC How to reserve an IP address Reserve IP Pool DNS Custom Reverse DNS Firewall Security Group Tag Security Firewall Bitninja Best Practices SSH Key Management Audit Logs Password Policy 2Factor Authentication Others License Management User Management Purchase SSL CertbotPlugin Apply or Redeem Coupon Code Account Statement Cloud Platform Support Introduction Platform Support Policy FAQ E2Es MyAccount FAQs Code of Conduct of Directors and Senior Management CSR Policy Whistle blower policy Jitsi Meet Mod Evasive Multisite using cPanel Softaculous Copying data from Linux to Windows using WinSCP Migrate MySQL Database Between DBaaS Manage MySQL Abuse Abuse Logs Abuse Attacks Spam Mails Phishing Complaint Copyright Complaint Billing Payment Payment Method EMandate Redeem Coupon Customer Details Updation Setup AutoDebit feature TDS Deduction process Declaration us 206AB Minimum Billing Provisioning and Deprovisioning Process View Invoice and Payment Prepaid Billing Set up Infra Credits Balance Alert Whatsapp notification for Payment reminder Restore Service on a Suspended Account for NonPayment Database Database Database PostgreSQL Parameter Group MongoDB mariaDB Storage Storage Block Storage Object Storage CDP Backup Scalable File System Kubernetes Kubernetes Service Kubernetes Kubernetes Marketplace Monitoring Stack Cert Manager Nginx Ingress Controller Troubleshooting Argo CD Declarative GitOps CD for Kubernetes Deploy to Kubernetes using Argo CD and GitOps Jenkins CI Tool Setup Jenkins On Kubernetes Cluster Ansible CD Tool Istio Service Connecting to Dbaas FAQS Container Registery Container Registery API Developers Guide API SDK E2E CLI Tool Introduction Terraform Terraform Getting Started e2enode Resource Node Plans e2eimage Resource AIML TIR AI Release Notes TIR AI Platform Introduction Getting Started Howto Guides Projects Notebooks Committed Notebook GPU H100 Plans Datasets Model Repository Model Endpoints Pipeline Run Scheduled Run Fine Tuning Models Model Playground Samples and Tutorials API Tokens SSH Key Container Team Features Settings Analytics Billing AIML Tutorials Finetune LLMA with Multiple GPUs Deploy Inference for LLMA 2 Deploy Inference for Codellama Deploy Inference for Stable Diffusion v21 Finetune Stable Diffusion model on TIR Deploy Inference for MPT7BCHAT Custom Containers in TIR Fine Tuning Bloom Natural Language Queries to SQL wth Code Llama E2E Networks documentation Welcome to TIR AI Platform Documentation Tutorials Deploy Model Endpoint for Codellama7b Deploy Model Endpoint for Codellama7b In this tutorial we will create a model endpoint for Codellama7b model The tutorial will mainly focus on the following Model Endpoint creation for Codellama7b using prebuilt container Model Endpoint creation for Codellama7b with custom model weights Brief description about the Supported parameters Model Endpoint creation for Codellama7b using prebuilt container When a model endpoint is created in TIR dashboard in the background a model server is launched to serve the inference requests TIR platform supports a variety of model formats through prebuit containers eg pytorch triton llma mpt etc For the scope of this tutorial we will use prebuilt container Codellama7b for the model endpoint but you may choose to create your own custom container by following this tutorial In most cases the prebuilt container would work for your use case The advantage is you wont have to worry about building an API handler API handler will be automatically created for you Steps to create inference endpoint for Codellama7b model Step 1 Create a Model Endpoint Go to TIR Dashboard Choose a project Go to Model Endpoints section Create a new Endpoint Choose Codellama7b model card Pick a suitable CPUGPU plan of your choice set the replicas disk sizeCPU plans might take more time If you wish to load your custom model weights finetuned or not select the appropriate model ie the EOS bucket containing your weights See Creating Model Endpoint with custom model weights section below If not you can skip the model details proceed further Complete the endpoint creation Model creation might take few minutes you can always see logs in log section Step 2 Generate your APITOKEN The model endpoint API requires a valid auth token which youll need to perform further steps So lets generate one Go to API Tokens section under the project Create a new API Token by clicking on the Create Token button on the top right corner You can also use an existing token if already created Once created youll be able to see the list of API Tokens containing the API Key and Auth Token You will need this Auth Token in the next step Step 3 Inferring Request When your endpoint is ready visit the Sample API request section to test your endpoint using curl Creating Model endpoint with custom model weights To create Inference against Codellama7b model with custom model weights we will Download Codellama7b model from huggingface Upload the model to Model Bucket EOS Create an inference endpoint model endpoint in TIR to serve API requests Step 1 Define a model in TIR Dashboard Before we proceed with downloading or finetuning optional the model weights let us first define a model in TIR dashboard Go to TIR Dashboard Choose a project Go to Model section Click on Create Model Enter a model name of your choosing eg tirmodel34 Select Model Type as Custom Click on CREATE You will now see details of EOS E2E Object Storage bucket created for this model EOS Provides a S3 compatible API to upload or download content We will be using MinIO CLI in this tutorial Copy the Setup Host command from Setup Minio CLI tab to a notepad or leave it in the clipboard We will soon use it to setup MinIO CLI Note In case you forget to copy the setup host command for MinIO CLI dont worry You can always go back to model details and get it again Step 2 Start a new Notebook To work with the model weights we will need to first download them to a local machine or a notebook instance In TIR Dashboard Go to Notebooks Launch a new Notebook with Transformers Image and a hardware plan eg A10080 We recommend a GPU plan if you plan to test or finetune the model Click on the Notebook name or Launch Notebook option to start jupyter labs environment In the jupyter labs Click New Launcher and Select Terminal Now paste and run the command for setting up MinIO CLI Host from Step 1 If the command works you will have mc cli ready for uploading our model Step 3 Download the Codellama7b model from notebook Now our EOS bucket will store the model weights Let us download the weights from Hugging face Start a new notebook untitledipynb in jupyter labs Run the following commands in download the model The model will be downloaded by huggignface sdk in the HOMEcache folder from transformers import AutoTokenizer import transformers import torch model codellamaCodeLlama7bhf tokenizer AutoTokenizerfrompretrainedmodel pipeline transformerspipeline textgeneration modelmodel torchdtypetorchfloat16 devicemapauto tokenizertokenizer Note If you face any issues running above code in the notebook cell you may be missing required libraries This may happen if you did not launch the notebook with Transformers image In such situation you can install the required libraries below Let us run a simple inference to test the model prompt def factorialnum int sequences pipelineprompt dosampleTrue topk10 temperature01 topp095 numreturnsequences1 eostokenidtokenizereostokenid maxlength200 note All the supported parameters are listed in Supported Parameters supportedparameters Step 4 Upload the model to Model Bucket EOS Now that the model works as expected you can finetune it with your own data or choose to serve the model asis This tutorial assumes you are uploading the model asis to create inference endpoint In case you finetune the model you can follow similar steps to upload the model to EOS bucket go to the directory that has the huggingface model code cd HOMEcachehuggingfacehubmodelscodellamaCodeLlama7bhfsnapshots push the contents of the folder to EOS bucket Go to TIR Dashboard Models Select your model Copy the cp command from Setup MinIO CLI tab The copy command would look like this mc cp r MODELNAME codellama7bcodellama7bhf here we replace MODELNAME with to upload all contents of snapshots folder mc cp r codellama7bcodellama7bhf Note The model directory name may be a little different we assume it is modelscodellamaCodeLlama7bhf In case this command does not work list the directories in the below path to identify the model directory HOMEcachehuggingfacehub Step 5 Create an endpoint for our model With model weights uploaded to TIR Models EOS Bucket what remains is to just launch the endpoint and serve API requests Head back to the section on A guide on Model Endpoint creation above and follow the steps to create the endpoint for your model While creating the endpoint make sure you select the appropriate model in the model details subsection ie the EOS bucket containing your model weights If your model is not in the root directory of the bucket make sure to specify the path where the model is saved in the bucket Follow the steps below to find the Model path in the bucket Go to MyAccount Object Storage Find your Model bucket in this case codellama22ec1d click on its Objects tab If the modelindexjson file is present in the list of objects then your model is present in the root directory you need not give any Model Path Otherwise navigate to the folder and find the modelindexjson file copy its path and paste the same in the Model Path field You can click on Validate button to validate the existence of the model at the given path Step 6 Inferring Request Head back to the section on A guide on Model Endpoint creation above and follow the steps 3 to infer the endpoint You can pass the parameters in your request body listed below to control your output while running inference mentioned in step 3 Supported Parameters Parameters that control the length of the output maxlength int optional defaults to 20 The maximum length the generated tokens can have Corresponds to the length of the input prompt maxnewtokens Its effect is overridden by maxnewtokens if also set maxnewtokens int optional The maximum numbers of tokens to generate ignoring the number of tokens in the prompt minlength int optional defaults to 0 The minimum length of the sequence to be generated Corresponds to the length of the input prompt minnewtokens Its effect is overridden by minnewtokens if also set minnewtokens int optional The minimum numbers of tokens to generate ignoring the number of tokens in the prompt earlystopping bool or str optional defaults to False Controls the stopping condition for beambased methods like beamsearch It accepts the following values True where the generation stops as soon as there are numbeams complete candidates False where an heuristic is applied and the generation stops when is it very unlikely to find better candidates never where the beam search procedure only stops when there cannot be better candidates canonical beam search algorithm maxtime float optional The maximum amount of time you allow the computation to run for in seconds generation will still finish the current pass after allocated time has been passed Parameters that control the generation strategy used dosample bool optional defaults to False Whether or not to use sampling use greedy decoding otherwise numbeams int optional defaults to 1 Number of beams for beam search 1 means no beam search numbeamgroups int optional defaults to 1 Number of groups to divide numbeams into in order to ensure diversity among different groups of beams this paper for more details penaltyalpha float optional The values balance the model confidence and the degeneration penalty in contrastive search decoding usecache bool optional defaults to True Whether or not the model should use the past last keyvalues attentions if applicable to the model to speed up decoding Parameters for manipulation of the model output logits temperature float optional defaults to 10 The value used to modulate the next token probabilities topk int optional defaults to 50 The number of highest probability vocabulary tokens to keep for topkfiltering topp float optional defaults to 10 If set to float 1 only the smallest set of most probable tokens with probabilities that add up to topp or higher are kept for generation typicalp float optional defaults to 10 Local typicality measures how similar the conditional probability of predicting a target token next is to the expected conditional probability of predicting a random token next given the partial text already generated If set to float 1 the smallest set of the most locally typical tokens with probabilities that add up to typicalp or higher are kept for generation See this paper for more details epsiloncutoff float optional defaults to 00 If set to float strictly between 0 and 1 only tokens with a conditional probability greater than epsiloncutoff will be sampled In the paper suggested values range from 3e4 to 9e4 depending on the size of the model See Truncation Sampling as Language Model Desmoothing for more details etacutoff float optional defaults to 00 Eta sampling is a hybrid of locally typical sampling and epsilon sampling If set to float strictly between 0 and 1 a token is only considered if it is greater than either etacutoff or sqrtetacutoff expentropysoftmaxnexttokenlogits The latter term is intuitively the expected next token probability scaled by sqrtetacutoff In the paper suggested values range from 3e4 to 2e3 depending on the size of the model See Truncation Sampling as Language Model Desmoothing for more details diversitypenalty float optional defaults to 00 This value is subtracted from a beams score if it generates a token same as any beam from other group at a particular time Note that diversitypenalty is only effective if group beam search is enabled repetitionpenalty float optional defaults to 10 The parameter for repetition penalty 10 means no penalty See this paper for more details encoderrepetitionpenalty float optional defaults to 10 The paramater for encoderrepetitionpenalty An exponential penalty on sequences that are not in the original input 10 means no penalty lengthpenalty float optional defaults to 10 Exponential penalty to the length that is used with beambased generation It is applied as an exponent to the sequence length which in turn is used to divide the score of the sequence Since the score is the log likelihood of the sequence ie negative lengthpenalty 00 promotes longer sequences while lengthpenalty 00 encourages shorter sequences norepeatngramsize int optional defaults to 0 If set to int 0 all ngrams of that size can only occur once badwordsids ListListint optional List of list of token ids that are not allowed to be generated Check NoBadWordsLogitsProcessor for further documentation and examples forcewordsids ListListint or ListListListint optional List of token ids that must be generated If given a ListListint this is treated as a simple list of words that must be included the opposite to badwordsids If given ListListListint this triggers a disjunctive constraint where one can allow different forms of each word renormalizelogits bool optional defaults to False Whether to renormalize the logits after applying all the logits processors or warpers including the custom ones Its highly recommended to set this flag to True as the search algorithms suppose the score logits are normalized but some logit processors or warpers break the normalization constraints ListConstraint optional Custom constraints that can be added to the generation to ensure that the output will contain the use of certain tokens as defined by Constraint objects in the most sensible way possible forcedbostokenid int optional defaults to modelconfigforcedbostokenid The id of the token to force as the first generated token after the decoderstarttokenid Useful for multilingual models like mBART where the first generated token needs to be the target language token forcedeostokenid Unionint Listint optional defaults to modelconfigforcedeostokenid The id of the token to force as the last generated token when maxlength is reached Optionally use a list to set multiple endofsequence tokens removeinvalidvalues bool optional defaults to modelconfigremoveinvalidvalues Whether to remove possible nan and inf outputs of the model to prevent the generation method to crash Note that using removeinvalidvalues can slow down generation exponentialdecaylengthpenalty tupleint float optional This Tuple adds an exponentially increasing length penalty after a certain amount of tokens have been generated The tuple shall consist of startindex decayfactor where startindex indicates where penalty starts and decayfactor represents the factor of exponential decay suppresstokens Listint optional A list of tokens that will be suppressed at generation The SupressTokens logit processor will set their log probs to inf so that they are not sampled beginsuppresstokens Listint optional A list of tokens that will be suppressed at the beginning of the generation The SupressBeginTokens logit processor will set their log probs to inf so that they are not sampled forceddecoderids ListListint optional A list of pairs of integers which indicates a mapping from generation indices to token indices that will be forced before sampling For example 1 123 means the second generated token will always be a token of index 123 sequencebias DictTupleint float optional Dictionary that maps a sequence of tokens to its bias term Positive biases increase the odds of the sequence being selected while negative biases do the opposite Check SequenceBiasLogitsProcessor for further documentation and examples guidancescale float optional The guidance scale for classifier free guidance CFG CFG is enabled by setting guidancescale 1 Higher guidance scale encourages the model to generate samples that are more closely linked to the input prompt usually at the expense of poorer quality lowmemory bool optional Switch to sequential topk for contrastive search to reduce peak memory Used with contrastive search Parameters that define the output variables of generate numreturnsequences int optional defaults to 1 The number of independently computed returned sequences for each element in the batch outputattentions bool optional defaults to False Whether or not to return the attentions tensors of all attention layers See attentions under returned tensors for more details outputhiddenstates bool optional defaults to False Whether or not to return the hidden states of all layers See hiddenstates under returned tensors for more details outputscores bool optional defaults to False Whether or not to return the prediction scores See scores under returned tensors for more details returndictingenerate bool optional defaults to False Whether or not to return a ModelOutput instead of a plain tuple Special tokens that can be used at generation time padtokenid int optional The id of the padding token bostokenid int optional The id of the beginningofsequence token eostokenid Unionint Listint optional The id of the endofsequence token Optionally use a list to set multiple endofsequence tokens Generation parameters exclusive to encoderdecoder models encodernorepeatngramsize int optional defaults to 0 If set to int 0 all ngrams of that size that occur in the encoderinputids cannot occur in the decoderinputids decoderstarttokenid int optional If an encoderdecoder model starts decoding with a different token than bos the id of that token On this page Model Endpoint creation for Codellama7b using prebuilt container Creating Model endpoint with custom model weights Supported Parameters Products TIR AI Platform GPU Dedicated Compute CPU Intensive Cloud High Memory Cloud Linux Smart Dedicated cPanel Linux Cloud Windows Cloud Windows SQL Cloud Plesk Windows Cloud GPU Smart Dedicated Load Balancer Company About Us Meet the Team Become a Partner E2E in Media Testimonials Investors Careers Contact Us Contact Sales Escalation Matrix Service Level Agreement Terms of Service Privacy Policy Refund Policy Policy FAQ Resources Blog Events Service Health Status Help White Papers Ecosystem Enablers Customers Certifications Countries Served FAQs E2E Networks Limited E2E Networks Limited is a NSE Listed AIFirst Hyperscale Cloud Computing Platform CIN Number L72900DL2009PLC341980 Copyright 2023 E2E Networks Limited


Welcome to E2E Abuse documentation E2E Networks documentation Skip to content E2E Cloud Docs E2E Networks TIR Toggle navigation menu Login Sign Up E2E Networks documentation K Docs E2E Networks TIR Myaccount Getting Started with Myaccount SignUp Process for Indian Customers Customer validation Process for Indian Customers SignUp Process for International Customers Customer Validation Process for International Process Customer Validation Process for Contact Persons Domestic Customer Validation Process FAQs International Customer Validation Process FAQs Sign In Process Release Notes Compute Nodes Virtual Compute Nodes Monitoring 1Click Deployment Active Directory GPU GPU Cloud EQS Introduction Appliance Load Balancer Appliance Auto Scaling Introduction Concepts Define Scale Groups FaaS Function as a Service FaaS Network CDN VPC How to reserve an IP address Reserve IP Pool DNS Custom Reverse DNS Firewall Security Group Tag Security Firewall Bitninja Best Practices SSH Key Management Audit Logs Password Policy 2Factor Authentication Others License Management User Management Purchase SSL CertbotPlugin Apply or Redeem Coupon Code Account Statement Cloud Platform Support Introduction Platform Support Policy FAQ E2Es MyAccount FAQs Code of Conduct of Directors and Senior Management CSR Policy Whistle blower policy Jitsi Meet Mod Evasive Multisite using cPanel Softaculous Copying data from Linux to Windows using WinSCP Migrate MySQL Database Between DBaaS Manage MySQL Abuse Abuse Logs Abuse Attacks Spam Mails Phishing Complaint Copyright Complaint Billing Payment Payment Method EMandate Redeem Coupon Customer Details Updation Setup AutoDebit feature TDS Deduction process Declaration us 206AB Minimum Billing Provisioning and Deprovisioning Process View Invoice and Payment Prepaid Billing Set up Infra Credits Balance Alert Whatsapp notification for Payment reminder Restore Service on a Suspended Account for NonPayment Database Database Database PostgreSQL Parameter Group MongoDB mariaDB Storage Storage Block Storage Object Storage CDP Backup Scalable File System Kubernetes Kubernetes Service Kubernetes Kubernetes Marketplace Monitoring Stack Cert Manager Nginx Ingress Controller Troubleshooting Argo CD Declarative GitOps CD for Kubernetes Deploy to Kubernetes using Argo CD and GitOps Jenkins CI Tool Setup Jenkins On Kubernetes Cluster Ansible CD Tool Istio Service Connecting to Dbaas FAQS Container Registery Container Registery API Developers Guide API SDK E2E CLI Tool Introduction Terraform Terraform Getting Started e2enode Resource Node Plans e2eimage Resource AIML TIR AI Release Notes TIR AI Platform Introduction Getting Started Howto Guides Projects Notebooks Committed Notebook GPU H100 Plans Datasets Model Repository Model Endpoints Pipeline Run Scheduled Run Fine Tuning Models Model Playground Samples and Tutorials API Tokens SSH Key Container Team Features Settings Analytics Billing AIML Tutorials Finetune LLMA with Multiple GPUs Deploy Inference for LLMA 2 Deploy Inference for Codellama Deploy Inference for Stable Diffusion v21 Finetune Stable Diffusion model on TIR Deploy Inference for MPT7BCHAT Custom Containers in TIR Fine Tuning Bloom Natural Language Queries to SQL wth Code Llama E2E Networks documentation Welcome to E2E Abuse documentation Welcome to E2E Abuse documentation E2E Networks platform team works around the clock to address complaints of abuse on our network We receive these complaints via feedback loops from security updates providers spam blacklisting services various industry contacts and mailing lists as well as from our clients Some of the types of abuses and the steps that can be taken to resolve the same are documented in the articles below Abuse Logs Abuse Attacks Spam Mails Introduction Phishing Complaint Introduction Copyright Complaint Introduction The following process is followed when we detect an abuse complaint regarding any serverservice you have taken from us We send out a warning email to the authorized contact as soon as we discover and ascertain the abuse issue The email contains the nature of the abuse and requests to check the issue at your end If there are any identifiable security vulnerabilities we will include the remedial measures as well We would ask you to respond to us with the corrective measures you have taken to address the issue For Abuse Complaints Since the outbound attack originates from your server In order to protect the network from attack We will suspend the Public and Private connectivity of your server as soon as the issue is reported For Phishing and Other Complaints If we do not get a response from your side in 2 hours and the issue is still persisting we would call the authorized contact on their given phone numbers to intimate the issue In lack of response for our phone call for another 2 hours It would be required by us to suspend the publicPrivate network of your machines to prevent malicious activities on our server You need to take action on the abuse complaint yourself by login to the server via console we would require written confirmation on the steps you have taken to stop the reported actions Please keep your authorized contact details updated to avoid any miscommunications by sending an email to cloudplatforme2enetworkscom whenever there is a change or an anomaly is discovered in contact details We understand getting an abuse ticket is a hassle but please remember that were doing our best to protect our network the Internet community and you Switching off your server is a last resort for us and we want to make sure everyone is on the same page to prevent us from getting to that last resort In case any of your server at E2E Networks is compromised Please note that during the entire process we request you to communicate and kindly take immediate action to fix the issue as the lack of response or resolution of the issue would be a contravention of IT Act 2000 and would lead to disabling of the public network Products TIR AI Platform GPU Dedicated Compute CPU Intensive Cloud High Memory Cloud Linux Smart Dedicated cPanel Linux Cloud Windows Cloud Windows SQL Cloud Plesk Windows Cloud GPU Smart Dedicated Load Balancer Company About Us Meet the Team Become a Partner E2E in Media Testimonials Investors Careers Contact Us Contact Sales Escalation Matrix Service Level Agreement Terms of Service Privacy Policy Refund Policy Policy FAQ Resources Blog Events Service Health Status Help White Papers Ecosystem Enablers Customers Certifications Countries Served FAQs E2E Networks Limited E2E Networks Limited is a NSE Listed AIFirst Hyperscale Cloud Computing Platform CIN Number L72900DL2009PLC341980 Copyright 2023 E2E Networks Limited


Whatsapp notification feature on Payment reminder E2E Networks documentation Skip to content E2E Cloud Docs E2E Networks TIR Toggle navigation menu Login Sign Up E2E Networks documentation K Docs E2E Networks TIR Myaccount Getting Started with Myaccount SignUp Process for Indian Customers Customer validation Process for Indian Customers SignUp Process for International Customers Customer Validation Process for International Process Customer Validation Process for Contact Persons Domestic Customer Validation Process FAQs International Customer Validation Process FAQs Sign In Process Release Notes Compute Nodes Virtual Compute Nodes Monitoring 1Click Deployment Active Directory GPU GPU Cloud EQS Introduction How to Create EQS Actions Add Queue under tab Actions for queue service Using SDK Appliance Load Balancer Appliance Auto Scaling Introduction Concepts Define Scale Groups FaaS Function as a Service FaaS How to Create Functions Functions Information Network CDN VPC How to reserve an IP address Reserve IP Pool DNS Custom Reverse DNS Firewall Security Group Tag Security Firewall Bitninja Best Practices SSH Key Management Audit Logs Password Policy 2Factor Authentication Others License Management User Management Purchase SSL CertbotPlugin Apply or Redeem Coupon Code Account Statement Cloud Platform Support Introduction Platform Support Policy FAQ E2Es MyAccount FAQs Code of Conduct of Directors and Senior Management CSR Policy Whistle blower policy Jitsi Meet Mod Evasive Multisite using cPanel Softaculous Copying data from Linux to Windows using WinSCP Migrate MySQL Database Between DBaaS Manage MySQL Abuse Abuse Logs Abuse Attacks Spam Mails Phishing Complaint Copyright Complaint Billing Payment Payment Method EMandate Redeem Coupon Customer Details Updation Setup AutoDebit feature TDS Deduction process Declaration us 206AB Minimum Billing Provisioning and Deprovisioning Process View Invoice and Payment Prepaid Billing Set up Infra Credits Balance Alert Whatsapp notification for Payment reminder Restore Service on a Suspended Account for NonPayment Database Database Database PostgreSQL Parameter Group How to create Parameter Group MongoDB mariaDB Storage Storage Block Storage Object Storage CDP Backup Scalable File System Kubernetes Kubernetes Service Kubernetes Kubernetes Marketplace Monitoring Stack Cert Manager Nginx Ingress Controller Troubleshooting Argo CD Declarative GitOps CD for Kubernetes Deploy to Kubernetes using Argo CD and GitOps Jenkins CI Tool Setup Jenkins On Kubernetes Cluster Ansible CD Tool Istio Service Connecting to Dbaas FAQS Container Registery Container Registry Simplifying Pull Operations with UserFriendly Interface API Developers Guide API SDK E2E CLI Tool Introduction Terraform Terraform Getting Started e2enode Resource Node Plans e2eimage Resource AIML TIR AI Release Notes TIR AI Platform Introduction Getting Started Howto Guides Projects Notebooks Committed Notebook GPU H100 Plans Datasets Model Repository Model Endpoints Pipeline Run Scheduled Run Fine Tuning Models Model Playground Samples and Tutorials API Tokens SSH Key Container Team Features Settings Analytics Billing AIML Tutorials Finetune LLMA with Multiple GPUs Deploy Inference for LLMA 2 Deploy Inference for Codellama Deploy Inference for Stable Diffusion v21 Finetune Stable Diffusion model on TIR Deploy Inference for MPT7BCHAT Custom Containers in TIR Fine Tuning Bloom Natural Language Queries to SQL wth Code Llama E2E Networks documentation E2E Networks Billing and Payment Information Whatsapp notification feature on Payment reminder Whatsapp notification feature on Payment reminder Introduction We have added a feature of enabling whatsapp in General settings Using this feature If the users enable this feature then the users will get payment reminder notification on whatsapp If users infra credit is negative then a payment reminder is sent to the users Total three payment reminders are sent to the users The message template is like Goal of this feature The goal of this feature is to provide payment reminder notification to the customers on Whatsapp Case of this feature Case1 If the user will enable this feature then the user will get a reminder on Whatsapp otherwise the user will not get notification on Whatsapp Case2 If the user will disable the Whatsapp feature then Whatsapp notification will be stopped Note As of now Whatsapp feature is available only for payment reminder The process of using this feature is as follows Step1 Navigate to MyAccount url and login using credentials Step2 After login click on Setting button from side nav bar and then click on General settings button Step3 Click on checkbox of Enable whatsapp Notification Step4 Click on Save button Step5 After clicking on Save button Now the Whatsapp feature has been enabled and the page looks like this Step6 If users want to disable this feature then They have to uncheck the Enable whatsapp Notification and click on Save button After disabling the whatsapp feature users will not be able to get reminders on whatsapp On this page Introduction Goal of this feature Case of this feature The process of using this feature is as follows Products TIR AI Platform GPU Dedicated Compute CPU Intensive Cloud High Memory Cloud Linux Smart Dedicated cPanel Linux Cloud Windows Cloud Windows SQL Cloud Plesk Windows Cloud GPU Smart Dedicated Load Balancer Company About Us Meet the Team Become a Partner E2E in Media Testimonials Investors Careers Contact Us Contact Sales Escalation Matrix Service Level Agreement Terms of Service Privacy Policy Refund Policy Policy FAQ Resources Blog Events Service Health Status Help White Papers Ecosystem Enablers Customers Certifications Countries Served FAQs E2E Networks Limited E2E Networks Limited is a NSE Listed AIFirst Hyperscale Cloud Computing Platform CIN Number L72900DL2009PLC341980 Copyright 2023 E2E Networks Limited


MongoDB E2E Networks documentation Skip to content E2E Cloud Docs E2E Networks TIR Toggle navigation menu Login Sign Up E2E Networks documentation K Docs E2E Networks TIR Myaccount Getting Started with Myaccount SignUp Process for Indian Customers Customer validation Process for Indian Customers SignUp Process for International Customers Customer Validation Process for International Process Customer Validation Process for Contact Persons Domestic Customer Validation Process FAQs International Customer Validation Process FAQs Sign In Process Release Notes Compute Nodes Virtual Compute Nodes Monitoring 1Click Deployment Active Directory GPU GPU Cloud EQS Introduction Appliance Load Balancer Appliance Auto Scaling Introduction Concepts Define Scale Groups FaaS Function as a Service FaaS Network CDN VPC How to reserve an IP address Reserve IP Pool DNS Custom Reverse DNS Firewall Security Group Tag Security Firewall Bitninja Best Practices SSH Key Management Audit Logs Password Policy 2Factor Authentication Others License Management User Management Purchase SSL CertbotPlugin Apply or Redeem Coupon Code Account Statement Cloud Platform Support Introduction Platform Support Policy FAQ E2Es MyAccount FAQs Code of Conduct of Directors and Senior Management CSR Policy Whistle blower policy Jitsi Meet Mod Evasive Multisite using cPanel Softaculous Copying data from Linux to Windows using WinSCP Migrate MySQL Database Between DBaaS Manage MySQL Abuse Abuse Logs Abuse Attacks Spam Mails Phishing Complaint Copyright Complaint Billing Payment Payment Method EMandate Redeem Coupon Customer Details Updation Setup AutoDebit feature TDS Deduction process Declaration us 206AB Minimum Billing Provisioning and Deprovisioning Process View Invoice and Payment Prepaid Billing Set up Infra Credits Balance Alert Whatsapp notification for Payment reminder Restore Service on a Suspended Account for NonPayment Database Database Database PostgreSQL Parameter Group MongoDB mariaDB Storage Storage Block Storage Object Storage CDP Backup Scalable File System Kubernetes Kubernetes Service Kubernetes Kubernetes Marketplace Monitoring Stack Cert Manager Nginx Ingress Controller Troubleshooting Argo CD Declarative GitOps CD for Kubernetes Deploy to Kubernetes using Argo CD and GitOps Jenkins CI Tool Setup Jenkins On Kubernetes Cluster Ansible CD Tool Istio Service Connecting to Dbaas FAQS Container Registery Container Registery API Developers Guide API SDK E2E CLI Tool Introduction Terraform Terraform Getting Started e2enode Resource Node Plans e2eimage Resource AIML TIR AI Release Notes TIR AI Platform Introduction Getting Started Howto Guides Projects Notebooks Committed Notebook GPU H100 Plans Datasets Model Repository Model Endpoints Pipeline Run Scheduled Run Fine Tuning Models Model Playground Samples and Tutorials API Tokens SSH Key Container Team Features Settings Analytics Billing AIML Tutorials Finetune LLMA with Multiple GPUs Deploy Inference for LLMA 2 Deploy Inference for Codellama Deploy Inference for Stable Diffusion v21 Finetune Stable Diffusion model on TIR Deploy Inference for MPT7BCHAT Custom Containers in TIR Fine Tuning Bloom Natural Language Queries to SQL wth Code Llama E2E Networks documentation Database Management in E2E Networks MongoDB MongoDB What is MongoDB MongoDB is a popular opensource documentoriented NoSQL database management system It is designed to store and manage large volumes of data in a flexible and scalable manner MongoDB uses a flexible document data model which means that data is stored in JSONlike documents with dynamic schemas allowing for easy and efficient storage and retrieval of complex data structures Why use MongoDB There are four major reasons why MongoDB is used more often They are 1 Flexibility MongoDB uses documents that can contain subdocuments in complex hierarchies making it expressive and flexible MongoDB can map objects from any programming language ensuring easy implementation and maintenance 2 Flexible Query Model The user can selectively index some parts of each document or a query based on regular expressions ranges or attribute values and have as many properties per object as needed by the application layer 3 Native Aggregation Native aggregation allows users to extract and transform data from the database The data can either be loaded into a new format or exported to other data sources 4 Schemaless model Applications get the power and responsibility to interpret different properties found in a collections documents To configure PostgreSQL kindly click on the following link httpsdocse2enetworkscomdatabasedatabasehtml Start the mongo Shell and Connect to MongoDB Once you have downloaded the mongo shell you can use it to connect to your running MongoDB server To connect to your database node using Mongo shell Enter the following command at a command prompt on your local or client desktop to connect to a MongoDB database Example mongosh host host u User Name p authenticationDatabase Database Name After connection done with your MongoDB you should see output similar to the following On this page What is MongoDB Why use MongoDB Start the mongo Shell and Connect to MongoDB To connect to your database node using Mongo shell Products TIR AI Platform GPU Dedicated Compute CPU Intensive Cloud High Memory Cloud Linux Smart Dedicated cPanel Linux Cloud Windows Cloud Windows SQL Cloud Plesk Windows Cloud GPU Smart Dedicated Load Balancer Company About Us Meet the Team Become a Partner E2E in Media Testimonials Investors Careers Contact Us Contact Sales Escalation Matrix Service Level Agreement Terms of Service Privacy Policy Refund Policy Policy FAQ Resources Blog Events Service Health Status Help White Papers Ecosystem Enablers Customers Certifications Countries Served FAQs E2E Networks Limited E2E Networks Limited is a NSE Listed AIFirst Hyperscale Cloud Computing Platform CIN Number L72900DL2009PLC341980 Copyright 2023 E2E Networks Limited


Install and Configure modevasive on CentOS E2E Networks documentation Skip to content E2E Cloud Docs E2E Networks TIR Toggle navigation menu Login Sign Up E2E Networks documentation K Docs E2E Networks TIR Myaccount Getting Started with Myaccount SignUp Process for Indian Customers Customer validation Process for Indian Customers SignUp Process for International Customers Customer Validation Process for International Process Customer Validation Process for Contact Persons Domestic Customer Validation Process FAQs International Customer Validation Process FAQs Sign In Process Release Notes Compute Nodes Virtual Compute Nodes Monitoring 1Click Deployment Active Directory GPU GPU Cloud EQS Introduction How to Create EQS Actions Add Queue under tab Actions for queue service Using SDK Appliance Load Balancer Appliance Auto Scaling Introduction Concepts Define Scale Groups FaaS Function as a Service FaaS How to Create Functions Functions Information Network CDN VPC How to reserve an IP address Reserve IP Pool DNS Custom Reverse DNS Firewall Security Group Tag Security Firewall Bitninja Best Practices SSH Key Management Audit Logs Password Policy 2Factor Authentication Others License Management User Management Purchase SSL CertbotPlugin Apply or Redeem Coupon Code Account Statement Cloud Platform Support Introduction Platform Support Policy FAQ E2Es MyAccount FAQs Code of Conduct of Directors and Senior Management CSR Policy Whistle blower policy Jitsi Meet Mod Evasive Multisite using cPanel Softaculous Copying data from Linux to Windows using WinSCP Migrate MySQL Database Between DBaaS Manage MySQL Abuse Abuse Logs Abuse Attacks Spam Mails Phishing Complaint Copyright Complaint Billing Payment Payment Method EMandate Redeem Coupon Customer Details Updation Setup AutoDebit feature TDS Deduction process Declaration us 206AB Minimum Billing Provisioning and Deprovisioning Process View Invoice and Payment Prepaid Billing Set up Infra Credits Balance Alert Whatsapp notification for Payment reminder Restore Service on a Suspended Account for NonPayment Database Database Database PostgreSQL Parameter Group How to create Parameter Group MongoDB mariaDB Storage Storage Block Storage Object Storage CDP Backup Scalable File System Kubernetes Kubernetes Service Kubernetes Kubernetes Marketplace Monitoring Stack Cert Manager Nginx Ingress Controller Troubleshooting Argo CD Declarative GitOps CD for Kubernetes Deploy to Kubernetes using Argo CD and GitOps Jenkins CI Tool Setup Jenkins On Kubernetes Cluster Ansible CD Tool Istio Service Connecting to Dbaas FAQS Container Registery Container Registry Simplifying Pull Operations with UserFriendly Interface API Developers Guide API SDK E2E CLI Tool Introduction Terraform Terraform Getting Started e2enode Resource Node Plans e2eimage Resource AIML TIR AI Release Notes TIR AI Platform Introduction Getting Started Howto Guides Projects Notebooks Committed Notebook GPU H100 Plans Datasets Model Repository Model Endpoints Pipeline Run Scheduled Run Fine Tuning Models Model Playground Samples and Tutorials API Tokens SSH Key Container Team Features Settings Analytics Billing AIML Tutorials Finetune LLMA with Multiple GPUs Deploy Inference for LLMA 2 Deploy Inference for Codellama Deploy Inference for Stable Diffusion v21 Finetune Stable Diffusion model on TIR Deploy Inference for MPT7BCHAT Custom Containers in TIR Fine Tuning Bloom Natural Language Queries to SQL wth Code Llama E2E Networks documentation Other Services on E2E Networks Install and Configure modevasive on CentOS Install and Configure modevasive on CentOS In this Documentation we will guide you through the installation and configuration process of modevasive on CentOS Modevasive is an Apache module designed to proactively protect Apache servers from various types of attacks including brute force and DDoSDoS attacks Functioning as both a defensive tool and a detection mechanism modevasive collaborates with routers firewalls ipchains and more It reports server vulnerabilities or attacks via email and Syslog facilities Modevasive takes preventive action by restricting or blacklisting an IP address if it meets any of the following criteria Repeatedly requesting the same page within a predefined time frame Initiating requests while the IP is temporarily blacklisted Generating multiple concurrent requests on the same child within a second Its essential to note that root access is required for the installation of modevasive on your server This tutorial will provide comprehensive instructions on configuring modevasive on your CentOS server Install modevasive on CentOS To install modevasive Apache on your CentOS server follow the below steps Make sure that the EPEL yum repository is available on the server The EPEL Extra Packages for Enterprise Linux is a free opensource communitybased repository project To check if the EPEL yum repository packages are available on your system run the following command rpm qa grep epel If it is not available on the server execute the following command to install and activate EPEL wget httpsdlfedoraprojectorgpubepelepelreleaselatest8noarchrpm rpm ivh epelreleaselatest8noarchrpm Run the following command to install the modevasive Apache module on your server yum install modevasive y Open the modevasive modules configuration file by using the following command to verify if the installation is successful cat etchttpdconfdmodevasiveconf If the configuration file opens up then the installation of the modevasive Apache module is successful Configure modevasive Open the modules configuration file cat etchttpdconfdmodevasiveconf To make sure that the module loads correctly add the following line in the modevasive configuration file LoadModule evasive20module modulesmodevasive24so Then you can see the default configuration value of modevasive on the file To make the changes reflect restart the httpd service by using the following command httpd M grep Ei evasive or etcinitdhttpd restart If the modevasive module loads correctly you can see the following output evasive24module shared MODEVASIVE Configuration Options The module has default configuration values set to it and you can customize or alter these values by opening the configuration file and make the changes to the options available There are different options in the modevasive configuration file that you can change to customize the configuration of your modevasive Apache module Some of the modevasive configuration options are vim etchttpdconfdmodevasiveconf 1 DOSHashTableSize The hash table size is the number of toplevel nodes for each childs hash table If you increase the value of the DOSHashTableSize then the module decreases the number of iterations required to get into the records and that offer faster performance But the modevasive consumes more memory if there is an increase in the hash table size The default value of the hash table size is 3097 so you are recommended to increase the value only if you have a busy web server DOSHashTableSize 3097 2 DOSSiteCount The DOSSiteCount option in the configuration file helps to set the threshold value for the total number of requests by the same client or listener to a particular object at a certain site interval If any of the client or listener exceeds the number of requests from the set threshold value then their IP gets added to the block list of your server DOSSiteCount 50 3 DOSPageCount The DOSPageCount is the threshold for the number of requests allowed to the same page or URI at a particular page interval If any of the IP request the same page more than the threshold value then that IP gets blacklisted or rejected in the server The default threshold value of DOSPageCount is 2 You can uncomment or edit the following line in the configuration file to set the threshold value DOSPageCount 2 4 DOSSiteInterval The value of the DOSSiteInterval option is the interval for the site count threshold The default value of the DOSSiteInterval is one second DOSSiteInterval 1 5 DOSPageInterval The value of the DOSPageInterval option is the interval for the page count threshold The default value of the DOSPageInterval is one second DOSPageInterval 1 6 DOSBlockingPeriod The DOSBlockPeriod option in the modevasive configuration file helps you to set the amount of time in seconds the clients IP gets blocked when added into the blocking list During this period all the subsequent actions and requests from the client throw a 403 Forbidden error and the timer of the IP block gets rested For example the default value of DOSBlockPeriod is 10 seconds so any action by the blocked IP during these 10 seconds reset the timer to another 10 seconds During the time of any attacks like DDoSDoS attack this timer keeps getting reset DOSBlockingPeriod 10 7 Email Alert In the modevasive Apache configuration file go to line number 48 in the configuration file and uncomment or edit the following line In the following line replace the Youyourdomaincom flag with your email id So in case of any DDoSDoS attack or if any IP gets blacklisted or rejected the system sends an alert to the mentioned email address automatically DOSEmailNotify Youyourdomaincom After tweaking the values in the modevasive configuration file restart the httpd service to reflect the changes Restart the httpd service by running the following command httpd M grep Ei evasive or etcinitdhttpd restart How to Whitelist a BLOCKED or REJECTED IP To whitelist the IPs that are blocked by modevasive do the following Open the modevasive configuration file Add the IPs that need to be whitelisted in the configuration file as follows DOSWhitelist IPaddress To whitelist a list of IPs add the following line DOSWhitelist 164520 After adding the IP in the configuration file restart the httpd service etcinitdhttpd restart Please comment below for any questions or queries If you are an InterServer customer please reach out to our support team for further help On this page Install modevasive on CentOS Configure modevasive MODEVASIVE Configuration Options 1 DOSHashTableSize 2 DOSSiteCount 3 DOSPageCount 4 DOSSiteInterval 5 DOSPageInterval 6 DOSBlockingPeriod 7 Email Alert How to Whitelist a BLOCKED or REJECTED IP Products TIR AI Platform GPU Dedicated Compute CPU Intensive Cloud High Memory Cloud Linux Smart Dedicated cPanel Linux Cloud Windows Cloud Windows SQL Cloud Plesk Windows Cloud GPU Smart Dedicated Load Balancer Company About Us Meet the Team Become a Partner E2E in Media Testimonials Investors Careers Contact Us Contact Sales Escalation Matrix Service Level Agreement Terms of Service Privacy Policy Refund Policy Policy FAQ Resources Blog Events Service Health Status Help White Papers Ecosystem Enablers Customers Certifications Countries Served FAQs E2E Networks Limited E2E Networks Limited is a NSE Listed AIFirst Hyperscale Cloud Computing Platform CIN Number L72900DL2009PLC341980 Copyright 2023 E2E Networks Limited


Model Endpoints E2E Networks documentation Skip to content E2E Cloud Docs E2E Networks TIR Toggle navigation menu Login Sign Up E2E Networks documentation K Docs E2E Networks TIR Myaccount Getting Started with Myaccount SignUp Process for Indian Customers Customer validation Process for Indian Customers SignUp Process for International Customers Customer Validation Process for International Process Customer Validation Process for Contact Persons Domestic Customer Validation Process FAQs International Customer Validation Process FAQs Sign In Process Release Notes Compute Nodes Virtual Compute Nodes Monitoring 1Click Deployment Active Directory GPU GPU Cloud EQS Introduction How to Create EQS Actions Add Queue under tab Actions for queue service Using SDK Appliance Load Balancer Appliance Auto Scaling Introduction Concepts Define Scale Groups FaaS Function as a Service FaaS How to Create Functions Functions Information Network CDN VPC How to reserve an IP address Reserve IP Pool DNS Custom Reverse DNS Firewall Security Group Tag Security Firewall Bitninja Best Practices SSH Key Management Audit Logs Password Policy 2Factor Authentication Others License Management User Management Purchase SSL CertbotPlugin Apply or Redeem Coupon Code Account Statement Cloud Platform Support Introduction Platform Support Policy FAQ E2Es MyAccount FAQs Code of Conduct of Directors and Senior Management CSR Policy Whistle blower policy Jitsi Meet Mod Evasive Multisite using cPanel Softaculous Copying data from Linux to Windows using WinSCP Migrate MySQL Database Between DBaaS Manage MySQL Abuse Abuse Logs Abuse Attacks Spam Mails Phishing Complaint Copyright Complaint Billing Payment Payment Method EMandate Redeem Coupon Customer Details Updation Setup AutoDebit feature TDS Deduction process Declaration us 206AB Minimum Billing Provisioning and Deprovisioning Process View Invoice and Payment Prepaid Billing Set up Infra Credits Balance Alert Whatsapp notification for Payment reminder Restore Service on a Suspended Account for NonPayment Database Database Database PostgreSQL Parameter Group How to create Parameter Group MongoDB mariaDB Storage Storage Block Storage Object Storage CDP Backup Scalable File System Kubernetes Kubernetes Service Kubernetes Kubernetes Marketplace Monitoring Stack Cert Manager Nginx Ingress Controller Troubleshooting Argo CD Declarative GitOps CD for Kubernetes Deploy to Kubernetes using Argo CD and GitOps Jenkins CI Tool Setup Jenkins On Kubernetes Cluster Ansible CD Tool Istio Service Connecting to Dbaas FAQS Container Registery Container Registry Simplifying Pull Operations with UserFriendly Interface API Developers Guide API SDK E2E CLI Tool Introduction Terraform Terraform Getting Started e2enode Resource Node Plans e2eimage Resource AIML TIR AI Release Notes TIR AI Platform Introduction Getting Started Howto Guides Projects Notebooks Committed Notebook GPU H100 Plans Datasets Model Repository Model Endpoints Pipeline Run Scheduled Run Fine Tuning Models Model Playground Samples and Tutorials API Tokens SSH Key Container Team Features Settings Analytics Billing AIML Tutorials Finetune LLMA with Multiple GPUs Deploy Inference for LLMA 2 Deploy Inference for Codellama Deploy Inference for Stable Diffusion v21 Finetune Stable Diffusion model on TIR Deploy Inference for MPT7BCHAT Custom Containers in TIR Fine Tuning Bloom Natural Language Queries to SQL wth Code Llama E2E Networks documentation Welcome to TIR AI Platform Documentation Model Endpoints Model Endpoints It is easy to deploy containers that serve model API TIR offers two methods to create an inference service API endpoint for your AI model Deploy using prebuilt TIR provided Containers Before you launch a service with prebuilt containers you must first create a TIR Model and upload model files to it The prebuilt containers are designed to autodownload the model files from EOS E2E Object Storage Bucket and launch the API server with them Once an endpoint is ready you can send synchronous request to the endpoint for inference Deploy using your own container You can provide a public or private docker image and launch an inference service with it Once endpoint is ready you can make synchronous requests to the endpoint for inference You may also choose to attach a tir model to your service to automate download of model files from EOS bucket to the container Prebuilt Containers TIR provides docker container images that you can run as prebuilt containers These containers provide inference servers HTTP that can serve inference requests with minimal configuration They are also capable of connecting with E2E Object Storage and downloading models on the containers at the startup This section lists deployment guides for all the integrated frameworks that TIR supports TorchServe Go through this complete guide for deploying a torchserve service NVIDIA Triton Go through this detailed guide to deploy a triton service LLAMA2 Go through this tutorial to deploy LLAMA v2 CodeLLMA Go through this tutorial to deploy CodeLLMA Service Stable Diffusion Go through this tutorial to deploy Stable Diffusion Inference Service Custom Containers Go through this detailed tutorial to building a custom images for model deployments Create Model Endpoints To create a Model Endppoint you have to click on Model Endpoints under Inference Click on CREATE ENDPOINT button Choose framework Model download then click on next Resource Details Machine Here you can select a machine type either GPU or CPU Replicas The number of replicas you specify in the input field below will always be ready and you will be charged continuously for themEnable Autoscaling Enable Autoscaling Here you have an option to enable Autoscaling Endpoint Details Endpoint Name Here you define the name of your end points then click on Next button Environment Variables Add Variable You can add variable by clicking ADD VARIABLE button After adding Variables To delete variable click on delete icon Click on FINISH button Click on CREATE button After successfully creating model endpoints you will see the following screen Overview In that overview tab you can see the Endpoint Details and Plan Details Logs In the log tab logs are generated and you can view them by clicking on the log tab Monitoring In the Monitoring tab you can choose between Hardware and Service as metric types Under Hardware youll find details like GPU Utilization GPU Memory Utilization GPU Temperature GPU Power Usage CPU Utilization and Memory Usage Auto Scaling In the Auto Scaling tab you can view the current number of replicas desired replicas and also have the option to disable autoscalingYou can increase the number of desired replicas Replica Management In the Replica Management tab you can handle the replicas Youll see the current replicas and you also have the option to delete them by clicking delete icon On this page Prebuilt Containers TorchServe NVIDIA Triton LLAMA2 CodeLLMA Stable Diffusion Custom Containers Create Model Endpoints Resource Details Endpoint Details Environment Variables Products TIR AI Platform GPU Dedicated Compute CPU Intensive Cloud High Memory Cloud Linux Smart Dedicated cPanel Linux Cloud Windows Cloud Windows SQL Cloud Plesk Windows Cloud GPU Smart Dedicated Load Balancer Company About Us Meet the Team Become a Partner E2E in Media Testimonials Investors Careers Contact Us Contact Sales Escalation Matrix Service Level Agreement Terms of Service Privacy Policy Refund Policy Policy FAQ Resources Blog Events Service Health Status Help White Papers Ecosystem Enablers Customers Certifications Countries Served FAQs E2E Networks Limited E2E Networks Limited is a NSE Listed AIFirst Hyperscale Cloud Computing Platform CIN Number L72900DL2009PLC341980 Copyright 2023 E2E Networks Limited


Policy FAQ Claim your spot on the waitlist for the NVIDIA H100 GPUs Join WaitlistE2E CloudProductsPricingPartnersEventsCareersCompanyInvestorContact UsBlogLoginLoginSign UpPolicy FAQFrequently Asked Questions1 Do you charge for datatransfer No we currently dont charge for datatransfer to from your machine instances2 Do you offer managed services for server instances for free No All our cloud instances are selfmanaged by default We provide basic platform support with no hands to keyboard approach3 What is your SLA E2E Networks provides a 999 Uptime SLA Please refer to our SLA details here4 Where are your data centers located We have partnered with TierIII plus data centers like Netmagic5 What are the various facility certifications available at your datacenter location Our data center has the following certifications INFORMATION SECURITY MANAGEMENT SYSTEM ISOIEC 270012005 IT SERVICE MANAGEMENT SYSTEM ISOIEC 2000012011 QUALITY MANAGEMENT SYSTEM ISO 900120086 What is your policy on abuse We have a zerotolerance policy on abuse7 Do you allow to run gamingmining We do not allow to run any sort of games like Counter Strike Quake etc nor we allow to run any sort of mining such as cryptocurrencies andor anything similar8 Do you allow the use of your servers for downloading content available only in India Circumvention of geographical restrictions that violate content licensing using our servers is NOT allowed9 Does E2E provides Self Managed servers Yes E2E only offers Self Managed servers Self Managed servers are servers in which E2E does NOT provide any maintenance management and support These servers are managed entirely by the customers The only thing that E2E is responsible for is server and network uptime Customers with technological savvy team and experience consider selfmanaged servers10 Do you support AnonymizationPublic VPN access for anonymizationTor nodes Any use case that involves hiding the IP address of an end user using our servers is a prohibitedProductsCPU Intensive CloudHigh Memory CloudLinux Smart DedicatedcPanel Linux CloudWindows CloudWindows SQL CloudPlesk Windows CloudGPU Smart DedicatedLoad BalancerCompanyAbout UsMeet the TeamBecome a PartnerE2E in MediaTestimonialsInvestorsCareersContact UsContact SalesEscalation MatrixService Level AgreementTerms of ServicePrivacy PolicyRefund PolicyPolicy FAQResourcesBlogEventsService Health StatusHelpWhitePapersEcosystem EnablersCustomersCertificationsCountries ServedFAQsE2E CloudE2E Networks Limited is Indias fastest growing accelerated cloud computing playerSubscribe to our newsletterGet latest news articles resources and trends delivered to your inbox weeklyThank you Your submission has been receivedOops Something went wrong while submitting the formCIN Number L72900DL2009PLC341980 Copyright 2024 E2E Networks Limited YouTubeInstagram


Abuse Attacks E2E Networks documentation Skip to content E2E Cloud Docs E2E Networks TIR Toggle navigation menu Login Sign Up E2E Networks documentation K Docs E2E Networks TIR Myaccount Getting Started with Myaccount SignUp Process for Indian Customers Customer validation Process for Indian Customers SignUp Process for International Customers Customer Validation Process for International Process Customer Validation Process for Contact Persons Domestic Customer Validation Process FAQs International Customer Validation Process FAQs Sign In Process Release Notes Compute Nodes Virtual Compute Nodes Monitoring 1Click Deployment Active Directory GPU GPU Cloud EQS Introduction How to Create EQS Actions Add Queue under tab Actions for queue service Using SDK Appliance Load Balancer Appliance Auto Scaling Introduction Concepts Define Scale Groups FaaS Function as a Service FaaS How to Create Functions Functions Information Network CDN VPC How to reserve an IP address Reserve IP Pool DNS Custom Reverse DNS Firewall Security Group Tag Security Firewall Bitninja Best Practices SSH Key Management Audit Logs Password Policy 2Factor Authentication Others License Management User Management Purchase SSL CertbotPlugin Apply or Redeem Coupon Code Account Statement Cloud Platform Support Introduction Platform Support Policy FAQ E2Es MyAccount FAQs Code of Conduct of Directors and Senior Management CSR Policy Whistle blower policy Jitsi Meet Mod Evasive Multisite using cPanel Softaculous Copying data from Linux to Windows using WinSCP Migrate MySQL Database Between DBaaS Manage MySQL Abuse Abuse Logs Abuse Attacks Spam Mails Phishing Complaint Copyright Complaint Billing Payment Payment Method EMandate Redeem Coupon Customer Details Updation Setup AutoDebit feature TDS Deduction process Declaration us 206AB Minimum Billing Provisioning and Deprovisioning Process View Invoice and Payment Prepaid Billing Set up Infra Credits Balance Alert Whatsapp notification for Payment reminder Restore Service on a Suspended Account for NonPayment Database Database Database PostgreSQL Parameter Group How to create Parameter Group MongoDB mariaDB Storage Storage Block Storage Object Storage CDP Backup Scalable File System Kubernetes Kubernetes Service Kubernetes Kubernetes Marketplace Monitoring Stack Cert Manager Nginx Ingress Controller Troubleshooting Argo CD Declarative GitOps CD for Kubernetes Deploy to Kubernetes using Argo CD and GitOps Jenkins CI Tool Setup Jenkins On Kubernetes Cluster Ansible CD Tool Istio Service Connecting to Dbaas FAQS Container Registery Container Registry Simplifying Pull Operations with UserFriendly Interface API Developers Guide API SDK E2E CLI Tool Introduction Terraform Terraform Getting Started e2enode Resource Node Plans e2eimage Resource AIML TIR AI Release Notes TIR AI Platform Introduction Getting Started Howto Guides Projects Notebooks Committed Notebook GPU H100 Plans Datasets Model Repository Model Endpoints Pipeline Run Scheduled Run Fine Tuning Models Model Playground Samples and Tutorials API Tokens SSH Key Container Team Features Settings Analytics Billing AIML Tutorials Finetune LLMA with Multiple GPUs Deploy Inference for LLMA 2 Deploy Inference for Codellama Deploy Inference for Stable Diffusion v21 Finetune Stable Diffusion model on TIR Deploy Inference for MPT7BCHAT Custom Containers in TIR Fine Tuning Bloom Natural Language Queries to SQL wth Code Llama E2E Networks documentation Welcome to E2E Abuse documentation Abuse Attacks Abuse Attacks What is a server compromise How to take steps to resolve it A server compromise is a situation where in you could have had unauthorized access to your server As a result of this suspicious processes may be running on your server andor compromise the integrity of your system How to troubleshoot and resolve it First you would need to determine the extent of the compromise by checking for suspicious processes by using the ps command If there are compromised processes running as root then you should assume this to be a root compromised system and build a new server and migrate The first thing to determine in starting to cleanup a server with malware is to do the following Check for suspicious processes and kill them and clean the files on those paths Turn off any services not being used Block all outbound connections from the server until malware issue is resolved alternatively turn off all services to prevent any outbound attacks Check for suspicious files in your web root and any suspicious cron entries Check for any recently modified files by using the find command A typical example would be to search for all files in the last 7 days using find command find name ph ctime 7 Check for filenames with unusual extensions Run any malware opensource scanner like maldet to scan the entire system to determine malware Check logs for ssh and webservers and any other custom service running on the server to determine how the malware attack happened This will assist further to help further secure the systems to prevent a further attack In general the following steps can be taken to improve the security of the system to prevent any attacks on the server Use ssh keys and disable ssh passwords to improve the security of the login process Run a periodic malware scanner like maldet to detect any anomalous files on the server Use a WAF like modsecurity or any alternate service like cloudflare with WAF to secure public websites Use a rootkit detection tool or a tripwire tool to detect any suspicious activity on the server Periodically ensure backups for the servers are taken Please note that this document is provided for the benefit of our customers and the community at large E2E Networks is not responsible for any inadvertent issues arising out of trying out any of the advise here or using by any of the tools In case any of your server at E2E Networks is compromised Please note that during the entire process we request you to communicate and kindly take immediate action to fix the issue as the lack of response or resolution of the issue would be a contravention of IT Act 2000 and would lead to disabling of the public network What is a malware attack How to take steps to resolve it Malware is a type of server compromise where malicious code is running on your server You could have malware uploaded through ssh if ssh password or key is compromised code injection or SQL injection uploaded through a website where it is not checked thoroughly or through any vulnerable services running on the server They could also The impact of malware on your server can result in outbound attacks occurring from your server run suspicious processes mining bitcoins send spam emails etc They could also be dormant and give a backdoor to an attacker to get into the server How to troubleshoot and resolve it First you would need to determine the extent of the compromise by checking for suspicious processes by using the ps command If there are compromised processes running as root then you should assume this to be a root compromised system and build a new server and migrate The first thing to determine in starting to cleanup a server with malware is to do the following Check for suspicious processes and kill them and clean the files on those paths Turn off any services not being used Block all outbound connections from the server until malware issue is resolved alternatively turn off all services to prevent any outbound attacks Check for suspicious files in your web root and any suspicious cron entries Check for any recently modified files by using the find command A typical example would be to search for all files in the last 7 days using find command find name ph ctime 7 Check for filenames with unusual extensions Run any malware opensource scanner like maldet to scan the entire system to determine malware Check logs for ssh and webservers and any other custom service running on the server to determine how the malware attack happened This will assist further to help further secure the systems to prevent a further attack In general the following steps can be taken to improve the security of the system to prevent any attacks on the server Use ssh keys and disable ssh passwords to improve the security of the login process Run a periodic malware scanner like maldet to detect any anomalous files on the server Use a WAF like modsecurity or any alternate service like cloudflare with WAF to secure public websites Use a rootkit detection tool or a tripwire tool to detect any suspicious activity on the server Periodically ensure backups for the servers are taken Please note that this document is provided for the benefit of our customers and the community at large E2E Networks is not responsible for any inadvertent issues arising out of trying out any of the advise here or using by any of the tools In case any of your server at E2E Networks is compromised Please note that during the entire process we request you to communicate and kindly take immediate action to fix the issue as the lack of response or resolution of the issue would be a contravention of IT Act 2000 and would lead to disabling of the public network Products TIR AI Platform GPU Dedicated Compute CPU Intensive Cloud High Memory Cloud Linux Smart Dedicated cPanel Linux Cloud Windows Cloud Windows SQL Cloud Plesk Windows Cloud GPU Smart Dedicated Load Balancer Company About Us Meet the Team Become a Partner E2E in Media Testimonials Investors Careers Contact Us Contact Sales Escalation Matrix Service Level Agreement Terms of Service Privacy Policy Refund Policy Policy FAQ Resources Blog Events Service Health Status Help White Papers Ecosystem Enablers Customers Certifications Countries Served FAQs E2E Networks Limited E2E Networks Limited is a NSE Listed AIFirst Hyperscale Cloud Computing Platform CIN Number L72900DL2009PLC341980 Copyright 2023 E2E Networks Limited


Welcome to E2E Volume documentation E2E Networks documentation Skip to content E2E Cloud Docs E2E Networks TIR Toggle navigation menu Login Sign Up E2E Networks documentation K Docs E2E Networks TIR Myaccount Getting Started with Myaccount SignUp Process for Indian Customers Customer validation Process for Indian Customers SignUp Process for International Customers Customer Validation Process for International Process Customer Validation Process for Contact Persons Domestic Customer Validation Process FAQs International Customer Validation Process FAQs Sign In Process Release Notes Compute Nodes Virtual Compute Nodes Monitoring 1Click Deployment Active Directory GPU GPU Cloud EQS Introduction How to Create EQS Actions Add Queue under tab Actions for queue service Using SDK Appliance Load Balancer Appliance Auto Scaling Introduction Concepts Define Scale Groups FaaS Function as a Service FaaS How to Create Functions Functions Information Network CDN VPC How to reserve an IP address Reserve IP Pool DNS Custom Reverse DNS Firewall Security Group Tag Security Firewall Bitninja Best Practices SSH Key Management Audit Logs Password Policy 2Factor Authentication Others License Management User Management Purchase SSL CertbotPlugin Apply or Redeem Coupon Code Account Statement Cloud Platform Support Introduction Platform Support Policy FAQ E2Es MyAccount FAQs Code of Conduct of Directors and Senior Management CSR Policy Whistle blower policy Jitsi Meet Mod Evasive Multisite using cPanel Softaculous Copying data from Linux to Windows using WinSCP Migrate MySQL Database Between DBaaS Manage MySQL Abuse Abuse Logs Abuse Attacks Spam Mails Phishing Complaint Copyright Complaint Billing Payment Payment Method EMandate Redeem Coupon Customer Details Updation Setup AutoDebit feature TDS Deduction process Declaration us 206AB Minimum Billing Provisioning and Deprovisioning Process View Invoice and Payment Prepaid Billing Set up Infra Credits Balance Alert Whatsapp notification for Payment reminder Restore Service on a Suspended Account for NonPayment Database Database Database PostgreSQL Parameter Group How to create Parameter Group MongoDB mariaDB Storage Storage Block Storage Object Storage CDP Backup Scalable File System Kubernetes Kubernetes Service Kubernetes Kubernetes Marketplace Monitoring Stack Cert Manager Nginx Ingress Controller Troubleshooting Argo CD Declarative GitOps CD for Kubernetes Deploy to Kubernetes using Argo CD and GitOps Jenkins CI Tool Setup Jenkins On Kubernetes Cluster Ansible CD Tool Istio Service Connecting to Dbaas FAQS Container Registery Container Registry Simplifying Pull Operations with UserFriendly Interface API Developers Guide API SDK E2E CLI Tool Introduction Terraform Terraform Getting Started e2enode Resource Node Plans e2eimage Resource AIML TIR AI Release Notes TIR AI Platform Introduction Getting Started Howto Guides Projects Notebooks Committed Notebook GPU H100 Plans Datasets Model Repository Model Endpoints Pipeline Run Scheduled Run Fine Tuning Models Model Playground Samples and Tutorials API Tokens SSH Key Container Team Features Settings Analytics Billing AIML Tutorials Finetune LLMA with Multiple GPUs Deploy Inference for LLMA 2 Deploy Inference for Codellama Deploy Inference for Stable Diffusion v21 Finetune Stable Diffusion model on TIR Deploy Inference for MPT7BCHAT Custom Containers in TIR Fine Tuning Bloom Natural Language Queries to SQL wth Code Llama E2E Networks documentation E2E Networks Storage Solutions Welcome to E2E Volume documentation Welcome to E2E Volume documentation Topics Introduction Getting Started Creating Volume Login to MyAccount Portal Navigate to Volume Add Volume Volume Configurations Volume Details Attaching Volume to your Node Enable Monitoring for your Volume Detaching Volume from your Node Create a Snapshot Upgrade Volume Delete a Volume Make your Block Storage volume available for use on Linux Make your Block Storage volume available for use on Windows Products TIR AI Platform GPU Dedicated Compute CPU Intensive Cloud High Memory Cloud Linux Smart Dedicated cPanel Linux Cloud Windows Cloud Windows SQL Cloud Plesk Windows Cloud GPU Smart Dedicated Load Balancer Company About Us Meet the Team Become a Partner E2E in Media Testimonials Investors Careers Contact Us Contact Sales Escalation Matrix Service Level Agreement Terms of Service Privacy Policy Refund Policy Policy FAQ Resources Blog Events Service Health Status Help White Papers Ecosystem Enablers Customers Certifications Countries Served FAQs E2E Networks Limited E2E Networks Limited is a NSE Listed AIFirst Hyperscale Cloud Computing Platform CIN Number L72900DL2009PLC341980 Copyright 2023 E2E Networks Limited


E2E Networks Container Registry Service E2E Networks documentation Skip to content E2E Cloud Docs E2E Networks TIR Toggle navigation menu Login Sign Up E2E Networks documentation K Docs E2E Networks TIR Myaccount Getting Started with Myaccount SignUp Process for Indian Customers Customer validation Process for Indian Customers SignUp Process for International Customers Customer Validation Process for International Process Customer Validation Process for Contact Persons Domestic Customer Validation Process FAQs International Customer Validation Process FAQs Sign In Process Release Notes Compute Nodes Virtual Compute Nodes Monitoring 1Click Deployment Active Directory GPU GPU Cloud EQS Introduction Appliance Load Balancer Appliance Auto Scaling Introduction Concepts Define Scale Groups FaaS Function as a Service FaaS Network CDN VPC How to reserve an IP address Reserve IP Pool DNS Custom Reverse DNS Firewall Security Group Tag Security Firewall Bitninja Best Practices SSH Key Management Audit Logs Password Policy 2Factor Authentication Others License Management User Management Purchase SSL CertbotPlugin Apply or Redeem Coupon Code Account Statement Cloud Platform Support Introduction Platform Support Policy FAQ E2Es MyAccount FAQs Code of Conduct of Directors and Senior Management CSR Policy Whistle blower policy Jitsi Meet Mod Evasive Multisite using cPanel Softaculous Copying data from Linux to Windows using WinSCP Migrate MySQL Database Between DBaaS Manage MySQL Abuse Abuse Logs Abuse Attacks Spam Mails Phishing Complaint Copyright Complaint Billing Payment Payment Method EMandate Redeem Coupon Customer Details Updation Setup AutoDebit feature TDS Deduction process Declaration us 206AB Minimum Billing Provisioning and Deprovisioning Process View Invoice and Payment Prepaid Billing Set up Infra Credits Balance Alert Whatsapp notification for Payment reminder Restore Service on a Suspended Account for NonPayment Database Database Database PostgreSQL Parameter Group MongoDB mariaDB Storage Storage Block Storage Object Storage CDP Backup Scalable File System Kubernetes Kubernetes Service Kubernetes Kubernetes Marketplace Monitoring Stack Cert Manager Nginx Ingress Controller Troubleshooting Argo CD Declarative GitOps CD for Kubernetes Deploy to Kubernetes using Argo CD and GitOps Jenkins CI Tool Setup Jenkins On Kubernetes Cluster Ansible CD Tool Istio Service Connecting to Dbaas FAQS Container Registery Container Registery API Developers Guide API SDK E2E CLI Tool Introduction Terraform Terraform Getting Started e2enode Resource Node Plans e2eimage Resource AIML TIR AI Release Notes TIR AI Platform Introduction Getting Started Howto Guides Projects Notebooks Committed Notebook GPU H100 Plans Datasets Model Repository Model Endpoints Pipeline Run Scheduled Run Fine Tuning Models Model Playground Samples and Tutorials API Tokens SSH Key Container Team Features Settings Analytics Billing AIML Tutorials Finetune LLMA with Multiple GPUs Deploy Inference for LLMA 2 Deploy Inference for Codellama Deploy Inference for Stable Diffusion v21 Finetune Stable Diffusion model on TIR Deploy Inference for MPT7BCHAT Custom Containers in TIR Fine Tuning Bloom Natural Language Queries to SQL wth Code Llama E2E Networks documentation E2E Networks Container Registry Service E2E Networks Container Registry Service The Container Registry section of the E2E Networks documentation is focused on providing users with guidance on using the Container Registry Service This section includes detailed information on how to effectively use the Container Registry with userfriendly interfaces for simplifying pull operations Key Topics For more detailed information on each aspect of the Container Registry service refer to follow sections in our documentation Overview of Container Registry Introduction to the service Getting Started Initial setup and configuration steps Managing Containers Instructions on container management and version control Pulling from the Registry Detailed process for pulling images Security and Access Guidelines on ensuring security and managing access controls As a next step head to this section On this page Key Topics Products TIR AI Platform GPU Dedicated Compute CPU Intensive Cloud High Memory Cloud Linux Smart Dedicated cPanel Linux Cloud Windows Cloud Windows SQL Cloud Plesk Windows Cloud GPU Smart Dedicated Load Balancer Company About Us Meet the Team Become a Partner E2E in Media Testimonials Investors Careers Contact Us Contact Sales Escalation Matrix Service Level Agreement Terms of Service Privacy Policy Refund Policy Policy FAQ Resources Blog Events Service Health Status Help White Papers Ecosystem Enablers Customers Certifications Countries Served FAQs E2E Networks Limited E2E Networks Limited is a NSE Listed AIFirst Hyperscale Cloud Computing Platform CIN Number L72900DL2009PLC341980 Copyright 2023 E2E Networks Limited


Node Plans E2E Networks documentation Skip to content E2E Cloud Docs E2E Networks TIR Toggle navigation menu Login Sign Up E2E Networks documentation K Docs E2E Networks TIR Myaccount Getting Started with Myaccount SignUp Process for Indian Customers Customer validation Process for Indian Customers SignUp Process for International Customers Customer Validation Process for International Process Customer Validation Process for Contact Persons Domestic Customer Validation Process FAQs International Customer Validation Process FAQs Sign In Process Release Notes Compute Nodes Virtual Compute Nodes Monitoring 1Click Deployment Active Directory GPU GPU Cloud EQS Introduction How to Create EQS Actions Add Queue under tab Actions for queue service Using SDK Appliance Load Balancer Appliance Auto Scaling Introduction Concepts Define Scale Groups FaaS Function as a Service FaaS How to Create Functions Functions Information Network CDN VPC How to reserve an IP address Reserve IP Pool DNS Custom Reverse DNS Firewall Security Group Tag Security Firewall Bitninja Best Practices SSH Key Management Audit Logs Password Policy 2Factor Authentication Others License Management User Management Purchase SSL CertbotPlugin Apply or Redeem Coupon Code Account Statement Cloud Platform Support Introduction Platform Support Policy FAQ E2Es MyAccount FAQs Code of Conduct of Directors and Senior Management CSR Policy Whistle blower policy Jitsi Meet Mod Evasive Multisite using cPanel Softaculous Copying data from Linux to Windows using WinSCP Migrate MySQL Database Between DBaaS Manage MySQL Abuse Abuse Logs Abuse Attacks Spam Mails Phishing Complaint Copyright Complaint Billing Payment Payment Method EMandate Redeem Coupon Customer Details Updation Setup AutoDebit feature TDS Deduction process Declaration us 206AB Minimum Billing Provisioning and Deprovisioning Process View Invoice and Payment Prepaid Billing Set up Infra Credits Balance Alert Whatsapp notification for Payment reminder Restore Service on a Suspended Account for NonPayment Database Database Database PostgreSQL Parameter Group How to create Parameter Group MongoDB mariaDB Storage Storage Block Storage Object Storage CDP Backup Scalable File System Kubernetes Kubernetes Service Kubernetes Kubernetes Marketplace Monitoring Stack Cert Manager Nginx Ingress Controller Troubleshooting Argo CD Declarative GitOps CD for Kubernetes Deploy to Kubernetes using Argo CD and GitOps Jenkins CI Tool Setup Jenkins On Kubernetes Cluster Ansible CD Tool Istio Service Connecting to Dbaas FAQS Container Registery Container Registry Simplifying Pull Operations with UserFriendly Interface API Developers Guide API SDK E2E CLI Tool Introduction Terraform Terraform Getting Started e2enode Resource Node Plans e2eimage Resource AIML TIR AI Release Notes TIR AI Platform Introduction Getting Started Howto Guides Projects Notebooks Committed Notebook GPU H100 Plans Datasets Model Repository Model Endpoints Pipeline Run Scheduled Run Fine Tuning Models Model Playground Samples and Tutorials API Tokens SSH Key Container Team Features Settings Analytics Billing AIML Tutorials Finetune LLMA with Multiple GPUs Deploy Inference for LLMA 2 Deploy Inference for Codellama Deploy Inference for Stable Diffusion v21 Finetune Stable Diffusion model on TIR Deploy Inference for MPT7BCHAT Custom Containers in TIR Fine Tuning Bloom Natural Language Queries to SQL wth Code Llama E2E Networks documentation Welcome to E2E Terraforms documentation Node Plans Node Plans Contents Linux Virtual Node CPU Intensive High Memory CPU Intensive 3rd Generation High Memory 3rd Generation Windows Virtual Node Windows 2016 Windows 2019 Windows 2022 GPU NVIDIA A 100 NVIDIA RTX 8000 NVIDIA T4 NVIDA V 100 NVIDIA A30 NVIDIA A40 Spot Instance NVIDIA A 100 vGPU NVIDIA A 100 Linux Smart Dedicated Compute Smart Dedicated Compute 3rd Generation Linux Smart Dedicated Compute Products TIR AI Platform GPU Dedicated Compute CPU Intensive Cloud High Memory Cloud Linux Smart Dedicated cPanel Linux Cloud Windows Cloud Windows SQL Cloud Plesk Windows Cloud GPU Smart Dedicated Load Balancer Company About Us Meet the Team Become a Partner E2E in Media Testimonials Investors Careers Contact Us Contact Sales Escalation Matrix Service Level Agreement Terms of Service Privacy Policy Refund Policy Policy FAQ Resources Blog Events Service Health Status Help White Papers Ecosystem Enablers Customers Certifications Countries Served FAQs E2E Networks Limited E2E Networks Limited is a NSE Listed AIFirst Hyperscale Cloud Computing Platform CIN Number L72900DL2009PLC341980 Copyright 2023 E2E Networks Limited


Welcome to E2E GPU clouds documentation E2E Networks documentation Skip to content E2E Cloud Docs E2E Networks TIR Toggle navigation menu Login Sign Up E2E Networks documentation K Docs E2E Networks TIR Myaccount Getting Started with Myaccount SignUp Process for Indian Customers Customer validation Process for Indian Customers SignUp Process for International Customers Customer Validation Process for International Process Customer Validation Process for Contact Persons Domestic Customer Validation Process FAQs International Customer Validation Process FAQs Sign In Process Release Notes Compute Nodes Virtual Compute Nodes Monitoring 1Click Deployment Active Directory GPU GPU Cloud EQS Introduction Appliance Load Balancer Appliance Auto Scaling Introduction Concepts Define Scale Groups FaaS Function as a Service FaaS Network CDN VPC How to reserve an IP address Reserve IP Pool DNS Custom Reverse DNS Firewall Security Group Tag Security Firewall Bitninja Best Practices SSH Key Management Audit Logs Password Policy 2Factor Authentication Others License Management User Management Purchase SSL CertbotPlugin Apply or Redeem Coupon Code Account Statement Cloud Platform Support Introduction Platform Support Policy FAQ E2Es MyAccount FAQs Code of Conduct of Directors and Senior Management CSR Policy Whistle blower policy Jitsi Meet Mod Evasive Multisite using cPanel Softaculous Copying data from Linux to Windows using WinSCP Migrate MySQL Database Between DBaaS Manage MySQL Abuse Abuse Logs Abuse Attacks Spam Mails Phishing Complaint Copyright Complaint Billing Payment Payment Method EMandate Redeem Coupon Customer Details Updation Setup AutoDebit feature TDS Deduction process Declaration us 206AB Minimum Billing Provisioning and Deprovisioning Process View Invoice and Payment Prepaid Billing Set up Infra Credits Balance Alert Whatsapp notification for Payment reminder Restore Service on a Suspended Account for NonPayment Database Database Database PostgreSQL Parameter Group MongoDB mariaDB Storage Storage Block Storage Object Storage CDP Backup Scalable File System Kubernetes Kubernetes Service Kubernetes Kubernetes Marketplace Monitoring Stack Cert Manager Nginx Ingress Controller Troubleshooting Argo CD Declarative GitOps CD for Kubernetes Deploy to Kubernetes using Argo CD and GitOps Jenkins CI Tool Setup Jenkins On Kubernetes Cluster Ansible CD Tool Istio Service Connecting to Dbaas FAQS Container Registery Container Registery API Developers Guide API SDK E2E CLI Tool Introduction Terraform Terraform Getting Started e2enode Resource Node Plans e2eimage Resource AIML TIR AI Release Notes TIR AI Platform Introduction Getting Started Howto Guides Projects Notebooks Committed Notebook GPU H100 Plans Datasets Model Repository Model Endpoints Pipeline Run Scheduled Run Fine Tuning Models Model Playground Samples and Tutorials API Tokens SSH Key Container Team Features Settings Analytics Billing AIML Tutorials Finetune LLMA with Multiple GPUs Deploy Inference for LLMA 2 Deploy Inference for Codellama Deploy Inference for Stable Diffusion v21 Finetune Stable Diffusion model on TIR Deploy Inference for MPT7BCHAT Custom Containers in TIR Fine Tuning Bloom Natural Language Queries to SQL wth Code Llama E2E Networks documentation Welcome to E2E GPU Cloud Documentation Welcome to E2E GPU clouds documentation Welcome to E2E GPU clouds documentation Contents Introduction GPU Cloud Computing Nvidia Tesla V100 GPUs On Cloud Why Use a Tesla V100 GPU Tesla V100 GPUs On E2E Cloud Make the Most From Tesla V100 GPUs on Cloud Nvidia Tesla T4 GPUs On Cloud How T4 is advantageous for Inferencing Platform Video Transcoding Performance Using T4 Make the Most From Tesla T4 GPUs on E2E Cloud NVIDIA A40 NVIDIA A40 Architectural Innovations NVIDIA A40 USE CASES A40 GPUs On E2E Cloud NVIDIA A30 NVIDIA A30 Architectural Innovations NVIDIA A30 USE CASES NVIDIA A100 GPUs on Cloud Elastic Data centers NVIDIA Ampere Architectural Innovations NVIDIA A100 USE CASES A100 GPUs On E2E Cloud NVIDIA GPU CloudNGC with E2E Cloud Compute Prerequisites Launching an instance based on the NGC image Connect to your NGC instance Start with your NGC container NvidiaDocker To verify bridge between Container GPU What is NvidiaDocker How to verify docker container is able to access the GPU NVIDIA GPU Cloud NGC Container Registry Where NGC NVIDIA GPU Cloud Container images hosted List of NVIDIA GPU Cloud NGC Components How to Access NGC Software Catalog Accessing And Pulling A Container From NGC Registry Running A Container Which was Pulled from NGC Registry NVIDIA GPU Cloud NGC Catalog CLI Introduction How to run a Jupyter Notebook inside Tensorflow Container for Accelerated Machine Learning E2E GPU Wizard Launching an Instance based on Tensorflow container with Jupyternotebook Running How to run a Jupyter Notebook inside Pytorch Container for Accelerated Machine Learning E2E GPU Wizard How to Run FashionMNIST Dataset Image Recognition Pytorch Notebook Troubleshooting steps if notebook isnt accessible Why doesnt my notebook have a password NVIDIA PARABRICKS Introduction Why Use Nvidia Parabricks Installation Applications Example Tutorial Installing CUDA 8 on Ubuntu 16 Introduction Installation Steps Tutorial How to access Jupyter Lab using browser SSH Tunneling to Connect with JupyterLab SSH Tunneling with a Mac or Linux SSH Tunneling with Windows and Putty How to Leverage E2E Object StorageEOS for your TensorFlow Projects Introduction How Do I access Audio over Remote Desktop Introduction Windows Audio Service Windows Group Policy Windows RD Client In MacOS Testing Audio FAQs SessionissuewithNew windowsserver2019rdslicense Nvidia Grid Driver Installation CUDA Installation Manage GPU with E2E Actions Access Console Power Off Start Reboot Reinstall Save Image Convert to committed Node Enable Recovery Node Lock Node Delete Products TIR AI Platform GPU Dedicated Compute CPU Intensive Cloud High Memory Cloud Linux Smart Dedicated cPanel Linux Cloud Windows Cloud Windows SQL Cloud Plesk Windows Cloud GPU Smart Dedicated Load Balancer Company About Us Meet the Team Become a Partner E2E in Media Testimonials Investors Careers Contact Us Contact Sales Escalation Matrix Service Level Agreement Terms of Service Privacy Policy Refund Policy Policy FAQ Resources Blog Events Service Health Status Help White Papers Ecosystem Enablers Customers Certifications Countries Served FAQs E2E Networks Limited E2E Networks Limited is a NSE Listed AIFirst Hyperscale Cloud Computing Platform CIN Number L72900DL2009PLC341980 Copyright 2023 E2E Networks Limited


Other Services on E2E Networks E2E Networks documentation Skip to content E2E Cloud Docs E2E Networks TIR Toggle navigation menu Login Sign Up E2E Networks documentation K Docs E2E Networks TIR Myaccount Getting Started with Myaccount SignUp Process for Indian Customers Customer validation Process for Indian Customers SignUp Process for International Customers Customer Validation Process for International Process Customer Validation Process for Contact Persons Domestic Customer Validation Process FAQs International Customer Validation Process FAQs Sign In Process Release Notes Compute Nodes Virtual Compute Nodes Monitoring 1Click Deployment Active Directory GPU GPU Cloud EQS Introduction How to Create EQS Actions Add Queue under tab Actions for queue service Using SDK Appliance Load Balancer Appliance Auto Scaling Introduction Concepts Define Scale Groups FaaS Function as a Service FaaS How to Create Functions Functions Information Network CDN VPC How to reserve an IP address Reserve IP Pool DNS Custom Reverse DNS Firewall Security Group Tag Security Firewall Bitninja Best Practices SSH Key Management Audit Logs Password Policy 2Factor Authentication Others License Management User Management Purchase SSL CertbotPlugin Apply or Redeem Coupon Code Account Statement Cloud Platform Support Introduction Platform Support Policy FAQ E2Es MyAccount FAQs Code of Conduct of Directors and Senior Management CSR Policy Whistle blower policy Jitsi Meet Mod Evasive Multisite using cPanel Softaculous Copying data from Linux to Windows using WinSCP Migrate MySQL Database Between DBaaS Manage MySQL Abuse Abuse Logs Abuse Attacks Spam Mails Phishing Complaint Copyright Complaint Billing Payment Payment Method EMandate Redeem Coupon Customer Details Updation Setup AutoDebit feature TDS Deduction process Declaration us 206AB Minimum Billing Provisioning and Deprovisioning Process View Invoice and Payment Prepaid Billing Set up Infra Credits Balance Alert Whatsapp notification for Payment reminder Restore Service on a Suspended Account for NonPayment Database Database Database PostgreSQL Parameter Group How to create Parameter Group MongoDB mariaDB Storage Storage Block Storage Object Storage CDP Backup Scalable File System Kubernetes Kubernetes Service Kubernetes Kubernetes Marketplace Monitoring Stack Cert Manager Nginx Ingress Controller Troubleshooting Argo CD Declarative GitOps CD for Kubernetes Deploy to Kubernetes using Argo CD and GitOps Jenkins CI Tool Setup Jenkins On Kubernetes Cluster Ansible CD Tool Istio Service Connecting to Dbaas FAQS Container Registery Container Registry Simplifying Pull Operations with UserFriendly Interface API Developers Guide API SDK E2E CLI Tool Introduction Terraform Terraform Getting Started e2enode Resource Node Plans e2eimage Resource AIML TIR AI Release Notes TIR AI Platform Introduction Getting Started Howto Guides Projects Notebooks Committed Notebook GPU H100 Plans Datasets Model Repository Model Endpoints Pipeline Run Scheduled Run Fine Tuning Models Model Playground Samples and Tutorials API Tokens SSH Key Container Team Features Settings Analytics Billing AIML Tutorials Finetune LLMA with Multiple GPUs Deploy Inference for LLMA 2 Deploy Inference for Codellama Deploy Inference for Stable Diffusion v21 Finetune Stable Diffusion model on TIR Deploy Inference for MPT7BCHAT Custom Containers in TIR Fine Tuning Bloom Natural Language Queries to SQL wth Code Llama E2E Networks documentation Other Services on E2E Networks Other Services on E2E Networks This section of our documentation covers a wide array of services and functionalities Its designed to provide users with essential information on various aspects such as license management user account operations SSL certificate procurement and specific configuration guidelines like CertbotPlugin Additionally it offers insights into using coupon codes understanding account statements and availing cloud platform support This section is also a resource for policy FAQs and other miscellaneous tools Key Areas Covered For detailed information on each topic visit the specific sections in our documentation License Management Guidelines for managing software licenses User Management Instructions on user account operations SSL Certificates Process for SSL certificate procurement CertbotPlugin Configuration Steps for setting up CertbotPlugin Coupon Code Redemption How to redeem and use coupon codes Account Statements Understanding and managing account statements Cloud Platform Support Support options for cloud platform users Policy FAQs Frequently asked questions about policies Myaccount FAQs Frequently asked questions on Myaccount Significant Policies Guidelines on some other significant policies Using Jitsi Meet Using Jitsi Meet on E2E Cloud Mod Evasive Using Modevasive on E2E Cloud Multisite using cPanel Softaculous Seamless installations using cPanel Softaculous Copying data from Linux to Windows using WinSCP How to copy data from Linux to Windows Migrate MySQL Database Between DBaaS Guide to migrating MySQL database between DBaaS Manage MySQL Guide to managing MySql On this page Key Areas Covered Products TIR AI Platform GPU Dedicated Compute CPU Intensive Cloud High Memory Cloud Linux Smart Dedicated cPanel Linux Cloud Windows Cloud Windows SQL Cloud Plesk Windows Cloud GPU Smart Dedicated Load Balancer Company About Us Meet the Team Become a Partner E2E in Media Testimonials Investors Careers Contact Us Contact Sales Escalation Matrix Service Level Agreement Terms of Service Privacy Policy Refund Policy Policy FAQ Resources Blog Events Service Health Status Help White Papers Ecosystem Enablers Customers Certifications Countries Served FAQs E2E Networks Limited E2E Networks Limited is a NSE Listed AIFirst Hyperscale Cloud Computing Platform CIN Number L72900DL2009PLC341980 Copyright 2023 E2E Networks Limited