Jay-Rajput/oci_data huggingface dataset:
What are Data Integration Applications


In Data Integration, an application is a container at the workspace level for runtime objects such as published tasks and task runs.

You can schedule and run published tasks, and monitor and compare task runs in an application.

Each workspace in Data Integration is created with a default application that you can use right away. You might, however, want to create your own applications. You can use applications to manage the life cycle of your data integration projects from development to testing to deployment in production.

Data Integration lets you create an application from scratch, or as a copy of another application. When creating a copy, only the published tasks and their dependencies from the source application are copied to the new target application. In the target application, you can map to different data assets, connections, and schemas. You can also refresh or sync the target application when you have changes in the source application.

The following describes how you might use applications to manage your runtime objects for different projects in a workspace. For example, if you have a project for Enterprise Resource Planning (ERP) data flows and tasks, and a project for Human Capital Management (HCM), you might create an ERP Application and an HCM Application. In addition, you might also have different applications for development and testing. The applications for testing can be created using existing resources in the respective development applications, as shown in the following illustration. When changes are made to the number and type of published tasks in a development application, you can sync the testing application with the changes.

The existing (source) application that you want to copy does not have to be in the same compartment or workspace as the new (target) application. For example, if you have separate workspaces for development, testing, and production, you can create your testing application in workspace 2 as a copy of the development application that is in workspace 1, and sync changes when needed. Similarly, you can create your production application in workspace 3 as a copy of the testing application that is in workspace 2, and sync changes when needed.
Appendices


Topics:

Write Performant Queries for Searching and Exporting Logs

Write Performant Regular Expressions

Write Performant Extended Field Extraction Expression

SQL Query Guidelines

Filter Logs by Hash Mask

Security of Your Logs in Logging Analytics
Creating Cloud Advisor policies

Resource-Types
Supported Variables
Details for Verb + Resource-Type Combinations
Permissions Required for Each API Operation
Networking Overview

Networking Components
Allowed VCN Size and Address Ranges
Availability Domains and Your VCN
Default Components that Come With Your VCN
Connectivity Choices
Networking Scenarios
Regions and Availability Domains
Public IP Address Ranges
IP Addresses Reserved for Use by Oracle
169.254.0.0/16
Class D and Class E
Three IP Addresses in Each Subnet
Creating Automation with Events
Resource Identifiers
Ways to Access Oracle Cloud Infrastructure
Authentication and Authorization
Limits on Your Networking Components
Overview of Marketplace

Resource Identifiers
Ways to Access Oracle Cloud Infrastructure
Authentication and Authorization
Creating an External Connection


Create a connection to external repositories such as GitHub, GitLab, Bitbucket Cloud, Visual Builder Studio, Bitbucket Server, and GitLab Server.

Before creating the connection, you must do the following depending on the repository you want to connect to:

GitHub Enterprise Cloud, GitLab SaaS, GitLab Server, and Visual Builder Studio: You have to retrieve a personal access token (PAT) from those providers and store your PAT securely in an OCI vault. For instructions, see Build Source Integration.
Bitbucket Cloud: You need your Bitbucket username and create an app password, then store the app password in an OCI vault. See Generating an App Password for Bitbucket Cloud.
Bitbucket Server: Create HTTP access token and then store the access token in an OCI vault.

Each service in OCI integrates with Identity and Access Management (IAM) for authentication and authorization. For creating dynamic groups and policies for code repositories and external connections, see Code Repository Policies. For more details, see DevOps IAM Policies.

For accessing DevOps using the Oracle Cloud Console, REST API, and CLI, see Accessing DevOps.

Console
CLI
API
Open the navigation menu and click Developer Services. Under DevOps, click Projects.
Select a project and from the left-side menu, click External Connections.
Click Create External Connection.
In the Create external connection panel, provide the following information:
Enter a name and description for the connection. Entering a description is optional.
Select a type of external connection.

If you select Bitbucket Cloud, then enter your Bitbucket Username.

If you select Bitbucket Server or GitLab Server, enter the Base URL of the hosted Bitbucket Server or GitLab Server. For Visual Builder Studio (VBS), enter the VBS instance's URL.
Select the vault and secret value that contains the personal access token (PAT) to connect to GitHub, GitLab, or Visual Builder Studio.

If you select Bitbucket Cloud, then select the vault value and app password secret.

(Optional) For TLS verification configuration, select a CA bundle to authenticate the self-hosted Bitbucket or GitLab server.

This is not applicable if the repository server (GitLab Server or Bitbucket Server) is hosted with the publicly trusted certificate authority.

(Optional) To add tags to the connection, click Show tagging options.

Tagging is a metadata system that lets you organize and track the resources in your tenancy.

If you have permissions to create a resource, you also have permissions to add free-form tags to it.

To add a defined tag, you must have permissions to use the tag namespace.

For more information, see Resource Tags.

Click Create.
The connection to the selected external repository is successfully created.
You can now mirror a code repository from GitHub, GitLab, Bitbucket Cloud, or Visual Builder Studio. See Mirroring a Repository.
Migrate Oracle Java Cloud Service
 applications from Oracle Cloud Infrastructure Classic and Oracle Cloud@Customer to an existing or new Oracle WebLogic Server for Oracle Cloud Infrastructure instance.

For information about migrating to Oracle WebLogic Server:

For OCI, see Migrating JCS on OCI to Oracle WebLogic Server for OCI Using tar.
For OCI-C, see Migrating JCS on OCI-C to Oracle WebLogic Server for OCI Using tar.

For information about Oracle WebLogic Server for Oracle Cloud Infrastructure, see About Oracle WebLogic Server for Oracle Cloud Infrastructure.

 Caution

Avoid entering confidential information when assigning descriptions, tags, or friendly names to cloud resources through the Oracle Cloud Infrastructure Console, API, or CLI.
Setting Up Contextual Notifications for an Instance

Before You Begin
Steps



For more information click here https://docs.oracle.com/en-us/iaas/Content/Notification/Tasks/contextual-notifications-compute.htm#top

For more information click here https://docs.oracle.com/en-us/iaas/Content/Notification/Tasks/create-contextual-notification.htm
Database Migration
 Documentation
Data Integration Blog
Copyright © 2021, Oracle and/or its affiliates.
About Oracle
Contact Us
Legal Notices
Terms of Use & Privacy
Document Conventions
Cookie Preferences
Compute Shapes

Compute Shape Pricing
Flexible Shapes
Supported Images
Supported Regions
Extended Memory VM Instances
Bare Metal Shapes
Standard Shapes
Dense I/O Shapes
GPU Shapes
HPC and Optimized Shapes
Virtual Machine (VM) Shapes
Standard Shapes
Dense I/O Shapes
GPU Shapes
HPC and Optimized Shapes
Dedicated Virtual Machine Host Shapes
Previous Generation Shapes
Upgrading from a Previous Generation Shape
Previous Generation Bare Metal Shapes
Previous Generation VM Shapes
Getting Started with Policies

If You're Doing a Proof-of-Concept
If You're Past the Proof-of-Concept Phase
Policy FAQs
Monitoring Threats


Cloud Guard can detect patterns of activity that indicate possible malicious attempts to gain access to resources in your environment and use them for corrupt purposes.

About Threat Detector provides an introduction to how Cloud Guard's Threat Detector works.

You can perform the following tasks from the Threat Monitoring page:

Listing Sightings and Getting Their Details
From the Threat Monitoring page, you can see resource profiles and their key attributes to quickly identify the highest priority events.
Work with Dashboards


You can use dashboards to visualize, explore, and analyze application data in easy-to-interpret charts.

Dashboards are data visualization tools that gather real-time data from the various tiers of an application and display them in charts to help quickly identify outliers and take corrective action. You can either use the Oracle-defined dashboards and widgets for Application Performance Monitoring or create custom dashboards to meet your specific requirements.

Topics:

Perform Dashboard Prerequisite Tasks

Access Dashboards

Oracle-defined Dashboards for Application Performance Monitoring

Create a Custom Dashboard

Export and Import Dashboards



For more information click here https://docs.oracle.com/en-us/iaas/management-agents/doc/work-dashboards.html
Managing Block Volumes


You can list, edit, move, clone, detach, and delete block volumes on Compute Cloud@Customer.
Cloud Center of Excellence
 Team	Roles	Responsibilities
Executive team	

Chief executive officer

Chief information officer/chief technology officer

Chief information security officer

Chief financial officer

Chief operations officer

Chief revenue officer

Chief people officer

	

Drive the focus on the organizational goals pursued with cloud adoption

Validate and sponsor the cloud adoption business case

Sponsor the changes in people, processes, and technology

Achieve stakeholder buy-in across IT and business

Move the cloud strategy forward and remove resistance to move to the cloud

Remove financial inhibitors

Remove organizational inhibitors

Validate business value


Business team	

Business owner

Business transformation leader

Finance

HR

IT security

Legal department

Procurement

	

Evangelize the value of cloud adoption for each business unit

Free up internal resources and allocate them to the cloud adoption initiative

Drive consensus between the business and IT

Ensure that the right skills are deployed in the areas of business, architecture, and implementation


Technical team	

IT leadership team

Program manager

Chief architect

Enterprise architect

Lead application architect

Lead infrastructure architect

Technical platform architect

Cloud architect

DevOps architect

Infrastructure architect

Networking architect

Security architect

IT operations architect

Cybersecurity architect

Compliance architect

	

Coordinate with the on-premises IT team

Define the scope of adoption

Define the enterprise architecture

Define the IT solution

Define the execution timeline

Remove siloed teams, siloed releases, and siloed operations

Iteratively mature the cloud governance and security model
Managing Functions


Find out how to manage the functions and applications you create using OCI Functions.

Read about how to manage functions and applications with OCI Functions:

Functions Management
Applications Management
Changing Default Memory and Timeout Settings
Scanning Function Images for Vulnerabilities
Signing Function Images and Enforcing the Use of Signed Images from Registry
Reducing Initial Latency Using Provisioned Concurrency
Getting Summary Information on the Overview Page


Use the Overview page to quickly get a sense of the overall state of security in your environment, and quickly focus on the highest risk problems Cloud Guard has detected.

About the Overview Page provides an introduction to how the Overview page works.

You can perform the following tasks from the Overview page:

Viewing and Understanding the Security Score
The Security Score on the Overview page provides a rough estimate of how secure your system is.
Viewing and Understanding the Risk Score
The Risk Score on the Overview page provides a rough estimate of the risk level to your environment that's posed by the problems that Cloud Guard detects.
Viewing and Interpreting the Trendline Charts
he trendline charts show the change over time in the Security Score number, the Problems Snapshot total number, and total number reflected in Security Recommendations.
Viewing Security Recommendations
Follow links from the Security Recommendations tile to implement Cloud Guard recommendations for resolving the highest priority problems that have been detected.
Viewing Problems from the Problems Snapshot
View a breakdown of problems by severity level and drill down to see the list of problems from each severity level on the Problems page.
Viewing Problems by Region, Compartment, or Resource Type
View summary information on problems, broken out by compartment, region, or resource type, then drill down to see the problems behind the summary, listed on the Problems page.
Viewing User Activity Problems
View the map showing geographic origins of user activity, based on the source IP address.
Viewing Responder Status Problems
Review recent remediations that have been performed through Cloud Guard responders.
Known Issues for Archive Storage


Archive Storage has no known issues.
Known Issues for API Gateway

API gateways do not inherit custom DNS servers from subnets
Fully-Automated Onboarding

Instructions
Working with Integration Tasks


An integration task lets you take a Data Integration data flow and configure the parameter values you want to use at runtime.

The following pages describe how you can create, edit, and delete integration tasks:

Creating an Integration Task
Editing an Integration Task
Deleting an Integration Task

The following pages describe other management tasks that can be performed after an integration task is created:

Duplicating a Task
Moving a Task
Streaming
/home.htm
Anomaly Detection Policies

Resource Types
Required IAM Policy
Example Policies
Permissions Required for Each API Operation
Managing Subscriptions

IAM Policies
Managing File Systems

Limitations and Considerations
Details About Your File System
Required IAM Service Policy



For more information click here https://docs.oracle.com/en-us/iaas/Content/File/Tasks/managingfilesystems.htm
Setting Up Identity Policies

Setting Up User Policies
Setting Up Cross Tenancy Policies
Making a Certificate Version Current


Make a specific certificate version the current version when you want to actively use it.

A certificate version that’s marked as anything other than deprecated can be marked as current to return it to active use. You can't make a certificate version marked as deprecated the current certificate version.

Console
CLI
API
Open the navigation menu and click Identity & Security.
Under Certificates, click Certificates.
From the list of certificates in the compartment, click the name of the certificate with the certificate version that you want to actively use by making it current.

To find a certificate in a different compartment, under List scope, choose a different compartment.

Under Resources, click Versions.
Under Versions, find the certificate version that you want to make current.
Click the Actions menu () for that certificate version and select Make Current.
Confirm the promotion by clicking Make Current.
Accessing Oracle Cloud Infrastructure


Create and manage resources in Oracle Cloud Infrastructure.

You can create and manage resources in the following ways:

Oracle Cloud Console The Console is an intuitive, graphical interface to create and manage instances, cloud networks, and storage volumes, as well as users and permissions. See Get to Know the Console.
APIs The OCI APIs are typical REST APIs that use HTTPS requests and responses. See API Requests.
SDKs Several Software Development Kits are available for easy integration with the OCI APIs, including SDKs for Java, Ruby, and Python. See Developer Tools and Resources.
Command Line Interface (CLI) You can use a command line interface with some services. See Developer Tools and Resources.
Terraform Terraform is "infrastructure-as-code" (IaC) software that lets you define your infrastructure resources in files that you can persist, version, and share. See Getting Started.
Ansible Use Ansible to automate the configuration and provisioning of cloud infrastructure, the deployment and updating of software assets, and the orchestration of complex operational processes. See Getting Started.
Resource Manager Use this OCI service to automate the process of provisioning OCI resources. Using Terraform, Resource Manager helps you install, configure, and manage resources through the IaC model. See Resource Manager.

For new capabilities, Oracle targets the release of relevant APIs, as well as CLI, SDKs, and Console updates, at the time of general availability (GA). We also target the release of an updated Terraform provider within 30 days of GA.
Classic Migration

Support
Get help and contact Support
Create a service request
Community
Oracle Cloud Infrastructure blog
Cloud Infrastructure community forum
Managing Cluster Metrics

Required IAM Policy
Available Metrics: oci_big_data_service
Managing Kubernetes Deployments


Find out about using Container Engine for Kubernetes (OKE) to manage Kubernetes deployments.

Read about how to use Container Engine for Kubernetes to manage Kubernetes deployments:

Deploying a Sample Nginx App on a Cluster Using Kubectl
Pulling Images from Registry during Deployment
Enforcing the Use of Signed Images from Registry
Supported Labels for Different Usecases
Adding OCI Service Operator for Kubernetes to Clusters
Adding OCI Service Broker for Kubernetes to Clusters
Managing Ingress Controllers
Example: Installing Calico and Setting Up Network Policies
Example: Enabling OCI Service Mesh on OKE
Example: Installing Istio Service Mesh on OKE
Preparing for Appliance Data Transfers

Installing and Using the Oracle Cloud Infrastructure Command Line Interface
Creating the Required IAM Users, Groups, and Policies
Requesting Appliance Entitlement
Showing the Status of an Appliance Entitlement Request
Creating Object Storage Buckets
Configuring Firewall Settings
Creating Transfer Jobs
Getting Transfer Job OCIDs
Setting Up Transfer Job Notifications from the CLI
Preparing Upload Configuration Files
Creating the Data Transfer Administrator Configuration File
Creating the Data Transfer Upload User Configuration File
Requesting the Import Appliance
Setting Up Import Appliance Request Notifications
Notifying the Data Administrator
Validating the Preparation Phase
What's Next
Overview of Archive Storage

Using Archive Storage
Ways to Access Archive Storage
Authentication and Authorization
WORM Compliance
Limits on Archive Storage Resources
Known Issues


OCI Control Center has no known issues.



For more information click here https://docs.oracle.com/en-us/iaas/osmh/doc/known-issues.htm

For more information click here https://docs.oracle.com/en-us/iaas/Content/control-center/known-issues.htm

For more information click here https://docs.oracle.com/en-us/iaas/Content/media-services/mediaflow/known-issues-mediaservices.htm

For more information click here https://docs.oracle.com/en-us/iaas/language/using/known-issues.htm

For more information click here https://docs.oracle.com/en-us/iaas/Content/document-understanding/using/known-issues.htm

For more information click here https://docs.oracle.com/en-us/iaas/Content/DNS/Tasks/known-issues.htm

For more information click here https://docs.oracle.com/en-us/iaas/data-science/using/knownissues.htm

For more information click here https://docs.oracle.com/en-us/iaas/Content/data-labeling/using/known-issues.htm

For more information click here https://docs.oracle.com/en-us/iaas/data-flow/using/known-issues.htm

For more information click here https://docs.oracle.com/en-us/iaas/Content/anomaly/using/known-issues-root.htm
Managing Applications

Required Policy or Role
Routing Details for Connections to Your On-Premises Network

DRG Route Advertisements to Your On-Premises Network
Using AS_PATH to prefer routes from Oracle to your on-premises network
Routing Preferences for Traffic from Your On-Premises Network to Oracle
Route Filtering
Related Resources



For more information click here https://docs.oracle.com/en-us/iaas/Content/Network/Concepts/routingonprem.htm
Getting Started

Supported File Formats
Regions and Availability Domains
How to Access Document Understanding



For more information click here https://docs.oracle.com/en-us/iaas/Content/cloud-marketplace/what-do-i-need-to-know-to-get-started.htm#what-do-i-need-to-know-to-get-started

For more information click here https://docs.oracle.com/en-us/iaas/mysql-database/doc/getting-started.html

For more information click here https://docs.oracle.com/en-us/iaas/Content/document-understanding/using/getting_started.htm#getting_started

For more information click here https://docs.oracle.com/en-us/iaas/Content/data-labeling/using/getting-started.htm

For more information click here https://docs.oracle.com/en-us/iaas/Content/bigdata/get-started.htm

For more information click here https://docs.oracle.com/en-us/iaas/access-governance/doc/getting-started.html

For more information click here https://docs.oracle.com/en-us/iaas/Content/API/SDKDocs/ansiblegetstarted.htm#Getting_Started_with_Oracle_Cloud_Infrastructure_and_Ansible
Agent Configuration Management


Learn about how to create and manage agent configurations.

You can perform the following agent configuration tasks:

Creating an Agent Configuration

Listing Agent Configurations

Getting an Agent Configuration's Details

Editing an Agent Configuration

Moving an Agent Configuration Between Compartments

Creating a Log Configuration for an Agent Configuration

Editing a Log Configuration for an Agent Configuration

Tagging an Agent Configuration

Deleting an Agent Configuration

To use agent configurations, you must be running an Oracle Cloud Infrastructure instance with the supported operating system (see Agent Management Overview). Agent configurations give you a central experience to easily configure what custom logs you want to ingest across your fleet of hosts. A configuration allows you to select:
Which hosts you want to collect logs from.
Exactly which logs you want to ingest from those hosts.
A log group/log destination.
You can manage agent configurations using the Console and Logging API. In addition, since you can choose to create an agent configuration later after creating a custom log, you can use the Agent Configurations page to set up the agent configuration and point it to your custom log.
To enable or disable an existing agent configuration
 Expand All Expandable Areas
Health Check Policies for Network Load Balancers

Heath Status Indicators
Configuring Your Health Check Protocol to Match Your Application or Service
Creating an Instance

What's Next



For more information click here https://docs.oracle.com/en-us/iaas/compute-cloud-at-customer/topics/compute/creating-an-instance.htm#creating-an-instance
Working in Regions

Switching Regions
Working Across Regions
Vision

Limits
Tutorial: Launching Your First Instance

Prerequisites
Tutorial Tasks
License Management

Supported Products
Required IAM Policy
Authentication and Authorization
Viewing License Summary Activity
Adding a License
Importing Oracle Product Licenses
Viewing Licenses and their Details
Product Licenses List
Viewing Consumption
Viewing and Working with License Records
Viewing and Working with Images
Using Notifications
Using the API
Anomaly Detection Algorithms

Univariate Algorithm
Multivariate Algorithm