cwielenb/CNCF-Dataset huggingface dataset:
Project: Numaflow (App Definition and Development / Streaming & Messaging)
File: environment-variables.md

For the `numa` container of vertex pods, environment variable `NUMAFLOW_DEBUG` can be set to `true` for . In , and containers, there are some preset environment variables that can be used directly. `NUMAFLOW_NAMESPACE` - Namespace. `NUMAFLOW_POD` - Pod name. `NUMAFLOW_REPLICA` - Replica index. `NUMAFLOWPIPELINENAME` - Name of the pipeline. `NUMAFLOWVERTEXNAME` - Name of the vertex. `NUMAFLOWCPUREQUEST` - `resources.requests.cpu`, roundup to N cores, `0` if missing. `NUMAFLOWCPULIMIT` - `resources.limits.cpu`, roundup to N cores, use host cpu cores if missing. `NUMAFLOWMEMORYREQUEST` - `resources.requests.memory` in bytes, `0` if missing. `NUMAFLOWMEMORYLIMIT` - `resources.limits.memory` in bytes, use host memory if missing. For setting environment variables on pods not owned by a vertex, see . To add your own environment variables to `udf` or `udsink` containers, check the example below. ```yaml apiVersion: numaflow.numaproj.io/v1alpha1 kind: Pipeline metadata: name: my-pipeline spec: vertices: name: my-udf udf: container: image: my-function:latest env: name: env01 value: value01 name: env02 valueFrom: secretKeyRef: name: my-secret key: my-key name: my-sink sink: udsink: container: image: my-sink:latest env: name: env03 value: value03 ``` Similarly, `envFrom` also can be specified in `udf` or `udsink` containers. ```yaml apiVersion: numaflow.numaproj.io/v1alpha1 kind: Pipeline metadata: name: my-pipeline spec: vertices: name: my-udf udf: container: image: my-function:latest envFrom: configMapRef: name: my-config name: my-sink sink: udsink: container: image: my-sink:latest envFrom: secretRef: name: my-secret ```
Project: Stolon (App Definition and Development / Database)
File: stolonctl_spec.md

Retrieve the current cluster specification Retrieve the current cluster specification ``` stolonctl spec [flags] ``` ``` --defaults also show default values -h, --help help for spec ``` ``` --cluster-name string cluster name --kube-context string name of the kubeconfig context to use --kube-namespace string name of the kubernetes namespace to use --kube-resource-kind string the k8s resource kind to be used to store stolon clusterdata and do sentinel leader election (only "configmap" is currently supported) --kubeconfig string path to kubeconfig file. Overrides $KUBECONFIG --log-level string debug, info (default), warn or error (default "info") --metrics-listen-address string metrics listen address i.e "0.0.0.0:8080" (disabled by default) --store-backend string store backend type (etcdv2/etcd, etcdv3, consul or kubernetes) --store-ca-file string verify certificates of HTTPS-enabled store servers using this CA bundle --store-cert-file string certificate file for client identification to the store --store-endpoints string a comma-delimited list of store endpoints (use https scheme for tls communication) (defaults: http://127.0.0.1:2379 for etcd, http://127.0.0.1:8500 for consul) --store-key string private key file for client identification to the store --store-prefix string the store base prefix (default "stolon/cluster") --store-skip-tls-verify skip store certificate verification (insecure!!!) --store-timeout duration store request timeout (default 5s) ``` - stolon command line client
Project: KICS (Provisioning / Security & Compliance)
File: f985a7d2-d404-4a7f-9814-f645f791e46e.md

title: Invalid Media Type Value (v2) hide: toc: true navigation: true <style> .highlight .hll { background-color: #ff171742; } .md-content { max-width: 1100px; margin: 0 auto; } </style> Query id: f985a7d2-d404-4a7f-9814-f645f791e46e Query name: Invalid Media Type Value (v2) Platform: OpenAPI Severity: <span style="color:#5bc0de">Info</span> Category: Best Practices URL: The Media Type value should match the following format: <type>/<subtype><br> ```json title="Positive test num. 1 - json file" hl_lines="16 11" { "swagger": "2.0", "info": { "title": "Simple API Overview", "version": "1.0.0" }, "paths": { "/": { "get": { "produces": [ "image/ png", "image/gif", "image/jpeg" ], "consumes": [ "application/ x-www-form-urlencoded" ], "operationId": "listVersionsv2", "summary": "List API versions", "responses": { "200": { "description": "200 response" } } } } } } ``` ```yaml title="Positive test num. 2 - yaml file" hl_lines="18 14" swagger: "2.0" info: title: Simple API Overview version: 1.0.0 paths: "/": get: operationId: listVersionsv2 summary: List API versions responses: "200": description: 200 response produces: image/ png image/gif image/jpeg consumes: application/ x-www-form-urlencoded ``` ```json title="Negative test num. 1 - json file" { "swagger": "2.0", "info": { "title": "Simple API Overview", "version": "1.0.0" }, "paths": { "/": { "get": { "produces": [ "image/png", "image/gif", "image/jpeg" ], "consumes": [ "application/x-www-form-urlencoded" ], "operationId": "listVersionsv2", "summary": "List API versions", "responses": { "200": { "description": "200 response" } } } } } } ``` ```yaml title="Negative test num. 2 - yaml file" swagger: "2.0" info: title: Simple API Overview version: 1.0.0 paths: "/": get: operationId: listVersionsv2 summary: List API versions responses: "200": description: 200 response produces: image/png image/gif image/jpeg consumes: application/x-www-form-urlencoded ```
Project: StarRocks (App Definition and Development / Database)
File: array_contains.md

displayed_sidebar: "English" Checks whether the array contains a certain element. If yes, it returns 1; otherwise, it returns 0. ```Haskell arraycontains(anyarray, any_element) ``` ```plain text mysql> select array_contains(["apple","orange","pear"], "orange"); +--+ | array_contains(['apple','orange','pear'], 'orange') | +--+ | 1 | +--+ 1 row in set (0.01 sec) ``` You can also check whether the array contains NULL. ```plain text mysql> select array_contains([1, NULL], NULL); +--+ | array_contains([1,NULL], NULL) | +--+ | 1 | +--+ 1 row in set (0.00 sec) ``` You can check whether the multi-dimensional array contains a certain subarray. At this time, you need to ensure that the subarray elements match exactly, including the element arrangement order. ```plain text mysql> select array_contains([[1,2,3], [4,5,6]], [4,5,6]); +--+ | array_contains([[1,2,3],[4,5,6]], [4,5,6]) | +--+ | 1 | +--+ 1 row in set (0.00 sec) mysql> select array_contains([[1,2,3], [4,5,6]], [4,6,5]); +--+ | array_contains([[1,2,3],[4,5,6]], [4,6,5]) | +--+ | 0 | +--+ 1 row in set (0.00 sec) ``` ARRAY_CONTAINS,ARRAY
Project: MongoDB (App Definition and Development / Database)
File: engflow_credential_setup.md

MongoDB uses EngFlow to enable remote execution with Bazel. This dramatically speeds up the build process, but is only available to internal MongoDB employees. To install the necessary credentials to enable remote execution, run scons.py with any build command, then follow the setup instructions it prints out. Or: (Only if not in the Engineering org) Request access to the MANA group https://mana.corp.mongodbgov.com/resources/659ec4b9bccf3819e5608712 (For everyone) Go to https://sodalite.cluster.engflow.com/gettingstarted Login with OKTA, then click the "GENERATE AND DOWNLOAD MTLS CERTIFICATE" button (If logging in with OKTA doesn't work) Login with Google using your MongoDB email, then click the "GENERATE AND DOWNLOAD MTLS CERTIFICATE" button On your local system (usually your MacBook), open a shell terminal and, after setting the variables on the first three lines, run: REMOTE_USER=<SSH User from https://spruce.mongodb.com/spawn/host> REMOTE_HOST=<DNS Name from https://spruce.mongodb.com/spawn/host> ZIP_FILE=~/Downloads/engflow-mTLS.zip curl https://raw.githubusercontent.com/mongodb/mongo/master/buildscripts/setupengflowcreds.sh -o setupengflowcreds.sh chmod +x ./setupengflowcreds.sh ./setupengflowcreds.sh $REMOTEUSER $REMOTEHOST $ZIP_FILE
Project: Cadence Workflow (Provisioning / Automation & Configuration)
File: pull_request_template.md

<!-- Describe what has changed in this PR --> What changed? <!-- Tell your future self why have you made these changes --> Why? <!-- How have you verified this change? Tested locally? Added a unit test? Checked in staging env? --> How did you test it? <!-- Assuming the worst case, what can be broken when deploying this change to production? --> Potential risks <!-- Is it notable for release? e.g. schema updates, configuration or data migration required? If so, please mention it, and also update CHANGELOG.md --> Release notes <!-- Is there any documentation updates should be made for config, https://cadenceworkflow.io/docs/operation-guide/setup/ ? If so, please open an PR in https://github.com/uber/cadence-docs --> Documentation Changes
Project: KubeBlocks by ApeCloud (App Definition and Development / Database)
File: kbcli_plugin_index_add.md

title: kbcli plugin index add Add a new index ``` kbcli plugin index add [flags] ``` ``` kbcli plugin index add myIndex ``` ``` -h, --help help for add ``` ``` --as string Username to impersonate for the operation. User could be a regular user or a service account in a namespace. --as-group stringArray Group to impersonate for the operation, this flag can be repeated to specify multiple groups. --as-uid string UID to impersonate for the operation. --cache-dir string Default cache directory (default "$HOME/.kube/cache") --certificate-authority string Path to a cert file for the certificate authority --client-certificate string Path to a client certificate file for TLS --client-key string Path to a client key file for TLS --cluster string The name of the kubeconfig cluster to use --context string The name of the kubeconfig context to use --disable-compression If true, opt-out of response compression for all requests to the server --insecure-skip-tls-verify If true, the server's certificate will not be checked for validity. This will make your HTTPS connections insecure --kubeconfig string Path to the kubeconfig file to use for CLI requests. --match-server-version Require server version to match client version -n, --namespace string If present, the namespace scope for this CLI request --request-timeout string The length of time to wait before giving up on a single server request. Non-zero values should contain a corresponding time unit (e.g. 1s, 2m, 3h). A value of zero means don't timeout requests. (default "0") -s, --server string The address and port of the Kubernetes API server --tls-server-name string Server name to use for server certificate validation. If it is not provided, the hostname used to contact the server is used --token string Bearer token for authentication to the API server --user string The name of the kubeconfig user to use ``` - Manage custom plugin indexes
Project: KICS (Provisioning / Security & Compliance)
File: c7781feb-a955-4f9f-b9cf-0d7c6f54bb59.md

title: BOM - GCP SB hide: toc: true navigation: true <style> .highlight .hll { background-color: #ff171742; } .md-content { max-width: 1100px; margin: 0 auto; } </style> Query id: c7781feb-a955-4f9f-b9cf-0d7c6f54bb59 Query name: BOM - GCP SB Platform: GoogleDeploymentManager Severity: <span style="color:#CCCCCC">Trace</span> Category: Bill Of Materials URL: A list of Storage Bucket resources found. Buckets are the basic containers that hold your data. Everything that you store in Cloud Storage must be contained in a bucket.<br> ```yaml title="Positive test num. 1 - yaml file" hl_lines="33 2 12 44 20" resources: name: sample-input type: storage.v1.bucket properties: storageClass: STANDARD location: EUROPE-WEST3 iamConfiguration: uniformBucketLevelAccess: enabled: true encryption: defaultKmsKeyName: some-key name: sample-input2 type: storage.v1.bucket properties: storageClass: STANDARD location: EUROPE-WEST3 iamConfiguration: uniformBucketLevelAccess: enabled: true name: sample-input3 type: storage.v1.bucket properties: storageClass: STANDARD location: EUROPE-WEST3 iamConfiguration: uniformBucketLevelAccess: enabled: true acl: entity: "project-viewers-ucg-configuration-project" role: READER entity: allUsers role: READER name: sample-input4 type: storage.v1.bucket properties: storageClass: STANDARD location: EUROPE-WEST3 iamConfiguration: uniformBucketLevelAccess: enabled: true defaultObjectAcl: entity: allUsers role: READER name: sample-input5 type: storage.v1.bucket properties: storageClass: STANDARD location: EUROPE-WEST3 iamConfiguration: uniformBucketLevelAccess: enabled: true name: sample-ac type: storage.v1.bucketAccessControl properties: bucket: sample-input5 entity: allUsers role: OWNER ``` ```yaml title="Negative test num. 1 - yaml file" resources: name: vm-template4 type: compute.v1.instance properties: zone: us-central1-a machineType: zones/us-central1-a/machineTypes/n1-standard-1 disks: deviceName: boot type: PERSISTENT boot: true autoDelete: true initializeParams: sourceImage: projects/debian-cloud/global/images/family/debian-9 diskEncryptionKey: sha_256: 68b4caecf5d5130426a8b8f0222cdd7f31232b5c99a5bf0daf19099e26e2ec29 rawKey: SGVsbG8gZnJvbSBHb29nbGUgQ2xvdWQgUGxhdGZvcm0= networkInterfaces: network: global/networks/default ```
Project: KubeBlocks by ApeCloud (App Definition and Development / Database)
File: feature-and-limit-list-mysql.md

title: Full feature and limit list description: The full feature and limit list of KubeBlocks migration function for MySQL keywords: [mysql, migration, migrate data in MySQL to KubeBlocks, full feature, limit] sidebar_position: 1 sidebar_label: Full feature and limit list Precheck Database connection Database version Whether the incremental migration is supported by a database The existence of the table structure Whether the table structure of the source database is supported Structure initialization Table Struct Table Constraint Table Index Comment Data initialization Supports all major data types Incremental data migration Supports all major data types Support the resumable upload capability of eventual consistency Overall limits If the incremental data migration is used, the source database should enable CDC (Change Data Capture) related configurations (both are checked and blocked in precheck). A table without a primary key is not supported. And a table with a foreign key is not supported (both are checked and blocked in precheck). Except for the incremental data migration module, other modules do not support resumable upload, i.e. if an exception occurs in this module, such as pod failure caused by downtime and network disconnection, a re-migration is required. During the data transmission task, DDL on the migration objects in the source database is not supported. The table name and field name cannot contain Chinese characters and special characters like a single quotation mark (') and a comma (,). During the migration process, the switchover of primary and secondary nodes in the source library is not supported, which may cause the connection string specified in the task configuration to change. This further leads to migration link failure. Precheck module: None Structure initialization module The user-defined type is not supported. The database character set other than UTF-8 is not supported. (If the source library is utf8mb4, characters in the source library that exceed the expression range of UTF-8 can't be correctly parsed during the module migration process.) Data initialization module Character sets of the source and sink databases should be the same. Data incremental migration module Character sets of the source and sink databases should be the same.
Project: VoltDB (App Definition and Development / Database)
File: Documentation.md

This page lists all documentation markdown files for Google Mock (the current git version) -- if you use a former version of Google Mock, please read the documentation for that specific version instead (e.g. by checking out the respective git branch/tag). -- start here if you are new to Google Mock. -- a quick reference. -- recipes for doing various tasks using Google Mock. -- check here before asking a question on the mailing list. To contribute code to Google Mock, read: -- read this before writing your first patch. -- how we generate some of Google Mock's source files.
Project: OAuth2 Proxy (Provisioning / Key Management)
File: bitbucket.md

id: bitbucket title: BitBucket In "Callback URL" use `https://<oauth2-proxy>/oauth2/callback`, substituting `<oauth2-proxy>` with the actual hostname that oauth2-proxy is running on. In Permissions section select: Account -> Email Team membership -> Read Repositories -> Read Note the Client ID and Client Secret. To use the provider, pass the following options: ``` --provider=bitbucket --client-id=<Client ID> --client-secret=<Client Secret> ``` The default configuration allows everyone with Bitbucket account to authenticate. To restrict the access to the team members use additional configuration option: `--bitbucket-team=<Team name>`. To restrict the access to only these users who have access to one selected repository use `--bitbucket-repository=<Repository name>`.
Project: Meshery (Provisioning / Automation & Configuration)
File: mesheryctl-exp-model-view.md

layout: default title: mesheryctl-exp-model-view permalink: reference/mesheryctl/exp/model/view redirect_from: reference/mesheryctl/exp/model/view/ type: reference display-title: "false" language: en command: exp subcommand: model view model view a model queried by its name <pre class='codeblock-pre'> <div class='codeblock'> mesheryctl exp model view [flags] </div> </pre> View current provider <pre class='codeblock-pre'> <div class='codeblock'> mesheryctl exp model view [model-name] </div> </pre> <pre class='codeblock-pre'> <div class='codeblock'> -h, --help help for view -o, --output-format string (optional) format to display in [json|yaml] (default "yaml") </div> </pre> <pre class='codeblock-pre'> <div class='codeblock'> --config string path to config file (default "/home/runner/.meshery/config.yaml") -v, --verbose verbose output </div> </pre> Go back to , if you want to add content manually to the CLI documentation, please refer to the for guidance.
Project: Beam (App Definition and Development / Streaming & Messaging)
File: evolve24.md

title: "Evolve24" icon: /images/logos/powered-by/evolve24.png hasLink: "https://evolve24.com/" <!-- Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. -->
Project: Meshery (Provisioning / Automation & Configuration)
File: v0.4.10.md

layout: release date: 2020-10-3 tag: v0.4.10 General fix: go modules conflicts generated by dependabot @kushthedude (#1627) Updated the UI for the preferences section @Nikhil-Ladha (#1632) Add Meshery Release v0.4.2 to Release page @KarenEfereyan (#1630) SMI table Tweaks @dhruv0000 (#1624) Conforming to Navigation Conformances @dhruv0000 (#1618) Maintenance Bump github.com/sirupsen/logrus from 1.6.0 to 1.7.0 @dependabot-preview (#1621) Bump google.golang.org/grpc from 1.31.1 to 1.32.0 @dependabot-preview (#1623) Bump fortio.org/fortio from 1.6.8 to 1.8.1 @dependabot-preview (#1620) Bump github.com/prometheus/common from 0.13.0 to 0.14.0 @dependabot-preview (#1622) Documentation [Docs] Updated adapter docs @chandrashritii (#1614) update meshery architecture diagrams @lolyparty (#1619)
Project: KICS (Provisioning / Security & Compliance)
File: 302736f4-b16c-41b8-befe-c0baffa0bd9d.md

title: Shared Host PID Namespace hide: toc: true navigation: true <style> .highlight .hll { background-color: #ff171742; } .md-content { max-width: 1100px; margin: 0 auto; } </style> Query id: 302736f4-b16c-41b8-befe-c0baffa0bd9d Query name: Shared Host PID Namespace Platform: Kubernetes Severity: <span style="color:#bb2124">High</span> Category: Insecure Configurations URL: Container should not share the host process ID namespace<br> ```yaml title="Positive test num. 1 - yaml file" hl_lines="6" apiVersion: v1 kind: Pod metadata: name: security-context-demo spec: hostPID: true securityContext: runAsUser: 1000 runAsGroup: 3000 fsGroup: 2000 volumes: name: sec-ctx-vol emptyDir: { } containers: name: sec-ctx-demo image: busybox command: [ "sh", "-c", "sleep 1h" ] volumeMounts: name: sec-ctx-vol mountPath: /data/demo securityContext: allowPrivilegeEscalation: false ``` ```yaml title="Positive test num. 2 - yaml file" hl_lines="9" apiVersion: serving.knative.dev/v1 kind: Configuration metadata: name: dummy-config namespace: knative-sequence spec: template: spec: hostPID: true securityContext: runAsUser: 1000 runAsGroup: 3000 fsGroup: 2000 volumes: name: sec-ctx-vol emptyDir: { } containers: name: sec-ctx-demo image: busybox command: [ "sh", "-c", "sleep 1h" ] volumeMounts: name: sec-ctx-vol mountPath: /data/demo securityContext: allowPrivilegeEscalation: false ``` ```yaml title="Negative test num. 1 - yaml file" apiVersion: v1 kind: Pod metadata: name: security-context-demo spec: hostPID: false securityContext: runAsUser: 1000 runAsGroup: 3000 fsGroup: 2000 volumes: name: sec-ctx-vol emptyDir: { } containers: name: sec-ctx-demo image: busybox command: [ "sh", "-c", "sleep 1h" ] volumeMounts: name: sec-ctx-vol mountPath: /data/demo securityContext: allowPrivilegeEscalation: false ``` ```yaml title="Negative test num. 2 - yaml file" apiVersion: serving.knative.dev/v1 kind: Configuration metadata: name: dummy-config namespace: knative-sequence spec: template: spec: hostPID: false securityContext: runAsUser: 1000 runAsGroup: 3000 fsGroup: 2000 volumes: name: sec-ctx-vol emptyDir: { } containers: name: sec-ctx-demo image: busybox command: [ "sh", "-c", "sleep 1h" ] volumeMounts: name: sec-ctx-vol mountPath: /data/demo securityContext: allowPrivilegeEscalation: false ```
Project: Teleport (Provisioning / Security & Compliance)
File: BUILD_macos.md

The instructions below are provided as in a best-effort basis. PRs with corrections and updates are welcome! Install `Go` version from Follow to install `Go` On an M1 Mac, download ARM64 installer from https://go.dev/dl/* Download the installer for `<version from go.mod>` After installing, don't forget to `export PATH="/usr/local/go/bin:$PATH"` in `~/.zprofile` If you need other go versions, see https://go.dev/doc/manage-install You will need to add `export PATH="$HOME/go/bin:$PATH"` to the `~/.zprofile` Or install required version of `Go` with homebrew: ```shell brew install go ```` `Rust` and `Cargo` version from (search for RUST_VERSION): Follow to install `rustup` Or install with homebrew: ```shell brew install rustup ``` Initialize Rustup ```shell rustup-init ``` Install the required version ```shell rustup toolchain install <version from build.assets/versions.mk> cd <teleport.git> rustup override set <version from build.assets/versions.mk> rustc --version ``` To install `libfido2` (pulls `openssl 3` as dependency) ```shell brew install libfido2 ``` To install `pkg-config` ```shell brew install pkg-config ``` To install tools for building the UI: `brew install node yarn` Currently, (< 2.0.0) is required The `Rust` and `Cargo` version in (search for `RUST_VERSION`) are required. The version in (search for `WASMPACKVERSION`) is required: `curl https://rustwasm.github.io/wasm-pack/installer/init.sh -sSf | sh` To run a full test suite locally, you will need `helm` and `helm-unittest` plugin ```shell brew install helm helm plugin install https://github.com/quintush/helm-unittest ``` `bats-core` version from (search for `bats-core`) ```shell curl -L https://github.com/bats-core/bats-core/archive/v1.2.1.tar.gz -o ~/Downloads/bats.tar.gz cd ~/Downloads tar xzvf bats.tar.gz sudo mkdir /usr/local/libexec sudo chown $USER /usr/local/libexec cd bats-core-1.2.1 sudo ./install.sh /usr/local cd ../ rm -rf bats-core-1.2.1 bats.tar.gz ``` `protoc` binary, typically found in `protobuf` package ```shell brew install protobuf ``` increased `ulimit -n` ```shell ulimit -n 2560 # 10x default ```