cwielenb/CNCF-Dataset huggingface dataset:
Project: KICS (Provisioning / Security & Compliance)
File: 7d7054c0-3a52-4e9b-b9ff-cbfe16a2378b.md

title: SQL DB Instance Publicly Accessible hide: toc: true navigation: true <style> .highlight .hll { background-color: #ff171742; } .md-content { max-width: 1100px; margin: 0 auto; } </style> Query id: 7d7054c0-3a52-4e9b-b9ff-cbfe16a2378b Query name: SQL DB Instance Publicly Accessible Platform: Ansible Severity: <span style="color:#ff0000">Critical</span> Category: Insecure Configurations URL: Cloud SQL instances should not be publicly accessible.<br> ```yaml title="Positive test num. 1 - yaml file" hl_lines="24 34 12" name: sql_instance google.cloud.gcpsqlinstance: auth_kind: serviceaccount name: "{{ resource_name }}-2" project: test_project region: us-central1 serviceaccountfile: /tmp/auth.pem settings: ip_configuration: authorized_networks: name: "google dns server" value: "0.0.0.0" tier: db-n1-standard-1 state: present name: sql_instance2 google.cloud.gcpsqlinstance: auth_kind: serviceaccount name: "{{ resource_name }}-2" project: test_project region: us-central1 serviceaccountfile: /tmp/auth.pem settings: ip_configuration: ipv4_enabled: yes tier: db-n1-standard-1 state: present name: sql_instance3 google.cloud.gcpsqlinstance: auth_kind: serviceaccount name: "{{ resource_name }}-2" project: test_project region: us-central1 serviceaccountfile: /tmp/auth.pem settings: tier: db-n1-standard-1 state: present ``` ```yaml title="Negative test num. 1 - yaml file" name: sql_instance google.cloud.gcpsqlinstance: auth_kind: serviceaccount name: '{{ resource_name }}-2' project: test_project region: us-central1 serviceaccountfile: /tmp/auth.pem settings: ip_configuration: authorized_networks: name: google dns server value: 8.8.8.8/32 tier: db-n1-standard-1 state: present ```
Project: ShardingSphere (App Definition and Development / Database)
File: show-migration-status.en.md

+++ title = "SHOW MIGRATION STATUS" weight = 8 +++ The `SHOW MIGRATION STATUS` syntax is used to query migration job status for specified migration job. {{< tabs >}} {{% tab name="Grammar" %}} ```sql ShowMigrationStatus ::= 'SHOW' 'MIGRATION' 'STATUS' migrationJobId migrationJobId ::= string ``` {{% /tab %}} {{% tab name="Railroad diagram" %}} <iframe frameborder="0" name="diagram" id="diagram" width="100%" height="100%"></iframe> {{% /tab %}} {{< /tabs >}} `migrationJobId` needs to be obtained through `SHOW MIGRATION LIST` syntax query | column | Description | |--|--| | item | migration job sharding serial number | | data source | migration source | | status | migration job status | | processedrecordscount | number of processed rows | | inventoryfinishedpercentage | finished percentage of migration job | | incrementalidleseconds | incremental idle time | | error_message | error message | Query migration job status ```sql SHOW MIGRATION STATUS 'j010180026753ef0e25d3932d94d1673ba551'; ``` ```sql mysql> SHOW MIGRATION STATUS 'j010180026753ef0e25d3932d94d1673ba551'; ++-+--+--+-+-+--++ | item | datasource | status | active | processedrecordscount | inventoryfinishedpercentage | incrementalidleseconds | errormessage | ++-+--+--+-+-+--++ | 0 | ds1 | EXECUTEINCREMENTAL_TASK | true | 6 | 100 | 25 | | ++-+--+--+-+-+--++ 1 row in set (0.01 sec) ``` `SHOW`, `MIGRATION`, `STATUS`
Project: YugabyteDB (App Definition and Development / Database)
File: func_yb_server_zone.md

title: ybserverzone() function [YSQL] headerTitle: ybserverzone() linkTitle: ybserverzone() description: Returns the zone of the currently connected node menu: v2.18: identifier: api-ysql-exprs-ybserverzone parent: geo-partitioning-helper-functions type: docs `ybserverzone()` returns the zone that a user's server is connected to. Select the zone that you're connected to: ```plpgsql yugabyte=# SELECT ybserverzone(); ``` ```output.sql ybserverzone -- us-west-1c (1 row) ``` Similar to , this function is also helpful while implementing , as it can significantly simplify inserting rows from the user server's partition if the partitioning is based on default value of ybserverzone(). {{< note title="Note" >}} If you didn't set the placementregion flag at node startup, ybserver_region() returns NULL. {{< /note >}}
Project: Kyverno (Provisioning / Security & Compliance)
File: kyverno_completion.md

Generate the autocompletion script for the specified shell Generate the autocompletion script for kyverno for the specified shell. See each sub-command's help for details on how to use the generated script. ``` -h, --help help for completion ``` ``` --adddirheader If true, adds the file directory to the header of the log messages --alsologtostderr log to standard error as well as files (no effect when -logtostderr=true) --logbacktraceat traceLocation when logging hits line file:N, emit a stack trace (default :0) --log_dir string If non-empty, write log files in this directory (no effect when -logtostderr=true) --log_file string If non-empty, use this log file (no effect when -logtostderr=true) --logfilemax_size uint Defines the maximum size a log file can grow to (no effect when -logtostderr=true). Unit is megabytes. If the value is 0, the maximum file size is unlimited. (default 1800) --logtostderr log to standard error instead of files (default true) --one_output If true, only write logs to their native severity level (vs also writing to each lower severity level; no effect when -logtostderr=true) --skip_headers If true, avoid header prefixes in the log messages --skiplogheaders If true, avoid headers when opening log files (no effect when -logtostderr=true) --stderrthreshold severity logs at or above this threshold go to stderr when writing to files and stderr (no effect when -logtostderr=true or -alsologtostderr=true) (default 2) -v, --v Level number for the log level verbosity --vmodule moduleSpec comma-separated list of pattern=N settings for file-filtered logging ``` - Kubernetes Native Policy Management. - Generate the autocompletion script for bash - Generate the autocompletion script for fish - Generate the autocompletion script for powershell - Generate the autocompletion script for zsh
Project: Meshery (Provisioning / Automation & Configuration)
File: openfeature.md

layout: integration title: OpenFeature subtitle: Collaborative and visual infrastructure as code for OpenEBS image: /assets/img/integrations/openfeature/icons/color/openfeature-color.svg permalink: extensibility/integrations/openfeature docURL: https://docs.meshery.io/extensibility/integrations/openfeature description: integrations-category: App Definition and Development integrations-subcategory: Continuous Integration & Delivery registrant: Artifact Hub components: featureList: [ "Drag-n-drop cloud native infrastructure designer to configure, model, and deploy your workloads.", "Invite anyone to review and make changes to your private designs.", "Ongoing synchronization of Kubernetes configuration and changes across any number of clusters." ] howItWorks: "Collaborative Infrastructure as Code" howItWorksDetails: "Collaboratively manage infrastructure with your coworkers synchronously sharing the same designs." language: en list: include type: extensibility category: integrations
Project: SeaTunnel (App Definition and Development / Streaming & Messaging)
File: jsonpath.md

JsonPath transform plugin Support use jsonpath select data | name | type | required | default value | ||-|-|| | Columns | Array | Yes | | Transform plugin common parameters, please refer to for details | name | type | required | default value | ||--|-|| | src_field | String | Yes | | | dest_field | String | Yes | | | path | String | Yes | | | dest_type | String | No | String | the json source field you want to parse Support SeatunnelDateType STRING BYTES ARRAY MAP ROW after use jsonpath output field the type of dest field Jsonpath The data read from source is a table like this json: ```json { "data": { "c_string": "this is a string", "c_boolean": true, "c_integer": 42, "c_float": 3.14, "c_double": 3.14, "c_decimal": 10.55, "c_date": "2023-10-29", "c_datetime": "16:12:43.459", "c_array":["item1", "item2", "item3"] } } ``` Assuming we want to use JsonPath to extract properties. ```json transform { JsonPath { sourcetablename = "fake" resulttablename = "fake1" columns = [ { "src_field" = "data" "path" = "$.data.c_string" "destfield" = "c1string" }, { "src_field" = "data" "path" = "$.data.c_boolean" "destfield" = "c1boolean" "dest_type" = "boolean" }, { "src_field" = "data" "path" = "$.data.c_integer" "destfield" = "c1integer" "dest_type" = "int" }, { "src_field" = "data" "path" = "$.data.c_float" "destfield" = "c1float" "dest_type" = "float" }, { "src_field" = "data" "path" = "$.data.c_double" "destfield" = "c1double" "dest_type" = "double" }, { "src_field" = "data" "path" = "$.data.c_decimal" "destfield" = "c1decimal" "dest_type" = "decimal(4,2)" }, { "src_field" = "data" "path" = "$.data.c_date" "destfield" = "c1date" "dest_type" = "date" }, { "src_field" = "data" "path" = "$.data.c_datetime" "destfield" = "c1datetime" "dest_type" = "time" }, { "src_field" = "data" "path" = "$.data.c_array" "destfield" = "c1array" "dest_type" = "array<string>" } ] } } ``` Then the data result table `fake1` will like this | data | c1string | c1boolean | c1integer | c1float | c1double | c1decimal | c1date | c1datetime | c1_array | |||||-|--|||--|--| | too much content not to show | this is a string | true | 42 | 3.14 | 3.14 | 10.55 | 2023-10-29 | 16:12:43.459 | ["item1", "item2", "item3"] | Suppose a column in a row of data is of type SeatunnelRow and that the name of the column is col <table> <tr><th colspan="2">SeatunnelRow(col)</th><th>other</th></tr> <tr><td>name</td><td>age</td><td>....</td></tr> <tr><td>a</td><td>18</td><td>....</td></tr> </table> The JsonPath transform converts the values of seatunnel into an array, ```json transform { JsonPath { sourcetablename = "fake" resulttablename = "fake1" columns = [ { "src_field" = "col" "path" = "$[0]" "dest_field" = "name" "dest_type" = "string" }, { "src_field" = "col" "path" = "$[1]" "dest_field" = "age" "dest_type" = "int" } ] } } ``` Then the data result table `fake1` will like this | name | age | col | other | ||--|-|-| | a | 18 | ["a",18] | ... | Add JsonPath Transform
Project: KICS (Provisioning / Security & Compliance)
File: 8f957abd-9703-413d-87d3-c578950a753c.md

title: IAM Group Without Users hide: toc: true navigation: true <style> .highlight .hll { background-color: #ff171742; } .md-content { max-width: 1100px; margin: 0 auto; } </style> Query id: 8f957abd-9703-413d-87d3-c578950a753c Query name: IAM Group Without Users Platform: CloudFormation Severity: <span style="color:#ff7213">Medium</span> Category: Access Control URL: IAM Group should have at least one user associated<br> ```yaml title="Positive test num. 1 - yaml file" hl_lines="4" AWSTemplateFormatVersion: "2010-09-09" Description: A sample template 2 Resources: myuseeer: Type: AWS::IAM::Group Properties: Path: "/" LoginProfile: Password: myP@ssW0rd Policies: PolicyName: giveaccesstoqueueonly PolicyDocument: Version: '2012-10-17' Statement: Effect: Allow Action: sqs:* Resource: !GetAtt myqueue.Arn Effect: Deny Action: sqs:* NotResource: !GetAtt myqueue.Arn IamUserAdminSample22: Type: AWS::IAM::User Condition: IsSampleIamUser Properties: UserName: sample-iam-user-admin Groups: !Ref 'myu2ser' ``` ```json title="Positive test num. 2 - json file" hl_lines="5" { "AWSTemplateFormatVersion": "2010-09-09", "Description": "A sample template", "Resources": { "myuseeer2": { "Type": "AWS::IAM::Group", "Properties": { "Policies": [ { "PolicyName": "giveaccesstoqueueonly", "PolicyDocument": { "Version": "2012-10-17", "Statement": [ { "Effect": "Allow", "Action": [ "sqs:*" ], "Resource": [ "myqueue.Arn" ] }, { "Action": [ "sqs:*" ], "NotResource": [ "myqueue.Arn" ], "Effect": "Deny" } ] } } ], "Path": "/", "LoginProfile": { "Password": "myP@ssW0rd" } } }, "IamUserAdminSample222": { "Type": "AWS::IAM::User", "Condition": "IsSampleIamUser", "Properties": { "UserName": "sample-iam-user-admin", "Groups": [ "myu2ser" ] } } } } ``` ```yaml title="Negative test num. 1 - yaml file" AWSTemplateFormatVersion: "2010-09-09" Description: A sample template Resources: myuser: Type: AWS::IAM::Group Properties: Path: "/" LoginProfile: Password: myP@ssW0rd Policies: PolicyName: giveaccesstoqueueonly PolicyDocument: Version: '2012-10-17' Statement: Effect: Allow Action: sqs:* Resource: !GetAtt myqueue.Arn Effect: Deny Action: sqs:* NotResource: !GetAtt myqueue.Arn IamUserAdminSample: Type: AWS::IAM::User Condition: IsSampleIamUser Properties: UserName: sample-iam-user-admin Groups: !Ref 'myuser' ``` ```json title="Negative test num. 2 - json file" { "Description": "A sample template", "Resources": { "myuserr": { "Type": "AWS::IAM::Group", "Properties": { "Policies": [ { "PolicyName": "giveaccesstoqueueonly", "PolicyDocument": { "Version": "2012-10-17", "Statement": [ { "Effect": "Allow", "Action": [ "sqs:*" ], "Resource": [ "myqueue.Arn" ] }, { "NotResource": [ "myqueue.Arn" ], "Effect": "Deny", "Action": [ "sqs:*" ] } ] } } ], "Path": "/", "LoginProfile": { "Password": "myP@ssW0rd" } } }, "IamUserAdminSample": { "Type": "AWS::IAM::User", "Condition": "IsSampleIamUser", "Properties": { "UserName": "sample-iam-user-admin", "Groups": [ "myuserr" ] } } }, "AWSTemplateFormatVersion": "2010-09-09" } ```
Project: Meshery (Provisioning / Automation & Configuration)
File: aws-kms-controller.md

layout: integration title: AWS Kinesis subtitle: Collaborative and visual infrastructure as code for AWS Kinesis image: /assets/img/integrations/aws-kms-controller/icons/color/aws-kms-controller-color.svg permalink: extensibility/integrations/aws-kms-controller docURL: https://docs.meshery.io/extensibility/integrations/aws-kms-controller description: integrations-category: Security & Compliance integrations-subcategory: Key Management Service registrant: GitHub components: name: field-export colorIcon: assets/img/integrations/aws-kms-controller/components/field-export/icons/color/field-export-color.svg whiteIcon: assets/img/integrations/aws-kms-controller/components/field-export/icons/white/field-export-white.svg description: name: adopted-resource colorIcon: assets/img/integrations/aws-kms-controller/components/adopted-resource/icons/color/adopted-resource-color.svg whiteIcon: assets/img/integrations/aws-kms-controller/components/adopted-resource/icons/white/adopted-resource-white.svg description: name: alias colorIcon: assets/img/integrations/aws-kms-controller/components/alias/icons/color/alias-color.svg whiteIcon: assets/img/integrations/aws-kms-controller/components/alias/icons/white/alias-white.svg description: name: grant colorIcon: assets/img/integrations/aws-kms-controller/components/grant/icons/color/grant-color.svg whiteIcon: assets/img/integrations/aws-kms-controller/components/grant/icons/white/grant-white.svg description: name: key colorIcon: assets/img/integrations/aws-kms-controller/components/key/icons/color/key-color.svg whiteIcon: assets/img/integrations/aws-kms-controller/components/key/icons/white/key-white.svg description: featureList: [ "Drag-n-drop cloud native infrastructure designer to configure, model, and deploy your workloads.", "Invite anyone to review and make changes to your private designs.", "Ongoing synchronization of Kubernetes configuration and changes across any number of clusters." ] howItWorks: "Collaborative Infrastructure as Code" howItWorksDetails: "Collaboratively manage infrastructure with your coworkers synchronously sharing the same designs." language: en list: include type: extensibility category: integrations
Project: Polaris (Provisioning / Security & Compliance)
File: feature_request.md

name: Feature request about: Suggest an idea for this project title: '' labels: [triage, enhancement] assignees: '' Is your feature request related to a problem? Please describe. A clear and concise description of what the problem is. Ex. I'm always frustrated when [...] Describe the solution you'd like A clear and concise description of what you want to happen. Describe alternatives you've considered A clear and concise description of any alternative solutions or features you've considered. Additional context Add any other context or screenshots about the feature request here.
Project: Apache Heron (App Definition and Development / Streaming & Messaging)
File: user-manuals-heron-tracker-runbook.md

id: version-0.20.0-incubating-user-manuals-heron-tracker-runbook title: Heron Tracker sidebar_label: Heron Tracker Runbook original_id: user-manuals-heron-tracker-runbook <!-- Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to you under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. --> Heron Tracker is a web service that continuously gathers a wide variety of information about Heron topologies and exposes that information through a . More on the role of the Tracker can be found . Heron uses for compiling. describes how to setup bazel for heron. ```bash $ bazel build heron/tools/tracker/src/python:heron-tracker $ ./bazel-bin/heron/tools/tracker/src/python/heron-tracker ``` `heron-tracker` is a self executable archive. The config file is a `yaml` file that should contain the following information. This is a list of locations where topology writes its states. An example of and look like this: ```yaml statemgrs: type: "file" name: "local" rootpath: "~/.herondata/repository/state/local" tunnelhost: "localhost" ``` Topologies from all the state managers would be read and can be queried from Tracker. Note that Tracker does not create any zookeeper nodes itself. It is a readonly service. If you launch the Tracker without creating `/topologies` node under the rootpath, Tracker will fail with a `NoNodeError`. This is an optional config. If it is present, then it will show up for each topology as the viz link as shown below. For each topology, these parameters will be filled appropriately. This parameter can be used to link metrics dashboards with topology UI page. ```yaml ``` `--port` - Port to run the heron-tracker on. Default port is `8888`. `--config-file` - The location of the config file for tracker. Default config file is `~/.herontools/conf/heron_tracker.yaml`. ```bash $ heron-tracker $ heron-ui --port=8888 --config-file=~/.herontools/conf/heron_tracker.yaml ```
Project: StarRocks (App Definition and Development / Database)
File: bitmap_andnot.md

displayed_sidebar: "English" Returns bitmap values that exist in `lhs` but do not exist in `rhs`, and returns the new bitmap. ```Haskell bitmap_andnot(BITMAP lhs, BITMAP rhs) ``` ```plain text mysql> select bitmaptostring(bitmapandnot(bitmapfromstring('1, 3'), bitmapfrom_string('2'))) cnt; ++ |cnt | ++ |1,3 | ++ mysql> select bitmaptostring(bitmapandnot(bitmapfromstring('1,3,5'), bitmapfrom_string('1'))) cnt; ++ |cnt | ++ |3,5 | ++ ``` BITMAP_ANDNOT, BITMAP
Project: KICS (Provisioning / Security & Compliance)
File: 881696a8-68c5-4073-85bc-7c38a3deb854.md

title: Key Vault Soft Delete Is Disabled hide: toc: true navigation: true <style> .highlight .hll { background-color: #ff171742; } .md-content { max-width: 1100px; margin: 0 auto; } </style> Query id: 881696a8-68c5-4073-85bc-7c38a3deb854 Query name: Key Vault Soft Delete Is Disabled Platform: Ansible Severity: <span style="color:#ff7213">Medium</span> Category: Backup URL: Make sure Soft Delete is enabled for Key Vault<br> ```yaml title="Positive test num. 1 - yaml file" hl_lines="18 7" name: Create instance of Key Vault azurermkeyvault: resource_group: myResourceGroup vault_name: samplekeyvault enabledfordeployment: yes enablesoftdelete: no vault_tenant: 72f98888-8666-4144-9199-2d7cd0111111 sku: name: standard access_policies: tenant_id: 72f98888-8666-4144-9199-2d7cd0111111 object_id: 99998888-8666-4144-9199-2d7cd0111111 keys: get list name: Create instance of Key Vault 02 azurermkeyvault: resource_group: myResourceGroup 02 vault_name: samplekeyvault enabledfordeployment: yes vault_tenant: 72f98888-8666-4144-9199-2d7cd0111111 sku: name: standard access_policies: tenant_id: 72f98888-8666-4144-9199-2d7cd0111111 object_id: 99998888-8666-4144-9199-2d7cd0111111 keys: get list ``` ```yaml title="Negative test num. 1 - yaml file" name: Create instance of Key Vault azurermkeyvault: resource_group: myResourceGroup vault_name: samplekeyvault enabledfordeployment: yes enablesoftdelete: yes vault_tenant: 72f98888-8666-4144-9199-2d7cd0111111 sku: name: standard access_policies: tenant_id: 72f98888-8666-4144-9199-2d7cd0111111 object_id: 99998888-8666-4144-9199-2d7cd0111111 keys: get list ```
Project: Apache StreamPipes (App Definition and Development / Streaming & Messaging)
File: VULNERABILITY.md

<!--\n ~ Licensed to the Apache Software Foundation (ASF) under one or more\n ~ contributor license agreements. See the NOTICE file distributed with\n ~ this work for additional information regarding copyright ownership.\n ~ The ASF licenses this file to You under the Apache License, Version 2.0\n ~ (the "License"); you may not use this file except in compliance with\n ~ the License. You may obtain a copy of the License at\n ~\n ~ http://www.apache.org/licenses/LICENSE-2.0\n ~\n ~ Unless required by applicable law or agreed to in writing, software\n ~ distributed under the License is distributed on an "AS IS" BASIS,\n ~ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\n ~ See the License for the specific language governing permissions and\n ~ limitations under the License.\n ~\n --> | OSV URL | CVSS | Ecosystem | Package | Version | Source | | | | | | | | | https://osv.dev/GHSA-6mjq-h674-j845 | 6.5 | Maven | io.netty:netty-handler | 4.1.72.Final | pom.xml | | https://osv.dev/GHSA-w596-4wvx-j9j6<br/>https://osv.dev/PYSEC-2022-42969 | 7.5 | PyPI | py | 1.11.0 | streampipes-client-python/poetry.lock | | https://osv.dev/GHSA-269g-pwp5-87pp | 4.4 | Maven | junit:junit (dev) | 4.8.2 | streampipes-maven-plugin/pom.xml | | https://osv.dev/GHSA-wf5p-g6vw-rhxx | 6.5 | npm | axios | 0.21.4 | ui/package-lock.json | | https://osv.dev/GHSA-rv95-896h-c2vc | 6.1 | npm | express (dev) | 4.18.3 | ui/package-lock.json | | https://osv.dev/GHSA-cxjh-pqwp-8mfp | 6.5 | npm | follow-redirects | 1.15.5 | ui/package-lock.json | | https://osv.dev/GHSA-4943-9vgg-gr5r | 6.1 | npm | quill | 1.3.7 | ui/package-lock.json | | https://osv.dev/GHSA-f5x3-32g6-xq36 | 6.5 | npm | tar (dev) | 6.2.0 | ui/package-lock.json | | https://osv.dev/GHSA-9qxr-qj54-h672 | 2.6 | npm | undici (dev) | 6.7.1 | ui/package-lock.json | | https://osv.dev/GHSA-m4v8-wqvr-p9f7 | 3.9 | npm | undici (dev) | 6.7.1 | ui/package-lock.json | | https://osv.dev/GHSA-8jhw-289h-jh2g | 5.9 | npm | vite (dev) | 5.1.5 | ui/package-lock.json |