cwielenb/CNCF-Dataset huggingface dataset:
Project: Beam (App Definition and Development / Streaming & Messaging)
File: mean.md

title: "Mean" <!-- Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. --> {{< localstorage language language-py >}} {{< button-pydoc path="apache_beam.transforms.combiners" class="Mean" >}} Transforms for computing the arithmetic mean of the elements in a collection, or the mean of the values associated with each key in a collection of key-value pairs. In the following example, we create a pipeline with a `PCollection`. Then, we get the element with the average value in different ways. We use `Mean.Globally()` to get the average of the elements from the entire `PCollection`. {{< playground height="700px" >}} {{< playgroundsnippet language="py" path="SDKPYTHONMeanGlobally" show="meanglobally" >}} {{< /playground >}} We use `Mean.PerKey()` to get the average of the elements for each unique key in a `PCollection` of key-values. {{< playground height="700px" >}} {{< playgroundsnippet language="py" path="SDKPYTHONMeanPerKey" show="meanper_ke" >}} {{< /playground >}} {{< button-pydoc path="apache_beam.transforms.combiners" class="Mean" >}}
Project: ClickHouse (App Definition and Development / Database)
File: v21.4.7.3-stable.md

sidebar_position: 1 sidebar_label: 2022 Backported in : Fixed a bug in recovery of staled `ReplicatedMergeTree` replica. Some metadata updates could be ignored by staled replica if `ALTER` query was executed during downtime of the replica. (). Backported in : Fix crash when `PREWHERE` and row policy filter are both in effect with empty result. (). Backported in : Fix `CLEAR COLUMN` does not work when it is referenced by materialized view. Close . (). Backported in : Fix error `Can't initialize pipeline with empty pipe` for queries with `GLOBAL IN/JOIN` and `usehedgedrequests`. Fixes . (). Backported in : HashedDictionary complex key update field initial load fix. Closes . (). Backported in : Fix keys metrics accounting for CACHE() dictionary with duplicates in the source (leads to `DictCacheKeysRequestedMiss` overflows). (). Backported in : Fix SIGSEGV for external GROUP BY and overflow row (i.e. queries like `SELECT FROM GROUP BY WITH TOTALS SETTINGS maxbytesbeforeexternalgroupby>0, maxrowstogroupby>0, groupbyoverflowmode='any', totalsmode='beforehaving'`). (). Backported in : Some `ALTER PARTITION` queries might cause `Part A intersects previous part B` and `Unexpected merged part C intersecting drop range D` errors in replication queue. It's fixed. Fixes . (). Backported in : Fix crash in MergeJoin, close . (). Backported in : Bug: explain pipeline with` select xxx final `shows wrong pipeline: ``` dell123 :) explain pipeline select z from prewheremoveselect_final final;. (). Backported in : Fix a rare bug that could lead to a partially initialized table that can serve write requests (insert/alter/so on). Now such tables will be in readonly mode. (). Backported in : Fix race condition which could happen in RBAC under a heavy load. This PR fixes , ,. (). Backported in : Fix abnormal server termination due to hdfs becoming not accessible during query execution. Closes . (). Flat, Hashed dictionary include update field bytes into bytes_allocated ().
Project: ArangoDB (App Definition and Development / Database)
File: app-map-httplib1.md

+++ title = "Mapping the HTTP library into the Application `1/2`" weight = 30 +++ Firstly, remember that we are the application writer who has the problem of integrating three third party libraries into our application's Outcome-based failure handling mechanism. We cannot modify those third party library sources; we must be non-intrusive. We start by dealing with the HTTP library. We will integrate this into our application by wrapping up `httplib::failure` into a custom STL exception type. We then type erase it into an `exception_ptr` instance. Please note that this code is exclusively defined in the `app` namespace: {{% snippet "finale.cpp" "appmaphttplib1" %}} Most of the complexity in this code fragment is driven by the need to create some sort of descriptive string for `std::runtime_error` so its `.what()` returns a useful summary of the original failure. This is the main purpose of the `app::makehttplibexception()` function. (Note that if you have Reflection in your C++ compiler, it may be possible to script the conversion of enum values to string representations) The only real thing to note about `app::httplib_error` is that it squirrels away the original `httplib::failure` in case that is ever needed.
Project: YugabyteDB (App Definition and Development / Database)
File: yba_provider_onprem_instance-types.md

Manage YugabyteDB Anywhere onprem instance types Manage YugabyteDB Anywhere on-premises instance types ``` yba provider onprem instance-types [flags] ``` ``` -h, --help help for instance-types ``` ``` -a, --apiToken string YugabyteDB Anywhere api token. --config string Config file, defaults to $HOME/.yba-cli.yaml --debug Use debug mode, same as --logLevel debug. --disable-color Disable colors in output. (default false) -H, --host string YugabyteDB Anywhere Host (default "http://localhost:9000") -l, --logLevel string Select the desired log level format. Allowed values: debug, info, warn, error, fatal. (default "info") -n, --name string [Optional] The name of the provider for the action. Required for create, delete, describe, instance-types and nodes. -o, --output string Select the desired output format. Allowed values: table, json, pretty. (default "table") --timeout duration Wait command timeout, example: 5m, 1h. (default 168h0m0s) --wait Wait until the task is completed, otherwise it will exit immediately. (default true) ``` - Manage a YugabyteDB Anywhere on-premises provider - Add an instance type to YugabyteDB Anywhere on-premises provider - Describe instance type of a YugabyteDB Anywhere on-premises provider - List instance types of a YugabyteDB Anywhere on-premises provider - Delete instance type of a YugabyteDB Anywhere on-premises provider
Project: KubeVirt (App Definition and Development / Application Definition & Image Build)
File: iscsi-authentication.md

This document describes how to associate a k8s secret with a VMI for the purpose of iscsi initiator authentication. NOTE: Only client authentication is supported at this time, meaning that the iscsi target with authenticate an initiator has permissions to access a device, but that a initiator can not authenticate the target. create a k8s secret containing the password and username fields. The k8s secret must be formatted in the same way kubernetes performs iscsi authentication for volumes. https://github.com/kubernetes/examples/blob/master/volumes/iscsi/chap-secret.yaml ``` cat << END > my-chap-secret.yaml apiVersion: v1 kind: Secret metadata: name: myK8sSecretID namespace: default apiVersion: v1 kind: Secret metadata: name: my-chap-secret type: "kubernetes.io/iscsi-chap" data: node.session.auth.username: $(echo "myUsername" | base64 -w0) node.session.auth.password: $(echo "mySuperSecretPassword" | base64 -w0) END ``` create a vm that references the name given to the k8s secret in the iscsi usage field ``` cat << END > my-vm.yaml kind: VirtualMachine metadata: name: testvm namespace: default spec: domain: devices: disks: auth: secret: type: iscsi usage: my-chap-secret type: network snapshot: external device: disk driver: name: qemu type: raw cache: none source: host: name: iscsi-demo-target.default port: "3260" protocol: iscsi name: iqn.2017-01.io.kubevirt:sn.42/2 target: dev: vda memory: unit: MB value: 64 os: type: os: hvm type: qemu END ``` Add the secret and vm to the cluster. ``` kubectl create -f my-chap-secret.yaml kubectl create -f my-vm.yaml ``` From there, the password and username fields in the k8s secret will automatically be mapped to a libvirt secret when the VMI is scheduled to a node allowing the iscsi auth to work without any further configuration.
Project: Druid (App Definition and Development / Database)
File: druid-vs-spark.md

id: druid-vs-spark title: "Apache Druid vs Spark" <!-- ~ Licensed to the Apache Software Foundation (ASF) under one ~ or more contributor license agreements. See the NOTICE file ~ distributed with this work for additional information ~ regarding copyright ownership. The ASF licenses this file ~ to you under the Apache License, Version 2.0 (the ~ "License"); you may not use this file except in compliance ~ with the License. You may obtain a copy of the License at ~ ~ http://www.apache.org/licenses/LICENSE-2.0 ~ ~ Unless required by applicable law or agreed to in writing, ~ software distributed under the License is distributed on an ~ "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY ~ KIND, either express or implied. See the License for the ~ specific language governing permissions and limitations ~ under the License. --> Druid and Spark are complementary solutions as Druid can be used to accelerate OLAP queries in Spark. Spark is a general cluster computing framework initially designed around the concept of Resilient Distributed Datasets (RDDs). RDDs enable data reuse by persisting intermediate results in memory and enable Spark to provide fast computations for iterative algorithms. This is especially beneficial for certain work flows such as machine learning, where the same operation may be applied over and over again until some result is converged upon. The generality of Spark makes it very suitable as an engine to process (clean or transform) data. Although Spark provides the ability to query data through Spark SQL, much like Hadoop, the query latencies are not specifically targeted to be interactive (sub-second). Druid's focus is on extremely low latency queries, and is ideal for powering applications used by thousands of users, and where each query must return fast enough such that users can interactively explore through data. Druid fully indexes all data, and can act as a middle layer between Spark and your application. One typical setup seen in production is to process data in Spark, and load the processed data into Druid for faster access. For more information about using Druid and Spark together, including benchmarks of the two systems, please see: <https://www.linkedin.com/pulse/combining-druid-spark-interactive-flexible-analytics-scale-butani>
Project: KubeMQ (App Definition and Development / Streaming & Messaging)
File: README.md

KubeMQ Community is the open-source version of KubeMQ, the Kubernetes native message broker. Browse to after installation and use the KubeMQ Web Interface to manage KubeMQ broker instance. Pull and run KubeMQ standalone docker container: ``` bash docker run -d -p 8080:8080 -p 50000:50000 -p 9090:9090 kubemq/kubemq-community:latest ``` Download the latest version of KubeMQ Community from Unpack the downloaded archive Run ```kubemq server``` |Name | Description | Github | |--|--|--| | KubeMQ Targets | Connect KubeMQ Message Broker with external systems and cloud services || | KubeMQ Sources | Connects external systems and cloud services with KubeMQ message queue broker || | KubeMQ Bridges | bridge, replicate, aggregate, and transform messages between KubeMQ || KubeMQ community edition comes with built-in CLI tool for interaction with KubeMQ server. Check out the docs: - Execute Kubemq 'commands' - Execute Kubemq 'events' Pub/Sub commands - Execute Kubemq 'Events-Store' Pub/Sub commands - Execute Kubemq 'queries' - Execute Kubemq 'queues' commands KubeMQ SDKs support list: | SDK | Github | |:-|:| | C# | https://github.com/kubemq-io/kubemq-CSharp | | Java | https://github.com/kubemq-io/kubemq-Java | | Python | https://github.com/kubemq-io/kubemq-Python | | Node | https://github.com/kubemq-io/kubemq-js | | Go | https://github.com/kubemq-io/kubemq-go | | REST | https://postman.kubemq.io/ | | SDK | Github | |:-|:| | C# | https://github.com/kubemq-io/csharp-sdk-cookbook | | Java | https://github.com/kubemq-io/java-sdk-cookbook | | Python | https://github.com/kubemq-io/python-sdk-cookbook | | Node | https://github.com/kubemq-io/node-sdk-cookbook | | Go | https://github.com/kubemq-io/go-sdk-cookbook| Visit our . You can reach us at: -
Project: KICS (Provisioning / Security & Compliance)
File: c640d783-10c5-4071-b6c1-23507300d333.md

title: PostgreSQL Log Connections Not Set hide: toc: true navigation: true <style> .highlight .hll { background-color: #ff171742; } .md-content { max-width: 1100px; margin: 0 auto; } </style> Query id: c640d783-10c5-4071-b6c1-23507300d333 Query name: PostgreSQL Log Connections Not Set Platform: Terraform Severity: <span style="color:#ff7213">Medium</span> Category: Observability URL: Make sure that for PostgreSQL Database, server parameter 'log_connections' is set to 'ON'<br> ```tf title="Positive test num. 1 - tf file" hl_lines="19 12 5" resource "azurermpostgresqlconfiguration" "positive1" { name = "log_connections" resourcegroupname = data.azurermresourcegroup.example.name servername = azurermpostgresql_server.example.name value = "off" } resource "azurermpostgresqlconfiguration" "positive2" { name = "log_connections" resourcegroupname = data.azurermresourcegroup.example.name servername = azurermpostgresql_server.example.name value = "Off" } resource "azurermpostgresqlconfiguration" "positive3" { name = "log_connections" resourcegroupname = data.azurermresourcegroup.example.name servername = azurermpostgresql_server.example.name value = "OFF" } ``` ```tf title="Negative test num. 1 - tf file" resource "azurermpostgresqlconfiguration" "negative1" { name = "log_connections" resourcegroupname = data.azurermresourcegroup.example.name servername = azurermpostgresql_server.example.name value = "on" } resource "azurermpostgresqlconfiguration" "negative2" { name = "log_connections" resourcegroupname = data.azurermresourcegroup.example.name servername = azurermpostgresql_server.example.name value = "On" } resource "azurermpostgresqlconfiguration" "negative3" { name = "log_connections" resourcegroupname = data.azurermresourcegroup.example.name servername = azurermpostgresql_server.example.name value = "ON" } ```
Project: ClickHouse (App Definition and Development / Database)
File: v23.8.13.25-lts.md

sidebar_position: 1 sidebar_label: 2024 Backported in : Fixed accounting of memory allocated before attaching thread to a query or a user. (). Backported in : Remove from the Keeper Docker image the volumes at /etc/clickhouse-keeper and /var/log/clickhouse-keeper. (). Fix REPLACE/MOVE PARTITION with zero-copy replication (). Fix ATTACH query with external ON CLUSTER (). Cancel merges before removing moved parts (). Mark CANNOTPARSEESCAPE_SEQUENCE error as parse error to be able to skip it in row input formats (). Try to fix segfault in Hive engine (). Backported in :. (). Backported in : We won't fail the job when GH fails to retrieve the job ID and URLs. (). Backported in :. (). Backported in :. (). Throw on query timeout in ZooKeeperRetries ().
Project: secureCodeBox (Provisioning / Security & Compliance)
File: pull_request_template.md

<!-- Thank you for your contribution to our Project Before submitting your Pull Request, please take the time to check the points below and provide some descriptive information. [ ] Set a meaningful title. Format: {taskname} (closes #{issuenumber}). For example: Use logger (closes #41) (if applicable) [ ] Create Draft pull requests if you need clarification or an explicit review before you can continue your work item. [ ] Make sure that your PR is not introducing unnecessary reformatting (e.g., introduced by on-save hooks in your IDE) [ ] Make sure each new source file you add has a correct license header. For more information on content related and formal acceptance criteria for PRs, please have a look at our . --> <!-- Please describe briefly which issue is solved by your PR or which enhancement it brings --> [ ] Test your changes as thoroughly as possible before you commit them. Preferably, automate your test by unit/integration tests. file. [ ] Make sure that all CI finish successfully. .
Project: external-secrets (Provisioning / Security & Compliance)
File: anchore-engine-credentials.md

Anchore Engine is an open-source project that provides a centralized service for inspection, analysis, and certification of container images. With Kubernetes, it also brings nice features like preventing unscanned images from being deployed into your clusters There are several parts of the installation that require credentials these being :- ANCHOREADMINUSERNAME ANCHOREADMINPASSWORD ANCHOREDBPASSWORD db-url db-user postgres-password Creating the following external secret ensure the credentials are drawn from the backend provider of choice. The example shown here works with Hashicorp Vault and AWS Secrets Manager providers. ``` yaml {% include 'vault-anchore-engine-access-credentials-external-secret.yaml' %} ``` ``` yaml {% include 'aws-anchore-engine-access-credentials-external-secret.yaml' %} ```
Project: Meshery (Provisioning / Automation & Configuration)
File: importing-applications.md

layout: default title: Importing Designs abstract: Learn how to import your existing designs and your existing infrastructure configurations into Meshery as you to manage, operate, and observe your cloud native infrastructure more effectively. permalink: guides/configuration-management/importing-designs category: configuration type: guides language: en Import your existing designs and existing infrastructure configurations into Meshery. The platform supports a variety of application definition formats, and you can import designs using either the Meshery CLI or the Meshery UI. Meshery supports the following design definition formats: Step 1: Install Meshery CLI Before you can use the Meshery CLI to import a Docker Compose app, you must first install it. You can install Meshery CLI by . Step 2: Import the Design Manifest Once you have created your Design Definition file, you can use the Meshery CLI to import your Docker Compose app into Meshery. To do this, run the following command: <pre class="codeblock-pre"> <div class="codeblock"><div class="clipboardjs">mesheryctl pattern import -f [file/url] -s [source-type]</div></div> </pre> This command enable users to import their existing designs from sources as Helm Charts Kubernetes Manifests Docker Compose Example : <pre class="codeblock-pre"> <div class="codeblock"><div class="clipboardjs">mesheryctl pattern import -f ./SampleDesign.yml -s "Kubernetes Manifest"</div></div> </pre> Step 1: Access the Meshery UI To import a Docker Compose app into Meshery using the Meshery UI, you must first Step 2: Navigate to the Designs section in the Configuration Once you have accessed the Meshery UI, navigate to the Design Import page. This page can be accessed by clicking on the "Designs" menu item and then selecting "Import Design". <a href="{{ site.baseurl }}/assets/img/applications/Menu.png"><img alt="Application-Navigation" style="width:500px;height:auto;" src="{{ site.baseurl }}/assets/img/applications/Menu.png" /></a> Step 3: Upload the Design On the Design Import page, you can upload your design by select File Type from the options and clicking on the "Browse" button and selecting the file from your local machine or uploading in through URL. Once you have selected the file, click on the "Import" button to import design into Meshery. When you import an design into Meshery, it will create a Meshery design based on definition. This Meshery design will include all of the services, ports, and other parameters defined in the File. <a href="{{ site.baseurl }}/assets/img/applications/ImportDesign.png"><img alt="Import-Application" style="width:500px;height:auto;" src="{{ site.baseurl }}/assets/img/applications/ImportDesign.png" /></a> Once the Meshery design has been created, you can use Meshery to manage, operate and observe your cloud native infrastructure. You can also use Meshery to deploy your Meshery design to any of your connected kubernetes clusters. For more information, see
Project: StarRocks (App Definition and Development / Database)
File: weeks_diff.md

displayed_sidebar: "English" Returns the week difference between two date expressions (`expr1` `expr2`), accurate to the week. ```Haskell BIGINT weeks_diff(DATETIME expr1,DATETIME expr2); ``` `expr1`: the end time. It must be of the DATETIME or DATE type. `expr2`: the start time. It must be of the DATETIME or DATE type. Returns a BIGINT value. NULL is returned if the date does not exist, for example, 2022-02-29. ```Plain select weeks_diff('2010-11-30 23:59:59', '2010-1-1 23:59:59'); +--+ | weeks_diff('2010-11-30 23:59:59', '2010-1-1 23:59:59') | +--+ | 47 | +--+ select weeksdiff(currenttime(), '2010-11-30 23:59:59'); ++ | weeksdiff(currenttime(), '2010-11-30 23:59:59') | ++ | 619 | ++ select weeks_diff('2010-11-30 23:59:59', '2010-11-24 23:59:59'); +-+ | weeks_diff('2010-11-30 23:59:59', '2010-11-24 23:59:59') | +-+ | 0 | +-+ ```
Project: TiKV (App Definition and Development / Database)
File: feature-request.md

name: "\U0001F680 Feature Request" about: As a user, I want to request a New Feature on the product. labels: type/feature-request <!-- A description of what the problem is. --> <!-- A description of what you want to happen. --> <!-- A description of any alternative solutions or features you've considered. --> <!-- If you can, explain some scenarios how users might use this, or situations in which it would be helpful. Any API designs, mockups, or diagrams are also helpful. -->
Project: ShardingSphere (App Definition and Development / Database)
File: alter-readwrite-splitting-rule-enable-disable.en.md

+++ title = "ALTER READWRITE_SPLITTING RULE ENABLE/DISABLE" weight = 1 +++ The `ALTER READWRITE_SPLITTING RULE ENABLE/DISABLE` syntax is used enable/disable a specified read source for specified readwrite-splitting rule. {{< tabs >}} {{% tab name="Grammar" %}} ```sql AlterReadwriteSplittingRule ::= 'ALTER' 'READWRITE_SPLITTING' 'RULE' groupName ('ENABLE' | 'DISABLE') storageUnitName 'FROM' databaseName groupName ::= identifier storageUnitName ::= identifier databaseName ::= identifier ``` {{% /tab %}} {{% tab name="Railroad diagram" %}} <iframe frameborder="0" name="diagram" id="diagram" width="100%" height="100%"></iframe> {{% /tab %}} {{< /tabs >}} When `databaseName` is not specified, the default is the currently used `DATABASE`. If `DATABASE` is not used, `No database selected` will be prompted. Disable a specified read source for specified readwrite-splitting rule in specified database ```sql ALTER READWRITESPLITTING RULE msgroup0 DISABLE readds0 FROM shardingdb; ``` Enable a specified read source for specified readwrite-splitting rule in specified database ```sql ALTER READWRITESPLITTING RULE msgroup0 ENABLE readds0 FROM shardingdb; ``` Disable a specified read source for specified readwrite-splitting rule in current database ```sql ALTER READWRITESPLITTING RULE msgroup0 DISABLE readds_0; ``` Enable a specified read source for specified readwrite-splitting rule in current database ```sql ALTER READWRITESPLITTING RULE msgroup1 ENABLE readds_0; ``` `ALTER`, `READWRITE_SPLITTING`, `RULE`, `ENABLE`, `DISABLE`