vania-janet/multiturn-rag-retrieval-data huggingface dataset:
Each cell calculates a relevancy score by multiplying the car model (row) relevancy value times the car component (header) relevancy value.| Car model | Component: engine | Component: brake | Component: radiator || --------- | ----------------- | ---------------- | ------------------- || Accord | Accord x engine | Accord x brake | Accord x radiator || CR-V | CR-V x engine | CR-V x brake | CR-V x radiator |<-- </table "class="row-headers comparison-table" "> -->Each array of columns and rows of the table is sorted in the same order of the results of the first and second aggregations. For example, if you specify the term aggregation as the first argument, the resulting column arrays are sorted by frequency of terms. If you use the timeslice aggregation as the second argument, the row arrays are sorted by date or time.<-- </section "id="section-pair-example" "> --><-- </section "id="section-pair" "> --><-- <section "id="section-sum" "> --> sum Adds the values of the specified field across all matching documents.<-- <section "id="section-sum-syntax" "> --> Syntax sum(field)
<-- </section "id="section-sum-syntax" "> --><-- <section "id="section-sum-example" "> --> Example <-- <table> -->Table 6. Sample product prices| Product | Price || -------- | ----- || I Series | 200 || J Series | 450 || X Series | 325 |<-- </table ""> -->When the sum aggregation type is applied to a set of documents in which the price field contains the values that are shown in Table 6, the result is 975.
Not Scored 1 [Pass](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-119cis-benchmark-remediations-119) Shared 
 5.2.8 Minimize the admission of containers with added capabilities. Not Scored 1 [Pass](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-119cis-benchmark-remediations-119) Shared 
 5.2.9 Minimize the admission of containers with capabilities assigned. Not Scored 2 [Pass](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-119cis-benchmark-remediations-119) Shared 







 5.3 Network policies and CNI 



Section 5.3 Network policies and CNI benchmark results

 Section Recommendation Scored/Not Scored Level Result Responsibility 

 5.3.1 Ensure that the CNI in use supports network policies. Not Scored 1 Pass IBM 
 5.3.2 Ensure that all namespaces have network policies defined. Scored 2 [Fail](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-119cis-benchmark-remediations-119) Shared 







 5.4 Secrets management 



Section 5.4 Secrets management benchmark results

 Section Recommendation Scored/Not Scored Level Result Responsibility 

 5.4.1 Prefer using secrets as files over secrets as environment variables. Not Scored 1 Pass Shared 
 5.4.2 Consider external secret storage. Not Scored 2 [Fail](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-119cis-benchmark-remediations-119) Shared 







 5.5 Extensible admission control 



Section 5.5 Extensible admission control benchmark results

 Section Recommendation Scored/Not Scored Level Result Responsibility 

 5.5.1 Configure Image Provenance using ImagePolicyWebhook admission controller. Not Scored 2 [Fail](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-119cis-benchmark-remediations-119) Shared
The trend indicator measures the increase ratio of the frequency of a given facet value for a given time interval compared to the expected average frequency. The excepted average frequency is calculated based on the changes in the past time interval frequencies of the given facet value, using a weighted arithmetic mean.If the standarized residual value is less than -2, the observed frequency is less than the expected frequency. If it is greater than 2, the observed frequency is greater than the expected frequency. If the standardized residual is greater or less than the expected frequency by 3 or more, then something unusual is happening and suggests that there might be an anomaly that is worth investigating.For example, the expected number of feedback submissions for the vanilla flavor in May is calculated from the number of feedback submissions that were received previously (from Jan to Apr). The result is 5.341. The actual number of feedback submissions in May is 10. The results indicate that the vanilla flavor got about twice the number of feedback submissions as expected. The standardized residual value is 2.016, which is greater than expected, but not unusually so. {
"aggregations":
{
"type": "trend",
"facet": "term(flavor),",
"time_segments": "timeslice(date, 1month)",
"show_estimated_matching_results": true,
"show_total_matching_documents": true,
"results":
{
"aggregations":
{
"type": "term",
"field": "flavor",
"results":
{
"key": "vanilla",
"matching_results": 36,
"aggregations":
{
"type": "timeslice",
"field": "date",
"results":
{
"key": 1577836800000,
"key_as_string": "2020-01-01T00:00:00.000Z",
"matching_results": 4,
"trend_indicator": 0.0,
"total_matching_documents": 7,
Not Scored 1 [Fail](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-123cis-benchmark-remediations-123) Shared 
 5.1.3 Minimize wildcard use in Roles and ClusterRoles. Not Scored 1 [Fail](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-123cis-benchmark-remediations-123) Shared 
 5.1.4 Minimize access to create pods. Not Scored 1 Pass Shared 
 5.1.5 Ensure that default service accounts are not actively used. Scored 1 [Fail](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-123cis-benchmark-remediations-123) Shared 
 5.1.6 Ensure that Service Account Tokens are only mounted where necessary. Not Scored 1 [Fail](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-123cis-benchmark-remediations-123) Shared 







 5.2 Pod Security Policies 



Section 5.2 Pod Security Policies benchmark results

 Section Recommendation Scored/Not Scored Level Result Responsibility 

 5.2.1 Minimize the admission of privileged containers. Not Scored 1 [Pass](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-123cis-benchmark-remediations-123) Shared 
 5.2.2 Minimize the admission of containers wanting to share the host process ID namespace. Scored 1 [Pass](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-123cis-benchmark-remediations-123) Shared 
 5.2.3 Minimize the admission of containers wanting to share the host IPC namespace. Scored 1 [Pass](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-123cis-benchmark-remediations-123) Shared 
 5.2.4 Minimize the admission of containers wanting to share the host network namespace.
Not Scored 1 [Pass](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-121cis-benchmark-remediations-121) Shared 
 5.2.8 Minimize the admission of containers with added capabilities. Not Scored 1 [Pass](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-121cis-benchmark-remediations-121) Shared 
 5.2.9 Minimize the admission of containers with capabilities assigned. Not Scored 2 [Pass](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-121cis-benchmark-remediations-121) Shared 







 5.3 Network policies and CNI 



Section 5.3 Network policies and CNI benchmark results

 Section Recommendation Scored/Not Scored Level Result Responsibility 

 5.3.1 Ensure that the CNI in use supports network policies. Not Scored 1 Pass IBM 
 5.3.2 Ensure that all namespaces have network policies defined. Scored 2 [Fail](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-121cis-benchmark-remediations-121) Shared 







 5.4 Secrets management 



Section 5.4 Secrets management benchmark results

 Section Recommendation Scored/Not Scored Level Result Responsibility 

 5.4.1 Prefer using secrets as files over secrets as environment variables. Not Scored 1 Pass Shared 
 5.4.2 Consider external secret storage. Not Scored 2 [Fail](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-121cis-benchmark-remediations-121) Shared 







 5.5 Extensible admission control 



Section 5.5 Extensible admission control benchmark results

 Section Recommendation Scored/Not Scored Level Result Responsibility 

 5.5.1 Configure Image Provenance using ImagePolicyWebhook admission controller. Not Scored 2 [Fail](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-121cis-benchmark-remediations-121) Shared
Inter-annotator agreement scores cannot be calculated unless two or more human annotators annotate the same documents. For example, if you specify a 20% overlap value for a corpus that contains 30 documents, and you divide the corpus into 3 document sets, 6 documents (20%) will be annotated by all human annotators. The remaining 24 documents will be divided among the 3 human annotators (8 each). Thus, each annotator receives 14 documents to annotate (6+8).



An annotation set that you plan to use to train a machine learning model must contain at least 10 annotated documents.



1. Select a user name from the list of human annotators.
2. Name the annotation set.

As a good practice for evaluating a human annotator's work as the workspace progresses, you might want to create annotation set names that identify the human annotator assigned to the set.

You cannot change the annotation set name after the set is created.
3. Click Generate.



6. A list of available annotation sets is displayed under Available Sets, along with the names of the human annotators assigned to them. To add available sets to your annotation task, click Add to task.
7. Make sure that all of the annotation sets that you want to include in the task appear under Selected Sets, then click Save to create the task.







 What to do next 

After the task is created, you can return to the Annotation Tasks tab on the Machine Learning Model > Annotations page to view the progress of each human annotator. Also, you can complete the following tasks:



* Check approved documents that overlap between annotation sets to resolve annotation conflicts.
* Open a task to add annotation sets to it. Ensure that the annotation sets that you add include documents that overlap with documents in the original annotation sets.



From the Settings tab of the main navigation, you can specify the following information:



* Specify preferences for using colors and keyboard shortcuts in the ground truth editor.
When a user enters a question or request, the phrase is evaluated across all the Customer starts with examples in every action. If two actions have similar phrase examples, then the wrong action might get triggered by your user's question.



 Confidence scoring 

Behind the scenes, Watson Assistant determines a confidence score for each phrase. The score is absolute, meaning that a confidence score is assigned based on a predetermined scale, and not relative to other customer phrases. This approach adds flexibility in case multiple questions or requests are detected in a single user input. It also means that the system might not trigger an action at all, if a phrase has a low confidence score. As confidence scores change, your action examples might need restructuring.

To learn more about review and testing confidence scores, see [Action confidence score](https://cloud.ibm.com/docs/watson-assistant?topic=watson-assistant-reviewreview-debug-confidence) in [Reviewing and debugging your work](https://cloud.ibm.com/docs/watson-assistant?topic=watson-assistant-review).
1.2.17 Ensure that the admission control plug-in NodeRestriction is set. Scored 1 Pass IBM 
 1.2.18 Ensure that the --insecure-bind-address option is not set. Scored 1 Pass IBM 
 1.2.19 Ensure that the --insecure-port option is set to 0. Scored 1 Pass IBM 
 1.2.20 Ensure that the --secure-port option is not set to 0. Scored 1 Pass IBM 
 1.2.21 Ensure that the --profiling option is set to false. Scored 1 [Fail](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-121cis-benchmark-remediations-121) IBM 
 1.2.22 Ensure that the --audit-log-path option is set. Scored 1 [Fail](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-121cis-benchmark-remediations-121) Shared 
 1.2.23 Ensure that the --audit-log-maxage option is set to 30 or as appropriate. Scored 1 [Fail](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-121cis-benchmark-remediations-121) Shared 
 1.2.24 Ensure that the --audit-log-maxbackup option is set to 10 or as appropriate. Scored 1 [Fail](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-121cis-benchmark-remediations-121) Shared 
 1.2.25 Ensure that the --audit-log-maxsize option is set to 100 or as appropriate. Scored 1 [Fail](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-121cis-benchmark-remediations-121) Shared 
 1.2.26 Ensure that the --request-timeout option is set as appropriate. Scored 1 Pass IBM
1.2.32 Ensure that the --etcd-cafile option is set as appropriate. Scored 1 Pass IBM 
 1.2.33 Ensure that the --encryption-provider-config option is set as appropriate. Scored 1 [Fail](https://cloud.ibm.com/docs/openshift?topic=openshift-cis-benchmark-410ibm-remediations-and-explanations-410) Shared 
 1.2.34 Ensure that encryption providers are appropriately configured. Scored 1 [Fail](https://cloud.ibm.com/docs/openshift?topic=openshift-cis-benchmark-410ibm-remediations-and-explanations-410) Shared 
 1.2.35 Ensure that the API Server makes use of only Strong Cryptographic Ciphers. Not Scored 1 Pass IBM 







 1.3 Controller manager 



Section 1.3 Controller manager benchmark results

 Section Recommendation Scored/Not Scored Level Result Responsibility 

 1.3.1 Ensure that the --terminated-pod-gc-threshold option is set as appropriate. Scored 1 Pass IBM 
 1.3.2 Ensure that the --profiling option is set to false. Scored 1 Pass IBM 
 1.3.3 Ensure that the --use-service-account-credentials option is set to true. Scored 1 Pass IBM 
 1.3.4 Ensure that the --service-account-private-key-file option is set as appropriate. Scored 1 Pass IBM 
 1.3.5 Ensure that the --root-ca-file option is set as appropriate. Scored 1 Pass IBM 
 1.3.6 Ensure that the RotateKubeletServerCertificate option is set to true. Scored 2 Pass IBM 
 1.3.7 Ensure that the --bind-address option is set to 127.0.0.1. Scored 1 Pass IBM 







 1.4 Scheduler 



Section 1.4 Scheduler benchmark results

 Section Recommendation Scored/Not Scored Level Result Responsibility 

 1.4.1 Ensure that the --profiling option is set to false. Scored 1 Pass IBM
Not Scored 1 [Fail](https://cloud.ibm.com/docs/openshift?topic=openshift-cis-benchmark-46cis-benchmark-remediations-46) Shared 
 5.1.3 Minimize wildcard use in Roles and ClusterRoles. Not Scored 1 [Fail](https://cloud.ibm.com/docs/openshift?topic=openshift-cis-benchmark-46cis-benchmark-remediations-46) Shared 
 5.1.4 Minimize access to create pods. Not Scored 1 Pass Shared 
 5.1.5 Ensure that default service accounts are not actively used. Scored 1 [Fail](https://cloud.ibm.com/docs/openshift?topic=openshift-cis-benchmark-46cis-benchmark-remediations-46) Shared 
 5.1.6 Ensure that Service Account Tokens are only mounted where necessary. Not Scored 1 [Fail](https://cloud.ibm.com/docs/openshift?topic=openshift-cis-benchmark-46cis-benchmark-remediations-46) Shared 







 5.2 Pod Security Policies 



Section 5.2 Pod Security Policies benchmark results

 Section Recommendation Scored/Not Scored Level Result Responsibility 

 5.2.1 Minimize the admission of privileged containers. Not Scored 1 [Pass](https://cloud.ibm.com/docs/openshift?topic=openshift-cis-benchmark-46cis-benchmark-remediations-46) Shared 
 5.2.2 Minimize the admission of containers wanting to share the host process ID namespace. Scored 1 [Pass](https://cloud.ibm.com/docs/openshift?topic=openshift-cis-benchmark-46cis-benchmark-remediations-46) Shared 
 5.2.3 Minimize the admission of containers wanting to share the host IPC namespace. Scored 1 [Pass](https://cloud.ibm.com/docs/openshift?topic=openshift-cis-benchmark-46cis-benchmark-remediations-46) Shared
An entity type exists independently and can be uniquely identified.







 F 



* F1 score

A measure of a test's accuracy that considers both precision and recall to compute the score. The F1 score can be interpreted as a weighted average of the precision and recall values. An F1 score reaches its best value at 1 and worst value at 0.
* false negative

An answer or annotation that is correct, but was predicted to be incorrect.
* false positive

An answer or annotation that is incorrect, but was predicted to be correct.
* feature

A data member or attribute of a type.
* Fleiss Kappa score

A measure of how consistently the same annotation was applied by multiple human annotators across overlapping documents. The Fleiss Kappa score reaches its best value at 1 and worst value at 0.







 G 



* ground truth

The set of vetted data, consisting of annotations added by human annotators, that is used to adapt a machine learning model to a particular domain. Ground truth is used to train machine learning models, measure model performance (precision and recall), and calculate headroom to decide where to focus development efforts for improving performance. Accuracy of ground truth is essential since inaccuracies in the ground truth will correlate to inaccuracies in the components that use it.







 H 



* headroom analysis

The process of determining how much improvement in accuracy, precision, or recall can be expected by addressing some class of problems that are identified while performing accuracy analysis.
* human annotator

A subject matter expert who reviews, modifies, and augments the results of pre-annotation by identifying mentions, entity type relationships, and mention coreferences. By examining text in context, a human annotator helps determine ground truth and improve the accuracy of the machine learning model.







 I 



* inter-annotator agreement

A measure of how similarly a document in two or more document sets is annotated.







 K 



* knowledge graph

A model that consolidates typed entities, their relationships, their properties, and hierarchical taxonomies to represent an organization of concepts for a given domain.
1.2.17 Ensure that the admission control plugin NodeRestriction is set Scored 1 Pass IBM 
 1.2.18 Ensure that the --insecure-bind-address argument is not set Scored 1 Pass IBM 
 1.2.19 Ensure that the --insecure-port argument is set to 0 Scored 1 Pass IBM 
 1.2.20 Ensure that the --secure-port argument is not set to 0 Scored 1 Pass IBM 
 1.2.21 Ensure that the --profiling argument is set to false Scored 1 Pass IBM 
 1.2.22 Ensure that the --audit-log-path argument is set Scored 1 [Fail](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-127cis-benchmark-remediations-127) Shared 
 1.2.23 Ensure that the --audit-log-maxage argument is set to 30 or as appropriate Scored 1 [Fail](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-127cis-benchmark-remediations-127) Shared 
 1.2.24 Ensure that the --audit-log-maxbackup argument is set to 10 or as appropriate Scored 1 [Fail](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-127cis-benchmark-remediations-127) Shared 
 1.2.25 Ensure that the --audit-log-maxsize argument is set to 100 or as appropriate Scored 1 [Fail](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-127cis-benchmark-remediations-127) Shared 
 1.2.26 Ensure that the --request-timeout argument is set as appropriate Scored 1 Pass IBM 
 1.2.27 Ensure that the --service-account-lookup argument is set to true Scored 1 Pass IBM 
 1.2.28 Ensure that the --service-account-key-file argument is set as appropriate Scored 1 Pass IBM 
 1.2.29 Ensure that the --etcd-certfile and --etcd-keyfile arguments are set as appropriate Scored 1 Pass IBM
Scored 1 [Fail](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-127cis-benchmark-remediations-127) Shared 
 5.1.6 Ensure that Service Account Tokens are only mounted where necessary Not Scored 1 [Fail](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-127cis-benchmark-remediations-127) Shared 







 5.2 Pod security policies 



Section 5.2 Pod security policies benchmark results

 Section Recommendation Scored? Level Result Responsibility 

 5.2.1 Minimize the admission of privileged containers Not Scored 1 [Pass](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-127cis-benchmark-remediations-127) Shared 
 5.2.2 Minimize the admission of containers wishing to share the host process ID namespace Scored 1 [Pass](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-127cis-benchmark-remediations-127) Shared 
 5.2.3 Minimize the admission of containers wishing to share the host IPC namespace Scored 1 [Pass](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-127cis-benchmark-remediations-127) Shared 
 5.2.4 Minimize the admission of containers wishing to share the host network namespace Scored 1 [Pass](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-127cis-benchmark-remediations-127) Shared 
 5.2.5 Minimize the admission of containers with allowPrivilegeEscalation Scored 1 [Pass](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-127cis-benchmark-remediations-127) Shared 
 5.2.6 Minimize the admission of root containers Not Scored 2 [Pass](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-127cis-benchmark-remediations-127) Shared
1.2.17 Ensure that the admission control plugin NodeRestriction is set Scored 1 Pass IBM 
 1.2.18 Ensure that the --insecure-bind-address argument is not set Scored 1 Pass IBM 
 1.2.19 Ensure that the --insecure-port argument is set to 0 Scored 1 Pass IBM 
 1.2.20 Ensure that the --secure-port argument is not set to 0 Scored 1 Pass IBM 
 1.2.21 Ensure that the --profiling argument is set to false Scored 1 Pass IBM 
 1.2.22 Ensure that the --audit-log-path argument is set Scored 1 [Fail](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-126cis-benchmark-remediations-126) Shared 
 1.2.23 Ensure that the --audit-log-maxage argument is set to 30 or as appropriate Scored 1 [Fail](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-126cis-benchmark-remediations-126) Shared 
 1.2.24 Ensure that the --audit-log-maxbackup argument is set to 10 or as appropriate Scored 1 [Fail](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-126cis-benchmark-remediations-126) Shared 
 1.2.25 Ensure that the --audit-log-maxsize argument is set to 100 or as appropriate Scored 1 [Fail](https://cloud.ibm.com/docs/containers?topic=containers-cis-benchmark-126cis-benchmark-remediations-126) Shared 
 1.2.26 Ensure that the --request-timeout argument is set as appropriate Scored 1 Pass IBM 
 1.2.27 Ensure that the --service-account-lookup argument is set to true Scored 1 Pass IBM 
 1.2.28 Ensure that the --service-account-key-file argument is set as appropriate Scored 1 Pass IBM 
 1.2.29 Ensure that the --etcd-certfile and --etcd-keyfile arguments are set as appropriate Scored 1 Pass IBM