xeroISB commited on
Commit
ef94eb9
1 Parent(s): 4e18682

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +103 -3
README.md CHANGED
@@ -1,3 +1,103 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ ---
4
+ Certainly! Here is a concise model card for the incident impact classification model:
5
+
6
+ ---
7
+
8
+ # Incident Impact Classification Model
9
+
10
+ ## Model Description
11
+
12
+ This model is a fine-tuned version of BERT (bert-base-uncased) designed to classify the impact of incident records based on their short descriptions. The impact is categorized into three levels: low, medium, and high.
13
+
14
+ ## Intended Use
15
+
16
+ Only for Demo pupose - The model is intended to assist in the automatic categorization of incident impacts to streamline incident management processes. It can be used by IT service management teams to quickly identify the severity of incidents based on short descriptions.
17
+
18
+ ## How to Use
19
+
20
+ ### Inference
21
+
22
+ To use the model for inference, you can utilize the Hugging Face `transformers` library. Below is an example of how to load the model and make predictions:
23
+
24
+ ```python
25
+ from transformers import pipeline
26
+
27
+ model_name = "xeroISB/incidentImpactModel"
28
+ classifier = pipeline("text-classification", model=model_name)
29
+
30
+ short_description = "Network outage in building 12"
31
+ prediction = classifier(short_description)
32
+ print(prediction)
33
+ ```
34
+
35
+ ### Training
36
+
37
+ The model was trained using the following configuration:
38
+ - **Model:** BERT (bert-base-uncased)
39
+ - **Learning Rate:** 2e-5
40
+ - **Batch Size:** 16
41
+ - **Epochs:** 3
42
+ - **Evaluation Strategy:** Epoch
43
+ - **Optimizer:** AdamW
44
+ - **Loss Function:** Cross-Entropy Loss
45
+
46
+ ### Dataset
47
+
48
+ The dataset used for training includes the following columns:
49
+ - `short_description`: A brief description of the incident.
50
+ - `impact`: The impact level categorized into three classes: low (3), medium (2), and high (1).
51
+
52
+ The `impact` values were mapped to integer labels as follows:
53
+ - 3 (low) -> 0
54
+ - 2 (medium) -> 1
55
+ - 1 (high) -> 2
56
+
57
+ ### Tokenization
58
+
59
+ The `short_description` was tokenized using the BERT tokenizer with padding to the maximum length and truncation enabled.
60
+
61
+ ## Performance
62
+
63
+ ### Confusion Matrix
64
+
65
+ The confusion matrix on the validation set is as follows:
66
+
67
+ | | Predicted Low | Predicted Medium | Predicted High |
68
+ |------|---------------|------------------|----------------|
69
+ | Low | 414 | 194 | 0 |
70
+ | Medium | 463 | 220 | 0 |
71
+ | High | 33 | 13 | 0 |
72
+
73
+ ### Classification Report
74
+
75
+ ```
76
+ Precision - 47%
77
+ Accuracy - 47%
78
+ Recall - 47%
79
+ F1 - 45%
80
+
81
+ ```
82
+
83
+ ## Limitations
84
+
85
+ - The model's performance is dependent on the quality and representativeness of the training data.
86
+ - It may not perform well on unseen incident descriptions that are significantly different from the training data.
87
+ - The model's predictions are limited to the context of the provided short descriptions and do not take into account other contextual information.
88
+
89
+ ## Ethical Considerations
90
+
91
+ - Ensure the model is used in an ethical manner, considering the potential impact of misclassifications on incident management and prioritization.
92
+ - Regularly monitor the model's performance and update it with new data to maintain accuracy and reliability.
93
+
94
+ ## License
95
+
96
+ This model is released under the [Apache 2.0 License](https://opensource.org/licenses/Apache2.0).
97
+
98
+ ## Contact Information
99
+
100
+ For questions or issues, please contact [Tushar Mishra](mailto:tushar_mishra2023@ampba.isb.edu).
101
+
102
+ ---
103
+