LH-Tech-AI commited on
Commit
30accb4
·
verified ·
1 Parent(s): 67d7c5d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +103 -3
README.md CHANGED
@@ -1,3 +1,103 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: en
3
+ license: mit
4
+ library_name: transformers
5
+ tags:
6
+ - sentiment-analysis
7
+ - classification
8
+ - from-scratch
9
+ - multi-domain
10
+ datasets:
11
+ - imdb
12
+ - glue
13
+ metrics:
14
+ - accuracy
15
+ model-index:
16
+ - name: VibeCheck-v1
17
+ results:
18
+ - task:
19
+ type: text-classification
20
+ name: Sentiment Analysis
21
+ dataset:
22
+ name: Mixed (IMDb & SST2)
23
+ type: multi-domain
24
+ metrics:
25
+ - type: accuracy
26
+ value: [INSERT_ACCURACY_HERE] # Replace with your final validation accuracy
27
+ pipeline_tag: text-classification
28
+ ---
29
+
30
+ # VibeCheck v1
31
+
32
+ VibeCheck v1 is a high-performance, multi-domain Transformer model trained **entirely from scratch**. Unlike its predecessor, this model was trained on a balanced mix of long-form reviews and short-form conversational data, making it a versatile tool for analyzing "vibes" across different types of English text.
33
+
34
+ ## Model Description
35
+ - **Architecture:** Enhanced Custom Transformer (DistilBERT-style)
36
+ - **Parameters:** ~11.17 Million
37
+ - **Layers:** 4 (Increased depth for better abstraction)
38
+ - **Attention Heads:** 8
39
+ - **Hidden Dimension:** 256 (Hidden Feed-Forward: 1024)
40
+ - **Training Data:** ~92,349 samples (Mixed IMDb Movie Reviews & SST-2 Sentence Bank)
41
+ - **Training Duration:** ~25-30 minutes on NVIDIA T4 GPU
42
+
43
+ ## Capabilities
44
+ - **Multi-Domain Versatility:** Reliable on everything from formal emails to short chat messages.
45
+ - **Enhanced Context Awareness:** 4 layers of self-attention allow for a deeper understanding of sentence structure.
46
+ - **Linguistic Nuance:** Strong performance on complex negatives (e.g., "not as bad as I thought") and rhetorical questions.
47
+ - **Robustness:** High tolerance for slang, typos, and non-standard English.
48
+
49
+ ## Limitations
50
+ - **Language Focus:** Primarily trained on English. While it shows some intuition for other languages, accuracy may vary.
51
+ - **Binary Nature:** Strictly classifies text as Positive or Negative; it does not detect neutral intent or specific emotions (like anger or joy).
52
+
53
+ ## How to use (Inference Script)
54
+ To use this model, download the `VibeCheck_v1_Model.zip`, unpack it, and run the provided `inference.py` script. Make sure to point the script to the unpacked directory.
55
+
56
+ ## Examples (VibeCheck v1 in Action)
57
+
58
+ ### Example 1: Formal Business Email
59
+ **Input:**
60
+ ```plaintext
61
+ Dear Team, I am writing to express my deep disappointment regarding the recent project update. The quality is subpar.
62
+ ```
63
+
64
+ **Output:** NEGATIVE | Confidence: 97.60%
65
+
66
+ ### Example 2: Short Conversational Fragment
67
+ **Input:**
68
+
69
+ ```plaintext
70
+ That sounds like a fantastic plan! I'm starving.
71
+ ```
72
+
73
+ **Output:** POSITIVE | Confidence: 74.15%
74
+
75
+ ### Example 3: Sarcastic Observation of a movie review
76
+ **Input:**
77
+
78
+ ```plaintext
79
+ Wow! What an amazing view we have out of this window!
80
+ ```
81
+
82
+ **Output:** POSITIVE | Confidence: 99.43%
83
+
84
+ ### Example 4: Classic Test
85
+ **Input:**
86
+
87
+ ```plaintext
88
+ You are dumb.
89
+ ```
90
+
91
+ **Output:** NEGATIVE | Confidence: 87.85%
92
+
93
+ ### Example 5: Simple chat
94
+ **Input:**
95
+
96
+ ```plaintext
97
+ Did you see the new movie?' B: 'Yeah, it was okay, but the ending felt a bit rushed.' A: 'I totally agree, it could have been better.'
98
+ ```
99
+
100
+ **Output:** NEGATIVE | Confidence: 80.98%
101
+
102
+ ## Training code
103
+ The full training code for this multi-domain version is available in `train_vibecheck.ipynb`.