Audio Classification
Transformers
Safetensors
audio-spectrogram-transformer
heart-sound-classification
heart-murmur-detection
medical-ai
Instructions to use rajnish612/ast-heart-murmur-classifier with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use rajnish612/ast-heart-murmur-classifier with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("audio-classification", model="rajnish612/ast-heart-murmur-classifier")# Load model directly from transformers import AutoFeatureExtractor, AutoModelForAudioClassification extractor = AutoFeatureExtractor.from_pretrained("rajnish612/ast-heart-murmur-classifier") model = AutoModelForAudioClassification.from_pretrained("rajnish612/ast-heart-murmur-classifier") - Notebooks
- Google Colab
- Kaggle
Heart Murmur AST Classifier
This model is a fine-tuned Audio Spectrogram Transformer (AST) for heart sound classification.
Classes
| Label ID | Class |
|---|---|
| 0 | Absent |
| 1 | Murmur |
| 2 | Unknown |
Base Model
- MIT/ast-finetuned-audioset-10-10-0.4593
Dataset
Fine-tuned on the CirCor DigiScope Phonocardiogram Dataset.
Performance
- Validation Accuracy: 86.2%
- Validation Loss: 0.4385
Usage
from transformers import ASTForAudioClassification
model = ASTForAudioClassification.from_pretrained(
"rajnish612/ast-heart-murmur-classifier"
)
Feature Extractor
from transformers import AutoFeatureExtractor
feature_extractor = AutoFeatureExtractor.from_pretrained(
"MIT/ast-finetuned-audioset-10-10-0.4593"
)
Prediction
inputs = feature_extractor(
audio,
sampling_rate=16000,
return_tensors="pt"
)
outputs = model(**inputs)
prediction = outputs.logits.argmax(-1).item()
Labels
labels = {
0: "Absent",
1: "Murmur",
2: "Unknown"
}
Intended Use
This model is intended for research and educational purposes in heart sound analysis and murmur detection.
Limitations
This model is not a medical device and should not be used for clinical diagnosis.
- Downloads last month
- 62
Model tree for rajnish612/ast-heart-murmur-classifier
Base model
MIT/ast-finetuned-audioset-10-10-0.4593