dev7halo
dev7halo
AI & ML interests
None yet
Recent Activity
updated
a model
3 days ago
dev7halo/ModernBERT-base-ko-test-v2
reacted
to
singhsidhukuldeep's
post
with ๐
3 days ago
Exciting breakthrough in e-commerce recommendation systems!
Walmart Global Tech researchers have developed a novel Triple Modality Fusion (TMF) framework that revolutionizes how we make product recommendations.
>> Key Innovation
The framework ingeniously combines three distinct data types:
- Visual data to capture product aesthetics and context
- Textual information for detailed product features
- Graph data to understand complex user-item relationships
>> Technical Architecture
The system leverages a Large Language Model (Llama2-7B) as its backbone and introduces several sophisticated components:
Modality Fusion Module
- All-Modality Self-Attention (AMSA) for unified representation
- Cross-Modality Attention (CMA) mechanism for deep feature integration
- Custom FFN adapters to align different modality embeddings
Advanced Training Strategy
- Curriculum learning approach with three complexity levels
- Parameter-Efficient Fine-Tuning using LoRA
- Special token system for behavior and item representation
>> Real-World Impact
The results are remarkable:
- 38.25% improvement in Electronics recommendations
- 43.09% boost in Sports category accuracy
- Significantly higher human evaluation scores compared to traditional methods
Currently deployed in Walmart's production environment, this research demonstrates how combining multiple data modalities with advanced LLM architectures can dramatically improve recommendation accuracy and user satisfaction.
liked
a model
4 days ago
maldv/Qwentile2.5-32B-Instruct
Organizations
dev7halo's activity
Is that full finetune or LoRA ?
#1 opened 3 months ago
by
dev7halo
Why do I get results without filling out the prompt?
1
#11 opened 8 months ago
by
dev7halo
Why do I get results without filling out the prompt?
1
#11 opened 8 months ago
by
dev7halo