Hugging Face's logo
Djuunaa's picture
165 29 546

Djuunaa

djuna
21world's profile picture dharminder123's profile picture ecastera's profile picture
·

AI & ML interests

None yet

Recent Activity

upvoted a paper about 14 hours ago
Orthogonal Finetuning Made Scalable
liked a model 3 days ago
zz1358m/SofT-GRPO-master
reacted to Locutusque's post with 🔥 5 days ago
🚀 AutoXLA - Accelerating Large Models on TPU AutoXLA is an experimental library that automates the distribution, optimization, and quantization of large language models for TPUs using PyTorch/XLA. It extends the Hugging Face Transformers interface with TPU-aware features such as automatic sharding, custom attention kernels, and quantization-aware loading, making large-scale deployment and training both simpler and faster. With quantization and Splash Attention kernels, AutoXLA achieves up to 4× speedups over standard Flash Attention implementations, significantly improving throughput for both inference and training workloads. Whether you’re experimenting with distributed setups (FSDP, 2D, or 3D sharding) or optimizing memory via LanguageModelQuantizer, AutoXLA is built to make scaling LLMs on TPU seamless. ⚠️ Note: This is an experimental repository. Expect rough edges! Please report bugs or unexpected behavior through GitHub issues. 🔗 GitHub Repository: https://github.com/Locutusque/AutoXLA
View all activity

Organizations

Dev Mode Explorers's profile picture Djuna Test Lab's profile picture Punya's profile picture