Yattish Ramhorry's picture

12

Yattish Ramhorry

yattishr

·

AI & ML interests

Deep Learning Computer Vision Reinforcement Learning Artificial Neural Networks

Recent Activity

reacted to schuler's post with 😎 28 days ago

🔮 GPT-3 implemented in pure Free Pascal! https://github.com/joaopauloschuler/gpt-3-for-pascal This implementation follows the GPT-3 Small architecture from the landmark paper "Language Models are Few-Shot Learners": ``` ┌─────────────────────────┐ │ Input Layer │ ├─────────────────────────┤ │ Token & Positional │ │ Embedding │ ├─────────────────────────┤ │ 12x Transformer │ │ Blocks │ │ - 12 heads │ │ - 768 hidden dims │ │ - 3072 intermediate │ ├─────────────────────────┤ │ Output Layer │ └─────────────────────────┘ ``` Clean Pascal Implementation ``` for CntLayer := 1 to {Layers=}12 do begin Result.AddTransformerBlockCAI( {Heads=}12, {intermediate dimensions=}4*768, {NoForward=}true, {HasNorm=}true, false ); end; ```

liked a model 3 months ago

tencent/HunyuanVideo

liked a model 4 months ago

Jacaranda/AfroLlama_V1

View all activity

Organizations

None yet

models

None public yet

datasets

None public yet