Dr. Joao Paulo Schwarz Schuler PRO

schuler

AI & ML interests

artificial intelligence

Recent Activity

posted an update 1 day ago
šŸ”® GPT-3 implemented in pure Free Pascal! https://github.com/joaopauloschuler/gpt-3-for-pascal This implementation follows the GPT-3 Small architecture from the landmark paper "Language Models are Few-Shot Learners": ``` ā”Œā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā” ā”‚ Input Layer ā”‚ ā”œā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”¤ ā”‚ Token & Positional ā”‚ ā”‚ Embedding ā”‚ ā”œā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”¤ ā”‚ 12x Transformer ā”‚ ā”‚ Blocks ā”‚ ā”‚ - 12 heads ā”‚ ā”‚ - 768 hidden dims ā”‚ ā”‚ - 3072 intermediate ā”‚ ā”œā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”¤ ā”‚ Output Layer ā”‚ ā””ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”˜ ``` Clean Pascal Implementation ``` for CntLayer := 1 to {Layers=}12 do begin Result.AddTransformerBlockCAI( {Heads=}12, {intermediate dimensions=}4*768, {NoForward=}true, {HasNorm=}true, false ); end; ```
updated a model 2 days ago
schuler/experimental-JP47D56
updated a model 2 days ago
schuler/experimental-JP47D56B
View all activity

Organizations

None yet

schuler's activity

New activity in open-llm-leaderboard/open_llm_leaderboard 2 months ago

submission issues

7
#1038 opened 2 months ago by
pszemraj
New activity in hallucinations-leaderboard/leaderboard 2 months ago

use_remote_code=True

#27 opened 2 months ago by
schuler
New activity in MAKILINGDING/english_dictionary 3 months ago

Source of the data?

#2 opened 3 months ago by
schuler
New activity in ohsuz/tiny-textbooks-merged 3 months ago

Source of the data?

#1 opened 3 months ago by
schuler
New activity in wangfuyun/AnimateLCM-SVD-xt 12 months ago

How to load the model ?

4
#7 opened 12 months ago by
schuler

How to load the model ?

4
#7 opened 12 months ago by
schuler

How to load the model ?

4
#7 opened 12 months ago by
schuler