Dr. Joao Paulo Schwarz Schuler PRO
schuler
AI & ML interests
artificial intelligence
Recent Activity
posted
an
update
1 day ago
š® GPT-3 implemented in pure Free Pascal!
https://github.com/joaopauloschuler/gpt-3-for-pascal
This implementation follows the GPT-3 Small architecture from the landmark paper "Language Models are Few-Shot Learners":
```
āāāāāāāāāāāāāāāāāāāāāāāāāāā
ā Input Layer ā
āāāāāāāāāāāāāāāāāāāāāāāāāāā¤
ā Token & Positional ā
ā Embedding ā
āāāāāāāāāāāāāāāāāāāāāāāāāāā¤
ā 12x Transformer ā
ā Blocks ā
ā - 12 heads ā
ā - 768 hidden dims ā
ā - 3072 intermediate ā
āāāāāāāāāāāāāāāāāāāāāāāāāāā¤
ā Output Layer ā
āāāāāāāāāāāāāāāāāāāāāāāāāāā
```
Clean Pascal Implementation
```
for CntLayer := 1 to {Layers=}12 do
begin
Result.AddTransformerBlockCAI(
{Heads=}12,
{intermediate dimensions=}4*768,
{NoForward=}true,
{HasNorm=}true,
false
);
end;
```
updated
a model
2 days ago
schuler/experimental-JP47D56
updated
a model
2 days ago
schuler/experimental-JP47D56B
Organizations
None yet
schuler's activity
submission issues
7
#1038 opened 2 months ago
by
pszemraj
use_remote_code=True
#27 opened 2 months ago
by
schuler
Gradio chatbot with AutoModelForCausalLM, AutoTokenizer and @spaces.GPU() (ZeroGPU space)
1
#3 opened 3 months ago
by
schuler
Source of the data?
#2 opened 3 months ago
by
schuler
Source of the data?
#1 opened 3 months ago
by
schuler
How to load the model ?
4
#7 opened 12 months ago
by
schuler
How to load the model ?
4
#7 opened 12 months ago
by
schuler
How to load the model ?
4
#7 opened 12 months ago
by
schuler