Commit History

feat: add interactive plot to view rope rotation angle as a function of dimension pair index (d) and token position index (k)
36a72e5
Running

DebasishDhal99 commited on

feat: made attention logits plot more interactive and added intuitive logic fir attention logits and attention scores
4f0e23c

DebasishDhal99 commited on

feat: enhance attention visualization with token context and improve markdown explanations
0342a67

DebasishDhal99 commited on

feat: add formla of Q, K matrix calculation
ba618db

DebasishDhal99 commited on

fix: made the sequence length accurate for real model setup and also added information on which attention head is attending which set of dims
3a74c51

DebasishDhal99 commited on

feat: add explanation on `hidden_size = num_attention_heads * dim_per_head`
4ed3b70

DebasishDhal99 commited on

feat: increase seq_len and auto-update of dim on UI during compute
c9744fe

DebasishDhal99 commited on

fix: re-add space.GPU to comply with mandatory gpu usage
b7f6530

DebasishDhal99 commited on

feat: add rope visualization only with some minor cmparison with sinusoidial positional embedding
aa7bfed

DebasishDhal99 commited on

fix: add spaces to comply with mandatory use og nvidia gpu on huggingface
1d852fb

DebasishDhal99 commited on

fix: make numpy constraintless because of dependency on 3.10 on huggingface platform
d67196e

DebasishDhal99 commited on

feat: basic setup with docker, no real code has been added for visualization yet
80699e5

DebasishDhal99 commited on

fix: Fix Hugging Face username in workflow
994e5da
unverified

DebasishDhal commited on

feat: add workflow for github->hf sync (for building a hf space for visualization)
e72368d

DebasishDhal99 commited on

Added visualization for rope implementation
b69f91a

DebasishDhal99 commited on

Added rope implementation code with explanation
f2aabc6

DebasishDhal99 commited on

feat: added bare minimum rel-position embedding
8038560

DebasishDhal99 commited on

feat: added bare mimimum implementation of absolute sinusoidal positional encoding
db4dc58

DebasishDhal99 commited on

Initial commit
32067df
unverified

DebasishDhal commited on