YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
SMAI Assignment 4 β MLP on CIFAR-10
Architecture: 3072 β 512 β 256 β 128 β 10 fully connected; hidden activation ReLU; output = 10 logits (no activation, softmax + cross-entropy loss).
Weights:
weights.npzwithW0, b0, W1, b1, ...;Whas shape (inputs, outputs), so logits = h @ W + b.Preprocessing: flatten the 32Γ32Γ3 image (row-major, channels last) to 3072 numbers, divide by 255, then standardise each column with
meanandstdfrompreprocessing.npz(computed on the 50,000 CIFAR-10 training images).Training: CIFAR-10 train part (true labels, p = 0), plain SGD, lr 0.05, batch 64, 100 epochs, seed 11030.
Result: train accuracy 0.9576, test accuracy 0.5025 (10,000 test images).