HW-202337458-transformer-decoder

Assignment

Transformer Decoder 구현 코드 업로드 과제입니다.

Student

• Student ID: 202337458
• Hugging Face ID: hf-june

Included Modules

• PositionWiseFeedForward
• DecoderBlock
• TransformerDecoder
• CustomDecoderConfig

Files

• transformer_decoder.py
• config.json
• test_transformer_decoder.py
• README.md

How to Use

import torch
from transformer_decoder import CustomDecoderConfig, TransformerDecoder

config = CustomDecoderConfig()
model = TransformerDecoder(config)

input_ids = torch.randint(0, config.vocab_size, (2, 10))
encoder_output = torch.randn(2, 10, config.hidden_size)

logits = model(input_ids=input_ids, encoder_output=encoder_output)
print(logits.shape)

Expected Output

torch.Size([2, 10, 30522])