machine-translation

Build error

App Files Files Community

machine-translation / llm_toolkit

Commit History

Chinese-English Machine Translation - Repetition Metrics for Different Models

a5c9876

dh-mc commited on Oct 12

completed llama-3.1-70b generic prompt

db47db5

dh-mc commited on Oct 11

ready for llama-3.1-8b

b83b354

dh-mc commited on Oct 6

Update translation_utils.py

7bba27d

dh-mc commited on Oct 6

ready for generic prompt

de63924

dh-mc commited on Oct 5

COMET eval results

927a69c

dh-mc commited on Sep 17

few shot COMET results

101f384

dh-mc commited on Sep 16

diable lfs for 00b notebook

553af0d

dh-mc commited on Sep 15

Update eval_epochs.py

380616e

dh-mc commited on Aug 13

ready eval qwen2-72b

1f80432

dh-mc commited on Aug 13

complete gpt-4o-mini training

3f6b774

dh-mc commited on Aug 10

complete finetune rpp results

a2a97d3

inflaton commited on Aug 10

add env var END_REPETITION_PENALTY

ee71b10

dh-mc commited on Aug 9

fine-tuned metrics WIP

2a89293

inflaton commited on Aug 9

finetune results

77dd763

inflaton commited on Aug 8

eval fine-tuned checkpoints

44cfb92

dh-mc commited on Aug 8

updated scripts

fc9601b

inflaton commited on Aug 8

train with 4gpu

a2100ac

dh-mc commited on Aug 8

ready for LF lora training

6fc6dc9

dh-mc commited on Aug 7

translation time analyzed

95ba169

dh-mc commited on Aug 6

complete results for gpt-4o and gpt-4o-mini

fddc7fb

inflaton commited on Aug 5

complete results for original prompt

ad9aba8

dh-mc commited on Aug 4

ready for few shots prompting 4gpu

0156aec

dh-mc commited on Aug 3

fixed bug

1a1bddc

inflaton commited on Aug 3

refine prompt

8434dc6

inflaton commited on Aug 3

eval with few-shots prompting

6c91c84

dh-mc commited on Aug 3

enable env: START_REPETITION_PENALTY

a457091

dh-mc commited on Aug 2

completed Qwen2-72B results

7dab5c1

dh-mc commited on Aug 2

new mistral results analyzed

1bdff66

dh-mc commited on Jul 31

set max_new_tokens to 300

a37d279

dh-mc commited on Jul 30

formatted code

640a737

dh-mc commited on Jul 30

data analysis notebooks

1a9edc9

dh-mc commited on Jul 30

fixed bug for Mistral

12a5ff3

dh-mc commited on Jul 30

enable do_sample

a69b127

dh-mc commited on Jul 30

set max_new_tokens to 2048

990ef6d

dh-mc commited on Jul 29

ready for gpu cluster

c73d190

dh-mc commited on Jul 28

WIP

07320d0

dh-mc commited on Jul 28

clean up

54b1b8a

dh-mc commited on Jul 28

initial code for Chinese/English translation

3860729

dh-mc commited on Jul 15

Commit History

Chinese-English Machine Translation - Repetition Metrics for Different Models a5c9876

completed llama-3.1-70b generic prompt db47db5

ready for llama-3.1-8b b83b354

Update translation_utils.py 7bba27d

ready for generic prompt de63924

COMET eval results 927a69c

few shot COMET results 101f384

diable lfs for 00b notebook 553af0d

Update eval_epochs.py 380616e

ready eval qwen2-72b 1f80432

complete gpt-4o-mini training 3f6b774

complete finetune rpp results a2a97d3

add env var END_REPETITION_PENALTY ee71b10

fine-tuned metrics WIP 2a89293

finetune results 77dd763

eval fine-tuned checkpoints 44cfb92

updated scripts fc9601b

train with 4gpu a2100ac

ready for LF lora training 6fc6dc9

translation time analyzed 95ba169

complete results for gpt-4o and gpt-4o-mini fddc7fb

complete results for original prompt ad9aba8

ready for few shots prompting 4gpu 0156aec

fixed bug 1a1bddc

refine prompt 8434dc6

eval with few-shots prompting 6c91c84

enable env: START_REPETITION_PENALTY a457091

completed Qwen2-72B results 7dab5c1

new mistral results analyzed 1bdff66

set max_new_tokens to 300 a37d279

formatted code 640a737

data analysis notebooks 1a9edc9

fixed bug for Mistral 12a5ff3

enable do_sample a69b127

set max_new_tokens to 2048 990ef6d

ready for gpu cluster c73d190

WIP 07320d0

clean up 54b1b8a

initial code for Chinese/English translation 3860729

Chinese-English Machine Translation - Repetition Metrics for Different Models

a5c9876

completed llama-3.1-70b generic prompt

db47db5

ready for llama-3.1-8b

b83b354

Update translation_utils.py

7bba27d

ready for generic prompt

de63924

COMET eval results

927a69c

few shot COMET results

101f384

diable lfs for 00b notebook

553af0d

Update eval_epochs.py

380616e

ready eval qwen2-72b

1f80432

complete gpt-4o-mini training

3f6b774

complete finetune rpp results

a2a97d3

add env var END_REPETITION_PENALTY

ee71b10

fine-tuned metrics WIP

2a89293

finetune results

77dd763

eval fine-tuned checkpoints

44cfb92

updated scripts

fc9601b

train with 4gpu

a2100ac

ready for LF lora training

6fc6dc9

translation time analyzed

95ba169

complete results for gpt-4o and gpt-4o-mini

fddc7fb

complete results for original prompt

ad9aba8

ready for few shots prompting 4gpu

0156aec

fixed bug

1a1bddc

refine prompt

8434dc6

eval with few-shots prompting

6c91c84

enable env: START_REPETITION_PENALTY

a457091

completed Qwen2-72B results

7dab5c1

new mistral results analyzed

1bdff66

set max_new_tokens to 300

a37d279

formatted code

640a737

data analysis notebooks

1a9edc9

fixed bug for Mistral

12a5ff3

enable do_sample

a69b127

set max_new_tokens to 2048

990ef6d

ready for gpu cluster

c73d190

WIP

07320d0

clean up

54b1b8a

initial code for Chinese/English translation

3860729