Alan Akbik

alanakbik

https://alanakbik.github.io/

AI & ML interests

None yet

Recent Activity

new activity 10 days ago

flair/ner-english:How to train NER model

View all activity

Organizations

alanakbik's activity

New activity in flair/ner-english 10 days ago

How to train NER model

#4 opened 11 days ago by

amriteshbytesview

updated 5 models 5 months ago

updated 6 models 6 months ago

alanakbik/ner-flair-v0.12.0

Token Classification • Updated Jul 15

alanakbik/ner-bpe-v0.12.0

Token Classification • Updated Jul 15

alanakbik/ner-flair-v0.12.1

Token Classification • Updated Jul 15

alanakbik/ner-flair-v0.13.0

Token Classification • Updated Jul 15 • 4

alanakbik/ner-new

Token Classification • Updated Jul 15

alanakbik/ner-gensim

Token Classification • Updated Jul 15

reacted to PatrickHaller's post with 🔥 7 months ago

Post

1910

How Robust Is Your Model in Complex Code Generation Tasks? 🤔

We've launched the PECC benchmark to challenge chat models in code generation, drawing from the Advent of Code for programming tasks and the Euler Project for math-heavy challenges. This new task tests models with problems presented in both detailed prose and concise "leet code" styles, evaluating their ability to understand and solve complex coding issues and math problem in chat-based interactions.

It seems that the Claude 3 models outperforme ChatGPT:
Model / Avg. (pass@3)
Claude 3 Haiku / 27.67
GPT-3.5-Turbo / 23.75
Mixtral-8x22B-Instruct-v0.1 / 8.35

Read our Preprint📃: PECC: Problem Extraction and Coding Challenges (2404.18766)
Look at the dataset🔎: PatrickHaller/pecc

We also got accepted at LREC-COLING '24 🎉