Vipitis (Jan)

upvoted a paper 22 days ago

What's the Meaning of Superhuman Performance in Today's NLU?

Paper • 2305.08414 • Published May 15, 2023 • 1

upvoted 2 papers about 2 months ago

StarCoder 2 and The Stack v2: The Next Generation

Paper • 2402.19173 • Published Feb 29 • 121

SWE-bench: Can Language Models Resolve Real-World GitHub Issues?

Paper • 2310.06770 • Published Oct 10, 2023 • 3

upvoted a paper 3 months ago

DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence

Paper • 2401.14196 • Published Jan 25 • 44

upvoted a collection 4 months ago

models to evaluate

Collection

collecting models I want to evaluate on shadereval-task2: https://github.com/bigcode-project/bigcode-evaluation-harness/pull/173 at fp16!! • 28 items • Updated 17 days ago • 1

upvoted 2 papers 4 months ago

CRUXEval: A Benchmark for Code Reasoning, Understanding and Execution

Paper • 2401.03065 • Published Jan 5 • 10

TACO: Topics in Algorithmic COde generation dataset

Paper • 2312.14852 • Published Dec 22, 2023 • 4

upvoted a collection 6 months ago

Interpretability

Collection

Select papers on language model interpretability with notes • 5 items • Updated Nov 27, 2023 • 3

upvoted 3 papers 6 months ago

upvoted 5 papers 7 months ago

Evaluate & Evaluation on the Hub: Better Best Practices for Data and Model Measurements

Paper • 2210.01970 • Published Sep 30, 2022 • 11

CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation

Paper • 2102.04664 • Published Feb 9, 2021 • 2

Program Synthesis with Large Language Models

Paper • 2108.07732 • Published Aug 16, 2021 • 3

MultiPL-E: A Scalable and Extensible Approach to Benchmarking Neural Code Generation

Paper • 2208.08227 • Published Aug 17, 2022 • 1

Measuring Coding Challenge Competence With APPS

Paper • 2105.09938 • Published May 20, 2021 • 1

upvoted a collection 7 months ago

Code Evaluation

Collection

Collection of Papers on Code Evaluation (from code generation language models) • 29 items • Updated 6 days ago • 6

upvoted 4 papers 7 months ago

Evaluating Large Language Models Trained on Code

Paper • 2107.03374 • Published Jul 7, 2021 • 6

CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion

Paper • 2310.11248 • Published Oct 17, 2023 • 3

Efficient Streaming Language Models with Attention Sinks

Paper • 2309.17453 • Published Sep 29, 2023 • 13

IntelliCode Compose: Code Generation Using Transformer

Paper • 2005.08025 • Published May 16, 2020 • 3

upvoted 5 papers 8 months ago

CodePlan: Repository-level Coding using LLMs and Planning

Paper • 2309.12499 • Published Sep 21, 2023 • 68

OctoPack: Instruction Tuning Code Large Language Models

Paper • 2308.07124 • Published Aug 14, 2023 • 27

CodeBERTScore: Evaluating Code Generation with Pretrained Models of Code

Paper • 2302.05527 • Published Feb 10, 2023 • 1

Textbooks Are All You Need II: phi-1.5 technical report

Paper • 2309.05463 • Published Sep 11, 2023 • 84

ReCode: Robustness Evaluation of Code Generation Models

Paper • 2212.10264 • Published Dec 20, 2022 • 1

upvoted 6 papers 9 months ago

WizardCoder: Empowering Code Large Language Models with Evol-Instruct

Paper • 2306.08568 • Published Jun 14, 2023 • 27

The Magic of IF: Investigating Causal Reasoning Abilities in Large Language Models of Code

Paper • 2305.19213 • Published May 30, 2023 • 1

Textbooks Are All You Need

Paper • 2306.11644 • Published Jun 20, 2023 • 137

Code Llama: Open Foundation Models for Code

Paper • 2308.12950 • Published Aug 24, 2023 • 18

A Static Evaluation of Code Completion by Large Language Models

Paper • 2306.03203 • Published Jun 5, 2023 • 3

Procedural Image Programs for Representation Learning

Paper • 2211.16412 • Published Nov 29, 2022 • 1

upvoted 7 papers 10 months ago

Out of the BLEU: how should we assess quality of the Code Generation models?

Paper • 2208.03133 • Published Aug 5, 2022 • 2

Large Language Models Are State-of-the-Art Evaluators of Code Generation

Paper • 2304.14317 • Published Apr 27, 2023 • 2

CodeT5+: Open Code Large Language Models for Code Understanding and Generation

Paper • 2305.07922 • Published May 13, 2023 • 3

CodeGen2: Lessons for Training LLMs on Programming and Natural Languages

Paper • 2305.02309 • Published May 3, 2023 • 1

Generative AI for Programming Education: Benchmarking ChatGPT, GPT-4, and Human Tutors

Paper • 2306.17156 • Published Jun 29, 2023 • 20

Stay on topic with Classifier-Free Guidance

Paper • 2306.17806 • Published Jun 30, 2023 • 26

A Survey on Evaluation of Large Language Models

Paper • 2307.03109 • Published Jul 6, 2023 • 36

Jan

AI & ML interests

Organizations

Vipitis's activity