Jan's picture

8 41 5

Jan

Vipitis

·

AI & ML interests

code generation, model evaluation

Recent Activity

New activity about 8 hours ago

Vipitis/shadermatch:Accessibility notice

updated a collection 8 days ago

models to evaluate

updated a dataset 9 days ago

Vipitis/Shadereval-inputs

View all activity

Organizations

Vipitis's activity

upvoted a collection 5 months ago

language models for computer grpahics

List of papers (and models?) that are specifically used in the domain of computergraphics. Reading list for my thesis • 6 items • Updated Aug 29 • 1

upvoted a paper 6 months ago

A Survey on Language Models for Code

Paper • 2311.07989 • Published Nov 14, 2023 • 21

upvoted a paper 7 months ago

What's the Meaning of Superhuman Performance in Today's NLU?

Paper • 2305.08414 • Published May 15, 2023 • 1

upvoted a paper 8 months ago

StarCoder 2 and The Stack v2: The Next Generation

Paper • 2402.19173 • Published Feb 29 • 136

upvoted a paper 9 months ago

SWE-bench: Can Language Models Resolve Real-World GitHub Issues?

Paper • 2310.06770 • Published Oct 10, 2023 • 4

upvoted a paper 10 months ago

DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence

Paper • 2401.14196 • Published Jan 25 • 47

upvoted a collection 10 months ago

models to evaluate

collecting models I want to evaluate on shadereval-task2: https://github.com/bigcode-project/bigcode-evaluation-harness/pull/173 at fp16!! • 39 items • Updated 8 days ago • 2

upvoted 2 papers 11 months ago

CRUXEval: A Benchmark for Code Reasoning, Understanding and Execution

Paper • 2401.03065 • Published Jan 5 • 11

TACO: Topics in Algorithmic COde generation dataset

Paper • 2312.14852 • Published Dec 22, 2023 • 4

upvoted a collection 12 months ago

Interpretability

Select papers on language model interpretability with notes • 6 items • Updated 12 days ago • 4

upvoted 8 papers about 1 year ago

Analyzing Transformers in Embedding Space

Paper • 2209.02535 • Published Sep 6, 2022 • 3

Code Execution with Pre-trained Language Models

Paper • 2305.05383 • Published May 8, 2023 • 2

CodeFusion: A Pre-trained Diffusion Model for Code Generation

Paper • 2310.17680 • Published Oct 26, 2023 • 69

Evaluate & Evaluation on the Hub: Better Best Practices for Data and Model Measurements

Paper • 2210.01970 • Published Sep 30, 2022 • 11

CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation

Paper • 2102.04664 • Published Feb 9, 2021 • 1

Program Synthesis with Large Language Models

Paper • 2108.07732 • Published Aug 16, 2021 • 4

MultiPL-E: A Scalable and Extensible Approach to Benchmarking Neural Code Generation

Paper • 2208.08227 • Published Aug 17, 2022 • 1

Measuring Coding Challenge Competence With APPS

Paper • 2105.09938 • Published May 20, 2021 • 1

upvoted a collection about 1 year ago

Code Evaluation

Collection of Papers on Code Evaluation (from code generation language models) • 45 items • Updated 28 days ago • 14

upvoted a paper about 1 year ago

Evaluating Large Language Models Trained on Code

Paper • 2107.03374 • Published Jul 7, 2021 • 6