BigCodeBench: Benchmarking Large Language Models on Solving Practical and Challenging Programming Tasks
•
43
BigCode
Enterprise
non-profit
AI & ML interests
None defined yet.
Recent Activity
View all activity
Articles
bigcode's activity
terryyz
updated
5
datasets
4 days ago
bigcode/bigcodebench-hard-results
Viewer
•
Updated
•
163
•
95
•
1
bigcode/bigcodebench-hard-solve-rate
Viewer
•
Updated
•
296
•
107
•
1
bigcode/bigcodebench-hard-domain
Viewer
•
Updated
•
297
•
92
•
1
bigcode/bigcodebench-hard-perf
Viewer
•
Updated
•
297
•
90
bigcode/bigcodebench-results
Viewer
•
Updated
•
163
•
101
•
2
terryyz
updated
a
Space
5 days ago
terryyz
updated
3
datasets
5 days ago
terryyz
updated
a
Space
5 days ago
Phi4 - Is it the new best small model?
1
#89 opened 11 days ago
by
AgileAndy
lvwerra
authored
a
paper
11 days ago
terryyz
updated
a
model
13 days ago
terryyz
updated
2
datasets
13 days ago
terryyz
updated
2
datasets
14 days ago
Incorrect URL in tests for example 1005
4
#3 opened 14 days ago
by
danieldritter
Post
2935
💫...And we're live!💫 Seasonal newsletter from ethicsy folks at Hugging Face, exploring the ethics of "AI Agents"
https://huggingface.co/blog/ethics-soc-7
Our analyses found:
- There's a spectrum of "agent"-ness
- *Safety* is a key issue, leading to many other value-based concerns
Read for details & what to do next!
With @evijit , @giadap , and @sasha
https://huggingface.co/blog/ethics-soc-7
Our analyses found:
- There's a spectrum of "agent"-ness
- *Safety* is a key issue, leading to many other value-based concerns
Read for details & what to do next!
With @evijit , @giadap , and @sasha
BrigitteTousi
posted
an
update
18 days ago
Post
1042
Community fine-tuned models are more carbon efficient than the models they are derived from! 🥳🌿
@alozowski @clefourrier @SaylorTwift @albertvillanova evaluated CO₂ emissions associated with model inference for over 3000 models on the Open LLM Leaderboard. Interesting trends and new insights emerged...👀
Blog Post: https://huggingface.co/blog/leaderboard-emissions-analysis
Leaderboard: open-llm-leaderboard/open_llm_leaderboard
@alozowski @clefourrier @SaylorTwift @albertvillanova evaluated CO₂ emissions associated with model inference for over 3000 models on the Open LLM Leaderboard. Interesting trends and new insights emerged...👀
Blog Post: https://huggingface.co/blog/leaderboard-emissions-analysis
Leaderboard: open-llm-leaderboard/open_llm_leaderboard