Ideas & society2024 · shared on Hacker News
Some critical issues with the SWE-bench dataset
Explore Some critical issues with the SWE-bench dataset, its original source and Hacker News discussions. Discover community perspectives and save it to your reading list.
GO BEYOND THE ABSTRACT
The conversation around the idea.
Original Hacker News threads. Different perspectives, questions, and things worth thinking about.
Showing up to 100 related threads. A paper may appear in a comment rather than the original submission.
Links found in the discussion
Up to 50 recent source links, in HN item order.
Yjoshwa ·
Some critical issues with the SWE-bench dataset
350 points116 comments
Yzone411 ·
SWE-Lancer: a benchmark of freelance software engineering tasks from Upwork
111 points74 comments
Yzeroonetwothree ·
SWE-Bench+: Enhanced Coding Benchmark for LLMs
3 points0 comments