Профиль

Roy

403 подписчиков1 тыс. подписок7,3 тыс. постов
Публикации
⟳ Репост от Roy

This is a really excellent benchmark, pointing to some serious missing capabilities in coding agents: arxiv.org/abs/2603.247.... They don't write code with an eye towards maintenance!

SlopCodeBench: Benchmarking How Coding Agents Degrade Over Long-Horizon Iterative TasksSoftware development is iterative, yet agentic coding benchmarks overwhelmingly evaluate single-shot solutions against complete specifications. Code can pass the test suite but become progressively ha...arxiv.org
Следующие публикации