AI Coding

27 readers

1 users here now

A community to discuss agentic and AI assisted coding.

All users are expected to follow the code of conduct, particularly in regards to voting:

1.3. Vote for quality: When downvoting content in communities the downvotes should reflect the quality of the content rather than whether you personally agree with it.

founded 2 months ago

MODERATORS

codeinabox@programming.dev

Evaluating AGENTS.md: Are Repository-Level Context Files Helpful for Coding Agents? (arxiv.org)

submitted 1 month ago by codeinabox@programming.dev to c/aicoding@programming.dev

1 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] codeinabox@programming.dev 1 points 1 month ago

The conclusion aligns with my own belief, which is that it's better to create a minimal context by hand than get agents to create it:

We find that all context files consistently increase the number of steps required to complete tasks. LLM-generated context files have a marginal negative effect on task success rates, while developer-written ones provide a marginal performance gain.

When I have got Claude to create a context, it's been overly verbose, and that also costs tokens.