Mostly different jobs, I think: robots.txt is domain-level exclusion for crawlers you didn't invite, AGENTS.md is repo-level instructions for agents you did invite. The web-side analogue ended up being llms.txt. Common thread: a well-known filename ships faster than a standards process.