llms.txt file
Interested to know what people think about this juxtaposition and what weight people see llms.txt files as having.
I found a section on https://developers.google.com/search/docs/fundamentals/ai-optimization-guide called Mythbusting generative AI search: what you don't need to do, and in that section they state you do not need to create machine-readable files, AI text files, or Markdown for Google Search or its AI features, as Google does not use them.
However on page speed insights there is a section in agentic browsing looking for a llms.txt file stating, To ensure large language models correctly understand how to crawl or use your website for training, your llms.txt file must be formatted as a Markdown file containing at least one H1 header.
Is this suggesting language models other than Google are reading the file but Google wont or am i missing something here?