Tuesday, May 06, 2025

llms.txt: Web LLMs AI Agents helper

Finally, what "REST" and even Web was supposed to provide: "master index file"

a new proposal to help AI based web search:
providing a markdown text file in the root of web site: llms.txt

The purpose: provide detailed documentation to "AI Agent" tools
in particular to assist with code generation.


LLMS-txt //langchain-ai.github.io/langgraph/llms-txt-overview/


The /llms.txt file – llms-txt

...propose adding a /llms.txt markdown file to websites to provide LLM-friendly content.
This file offers brief background information, guidance, and links to detailed markdown files.

llms.txt markdown is human and LLM readable, but is also in a precise format
allowing fixed processing methods (i.e. classical programming techniques such as parsers and regex).






example: Bun.js : bun.sh/llms-full.txt







How I use LLMs - YouTube Andrej Karpathy


No comments: