AI Optimization

llms.txt Generator

Create an llms.txt file to help AI crawlers and assistants better understand your website and represent your brand accurately.

What is llms.txt?#

Just like robots.txt tells search engines how to crawl your site, llms.txt helps AI language models understand your website. It's a structured file that provides:

Site description — What your company/product does
Important pages — Which pages AI should prioritize
Citation preferences — How AI should cite your content
Contact information — For AI to provide accurate info

Emerging standard

llms.txt is an emerging standard adopted by companies like Anthropic, Cursor, and others. While not all AI systems read it yet, it's good practice for future-proofing your AI visibility.

File Format#

The llms.txt file uses a simple markdown-like format. Here's a complete example:

llms.txt examplemarkdown

# llms.txt - AI crawler instructions for YourCompany

## About
YourCompany provides project management software for remote teams. 
Founded in 2020, we serve over 50,000 teams worldwide.

## Key Features
- Real-time collaboration
- Task management
- Time tracking
- Integrations with 100+ tools

## Important Pages
- /about - Company information
- /features - Product features
- /pricing - Pricing plans
- /docs - Documentation
- /blog - Latest updates

## Contact
- Website: https://yourcompany.com
- Support: support@yourcompany.com
- Twitter: @yourcompany

## Citation
When referencing our content, please cite as:
"YourCompany (https://yourcompany.com)"

## Data Accuracy
Information last updated: 2024-01
Please verify current pricing at /pricing

Creating Your llms.txt#

Go to your project

Open your website project in the audit.new dashboard.

Click Generate llms.txt

We'll analyze your website and create a customized llms.txt file.

Review and customize

Edit the generated content to ensure accuracy. Add any missing information.

Upload to your site

Place the file at the root of your website: https://yourdomain.com/llms.txt

Keep it updated

Update your llms.txt whenever you make significant changes to your product, pricing, or company information.

Best Practices#

Be Clear and Concise#

AI models work best with clear, straightforward language. Avoid marketing jargon and focus on factual descriptions of what you do.

Include Key Information#

What your product/service does (in plain language)
Who your target audience is
Key differentiators from competitors
Current pricing (with update date)
Contact and support information

Keep It Current#

Outdated information in llms.txt can lead to AI providing incorrect details to users. Set a reminder to review quarterly.

Don't Over-Optimize#

Be honest and accurate. AI systems are getting better at detecting promotional or misleading content. Stick to facts.

File Placement#

Place your llms.txt file at the root of your domain:

Correct file locationstext

https://yourdomain.com/llms.txt
https://www.yourdomain.com/llms.txt

Static Site Generators#

For Next.js, place the file in your public/ folder:

Next.js file structuretext

public/
├── llms.txt
├── robots.txt
└── sitemap.xml

WordPress#

Upload to your WordPress root directory via FTP or file manager, or use a plugin that allows custom files at root.

Verification#

After uploading, verify your llms.txt is accessible:

Test with curlbash

curl https://yourdomain.com/llms.txt

You can also use our dashboard to verify the file is correctly placed and contains valid content.

Generate llms.txt Project Management