# Guides for AI-ready documentation

import { LinkCard, CardGrid, Aside } from '@astrojs/starlight/components';

AI assistants, answer engines, and training crawlers now read documentation alongside human readers. These guides help you understand that traffic and prepare your content for it. They are vendor-neutral best practices: you can apply them to any documentation site, whether or not you use EkLine.

<Aside type="note">
These guides cover open standards and industry practices, not EkLine product features. Where EkLine helps with a task, the guide links to the relevant tool.
</Aside>

## Monitor AI traffic

Understand which AI bots read your documentation, how to identify them in your logs, and how to measure their activity.

<CardGrid>
  <LinkCard
    title="Understand AI traffic to your docs"
    description="What AI bots and crawlers are, the three categories that matter, and why they affect documentation teams."
    href="/guides/ai-traffic/understanding/"
  />
  <LinkCard
    title="Identify AI bots and crawlers"
    description="A reference of common user-agent tokens by operator, with verification methods."
    href="/guides/ai-traffic/identify-bots/"
  />
  <LinkCard
    title="Monitor AI traffic to your docs"
    description="Measure AI crawler and referral traffic using server logs, CDN analytics, and web analytics."
    href="/guides/ai-traffic/monitor/"
  />
</CardGrid>

## Make your docs AI-ready

Configure your documentation site so AI tools can fetch, read, and use your content — and decide which AI systems may access it.

<CardGrid>
  <LinkCard
    title="Serve a Markdown version of every page"
    description="Give each page a clean Markdown version through per-page files, content negotiation, and an HTML discovery tag."
    href="/guides/serve-markdown/"
  />
  <LinkCard
    title="What is llms.txt?"
    description="The proposed standard, its format, and how it differs from robots.txt and sitemap.xml."
    href="/guides/llms-txt/what-is-llms-txt/"
  />
  <LinkCard
    title="Add an llms.txt file to your docs"
    description="Create, place, and maintain an llms.txt file, with platform-specific options."
    href="/guides/llms-txt/add-llms-txt/"
  />
  <LinkCard
    title="Control AI crawler access"
    description="Use robots.txt to block training crawlers while allowing AI search and on-demand fetchers."
    href="/guides/control-ai-access/"
  />
</CardGrid>