# llms.txt - Guidelines for LLM/AI crawlers # This file provides instructions to large language models and AI systems about content access policies User-agent: * Allow: /index.html Allow: /Careers.html Disallow: /A Disallow: /aspnet_client Disallow: /Images Disallow: /icons Disallow: /bin Disallow: /junk Disallow: /icon Disallow: /EMStyles Disallow: /cgi-bin Disallow: /TEXT Disallow: /LAYOUT Disallow: /js Disallow: /Classes Disallow: /!!!OLDSITE Disallow: /!!NEWSITE Disallow: /test # Crawl delay for LLM crawlers (in seconds) Crawl-delay: 10