14 lines
229 B
Plaintext
14 lines
229 B
Plaintext
User-Agent: *
|
|
Allow: /
|
|
Disallow: /api/
|
|
Disallow: /health/
|
|
|
|
User-Agent: GPTBot
|
|
User-Agent: ClaudeBot
|
|
User-Agent: PerplexityBot
|
|
User-Agent: Google-Extended
|
|
User-Agent: OAI-SearchBot
|
|
Allow: /
|
|
|
|
Sitemap: https://e-tib.com/sitemap.xml
|