fgo-ta-com-website/static/robots.txt

user-agent:*
Disallow: /assets/data/

User-agent: GPTBot
Disallow: /

Sitemap: https://fgo-ta.com/sitemap-index.xml
Major rewrite for 0.1.6 - Dynamic database entry generation based on json files, dynamic run page generation and more 2024-01-02 22:19:14 +00:00			`user-agent:*`
			`Disallow: /assets/data/`

			`User-agent: GPTBot`
			`Disallow: /`

Added a ton of TAs, fixed sitemap, made sorting more intelligent 2024-01-05 19:03:23 +00:00			`Sitemap: https://fgo-ta.com/sitemap-index.xml`