firq-dev-website/public/robots.txt
Firq a77312c17c
All checks were successful
Linting and checking code / get-version (push) Successful in 2s
Linting and checking code / astro-check (push) Successful in 13s
Build and deploy preview site / check-tag (push) Successful in 2s
Build and deploy preview site / checking (push) Successful in 12s
Build and deploy preview site / build-site (push) Successful in 1m12s
Build and deploy preview site / run-unlighthouse (push) Successful in 0s
Build and deploy preview site / create-release (push) Successful in 6s
Build and deploy preview site / auto-deploy-dockge (push) Successful in 21s
Restructure and extra stuff
2024-10-26 22:41:24 +02:00

8 lines
No EOL
137 B
Text

User-agent: *
Disallow: /assets/data/
User-agent: GPTBot
User-agent: Bytespider
Disallow: /
Sitemap: https://firq.dev/sitemap-index.xml