Restructure and extra stuff
This commit is contained in:
parent
b0fc3a05c5
commit
a77312c17c
36 changed files with 250 additions and 68 deletions
public
8
public/robots.txt
Normal file
8
public/robots.txt
Normal file
|
@ -0,0 +1,8 @@
|
|||
User-agent: *
|
||||
Disallow: /assets/data/
|
||||
|
||||
User-agent: GPTBot
|
||||
User-agent: Bytespider
|
||||
Disallow: /
|
||||
|
||||
Sitemap: https://firq.dev/sitemap-index.xml
|
Loading…
Add table
Add a link
Reference in a new issue