mirror of
https://github.com/blackboxprogramming/epstein-files-transparency.git
synced 2026-03-17 05:57:16 -05:00
Add robots.txt for search engine crawling
This commit is contained in:
4
robots.txt
Normal file
4
robots.txt
Normal file
@@ -0,0 +1,4 @@
|
|||||||
|
User-agent: *
|
||||||
|
Allow: /
|
||||||
|
|
||||||
|
Sitemap: https://blackboxprogramming.github.io/sitemap.xml
|
||||||
Reference in New Issue
Block a user