rename frontend directory to frontend
This commit is contained in:
parent
71a9b69e04
commit
c7d996dbeb
30 changed files with 1 additions and 1 deletions
4
crawler/frontend/public/robots.txt
Normal file
4
crawler/frontend/public/robots.txt
Normal file
|
|
@ -0,0 +1,4 @@
|
|||
# Block ALL bots from ALL pages
|
||||
User-agent: *
|
||||
Disallow: /
|
||||
|
||||
Loading…
Add table
Add a link
Reference in a new issue