Copyright © 2024 Farlex, Inc.
| Privacy policy
| Feedback | Dictionary Home
Disclaimer: All content on this website is for informational purposes only. It was submitted by the users and has not been checked for accuracy. This information should not be considered complete, up to date, and is not intended to be used in place of a visit, consultation, or advice of a legal, medical, or any other professional.
ROBOTS-TXT
Definition
robots.txt -- A text (.txt) file used to exclude web robots/spiders from visiting pre-defined folders or files in a web server. The file has to be named robots.txt and has to be placed in the root level of a web site.
Link to this page: