The robots.txt file is a text file stored in the root of the domain that defines which parts of a domain can and cannot be crawled by a crawler.
確定！ 回上一頁
