你即將離開本站

並前往https://webmasters.stackexchange.com/questions/113178/facebook-crawler-with-no-user-agent-spamming-our-site-in-possible-dos-attack

Facebook crawler with no user agent spamming our site in ...

Sources say that Facebook/Externalhit does not respect crawl-delay in robots.txt because Facebook doesn't use a crawler, it uses a scraper.

確定！ 回上一頁

查詢 「Facebook user agent」的人也找了：

  1. Facebook user agent
    2.
  2. Client user agent Facebook
    3.
  3. Facebook crawler
    4.
  4. Facebook crawler 2020
    5.
  5. Facebook in app browser user agent
    6.
  6. Facebook scraper
    7.
  7. User-agent parser
    8.
  8. Facebook crawler Python
    9.