Edge Rewrite
// HTMLRewriter · presentation

This page was redesigned at the edge.

Cloudflare fetched the original article and streamed it through HTMLRewriter to apply an entirely new visual system without rebuilding the source page.

// request.cf · coarse context

A page that knows where it met you.

Only coarse request metadata is shown. This demo does not display or persist visitor IP addresses.

Country
US
Cloudflare location
CMH
Connection
HTTP/2
Language
Not provided

Ray ID: a22034553c34c424

Jump to content

// Workers AI · dad joke modeWhat did Bingbot say to its date? You're a search above the rest.

From Wikipedia, the free encyclopedia
Bingbot
Original authorMicrosoft
TypeWeb crawler
WebsiteBingbot FAQ

Bingbot is a web-crawling robot (type of internet bot), deployed by Microsoft October 2010 to supply Bing.[1] It collects documents from the web to build a searchable index for the Bing search engine. It performs the same as Google's Googlebot.[2]

Behavior

[edit]

A typical user agent string for Bingbot is "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)". This appears in the web server logs to tell the webmaster who is requesting a file. Each webmaster is able to use the included agent identifier, "bingbot", to disallow or allow access to their site (by default access is allowed).[3] If they don't want to grant access, they can use robots.txt to block it (relying on the assumed good behaviour of bingbot), or use other server specific means (relying on the web server to do the blocking).[4]

References

[edit]
  1. "BingBot Crawl Activity Surging?". 28 January 2013. Retrieved 2016-07-16.
  2. Shenoy, Aravind; Prabhu, Anirudh (2016-07-26). Introducing SEO: Your quick-start guide to effective SEO practices. Apress. ISBN 978-1-4842-1854-9.
  3. Team, IntroBooks. Microsoft Bing's Algorithm Explained. IntroBooks.
  4. Siegler, M. G. (2009-07-17). "Ignore That Scary MSNbot, It's Just The Friendly BingBot - Unless It Attacks!". TechCrunch. Retrieved 2023-10-22.
[edit]