Talk:Web crawler

Computing Mid‑importance

	This article is within the scope of WikiProject Computing, a collaborative effort to improve the coverage of computers, computing, and information technology on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.ComputingWikipedia:WikiProject ComputingTemplate:WikiProject ComputingComputing
Mid	This article has been rated as Mid-importance on the project's importance scale.

Internet High‑importance

	Internet portal This article is within the scope of WikiProject Internet, a collaborative effort to improve the coverage of the Internet on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.InternetWikipedia:WikiProject InternetTemplate:WikiProject InternetInternet
High	This article has been rated as High-importance on the project's importance scale.

This article is prone to spam. Please monitor the References and External links sections.

Archives (index)

Index 1

This page has archives. Topics inactive for 730 days are automatically archived 1 or more at a time by if there are more than 4.

Phrasing

Latest comment: 2 years ago2 comments2 people in discussion

I would like to bring attention to this paragraph on the article:

"The number of Internet pages is extremely large; even the largest crawlers fall short of making a complete index. For this reason, search engines struggled to give relevant search results in the early years of the World Wide Web, before 2000. Today, relevant results are given almost instantly."

I wanted to get other people's insight on how to rephrase this. Akdulj (talk) 20:29, 5 February 2023 (UTC)Reply

sher alam 188.54.121.141 (talk) 01:33, 23 December 2023 (UTC)Reply

Low quality citation

Latest comment: 2 years ago1 comment1 person in discussion

First citation ^[1] in this Wikipedia entry is a website with just one article, hosted on Wordpress, with no data about the article's author, dead for about a year at this point. Due to all of those facts, it seems that the cited article is low effort, and low quality. Maciej Błędkowski (talk) 15:55, 20 January 2024 (UTC)Reply

References

↑ "Web Crawlers: Browsing the Web". Archived from the original on 2021-12-06.

[1] "Web Crawlers: Browsing the Web". Archived from the original on 2021-12-06.

[1]

This page was redesigned at the edge.

A page that knows where it met you.

Talk:Web crawler

Phrasing

Low quality citation