Yahoo moving to new Web-crawler software

Slurp 3.0, a new generation of the Internet company's indexing software, aims to scour the World Wide Web's content.

Yahoo has begun indexing the World Wide Web with its third-generation software, Slurp 3.0, the company said Monday.

"With everything now in place, the rollout has officially begun," Sharad Verma and Yoram Arnon said in a posting to Yahoo's search blog on Monday.

Unlike top search rival Google, which on Friday revealed its indexing software now is trying to uncover previously hidden pages by filling in Web pages' forms , Yahoo didn't detail what's new with its indexing software.

The company did advise those who watch for indexing software (sometimes called bots, crawlers, and spiders) as it visits their site to update their methodology from the Slurp 2.0 days.

Update 4:35 p.m.: Yahoo officially declined to comment further. I'm all ears if people notice differences in how their Web pages show up in search rankings.

About the author

Stephen Shankland has been a reporter at CNET since 1998 and covers browsers, Web development, digital photography and new technology. In the past he has been CNET's beat reporter for Google, Yahoo, Linux, open-source software, servers and supercomputers. He has a soft spot in his heart for standards groups and I/O interfaces.


Discuss Yahoo moving to new Web-crawler software

Conversation powered by Livefyre

Show Comments Hide Comments
Latest Articles from CNET
Galaxy S6 fails to bring back Samsung's mojo