Craigslist reportedly asks search engines to stop indexing its posts
Alleged action follows a lawsuit filed by the online bulletin board to prevent data harvester 3taps and apartment listings aggregator PadMapper from exporting its listings.
Craigslist is allegedly ramping up its efforts to keep PadMapper from displaying the online bulletin board's listings.
Craigslist has reportedly asked general search engines to stop indexing its postings, effectively cutting off data harvester 3taps and those who use its API, including the popular apartment listings aggregator. The request was made Monday, according to 3taps' Twitter feed.
"We are sorry CL has chosen this course of action and are exploring options to restore service," 3taps said in a tweet today. "We may be down for an extended period."
CNET has contacted Craigslist for comment and will update this report when we learn more.
However, a quick glance at Google reveals that Craigslist listings are still appearing on the popular search engine. Also, a review of Craigslist's robots.txt file -- a simple code that sites use to prevent bots from indexing their pages -- reveals that it's apparently unchanged from last year, long before this brouhaha kicked up.
The popular portal's terms of service prohibit "copying, aggregation, display, distribution, performance, or derivative use of Craigslist or any content posted on Craigslist."
That development ledlate last month, accusing the pair of "unlawfully and unabashedly mass-harvesting and redistributing postings entrusted by Craigslist users to their local Craigslist sites," according to the complaint. "This exploitation of Craigslist content undermines the integrity of local Craigslist communities, ultimately harming both Craigslist and its users."