Academia's quest for the ultimate search tool

U.C. Berkeley is developing a major research center focused on improving Internet search technology.

The University of California at Berkeley is creating an interdisciplinary center for advanced search technologies and is in talks with search giants including Google to join the project, CNET has learned.

The project is one of many efforts at U.S. universities designed to address the explosive growth of Internet search and the complex issues that have arisen in the field.

U.C. Berkeley, birthplace of early search highflier Inktomi and the school where Google CEO Eric Schmidt got his computer science doctoral degree, is bringing together roughly 20 faculty members from various departments to cross-pollinate work on search technology, said Robert Wilensky, the center's director. The principal areas of focus: privacy, fraud, multimedia search and personalization.


What's new:
Continuing a long tradition of academic exploration in Net technology, U.C. Berkeley will soon open an interdisciplinary center for developing new search technologies. The school is talking to a number of search companies, including Google, about participating.

Bottom line:
Drawing on the expertise of faculty from various departments, Berkeley's center will focus on privacy, fraud, multimedia and personalization as these topics relate to the increasingly diverse and in-depth information available on the Internet.

More stories on this topic

"We want to solve the problems that have been engendered by the success of search," Wilensky said in an interview. Wilensky is a professor of computer science and information management at Berkeley.

Plans are still being worked out for the center's physical space, but Wilensky said he hopes designs will be completed within the next few months and the center opened early next year. He also said he's talking to Google and other search players about membership.

"If you have 20 researchers interested in search, then getting them together where they are cross-fertilizing ideas, you make something bigger than its parts. You can create a nuclear reaction," he said.

Google declined to comment. (Google representatives have instituted a policy of not talking with CNET reporters until July 2006 in response to privacy issues raised by a previous story.)

The success of the $5 billion-a-year search-advertising business is fueling Internet research and development in many ways. The business has not only bolstered the likes of Yahoo and Google with billion-dollar annual revenues to be spent in new areas but it's also revived hundreds of smaller dot-coms and inspired leagues of upstarts to venture into areas of specialty search.

Looking for the next generation to be born? There's no better place to visit than academia, where today's most successful search companies got their start. "A big source of new ideas comes out of universities," said Geoff Yang, a venture capitalist at Redpoint Ventures, which has backed such companies as AskJeeves and TiVo.

Google and Yahoo were practically hatched in the same dorm room at Stanford University by two pairs of graduate students roughly six years apart. Lycos, a one-time search leader, came out of Carnegie Mellon University. Newer projects include Vivisimo, a clustering search tool from CMU professor Raul Valdes-Perez.

The search problems of today are different from those of five years ago. With books, scholarly papers and television programs being digitized and put online, the technology necessary to search through the material needs to be that much better. People need a way to trust the information they find and to ask more-complex questions with search tools so they can extract knowledge or ideas.

Jaime Carbonell, director of CMU's Language Technologies Institute, said his research team is perfecting a technology for personalized search that would solve some of the privacy concerns surrounding the wide-scale collection of sensitive data, such as names and query histories. CMU's project takes an auxiliary approach to software already being tested by commercial players like Yahoo and Google, which are collecting and storing search histories on their own networks.

CMU developed an add-on application that people download to a PC. It allows users to maintain and modify personal information, such as query history, preferences and favored sites, within a search profile. A search engine would be able to query the profile, along with the user's search term, to deliver a set of tailored results each time, thereby keeping personal information off the network and on the client's desktop.

Carbonell said the technology will be ready within a year, and CMU could either offer it as open-source software or license it to industry players.

CMU is also working under a government grant on a longer-term project called Javelin, focused on question-and-answer search technology. Google, MSN, Ask Jeeves and others already help people find quick answers for word definitions or encyclopedia facts like "What is the

Featured Video