Sunday, April 11, 2021

Wikia Search Launches With Google in Its Sights

Declaring that Internet search is currently broken, Wikipedia co-founder Jimmy Wales is trying to fix it. And he wants your help.

After several months of development and acquisitions to assemble the infrastructure needed to build a viable search engine, Wikia Search service goes live today. Wikia Search is a product of Wikia Inc., a for-profit company wholly separate from the Wikimedia Foundation, the nonprofit organization that was founded in 2004 and oversees Wikipedia.

Following a brief period of private alpha testing, today’s unveiling is billed as a “public alpha release.” Wales has freely admitted that today’s launch is something of a test drive, and that the application will continue to see substantial modifications and updates.

With the community-driven, open-source search engine, Wales is hoping to transform Internet search, which he describes as currently dominated by a few large companies operating under a cloak of secrecy with virtually no accountability for how results are served up or pages are ranked.

“The philosophical background here is that I’m a very big advocate of openness and transparency,” Wales told InternetNews.com. The best parts of the Web are largely absent from the proprietary protocols of the major search engines, he said.

“My view here is that there’s an opportunity to change that.”

Starting from www.wikia.com, users can navigate to an unadorned search page that Wales compared to Google’s for its deceptive spareness — like Google, the Wikia Search launch page is just the tip of the iceberg.

Wales said that Wikia Search is both a social network and a search engine. On the site, users register, create profiles and are able to perform all the typical functions of a social networking site – messaging friends, uploading photos, etc.

The search engine serves up results as a series of links ranked in order of relevance, just as Google and Yahoo do (enter a query; receive a list of results), but the similarities end there.

Applying the collaborative editing approach that is the essence of a wiki, the search results are treated as a mini-article that registered users can edit and comment on, Wales said.

Users can click on the links and rank the relevance of the result to the search term on a scale of one to five; their evaluations are then fed back into the algorithm to improve the quality of information delivered.

Building a search engine from the ground up, with results delivered and refined the using the same approach that made Wikipedia the Web’s favorite general reference site, is not going to be an overnight process, Wales admitted. Just looking at the near future, “we’d be ecstatic if we grabbed 5 percent of the market,” Wales said.

The push toward community-driven search began in earnest in July, when Wikia announced the acquisition of Grub, the open source search project that harnesses the distributed processing power of individuals’ computers to crawl the Web.

The Grub Web crawler is just one of many technologies cobbled together to power Wikia Search, Wales said. On the back end, Apache efforts Lucene and Nutch shoulder the brunt of the search and indexing responsibilities. The front end, which handles the user interactions, such as the comments and rankings, is written in Java.

Wales said that Wikia Inc. is still exploring monetization methods for the search engine, but that, in a general sense, it would employ some form of an advertising model. No commercial partners have been announced.

Delivering search results through open source algorithms that evolve through community rankings begs the same question of user abuse that has dogged Wikipedia from time to time.

Search engine optimization is a microindustry in its own right these days. Asked about the concern that by turning the algorithms and rankings over to the community, Wikia Search could be a ripe target for gaming the search engine to artificially boost site rankings, Wales demurred.

This article was first published on InternetNews.com. To read the full article, click here.

Similar articles

Latest Articles

The Conversational AI Revolution:...

One of the things I’m looking forward to seeing at next week’s NVIDIA GTC event is an update on their Conversational AI efforts. I’m fascinated...

Edge Computing

Edge computing is a broad term that refers to a highly distributed computing framework that moves compute and storage resources closer to the exact...

Data-Driven Decision Making: Top...

The phrase data-driven decision making – certainly popular in the field of data analytics – may seem redundant. After all, nearly everything is driven...

Top Performing Artificial Intelligence...

As artificial intelligence has become a growing force in business, today’s top AI companies are leaders in this emerging technology. Often leveraging cloud computing and...