memcached

NorthScale, Zynga team up on NoSQL

The massive amounts of data being created on the Web and the rise of cloud computing together make an ideal environment for alternative database technologies to thrive. And the Web is often proving to be just an entry point for bleeding-edge technology to be tested out before it starts heading into the enterprise.

NoSQL databases and associated operational-data technologies based on nonrelational approaches to data management and manipulation continue to be top of mind for big Web shops and are slowly starting to make their way into enterprise IT infrastructure.

I've spoken with a number of vendors roaming the NoSQL space over the last few months and there seems to be one common thread that they push: traditional relational databases are expensive, bulky, and simply not ideal for this new era of Web technology.

On Wednesday, a new NoSQL database joins the fray: Membase. Launched as an open-source project under the Apache 2.0 license and co-sponsored by NorthScale, Zynga, and NHN (Korea's top online gaming portal), Membase is optimized for storing the data behind interactive Web applications.

Membase says it is 100 percent compatible with Memcached, the de facto standard for distributed object caching behind Web applications. Basically, Membase is as easy to use as Memcached but also stores data.

According to James Phillips, NorthScale co-founder and senior vice president of products, the thousands of organizations that use Memcached (18 of the top 20 most visited Web sites including Twitter, Facebook, and Google) have a demand for a solution that looks like Memcached but acts like a distributed, highly available, high-performance, elastic database technology. … Read more

Cloud-scaling on Amazon with Memcached

One of the headlines that caught my eye today is this blog post from the Amazon Web Services team about a new Memcached as a service offering from Gear6.

For years, Memcached has been used quietly to provide in-memory caching for many popular Web sites, from LiveJournal (for which it was first developed six years ago) to Twitter, Flickr, and Facebook. In the last couple of months, Facebook has opened up about how it scales, and one the key technologies enabling this is Memcached, which services 120 million queries every second. To achieve this, Facebook admits it has had to … Read more

IBM: Three tiers for scale

As transactional data volumes increase, system architecture must stay flexible and be able to scale in accordance.

Back in September, the London Stock Exchange experienced a significant interruption when a proprietary system built on Microsoft technology went offline. Few details were shared, but I eventually cobbled together a rough explanation of what happened.

The stock exchange's system hung due to a "coincidence" (whatever that means) that stopped data from processing. What appears to have happened is several Windows processes, including message processing, crashed at the same time due to a configuration glitch. Because the applications were so directly tied in to Windows, the impact affected everything instead of just one component.

I spoke on the phone with Craig Hayman, vice president of IBM's WebSphere, discussing how open standards and design principles allow for more robust system architecture. Craig explained that the stock exchange incident was likely a result of being too dependent on a myopic structure rather than relying on a three-tier architecture that's been proven to scale.

It feels a bit old-school to talk about three-tier architectures in this day of Ruby apps built in 15 minutes, but the fact is you need separation and best-of-breed components when you are dealing with large transaction volumes and varietal peaks. … Read more

Europeana crash prevention: Cloud and memcached

When I read today that Europeana, a digital library of Europe's cultural heritage "crashed just hours after it went online and will be out of operation for several weeks" I was pretty shocked.

How a website could crash and be offline for weeks in this age of flexible-scale Cloud offerings and caching technology is a bit mind-boggling--especially considering that a properly architected website should be easily portable to larger hardware or a scaled-out system.

There are a great many ways to deal with traffic bursts, from using Amazon S3 for storage, or EC2 for more machines, to … Read more