Sessions at MongoNYC 2012 about Scaling on Wednesday 23rd May

Understanding the concerns and goals of running multiple datacenter in a hot-failover or hot-hot-hot configuration can be challenging. Come to this talk to learn the basics while finish up with a much better understanding how to deploy MongoDB across the world. We will work through deploying multi data center for read/write locality, increased availability and improved systems isolation, for disaster preparedness with recovery. In addition we'll look at the MongoDB roadmap and planned enhancements around data center awareness.

Sailthru is a behavioral communication and analytics platform focusing on email, onsite, and mobile personalization. Sailthru stores terabytes of data for hundreds of millions of end users and billions of messages, all in MongoDB. Since we presented last year, we've had 10x growth and experienced lots of challenges scaling on AWS. We've learned lots of lessons about building and designing for MongoDB at scale, and we'll share them.

Build a scalable message logging service and then shard it - Live!

We will extend the IRC server to log the full chat history. This requires a scalable backend to store an infinitely growing volume of messages. We'll look at several ways of designing the message storage and the limitations and tradeoffs of each. We will then deploy our updated IRC server and upgrade from a replica set to a sharded cluster without any downtime.

At foursquare we store almost all our live data within sharded mongodb clusters. We handle thousands of requests per second via our web site and api and each of those may generate several dozen mongo queries. This talk will address the practical details of our configuration, optimizations we've found useful, and the operational techniques we use to keep things running smoothly.