Document Schema Design and Data Consistency

GameChanger is a giant data pipeline where high throughput on dynamic content is the top priority. We route live sports data in and back out to content generation systems, phones, dynamic web viewers, mobile apps, and email, peaking out at 10s of 1000s of constantly changing data streams. Our play-by-play collection will soon pass 1 billion 1k-sized, sport-variable documents- it's not something you can just query. We've had to re-learn how to lay out data in the document world: you must validate and maintain data differently, change access patterns, and cater to the strengths of the platform.