Your current filters are…
At 80legs, we've built a unified, structured and queryable database of the entire Internet. In this talk, we'll discuss how we built this ambitious and absurd platform.
We'll provide insight into how we evaluated cutting-edge big data tools (Hbase, Cassandra and so on) for our specific use-case and implemented some of our own proprietary systems (grid computing architecture, funky file systems and more).
We'll also discuss lessons learned along the way and provide some thoughts on tackling large computing problems like ours.