Federated HDFS

A session at Hadoop Users Group: An Evening with Hadoop

  • Sanjay Radia

Scalability of the NameNode has been a key struggle. Because the NameNode keeps all the namespace and block locations in memory, the size of the NameNode heap limits the number of files and also the number of blocks addressable. This also limits the total cluster storage that can be supported by the NameNode.

Federated HDFS allows multiple independent namespaces (and NameNodes) to share the physical storage within a cluster. This is enabled by the introduction of the notion of Block pools which is analogous to LUNs in a SAN storage system.

About the speaker

This person is speaking at this event.
Sanjay Radia

Coverage of this session

Sign in to add slides, notes or videos to this session

Tell your friends!

Short URL

lanyrd.com/sddpc

Official event site

hadoopmarch2011.eventbrite.com

View the schedule

Share

See something wrong?

Report an issue with this session