Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
learn:bigdata:hdfs [2014/08/07 16:38] – [MapReduce world] yehudalearn:bigdata:hdfs [2022/01/03 16:03] (current) – external edit 127.0.0.1
Line 4: Line 4:
   * HDFS has [[wp>Fault tolerance]] - [[HDFS]] replicate same [[Data block]] on X [[Data node|Data nodes]]. X is  [[Replication factor]]   * HDFS has [[wp>Fault tolerance]] - [[HDFS]] replicate same [[Data block]] on X [[Data node|Data nodes]]. X is  [[Replication factor]]
   * HDFS Master / Slaves architecture   * HDFS Master / Slaves architecture
 +
 +===== HDFS Features =====
 +  * Rack awarness - What happends if entire rack is lost ?
 +  * Reliable storage
 +  * High throughput
 ===== Tools ===== ===== Tools =====
   * [[dfsadmin]]   * [[dfsadmin]]
Line 15: Line 20:
   * [[Data node]] - Block Ops, Replications   * [[Data node]] - Block Ops, Replications
 ==== MapReduce world ==== ==== MapReduce world ====
 +See: [[MapReduce]]
   * Master: [[Job tracker]] - controller of [[Task tracker|Task trackers]]   * Master: [[Job tracker]] - controller of [[Task tracker|Task trackers]]
   * [[Task tracker]]    * [[Task tracker]] 
learn/bigdata/hdfs.1407429484.txt.gz · Last modified: (external edit)
Back to top
Driven by DokuWiki Recent changes RSS feed Valid CSS Valid XHTML 1.0