Differences

This shows you the differences between two versions of the page.

--- learn:bigdata:hdfs [2014/08/07 13:59] – yehuda
+++ learn:bigdata:hdfs [2022/01/03 16:03] (current) – external edit 127.0.0.1
@@ Line 3: / Line 3: @@
   * HDFS knows to handle large file (Ex. 1ptb) and split it to [[Data block|Data blocks]] and distrebute it over [[Cluster]].
   * HDFS has [[wp>Fault tolerance]] - [[HDFS]] replicate same [[Data block]] on X [[Data node|Data nodes]]. X is  [[Replication factor]]
+  * HDFS Master / Slaves architecture
+===== HDFS Features =====
+  * Rack awarness - What happends if entire rack is lost ?
+  * Reliable storage
+  * High throughput
+===== Tools =====
+  * [[dfsadmin]]
+  * [[fs shell]]
+  * Web-UIs
 ===== Nodes =====
-  * [[Name node]]
+==== Data world ====
-  * [[Data node]]
+  * [[Name node]] - FS Ops, Block Mapping
+  * [[Secondary name node]] - Checkpoint Ops
+  * [[Data node]] - Block Ops, Replications
+==== MapReduce world ====
+See: [[MapReduce]]
+  * Master: [[Job tracker]] - controller of [[Task tracker|Task trackers]]
+  * [[Task tracker]]

learn/bigdata/hdfs.1407419997.txt.gz · Last modified: 2022/01/03 16:03 (external edit)

Back to top