Differences
This shows you the differences between two versions of the page.
| Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
| learn:bigdata:hdfs [2014/08/07 16:30] – [HDFS (HaDoop File System)] yehuda | learn:bigdata:hdfs [2022/01/03 16:03] (current) – external edit 127.0.0.1 | ||
|---|---|---|---|
| Line 4: | Line 4: | ||
| * HDFS has [[wp> | * HDFS has [[wp> | ||
| * HDFS Master / Slaves architecture | * HDFS Master / Slaves architecture | ||
| + | |||
| + | ===== HDFS Features ===== | ||
| + | * Rack awarness - What happends if entire rack is lost ? | ||
| + | * Reliable storage | ||
| + | * High throughput | ||
| ===== Tools ===== | ===== Tools ===== | ||
| * [[dfsadmin]] | * [[dfsadmin]] | ||
| Line 10: | Line 15: | ||
| ===== Nodes ===== | ===== Nodes ===== | ||
| - | | + | ==== Data world ==== |
| - | * [[Secundery | + | |
| - | * [[Data node]] | + | * [[Secondary |
| - | * [[Job tracker]] | + | * [[Data node]] - Block Ops, Replications |
| + | ==== MapReduce world ==== | ||
| + | See: [[MapReduce]] | ||
| + | * Master: | ||
| + | * [[Task | ||