Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
learn:bigdata:name_node [2014/08/07 17:10] – [Contains] yehudalearn:bigdata:name_node [2022/01/03 16:03] (current) – external edit 127.0.0.1
Line 1: Line 1:
 ====== Name node ====== ====== Name node ======
 +see also [[Secondary name node]]
   * :!: MOST IMPORATANT FOR CLUSTER!    * :!: MOST IMPORATANT FOR CLUSTER! 
   * in-memory location of every [[Data block]] in cluster / rack   * in-memory location of every [[Data block]] in cluster / rack
Line 5: Line 6:
   * FS Ops    * FS Ops 
   * Block Mapping   * Block Mapping
 +  * Send cordinates to clients where to get the [[Data blocks]] and witch [[Data node]]
 +  * [[Name node]] retrives every __3 secounds__ heart-bit from [[Data node]]
 +  * If [[Name node]] not retrives from the [[Data node]] heart-bit more then __10 minutes__ [[Name node]] will consedure the [[Data node]] as a [[Dead node]] and the [[Name node]] start to replicate all [[Data blocks]] that has on a [[Dead node]] to other nodes  
  
 ===== Requriements ===== ===== Requriements =====
   * Should have LOT OF RAM, LOT OF MEM, LOT OF POWER   * Should have LOT OF RAM, LOT OF MEM, LOT OF POWER
  
-===== Contains ===== +===== Structure ===== 
-  * Map - Snapshot of entire file system (in Memory) +  * RAM 
-    * Tracks all the files +    * [[Edit log]] 
-    * Tracks Replication value - can be configured by [[Replication factor]] +    * [[fsImage]]  
-  * Edit log - (aka Journal) Track any client changes of information +  * FILE 
-  When proccess of Reboot or [[Checkpoint]] the Map marges with Edit log to [[fsImage]]+    * [[fsImage]] 
  
-To keep presistnece of the data on hard drive the [[Edit log]] marges with Map+When proccess of Reboot or [[Checkpoint]] the [[fsImage|RAM\fsImage]] marges with [[Edit log]] to [[fsImage|FILE\fsImage]] file that makes it to keep presistnece.
learn/bigdata/name_node.1407431407.txt.gz · Last modified: (external edit)
Back to top
Driven by DokuWiki Recent changes RSS feed Valid CSS Valid XHTML 1.0