Differences

This shows you the differences between two versions of the page.

--- kb:bigdata [2021/02/10 16:32] – [Other url] yehuda
+++ kb:bigdata [2022/01/03 16:03] (current) – external edit 127.0.0.1
@@ Line 13: / Line 13: @@
   * [[https://www.cloudera.com/documentation/enterprise/5-9-x/topics/admin_hos_tuning.html|Cloudera tune]]
+==== Tools ====
-===== Performance Tools =====
   * [[https://unraveldata.com/|Unravel]]
   * [[https://github.com/linkedin/dr-elephant|Dr. Elephant]]
   * [[https://www.pepperdata.com/| Dr. Elephant Enterprise]]
+===== Ingestion =====
+  * [[https://gobblin.apache.org/|Apache Gobblin]]
+    * [[https://www.youtube.com/watch?v=BQ7aONetKl4|Youtube:Stream and Batch Data Integration at LinkedIn scale using Apache Gobblin]]
+    * [[https://engineering.linkedin.com/blog/2021/data-integration-library|Linkedin blog: data-integration-library]]
+    * [[https://gobblin.readthedocs.io/en/latest/miscellaneous/Exactly-Once-Support/#achieving-exactly-once-delivery-with-commitstepstore|Gobblin Exactly-Once-Support readthedocs.io]]
+    * [[https://www.youtube.com/watch?v=fHFNZlWCpKA|Youtube:Gobblin как ETL-фреймворк / Иван Ахлестин (Rambler&Co)]]
+    * [[https://cwiki.apache.org/confluence/display/GOBBLIN/Gobblin+as+a+Service|Gobblin as a Service]]
+    * [[https://gobblin.apache.org/docs/user-guide/Gobblin-CLI/|user-guide Gobblin-CLI]]
+===== Workflow =====
+  * [[https://azkaban.github.io|Azkaban]]
+===== MDM =====
+  * DataHub: A Generalized Metadata Search & Discovery Tool (ex WhereHows)
+    * [[https://github.com/linkedin/datahub| Linkedin Datahub (ex WhereHows)]]
+    * [[https://engineering.linkedin.com/wherehows | Linkedin wherehows]]
 ===== OLAP & OLTP =====

kb/bigdata.1612974764.txt.gz · Last modified: 2022/01/03 16:03 (external edit)

Back to top