11天裏13個Apache開源項目宣佈退休，Hadoop的時代結束了

{"type":"doc","content":[{"type":"blockquote","content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"在11天之內，Apache宣佈退役了13個與大數據相關的Apache項目，其中包括Sentry、Tajo和Falcon。看起來Hadoop和大數據的黃金年代已經正式結束。"}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"曾幾何時，Apache Hadoop是大數據的代表，但今天誰都知道它已經過時了。而自4月1日起，Apache軟件基金會（ASF）宣佈將至少19個開源項目撤回到他們的“Attic”，其中13個與大數據相關，10個屬於Hadoop生態系統。"}]},{"type":"heading","attrs":{"align":null,"level":2},"content":[{"type":"text","text":"光榮榜"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"單個項目的退役公告可能不算什麼，但它們加在一起足以成爲一個分水嶺。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"爲了幫助從業者和行業觀察者充分認識到這次大數據開源項目洗牌的深刻影響，我們應該好好整理一下。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"與大數據相關的Apache退役項目包括："}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"bulletedlist","content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"Apex：基於HadoopYARN的統一大數據流和批處理平臺"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"Chukwa：基於Hadoop分佈式文件系統（HDFS）構建的，用於監視大型分佈式系統的數據收集系統"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"Crunch，提供了用於編寫、測試和運行MapReduce（包括HadoopMapReduce）管道的框架"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"Eagle：一種分析解決方案，可在包括Hadoop在內的大數據平臺上迅速識別安全和性能問題"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"Falcon：針對Hadoop的數據處理和管理解決方案，設計用於數據移動、數據管道協調、生命週期管理和數據發現"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"Hama：一種用於大數據分析的框架，運行在Hadoop上，並且基於BulkSynchronousParallel範式"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"Lens，提供了統一的分析界面，將Hadoop與傳統數據倉庫深度集成在一起"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"Marmotta：鏈接數據的開放平臺"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"Metron：專注於實時大數據安全性"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"PredictionIO：一種用於管理和部署生產就緒的預測服務的機器學習服務器"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"Sentry：一種用於對ApacheHadoop中的數據和元數據執行細粒度授權的系統"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"Tajo：Hadoop上的大數據倉庫系統"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"Twill，它使用HadoopYARN的分佈式功能和類似的編程模型來運行線程"}]}]}]},{"type":"heading","attrs":{"align":null,"level":2},"content":[{"type":"text","text":"房間裏的“大象”"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"上面這個列表很長，而完整的列表還包括一些非大數據項目。顯然，ASF正在做一些內部清掃工作。此外，由於Cloudera-Hortonworks的合併，與Ranger和Spot項目競爭的Sentry和Metron也被棄用。之前兩家公司總共支持四個項目，現在只保留兩個就夠了。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"這次合併的背景是大數據市場的整合趨勢。而且可以說，這場大數據整合潮流也是上面這些項目“退役”的根本原因。至少可以說，在不到兩週的時間內宣佈所有這些項目“退役”的確是一件大事。"}]},{"type":"heading","attrs":{"align":null,"level":2},"content":[{"type":"text","text":"官方評論"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"我向ASF詢問了他們清理大數據項目的解釋。ASF市場營銷與宣傳副總裁Sally Khudairi通過電子郵件回覆說：“Apache項目活動在生命週期中往往會起伏不定，這取決於社區的參與。”Khudairi補充說：“我們……從項目管理委員會（PMC）到董事會內部，對多個Apache項目的活動進行了審查和評估，並投票決定將這些項目退回到Attic。”Khudairi還說，ASF的Apache Attic副總裁Hervé Boutemy“最近非常高效地完成了“春季大掃除”，妥善處理了在過去幾個月中準備退役的十幾個項目。”"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"儘管ASF斷言這次大數據清理工作只是其他常規項目退役的一部分，但很明顯，大數據領域的情況已經發生了變化。Hadoop在開源分析技術的主導地位已讓給Spark，Hortonworks和老牌的Cloudera之間的相似項目無意義競爭也結束了，這些項目完成了達爾文自然選擇過程。"}]},{"type":"heading","attrs":{"align":null,"level":2},"content":[{"type":"text","text":"小心一點吧"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"很明顯，在大數據世界中，大量投資於Apache Sentry的供應商和客戶現在需要整理他們的損失並繼續前進。殘酷的現實帶來的教訓幾乎適用於所有技術炒作週期：社區開始興奮起來，開源技術激增，生態系統逐漸完善。但這些生態系統並不會永存，幾乎任何新平臺（無論是商業平臺還是開源平臺）都存在固有的風險。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"用ASF的Khudairi的話來說：“每個項目背後的社區纔是代碼生命力的源泉（'代碼不會自動編寫出來'），因此社區改變項目步伐的情況並不少見。”換句話說，尖端技術令人興奮，但早期採用者要小心：它也是很脆弱的。請多加註意，並妥善管理風險。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong"}],"text":"原文鏈接："}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"link","attrs":{"href":"https:\/\/www.zdnet.com\/article\/apache-software-foundation-retires-slew-of-hadoop-related-projects\/?fileGuid=RtTCVhcpvRcRdC9c","title":"","type":null},"content":[{"type":"text","text":"https:\/\/www.zdnet.com\/article\/apache-software-foundation-retires-slew-of-hadoop-related-projects\/"}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}}]}