雲原生2.0加速：分佈式雲探尋全面雲化的通路

{"type":"doc","content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"企業數字化轉型成爲勢不可擋的浪潮，尤其後疫情時代，各行各業都在積極數字化轉型，謀求新的市場環境下的生存空間。據Gartner預測，2021年中國IT支出將達到3.09萬億，相比2020年增長7.7%。市場需求的不斷升級，促使雲基礎設施服務市場快速響應。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":" "}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"經歷以“設備”爲中心的服務器階段，以“資源”爲中心的雲化階段，企業數字化轉型進程如今來到以“應用”爲中心的雲原生化階段。降低人力依賴度，提高資源運維效率，降低部署繁雜度，提高應用便捷度，以及更加智能和安全可信，成爲“雲原生2.0”區別於此前的主要優勢。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":" "}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"在4月8日的華爲雲TechWave全球技術峯會上，華爲雲對去年提出的“雲原生2.0”進行進一步解讀：全面雲化和全棧智能是實現企業數字化治理的基石。換句話說，遷移平滑、運維穩定、開發便捷則是企業數字化轉型的底色，分佈式雲x雲原生在當下普遍被認爲是企業實現數字化治理的有效通路。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":" "}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"5月31日，華爲雲線上舉辦TechWave雲基礎設施專題日，基於雲基礎設施新範式進一步解讀分佈式雲、雲原生基礎設施產品及背後黑科技，首次亮相分佈式雲操作系統瑤光。"}]},{"type":"heading","attrs":{"align":null,"level":1},"content":[{"type":"text","text":"“一朵雲”的關鍵特點"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":" "}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"華爲雲分佈式雲具備四個關鍵特點：一張分佈式網絡滿足便捷安全接入，一致運行環境構建無差別體驗，一套管理體系應對精細化企業治理，一朵分佈式雲實現全場景覆蓋。"}]},{"type":"image","attrs":{"src":"https:\/\/static001.infoq.cn\/resource\/image\/f3\/b4\/f3ff09336e086ab73a406fcc4b2c00b4.png","alt":null,"title":"","style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":"","fromPaste":false,"pastePass":false}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"具體而言，一張分佈式網絡，指的是實現企業IDC到公有云環境的便捷和安全接入，構建企業多種組網環境之間的高效互通；通過VPC雲邊內網互通，中心雲服務與企業機房本地應用實現無縫互訪，且可分鐘級按需發放到邊緣。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":" "}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"在華爲雲分佈式雲產品經理鄭梁看來，這意味着物理分佈，邏輯歸一的分佈式IT架構，典型場景如中心訓練、邊緣推理；本地數據脫敏後，還可以將數據回傳中心數據湖，持續增加訓練樣本迭代優化。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":" "}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"這種分佈式IT架構的實現，依託於華爲雲擎天架構，提供一致的運行環境。部署的便捷和運行的按需彈性服務，是分佈式雲給予的保證。在企業日常運營中，本地部署可以滿足數據低延遲的訴求，一旦出現流量洪峯，本地數據庫和中心Region協同工作，緩解流量壓力。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":" "}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"由於企業所處行業、組織架構不同，滿足統一資源統籌和業務管理的訴求往往不易實現。華爲雲基於自身實踐和對政企客戶的深入瞭解，推出基於分佈式雲的管理體系，通過EPS和IAM的能力，構建一張整體管理視圖，在人、物、財三方面實現精細化權限管理，匹配企業多層級、多部門的組織模型和管理訴求；通過RMS和CES能力，對整個分佈式雲統一資源管理和運維監控，進行精細化治理。 "}]},{"type":"image","attrs":{"src":"https:\/\/static001.infoq.cn\/resource\/image\/d6\/af\/d62cbf6f1dc8b395f6ccb92b694725af.png","alt":null,"title":"","style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":"","fromPaste":false,"pastePass":false}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"在不同業務場景的部署上，這朵分佈式雲有多種表現形式：中心Region、智能邊緣雲IEC、智能邊緣小站IES、智能邊緣平臺IEF和專屬Region。如果按照網絡的概念來類比，中心雲類似骨幹網的核心節點，智能邊緣雲類似於城域網節點，各類企業的現場邊緣類似於接入網。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":" "}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"其中，中心Region，服務豐富，滿足集約效應和規模彈性；智能邊緣雲IEC提供小於10ms網絡接入時延，實現熱點區域的廣覆蓋和多線接入能力，滿足就近接入及穩定低時延訴求，據鄭梁介紹，IEC幫助國內某頭部直播平臺實現轉碼質量提高20%，帶寬成本節省50%以上。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":" "}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"區別於前者，智能邊緣小站IES，把雲服務延伸到企業數據中心，滿足數據本地化和極低時延的要求，目前具備4節點起步的能力，可無縫拓展至16櫃，支持10+雲服務，提供小於5ms的本地時延，能實現整櫃到貨、4周內快速交付。中圖雲創通過本地部署智能邊緣小站IES，在落地“全景新閱讀”的沉浸式體驗時，爲VR設備提供端到端<30ms穩定低時延，節省30%的帶寬成本。智能邊緣雲IEC和邊緣小站IES的運維皆由華爲雲來負責。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":" "}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"智能邊緣平臺IEF更輕量化，向上支撐應用，向下封裝資源，目前支持包括電力、交通等行業在內的200+智能應用。在已經落地的全國高速取消省界項目中，實現了7.4萬邊緣節點，48萬邊緣應用“一張網”管理，比傳統方式提效10倍，使車輛省界通行時間從15s降低到2s。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":" "}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"專屬Region主要面向大型政企治理訴求，提供全棧數字化轉型底座。已經可以看到的實例是，中國一汽部署專屬Region後，整體運維效率提升40%，通過使用全棧雲服務，滿足了企業辦公、數字化營銷、車聯網、智慧出行等業務部署的要求。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":" "}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"這些服務的實現，底層紮根於華爲雲擎天架構，頂層則依靠華爲雲瑤光分佈式雲操作系統的統一調度、管理和分發。"}]},{"type":"heading","attrs":{"align":null,"level":1},"content":[{"type":"text","text":"華爲雲的“智慧雲腦”——瑤光分佈式雲操作系統"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":" "}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"瑤光是華爲雲在2019年底發佈的國內首個分佈式雲操作系統，相當於華爲雲的“智慧雲腦”。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":" "}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"在整體設計上，華爲雲瑤光的關鍵架構包含多個層次：頂層是智能資源經營系統，二層是多目標優化系統，三層是全域調度系統，四層是對分式雲站點管理，最小單元則是對多元硬件的管理，已經率先實現對x86、鯤鵬、昇騰等多樣性算力的兼容。這五層系統，基於端到端的仿真平臺，進行算法的訓練仿真與迭代，實現分佈式雲操作系統的自學習和自調優。"}]},{"type":"image","attrs":{"src":"https:\/\/static001.infoq.cn\/resource\/image\/47\/50\/47ddc6722cc8883536404f96a547e950.png","alt":null,"title":"","style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":"","fromPaste":false,"pastePass":false}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"瑤光的存在，目標實現全域資源供給極優，多樣性算力使用極簡。其中一大的難點在於，公有云租戶對於雲廠商們而言，動態變化的陌生租戶業務類似一個黑盒，難以進行有效畫像和預測。針對這個問題，瑤光構建了端到端的資源控制系統。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":" "}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"其通過採集CPU微架構、利用率、操作系統內核等指標建立QoS量化模型，實時監測每個實例QoS干擾水平，然後通過將“對抗學習”和“知識遷移”相結合。其中，華爲雲自研的特徵識別CDA-WGAN 算法能將業務特徵識別準確度提升 10%以上，瑤光使用的自研METRO多維時序預測算法，與常用的開源算法相比能提升40%的準確，降低70%的誤差。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":" "}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"此外，爲了真正實現“一朵雲”的全域調度並保障確定性SLA，華爲雲開發了調度算法DQA。DQA 通過對網絡服務質量、計算資源成本、雲站點資源均衡度分別建模，並在收益函數中進行統一計算，幫助業務時延降低40%，同時成本優化達到33%。 同時，爲了匹配動態業務訴求，華爲雲瑤光建立了包含機型設計、容量規劃、資源分配等全鏈路仿真平臺，爲了匹配動態業務訴求，華爲雲瑤光建立了包含機型設計、容量規劃、資源分配等全鏈路仿真平臺。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":" "}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"華爲雲瑤光將“複雜”留給自身，將“簡單”交給客戶。"}]},{"type":"heading","attrs":{"align":null,"level":1},"content":[{"type":"text","text":"“簡單”背後的黑科技，容器技術再革新 "}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"長期以來，雲原生落地的兩大攔路虎是技術的和管理的複雜性，到目前爲止的相關實踐都是對這兩大難題的不斷解碼。容器技術作爲近兩年的熱門，是雲原生基礎設施的核心。爲了實現計算、網絡、調度上的全面進階，華爲雲研發了容器集羣CCE Turbo，並在今年爲其裝配容器卸載技術。 "}]},{"type":"image","attrs":{"src":"https:\/\/static001.infoq.cn\/resource\/image\/03\/ae\/03915f942070b6ba87457d24fbdaffae.png","alt":null,"title":"","style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":"","fromPaste":false,"pastePass":false}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"目前，華爲雲主要在3方面對容器引擎進行了優化，集羣整體性能提升了40%：瘦身容器引擎，剔除冗餘部件，優化內部執行邏輯；大量優化Kubernets中的Pod，如基於rust語言重寫shimv2和agent，減少進程數量；大量優化容器引擎代碼減少內存消耗，提升容器的啓動性能和Cgroup管理能力。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":" "}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"在網絡加速方面，CCE Turbo實現了容器到VPC的直接連通，彈性網卡Trunkport能力，並在此基礎上對容器級的網絡安全組的安全和效率進一步提升，新增安全組相關的Kubernetes CRD對象，簡化容器安全訪問規則配置。此外，華爲雲通過實現離線和在線業務的混合部署，及調度能力升級，提升集羣資源利用率。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":" "}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"值得一提的是，在調度方面，CCE Turbo實現了面向應用的智能化調度，通過IO Aware等調度算法優化、隊列優化、Alloc_set等策略，提升大數據和AI作業調度效率，將AI、大數據類任務計算時間縮短30%~40%。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":" "}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"此外，華爲雲此前聯合合作伙伴共同發佈雲原生服務中心OSC，建立雲原生服務生命週期治理規範並對接華爲雲應用市場。據悉，OSC規範下的雲原生應用，可以發佈到所有支持Operator、HELM標準的倉庫中，同時，OSC還自動對接華爲雲容器引擎、多雲容器平臺、監控、告警等服務，實現應用跨公有云、專屬雲全球化無差異部署。目前，已經有130+數據庫、中間件及行業應用基於OSC適配。 "}]},{"type":"heading","attrs":{"align":null,"level":1},"content":[{"type":"text","text":"基礎能力全面升級，推新場景化解決方案"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"基於擎天架構，華爲雲基礎能力迎來全面升級，在計算層面，發佈全新的通用計算增強型雲服務器C7；在存儲層面，對SFS Turbo、Data+都進行了升級；在網絡層面，發佈獨享型ELB和CLOUD WAN解決方案。其中，C7在視頻轉碼、圖像渲染等場景性能提升了30%，在MySQL等數據庫場景性能上提升了50%，在Nginx等網絡服務器場景性能上提升了60%。"}]},{"type":"image","attrs":{"src":"https:\/\/static001.infoq.cn\/resource\/image\/8b\/39\/8beb899b3f7eb79b52c7c3f6c1ce0639.png","alt":null,"title":"","style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":"","fromPaste":false,"pastePass":false}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"此外，華爲雲還推出兩款全新場景化解決方案：異構計算三維建模聯合解決方案和4K影視雲製作解決方案。其中，異構計算三維建模聯合解決方案由華爲雲和瞰景科技聯合打造，建模性能提升30%，單次測量即可達到精度要求；4K影視雲製作解決方案可以幫助節目製作的端到端效率提升30%，成本大幅降低，將大幅加速4K節目的普及。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":" "}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"幫助企業實現全面雲化、擁有全棧智能的能力充滿挑戰，也是當下所有云服務商共同面臨的長期課題。不侷限交付位置，能夠將公有云服務分發到業務所需位置，通過對不同節點統一管理，滿足低延遲、本地化、多種混合場景的用戶需求，分佈式雲x雲原生的優越性已經顯而易見。可以預見，分佈式雲x雲原生的進展將在未來幾年決定雲的走向。"}]}]}