透過數字化轉型再談數據中臺(二):唯一性定理中的數據中臺

{"type":"doc","content":[{"type":"blockquote","content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"編者按:《透過數字化轉型再談數據中臺》系列連載 6-8 篇左右,作者結合自己在數據中臺領域多年實踐經驗,總結了數據架構知識、BI 知識,以及分享給大家一些產業互聯網實施經驗。本文是系列文章中的第二篇。"}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"中臺論盛行之時,我曾看到過一篇介紹“大數據中臺實踐”的文章,結果用搜索引擎找到了一篇相似度高達百分之九十的多年前的“大數據平臺實踐”文章。這讓人不禁猜測其實這篇“中臺實踐”文章,實際上就是將原來的“平臺”用詞替換爲了“中臺”,之後被再度發佈出來。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https:\/\/static001.infoq.cn\/resource\/image\/2d\/2e\/2d46f3b930c120db089ba894185af22e.png","alt":null,"title":"","style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":"","fromPaste":false,"pastePass":false}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":"center","origin":null},"content":[{"type":"text","text":"圖片來自百度圖文搜索"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"到了去年,中臺倡導者又宣佈將“拆中臺”。從“拆中臺”的提出到現在差不多有大半年有餘,行業對“中臺”的爭議更加明顯,不同視角觀點四起。現在很多企業都有給自己業務命名爲“中臺”,至於說真正的架構、設計、實施按照“中臺”的模式去做還是隻冠了一個名稱卻不得而知, 但是從目前的形勢來看關於“中臺”的討論將會持續很久很久,並且中臺也會在未來的發展中逐步滲透進傳統行業的方方面面。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"在這幾年不同企業的實施、發展,中臺的弊端也在逐漸凸顯。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"比如有業務方給中臺提需求半個月卻得不到回覆,無奈只能自己上線,結果實施之後,中臺來告狀說重複造輪子浪費人力,埋怨這是信不過中臺的表現。一些中小業務線想去做個創新也會遇到來自中臺的各種阻礙,以中小業務線體量小不支持或不優先支持爲由晾到一邊。還有一些中小業務線賴以生存的、有價值的東西都被中臺搶走了,但卻沒有被中臺繼續利用併發揚光大,反而讓這些業務最後不了了之。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https:\/\/static001.infoq.cn\/resource\/image\/80\/db\/80feca8aa922c8cfff0a7614e3f611db.png","alt":null,"title":"","style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":"","fromPaste":false,"pastePass":false}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":"center","origin":null},"content":[{"type":"text","text":"圖片來自電影 風語者"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"以前建立中臺是爲了集中炮火,結果這個炮彈全部落到自己的前臺陣地上了。有些公司允許廝殺,前後臺、中臺與中臺之間不是沉下心來去做職責內工作,而是在搶來搶去。所有新事物的發展必然有兩面性,"},{"type":"text","marks":[{"type":"strong"}],"text":"去蕪存菁汰劣留良,更應該結合企業自己特色來實施"},{"type":"text","text":"。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"heading","attrs":{"align":null,"level":2},"content":[{"type":"text","text":"花式的“數據中臺”"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"中臺的發展需要時間的驗證,而數據中臺的發展也隨之起伏。數據中臺隨着中臺的普及而更加普及,但並沒有遭遇“中臺”的低谷,而是隨着數字化轉型得到了更好的推廣,較之“中臺”,企業普遍更爲接受數據中臺這個概念。 倡導者提出“數據中臺”這個詞,但並沒有其它更多具象化內容及落地實施的指引與幫助,反而這幾年,其它行業企業、同行拋磚引玉在方法論、落地方案上增加了很多解釋性概念、實例化的內容。很多業內人士對數據中臺提出了很多的觀點,解讀很多,但基本都是對數據中臺的廣義與狹義的解讀。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"比如:"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"bulletedlist","content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"“數據湖”是數據中臺的底層或者是數據中臺一定是構建在數據湖之上。"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"數據中臺是解決是共享的問題。"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"數據中臺就是一堆API的集合。"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"數據中臺的能力成熟度模型。"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"數據中臺的核心數據數據資產管理。"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"筆者記憶中還在某網站看到了一篇數據中臺的發展史,嘗試對數據中臺做了一個分類,很多企業或者從業者也開始在外面講數據中臺的構建過程。"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"”數據中臺“與”數據平臺“之間的關係是什麼,也是一直嘗試劃分一個比較明確的邊界。"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"數據中臺的建模方法是採用三範式、還是採用維度模型。"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"數字化轉型數據中臺是核心。"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"主要是One data 的設計方法論。"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"數據中臺的下一站是AI中臺、算法中臺等。"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"數據中臺的組織架構是建設數據中臺的第一步,數據中臺組織一定是獨立的部門,同時要避免與業務脫節,深入業務,要與業務目標綁定。"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"數據中臺就是要解決業務口徑不一致、計算邏輯不一致、數據來源不一致。"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"數據中臺由於數據只能加工一次,強調數據的複用性,這就對數據的質量提出了更高的要求。"}]}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"筆者調研過互聯網企業、傳統行業多家企業,其中部分互聯網中的企業對“數據中臺”這個詞偏負面一點,一些中小型互聯網企業、傳統行業中大型企業對“數據中臺”這個詞還是比較感興趣的。 在 “數據中臺”的實施中,不管是第三方實施或企業自建基本都是在通過自己理解的方法在"},{"type":"text","marks":[{"type":"strong"}],"text":"實施。數據本身具備的天然特性就是一次採集、抽象公共總線並廣泛使用、自身就帶着共享與服務的特點恰恰又踩到了”中臺”詞的複用、服務的特點。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"數據中臺“在從牛市轉爲熊市的過程中,一篇文章《"},{"type":"link","attrs":{"href":"http:\/\/www.infoobs.com\/article\/20201012\/42540.html","title":"xxx","type":null},"content":[{"type":"text","text":"數據中臺唱衰,企業數字化轉型路在何方?(上、下)"}]},{"type":"text","text":"》寫到數據中臺項目失敗誰之過,對其失敗進行了較爲深入細緻的總結,也提到了"},{"type":"text","marks":[{"type":"strong"}],"text":"“不忘初心、方得始終,迴歸數據中臺的本質”"},{"type":"text","text":",那麼問題來了:"},{"type":"text","marks":[{"type":"strong"}],"text":"數據中臺的本質到底是什麼?"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"“數據中臺”真的\"死了\"嗎? 是\"死了\", 死而不僵。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"具體表現在:一些企業停止了大投入、高舉高打的實施行爲,團隊從好幾百人縮減到目前的十幾號人;有的企業只剩下一個名字等待東山再起;還有一小部分企業仍在不聲不響的繼續努力着自身的建設與實施;甚至還有更奇葩的企業自己的數據中臺部門內部還在構建更多小煙筒,比如數據中臺內不同小團隊都在做類似的報表工具、類似的統一數據查詢接口、做類似的各種引擎等等。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"當然也有一些數據中臺不僅沒有“死”而且實施得比較成功,這樣的典型案例包括"},{"type":"text","marks":[{"type":"strong"}],"text":"某服飾K項目、某母嬰M項目"},{"type":"text","text":"。這兩套案例總結實施也非常經典,做到了:管理層的指標監控駕駛艙、KPI監控管理、傳統的BI分析(報表分析、日常運營服務、當前業務鏈路的人貨場以及電商化的分析)、店的人效、電商線上化的營銷、精準、推薦,圍繞上面應用場景的數據規範採集,打通日誌、交易、售後等數據整合等。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"這倆案例數據建設不管是用哪一種實施的方法論來落地,用到的技術、方法論都是2009 ~2013年左右的,其技術體系、架構是可以非常好的滿足需求的。迴歸到本質,這個方向是否有過度包裝、過度營銷的嫌疑,除了本段提到的那些促成“數據中臺”過度包裝的原因外是否還有其它的因素呢?"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"heading","attrs":{"align":null,"level":4},"content":[{"type":"text","text":"“令人失望的原因還有哪些”"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"經歷過一個疫情期,“數據中臺”也像生了一場大病,變得無精打采。是什麼原因導致的呢?作爲一個實施者,在我看來,除了之前各種文章提到的數據中臺實施的一些問題外,還有幾個主要的行業性原因。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"bulletedlist","content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong"}],"text":"“數據中臺”概念是個籃子什麼都往裏裝。"}]}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"在還沒有搞清楚數據中臺是什麼情況下,就開始按照自己的理解瘋狂地往這個籃子塞各種概念,這種填鴨式導致的結果是把”數據中臺“這個詞撐到讓更多人無法消化,尤其知乎、公衆號中有大量的快消類內容文章對“數據中臺”進行各種包裝,不管含義、不管是否適用就直接往數據中臺裏面塞,但實施中就留下甲方乙方都難受至極的結果,或者是像是傳出來的某某數據中臺實施失敗(我總結過一些具體數據中臺實施中問題案例,有機會再小範圍分享)。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"bulletedlist","content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong"}],"text":"實施中遇到共性數據問題。"}]}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"在很多文章、教材裏會提到一些共性問題,比如說融合整個企業的全部數據、打通數據之間的隔閡屏蔽數據孤島問題、數據標準與口徑不一致的地方、統一數據規範的設計規範、解決數據口徑不一致的問題、數據質量老大難的問題、元數據管理的問題、數據提供統一的出口與統一的入口問題。有很多類似的問題,不管是在十五年前、十年前、五年前、今天,數據中臺、數據平臺、數據倉庫面臨的問題基本上是一致的。有沒有想過一個問題呢,十幾年前的企業級數據倉庫實施項目、數據平臺建設項目、今天的數據中臺實施,不管是在哪個階段,很多實施中遇到的問題都是基本一致的。這麼多年下來DAMA也一直在佈道數據治理的方法論與認證等,但是遇到的問題還是一樣的,多年反覆出現而不能解決,雖然無趣,但還是得思考"},{"type":"text","marks":[{"type":"strong"}],"text":"造成這些問題的核心要素是什麼?"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"bulletedlist","content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong"}],"text":"概念發展太快,信息量過載,不知道從何入手。"}]}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"業內有這樣一個現象,近年一些新入行的大數據從業者,看完市面好幾本數據中臺的書以及文章,感覺雖然似懂非懂卻能談得頭頭是道,但在落地時卻表現得無從下手,或因實施中產生滿天飛的各種問題最後被優化。2015年以後從海量數據到大數據的變化特別迅速, 原有數據倉庫、數據平臺使用了10年、20年積累下來各種知識體系,瞬間被互聯網賦予新鮮的名詞,後面的從業者面對這些變化新老內容一起的被動接受吸收、學習理解,卻不容易喫透弄通。大數據這個領域本身專業術語非常多,進入到大數據領域的人會同時面對多個版本名詞、含義、不同解釋,理解起會變得較爲困難,很多專有名詞是需要機制上的理解與多次反覆實踐才能摸索出門道。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"不管在大數據領域工作多久接觸到多少專有詞彙,其核心是原有數據倉庫、數據平臺的內容基礎上增加了很多介於互聯網的特色或者新時代進步下賦予了新的含義,有的是擴充、有的是更加聚焦了。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"bulletedlist","content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong"}],"text":"講“數據中臺”的不知道怎麼落地。"}]}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"看過一些關於數據中臺的培訓視頻、講義,筆者對一些只強調大數據領域中概念卻不指導如何具體實施的培訓內容表示不敢苟同。希望在講的時候帶有一顆敬畏的心來做知識傳播 。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"近一年提倡數字化轉型,有的企業可以一步到位數字化,有的企業則需要經歷從信息化再"},{"type":"text","marks":[{"type":"strong"}],"text":"到數據化的過程,企業自身業務現狀、數據化現狀處在不同階段,遇到複雜的專業以及過度營銷,或許前期感覺很高到上,中期地氣不足,後期就難受。"},{"type":"text","text":"大數據這個領域有個特點就是專業詞彙很多,讓接觸者感覺高大上的同時理解起來更加困難,但真實情況是數據中臺、數據產品、Bi分析這幾年在各媒體、培訓機構的充斥下認知的門檻變得很低,從認知到上手來做的門檻也變得很低。但是從能做變成做好,從做好變成架構與設計好,卻不是一件能一蹴而就的事情。"},{"type":"text","marks":[{"type":"strong"}],"text":"入門的門檻在逐漸的降低,但是天花板卻變得更高,從而對從業者提出了更好的技術要求。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"把行業上所有的數據中臺&平臺拿出來,百分之九十多項目都是介於失敗或中間階段,成功或評價好的沒幾個。 當然這個也不能絕對說明什麼,我也相信在業內有做的非常好的案例,可能是不願意出來分享。當然,對於評估數據項目優劣的評判標準,後面再做詳細拆解。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"在充斥着知識快消的當今時代,透傳出一種行業的浮躁,每一個新的概念下必然會有一羣失敗的實踐者,我們可以輕鬆的刺破浪尖上的泡沫但是擋不住任性的浮躁心理。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"heading","attrs":{"align":null,"level":4},"content":[{"type":"text","text":"唯一性定理解析狹義的“數據中臺”"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"再次引用本系列第一篇廣義與狹義數據中臺內容:"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"數據中臺\"這個詞是從互聯網大型企業的中臺這個概念中提煉與逐步演進的,並逐步走進傳統企業與大家的眼中。數據中臺在數字化轉型中承擔的角色、職能以及投入產出還需要在實踐中進一步去演進與變革。 目前在行業上對數據中臺的引用已經變的更好廣泛,自然含義也有不同。 既有廣義、也有狹義。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong"}],"text":"廣義上的數據中臺"},{"type":"text","text":"就是一個什麼都能裝的籃子,除了原有數據平臺內的技術框架、應用場景、其它的或許跟大數據一點邊的場景、數據內容、框架都會往裏裝,以及站在更高的組織結構上去思考數據的全局化、統一化、一致化的設計與實施,強調複用性、共享式的服務。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong"}],"text":"狹義中的數據中臺"},{"type":"text","text":"就是定義在一個大數據技術平臺(存儲、計算、開發工具、可視化、數據管理、大數據運維管理等),在原有的數據倉庫以及升級後的數據平臺的責任範圍。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"去年數據中臺在行業內剛流行起來的時候自己遵循第一性原理,橫向來看數據平臺、狹義的數據中臺的內在關係並進行合理性的比較。 自己是從數據源的類型、計算與存儲、數據內容的組織、數據資產管理、應用場景與價值來做橫向的比較(嚴謹性還需要進一步整理):"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https:\/\/static001.infoq.cn\/resource\/image\/3e\/cf\/3e0fe09657896ec65465c7dc6eb0eacf.png","alt":null,"title":"","style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":"","fromPaste":false,"pastePass":false}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"可能有人會提出,這裏爲什麼沒有提到"},{"type":"text","marks":[{"type":"strong"}],"text":"組織結構的保障"},{"type":"text","text":",數據中臺不是說必須得有強力的組織上的保障嗎?在後面文章會稍微展開解釋,需要組織上保障的數據中臺的前因後果。 爲什麼數據中臺提組織結構是感覺非常合理的,"},{"type":"text","marks":[{"type":"strong"}],"text":"大數據天然的特性就是帶着中臺的一些概念關鍵詞屬性,比如共享、複用、平臺化,數據本身其具備的天然特性就是一次採集、抽象公共總線並廣泛使用、自身就帶着共享與服務的特點恰恰又踩到了”中臺”詞的複用、服務的特點。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"除了這個比較之外還有一個獨特的地方,在數據模型上因爲數據中臺面對的業務線複雜度、數據使用者的複雜度均有所增加,自然在數據模型中關於公共主題"},{"type":"text","marks":[{"type":"strong"}],"text":"領域的設計會更加側重一些,就是數據的複用性的問題"},{"type":"text","text":"。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"如果要學習數據中臺,必須瞭解從數據倉庫到數據中臺的發展歷史,才能理清現在迎面撲來的各種專有名詞及其含義,以及背後產生變化的原因。例如在一些非常成熟的數據平臺因業務的需要是通過API或服務的方式爲業務提供各種數據化場景(數據服務、總線、推送、訂閱類常規的方式是受到業務對數據的場景化訴求驅動)。目前提到的指標統一、維度統一、編碼統一、指標落地統一拆解構建統一在數據的企業級實施中數據總線設計的必須設計的,但今天受到事物、認知、複雜業務視角、組織環境、環境的發展的影響,在之前的基礎概念上進行大膽的創新與變革。 業內有套非常牛逼的OneData 方法論,其包含的統一模型設計、統一id、統一服務以及其他統一視角的建設。在後面一片文章也會嘗試從自己的理解的角度來分享一下對這套方法論的建設觀點與思考。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong"}],"text":"相關文章:"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"link","attrs":{"href":"https:\/\/www.infoq.cn\/article\/qPl0gtOYYxOhQeSqXpzz","title":"xxx","type":null},"content":[{"type":"text","text":"透過數字化轉型再談數據中臺(一):關於數字化轉型的幾個見解"}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong"}],"text":"作者簡介"},{"type":"text","text":":"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"松子(李博源),BI& 數據產品老兵一枚,漂過幾個大廠。2016 年到現在持續輸出原創內容幾十篇,《中臺翻車紀實》 、《從數據倉庫到大數據,數據平臺這 25 年是怎樣進化的》 、《數據產品三部曲系列》等系列有思考深度的文章。"}]}]}
發表評論
所有評論
還沒有人評論,想成為第一個評論的人麼? 請在上方評論欄輸入並且點擊發布.
相關文章