物聯網及電子交易的實時BI分析場景探討

{"type":"doc","content":[{"type":"blockquote","content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"在大數據時代，消費互聯網和工業互聯網每時每刻都在產生大量的實時流式數據，以Flink、Spark Streaming爲代表的流數據處理系統將數據處理之後，通過Kafka，MQTT等通道分發給各種下游系統。在實際應用中，對於可連接流式數據的可視化平臺的需求應運而生。本文將基於實時數據可視化軟件Altair Panopticon與大家共同探討物聯網及電子交易的實時BI分析場景。"}]}]},{"type":"heading","attrs":{"align":null,"level":2},"content":[{"type":"text","text":"爲什麼需要實時流數據BI軟件？"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"在電子交易、物（車）聯網、工業製造、電信和能源等對實時性要求高以及需要事中分析的業務場景中，延遲的決策是代價高昂的。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"Altair Panopticon™允許業務用戶和工程師使用UI界面, 構建、修改和部署複雜的流式數據分析和可視化應用程序。用戶可以連接到幾乎任何數據源，包括實時流式數據，如Kafka和時序數據庫。開發複雜的流數據處理流程，並設計可視化界面，從而在大量快速變化的數據上做出迅速和充分的決策。"}]},{"type":"heading","attrs":{"align":null,"level":3},"content":[{"type":"text","text":"1. 實時數據可視化軟件Altair Panopticon"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"Panopticon是Altair公司的實時流數據及可視化商務智能（BI）分析平臺，包括Panopticon Visual Analytics和Panopticon Streams兩個主要模塊。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"其中，Panopticon Visual Analytics是市場上唯一真正的實時數據可視化系統，Panopticon 作爲基於流式數據的可視化方案，具有卓越的速度、靈活性和可擴展性，進一步簡化了用戶生成分析報表、儀表板的過程。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"而 Panopticon Streams 是一個流數據處理引擎，支持用戶在完全可視化的界面上構建複雜的流數據處理流程。"}]},{"type":"heading","attrs":{"align":null,"level":3},"content":[{"type":"text","text":"2. Panopticon產品架構"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"Panopticon可以直接與各種實時信息系統，包括MQTT, Kafka, Solace, Rabbit MQ等，以及時間序列數據存儲，包括Kx kbd+, OneTick, MemSQL, Vertica, SparkSQL等集成。並這些數據的基礎上，生成可視化分析報告。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https:\/\/static001.geekbang.org\/infoq\/b4\/b4681ad0031b5234e67dffdc03090c16.png","alt":"圖片","title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"heading","attrs":{"align":null,"level":3},"content":[{"type":"text","text":"3. 主要功能"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"① 實時數據分析：從直連實時數據開始，構建支持納秒級別的實時數據分析，同時支持任何速度的回放數據流。支持的數據連接包括文件、數據庫和流式數據源。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https:\/\/static001.geekbang.org\/infoq\/89\/89d7f3af5c79f1b2af6945e5303e1c1c.png","alt":"圖片","title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"② 無代碼開發：使用UI界面，通過點擊和拖拽生成流數據處理和分析看板。快速響應不斷變化的業務需求，降低風險和成本，並可以在幾分鐘內快速部署新的流程和儀表板。分析人員可以在 Panopticon 中快速、直觀地分析時間序列和實時數據，從而能夠在幾秒鐘內發現操作環境中的異常情況。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https:\/\/static001.geekbang.org\/infoq\/d7\/d7b167ee363fe8b116d77748ba016a7c.png","alt":"圖片","title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"③ 構建基於Kafka的流數據處理程序：Panopticon Streams流處理引擎基於Apache Kafka構建，支持實時數據的聚合、計算和警報。用戶無需編寫任何Java、Scala或者KSQL代碼就可以實現Kafka數據流處理功能。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https:\/\/static001.geekbang.org\/infoq\/3d\/3d0d7133403c7703ec94ba38f6c07a37.png","alt":"圖片","title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"bulletedlist","content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"流式數據準備：將多個實時流與歷史數據源相結合"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"計算引擎：根據業務需求計算性能指標"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"聚合驅動程序：根據需要組合數據"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"報警引擎：根據用戶定義的閾值突出顯示異常情況"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"集成了Confluent企業級控制檯"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"擴展對物聯網環境的支持，包括製造、能源、公用事業和運輸物流   "}]}]}]},{"type":"heading","attrs":{"align":null,"level":2},"content":[{"type":"text","text":"典型業務應用場景"}]},{"type":"heading","attrs":{"align":null,"level":3},"content":[{"type":"text","text":"1. F1 賽車遙測數據的實時可視化和數據洞察，提升賽車成績"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"爲了具備更強的競賽能力，每換到一條賽道或每次遇到天氣變化時，都需要重新調校 F1 賽車。有時車隊會通過遙測系統反饋的信息、以往比賽取得的經驗、以往賽季中記錄的數據和計算機模擬的結果對賽車進行有限的調校。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"在下方視頻中，我們將會介紹如何無需代碼使用 Altair Panopticon 實時可視化 F1 賽車的遙測數據，並從數據中獲得洞察，從而進一步優化提高性能。"}]},{"type":"heading","attrs":{"align":null,"level":3},"content":[{"type":"text","text":"2. 智能電錶實時監控與分析"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"目前的電力公司藉助於物聯網技術，可以實現對管轄區域內的用電情況實時監控與分析，包括峯谷時間的用電量、用電峯值異常變化、分析歷史數據，以及預判供電負荷等，這些目標都需要藉助於當前的智能電錶數據採集和傳輸功能來實現。"}]},{"type":"heading","attrs":{"align":null,"level":3},"content":[{"type":"text","text":"3. 實時監控市場風險"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"風險分析師使用這種可視化分析來監控公司各交易層級在指定時間內的承受風險。他們可以設置警報，以在風險超過預定閾值時通知他們，並使用視覺和過濾器在幾秒鐘內確定任何異常的原因。"}]},{"type":"heading","attrs":{"align":null,"level":3},"content":[{"type":"text","text":"4. 實時監控物流車隊"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"使車隊運營商能夠分析來自傳感器和其他來源的關鍵數據流。這種對車輛和駕駛員性能的實時可視性有助於降低運營成本、保護人員和資產並提高生產率。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"分析員可以實時顯示所有資產當前位置的地圖，檢查路線偏差，對任何一組參數設置程序警報，並比較駕駛員的行爲。"}]},{"type":"bulletedlist","content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"用戶根據自己的業務需要，自定義監控儀表板"}]}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"比如：駕駛員狀態列表，車輛地理位置信息，時間與距離的散點圖來查看駕駛員的異常值和平均值等。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https:\/\/static001.geekbang.org\/infoq\/c3\/c3d4e95e43c5ec0852cf3693de15d7c4.png","alt":"圖片","title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"bulletedlist","content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"回看歷史，瞭解駕駛員的行駛情況，並與其他人或歷史數據比較，優化行駛路線等。"}]}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https:\/\/static001.geekbang.org\/infoq\/2a\/2a133c4df0d73127755bc69b6d5d8252.png","alt":"圖片","title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"heading","attrs":{"align":null,"level":3},"content":[{"type":"text","text":"5. 實時交易，成本分析與損益統計"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"此看板旨在使交易員，量化和銷售人員能夠監視最佳執行情況，並實時分析交易活動的損益以及交易成本。這使他們能夠在交易日內立即響應市場事件以及對客戶訂單流執行和公司獲利能力的威脅。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https:\/\/static001.geekbang.org\/infoq\/86\/867482751bcfe065bace2e9f2c52576c.png","alt":"圖片","title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong"}],"text":"作者簡介"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"Altair 數據分析團隊致力於打造企業級數據產品及解決方案，包括數據清洗、數據處理、數據建模、實時數據可視化等多方面業務場景，擁有國內外豐富行業經驗，如金融、零售、製造業等等。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"本文轉載自：DataFunTalk（ID：dataFunTalk）"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"原文鏈接："},{"type":"link","attrs":{"href":"https:\/\/mp.weixin.qq.com\/s\/nbHMHhagZEmdM8rXN59E8Q","title":"xxx","type":null},"content":[{"type":"text","text":"物聯網及電子交易的實時BI分析場景探討"}]}]}]}