物联网及电子交易的实时BI分析场景探讨

{"type":"doc","content":[{"type":"blockquote","content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"在大数据时代，消费互联网和工业互联网每时每刻都在产生大量的实时流式数据，以Flink、Spark Streaming为代表的流数据处理系统将数据处理之后，通过Kafka，MQTT等通道分发给各种下游系统。在实际应用中，对于可连接流式数据的可视化平台的需求应运而生。本文将基于实时数据可视化软件Altair Panopticon与大家共同探讨物联网及电子交易的实时BI分析场景。"}]}]},{"type":"heading","attrs":{"align":null,"level":2},"content":[{"type":"text","text":"为什么需要实时流数据BI软件？"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"在电子交易、物（车）联网、工业制造、电信和能源等对实时性要求高以及需要事中分析的业务场景中，延迟的决策是代价高昂的。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"Altair Panopticon™允许业务用户和工程师使用UI界面, 构建、修改和部署复杂的流式数据分析和可视化应用程序。用户可以连接到几乎任何数据源，包括实时流式数据，如Kafka和时序数据库。开发复杂的流数据处理流程，并设计可视化界面，从而在大量快速变化的数据上做出迅速和充分的决策。"}]},{"type":"heading","attrs":{"align":null,"level":3},"content":[{"type":"text","text":"1. 实时数据可视化软件Altair Panopticon"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"Panopticon是Altair公司的实时流数据及可视化商务智能（BI）分析平台，包括Panopticon Visual Analytics和Panopticon Streams两个主要模块。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"其中，Panopticon Visual Analytics是市场上唯一真正的实时数据可视化系统，Panopticon 作为基于流式数据的可视化方案，具有卓越的速度、灵活性和可扩展性，进一步简化了用户生成分析报表、仪表板的过程。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"而 Panopticon Streams 是一个流数据处理引擎，支持用户在完全可视化的界面上构建复杂的流数据处理流程。"}]},{"type":"heading","attrs":{"align":null,"level":3},"content":[{"type":"text","text":"2. Panopticon产品架构"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"Panopticon可以直接与各种实时信息系统，包括MQTT, Kafka, Solace, Rabbit MQ等，以及时间序列数据存储，包括Kx kbd+, OneTick, MemSQL, Vertica, SparkSQL等集成。并这些数据的基础上，生成可视化分析报告。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https:\/\/static001.geekbang.org\/infoq\/b4\/b4681ad0031b5234e67dffdc03090c16.png","alt":"图片","title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"heading","attrs":{"align":null,"level":3},"content":[{"type":"text","text":"3. 主要功能"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"① 实时数据分析：从直连实时数据开始，构建支持纳秒级别的实时数据分析，同时支持任何速度的回放数据流。支持的数据连接包括文件、数据库和流式数据源。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https:\/\/static001.geekbang.org\/infoq\/89\/89d7f3af5c79f1b2af6945e5303e1c1c.png","alt":"图片","title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"② 无代码开发：使用UI界面，通过点击和拖拽生成流数据处理和分析看板。快速响应不断变化的业务需求，降低风险和成本，并可以在几分钟内快速部署新的流程和仪表板。分析人员可以在 Panopticon 中快速、直观地分析时间序列和实时数据，从而能够在几秒钟内发现操作环境中的异常情况。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https:\/\/static001.geekbang.org\/infoq\/d7\/d7b167ee363fe8b116d77748ba016a7c.png","alt":"图片","title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"③ 构建基于Kafka的流数据处理程序：Panopticon Streams流处理引擎基于Apache Kafka构建，支持实时数据的聚合、计算和警报。用户无需编写任何Java、Scala或者KSQL代码就可以实现Kafka数据流处理功能。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https:\/\/static001.geekbang.org\/infoq\/3d\/3d0d7133403c7703ec94ba38f6c07a37.png","alt":"图片","title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"bulletedlist","content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"流式数据准备：将多个实时流与历史数据源相结合"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"计算引擎：根据业务需求计算性能指标"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"聚合驱动程序：根据需要组合数据"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"报警引擎：根据用户定义的阈值突出显示异常情况"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"集成了Confluent企业级控制台"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"扩展对物联网环境的支持，包括制造、能源、公用事业和运输物流   "}]}]}]},{"type":"heading","attrs":{"align":null,"level":2},"content":[{"type":"text","text":"典型业务应用场景"}]},{"type":"heading","attrs":{"align":null,"level":3},"content":[{"type":"text","text":"1. F1 赛车遥测数据的实时可视化和数据洞察，提升赛车成绩"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"为了具备更强的竞赛能力，每换到一条赛道或每次遇到天气变化时，都需要重新调校 F1 赛车。有时车队会通过遥测系统反馈的信息、以往比赛取得的经验、以往赛季中记录的数据和计算机模拟的结果对赛车进行有限的调校。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"在下方视频中，我们将会介绍如何无需代码使用 Altair Panopticon 实时可视化 F1 赛车的遥测数据，并从数据中获得洞察，从而进一步优化提高性能。"}]},{"type":"heading","attrs":{"align":null,"level":3},"content":[{"type":"text","text":"2. 智能电表实时监控与分析"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"目前的电力公司借助于物联网技术，可以实现对管辖区域内的用电情况实时监控与分析，包括峰谷时间的用电量、用电峰值异常变化、分析历史数据，以及预判供电负荷等，这些目标都需要借助于当前的智能电表数据采集和传输功能来实现。"}]},{"type":"heading","attrs":{"align":null,"level":3},"content":[{"type":"text","text":"3. 实时监控市场风险"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"风险分析师使用这种可视化分析来监控公司各交易层级在指定时间内的承受风险。他们可以设置警报，以在风险超过预定阈值时通知他们，并使用视觉和过滤器在几秒钟内确定任何异常的原因。"}]},{"type":"heading","attrs":{"align":null,"level":3},"content":[{"type":"text","text":"4. 实时监控物流车队"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"使车队运营商能够分析来自传感器和其他来源的关键数据流。这种对车辆和驾驶员性能的实时可视性有助于降低运营成本、保护人员和资产并提高生产率。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"分析员可以实时显示所有资产当前位置的地图，检查路线偏差，对任何一组参数设置程序警报，并比较驾驶员的行为。"}]},{"type":"bulletedlist","content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"用户根据自己的业务需要，自定义监控仪表板"}]}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"比如：驾驶员状态列表，车辆地理位置信息，时间与距离的散点图来查看驾驶员的异常值和平均值等。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https:\/\/static001.geekbang.org\/infoq\/c3\/c3d4e95e43c5ec0852cf3693de15d7c4.png","alt":"图片","title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"bulletedlist","content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"回看历史，了解驾驶员的行驶情况，并与其他人或历史数据比较，优化行驶路线等。"}]}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https:\/\/static001.geekbang.org\/infoq\/2a\/2a133c4df0d73127755bc69b6d5d8252.png","alt":"图片","title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"heading","attrs":{"align":null,"level":3},"content":[{"type":"text","text":"5. 实时交易，成本分析与损益统计"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"此看板旨在使交易员，量化和销售人员能够监视最佳执行情况，并实时分析交易活动的损益以及交易成本。这使他们能够在交易日内立即响应市场事件以及对客户订单流执行和公司获利能力的威胁。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https:\/\/static001.geekbang.org\/infoq\/86\/867482751bcfe065bace2e9f2c52576c.png","alt":"图片","title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong"}],"text":"作者简介"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"Altair 数据分析团队致力于打造企业级数据产品及解决方案，包括数据清洗、数据处理、数据建模、实时数据可视化等多方面业务场景，拥有国内外丰富行业经验，如金融、零售、制造业等等。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"本文转载自：DataFunTalk（ID：dataFunTalk）"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"原文链接："},{"type":"link","attrs":{"href":"https:\/\/mp.weixin.qq.com\/s\/nbHMHhagZEmdM8rXN59E8Q","title":"xxx","type":null},"content":[{"type":"text","text":"物联网及电子交易的实时BI分析场景探讨"}]}]}]}