閉環管理下的銀行監控系統改造

{"type":"doc","content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong"}],"text":"本文由 dbaplus 社羣授權轉載。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"heading","attrs":{"align":null,"level":2},"content":[{"type":"text","text":"前言"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"近幾年來，隨着某城商銀行數字化建設發展，銀行系統引進了大數據及人工智能技術建設，同時銀行監控管理需要整體優化管控策略和監測工具。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"立足國內監控政策環境和自身運營實際，我行現提出“監-管-控”閉環監控系統改造策略，從監控系統、一體化運營管理平臺、自動化控制三個方面系統推進，以期爲銀行監控管理的發展提供可供借鑑的發展思路。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"大數據及人工智能技術在監控領域的應用使銀行系統的監控面臨更爲重要的機遇和挑戰，某城商銀行服務主體對業務可用性要求不斷提高，需要不斷優化現有監控平臺及監控策略，需要形成監控標準化體系。因此，監控管理亟待更新監控管理辦法，制定相適應的管控策略。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"heading","attrs":{"align":null,"level":2},"content":[{"type":"text","text":"一、某城商銀行監控管理系統升級改造的背景"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"我行監控系統面臨的主要問題有："}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"bulletedlist","content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"銀行監控系統整體來看，普遍存在不同監控平臺監控策略、告警事件、數據歸集分散的問題；"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"監控工具方面，監控控工具展示的更多的是面向專家和技術人員使用的監控視圖，對ECC一線整體監控可視化需求的實現不足；"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"業務監控方面，自動化巡檢及處置流程覆蓋面積小，覆蓋場景單一，缺乏有效的自動化開發管理流程。"}]}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"由此，我行在現有問題的基礎上積極探索解決方案，我行根據監控數據現實及服務需求制定了“監-管-控”一體化的閉環管理方案，以期爲銀行的監控系統改造提供切實可行的方案。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"heading","attrs":{"align":null,"level":2},"content":[{"type":"text","text":"二、“監-管-控”閉環監控系統方案內容"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"heading","attrs":{"align":null,"level":3},"content":[{"type":"text","text":"1、監：監控系統"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"監控系統重點改進主要涉及監控信息採集及事件處理流程、應用系統的改造、基礎設施故障的告警事件、應用和業務場景故障的應急響應等幾個方面。具體監控內容如下："}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"bulletedlist","content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"以ITM和ZABBIX爲監控信息採集核心，通過syslog和snmp等標準協議，將存儲、網絡設備、安全防護等專有設備的監控事件統一歸集管理，利用Omnibus形成標準的監控告警事件，與短信平臺、ITIL平臺進行數據集成，形成標準的事件處理流程。"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"對應用系統進行改造，形成格式化的交易流水日誌，並通過大數據分析平臺對應用日誌進行統一採集、歸檔、展示分析；添加應用心跳監測日誌，確保在不同交易特徵時段都可實時掌握應用可用性數據，保障監控信息可靠、有效。"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"針對基礎設施故障，開發報警事件架構分佈圖，根據系統架構層級關係、告警事件及應用映射快速定位，並與自動化工具集成，形成聯動，如：存儲IO故障，應用緩慢的根本原因定位，採取容災切換規避等。"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"針對應用或業務場景故障，製作基於業務日誌的實時故障分析展現視圖，如：ATM交易流水中，他代本報錯，是全部他行報錯，還是部分他行報錯，處理的機制不同等。"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"提供針對告警事件、業務日誌的AIOps智能化分析功能，針對告警事件和日誌異常進行告警提示，協助管理人員快速發現、定位故障。"}]}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"heading","attrs":{"align":null,"level":3},"content":[{"type":"text","text":"2、管：一體化運維管理平臺"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"一體化運維管理平臺主要涉及的三個方面內容有："}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"bulletedlist","content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"通過一體化運維管理平臺實現針對監控對象及其構成組件的自動化登記，以及各組件的監控策略部署控制，並與監控工具集成，實現實時控制。"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"形成監控對象—監控KPI—監控策略—監控覆蓋（實例化）的監控檔案管理體系，針對監控事件和監控策略進行編碼，形成結構化的告警事件管理和策略管理。"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"與CMDB集成數據，並形成可由容災管理平臺調用的資產管理數據源，向各應用平臺提供資產及監控策略管理數據。如下圖所示："}]}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https:\/\/static001.infoq.cn\/resource\/image\/19\/4a\/19a85d9a632c052777c70a29153b634a.png","alt":null,"title":null,"style":null,"href":null,"fromPaste":true,"pastePass":false}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}}]}