數據遷移同步平臺CloudCanal免費社區版正式發佈

{"type":"doc","content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"近日,CloudCanal社區版正式發佈。據悉,這次社區版的發佈花了近2年時間準備,將免費開放並持續維護。同時,官方透露CloudCanal內核未來會開源,相關工作正在準備階段。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"link","attrs":{"href":"https:\/\/www.askcug.com\/category\/14\/cloudcanal","title":"xxx","type":null},"content":[{"type":"text","text":"CloudCanal"}]},{"type":"text","text":"是一款由"},{"type":"link","attrs":{"href":"https:\/\/www.clougence.com\/","title":"xxx","type":null},"content":[{"type":"text","text":"ClouGence"}]},{"type":"text","text":"公司發行的集結構遷移、數據全量遷移\/校驗\/訂正、增量實時同步爲一體的數據遷移同步平臺。產品包含完整的產品化能力,助力企業打破數據孤島、完成數據互融互通,從而更好的使用數據。其核心團隊成員來自阿里巴巴中間件和數據庫團隊,長期從事分佈式數據庫、數據庫中間件、應用中間件工作。"}]},{"type":"heading","attrs":{"align":null,"level":2},"content":[{"type":"text","text":"功能介紹"}]},{"type":"heading","attrs":{"align":null,"level":4},"content":[{"type":"text","marks":[{"type":"strong"}],"text":"支持的源和目標"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"CloudCanal是一款多源多端數據遷移同步工具,當前支持的數據源主要如下(2021年8月1日版本,數據源持續添加中):"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"源端:MySQL、Oracle、PostgreSQL、Greenplum、Kafka"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"目標端:MySQL、Oracle、PostgreSQL、Greenplum、Kafka、RabbitMQ、RocketMQ、Tidb、ClickHouse、ElasticSearch、Hive、阿里雲ADB"}]},{"type":"heading","attrs":{"align":null,"level":4},"content":[{"type":"text","text":"功能矩陣"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"CloudCanal針對數據源提供的標準能力如下:"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"bulletedlist","content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong"}],"text":"數據源管理"},{"type":"text","text":":產品化添加阿里雲數據源;產品化添加自建數據源;修改內網網Host地址;修改數據源在CloudCanal平臺存儲的賬號密碼;針對阿里雲數據源自動添加機器白名單;刪除數據源,數據源多維篩選搜索。"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong"}],"text":"機器管理"},{"type":"text","text":":集羣化管理,機器生命週期控制,機器系統信息實時監控,白屏化機器日誌查看(針對CloudCanal的Sidecar組件),產品化添加ECS,產品化添加自建機器,集羣搜索;"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong"}],"text":"監控管理"},{"type":"text","text":":監控大盤查看整體任務創建情況、機器使用情況;白屏化全局異常事件蒐集,支持按照任務搜索並且查看異常堆棧;異常事件搜索;告警發送日誌。"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong"}],"text":"系統管理"},{"type":"text","text":":用戶管理(支持用戶搜索);狀態機管理(支持查看任務狀態機詳情和狀態);異步任務管理(支持查看異步任務詳情、狀態、失敗時異常堆棧);支持全局操作審計、條件過濾。"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong"}],"text":"任務管理"},{"type":"text","text":":支持卡片、列表兩種任務展示方式;任務遷移同步進度、狀態查看;任務生命週期控制(任務啓動、刪除、批量操作);任務詳情查看(同步的源、目標查看,運行機器查看,任務各同步階段狀態,統計信息查看);清除位點(從當前時間點開始同步)。"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong"}],"text":"重置位點"},{"type":"text","text":":設置位點的開始時間;任務實時監控數據查看(實時RPS、任務引擎監控、資源監控等);任務參數修改(支持任務內核參數調整、生效);支持查看任務訂閱情況,並且支持多維篩選;支持白屏化查看任務關鍵日誌;任務監控報警(支持設定延遲閾值進行釘釘、短信、電話報警);支持新增、刪除訂閱(新訂閱的表會自動進行全量同步);支持異常跳過策略參數配置;支持參數化配置並行度、批處理大小、內存隊列大小等關鍵配置。"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong"}],"text":"可視化任務創建"},{"type":"text","text":":支持可視化配置源、目標以及任務運行機器;支持創建結構遷移、全量遷移、實時增量、校驗任務、訂正任務等任務類型;支持創建任務規格選擇;支持庫、表、列訂閱裁剪;支持整庫遷移;支持庫樹形批量篩選;支持表過濾條件設置、表批量設置過濾條件;支持豐富的篩選條件批量設置訂閱;支持按照列搜索並批量設置過濾條件;支持列映射;支持無主鍵表設置自定義主鍵;支持虛擬列設置;支持增量ACTION過濾。"}]}]}]},{"type":"heading","attrs":{"align":null,"level":2},"content":[{"type":"text","text":"技術架構"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"CloudCanal主體上分爲三個主要部分:"}]},{"type":"bulletedlist","content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"控制檯:完成CloudCanal的主要產品化能力"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"Sidecar: 主要負責任務進程和控制檯程序之間的信息交互並且保證任務進程高可用"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"任務內核:任務內核進程,負責全量"}]}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https:\/\/static001.geekbang.org\/infoq\/5a\/5a5bf98ef16d9d50f0acbd6891f90521.png","alt":null,"title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong"}],"text":"附上CloudCanal社區版下載地址:"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"OSS下載地址:"},{"type":"link","attrs":{"href":"https:\/\/cloudcanal-community.oss-cn-hangzhou.aliyuncs.com\/2021_07_31\/cloudcanal.7z","title":"","type":null},"content":[{"type":"text","text":"https:\/\/cloudcanal-community.oss-cn-hangzhou.aliyuncs.com\/2021_07_31\/cloudcanal.7z"}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"安裝教程:"},{"type":"link","attrs":{"href":"https:\/\/www.askcug.com\/topic\/75\/cloudcanal%E7%A4%BE%E5%8C%BA%E7%89%88docker%E7%89%88%E5%AE%89%E8%A3%85-linux-macos\/2","title":"","type":null},"content":[{"type":"text","text":"https:\/\/www.askcug.com\/topic\/75\/cloudcanal%E7%A4%BE%E5%8C%BA%E7%89%88docker%E7%89%88%E5%AE%89%E8%A3%85-linux-macos\/2"}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong"}],"text":"官方社區地址:"},{"type":"link","attrs":{"href":"https:\/\/www.askcug.com","title":"","type":null},"content":[{"type":"text","text":"https:\/\/www.askcug.com"}]}]}]}
發表評論
所有評論
還沒有人評論,想成為第一個評論的人麼? 請在上方評論欄輸入並且點擊發布.
相關文章