將Kafka作爲存儲系統

{"type":"doc","content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"當開發者通過API消費Twitter的公共數據時,他們需要獲得可靠性、速度和穩定性方面的保證。因此,在不久前,我們推出了Account Activity Replay API("},{"type":"link","attrs":{"href":"https:\/\/developer.twitter.com\/en\/docs\/twitter-api\/enterprise\/account-activity-api\/guides\/activity-replay-api","title":"","type":null},"content":[{"type":"text","text":"https:\/\/developer.twitter.com\/en\/docs\/twitter-api\/enterprise\/account-activity-api\/guides\/activity-replay-api"}]},{"type":"text","text":"),幫助開發者們提升他們系統的穩定性。這個API是一個數據恢復工具,開發者可以用它來檢索最早發生在5天前的事件,恢復由於各種原因(包括在實時傳遞時突然發生的服務器中斷)沒有被傳遞的事件。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"除了構建API來提升開發者體驗,我們還做了一些優化:"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"bulletedlist","content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"提高Twitter內部工程師的生產力。"}]}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"bulletedlist","content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"保持系統的可維護性。具體來說,就是儘量減少開發人員、站點可靠性工程師和其他與系統交互的人員的上下文切換。"}]}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"基於這些原因,在構建這個API所依賴的回放系統時,我們利用了Account Activity API現有的實時系統設計。這有助於我們重用現有的工作,並最小化上下文切換負擔和培訓工作。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"實時系統採用了發佈和訂閱架構。爲了保持架構的一致性,構建一個可以讀取數據的存儲層,我們想到了傳統的流式技術——Kafka。"}]},{"type":"heading","attrs":{"align":null,"level":2},"content":[{"type":"text","text":"背景"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"兩個數據中心產生實時事件,事件被寫入到跨數據中心的主題上,實現數據冗餘。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}}]}
發表評論
所有評論
還沒有人評論,想成為第一個評論的人麼? 請在上方評論欄輸入並且點擊發布.
相關文章