将Kafka作为存储系统

{"type":"doc","content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"当开发者通过API消费Twitter的公共数据时，他们需要获得可靠性、速度和稳定性方面的保证。因此，在不久前，我们推出了Account Activity Replay API（"},{"type":"link","attrs":{"href":"https:\/\/developer.twitter.com\/en\/docs\/twitter-api\/enterprise\/account-activity-api\/guides\/activity-replay-api","title":"","type":null},"content":[{"type":"text","text":"https:\/\/developer.twitter.com\/en\/docs\/twitter-api\/enterprise\/account-activity-api\/guides\/activity-replay-api"}]},{"type":"text","text":"），帮助开发者们提升他们系统的稳定性。这个API是一个数据恢复工具，开发者可以用它来检索最早发生在5天前的事件，恢复由于各种原因（包括在实时传递时突然发生的服务器中断）没有被传递的事件。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"除了构建API来提升开发者体验，我们还做了一些优化："}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"bulletedlist","content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"提高Twitter内部工程师的生产力。"}]}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"bulletedlist","content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"保持系统的可维护性。具体来说，就是尽量减少开发人员、站点可靠性工程师和其他与系统交互的人员的上下文切换。"}]}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"基于这些原因，在构建这个API所依赖的回放系统时，我们利用了Account Activity API现有的实时系统设计。这有助于我们重用现有的工作，并最小化上下文切换负担和培训工作。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"实时系统采用了发布和订阅架构。为了保持架构的一致性，构建一个可以读取数据的存储层，我们想到了传统的流式技术——Kafka。"}]},{"type":"heading","attrs":{"align":null,"level":2},"content":[{"type":"text","text":"背景"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"两个数据中心产生实时事件，事件被写入到跨数据中心的主题上，实现数据冗余。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}}]}