TopicSolutionProsConsResult前端技术栈 | React | - 与当前团队内的实践一致
- 非常成熟的社区和生态
- 今天它仍然在快速发展
| ✅平台编程语言 | Ruby on Rails | - 可以简单快速搭建Web应用
- 团队内有Rails开发经验和专家资源
- 在未来可能会碰到性能瓶颈,就像今天的业务应用
- 相关技术在今天发展缓慢
| | Golang | - 很好的运行时性能
- 最近几年生态发展迅猛
- 技术栈和团队的微服务实践一致
- 代码比较冗余
- GRPC接口数据转换实现繁琐
| | Nodejs | - 可以和前端统一语言于JS
- 生态有丰富的包可以使用
- JSON格式和接口处理方便
- 未来可能也会有性能瓶颈
✅数据库类型 | Postgresql | - 在SQL和NoSQL上丰富的功能和特色支持
- 相对较高的性能
- 对工程师和DBA来说相对陌生
- 我们可能不会使用太多的新功能
| | Mysql | - 对开发团队简单友好,基本的需求都能满足
- DBA可以提供更多支持
- 为了一些json格式支持等功能,必须使用5.7及以上版本
✅数据库运行时 | K8S pod\/pv\/pvc | - 很轻量级
- Kubernetes Pod资源已经存在,可以节省开销
- 用Pod的形式比较难维护
- 需要在集群中开放额外的路由以便从外网访问
| | AWS RDS | - DBA可以提供维护,工程师可以专注于使用
- 请求量超过1M\/月时才会收费,廉价
- AWS云原生,周边基础设施支持齐全
- 在现阶段对于一个内部使用的Web平台而言略重
✅"}}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"根据以上对比,基于对治理平台快速开发、稳定运行的要求,我们最终选用React+Nodejs+Mysql+AWS RDS的组合来进行开发构建。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"按照FreeWheel今天的业务场景需求,我们的治理平台将包括四个主要的部分:Falcon前端,Falcon后端,数据库,Redis。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":" "}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"为了与现有的服务集群进行整合,我们需要将治理平台的各模块部署在AWS集群中:"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":" "}]},{"type":"image","attrs":{"src":"https:\/\/static001.geekbang.org\/infoq\/cd\/cd5ff1b9a0d429f22b6fe7dace55f09e.png","alt":null,"title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"其中:"}]},{"type":"bulletedlist","content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"Falcon前端主要提供所有的Web前端资源和逻辑,它是独立于后端进行开发和部署的,实现了前后端的分离解耦。"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"Falcon后端是整个平台的后端服务器,负责平台的所有业务逻辑。同时它需要和集群中的业务微服务和公共组件进行通信交互。"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"数据库用于存储平台自身的数据,例如登录用户的信息、采集到的业务数据等。"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"Redis模块是为了实现定时任务等功能点所引入的模块。为了尽量减少对线上微服务的影响,我们没有使用集群中业务微服务所使用的Redis,而是重新部署了一个单独的Redis。"}]}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":" "}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"我们将Falcon前端\/Falcon后端\/Redis打包,以Kubernetes Pod的形式运行部署,和FreeWheel的业务微服务部署在同一个AWS EKS集群中,而数据库使用了AWS RDS服务来支持。我们对Falcon前端\/Falcon后端\/数据库暴露了VIP,FreeWheel内网进来的请求,会先经过AWS ALB,转发到服务网格Ingress Gateway,最后打到Falcon对应的Pod或数据库。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":" "}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"Falcon与EKS集群的交互主要通过Falcon后端完成:订阅监听Kafka传递的消息;搜索读取集群Redis中的数据;对业务微服务进行接口调用等。其中,Kafka是FreeWheel使用的分布式消息发布订阅系统,用来传递业务微服务之间的异步消息;Redis用于缓存一些不易变的业务数据,或者用于存储实现后台任务;业务微服务处理业务请求,会跟AWS S3等设施配合实现业务,使用Aurora存储业务数据,与FreeWheel后端服务进行交互等。"}]},{"type":"heading","attrs":{"align":null,"level":3},"content":[{"type":"text","text":"平台运行工作流"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"当Falcon被部署运行使用时,会经历以下过程:"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":" "}]},{"type":"numberedlist","attrs":{"start":null,"normalizeStart":1},"content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":1,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"部署之后,Falcon后端开启消费者监听Kafka消息"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":2,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"Falcon后端加载数据监控配置进Redis,开启任务调度"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":3,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"用户访问VIP地址, 请求被路由到Falcon前端Pod,Falcon前端返回JS资源"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":4,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"浏览器加载并渲染前端资源,进入登录页面"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":5,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"用户输入LDAP用户名\/密码,请求路由到Falcon后端,Falcon后端验证登录,存储登录信息进session和数据库"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":6,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"用户在平台界面操作,请求路由到Falcon后端,将操作数据存储,或实时调用业务微服务,完成对应操作"}]}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":" "}]},{"type":"image","attrs":{"src":"https:\/\/static001.geekbang.org\/infoq\/26\/2665d7a23892cb42c55c9c202578c84e.png","alt":null,"title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"heading","attrs":{"align":null,"level":3},"content":[{"type":"text","text":"平台提供的功能模块"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"今天Falcon针对于业务团队的痛点实现了许多功能模块,还有一些功能模块正在探索和开发中,下图是Falcon的导航首页。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":" "}]},{"type":"image","attrs":{"src":"https:\/\/static001.geekbang.org\/infoq\/9f\/9ff749e20a889f0249c84ccf2ec23381.png","alt":null,"title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"接下来本文会围绕Falcon的这些功能模块进行介绍:登录验证,数据监控模块,后台任务模块,异步消息模块,业务缓存模块,线上调试模块,用户管理模块和使用记录模块。"}]},{"type":"heading","attrs":{"align":null,"level":4},"content":[{"type":"text","text":"准备工作 - 登录验证"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"出于系统平台安全性的考虑,我们限定了只有在FreeWheel内网才可以访问Falcon平台。平台的使用用户限定在FreeWheel的工程师团队,而FreeWheel内部员工使用LDAP来做账号的统一登录认证,因此Falcon后端也集成了LDAP对登录用户认证。在用户首次登录时,Falcon会将该用户同步存储在数据库中,以便之后为其配置在Falcon平台的用户权限。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https:\/\/static001.geekbang.org\/infoq\/2e\/2e79f1b7a053f5481c0c1160c97cd46b.png","alt":null,"title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"heading","attrs":{"align":null,"level":4},"content":[{"type":"text","text":"数据监控"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"数据监控模块旨在监控异常的业务数据。在从Rails单体应用迁移到分布式微服务后,很多数据的增删改不再由原来一个数据库事务来完成,而是变成了多个微服务多个数据库事务来进行数据更新,因而很难保证不同微服务间的数据强一致。一个简单快速的方案就是对业务不一致的数据进行监控,Falcon提供了这样一个入口进行脏数据的监控和报警,用户可以通过提供一段SQL语句,或者是微服务实现的一个接口,来达到对特定数据的监控目的。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":" "}]},{"type":"image","attrs":{"src":"https:\/\/static001.geekbang.org\/infoq\/a6\/a64a5d74a176691265f1a78e0be8f239.png","alt":null,"title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"如上图所示,Falcon后端在启动完成后,从数据库加载数据监控设置,初始化基于Redis的任务队列。任务队列中的任务根据设置好的排期,定时调用Handler执行SQL或调用接口,将执行结果写会到数据库。同时将执行结果与用户设置的参数进行比较,一旦发现满足脏数据条件,即进行报警通知订阅者。今天Falcon提供了Email和Slack两种方式进行报警通知。用户可以实时更改监控设置,Falcon后端会将用户的实时更改持久化,并更新任务队列即时生效。"}]},{"type":"heading","attrs":{"align":null,"level":4},"content":[{"type":"text","text":"后台任务"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"后台任务一般分为定时任务和按需任务。相信大部分的系统平台都有与自身业务相关的后台任务,FreeWheel也不例外。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":" "}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"在Rails单体应用的年代,FreeWheel使用Resque对后台任务进行管理,Resque自身也提供了一套基于Sinatra的Web管理界面。迁移到Golang微服务之后,FreeWheel使用封装的bricks\/job作为后台任务管理工具,创建、执行、重试、销毁后台任务。然而相比于Resque,它对于工程师的痛点在于无法进行可视化的管理。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":" "}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"针对这一痛点,我们在Falcon中构建了后台任务的可视化模块,提供5个方面的内容:Worker Pool, Queue, Scheduled Job, Retry Job, Dead Job. 用户可以查看到正在执行的任务有哪些,队列中已有哪些任务,将要执行的定时任务分别安排在了什么时间,重新过的任务是哪些,哪些任务执行失败了等等。例如下图中展示了Inventory Service中每10秒执行一次的default_check_alive任务的排期情况。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https:\/\/static001.geekbang.org\/infoq\/b6\/b69e160eddfc72c884f7da4568798188.png","alt":null,"title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":" "}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"特别的,我们可能更关注于哪些任务执行失败了,以及失败原因,因此我们把失败任务的诸如参数、错误内容等详细信息展示出来,并提供了重试功能,以便在工程师在排查完错误原因后,可以手动触发重新执行任务。如下图展示了Order Service最近执行失败的任务、任务参数、失败原因等等。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https:\/\/static001.geekbang.org\/infoq\/5b\/5b7fe8cf18d4e29c7494f912576acaf5.png","alt":null,"title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"heading","attrs":{"align":null,"level":4},"content":[{"type":"text","text":"异步消息"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"随着微服务集群规模越来越庞大,业务越来越复杂,异步消息机制也被越来越广泛地应用,微服务在很多业务场景中都需要发送\/接收异步消息。从工程师的角度,我们很希望能实时得知消息是否被成功发送到Kafka,发送的消息内容是否是我们所期望的。以往我们只能通过查看日志的方式来获知消息的发送情况,这对工程师是非常不友好的。在这个模块,我们通过新加消费者监听消息的方式,并将监听消息展示,实现了Kafka业务消息的可视化。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https:\/\/static001.geekbang.org\/infoq\/1e\/1e2d1d6903643c0031f88175fdfb00ca.png","alt":null,"title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"Falcon后端启动完成后,从数据库加载异步消息监听配置,最主要的是消息的proto格式文件,通过proto handler将消息格式解析,并启动初始化consumer监听该topic消息,将监听到的消息存储回数据库,并构建UI对这些数据进行展示,达到了业务消息可视化的目的。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":" "}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"由于随着新业务的出现,新的消息也会不断增加,为了应对和支持越来越多的新消息,我们也做了动态添加新消息类型并监听展示的功能。当我们的微服务中增加了新消息,只需要将新消息的topic\/消息的proto定义文件\/消息的名称配置好,Falcon会将配置实时存入数据库,并动态加载这个消息并监听展示。由于消息量巨大,考虑到存储成本,以及我们对历史已久的消息并不感兴趣,在数据库层面我们设置了Event Scheduler定期对历史消息进行清理操作。"}]},{"type":"heading","attrs":{"align":null,"level":4},"content":[{"type":"text","text":"业务缓存"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"为了提升微服务的处理能力和响应性能,减小业务层对数据库的压力,我们会在领域微服务中加入缓存,将常用不易变的数据放到缓存中。每次有新的请求过来,先查询缓存,如果有数据并不过期,则直接读取返回。类似于后台任务模块和异步消息模块的问题,缓存中存了什么,有效期多久,何时进行的更新,在微服务运行时我们是无从得知的。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":" "}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"一个常见的场景是,数据库中的数据更新了,却不能很清楚地知道数据何时能生效,在定位问题时很容易导致判断错误。在这个模块中,我们将缓存数据进行了可视化展示,提供搜索功能以针对特定的key进行查询,用户可以很清楚地看到有哪些数据被缓存,数据量多大,到期时间等等。如下图展示了Metadata Service中当前缓存的业务数据情况。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https:\/\/static001.geekbang.org\/infoq\/16\/16a736e4477bc3ecc12be364ea938f39.png","alt":null,"title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"heading","attrs":{"align":null,"level":4},"content":[{"type":"text","text":"线上调试"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"领域微服务的业务中,往往需要依赖于第三方的服务,而在生产环境中这些第三方服务发生问题时,我们很难快速地从微服务的角度进行问题定位。比如下层服务响应慢,微服务对外的表现也是响应慢,但很难确定是微服务本身操作数据库慢,还是调用下游服务响应慢。不同的微服务可以根据自己的业务情况,实现自己的调试接口,提供调试信息。线上调试模块提供了调试入口,将调试接口集成到平台调试模块,用户就可以在平台手动触发,查看整个链路的执行情况。这在发生线上问题时,能帮助工程师快速定位出错原因,节约处理时间。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https:\/\/static001.geekbang.org\/infoq\/00\/00652e143ad3af6793b4e2ee754bb2a8.png","alt":null,"title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":" 以Advertising模块为例,今天它主要依赖于Feedback\/Counter\/Conflict Detection\/Presto\/S3等服务,我们针对于这些依赖都接入了特定的调试接口。平台本身提供了快速接入其他接口的代码模板,在有新的需求出现时能快速扩展。"}]},{"type":"heading","attrs":{"align":null,"level":4},"content":[{"type":"text","text":"用户管理"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"Falcon平台的功能和架构定位,决定了它的重要性和影响程度远高于微服务。尽管平台致力于实现对于业务有保护性质的功能,但仍有必要对登录使用该平台的用户进行管理,以避免发生误操作造成严重影响。我们采用了通用的用户-角色-权限模式来进行用户的管理,每个功能模块都定义了读写权限,细化到微服务,在此之上按团队划分配置了工程师角色,只需要给不同用户以相应的角色,即对该用户在平台的操作权限进行了控制。如下图是给一个Advertising团队工程师的权限。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":" "}]},{"type":"image","attrs":{"src":"https:\/\/static001.geekbang.org\/infoq\/cb\/cbd1edfdeb7f66a6f3d233a588d92e11.png","alt":null,"title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"heading","attrs":{"align":null,"level":4},"content":[{"type":"text","text":"使用记录"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"作为平台系统完整性的一部分,也为了更好地追踪平台上的设置更改,我们实现了使用记录模块,以记录在该平台上发生的所有更新操作。由于平台本身没有特别的复杂业务,同时更新不会特别频繁,因而在记使用记录时我们选择记录使用全量,而非变量,即当某个对象发生变化时,都将原始对象的快照进行全量备份。下图是某次更改设置的新值与旧值的对比,通过记录全量,我们能很清楚地看到某一时刻整个数据的状态,也能很容易地看到那些字段发生了变化。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https:\/\/static001.geekbang.org\/infoq\/7e\/7e7a6e40f725ccabfb6cec53fc724f30.png","alt":null,"title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"heading","attrs":{"align":null,"level":2},"content":[{"type":"text","text":"结语"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"Falcon作为FreeWheel核心业务开发团队从0构建的一套微服务治理平台,提供了诸如数据监控、异步消息等功能模块,帮助工程师解决了很多在分布式微服务架构时期所面临的业务治理或监控痛点。目前这个平台只提供了一些对工程师而言最急切的功能,很多地方还有待进一步提升,未来我们会从以下几个方面进行持续进行工作:"}]},{"type":"numberedlist","attrs":{"start":null,"normalizeStart":1},"content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":1,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"对已有的功能进行持续优化完善,确保平台稳定可靠"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":2,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"探索对分布式事务的集成与支持,以对异常分布式事务进行控制"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":3,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"提供配置中心功能,集中管理业务微服务配置"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":4,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"集成报警,让工程师可以简便快捷进行预警配置"}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":5,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"支持功能快速扩展,当有新的功能需求时可以快速集成"}]}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":" "}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":"对于微服务治理我们还是新人,未来我们仍将在这条路上持续学习、深入探索。"}]},{"type":"heading","attrs":{"align":null,"level":4},"content":[{"type":"text","text":"作者介绍"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}},{"type":"strong"}],"text":"尚鹏飞"},{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":",FreeWheel高级研发工程师,任职于FreeWheel核心业务开发团队,擅于解决后端业务系统的复杂问题,有丰富的开发经验和敏捷团队管理经验,热衷于新技术的探索与分享,目前致力于Golang微服务和系统重构相关工作。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"color","attrs":{"color":"#494949","name":"user"}}],"text":" "}]}]} |
|
|
|
| |
|
|
|
| |
|
|
|
|
|
| |
| | | | | |