開發者實踐丨Agora Home AI 音視頻的未來

{"type":"doc","content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"本文作者是本屆 RTE 2021 創新編程挑戰賽獲獎者，來自上海交通大學的李新春。他分享了本次參賽作品的構思、系統設計和開發的心得。","attrs":{}}]},{"type":"heading","attrs":{"align":null,"level":1},"content":[{"type":"text","text":"01 不得忽略的背景","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"從國家層面上講，十四五期間我國人工智能發展的方向之一是：基於 AI 硬件的新產品設計及平臺將成爲主流。當前，人工智能解決方案正由“軟件”模式轉變爲“軟件+硬件”模式。隨着智能計算芯片與系統、新型多元智能傳感器件與集成平臺等新一代人工智能基礎支撐平臺日漸成熟。以 AI 硬件爲基礎，在“端+雲+芯片”協同發展的背景下，產品的感知、理解、推理和決策能力將實現突破。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"從企業發展來說，AI 技術正越來越多的應用的社會的各個方面，從基礎的人臉識別到無人駕駛，無論是機器學習還是深度學習雖然是弱人工智能時代，但已經足夠讓人們的生活產生明顯的影響。因而，依託企業應用實踐，結合人工智能的發展方向，打造出獨具特色的人工智能產品是值得探索戰略方向。","attrs":{}}]},{"type":"heading","attrs":{"align":null,"level":1},"content":[{"type":"text","text":"02 本項目緣起","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"因本人一直從事技術領域相關工作，從 AR、VR 到現在的 AI。在不斷的工作實踐中積累經驗，也在不斷思考未來技術如何改變生活，所謂人工智能，在現階段的應用主要的幾個方面如工廠生產、生活服務、社會治理等等，各個領域互相獨立，有自己獨特的算法和模型，那是不是可以做一套雲平臺，接入各種音視頻進行實時分析並反饋，形成一套 AI 雲服務平臺？因此，本次參賽的出發點就是形成一套可行的應用實踐，並提出一種雲上 AI 平臺的系統架構。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https://static001.geekbang.org/infoq/e8/e8a65c2c1c80164935e6c0affc01d2b1.png","alt":null,"title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"heading","attrs":{"align":null,"level":1},"content":[{"type":"text","text":"03 系統構成","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"在本次項目中採用了 YOLO V3 作爲基礎算法識別引擎，採用聲網Agora 的音視頻傳輸作爲智能終端的數據來源，採用開源硬件 NodeMcu 及其配套作爲智能硬件終端代表，最終形成在家庭局域網內的智能家居平臺。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"YOLO V3","attrs":{}},{"type":"text","text":"：是 YOLO(You Only Look Once)系列目標檢測算法中的第三版。在這一版本中提升了對小目標的識別性能，同時速度得到更好的提升。目前該算法已經更新到 V5 版本，在速度和識別結果上有大幅提升。簡單的說，該算法能夠達到實時得識別數據，識別精度也滿足基本要求，同時在配置、使用和學習上成本較低。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https://static001.geekbang.org/infoq/cf/cff99627de3c13461df51698ab50d6bc.png","alt":null,"title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"Agora SDKs","attrs":{}},{"type":"text","text":"：在本項目中使用到聲網提供的兩款 SDK，RTC 實時音視頻通信主要功能是進行實時視音頻的傳輸，RTM雲信令提供高效、高併發的實時消息，這兩款 SDK 兼容 iOS、Android、Windows、macOS、Web、小程序等 20 多個開發平臺，可以方便的進行拓展和多平臺交互開發。同時對於註冊用戶，每個月均有 10000 分鐘的免費時長，這對於普通開發者完全可以滿足日常需求，並且實測在 4G 網絡的情況下端到端延遲<400ms，開發測試也是十分良好的體驗。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https://static001.geekbang.org/infoq/f8/f8beafa7c57a820c77a308d1a4a085e8.png","alt":null,"title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"智能硬件","attrs":{}},{"type":"text","text":"：項目中實際上應用包括智能小車控制的 Node MCU 和音視頻傳輸的終端（樹莓派Android things等）因爲手頭的終端性能太差，故開發採用舊手機作爲智能硬件控制終端，通過局域網對家庭內的所有智能硬件設備進行綜合管理。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https://static001.geekbang.org/infoq/e8/e8a8e0159b24006e25c462c008dbfebb.png","alt":null,"title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"開發環境","attrs":{}},{"type":"text","text":"：因爲項目使用了機器學習算法，所以對設備還是有點要求，目前本人的開發環境如下：","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"硬件環境：","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"bulletedlist","content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"CPU：I7 9700K","attrs":{}}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"GPU：GTX1050TI","attrs":{}}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"內存：16G，500SSD","attrs":{}}]}]}],"attrs":{}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"軟件環境：","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"bulletedlist","content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"VS2015","attrs":{}}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"Arduino IDE","attrs":{}}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"Unity 3D 2019.2","attrs":{}}]}]}],"attrs":{}},{"type":"heading","attrs":{"align":null,"level":1},"content":[{"type":"text","text":"04 系統設計","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"平臺初步規劃以家居的只能 AI 項目應用，通過家庭筆記本、網絡監控攝像機、智能硬件設備、物聯網終端設備、Agora 音視頻平臺等構建一套在家庭範圍內可用的智能管理平臺。接入智能硬件設備、實時音視頻通信、實時信令控制等主要功能，完成從設備管理到事件處理的完整邏輯。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"平臺功能","attrs":{}},{"type":"text","text":"：平臺引入 YOLO V3 並進行封裝，以滿足在 Unity3D 中實時調用進行識別的需求；調整 Agora 音視頻傳輸腳本，將回調的視頻圖片進行實時識別，並輸出識別事件；構建 Agora 信令消息羣組，進行智能硬件控制；使用 Unity Charts 進行數據的展示和分析。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https://static001.geekbang.org/infoq/f3/f39a042f61f00639f72355ee5dc545fe.png","alt":null,"title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"設備管理","attrs":{}},{"type":"text","text":"：隨着智能設備性能提升和網絡的快速發展，以音視頻爲基礎的智能硬件正快速發展，對於各種設備接入，建議通過專門的設備管理中心進行數據對接，而對於AI管理平臺只需要對接梳理好的各類硬件設備，從而進行解耦。目前家居管理平臺主要以視頻管理爲主，支持多種視頻監控接入：Agora 視頻流、Web 攝像頭、HTTP 視頻流（HLS）、視頻文件等。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https://static001.geekbang.org/infoq/5d/5dcb278d4482e7bc82b73fd87f288230.png","alt":null,"title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"AI 算法","attrs":{}},{"type":"text","text":"：系統採用開源 YOLO V3 算法進行各種視頻數據的處理。除此之外，各種人工智能識別算法均可以進行接入。當然需要解決在 Unity 中的調用和數據反饋問題。當前家居管理平臺通過對 YOLO V3 的封裝，支持 C#、C++ 調用；當前項目支持基礎 80 種物體識別（自帶）、安全帽識別（網絡下載）、冰球識別（自定義）等均可以在 github 項目中下載得到，替換同名文件即可實現不同種類識別。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https://static001.geekbang.org/infoq/aa/aad87a38644a3d03749adf412e5f3505.png","alt":null,"title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"模型構建","attrs":{}},{"type":"text","text":"：如上所述，當前平臺已經支持 YOLO 基礎 80 種物體識別、安全帽識別、冰球識別，依照 YOLO V3 進行自主訓練的模型，均可以在本項目中執行，極大減少了程序開發的難度。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https://static001.geekbang.org/infoq/4a/4a25772541c78cba4a5cb1cca16ce1da.png","alt":null,"title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"硬件控制","attrs":{}},{"type":"text","text":"：當前採用聲網提供的雲信令進行遠程設備控制，通過構建羣組房間進行家居環境下的消息實時通信，支持通過自定義協議進行智能硬件的控制，對於一些智能硬件愛好者，可能只需要一個腳本即可接入到本平臺的系統中。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https://static001.geekbang.org/infoq/34/34581e90ae5e9363b08c9e4ad66c7c0f.png","alt":null,"title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"事件處理","attrs":{}},{"type":"text","text":"：採用 Agora 雲信令，在構建的家居智能管理羣組中發送不同的識別消息和控制命令，通過即時消息發送給移動端用戶以及智能設備。支持在線消息、離線消息，讓用戶任何時候都不錯過消息。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https://static001.geekbang.org/infoq/cd/cd84d4fd44c0807d06bddb8e0db598ba.png","alt":null,"title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"移動應用","attrs":{}},{"type":"text","text":"：本項目中，採用 Agora 音視頻直播和雲信令功能，讓用戶在接收消息的同時進行對智能硬件進行實時控制，如控制開關、攝像頭旋轉等。同時，因爲 Agora 有很好的可擴展性和封裝性，可以對應用系統進行解耦，方便用戶進行各模塊的分離編程，提升系統可用性。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https://static001.geekbang.org/infoq/56/56c12177bacf5713e951ef607ab3f332.png","alt":null,"title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"heading","attrs":{"align":null,"level":1},"content":[{"type":"text","text":"05 系統開發","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"相對與去年 Agora 更新發布了針對 Unity3D 的 RTM 即時通信 SDK，同時開發者平臺在專業的管理運營下也越來越豐富，同時對於 Unity 3D 開發的支持也在不斷完善，出現了很多教程和示例以及豐富的開發文檔。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https://static001.geekbang.org/infoq/9b/9bb74d7b08a0b8ab934273109f06b832.png","alt":null,"title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"在本次開發中，因爲要對 Agora 本身的視頻進行圖像識別，在 VideoSurface.cs 腳本上進行修改：","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"codeblock","attrs":{"lang":"text"},"content":[{"type":"text","text":"//調用yolo封裝過的sdk，detectedCallback是託管函數，對回調數據進行處理\nvar container = RTCGameManager.rtcYoloManager.GetYolo().Detect(nativeTexture.EncodeToJPG());\nif (detectedCallback != null)\n {\n detectedCallback.Invoke(new DeviceItem(), container, nativeTexture,width, height);\n }\n","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"因爲使用了 YOLO 機器學習框架，項目還涉及大量的 C++ 開發，除了 YOLO V3 的配置、學習、數據訓練還有 C++ 與 C# 的數據通信，爲了能使 Unity 3D 順利調用 YOLO 也是費了很大力氣，在工程源碼中封裝了 YoloWrapper 可以對封裝的 DLL 進行調用。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"codeblock","attrs":{"lang":"text"},"content":[{"type":"text","text":"yolo V3 封裝\n這一階段使用AlexeyAB在Windows上配置Yolo V3並實現運行和視頻識別\n目前系統封裝瞭如下主要函數\n\n//定義C#的Debug函數，方便調試\ntypedef void(*FuncPtr)(const char *);\n//傳入Debug託管函數\nextern \"C\" YOLODLL_API void set_debug(FuncPtr fp);\n//傳入是否展示Opencv渲染輸出\nextern \"C\" YOLODLL_API void set_show(bool s);\n//測試callback\nextern \"C\" YOLODLL_API void test(char* s);\n//僅能使用NEt視頻流，Web視頻流的識別\nextern \"C\" YOLODLL_API bool detect_net( char* filename, char* type, float thresh , bool use_mean);\n//配合上一函數使用\nextern \"C\" YOLODLL_API int update_tracking(uchar* data, bbox_t_container &container,int &w,int &h);\n//輔助色彩轉換函數\nextern \"C\" YOLODLL_API int bgr_to_rgb(const uint8_t* src, const size_t data_length, uchar* des);\n//輔助大小轉換（圖片太大時候使用）\nextern \"C\" YOLODLL_API int resize(const uint8_t* src, const size_t data_length, int w, int h, uchar* des);\n//初始化，傳入Yolo v3cfg、weights等\nextern \"C\" YOLODLL_API int init(const char *configurationFilename, const char *weightsFilename, const char* names, int gpu);\n//識別單張圖片文件\nextern \"C\" YOLODLL_API int detect_image(const char *filename, bbox_t_container &container);\n//識別單張圖片文件bytes\nextern \"C\" YOLODLL_API int detect_mat( uint8_t* data, const size_t data_length, bbox_t_container &container, float thresh, bool use_mean);\n//關閉系統\nextern \"C\" YOLODLL_API int dispose();\n","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"在智能硬件控制方面本次採用的是開源硬件 NodeMCU，雖說是硬件，但是經過封裝之後，採用 C++ 的編程習慣可以順利的進行端口控制和數據交互，在本次項目中採用舵機控制進行攝像機的轉向，通過馬達對小車進行運動控制，通過超聲波進行避障控制。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https://static001.geekbang.org/infoq/6c/6ce0710ab1195afdca0e3df7797038f0.png","alt":null,"title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"codeblock","attrs":{"lang":"text"},"content":[{"type":"text","text":"//loop函數，循環檢測前方是否有障礙物，同時處理服務器\nvoid loop() {\n//超聲波測距\n digitalWrite(trigPin, LOW); \n delayMicroseconds(2); \n digitalWrite(trigPin, HIGH);\n delayMicroseconds(10); \n digitalWrite(trigPin, LOW);\n duration = pulseIn(echoPin, HIGH);\n distance = ((duration/2) / 29.1);\n if(disLeng<3){\n disAvg[disLeng]=distance;\n disLeng++;\n }else{\n disAvg[0]=disAvg[1];\n disAvg[1]=disAvg[2];\n disAvg[2]=distance;\n }\n// 距離控制，過近則停止運動\nif((disAvg[0]+disAvg[1]+disAvg[2])/3<10){\nstop_motors();\n}\ndelay(50);\n//處理服務器響應\n server.handleClient();\n delay(50);\n}\n","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"最終，項目經過一個多月的開發，形成初步可演示系統。期望藉助 Agora 挑戰賽的平臺，集合小夥伴們的力量，一起豐富擴展這個平臺，也期望能爲各領域開發者提供一些新的想和和實踐。","attrs":{}}]},{"type":"heading","attrs":{"align":null,"level":1},"content":[{"type":"text","text":"06 寫在最後","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"關於本次項目","attrs":{}},{"type":"text","text":"：項目目前只是本地 AI 識別 + Agora 音視頻平臺 + 雲信令消息通信 + 智能硬件形成的一個小型綜合管理平臺，而對於這個平臺的最終形態應該是：","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"bulletedlist","content":[{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"雲服務 AI 識別中臺、可配置模型算法庫、完善的事件處理流程。","attrs":{}}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"雲服務設備管理平臺，對接入的各類硬件傳感設備進行綜合管理、數據輸入輸出。","attrs":{}}]}]},{"type":"listitem","attrs":{"listStyle":null},"content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"智能生態：以 Agora 音視頻、雲信令等開發 APP 應用於機頂盒、居家機器人、監護設備，以智能硬件等進行家居設備如煙感、紅外、一鍵 SOS 等應用開發。","attrs":{}}]}]}],"attrs":{}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"當然做起來這一套系統還需要大量的人力物力投入，也需要更多的系統設計和開發，道阻且長。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https://static001.geekbang.org/infoq/66/66b49a4926095febe2c1e5ba72974942.png","alt":null,"title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}}]}