揭祕 Amazon Go 無人商店是如何煉成的！

{"type":"doc","content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"人工智能（AI）已經發展了多年，機器學習（ML）和深度學習也早已不是陌生的概念。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"長期以來，ML 技術僅限於少數大型科技公司和專業學習研究人員，但是，當雲計算進入 AI 領域之後，ML 逐漸發展成爲一種主流的技術。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"算法、計算能力與數據的潛力被激發出來，以ML 爲代表的人工智能正在走向舞臺的中央，併成爲金融、零售、時尚、房地產、醫療保健、製造業等多個行業的核心競爭力。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https://static001.geekbang.org/infoq/00/00cb78d4abb7f6a1f5d344644f1571d7.png","alt":"圖片","title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"亞馬遜雲科技早就注意到了這一臨界點的到來，因爲企業中的 AI/ML  的用例正在顯著的增加。通過智能交互、個性化和推薦系統等功能，客戶體驗正在發生着顯著的變化。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https://static001.geekbang.org/infoq/6a/6aff7319b7c8b4a4d51fde27be788155.png","alt":"圖片","title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"比如在零售領域，基於 AI 的需求預測將錯誤減少了 30-50%，同時將由於產品不可用導致的銷售額損失減少了 65%。可以說 AI/ML 正在幫助公司做出更好、更快的決策。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"Amazon 本身就是一個非常好的例子。","attrs":{}},{"type":"text","text":"經歷了多年 ML 探索實踐，Amazon 成爲了你今天所看到的由 ML 驅動的企業。ML 是 Amazon 創新最重要的一個部分。隨着時間的推移，Amazon 持續改進早期的簡單的個性化模型，並將其應用到了如 Amazon Prime 這樣的產品中。這樣的轉變即便對 Amazon 而言也是相當巨大的。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https://static001.geekbang.org/infoq/51/51d541806ba36a58f4df5b1a70c76fac.png","alt":"圖片","title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"但是想做到這一點並不難，我們始終相信這是每個企業都可以做到的。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"2015 年 12 月 5 日，亞馬遜宣佈推出革命性線下實體商店—— Amazon Go。在 2018年 1 月 22 日，Amazon Go 向公衆開放。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"那麼，Amazon Go 是如何實現從傳統收銀結算，到 “Just Walk Out” 的跨越的呢？看看本屆 INNOVATE 上我們的技術大咖費老師如何解答！","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"在實現 “Just Walk Out” 的過程中，","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"我們要解決一個基礎的問題即，","attrs":{}},{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"到底是哪個人，拿了哪件東西","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https://static001.geekbang.org/infoq/66/66fcf55024a9afb2b106ce236277cc93.png","alt":"圖片","title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"看起來這是一個簡單的目標，其實擺在我們面前的是一個巨大的挑戰。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"試想一下，商場里布滿擁擠的人羣，人們在購物，孩子們四處奔跑，嬰兒車上的嬰兒還在熟睡，人們並不總是拿上商品然後離開 —— 他們往往挑選一個商品，看看它，然後把它放回貨架上；或者有時他們把它放回另一個貨架上。 ","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"而這意味着","attrs":{}},{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"龐大的數據處理與計算的需求","attrs":{}},{"type":"text","text":"。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https://static001.geekbang.org/infoq/d6/d69983d1fd5c15777907d429c9fe1441.jpeg","alt":"圖片","title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"爲了解決這一問題，我們打造了這樣的架構方案。","attrs":{}},{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"它由流媒體服務、入口出口管理服務和 Just Walk Out Technology 共同組成。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"這三個模塊一起幫我們解決“在人海中，到底是誰拿了哪件商品”這一“終極問題”。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https://static001.geekbang.org/infoq/0b/0bd0d4857d714630b652c20b495783e7.png","alt":"圖片","title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"首先來說流媒體服務，","attrs":{}},{"type":"text","text":"圖中頂部的部分代表了店鋪中部署的設備 ：這些設備包括了","attrs":{}},{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"專門製作的攝像頭以及我們用於商品銷售的傳感器","attrs":{}},{"type":"text","text":"。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"流媒體服務負責將視頻從商店中運行的攝像頭傳輸到需要在雲中。","attrs":{}},{"type":"text","text":"爲了使算法發揮作用，就需要在客戶挑選或放回商品時可靠地捕捉視頻圖像以實現 “真實時刻”。而處理視頻的算法則在亞馬遜雲科技的雲中運行。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https://static001.geekbang.org/infoq/a3/a3d6b9a71f1e16c2812835ed5365b091.png","alt":"圖片","title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"一旦將視頻傳入雲端，我們需要提供一種使它們可用於算法進行處理的方法。","attrs":{}},{"type":"text","text":"因此，我們準備了一套服務負責存儲和索引這些視頻，它們提供了視頻檢索的接口，這些接口由視頻處理應用所使用。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"此外，在現實世界中，事情並不總是順利運行，所以必須要處理各種各樣的意外。因此，我們也設計了","attrs":{}},{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"檢測攝像頭故障 、網絡延遲、和服務器故障的系統 ","attrs":{}},{"type":"text","text":"，來有效地處理這些故障。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"基於這些高可用性、高吞吐量的服務集羣們提供的基礎架構，我們得以","attrs":{}},{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"構建  “just walk out”  技術","attrs":{}},{"type":"text","text":"。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"接着我們來談談出口入口管理服務，","attrs":{}},{"type":"text","text":"與傳統商店不同，在 Amazon Go 這裏沒有收銀櫃臺。但是，仍然需要獲得支付工具（信用卡），在客戶離開商店後，我們可以使用該工具向客戶收取費用。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"爲此我們建立了一種體驗，讓買家使用 Amazon Go 的應用進入商店，並將他們與他們的 Amazon 帳戶和存儲的付款方式相關聯。我們統稱這些我們的","attrs":{}},{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"“入口和出口”服務，他們負責管理客戶會話和相關付款方式","attrs":{}},{"type":"text","text":"。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"在這個過程中，我們面臨的挑戰之一是需要打造感覺自然且無縫的“流暢感”。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"因此我們設計了入口門的硬件和軟件，使客戶可以自然的朝下掃描二維碼，而系統可快速地驗證客戶身份，並打開門，所有的這一切通常在不到一秒鐘的時間內完成。在出口上我們也做了同樣的設計，以全面的免去客戶不必要的動作。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https://static001.geekbang.org/infoq/a8/a8ba4a2b365a4f919ae415c1f9e3e7e9.png","alt":"圖片","title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"另一個挑戰是如何能夠適應現實世界的情況，因爲現實中的場景比模型複雜的多。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"例如，在理想的世界中，我們希望每一位客戶在進入商店時只掃描一次。然而，有時人們掃描手機，但後來他們分心，並開始與朋友交談，所以他們掃描兩次之前進入商店。我們的系統必須足夠聰明才能處理所有這些邊緣案例。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"最後，我們需要","attrs":{}},{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"明智地管理家庭購物的場景","attrs":{}},{"type":"text","text":"，或者說，一組打算共同付款的客戶。在這種情況下，某人是一組領導人，在組中的每個成員進入商店時掃描他的手機。但顯然他們中的任何人都可以隨時離開商店，所以會話管理邏輯必須在這些情況下正常工作。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"因此，","attrs":{}},{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"作爲入口/出口服務的一部分，我們構建了用於驗證客戶帳戶、組關聯和會話管理的系統。","attrs":{}},{"type":"text","text":"總的來說，這些服務的輸出是當前在商店中處於活動狀態的一組客戶的會話以及每個服務的相關支付方式。 ","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"最後來說核心的 Just Walk Out 技術，“Just Walk Out”  技術是架構的核心部分。","attrs":{}},{"type":"text","text":"這是系統的大腦。","attrs":{}},{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"它基於深度學習算法，解決的是 “誰拿了什麼” 的問題","attrs":{}},{"type":"text","text":"。 ","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https://static001.geekbang.org/infoq/98/980703af396dbebcfc86795394801989.png","alt":"圖片","title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"首先讓我們看看如何解決 “誰” 這個問題。","attrs":{}},{"type":"text","text":"爲了解決它，我們需要的是從店鋪入口到出口的客戶的全程的定位。因此這個方案中包含","attrs":{}},{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"三個主要模塊：定位器、鏈接器和複雜狀態解析器","attrs":{}},{"type":"text","text":"。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"在 Amazon Go 店鋪里布置的每個攝像頭都會產生一個 3D 點雲。基於攝像頭的校準參數們將這些參數聚合爲一個全局表示，並提取移動對象。當然並非所有的移動物體對應的都是人，還可能是籃子、推車、嬰兒車等。人員定位器查看分段的數據，並決定它是某人或者是另一個對象。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"然後，我們將人員在一個幀中的位置鏈接到下一個幀，爲每個人的數據分配一個標籤，鏈接器將標籤從一個幀保留到下一個幀。有時候，當人們彼此接近時，這使得識別變得困難，稱之爲糾結狀態。因此，要對人員位置的不確定性進行建模，並通過運動和圖像特徵來解決人員位置的不確定性的問題。 ","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"現在我們已經知道如何解決“誰”的部分，那麼讓我們再來看看","attrs":{}},{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"“拿了什麼”","attrs":{}},{"type":"text","text":"這部分。這一部分","attrs":{}},{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"面臨的主要挑戰是——在 Amazon Go 我們有許多商品，包括即食食品、餐具包、飲料。而這些商品在視覺上看起來往往會非常相似。 ","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https://static001.geekbang.org/infoq/7f/7f11a8b23329ddb3f2a80290e55f3604.png","alt":"圖片","title":null,"style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":null,"fromPaste":true,"pastePass":true}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"結合產品分類（通過索引方案）和基於殘差網絡的細粒度識別來解決這個問題。這種方法可識別成千上萬的產品，並且能夠適應店鋪裏照明變化、陰影和反射的影響。","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"這樣通過","attrs":{}},{"type":"text","marks":[{"type":"strong","attrs":{}}],"text":"流媒體服務、入口出口管理服務和 Just Walk Out Technology ","attrs":{}},{"type":"text","text":"的共同合作，我們就這樣打造了一個具備流暢體驗的無人店鋪~","attrs":{}}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"原文鏈接：","attrs":{}},{"type":"link","attrs":{"href":"https://mp.weixin.qq.com/s/aGCMEK1LSOXsgWNTtFZRqw","title":"","type":null},"content":[{"type":"text","text":"揭祕 Amazon Go 無人商店是如何煉成的！","attrs":{}}]}]}]}