特斯拉披露自家超算集羣雛形，最新版本超算有望登頂世界第一？

{"type":"doc","content":[{"type":"blockquote","content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"特斯拉選擇的是純視覺的自動駕駛方案，這種方案對傳感器的依賴較弱，但需要極強的數據處理和 AI 能力，這就使得自研適應性強的超級計算機顯得很有必要。"}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"隨着自動駕駛的不斷成熟，自動駕駛汽車公司對算力的需求正在呈指數級增長。在 2021 年計算機視覺和模式識別會議 ("},{"type":"link","attrs":{"href":"http:\/\/cvpr2021.thecvf.com\/","title":"xxx","type":null},"content":[{"type":"text","text":"CVPR 2021"}]},{"type":"text","text":") 上，特斯拉特斯拉人工智能與自動駕駛視覺總監（Director of AI and Autopilot Vision） "},{"type":"link","attrs":{"href":"https:\/\/twitter.com\/karpathy","title":"xxx","type":null},"content":[{"type":"text","text":"Andrej Karpathy"}]},{"type":"text","text":" 公佈了自家的第三個超級計算機集羣，他聲稱這是還未發佈的超級計算機 Dojo（Dojo 發音源自日語，意爲 “道場”）的開發原型版本。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"目前，這一開發原型版本的每秒浮點運算能力（FLOPS）已經達到世界第五的水平，而其正式版本，超級計算機 Dojo 將超越目前世界排名第一的日本超級計算機富嶽（Fugaku，富士山的別名）。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"heading","attrs":{"align":null,"level":2},"content":[{"type":"text","text":"特斯拉用超級計算機來做什麼"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"其實早在 2019 年的特斯拉自動駕駛開放日 ("},{"type":"link","attrs":{"href":"https:\/\/www.youtube.com\/watch?v=-b041NXGPZ8","title":"xxx","type":null},"content":[{"type":"text","text":"Autonomy Day"}]},{"type":"text","text":") 上，特斯拉 CEO 伊隆·馬斯克就介紹過 Dojo 項目。彼時，馬斯克提到，“那是一臺超級強大的訓練電腦，目標是能夠接收大量數據並在視頻級別進行培訓，並使用 Dojo 程序或 Dojo 計算機對大量視頻進行無監督的大規模訓練 ("},{"type":"link","attrs":{"href":"https:\/\/www.guru99.com\/supervised-vs-unsupervised-learning.html","title":"xxx","type":null},"content":[{"type":"text","text":"unsupervised massive training"}]},{"type":"text","text":")”。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"Dojo 已經是特斯拉第三個自研的超級計算機項目了。那麼，作爲一家自動駕駛的車企，特斯拉爲何要執着於打造超級計算機呢？"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"超級計算機（Super Computer），通常是體量巨大、造價高昂的設備，擁有數以萬計的處理器，其能夠執行一般個人電腦無法處理的高速運算，規格與性能比個人計算機強大許多。常用於需要大量運算的工作，譬如數值天氣預報、運算化學、分子模型、天體物理模擬、汽車設計模擬、密碼分析等。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"對於自動駕駛車企而言，典型的自動駕駛解決方案有三種，分別是：1）基於視覺主導，採用 GPS 地圖結合 AI 人工智能進行自動駕駛；2）基於激光雷達主導，視覺輔導，採用高精度地圖和人工智能進行自動駕駛；3）基於車聯網主導，多種傳感器融合的人工智能自動駕駛。特斯拉選擇的是第一種純視覺的自動駕駛方案，這種方案對傳感器的依賴較弱，但需要極強的數據處理和 AI 能力，這就使得自研適應性強的超級計算機顯得很有必要。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"在馬斯克的介紹中，Dojo 將配合無監督學習算法（unsupervised learning）來減少特斯拉對於人工標註數據的工作量，進而幫助其實現指數級的數據訓練效率提升。（注：無監督學習算法即無需人工對訓練數據集進行標註，系統可以自行根據樣本間的統計規律對樣本集進行分析。如不給任何額外提示的情況下，僅依據一定數量“狗”的圖片特徵，將“狗”的圖片區分出來）。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"heading","attrs":{"align":null,"level":2},"content":[{"type":"text","text":"Dojo 的性能如何"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"在 2019 年特斯拉 AI Day 現場，馬斯克說到“Dojo 使用我們自己的芯片和針對神經網絡訓練而優化的計算機架構，而不是 GPU 集羣。如果我沒弄錯，這將是世界上最好的”。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"如今，對於 Dojo 的雛形機，Karpathy 在 2021 年計算機視覺和模式識別會議 (CVPR 2021) 上表示，“我們展示的是使用 720 個 80GB 版本的 8x A100 節點構建的集羣。這是一臺巨大的超級計算機，就每秒浮點（FLOPS）運算次數而言，我認爲它可能是全球第五的超級計算機。第五位目前由英偉達公司的 Selene 集羣佔據，該集羣擁有非常相似的架構和類似的 GPU 數量（4480 對我們的 5760，所以少一點）”。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"而對於 Dojo 最終發佈的期望，特斯拉在 2020 年發佈的推文中表示，Dojo 能夠實現每秒千萬億次浮點運算（1000 PFLOPS），這將使得 Dojo 成爲一款真正的尖端超級計算機。未來，Dojo 的算力將要達到每秒鐘 exaFLOP（百億億次, 是千萬億次 PFLOPS 的 1000 倍) 的級別，並且運算速度要超過富嶽（Fugaku），成爲世界第一。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"而富嶽是目前世界上速度最快的超級計算機，其浮點計算的峯值速度可達到 442PFLOPS（每秒 442 x 1 千萬億次浮點運算），最高性能超過 1000 PFLOPS。"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https:\/\/static001.infoq.cn\/resource\/image\/27\/48\/27f599d8880cef7435ef26a8108fa148.jpg","alt":null,"title":"","style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":"","fromPaste":false,"pastePass":false}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"image","attrs":{"src":"https:\/\/static001.infoq.cn\/resource\/image\/9f\/17\/9fa316c5fb1479bdec4b6cba57952f17.jpg","alt":null,"title":"","style":[{"key":"width","value":"75%"},{"key":"bordertype","value":"none"}],"href":"","fromPaste":false,"pastePass":false}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"在 2020 年的世界超級計算機大會上（"},{"type":"link","attrs":{"href":"https:\/\/sc20.supercomputing.org\/","title":"xxx","type":null},"content":[{"type":"text","text":"SC20"}]},{"type":"text","text":"），位列前五的超級計算機分別是，日本的富嶽 Fugaku，美國的 Summit ，美國的 Sierra，中國的“神威·太湖之光” 和美國的 Selene。"}]}]}