阿里巴巴 AI 「看圖回答」 測驗擊敗微軟、臉書、特斯拉，準確率還首次超越人類！

陳宜伶
2021-08-25

看圖回答問題是人類生活及溝通的基本條件，但是對 AI 來說卻是一項高難度任務。

阿里巴巴達摩學院打造出來的 AI 語言模型 AliceMind，幾天前首度打破圖像問答（VQA）世界紀錄，答題準確率甚至超越人類基準，並且擊敗同樣有參加挑戰的微軟、FB 隊伍，象徵達摩學院的人工智慧技術邁出關鍵一步。

VQA 挑戰是什麼？

圖像問答（Visual Question Answering）挑戰的緣起，是因為國際電腦視覺與技術辨識大會 （Conference on Computer Vision and Pattern Recognition，CVPR）希望鼓勵企業攻克 AI 多模態機器學習（MultiModal Machine Learning）的難題，因此從 2015 年開辦 VQA 挑戰賽，吸引來自世界各地的網路企業、科研單位參賽。

今年的 VQA 挑戰賽和往年一樣，題庫包含了超過 25 萬張真實照片，總共有 110 萬道題目。這些題目會考驗 AI 是否能辨別圖像，比如說在一張人群的照片中算出有幾個兒童、或是在圖片中辨認出書桌上的車鑰匙，進而推測房間主人是有車的。

VQA 技術已經被廣泛導入阿里巴巴平台，像是它的 AI 客服機器人「小蜜」（Alime）就已經被淘寶、天貓商家等電商平台採用。消費者輸入問題後，AI 客服會根據商品資訊和顧客問題給出答案。

另一方面，VQA 技術不僅能運用在電商，還可用於醫學圖像辨識，以及電動車的智慧駕駛分析。

阿里巴巴的 AI 模型為何成績能夠超越人類？

這幾年人工智慧（AI）逐漸滲透到各行業，也推動更多科技革命，AI 技術逐漸成為企業數位轉型、對抗疫情，並讓經濟重返正軌的重要力量。

由阿里巴巴達摩學院打造的 AI 深度語言模型系統 AliceMind 在這次的 VQA 測驗中，答題準確率拿到 81.26%，首次超越了人類答題的準確率 80.83% ，更讓馬雲投資的達摩學院在 AI 發展上取得重大進展。

AliceMind 採用了多種專有技術，包括多樣化的視覺表示（diverse visual representations）、「多模態」預訓練語言模型（multimodal pretrained language models）、「跨模態」語義融合和對齊技術（ adaptive cross-modal semantic fusion and alignment technology）。這些技術不僅可以讓阿里巴巴的 AI 理解問題並分析圖像，還可以讓 AI 用近似人類的語感回答問題。

阿里巴巴達摩院自然語言處理（NLP）負責人 Si Luo 表示：「這代表我們在『機器學習』領域又取得了一個重要里程碑，AliceMind 在視覺與文本的『多模態』理解及推理上，測試分數媲美人類認知水準，彰顯了我們研發 AI 的努力成效。」

打造出這款 AI 模型的達摩學院是什麼來歷？

2017 年，馬雲認為阿里巴巴應該要把眼光放遠，致力解決未來世界經濟、社會等問題，在此願景下成立了研究單位「達摩學院」（ DAMO Academy），號稱要在 3 年投入超過 1000 億人民幣，將重點放在基礎科學和顛覆式技術創新研究上。

Si Luo 表示，人工智慧分為運算智慧、感知智慧、認知智慧及創造智慧 4 個層次。這次 AliceMind 參與的 VQA 測試內容屬於認知智慧部份。

負責人也補充說，這不代表有一天我們會被機器人取代，反而這些智慧機器可以用來輔助我們的日常工作和生活，因此人們可以很專注在他們擅長的創作上。

資料來源：https://buzzorange.com/techorange/2021/08/25/vqa-ai-alibaba/

Veratasium 係一個好有質素嘅講科普嘅channel。

喺呢個video裡面，佢有講到科學家嘅研究 debunk（擊破）咗一個myth（迷思 / 誤會）：就係呢個世界有visual learner、audio learner同kinaesthetic learner之分。

其實人學嘢，都係用multimodal（多模式）嘅方法去學最有效嘅。

RWTH AACHEN & NCTUEE Online Virtual Workshop~please feel free to join.

NCTUEE & RWTH Aachen Online Virtual Workshop
交大電子與德國Aachen大學 線上雙邊研討會

Monday 14th December 2020, 15:30 – 19:00 CST
https://meet.google.com/jfj-cgxp-xtb
(聆聽時，建議可關閉鏡頭及麥克風，以免影響會議進行)

15:30-15:35 Welcome!
15:35-16:05 Prof. Pei-Wen Li, NCTU
“Germanium Quantum Dots for CMOS-compatible Photonics and Quantum Electronics”
16:05-16:35 Prof. Andrei Vescan, CST, RWTH Aachen University
“GaN Devices and Technology in Aachen”
16:35-17:05 Prof. Sven Ingebrandt, RWTH Aachen University
“Micro- and Nanotechnology for Biomedical Sensors”
17:05-17:15 Pause
17:15-17:45 Prof. Der-Hsien Lien, NCTU
“Challenges to developing high-performance monolayer devices and solutions”
17:45-18:15 Prof. Regina Dittmann, Forschungszentrum Jülich
“Redox-based memristive devices: From basic understanding to neuromorphic applications”
18:15-18:45 Prof. Yu-Ting Cheng, NCTU
“A Size Scalable Micromachined Multimodal Probe for Ischemia Muscle Monitoring”
18:45-19:00 Exchange of Contact Information

The BMW X7 is the first car to fuse the presence, exclusivity and spaciousness of a luxury model with the agile and versatile driving properties expected of a Sports Activity Vehicle (SAV).

A new dimension in luxury: The first BMW X7 combines the presence, exclusivity and spaciousness of a luxury car with the versatile, agile driving properties of a Sports Activity Vehicle (SAV). Production will take place at BMW Plant Spartanburg (USA). Market launch will be March 2019.
The largest BMW X model is 5,151 millimetres in length, 2,000 millimetres wide and 1,805 millimetres tall, and has a wheelbase of 3,105 millimetres. Its clear and precise design language spans a punchy, extremely prominent front end, large windows, high ground clearance, a long roofline and a two-section split tailgate. Exclusive detailing includes extensive chrome elements. LED headlights are standard, BMW Laserlight optional.
Generous interior space across three rows of seats. Seven seats as standard. Middle row can be specified with two individual comfort seats as an option. Uncompromised space in the third row, complete with armrests, cupholders and USB ports. All seats are electrically adjustable. Vernasca leather trim as standard. Boot capacity can be expanded from 326 litres to a maximum 2,120 litres.
20-inch light-alloy wheels as standard, 21- and 22-inch light-alloy wheels optional.
Design Pure Excellence, M Sport package and model-specific BMW Individual features allow carefully judged individualisation.
Four-zone automatic climate control, ambient lighting and three-section panoramic glass roof as standard. Five-zone automatic climate control, Ambient Air package, Panorama glass roof Sky Lounge, controls with glass applications, Bowers & Wilkins Diamond Surround Sound System and Rear-seat entertainment Professional optional.
Air springs at both axles and Adaptive suspension with electronically controlled dampers are standard. Integral Active Steering and Executive Drive Pro with active roll stabilisation optional. M Sport differential standard on the BMW X7 M50d (fuel consumption combined: 7.4 – 7.0 l/100 km [38.2 – 40.4 mpg imp]; CO2 emissions combined: 193 – 185 g/km) and optional for the BMW X7 xDrive50i (fuel consumption combined: 11.4 l/100 km [24.8 mpg imp]; CO2 emissions combined: 261 g/km) and BMW X7 xDrive40i (fuel consumption combined: 9.0 – 8.7 l/100 km [31.4 – 32.5 mpg imp]; CO2 emissions combined: 205 – 198 g/km). Optional Off-Road package enables selection of xSand, xGravel, xRocks and xSnow driving modes at the touch of a button.
Full range of state-of-the-art driver assistance systems (availability may vary between markets). Active Cruise Control with Stop & Go function, Driving Assistant Professional with Steering and lane control assistant, Lane Change Warning and Lane Departure Warning, Lane Keeping Assistant and side collision protection, evasion aid, Crossing traffic warning, Priority warning and Wrong-way warning. Latest generation of the BMW Head-Up Display. Emergency Stop Assistant (not available in Europe). Parking Assistant including rear view camera and Reversing Assistant as standard.
BMW Live Cockpit Professional with BMW Operating System 7.0 as standard. Fully digital instrument cluster and Control Display each with 12.3-inch screen diagonal. BMW Operating System 7.0 enables intuitive und multimodal operation via touchscreen, iDrive Controller, steering wheel buttons, voice control and gesture control.
BMW Intelligent Personal Assistant performs role of digital co-driver and vehicle expert, and activates in-car experiences. Operated by natural voice command. BMW Digital Key allows customers to use their smartphone for vehicle access and engine start-up. Remote Software Upgrade updates vehicle functions over the air.