SlideShare a Scribd company logo

Intel IoT Edge Computing 在 AI 領域的應用與商機

•
•
Amazon Web Services
Amazon Web Services

近年來，物聯網(IoT)產業正以驚人的速度成長中，相關的應用與服務也陸續問市，而包含物聯網(IoT)、人工智慧(AI)與機器學習(machine learning)等科技的革新，致使從新創企業乃至傳統產業皆投入這一波新科技的發展，更添產業動能，尤其是在製造業、運輸及物流、公共安全、智慧城市等幾大面向。 據消費及商業企業服務供應商JT Group白皮書預估，到2020年全球物聯網累計裝置量(installed base)將達204.1億台。更多企業也將改變其商業模式，由產品導向轉為服務導向，客戶機構採購的不再只是硬體產品，而是尋求整套完整的解決方案。AWS 即將於3/7 (四) 舉辦『AWS AIoT未來智造高峰論壇』，持續以創新、全球視野帶領您與您的企業一起探索物聯網價值最大化的關鍵。

Related slideshows

Coscup2021 open source network os for datacenter
Coscup2021 open source network os for datacenterCoscup2021 open source network os for datacenter
Coscup2021 open source network os for datacenter
 
DPDK KNI interface
DPDK KNI interfaceDPDK KNI interface
DPDK KNI interface
 
BUD17-400: Secure Data Path with OPTEE
BUD17-400: Secure Data Path with OPTEE BUD17-400: Secure Data Path with OPTEE
BUD17-400: Secure Data Path with OPTEE
 
1 of 26
Download to read offline
Intel IoT Edge Computing 在 AI 領域的應用與商機 • James Shih • Director of Platform Application • IoTG, INTEL
Internet of Things Group 1. IDC 2. MC/EDC: The Digital Universe of Opportunities 3. Goldman Sachs 4. IMS Research 2 Things network cloud 50B devices1 44 zetabytes2 212B sensors1 85% unconnected4 Cost of Sensors1 Past 10 Years Cost of Bandwidth2 Past 10 Years Cost of Processing3 Past 10 Years2X 40X 60X
Internet of Things Group InternetofThings-ThreephasesofIoTdeployment CONNECTED SMART AUTONOMOUS Connect the Unconnected Smart & Connected Things Devices Communicate Amongst Themselves at Local IoT Gateway is Fundamental in Moving Data for IoTEdge Computing is Fundamental for IoT
Intel Confidential Intel Confidential
MANUFACTURING TRANSPORTATION ENERGY VIDEO HEALTHCARE RETAIL DRONES PHONES SMART CITIESPCs Driversforedge Latency Bandwidth Security connectivity Devices/ Things Core Network CloudData Center NetworkHub orregional DataCenter EdgeCompute Node INCREASINGneedforedgecompute WILLDRIVEIOTINVESTMENTS Source: IDC future scape 2018 IOT predictions IT spend on edge iinfrastructure. Driven by deployments of converged IT/OT systems that reduce the time to value of data collected from their connected devices $16.3BBy 2020
Devices/edge network Cloud/datacenter INTEL’s data-centric TRANSFORMATION AutonomousTHINGS–EDGE–NETWORK–CLOUD
iNTELIOTSTRATEGY Replace picture SCALETHESTRATEGYWITHVERTICALFOCUS BESTINCLASSSILICONFORIOT ENABLE THEEDGE ComputerVISION
Intel® CONFIDENTIAL – all material covered by NDA Vision is Driving Artificial Intelligence at the Edge 2500petabytes Daily videosurveillancedata generatedin2019
Intel® CONFIDENTIAL – all material covered by NDA 9 Deep learning revenue to grow from $655 Million in 2016 to $35 Billion by 2025 --a CAGR of 53%2 The overall computer vision market to reach $17.38 Billion by 20231 The video analytics market to reach $11.17 Billion by 2022 at a CAGR of 21.5%3 Bandwidth & Storage Costs Near Real Time Response Needs Forensic to Predictive Accuracy Privacy DeepLearning 1. Marketsandmarkets, Computer Vision Market, 2017 2. Tractica, 2Q, 2017 3. Marketsandmarkets, Video Analytics Market, 2017
Intel® CONFIDENTIAL – all material covered by NDA Industrial SmartCities Healthcare Retail 10 Fast & Accurate Defect Detection Identify Congestion & Redirect Traffic Interpret Shopper Behavior & Improve Inventory Tracking Diagnose Illnesses with Real- time Feedback Behavior Anomalies & Property Demographics DigitalSecurity&Surveillance
Internet of Things Group If need higher DL performance utilize: Openvino™Toolkit Writeonce - deploytoCPU,GPU,FPGA&VPUAccelerators - LeveragecommonLibraries/Frameworks/networks Integrated Graphics (on die with Intel CPU) Accelerators (on board or add-in cards) VPU FPGA Host CPU App & Media Processing, IO, Storage If need higher performance utilize:
DEEP LEARNING Inference Engine Open CV CV Library (Kernel & Graph APIs) Open CL >100 Networks Supported CV Algorithmes COMPUTER VISION ONNX HIGH PERFORMANCE & SCALABILTY FOR THE EDGE AGNOSTIC, COMPLEMENTARY TO MAJOR FRAMEWORKS CROSS-PLATFORM FLEXIBILITY Model Optimizer *Other names and brands names may be claimed as the property of others
Intel® CONFIDENTIAL – all material covered by NDA Load, infer GPU = Intel CPU with integrated graphics processing unit/Intel® Processor Graphics OpenCL and the OpenCL logo are trademarks of Apple Inc. used by permission by Khronos *Other names and brands may be claimed as the property of others. Caffe* TensorFlow* MxNet* IR = Intermediate Representation format Convert & optimize to fit all targets CPUPlugin GPUPlugin FPGAPlugin MyriadPlugin Model Optimizer Convert & Optimize Extendibility C++ Extendibility OpenCL™ Extendibility OpenCL/TBD Extendibility TBD Trained Model Inference Engine Common API (C++) Optimized cross- platform inference Model Optimizer  What it is: Preparation step -> imports trained models  Why important: Optimizes for performance/space with conservative topology transformations; biggest boost is from conversion to data types matching hardware. Inference Engine  What it is: High-level inference API  Why important: Interface is implemented as dynamically loaded plugins for each hardware type. Delivers best performance for each type without requiring users to implement and maintain multiple code pathways. IR .data IR 13
Performance&Scalability Varietyofformfactors M.2,Mini-PCIe,PCI-E DeeplearningAlgorithm portabilitywithOpenVINO AnnouncingIntel®VisionAcceleratorDesigns Intel®Vision AcceleratorDesign with Intel® Arria® 10 FPGA Intel®Vision AcceleratorDesign with Intel® Movidius™ VPU 1x->8xMyriadX FPGA NEW MyriadX
Intel IoT Edge Computing 在 AI 領域的應用與商機
2018INTELVISION PORTFOLIOLaunch STRONG INDUSTRY PARTNERSHIP Other names and brands may be claimed as the property of others. Sale Pipeline as of October INTEL®VISION ACCELeRATORDESIGN INTEL®VISION ACCELERATORDESIGN With Intel® Movidius™ VPU 1X→8XVPU With Intel® Arria™ 10 FPGA Writeonce | Leveragecommonalgorithms deploytoCPU,GPUandAIAccelerators
intel®ai:InproductionA LEADING ECOSYSTEM FOR AI AT THE EDGE DEPLOYMENTS HTTP://SOFTWARE.INTEL.COM/AI-IN-PRODUCTION JOINNOW *Other names and brands names may be claimed as the property of others
Intel® CONFIDENTIAL – all material covered by NDA Usbvisiondevkits Intel® Movidius™ Neural Compute Stick + Intel® Movidius™ Myriad™ 2 VPU VisionAccelerator Designproducts Vision Accelerator Kits Intel® Core® Processor + Intel® Vision Accelerator Design with Intel® Arria® 10 FPGAbetter good edge & cloud developers, OEMs, ISVs cloud developers TargetAudience OEMs Integrators, cloud developers, edge developers developers end users Intel®iotMarketReadySolutions Smart Cities Retail Industrial Worker Safety Smart Cities Transportation Visionkits| CSPintegration AWS GreenGrass* Inference Implementation RFPReadykits Health Robotics Retail best Security and Surveillance Intel® Atom™ Processor + Intel® Vision Accelerator Design with Intel® Movidius™ Myriad™ 2 VPU Intel® Atom™ Processor + Intel® Vision Accelerator Design with Intel® Movidius™ Myriad™ X VPU Intel® Core® Processor + Intel® Vision Accelerator Design with Intel® Movidius™ Myriad™ X VPU Intel® Xeon® Processor + Intel® Vision Accelerator Design products Intel® Vision Accelerator Design with Intel® Arria® 10 FPGA Intel® Vision Accelerator Design with Intel® Movidius™ Myriad™ 2 VPU
Intel® CONFIDENTIAL – all material covered by NDA VisionKit poweredbyIEITANK VisionKit poweredbyAAEONUP² Developer Kits to Accelerate Computer Vision Deployments article *Other names and brands may be claimed as the property of others. Intel®distributionof OpenVino™Toolkit Download Free  Learn More Get started quickly with:  Developer resources  Intel® Tech.Decoded online webinars, tool how-tos & quick tips  Hands-on, in-person workshops Support  Connect with Intel engineers & computer vision experts at the Community Forum  UP Squared* Board (Intel Atom® x7-E3950)  AI Core- Intel® Movidius Myriad 2 mini PCIe* VPU  USB camera  Intel Distribution of OpenVINO toolkit  Ubuntu* 16.04 Desktop w/ 4.14 kernel  Intel® System Studio  Arduino Create*  IEI TANK 870-Q170 (6th/7th Gen Intel® Core™ processor)  Intel Distribution of OpenVINO toolkit  Intel® Media SDK  Ubuntu Desktop16.04 Desktop LTS  Intel System Studio link to purchase link to purchase Futureproof design Expeditepath toproduction Accelerate performance 19Optimization Notice
Intel® CONFIDENTIAL – all material covered by NDA 20 Rapid Prototyping, Validation, and Deployment of Deep Neural Network Inference at the Edge T R A I N O P T I M I Z E D E P L O Y Mode l + + + with Intel® Vision Accelerator Designs featuring Intel® Movidius™ Myriad™ X VPU P R O D U C T I Z E your deep neural network on the Intel® Neural Compute Stick 2 and your prototyping host your pre-trained models with the Intel® Distribution of OpenVINO™ toolkit your deep neural network models where desired Write once, deploy everywhere with the Intel® Distribution of OpenVINO™ toolkit D E V E L O P A N D S C A L E through Intel® AI: In Production
Intel® CONFIDENTIAL – all material covered by NDA *Other names and brands may be claimed as the property of others. Intel® Movidius™ VPU Hardware TensorFlow*, MobileNet SSD* and YOLO* v2 Worker Safety Management 21 Intel® Distribution of OpenVINO™ Toolkit MobileNet SSD* YOLO v2* Intel® Arria® 10 FPGA Hardware Caffe*, MobileNet SSD* and CL-DNN Technology Medical Image Detection Intel® Distribution of OpenVINO™ Toolkit MobileNet SSD* CL-DNN* Optimization Notice
22Intel Confidential Whatis5G? • Next generation of wireless networks • Will provide higher speeds, greater capacity, and lower latency • Will be capable of supporting billions of connected devices and ‘things’ • Requires fundamental transformation of the network infrastructure • Extends intelligence throughout the network Reactive, smart, and connected devices Faster data rates Data and the ‘app’ revolution Cellular Comms. 5G 4G 2G 3G
23Intel Confidential 5GEnhancementsWillTransformLives Ultra Reliability and Low Latency (Mission Critical) Healthcare Emergency Services Autonomous DrivingDrones Massive M2M Connectivity Manufacturing Supply Chain/ LogisticsSmart AgricultureSmart Cities Enhanced Mobile Broadband (EMBB) Broadband to HomeMobile Office Virtual and Merged Reality Entertainment
Intel IoT Edge Computing 在 AI 領域的應用與商機
Thank you.
Intel IoT Edge Computing 在 AI 領域的應用與商機

More Related Content

Intel IoT Edge Computing 在 AI 領域的應用與商機

  • 1. Intel IoT Edge Computing 在 AI 領域的應用與商機 • James Shih • Director of Platform Application • IoTG, INTEL
  • 2. Internet of Things Group 1. IDC 2. MC/EDC: The Digital Universe of Opportunities 3. Goldman Sachs 4. IMS Research 2 Things network cloud 50B devices1 44 zetabytes2 212B sensors1 85% unconnected4 Cost of Sensors1 Past 10 Years Cost of Bandwidth2 Past 10 Years Cost of Processing3 Past 10 Years2X 40X 60X
  • 3. Internet of Things Group InternetofThings-ThreephasesofIoTdeployment CONNECTED SMART AUTONOMOUS Connect the Unconnected Smart & Connected Things Devices Communicate Amongst Themselves at Local IoT Gateway is Fundamental in Moving Data for IoTEdge Computing is Fundamental for IoT
  • 6. Devices/edge network Cloud/datacenter INTEL’s data-centric TRANSFORMATION AutonomousTHINGS–EDGE–NETWORK–CLOUD
  • 8. Intel® CONFIDENTIAL – all material covered by NDA Vision is Driving Artificial Intelligence at the Edge 2500petabytes Daily videosurveillancedata generatedin2019
  • 9. Intel® CONFIDENTIAL – all material covered by NDA 9 Deep learning revenue to grow from $655 Million in 2016 to $35 Billion by 2025 --a CAGR of 53%2 The overall computer vision market to reach $17.38 Billion by 20231 The video analytics market to reach $11.17 Billion by 2022 at a CAGR of 21.5%3 Bandwidth & Storage Costs Near Real Time Response Needs Forensic to Predictive Accuracy Privacy DeepLearning 1. Marketsandmarkets, Computer Vision Market, 2017 2. Tractica, 2Q, 2017 3. Marketsandmarkets, Video Analytics Market, 2017
  • 10. Intel® CONFIDENTIAL – all material covered by NDA Industrial SmartCities Healthcare Retail 10 Fast & Accurate Defect Detection Identify Congestion & Redirect Traffic Interpret Shopper Behavior & Improve Inventory Tracking Diagnose Illnesses with Real- time Feedback Behavior Anomalies & Property Demographics DigitalSecurity&Surveillance
  • 11. Internet of Things Group If need higher DL performance utilize: Openvino™Toolkit Writeonce - deploytoCPU,GPU,FPGA&VPUAccelerators - LeveragecommonLibraries/Frameworks/networks Integrated Graphics (on die with Intel CPU) Accelerators (on board or add-in cards) VPU FPGA Host CPU App & Media Processing, IO, Storage If need higher performance utilize:
  • 12. DEEP LEARNING Inference Engine Open CV CV Library (Kernel & Graph APIs) Open CL >100 Networks Supported CV Algorithmes COMPUTER VISION ONNX HIGH PERFORMANCE & SCALABILTY FOR THE EDGE AGNOSTIC, COMPLEMENTARY TO MAJOR FRAMEWORKS CROSS-PLATFORM FLEXIBILITY Model Optimizer *Other names and brands names may be claimed as the property of others
  • 13. Intel® CONFIDENTIAL – all material covered by NDA Load, infer GPU = Intel CPU with integrated graphics processing unit/Intel® Processor Graphics OpenCL and the OpenCL logo are trademarks of Apple Inc. used by permission by Khronos *Other names and brands may be claimed as the property of others. Caffe* TensorFlow* MxNet* IR = Intermediate Representation format Convert & optimize to fit all targets CPUPlugin GPUPlugin FPGAPlugin MyriadPlugin Model Optimizer Convert & Optimize Extendibility C++ Extendibility OpenCL™ Extendibility OpenCL/TBD Extendibility TBD Trained Model Inference Engine Common API (C++) Optimized cross- platform inference Model Optimizer  What it is: Preparation step -> imports trained models  Why important: Optimizes for performance/space with conservative topology transformations; biggest boost is from conversion to data types matching hardware. Inference Engine  What it is: High-level inference API  Why important: Interface is implemented as dynamically loaded plugins for each hardware type. Delivers best performance for each type without requiring users to implement and maintain multiple code pathways. IR .data IR 13
  • 16. 2018INTELVISION PORTFOLIOLaunch STRONG INDUSTRY PARTNERSHIP Other names and brands may be claimed as the property of others. Sale Pipeline as of October INTEL®VISION ACCELeRATORDESIGN INTEL®VISION ACCELERATORDESIGN With Intel® Movidius™ VPU 1X→8XVPU With Intel® Arria™ 10 FPGA Writeonce | Leveragecommonalgorithms deploytoCPU,GPUandAIAccelerators
  • 17. intel®ai:InproductionA LEADING ECOSYSTEM FOR AI AT THE EDGE DEPLOYMENTS HTTP://SOFTWARE.INTEL.COM/AI-IN-PRODUCTION JOINNOW *Other names and brands names may be claimed as the property of others
  • 18. Intel® CONFIDENTIAL – all material covered by NDA Usbvisiondevkits Intel® Movidius™ Neural Compute Stick + Intel® Movidius™ Myriad™ 2 VPU VisionAccelerator Designproducts Vision Accelerator Kits Intel® Core® Processor + Intel® Vision Accelerator Design with Intel® Arria® 10 FPGAbetter good edge & cloud developers, OEMs, ISVs cloud developers TargetAudience OEMs Integrators, cloud developers, edge developers developers end users Intel®iotMarketReadySolutions Smart Cities Retail Industrial Worker Safety Smart Cities Transportation Visionkits| CSPintegration AWS GreenGrass* Inference Implementation RFPReadykits Health Robotics Retail best Security and Surveillance Intel® Atom™ Processor + Intel® Vision Accelerator Design with Intel® Movidius™ Myriad™ 2 VPU Intel® Atom™ Processor + Intel® Vision Accelerator Design with Intel® Movidius™ Myriad™ X VPU Intel® Core® Processor + Intel® Vision Accelerator Design with Intel® Movidius™ Myriad™ X VPU Intel® Xeon® Processor + Intel® Vision Accelerator Design products Intel® Vision Accelerator Design with Intel® Arria® 10 FPGA Intel® Vision Accelerator Design with Intel® Movidius™ Myriad™ 2 VPU
  • 19. Intel® CONFIDENTIAL – all material covered by NDA VisionKit poweredbyIEITANK VisionKit poweredbyAAEONUP² Developer Kits to Accelerate Computer Vision Deployments article *Other names and brands may be claimed as the property of others. Intel®distributionof OpenVino™Toolkit Download Free  Learn More Get started quickly with:  Developer resources  Intel® Tech.Decoded online webinars, tool how-tos & quick tips  Hands-on, in-person workshops Support  Connect with Intel engineers & computer vision experts at the Community Forum  UP Squared* Board (Intel Atom® x7-E3950)  AI Core- Intel® Movidius Myriad 2 mini PCIe* VPU  USB camera  Intel Distribution of OpenVINO toolkit  Ubuntu* 16.04 Desktop w/ 4.14 kernel  Intel® System Studio  Arduino Create*  IEI TANK 870-Q170 (6th/7th Gen Intel® Core™ processor)  Intel Distribution of OpenVINO toolkit  Intel® Media SDK  Ubuntu Desktop16.04 Desktop LTS  Intel System Studio link to purchase link to purchase Futureproof design Expeditepath toproduction Accelerate performance 19Optimization Notice
  • 20. Intel® CONFIDENTIAL – all material covered by NDA 20 Rapid Prototyping, Validation, and Deployment of Deep Neural Network Inference at the Edge T R A I N O P T I M I Z E D E P L O Y Mode l + + + with Intel® Vision Accelerator Designs featuring Intel® Movidius™ Myriad™ X VPU P R O D U C T I Z E your deep neural network on the Intel® Neural Compute Stick 2 and your prototyping host your pre-trained models with the Intel® Distribution of OpenVINO™ toolkit your deep neural network models where desired Write once, deploy everywhere with the Intel® Distribution of OpenVINO™ toolkit D E V E L O P A N D S C A L E through Intel® AI: In Production
  • 21. Intel® CONFIDENTIAL – all material covered by NDA *Other names and brands may be claimed as the property of others. Intel® Movidius™ VPU Hardware TensorFlow*, MobileNet SSD* and YOLO* v2 Worker Safety Management 21 Intel® Distribution of OpenVINO™ Toolkit MobileNet SSD* YOLO v2* Intel® Arria® 10 FPGA Hardware Caffe*, MobileNet SSD* and CL-DNN Technology Medical Image Detection Intel® Distribution of OpenVINO™ Toolkit MobileNet SSD* CL-DNN* Optimization Notice
  • 22. 22Intel Confidential Whatis5G? • Next generation of wireless networks • Will provide higher speeds, greater capacity, and lower latency • Will be capable of supporting billions of connected devices and ‘things’ • Requires fundamental transformation of the network infrastructure • Extends intelligence throughout the network Reactive, smart, and connected devices Faster data rates Data and the ‘app’ revolution Cellular Comms. 5G 4G 2G 3G
  • 23. 23Intel Confidential 5GEnhancementsWillTransformLives Ultra Reliability and Low Latency (Mission Critical) Healthcare Emergency Services Autonomous DrivingDrones Massive M2M Connectivity Manufacturing Supply Chain/ LogisticsSmart AgricultureSmart Cities Enhanced Mobile Broadband (EMBB) Broadband to HomeMobile Office Virtual and Merged Reality Entertainment