A Pragmatic Reference Architecture for The Internet of Things
•
2 likes•1,138 views
We already know that the Internet of Things is big. It isn't something that's coming. It's already here. From manufacturing to healthcare, retail and hospitality, transportation, utilities and energy, the shift from Information Technology to Operational Technology and the value that this massive explosion of data can provide is taking the world by storm. But IoT isn't a product. It's not something you can buy. As with any gold rush, snake oil abounds. The potential is massive and the good news is that the technology and platforms are already here! But how do you get started? What are the application and networking protocols at play? How do you handle the ingestion of massive, real-time streams of data? Where do you land the data? What kind of insights does the data at scale provide? How do you make sense of it and/or take action on the data in real time scaling to hundreds if not hundreds of thousands of devices per deployment? In this session, Rick G. Garibay will share a pragmatic reference architecture based on his experience working with dozens of customers in the field and provide an insider’s view on some real-world IoT solutions he's led. He'll demystify what IoT is and what it isn't, discuss patterns for addressing the challenges inherent in IoT projects and how the most popular public cloud vendors are already providing the capabilities you need to build real-world IoT solutions today.
Report
Share
A Pragmatic Reference Architecture for The Internet of Things
- 1. A Pragmatic Reference Architecture for the Internet of Things Rick G. Garibay Senior SDM, Amazon.com Level: Beginner
- 2. Agenda • What is the Internet of Things? • IoT Problem Space • IoT Value Chain (A Pragmatic Reference Architecture) • Wrap Up
- 3. About Me • Senior Manager, Software Development @ Amazon.com • Distributed Systems Nerd • Published author and frequent contributor to CODE Magazine • 8X Microsoft MVP • Co-Author, “Windows Server AppFabric Cookbook” by Packt Pub. • twitter: @rickggaribay • blog: http://rickgaribay.net • email: rickgari@amazon.com We’re hiring!
- 4. The Internet of Things: By the Numbers B5075212
- 5. This change is happening more rapidly than anyone imagined.
- 6. This change could bring tremendous opportunity to your employer, customers, industry and you as a technologist.
- 7. The Internet of Things is the network of physical objects that contain embedded technology to communicate and interact with their internal states or the external environment.
- 8. OEM Revenue Opportunity | Market Forecast CY17 Source: IDC Sept 2013 and Microsoft Auto & Trans Retail Manufacturing Healthcare Energy Computing Telecom Consumer $7 B $16 B $197 B $3 B $27 B $908 B $179 B $356 B System Revenue Intelligent Systems 1.7T$
- 9. Smart Products Grid Renewables Oil/Gas/Coal Recovery and Distribution Points of Sale Restaurants Hotels Fuel Stations Patients Clinics Hospitals Nursing Homes Mobile Care Safety Security Comfort Lighting Automation Manufacturing Integration and Automation Remote Servicing Predictive and Reactive Maintenance Water Waste Pollution Control Fire Emergency Public Safety Law Enforcement Letters Packages Containers Tanks Bulkware Games Events Sports Television Streaming Traffic Buses Cars Trucks Trains Vessels Aircraft Bikes Smart Energy Smart Retail Smart Mobility Smart Logistics Smart Factory Smart Cities Smart Entertain- ment Smart Health- care Smart Building Home
- 12. CGM in the Cloud
- 13. What is IoT About? Things (Devices) Connectivity Data Analytics
- 14. IoT Device Taxonomy Large Mobile Micro Small POS terminal, ATM, MRI x86, PC-like, apps Industry handheld, POS tablet ARM and x86, shell experience, apps Gateways, wearables, panels, cars ARM and x86, diverse hardware, no shell Controllers, fixed-use, sensors, actuators ARM, constrained hardware, headless
- 15. Raspberry Pi
- 16. Intel Galileo
- 18. Arduino Uno
- 19. Netduino Plus 2
- 20. Spark
- 21. 5mm 5mm
- 24. What is the Internet of Things? Things (Devices) Connectivity Data Analytics
- 26. Canonical Message Types Voluntary information flow from device to another system. Telemetry Requests for information from device to other systems. Inquires Instructions from other systems to a device. Commands Information flow from other systems to the device. Notifications
- 27. Cloud Gateways Connections are device-initiated and outbound NAT/Firewall Device (Router) IP NAT Cloud GatewaySource Port mapping is automatic, outbound Device does not listen for unsolicited traffic No inbound ports open, attack surface is minimized Access-controlled command API Secure, managed hosting platform DNS myapp.cloudapp.net
- 28. What is the Internet of Things? Things (Devices) Connectivity Data Analytics
- 29. Event Velocity Device telemetry • Thermostats report data every 15 minutes • Cars send telemetry data every minute Application telemetry • Application perf counters are measured every second per server • Mobile app telemetry is captured for every action on your app! App and operational events • Halo game engine estimate 1,000,000 messages/second
- 30. What is the Internet of Things? Things (Devices) Connectivity Data Analytics
- 31. The true significance of IoT is the foundation it provides for enabling new insights and unlocking new opportunities.
- 32. The Vs of Big Data Volume: Scale of Data • 40 Zettabytes (43 Trillion Gigabytes) of data will be created by 2020. 300 Times increase from 2005 • 6B people have mobile phones • Most companies in the U.S have at least 100Tb of data Velocity: Streams of Data • NYSE captures 1TB of trade information every day • The average modern car has over 100 sensors • 18.9 billion network connections by 2016 Variety: Endless forms of Data • Nearly 420 Million wearable health monitors • Over 4 Billion hours of video watched on YouTube everyday Source: McKinsey Global, Twitter, Cisco, Gartner
- 33. IoT Value Pipeline Ingest Staging Insight Action
- 34. Reference Architecture Ingest & Staging Insight & Action +
- 35. Reference Architecture Ingest HTTP MQTT AMQP CoAP … Brokered Streamed Staging Blob KVP Document Insight OLTP ETL CEP Big Data Action Custom APIs Brokered 3rd Party APIs Security,Management,Monitoring
- 36. Brokered Communication • Each device has a dedicated Inbox/Outbox on the Gateway – Device sends telemetry/alerts and routes service invocations via its Outbox – Device receives commands and queries from its Inbox – Correlated request/reply patterns can be implemented on top of these two messaging channels – The device knows, and has access to, only its own specific inbox/outbox endpoints (URI’s) Backend Components Cloud Gateway Inbox Outbox CommandAPI ProtocolHead
- 37. Streamed Communication • Read (forward) and Rewind (go back) data access – Partition/shard-based – Sequence of events, akin to a commit log – Designed for high volume, high density ingest – Typically (but not always) real-time use cases
- 38. Reference Architecture Ingest HTTP MQTT AMQP CoAP … Brokered Streamed Staging Blob KVP Document Insight OLTP ETL CEP Big Data Action Custom APIs Brokered 3rd Party APIs Security,Management,Monitoring
- 39. Staging Blob • Any binary data • Images, streams, big text files, etc. KVP • Any string • JSON, XML Document • Typically JSON
- 40. Staging Considerations Commands & Inquiries • The capability provides transient staging typically tied to a retention period and/or TTL • A worker typically consumes and processes work message by message Telemetry & Notifications • The capability provides high-throughput backing to be consumed by either durable or stream-based consumers • Typically bulk writes or stream based readers
- 41. Reference Architecture Ingest HTTP MQTT AMQP CoAP … Brokered Streamed Staging Blob KVP Document Insight OLTP ETL CEP Big Data Action Custom APIs Brokered 3rd Party APIs Security,Management,Monitoring
- 42. Insight OLTP • Structured queries ETL • Moving data from one staging area to another CEP • Reading and analyzing streams in real-time Big Data • Analyzing large amounts of data at rest
- 43. Reference Architecture Ingest HTTP MQTT AMQP CoAP … Brokered Streamed Staging Blob KVP Document Insight OLTP ETL CEP Big Data Action Custom APIs Brokered 3rd Party APIs Security,Management,Monitoring
- 44. Action Your APIs • Commands & Notifications • Business Scenarios • Cloud hosted • Behind the firewall • Synchronous & Asynchronous Brokered • Commands & Notifications • Devices you own, control • Asynchronous by design 3rd Party APIs • Commands & Notifications • Typically commercial devices or devices supported by a vendor
- 45. Wrapping Up • Model your solution across the four stages • Evaluate the capability that’s right for you based on your needs, team skills and perhaps most important, the cost. • Cloud providers are competing vigorously which is great for customers!
- 46. A Pragmatic Reference Architecture for the Internet of Things Rick G. Garibay Senior SDM, Amazon.com Level: Beginner