SlideShare a Scribd company logo

Improving the Demand Side of the AI Economy (API World 2018)

•
•
Konstantin Savenkov
Konstantin Savenkov

Training AI in-house is often infeasible as it requires a critical mass of talent and data, and has high R&D risks. For Cognitive AI, like machine translation and speech recognition, hundreds of pre-trained and adaptive models are already available on the market via APIs from many vendors. Their performance varies case by case and change often. Their prices are 100x-200x times different, hence a wrong choice may be a complete miss. In this talk, we argue that the only way to go is to evaluate and continuously optimize AI vendor portfolio and introduce our vendor-agnostic demand-side API platform for AI.

Related slideshows

State of the Machine Translation by Intento (stock engines, Jan 2019)
State of the Machine Translation by Intento (stock engines, Jan 2019)State of the Machine Translation by Intento (stock engines, Jan 2019)
State of the Machine Translation by Intento (stock engines, Jan 2019)
 
State of the Machine Translation by Intento (July 2018)
State of the Machine Translation by Intento (July 2018)State of the Machine Translation by Intento (July 2018)
State of the Machine Translation by Intento (July 2018)
 
Machine Translation Insights
Machine Translation InsightsMachine Translation Insights
Machine Translation Insights
 
1 of 24
Download to read offline
IMPROVING THE DEMAND SIDE OF THE AI ECONOMY Konstantin Savenkov © Intento, Inc. 
 September 2018
INTENTO !2© Intento, Inc. / September 2018 INTENTO A simple API to third-party AI models from many vendors https://inten.to
AI SUPPLY SIDE STACK !3 INTENTO Hardware and infrastructure Deep Learning Frameworks Neural Network Architectures Training Inference Data Processing Data Data Collection API Management Domain Adaptation © Intento, Inc. / September 2018
!4 Hardware and infrastructure Deep Learning Frameworks Neural Network Architectures Training Inference Data Processing Data Data Collection API Management Domain Adaptation ON THE SHOULDERS OF GIANTS http://www.shivonzilis.com/machineintelligence© Intento, Inc. / September 2018
A PLENTY OF SUPPLY !5 APIs 200+ intents 100+ AI models 20,000+ INTENTO© Intento, Inc. / September 2018
!6 23 intents 60+ APIs © Intento, Inc. / Confidential / June 2018 EXAMPLE: NLP APIS
DOES IT WORK? SOMETIMES !7 of companies using AI get ROI >30% 83% Deloitte State of Cognitive Survey 2017 INTENTO
DOES IT WORK? SOMETIMES !8 of them use third-party AI 80% of companies using AI get ROI >30% 83% Deloitte State of Cognitive Survey 2017 INTENTO
DOES IT WORK? NOT QUITE !9 of them use third-party AI 80% of companies using AI get ROI >30% 83% Deloitte State of Cognitive Survey 2017 INTENTO of all companies ever tried to use AI 20%
ANOTHER RED FLAG: PRICE !10 up to 300x difference for similar services — Machine Translation: $3 to $972 per 1M symbols — Sentiment Analysis: $1 to $99 per 10K API calls INTENTO© Intento, Inc. / September 2018 https://bit.ly/mt_jul2018 https://bit.ly/sa_overview
LEGACY (SAAS) BUYING PROCESS !11 INTENTO Good brand — Set of features — Price — Pilot Integration “AI IS NOT THERE YET!” Six months later: © Intento, Inc. / September 2018
WHAT MAKES THE AI DIFFERENT? !12 trained on vast amount of unknown data — performance varies up to 4x case by case — constantly updated (not always improving) — has its own quirks — decisions often made by non engineers INTENTO© Intento, Inc. / September 2018
IT’S MORE LIKE HIRING HUMANS !13 INTENTO evaluate source onboard © Intento, Inc. / September 2018
WITH ITS OWN PROBLEMS !14 different APIs and data formats — hard to evaluate — hard to use multiple vendors concurrently — hard to source INTENTO© Intento, Inc. / September 2018
Programmable Web AI MODELS: SOURCING !15 INTENTO Major AI Vendors AI API Marketplaces Indie AI Vendors Deprecated AI APIs © Intento, Inc. / September 2018
AI MODELS: EVALUATION !16 INTENTO lots of vendor reports and marketing — web demos — … — API integrations NOTHING! © Intento, Inc. / September 2018
AI MODELS: ONBOARDING !17 different APIs, SDKs, CLIs — connectors and plugins to client systems — domain adaptation INTENTO© Intento, Inc. / September 2018
HOW INTENTO CHANGES THAT? 1. CORE TECHNOLOGY !18 we build and maintain many AI API integrations — intent-based vendor-agnostic API — high-performance AI middleware solution — the same convenience tools for every API: SDK, CLI, developer console INTENTO evaluate source onboard © Intento, Inc. / September 2018
HOW INTENTO CHANGES THAT? 2. SOURCING !19 Intento Service Catalog https://inten.to/api-platform — monitoring changes in API specs, documentation and behavior — regular public evaluation reports (performance, price and feature comparison) INTENTO evaluate source onboard © Intento, Inc. / September 2018
HOW INTENTO CHANGES THAT? 3. EVALUATION !20 Single API https://github.com/intento/intento-api — human-friendly evaluation tools (command-line interface) — API request smart-routing, optimizing performance, price or latency INTENTO evaluate source onboard © Intento, Inc. / September 2018
HOW INTENTO CHANGES THAT? 4. ONBOARDING !21 Vendor-agnostic SDK and developer tools https://console.inten.to — Re-usable plugins and connectors to internal systems — No need to choose the AI vendor INTENTO evaluate source onboard © Intento, Inc. / September 2018
ACCESS TO MANY MODELS EASY TO PICK THE RIGHT ONE !22 INTENTO API MARKETPLACES INDIE VENDORS MAJOR VENDORS EASY TO CHOOSE HARD TO CHOOSE FEW MODELS MANY MODELS INTENTO© Intento, Inc. / September 2018
CONCLUSIONS !23 INTENTO lots of niche AI models with APIs — complex performance / price landscape — AI users: choose AI portfolio, not a single vendor — AI vendors: - avoid inventing new APIs - make tools for humans as well © Intento, Inc. / September 2018
THANK YOU! !24 Konstantin Savenkov ks@inten.to 2150 Shattuck Ave Berkeley CA 94705 INTENTO https://inten.to Konstantin Savenkov ks@inten.to

More Related Content

Improving the Demand Side of the AI Economy (API World 2018)

  • 1. IMPROVING THE DEMAND SIDE OF THE AI ECONOMY Konstantin Savenkov © Intento, Inc. 
 September 2018
  • 2. INTENTO !2© Intento, Inc. / September 2018 INTENTO A simple API to third-party AI models from many vendors https://inten.to
  • 3. AI SUPPLY SIDE STACK !3 INTENTO Hardware and infrastructure Deep Learning Frameworks Neural Network Architectures Training Inference Data Processing Data Data Collection API Management Domain Adaptation © Intento, Inc. / September 2018
  • 4. !4 Hardware and infrastructure Deep Learning Frameworks Neural Network Architectures Training Inference Data Processing Data Data Collection API Management Domain Adaptation ON THE SHOULDERS OF GIANTS http://www.shivonzilis.com/machineintelligence© Intento, Inc. / September 2018
  • 5. A PLENTY OF SUPPLY !5 APIs 200+ intents 100+ AI models 20,000+ INTENTO© Intento, Inc. / September 2018
  • 6. !6 23 intents 60+ APIs © Intento, Inc. / Confidential / June 2018 EXAMPLE: NLP APIS
  • 7. DOES IT WORK? SOMETIMES !7 of companies using AI get ROI >30% 83% Deloitte State of Cognitive Survey 2017 INTENTO
  • 8. DOES IT WORK? SOMETIMES !8 of them use third-party AI 80% of companies using AI get ROI >30% 83% Deloitte State of Cognitive Survey 2017 INTENTO
  • 9. DOES IT WORK? NOT QUITE !9 of them use third-party AI 80% of companies using AI get ROI >30% 83% Deloitte State of Cognitive Survey 2017 INTENTO of all companies ever tried to use AI 20%
  • 10. ANOTHER RED FLAG: PRICE !10 up to 300x difference for similar services — Machine Translation: $3 to $972 per 1M symbols — Sentiment Analysis: $1 to $99 per 10K API calls INTENTO© Intento, Inc. / September 2018 https://bit.ly/mt_jul2018 https://bit.ly/sa_overview
  • 11. LEGACY (SAAS) BUYING PROCESS !11 INTENTO Good brand — Set of features — Price — Pilot Integration “AI IS NOT THERE YET!” Six months later: © Intento, Inc. / September 2018
  • 12. WHAT MAKES THE AI DIFFERENT? !12 trained on vast amount of unknown data — performance varies up to 4x case by case — constantly updated (not always improving) — has its own quirks — decisions often made by non engineers INTENTO© Intento, Inc. / September 2018
  • 13. IT’S MORE LIKE HIRING HUMANS !13 INTENTO evaluate source onboard © Intento, Inc. / September 2018
  • 14. WITH ITS OWN PROBLEMS !14 different APIs and data formats — hard to evaluate — hard to use multiple vendors concurrently — hard to source INTENTO© Intento, Inc. / September 2018
  • 15. Programmable Web AI MODELS: SOURCING !15 INTENTO Major AI Vendors AI API Marketplaces Indie AI Vendors Deprecated AI APIs © Intento, Inc. / September 2018
  • 16. AI MODELS: EVALUATION !16 INTENTO lots of vendor reports and marketing — web demos — … — API integrations NOTHING! © Intento, Inc. / September 2018
  • 17. AI MODELS: ONBOARDING !17 different APIs, SDKs, CLIs — connectors and plugins to client systems — domain adaptation INTENTO© Intento, Inc. / September 2018
  • 18. HOW INTENTO CHANGES THAT? 1. CORE TECHNOLOGY !18 we build and maintain many AI API integrations — intent-based vendor-agnostic API — high-performance AI middleware solution — the same convenience tools for every API: SDK, CLI, developer console INTENTO evaluate source onboard © Intento, Inc. / September 2018
  • 19. HOW INTENTO CHANGES THAT? 2. SOURCING !19 Intento Service Catalog https://inten.to/api-platform — monitoring changes in API specs, documentation and behavior — regular public evaluation reports (performance, price and feature comparison) INTENTO evaluate source onboard © Intento, Inc. / September 2018
  • 20. HOW INTENTO CHANGES THAT? 3. EVALUATION !20 Single API https://github.com/intento/intento-api — human-friendly evaluation tools (command-line interface) — API request smart-routing, optimizing performance, price or latency INTENTO evaluate source onboard © Intento, Inc. / September 2018
  • 21. HOW INTENTO CHANGES THAT? 4. ONBOARDING !21 Vendor-agnostic SDK and developer tools https://console.inten.to — Re-usable plugins and connectors to internal systems — No need to choose the AI vendor INTENTO evaluate source onboard © Intento, Inc. / September 2018
  • 22. ACCESS TO MANY MODELS EASY TO PICK THE RIGHT ONE !22 INTENTO API MARKETPLACES INDIE VENDORS MAJOR VENDORS EASY TO CHOOSE HARD TO CHOOSE FEW MODELS MANY MODELS INTENTO© Intento, Inc. / September 2018
  • 23. CONCLUSIONS !23 INTENTO lots of niche AI models with APIs — complex performance / price landscape — AI users: choose AI portfolio, not a single vendor — AI vendors: - avoid inventing new APIs - make tools for humans as well © Intento, Inc. / September 2018
  • 24. THANK YOU! !24 Konstantin Savenkov ks@inten.to 2150 Shattuck Ave Berkeley CA 94705 INTENTO https://inten.to Konstantin Savenkov ks@inten.to