SlideShare a Scribd company logo
INTEGRATION SUMMIT 2019
Role of Integration In API Driven
World
Asitha Nanayakkara
Technical Lead, Integration team
INTEGRATION
INTEGRATION SUMMIT 2019
Story of SuperCity
INTEGRATION SUMMIT 2019
INTEGRATION SUMMIT 2019
Challenge from Digital Competition
INTEGRATION SUMMIT 2019
New Strategy
Reuse existing systems
Cost Savings
Faster time to market
Work with legacy
backend systems
Room for future
expansions
API Management solution along with some broad integration capabilities
INTEGRATION SUMMIT 2019
SuperCity API Initiative
API
Existing System
Mobile
App
Website
INTEGRATION SUMMIT 2019
API Driven Development
INTEGRATION SUMMIT 2019
Why APIs ?
● APIs are a key enabler of digital enterprise
● APIs acts as gateways to enterprise digital asserts
● Allows the enterprise to build new digital consumer experiences within
accelerated time frame
● They open up new revenue channels and expand existing revenue
channels
● APIs enable the enterprise to cater for future expansions
INTEGRATION SUMMIT 2019
Code first design
Code First vs API First Design
Back-end
Team
ImpI 1
API
2
Client
A
Client
B
...
SDK SDK ...
3
Front-end
Teams
API first design
Front-end
Teams
Back-end
Team
API API API
Mock Mock Mock 1
Client
A
Client
B
...
SDK SDK ...
ImpI 2
2
ImpI ImpI
Data Services
INTEGRATION SUMMIT 2019
API Façade
IoT
Mobile
Apps
Web
API Gateway
API Façade
DatabaseLegacy System
Content
Management
CRM/HR/Inventory
Systems
SaaS
INTEGRATION SUMMIT 2019
API Façade
System 1
API 1
System 2
API 2
Composite API
System APIs
Orchestration APIs
INTEGRATION SUMMIT 2019
Orchestration APIs
Invoke
Policy / discovery
Enrich Publish
DB
write
Transform Update
Policy
Orchestration API
CRM
API1 Queue
DB
REST
API
INTEGRATION SUMMIT 2019
API Façade
IoT
Mobile
Apps
Web
API Gateway
API Façade
DatabaseLegacy System
Content
Management
CRM/HR/Inventory
Systems
SaaS
API A API B
Orchestration API
Orchestration APIs
System System
INTEGRATION SUMMIT 2019
SuperCity’s Digital Story
INTEGRATION SUMMIT 2019
SuperCity API Initiative
API
Existing System
Mobile
App
Website
INTEGRATION SUMMIT 2019
Building the API’s
Price
Update
System
Inventory
System
Reservation
System
PoS
System
Store 1
Store 2
Store 3
Mobile App
Website
API
API
Delivery System
API
Payment System
API
API
API
INTEGRATION SUMMIT 2019
Building the API’s
Price
Update
System
Inventory
System
Reservation
System
PoS
System
Store 1
Store 2
Store 3
Mobile App
Website
API
Delivery System
API
Payment System
API
Managed API
API
API
API
INTEGRATION SUMMIT 2019
Types of digital assets in enterprises
● Application silos that hold key business capabilities of the enterprise
● Enterprise SaaS applications
● Enterprise Data stored in various storage mechanisms including RDBMS,
Files, Spreadsheets, CSV files ...
● Applications that execute the process flows in the enterprise
● Systems based on proprietary protocols and data formats
INTEGRATION SUMMIT 2019
Key integration capabilities
● API and Service Hosting
● Orchestration of services and apis
● Routing
● Transformations
● Protocol switching and ability to process different data formats
● Parallel processing
INTEGRATION SUMMIT 2019
Integration Strategy
• Discover the ecosystems and Application silos
• Understand the data
• Understand the capabilities
• Identify the possible integration points for each system
• API enable the identified systems
• Implement the integration logic
INTEGRATION SUMMIT 2019
WSO2 Enterprise Integrator
INTEGRATION SUMMIT 2019
A Hybrid Integration Platform
Connectivity / Integration: anything-to-anything
WSO2 EIConnectors
Web services
APIs
Filesystems
Messaging systems
Business
Applications
Partners’ systems
Data
Supporting Standards
• HTTP(S)
• JMS, AMQP, MQ
• Websockets
• VFS
• FIX, HL7
• JSON, SOAP
• XSLT, XPATH, Smooks
• JDBC, CSV, NO-SQL
• OAuth, XACML, WS-Sec
INTEGRATION SUMMIT 2019
Enterprise Integrator Capabilities
INTEGRATION SUMMIT 2019
API Integration - Integrator Profile
A lightweight, high performance integration runtime
• Comprehensive REST, SOAP, and WS-* support
• Support for File, Data, Messaging based integrations
• SAP, FIX, and HL7 - Domain specific solutions
• Configuration driven
• Extensible and Scalable
• 100% coverage of all EI patterns
INTEGRATION SUMMIT 2019
Data Integration - Integrator Profile
Building service abstractions on top of disparate data sources
SQL
SOAP/REST/OData
XML/JSON
Integrator Runtime
WSO2 EI
INTEGRATION SUMMIT 2019
Business Processes - BPS Profile
Processes/Workflows with BPMN, BPEL, Human Tasks
Application α
Application β
Defined processes and workflows
which may also consist of human
tasks
Business Process Execution
as a Service
WSO2 EI
Application N
Process Initiation
Results/Decisions
INTEGRATION SUMMIT 2019
Micro Integrator
• Can be to used to create composite services using atomic services
• Separate distribution that can be used in a cloud native environment
• Users can use the same EI tooling to create artifacts
• Deploy few composite integration services per micro integration
• Command line tool for management tasks
• Fast startup time (5s)
• Small distribution size of 150 mb
• K8S Integration
https://github.com/wso2/micro-integrator
INTEGRATION SUMMIT 2019
Micro-integrations
28
Consumer 1
API Service P API Service Q API Service R API Service S
Consumers
Consumer 2 Consumer 3
μ Service A
Proprietary &
Legacy
Systems
Web API /
SaaS
API Services/
Edge Services
Composite Service/
Integration Services
Core Services/
Atomic Services μ Service I
μ Service H
μ Service J
μ Service E
μ Service C
μ Service D
μ Service G
μ Service B
μ Service F
API
Management
INTEGRATION SUMMIT 2019
WSO2 EI Graphical Tooling
• Drag and Drop Visual Editor
• Develop, Deploy, Test, Debug
capabilities from the editor
• Build in micro Integrator runtime for
testing and debugging
• Export artifacts as a docker image
with micro integration
• Integration templates for rapid
development
INTEGRATION SUMMIT 2019
Integration Analytics
Dashboards for Transaction Analytics and Monitoring
Overall setup
• Overall Throughput (in TPS)
• Overall Message Count
APIs, proxies, endpoints specific
• Request Count
• Message Count
• Message Latency
• Explore Messages
• Explore Message Flows
INTEGRATION SUMMIT 2019
Other Analytics Integrations
• ELK Stack
• Prometheus
INTEGRATION SUMMIT 2019
Continuous Integration and Continuous Delivery
Continuous
Integration Server
Source Control
System
WSO2 EI
WSO2 EI
Environment 1
WSO2 EI
WSO2 EI
Environment 2
Continuous Test
Server
Integration
artifacts
IDE IDEIDE
INTEGRATION SUMMIT 2019
Solving the Integration
Requirements with WSO2 EI
INTEGRATION SUMMIT 2019
Integration with Systems that Talk in Standard
Protocols
Support for a wide range of
standard protocols
• HTTP/HTTPS
• JMS
• AMQP
• FTP/SFTP/FTPS/SMB
• SMTP/IMAP
• MQTT
• KAFKA
• And many more
SMTP
HTTP
JMS
FTP
Websocke
t
INTEGRATION SUMMIT 2019
Integration with Systems that Talk in Standard
Protocols
HTTP/API
Public Private Organization
Existing
System
FTP
INTEGRATION SUMMIT 2019
Integration with Systems that Talk in Non-
standard/ Proprietary Protocols
• Built in support for well-known proprietary protocols
E.g. SAP
• Easy to extend the functionality to introduce new protocols
HTTP/API
Public Private Organization
Existing
System
Non Standard
Protocol
Connector
INTEGRATION SUMMIT 2019
Integration with Files-based Systems
● WSO2 Enterprise Integrator supports a wide range of file transferring
protocols such as FTP, SFTP, FTPS, and SMB
○ Listen to a location, pick files, and invoke a web API using the content of the
files
File HTTP
Web API
Invocation
Existing Legacy
System
INTEGRATION SUMMIT 2019
Integration with Systems that Use Databases
Expose databases or other data sources as services
HTTP
INTEGRATION SUMMIT 2019
Extension Points
• Script mediator
• Connectors
• Custom/Class mediators
• API handlers
• Custom tasks
• Custom inbound endpoints
• Custom XPath functions
• Message builders and formatters
• Transport listeners and senders
• Custom message
stores/processors
INTEGRATION SUMMIT 2019
Conclusion
● Why API Driven integrations are important
● API and Integration strategy and approaches
● WSO2 Integration suite functionality to support API driven Integration
● How to successfully implement API driven Integration
INTEGRATION SUMMIT 2019
THANK YOU
wso2.com
INTEGRATION SUMMIT 2019
Questions?

More Related Content

WSO2 - Yenlo Integration Summit Stuttgart 15 May 2019 - Role of Integration in API Driven world - Asitha Nanayakkara

  • 1. INTEGRATION SUMMIT 2019 Role of Integration In API Driven World Asitha Nanayakkara Technical Lead, Integration team INTEGRATION
  • 4. INTEGRATION SUMMIT 2019 Challenge from Digital Competition
  • 5. INTEGRATION SUMMIT 2019 New Strategy Reuse existing systems Cost Savings Faster time to market Work with legacy backend systems Room for future expansions API Management solution along with some broad integration capabilities
  • 6. INTEGRATION SUMMIT 2019 SuperCity API Initiative API Existing System Mobile App Website
  • 7. INTEGRATION SUMMIT 2019 API Driven Development
  • 8. INTEGRATION SUMMIT 2019 Why APIs ? ● APIs are a key enabler of digital enterprise ● APIs acts as gateways to enterprise digital asserts ● Allows the enterprise to build new digital consumer experiences within accelerated time frame ● They open up new revenue channels and expand existing revenue channels ● APIs enable the enterprise to cater for future expansions
  • 9. INTEGRATION SUMMIT 2019 Code first design Code First vs API First Design Back-end Team ImpI 1 API 2 Client A Client B ... SDK SDK ... 3 Front-end Teams API first design Front-end Teams Back-end Team API API API Mock Mock Mock 1 Client A Client B ... SDK SDK ... ImpI 2 2 ImpI ImpI Data Services
  • 10. INTEGRATION SUMMIT 2019 API Façade IoT Mobile Apps Web API Gateway API Façade DatabaseLegacy System Content Management CRM/HR/Inventory Systems SaaS
  • 11. INTEGRATION SUMMIT 2019 API Façade System 1 API 1 System 2 API 2 Composite API System APIs Orchestration APIs
  • 12. INTEGRATION SUMMIT 2019 Orchestration APIs Invoke Policy / discovery Enrich Publish DB write Transform Update Policy Orchestration API CRM API1 Queue DB REST API
  • 13. INTEGRATION SUMMIT 2019 API Façade IoT Mobile Apps Web API Gateway API Façade DatabaseLegacy System Content Management CRM/HR/Inventory Systems SaaS API A API B Orchestration API Orchestration APIs System System
  • 15. INTEGRATION SUMMIT 2019 SuperCity API Initiative API Existing System Mobile App Website
  • 16. INTEGRATION SUMMIT 2019 Building the API’s Price Update System Inventory System Reservation System PoS System Store 1 Store 2 Store 3 Mobile App Website API API Delivery System API Payment System API API API
  • 17. INTEGRATION SUMMIT 2019 Building the API’s Price Update System Inventory System Reservation System PoS System Store 1 Store 2 Store 3 Mobile App Website API Delivery System API Payment System API Managed API API API API
  • 18. INTEGRATION SUMMIT 2019 Types of digital assets in enterprises ● Application silos that hold key business capabilities of the enterprise ● Enterprise SaaS applications ● Enterprise Data stored in various storage mechanisms including RDBMS, Files, Spreadsheets, CSV files ... ● Applications that execute the process flows in the enterprise ● Systems based on proprietary protocols and data formats
  • 19. INTEGRATION SUMMIT 2019 Key integration capabilities ● API and Service Hosting ● Orchestration of services and apis ● Routing ● Transformations ● Protocol switching and ability to process different data formats ● Parallel processing
  • 20. INTEGRATION SUMMIT 2019 Integration Strategy • Discover the ecosystems and Application silos • Understand the data • Understand the capabilities • Identify the possible integration points for each system • API enable the identified systems • Implement the integration logic
  • 21. INTEGRATION SUMMIT 2019 WSO2 Enterprise Integrator
  • 22. INTEGRATION SUMMIT 2019 A Hybrid Integration Platform Connectivity / Integration: anything-to-anything WSO2 EIConnectors Web services APIs Filesystems Messaging systems Business Applications Partners’ systems Data Supporting Standards • HTTP(S) • JMS, AMQP, MQ • Websockets • VFS • FIX, HL7 • JSON, SOAP • XSLT, XPATH, Smooks • JDBC, CSV, NO-SQL • OAuth, XACML, WS-Sec
  • 23. INTEGRATION SUMMIT 2019 Enterprise Integrator Capabilities
  • 24. INTEGRATION SUMMIT 2019 API Integration - Integrator Profile A lightweight, high performance integration runtime • Comprehensive REST, SOAP, and WS-* support • Support for File, Data, Messaging based integrations • SAP, FIX, and HL7 - Domain specific solutions • Configuration driven • Extensible and Scalable • 100% coverage of all EI patterns
  • 25. INTEGRATION SUMMIT 2019 Data Integration - Integrator Profile Building service abstractions on top of disparate data sources SQL SOAP/REST/OData XML/JSON Integrator Runtime WSO2 EI
  • 26. INTEGRATION SUMMIT 2019 Business Processes - BPS Profile Processes/Workflows with BPMN, BPEL, Human Tasks Application α Application β Defined processes and workflows which may also consist of human tasks Business Process Execution as a Service WSO2 EI Application N Process Initiation Results/Decisions
  • 27. INTEGRATION SUMMIT 2019 Micro Integrator • Can be to used to create composite services using atomic services • Separate distribution that can be used in a cloud native environment • Users can use the same EI tooling to create artifacts • Deploy few composite integration services per micro integration • Command line tool for management tasks • Fast startup time (5s) • Small distribution size of 150 mb • K8S Integration https://github.com/wso2/micro-integrator
  • 28. INTEGRATION SUMMIT 2019 Micro-integrations 28 Consumer 1 API Service P API Service Q API Service R API Service S Consumers Consumer 2 Consumer 3 μ Service A Proprietary & Legacy Systems Web API / SaaS API Services/ Edge Services Composite Service/ Integration Services Core Services/ Atomic Services μ Service I μ Service H μ Service J μ Service E μ Service C μ Service D μ Service G μ Service B μ Service F API Management
  • 29. INTEGRATION SUMMIT 2019 WSO2 EI Graphical Tooling • Drag and Drop Visual Editor • Develop, Deploy, Test, Debug capabilities from the editor • Build in micro Integrator runtime for testing and debugging • Export artifacts as a docker image with micro integration • Integration templates for rapid development
  • 30. INTEGRATION SUMMIT 2019 Integration Analytics Dashboards for Transaction Analytics and Monitoring Overall setup • Overall Throughput (in TPS) • Overall Message Count APIs, proxies, endpoints specific • Request Count • Message Count • Message Latency • Explore Messages • Explore Message Flows
  • 31. INTEGRATION SUMMIT 2019 Other Analytics Integrations • ELK Stack • Prometheus
  • 32. INTEGRATION SUMMIT 2019 Continuous Integration and Continuous Delivery Continuous Integration Server Source Control System WSO2 EI WSO2 EI Environment 1 WSO2 EI WSO2 EI Environment 2 Continuous Test Server Integration artifacts IDE IDEIDE
  • 33. INTEGRATION SUMMIT 2019 Solving the Integration Requirements with WSO2 EI
  • 34. INTEGRATION SUMMIT 2019 Integration with Systems that Talk in Standard Protocols Support for a wide range of standard protocols • HTTP/HTTPS • JMS • AMQP • FTP/SFTP/FTPS/SMB • SMTP/IMAP • MQTT • KAFKA • And many more SMTP HTTP JMS FTP Websocke t
  • 35. INTEGRATION SUMMIT 2019 Integration with Systems that Talk in Standard Protocols HTTP/API Public Private Organization Existing System FTP
  • 36. INTEGRATION SUMMIT 2019 Integration with Systems that Talk in Non- standard/ Proprietary Protocols • Built in support for well-known proprietary protocols E.g. SAP • Easy to extend the functionality to introduce new protocols HTTP/API Public Private Organization Existing System Non Standard Protocol Connector
  • 37. INTEGRATION SUMMIT 2019 Integration with Files-based Systems ● WSO2 Enterprise Integrator supports a wide range of file transferring protocols such as FTP, SFTP, FTPS, and SMB ○ Listen to a location, pick files, and invoke a web API using the content of the files File HTTP Web API Invocation Existing Legacy System
  • 38. INTEGRATION SUMMIT 2019 Integration with Systems that Use Databases Expose databases or other data sources as services HTTP
  • 39. INTEGRATION SUMMIT 2019 Extension Points • Script mediator • Connectors • Custom/Class mediators • API handlers • Custom tasks • Custom inbound endpoints • Custom XPath functions • Message builders and formatters • Transport listeners and senders • Custom message stores/processors
  • 40. INTEGRATION SUMMIT 2019 Conclusion ● Why API Driven integrations are important ● API and Integration strategy and approaches ● WSO2 Integration suite functionality to support API driven Integration ● How to successfully implement API driven Integration