SlideShare a Scribd company logo
Azure Integration Patterns
Sam Vanhoutte - Codit
Nice to meet you
SamVANHOUTTE
CTO Codit
6 year - BizTalkV-TSP
1st year - Integration MVP
sam.vanhoutte@codit.eu
+32 474 849 993
@SamVanhoutte
be.linkedin.com/in/samvanhoutte/
> 60 Active integration customers
International Focus -
HQ in BEFocused on integration solutions
2000 Belgium
2004 France
2013 Portugal
60 employees
> 50 consultants BizTalk certifiede-news + SoMe
2012 & 2013
Partner of the Year
Award Finalist
Application Integration
And take home the
Lumia 1320
Present your feedback form when you exit
the last session & go for the drink
Give Me Feedback
Bring the cloud to your enterprise:
Integration
Your
Data
Center
Integration
Partners
SaaS
Apps
Same problems
different solutions, new challenges
Network latency
Identity Management
Different SLAs
Data Security
Monitoring
Management
Mobile AccessInterop
Changing schemas
Services not Servers
ConnectivityREST-first
Architectural challenges
Operational challenges
Security Latency
Standards &
Interop
Hybrid
connectivity …
“DevOps”
Enterprise
procedures SLA’s Monitoring …
Same problems
different solutions, new challenges
Cloud Integration Patterns
Network Integration
Data Integration
Application Integration
Connect and synchronize data between on-prem and cloud
Connect on protocol – network level
Synchronous or asynchronous message communication on
application level
NETWORK INTEGRATION
Network integration:
Technology overview
• Virtual Networking
– Point to Site
– Site to Site
• ExpressRoute
• Hybrid connections
– (app. integration)
Virtual networking options
ExpressRoute connectivity
Microsoft Azure
Compute
Azure
Edge
Connectivity
Provider
Infrastructure
ExpressRoute connectivity
ExpressRoute provides
organizations a private,
dedicated, high-throughput
network connection between
Windows Azure datacenters and
their on-premises IT environment.
DATA INTEGRATION
Data integration:
Technology overview
• Azure Storage
– Azure File Service
– Table & Blob storage
• Azure SQL Database
– Data Sync
– SQL Connectivity
Connect to Azure SQL Database
• Through SQL Azure TDS
• Local firewall settings
– Outbound connections
– TCP port 1433
• SQL database firewall
– Provide allowed IP ranges to connect to server
– Use sp_set_database_firewall_rule on
database level
SQL Azure Data Sync
• Warning! Still in preview… For years
• Powers movement of data
– Cloud  cloud
– On-premises  cloud
• Getting data where you need it
– Sync SQL Azure instances
– Sync SQL Server to SQL Azure
– Sync offline apps to SQL Azure
– Enable geo-replication of data
Sync
SQL
Azur
e
APPLICATION INTEGRATION
Application integration:
Technology overview
• Service Bus
– Relay Service
– Messaging
– Notification Hubs
• BizTalk Services
– Hybrid Connections
– Adapter service
– EDI Trading partners
Service Bus Brokered Messaging
Port 9354 outbound
Port 5672 for AMQP
Port 443 for HTTPS
• Asynchronous / queued processing
• Distributed processing
• Load leveling / Temporal decoupling
• Interoperability through AMQP / REST
• Routing of messages
Service Bus Relay - how it works
• Outbound firewall only
• Bi-directional
communication patterns
• Load-balancing in the cloud
• HTTP or TCP connectivity
• Different security options
Firewall friendly? Yes, but…
• Only outbound firewall rules needed
– TCP: Ports 9350-9353
– HTTP: Ports 80 & 443
• IP range of cloud services change
constantly
– Don’t block outbound IP addresses
– http://bit.ly/15lXMB0
Port configuration #fyi
• Outbound TCP (Ports 9350-9353)
– 9350 Unsecured TCP One-way (client)
– 9351 Secured TCP One-way (all listeners, secured clients)
– 9352 Secured TCP Rendezvous (all listeners except one-way)
– 9353 Direct Connect Probing Protocol (TCP listeners with direct
connect)
• Outbound HTTP (Port 80, Listeners)
– TCP equivalent tunnel with overlaid TLS/SSL formed over pair of
HTTP requests
– Alternate connectivity path if outbound TCP is blocked
• Outbound HTTPS (Port 443, Senders)
Service Bus Relay
Demo – connect to on prem SQL
Hybrid Connections
Web Sites
Mobile Services
Corporate Network
Microsoft SQL Server
Hybrid Connection
Other published
resourcesHybrid Connection
Manager
Hybrid connections
Access to on-premises
resources
Connect to SQL Server, Web Services or most other that use
TCP or HTTP connectivity
No need to alter the network
perimeter
Doesn’t require a VPN gateway or Firewall changes to allow
incoming traffic
Applications have access only to the resource that they
require
Outbound connection needed on port 5671
IT maintains control over
resources
Support for Group Policy and Event/Audit Logging providing
Admins control and visibility
Event and Audit logging
IT has insight into resources being accessed
IT can use existing infrastructure investments for monitoring
and control
Dashboard on Azure portal
Access to connection health, status
Will provide insights on usage and metrics
Hybrid Connections
Demo – migrate web site
BizTalk Services
BizTalk Adapter Service
Server Explorer
(Visual Studio)
PowerShell
CmdLets
Management
Service REST API
Lob Relay
(Service Host)
Bridge
Pipeline
V E T E
Messages
Sources
FTP/S
HTTP
SFTP
Destinations
Service Bus
Web Service
FTP/S
HTTP
Blob
BizTalk Services
Demo – connect to SAP or SQL on prem
Hybrid connectivity options
Scenarios
When to use what ?
Local, shielded network
Virtual Networking
VPN device
Site to Site VPN
SOAP
Site to Site VPN, connecting local services and file shares
FTP
IPSec tunnel
Codit Integration Cloud
Local, shielded network
Virtual Networking
VPN device
Site to Site VPN
SOAP
Site to Site VPN, connecting local services and file shares
FTP
IPSec tunnel
Advantages
• Connections managed from the cloud
• On-premises footprint extremely small
• No DMZ deployment needed
• Extensible connection service
Reasoning
• Minimize network / application impact
• Fully outsource solution
Codit Integration Cloud
Belgium
SQL Data Sync
Worker Role
reference data lookup
SQL Data Sync
Feed Azure Database with local SQL reference data for lookups
On prem SQL
SQL Azure Database
Belgium
SQL Data Sync
" changing the way integration is done
BizTalk Services
(bridge enrichment : look up)
SQL Data Sync
Feed Azure Database with local SQL reference data for lookups
On prem SQL
SQL Azure Database
Advantages
• Quick to set up
• Low latency for data access (same data center)
• No changes need to local application
Reasoning
• Warning – in preview for years !
• Good for caching data in the cloud
Netherlands
Service Bus Relay
BizTalk Adapter
Service
Service Bus Relay
REST FILE
Cloud Integration environment, using Service Bus Relay to on-prem
SQL
Cyprus
Cloud
Connector
Codit Integration Cloud
Service Bus Relay
Cloud Integration environment, using Service Bus Relay to on-prem
Advantages
• Connections managed from the cloud
• On-premises footprint extremely small
• No DMZ deployment needed
• Extensible connection service
Reasoning
• Minimize network / application impact
• Fully outsource solution
BizTalk Services
Azure BizTalk Services
On prem ESB
Service Bus Relay
SAP WMS Oracle
FTP, AS2…
Customer moving all B2B to the cloud, relaying to on prem BizTalk
BizTalk Services
Windows Azure
BizTalk Services
BizTalk ESB
Service Bus Relay
SAP WMS Oracle
FTP, AS2…
Advantages
• Faster set-up of partner connections
• One-time firewall set-up
• Support for existing mappings & schemas in WABS
• No specific DMZ deployment needed
Reasoning
• Latency less important for B2B than EAI
Customer moving all B2B to the cloud, relaying to on prem BizTalk
THANK YOU
AND NOW, QUESTIONS?
OR DRINKS?
Follow Technet Belgium
@technetbelux
Subscribe to the TechNet newsletter
aka.ms/benews
Be the first to know
Belgiums’ biggest IT PRO Conference

More Related Content

azure track -06- cloud integration patterns for it-pros - itproceed

  • 1. Azure Integration Patterns Sam Vanhoutte - Codit
  • 2. Nice to meet you SamVANHOUTTE CTO Codit 6 year - BizTalkV-TSP 1st year - Integration MVP sam.vanhoutte@codit.eu +32 474 849 993 @SamVanhoutte be.linkedin.com/in/samvanhoutte/ > 60 Active integration customers International Focus - HQ in BEFocused on integration solutions 2000 Belgium 2004 France 2013 Portugal 60 employees > 50 consultants BizTalk certifiede-news + SoMe 2012 & 2013 Partner of the Year Award Finalist Application Integration
  • 3. And take home the Lumia 1320 Present your feedback form when you exit the last session & go for the drink Give Me Feedback
  • 4. Bring the cloud to your enterprise: Integration Your Data Center Integration Partners SaaS Apps
  • 5. Same problems different solutions, new challenges Network latency Identity Management Different SLAs Data Security Monitoring Management Mobile AccessInterop Changing schemas Services not Servers ConnectivityREST-first
  • 6. Architectural challenges Operational challenges Security Latency Standards & Interop Hybrid connectivity … “DevOps” Enterprise procedures SLA’s Monitoring … Same problems different solutions, new challenges
  • 7. Cloud Integration Patterns Network Integration Data Integration Application Integration Connect and synchronize data between on-prem and cloud Connect on protocol – network level Synchronous or asynchronous message communication on application level
  • 9. Network integration: Technology overview • Virtual Networking – Point to Site – Site to Site • ExpressRoute • Hybrid connections – (app. integration)
  • 12. ExpressRoute connectivity ExpressRoute provides organizations a private, dedicated, high-throughput network connection between Windows Azure datacenters and their on-premises IT environment.
  • 14. Data integration: Technology overview • Azure Storage – Azure File Service – Table & Blob storage • Azure SQL Database – Data Sync – SQL Connectivity
  • 15. Connect to Azure SQL Database • Through SQL Azure TDS • Local firewall settings – Outbound connections – TCP port 1433 • SQL database firewall – Provide allowed IP ranges to connect to server – Use sp_set_database_firewall_rule on database level
  • 16. SQL Azure Data Sync • Warning! Still in preview… For years • Powers movement of data – Cloud  cloud – On-premises  cloud • Getting data where you need it – Sync SQL Azure instances – Sync SQL Server to SQL Azure – Sync offline apps to SQL Azure – Enable geo-replication of data Sync SQL Azur e
  • 18. Application integration: Technology overview • Service Bus – Relay Service – Messaging – Notification Hubs • BizTalk Services – Hybrid Connections – Adapter service – EDI Trading partners
  • 19. Service Bus Brokered Messaging Port 9354 outbound Port 5672 for AMQP Port 443 for HTTPS • Asynchronous / queued processing • Distributed processing • Load leveling / Temporal decoupling • Interoperability through AMQP / REST • Routing of messages
  • 20. Service Bus Relay - how it works • Outbound firewall only • Bi-directional communication patterns • Load-balancing in the cloud • HTTP or TCP connectivity • Different security options
  • 21. Firewall friendly? Yes, but… • Only outbound firewall rules needed – TCP: Ports 9350-9353 – HTTP: Ports 80 & 443 • IP range of cloud services change constantly – Don’t block outbound IP addresses – http://bit.ly/15lXMB0
  • 22. Port configuration #fyi • Outbound TCP (Ports 9350-9353) – 9350 Unsecured TCP One-way (client) – 9351 Secured TCP One-way (all listeners, secured clients) – 9352 Secured TCP Rendezvous (all listeners except one-way) – 9353 Direct Connect Probing Protocol (TCP listeners with direct connect) • Outbound HTTP (Port 80, Listeners) – TCP equivalent tunnel with overlaid TLS/SSL formed over pair of HTTP requests – Alternate connectivity path if outbound TCP is blocked • Outbound HTTPS (Port 443, Senders)
  • 23. Service Bus Relay Demo – connect to on prem SQL
  • 24. Hybrid Connections Web Sites Mobile Services Corporate Network Microsoft SQL Server Hybrid Connection Other published resourcesHybrid Connection Manager
  • 25. Hybrid connections Access to on-premises resources Connect to SQL Server, Web Services or most other that use TCP or HTTP connectivity No need to alter the network perimeter Doesn’t require a VPN gateway or Firewall changes to allow incoming traffic Applications have access only to the resource that they require Outbound connection needed on port 5671 IT maintains control over resources Support for Group Policy and Event/Audit Logging providing Admins control and visibility Event and Audit logging IT has insight into resources being accessed IT can use existing infrastructure investments for monitoring and control Dashboard on Azure portal Access to connection health, status Will provide insights on usage and metrics
  • 26. Hybrid Connections Demo – migrate web site
  • 27. BizTalk Services BizTalk Adapter Service Server Explorer (Visual Studio) PowerShell CmdLets Management Service REST API Lob Relay (Service Host) Bridge Pipeline V E T E Messages Sources FTP/S HTTP SFTP Destinations Service Bus Web Service FTP/S HTTP Blob
  • 28. BizTalk Services Demo – connect to SAP or SQL on prem
  • 31. Local, shielded network Virtual Networking VPN device Site to Site VPN SOAP Site to Site VPN, connecting local services and file shares FTP IPSec tunnel Codit Integration Cloud
  • 32. Local, shielded network Virtual Networking VPN device Site to Site VPN SOAP Site to Site VPN, connecting local services and file shares FTP IPSec tunnel Advantages • Connections managed from the cloud • On-premises footprint extremely small • No DMZ deployment needed • Extensible connection service Reasoning • Minimize network / application impact • Fully outsource solution Codit Integration Cloud
  • 33. Belgium SQL Data Sync Worker Role reference data lookup SQL Data Sync Feed Azure Database with local SQL reference data for lookups On prem SQL SQL Azure Database
  • 34. Belgium SQL Data Sync " changing the way integration is done BizTalk Services (bridge enrichment : look up) SQL Data Sync Feed Azure Database with local SQL reference data for lookups On prem SQL SQL Azure Database Advantages • Quick to set up • Low latency for data access (same data center) • No changes need to local application Reasoning • Warning – in preview for years ! • Good for caching data in the cloud
  • 35. Netherlands Service Bus Relay BizTalk Adapter Service Service Bus Relay REST FILE Cloud Integration environment, using Service Bus Relay to on-prem SQL Cyprus Cloud Connector Codit Integration Cloud
  • 36. Service Bus Relay Cloud Integration environment, using Service Bus Relay to on-prem Advantages • Connections managed from the cloud • On-premises footprint extremely small • No DMZ deployment needed • Extensible connection service Reasoning • Minimize network / application impact • Fully outsource solution
  • 37. BizTalk Services Azure BizTalk Services On prem ESB Service Bus Relay SAP WMS Oracle FTP, AS2… Customer moving all B2B to the cloud, relaying to on prem BizTalk
  • 38. BizTalk Services Windows Azure BizTalk Services BizTalk ESB Service Bus Relay SAP WMS Oracle FTP, AS2… Advantages • Faster set-up of partner connections • One-time firewall set-up • Support for existing mappings & schemas in WABS • No specific DMZ deployment needed Reasoning • Latency less important for B2B than EAI Customer moving all B2B to the cloud, relaying to on prem BizTalk
  • 39. THANK YOU AND NOW, QUESTIONS? OR DRINKS?
  • 40. Follow Technet Belgium @technetbelux Subscribe to the TechNet newsletter aka.ms/benews Be the first to know
  • 41. Belgiums’ biggest IT PRO Conference