SlideShare a Scribd company logo

Creating Flexible Data Services For Enterprise Soa With Wso2 Data Services

•
•
S
sumedha.r

WSO2 Data Services allows accessing data from various sources like relational databases and exposing it as web services or REST resources. It uses a Data Service Description Language to map service requests to database queries and results to XML responses. Key features include support for CRUD operations, caching, security, and connection pooling. Professional support and training is available to help with implementation and production use.

Related slideshows

CloudConnect 2011 - Building Highly Scalable Java Applications on Windows Azure
CloudConnect 2011 - Building Highly Scalable Java Applications on Windows AzureCloudConnect 2011 - Building Highly Scalable Java Applications on Windows Azure
CloudConnect 2011 - Building Highly Scalable Java Applications on Windows Azure
 
Rock Solid SQL Server Management
Rock Solid SQL Server ManagementRock Solid SQL Server Management
Rock Solid SQL Server Management
 
SQL Server Developer 70-433
SQL Server Developer 70-433SQL Server Developer 70-433
SQL Server Developer 70-433
 
1 of 39
Creating flexible data services for enterprise SOA with WSO2 Data Services Sumedha Rubasinghe ( [email_address] ) ~ WSO2 Data Services Team ~
WSO2 Background Founded in August 2005 by leaders in XML and Web services technologies & standards, and open source Building complete SOA platform, all 100% open source Founders / leading contributors to all key Apache Web services / SOA projects Selling support, training and services around the software & solutions Global corporation with R&D center in Sri Lanka and offices in US & UK, totaling 60+ employees
Problem Data locked away in monolithic application silos No unified away of accessing data Need to access most recent data Mergers/acquisitions/partnerships Challenges SOA demands access to data in heterogeneous data sources Business users does not differentiate between application functionality or data access Financial & budgeting constraints
Alternative approaches to data access in a SOA Direct access to databases (JDBC,ODBC,..etc) Use of O/R mapping frameworks (Hibernate, Ibatis,...) Enterprise Java Beans (EJBs) CORBA Problem Each approach demands different way of access Developer time spent on data access, rather than implementing business functionality Thus comes the need for Data services
How Can WSO2 Data Services Help? Ability to access most up-to-date data using a service call (brings you to the front of the wave) Single layer for accessing all the data needs of your SOA Optimization efforts will be available to all the service consumers Developer productivity – save time on developing similar data access mechanism for different applications QoS – battle tested runtime
WSO2 Data Services in a nutshell A mechanism to take relational and other data locked away in databases and make them available as WS-* style Web services or as a set of REST style web resources.
Simple example Expose Employee contact data in MySQL database as a service Table Structure How to do this?
Simple example – GUI wizard step (1)
Simple example – GUI wizard step (2)
Simple example – GUI wizard step (3)
Simple example : configuration file <data name=&quot; ContactInfoService &quot;> <config> <property name=&quot;org.wso2.ws.dataservice.driver&quot;> com.mysql.jdbc.Driver </property> <property name=&quot;org.wso2.ws.dataservice.protocol&quot;> jdbc:mysql://localhost:3306/dataservice_sample </property> <property name=&quot;org.wso2.ws.dataservice.user&quot;> dsuser </property> <property name=&quot;org.wso2.ws.dataservice.password&quot;> user123 </property> <property name=&quot;org.wso2.ws.dataservice.minpoolsize&quot;> 1 </property> <property name=&quot;org.wso2.ws.dataservice.maxpoolsize&quot;> 5 </property> </config> <query id=&quot; contactInfoQuery &quot;> <sql> select firstName,lastName,extension,email from employees where lastName = ? </sql> <param name=&quot; name &quot; sqlType=&quot; STRING &quot; /> <result element=&quot; Employees &quot; rowName=&quot; ContactInfo &quot;> <attribute name=&quot; LastName &quot; column=&quot; lastName &quot; /> <element name=&quot; FirstName &quot; column=&quot; firstName &quot; /> <element name=&quot; Extension &quot; column=&quot; extension &quot; /> <element name=&quot; Email &quot; column=&quot; email &quot; /> </result> </query> <operation name=&quot; getContactInformation &quot;> <call-query href=&quot; contactInfoQuery &quot; > <with-param name=&quot; name &quot; query-param=&quot; name &quot; /> </call-query> </operation> </data>
WSDL for the Service http://<IP>:<PORT>/services/ContactInfoService?wsdl2
Invoking the Service – HTTP binding http://<IP>:<PORT>/services/ContactInfoService/getContactInformation?name=Patterson
Invoking the Service – using TryIt Services > ContactInfoService > TryIt
Data Services Description Language In-house developed language for writing data services Maps service requests to your SOA to queries operating on your database objects (tables, views, procedures & functions) Maps query results to XML responses Available online @ http://wso2.org/wiki/display/wsf/Data+Services+and+Resources
Data Services Architecture Data Services are SOA equivalent of the Data Access Object(DAO) Pattern DS deal with different data sources similar to what DAO does But, DS operate on a different layer
WSO2 Data Services(DS),WSAS & Axis2 First appeared on WSAS 2.0 WSO2 DS runs on top of Axis2 SOAP Engine Equinox OSGI container First of new breed of products Also available on WSO2's Web Services Application Server (WSAS) Growing feature list with every new release Open source (Apache licensed)
Currently Supported Data Sources Relational Databases Any database accessible via JDBC Tables, views, stored procedures, functions URL accessible Comma Separated Value (CSV) files Microsoft Excel (97 – 2003) spread sheets operation per work book Coming up Support for LDAP Trees
Zero code approach Simple XML configuration file Easy configuration for Database Administrators System Administrators Easily portable
CRUD support Create/Read/Update/Delete most up to date data
Web console / Eclipse plugin wizard Simple Web based UI wizard Eclipse plugin wizard
Customizable Response Service consumer – different input formats Response format can be customizable XSLT transformation capabilities (future feature) Advance Transformations through ESB (eg. WSO2 ESB)
Data as Resources(REST) Unique URL for each data item http://myserver.com/services/products/ {product-code} http://myserver.com/services/products/ AB342 http://mybooks.com/services/book/ISBN2823 Support HTTP GET,POST,PUT,DELETE methods Simple configuration
Single service - multiple data sources 'Customer data' in MSSQL DB & 'Order data' in 'Derby DB' The need – Orders along with Customers placed them Link heterogeneous data sources (MySQL & CSV file) Consolidated logical view – distribute data Derby MS SQL
Expose Stored Procedures & Functions Business logic in Stored procedures/functions Expose them as web services within minutes Power of pre-compiled procedures + Data Service in SOA
Built-in caching Infrequent updates to database data Cache response & use it Configurable options Timeout Cache size memory/file system
Access Throttling Control access frequency Two options, Rate based throttling Frequency based throttling
High Availability HA via clustering Using Apache Tribes – Tomcat Clustering Communication module Graceful shutdown
Security Supports WS Security using Apache Rampart 15 Security Scenarios Basic (4) Confidentiality UsernameToken Integrity Non-repudiation Advance (11)
Built-in connection pooling Apache DBCP as the built-in pooling manager Greatly increases the performance Ability to connect to Data sources bound to JNDI name Use a pooling manager of your choice
'Try It' for testing services Test your data services without leaving console Ability to dynamically change the configuration & see the results
Management Console Monitor system usage Statistics gathered include: Service usage Endpoint load Overall system performance Enable tracing of a running system and capture service level message traces Configure system level logging and monitor logs directly from the console Monitoring via JMX
Up coming features LDAP Directories as data sources SQL support for CSV & Excel Response Compression Reading database credentials from runtime Batch insert/update APP support support for SQL in (...where country_id in ('SL','US','UK');) Content filtering based on logged in User Improved Eclipse Plugin More user friendly Web UI
Getting started ... Many online resources on WSO2 Oxygen Tank (wso2.org) How to use MySQL 5 INOUT variables in Data Services? ( http://wso2.org/blog/sumedha/3082 ) How to call MySQL 5 Stored Function from Data Service? ( http://wso2.org/blog/sumedha/3029 ) How to call MySQL 5 stored procedure from Data Services?( http://wso2.org/blog/sumedha/2623 ) How to call MySQL 5 view from Data Services? (coming up) Data Service in 2 minutes - Movie (coming up) Getting started with Data Services using Oracle ( http://wso2.org/blog/sumedha/3051 ) Getting started with Data Services using WSO2 WSAS-2.0 ( http://wso2.org/blog/sumedha/2573 ) - using Derby as database Getting started with Data Service Samples - Movie ( http://wso2.org/blog/sumedha/2590 ) - using Derby as database How to page (http://wso2.org/library/3183) Forum (http://wso2.org/forum/404) Mailing list (ds-java-user@wso2.org)
Professional Services & support WSO2 is the leading provider of Open Source support for Apache WS projects With over 60 employees in three geographies we can offer first class support Range of support options up to 24x7 production Support Backed by key Apache and OSS committers More information - http://wso2.com/support/
Summary
Summary Service enable data locked away in relational databases Support for tables,views, functions & stored procedures Data Service Description Language Not limited to RDBMS (CSV,EXCEL,...) Improved QoS Professional support
Trainings Introduction to Data services http://wso2.com/training/courses/owas001/ Advance Data Services http://wso2.com/training/courses/owas002/ Visit http://wso2.com/training/ for more information
Thank you

More Related Content

Creating Flexible Data Services For Enterprise Soa With Wso2 Data Services

  • 1. Creating flexible data services for enterprise SOA with WSO2 Data Services Sumedha Rubasinghe ( [email_address] ) ~ WSO2 Data Services Team ~
  • 2. WSO2 Background Founded in August 2005 by leaders in XML and Web services technologies & standards, and open source Building complete SOA platform, all 100% open source Founders / leading contributors to all key Apache Web services / SOA projects Selling support, training and services around the software & solutions Global corporation with R&D center in Sri Lanka and offices in US & UK, totaling 60+ employees
  • 3. Problem Data locked away in monolithic application silos No unified away of accessing data Need to access most recent data Mergers/acquisitions/partnerships Challenges SOA demands access to data in heterogeneous data sources Business users does not differentiate between application functionality or data access Financial & budgeting constraints
  • 4. Alternative approaches to data access in a SOA Direct access to databases (JDBC,ODBC,..etc) Use of O/R mapping frameworks (Hibernate, Ibatis,...) Enterprise Java Beans (EJBs) CORBA Problem Each approach demands different way of access Developer time spent on data access, rather than implementing business functionality Thus comes the need for Data services
  • 5. How Can WSO2 Data Services Help? Ability to access most up-to-date data using a service call (brings you to the front of the wave) Single layer for accessing all the data needs of your SOA Optimization efforts will be available to all the service consumers Developer productivity – save time on developing similar data access mechanism for different applications QoS – battle tested runtime
  • 6. WSO2 Data Services in a nutshell A mechanism to take relational and other data locked away in databases and make them available as WS-* style Web services or as a set of REST style web resources.
  • 7. Simple example Expose Employee contact data in MySQL database as a service Table Structure How to do this?
  • 8. Simple example – GUI wizard step (1)
  • 9. Simple example – GUI wizard step (2)
  • 10. Simple example – GUI wizard step (3)
  • 11. Simple example : configuration file <data name=&quot; ContactInfoService &quot;> <config> <property name=&quot;org.wso2.ws.dataservice.driver&quot;> com.mysql.jdbc.Driver </property> <property name=&quot;org.wso2.ws.dataservice.protocol&quot;> jdbc:mysql://localhost:3306/dataservice_sample </property> <property name=&quot;org.wso2.ws.dataservice.user&quot;> dsuser </property> <property name=&quot;org.wso2.ws.dataservice.password&quot;> user123 </property> <property name=&quot;org.wso2.ws.dataservice.minpoolsize&quot;> 1 </property> <property name=&quot;org.wso2.ws.dataservice.maxpoolsize&quot;> 5 </property> </config> <query id=&quot; contactInfoQuery &quot;> <sql> select firstName,lastName,extension,email from employees where lastName = ? </sql> <param name=&quot; name &quot; sqlType=&quot; STRING &quot; /> <result element=&quot; Employees &quot; rowName=&quot; ContactInfo &quot;> <attribute name=&quot; LastName &quot; column=&quot; lastName &quot; /> <element name=&quot; FirstName &quot; column=&quot; firstName &quot; /> <element name=&quot; Extension &quot; column=&quot; extension &quot; /> <element name=&quot; Email &quot; column=&quot; email &quot; /> </result> </query> <operation name=&quot; getContactInformation &quot;> <call-query href=&quot; contactInfoQuery &quot; > <with-param name=&quot; name &quot; query-param=&quot; name &quot; /> </call-query> </operation> </data>
  • 12. WSDL for the Service http://<IP>:<PORT>/services/ContactInfoService?wsdl2
  • 13. Invoking the Service – HTTP binding http://<IP>:<PORT>/services/ContactInfoService/getContactInformation?name=Patterson
  • 14. Invoking the Service – using TryIt Services > ContactInfoService > TryIt
  • 15. Data Services Description Language In-house developed language for writing data services Maps service requests to your SOA to queries operating on your database objects (tables, views, procedures & functions) Maps query results to XML responses Available online @ http://wso2.org/wiki/display/wsf/Data+Services+and+Resources
  • 16. Data Services Architecture Data Services are SOA equivalent of the Data Access Object(DAO) Pattern DS deal with different data sources similar to what DAO does But, DS operate on a different layer
  • 17. WSO2 Data Services(DS),WSAS & Axis2 First appeared on WSAS 2.0 WSO2 DS runs on top of Axis2 SOAP Engine Equinox OSGI container First of new breed of products Also available on WSO2's Web Services Application Server (WSAS) Growing feature list with every new release Open source (Apache licensed)
  • 18. Currently Supported Data Sources Relational Databases Any database accessible via JDBC Tables, views, stored procedures, functions URL accessible Comma Separated Value (CSV) files Microsoft Excel (97 – 2003) spread sheets operation per work book Coming up Support for LDAP Trees
  • 19. Zero code approach Simple XML configuration file Easy configuration for Database Administrators System Administrators Easily portable
  • 21. Web console / Eclipse plugin wizard Simple Web based UI wizard Eclipse plugin wizard
  • 22. Customizable Response Service consumer – different input formats Response format can be customizable XSLT transformation capabilities (future feature) Advance Transformations through ESB (eg. WSO2 ESB)
  • 23. Data as Resources(REST) Unique URL for each data item http://myserver.com/services/products/ {product-code} http://myserver.com/services/products/ AB342 http://mybooks.com/services/book/ISBN2823 Support HTTP GET,POST,PUT,DELETE methods Simple configuration
  • 24. Single service - multiple data sources 'Customer data' in MSSQL DB & 'Order data' in 'Derby DB' The need – Orders along with Customers placed them Link heterogeneous data sources (MySQL & CSV file) Consolidated logical view – distribute data Derby MS SQL
  • 25. Expose Stored Procedures & Functions Business logic in Stored procedures/functions Expose them as web services within minutes Power of pre-compiled procedures + Data Service in SOA
  • 26. Built-in caching Infrequent updates to database data Cache response & use it Configurable options Timeout Cache size memory/file system
  • 27. Access Throttling Control access frequency Two options, Rate based throttling Frequency based throttling
  • 28. High Availability HA via clustering Using Apache Tribes – Tomcat Clustering Communication module Graceful shutdown
  • 29. Security Supports WS Security using Apache Rampart 15 Security Scenarios Basic (4) Confidentiality UsernameToken Integrity Non-repudiation Advance (11)
  • 30. Built-in connection pooling Apache DBCP as the built-in pooling manager Greatly increases the performance Ability to connect to Data sources bound to JNDI name Use a pooling manager of your choice
  • 31. 'Try It' for testing services Test your data services without leaving console Ability to dynamically change the configuration & see the results
  • 32. Management Console Monitor system usage Statistics gathered include: Service usage Endpoint load Overall system performance Enable tracing of a running system and capture service level message traces Configure system level logging and monitor logs directly from the console Monitoring via JMX
  • 33. Up coming features LDAP Directories as data sources SQL support for CSV & Excel Response Compression Reading database credentials from runtime Batch insert/update APP support support for SQL in (...where country_id in ('SL','US','UK');) Content filtering based on logged in User Improved Eclipse Plugin More user friendly Web UI
  • 34. Getting started ... Many online resources on WSO2 Oxygen Tank (wso2.org) How to use MySQL 5 INOUT variables in Data Services? ( http://wso2.org/blog/sumedha/3082 ) How to call MySQL 5 Stored Function from Data Service? ( http://wso2.org/blog/sumedha/3029 ) How to call MySQL 5 stored procedure from Data Services?( http://wso2.org/blog/sumedha/2623 ) How to call MySQL 5 view from Data Services? (coming up) Data Service in 2 minutes - Movie (coming up) Getting started with Data Services using Oracle ( http://wso2.org/blog/sumedha/3051 ) Getting started with Data Services using WSO2 WSAS-2.0 ( http://wso2.org/blog/sumedha/2573 ) - using Derby as database Getting started with Data Service Samples - Movie ( http://wso2.org/blog/sumedha/2590 ) - using Derby as database How to page (http://wso2.org/library/3183) Forum (http://wso2.org/forum/404) Mailing list (ds-java-user@wso2.org)
  • 35. Professional Services & support WSO2 is the leading provider of Open Source support for Apache WS projects With over 60 employees in three geographies we can offer first class support Range of support options up to 24x7 production Support Backed by key Apache and OSS committers More information - http://wso2.com/support/
  • 37. Summary Service enable data locked away in relational databases Support for tables,views, functions & stored procedures Data Service Description Language Not limited to RDBMS (CSV,EXCEL,...) Improved QoS Professional support
  • 38. Trainings Introduction to Data services http://wso2.com/training/courses/owas001/ Advance Data Services http://wso2.com/training/courses/owas002/ Visit http://wso2.com/training/ for more information