SlideShare a Scribd company logo

Introducing Open XDX Technology for Open Data API development

•Download as PPTX, PDF•
•
Bizagi Inc
Bizagi Inc

Introduction to the concepts of Open-XDX for building Open Data APIs using the CAMeditor toolkit. See also http://www.verifyXML.org for working online demonstration site. For online demonstration site please see: http://www.verifyxml.org

Related slideshows

Solution de génération de rapport OpenDocument à partir de plusieurs sources ...
Solution de génération de rapport OpenDocument à partir de plusieurs sources ...Solution de génération de rapport OpenDocument à partir de plusieurs sources ...
Solution de génération de rapport OpenDocument à partir de plusieurs sources ...
 
The IBM Netezza datawarehouse appliance
The IBM Netezza datawarehouse applianceThe IBM Netezza datawarehouse appliance
The IBM Netezza datawarehouse appliance
 
The SPOSAD Architectural Style for Multi-tenant Software Applications
The SPOSAD Architectural Style for Multi-tenant Software ApplicationsThe SPOSAD Architectural Style for Multi-tenant Software Applications
The SPOSAD Architectural Style for Multi-tenant Software Applications
 
1 of 20
Open <Insert Picture Here> Data Exchange Open Data API delivery “Open-XDX” David Webber, Information Architect, Oracle Public Sector
Disclaimer Notice The following is intended to outline Oracle general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle. Slide 2
Background "Open Data is the new default… anywhere, anytime on any device, and everything should be APIs" Steven VanRoekel Federal CIO – Whitehouse Digital Strategy Architect
Decoding the Digital Strategy • What exactly are Open Data APIs? • How can Oracle solutions support them? • What does a solution architecture look like? © 2012 Oracle Corporation – Proprietary and Confidential 4
Open Data APIs explained • A way, via the internet, to securely deliver information between entities and systems • API – Application Programming Interface • Security is supported along with roles and permissions for requestors, e.g. – Public information – such as road works, health services, voting – Private information – patient data, student data, company data © 2012 Oracle Corporation – Proprietary and Confidential 5
Oracle Solutions for Open Data • Introducing Open-XDX • How Oracle Solutions work with Open-XDX • Open Data APIs – unleashed data • Cross-platform and device delivery © 2012 Oracle Corporation – Proprietary and Confidential 6
Oracle Open Data Solution – Open-XDX • Open-XDX is an all new component designed to deliver rapid Open Data APIs • Integrates into Oracle Fusion Middleware foundation and Database products • Uses XML configuration templates and code- less methods and open source NIEM tools • Allows plug-and-play delivery for Oracle customers and applications © 2012 Oracle Corporation – Proprietary and Confidential 7
Integration Conceptual View Open XDX deployment Design Test Deploy Data Delivery CAM Editor SQL DB Open XDX XML Open XDX SQL XML FMW CAMV Web • Device • Visual Editor • Generate Data • Browser • SQL Browser • Validate Data • Open XDX • Server • Dictionaries • Send Data • Web Services • Drag and Drop • FMW / BPM
Open XDX - Conceptual Overview Data Exchange Existing Information Control template contains Databases information of the exchange structure design and DB mapping SQL rules of data tables and columns SQL JDBC Template connection Rapid Structure Deploy Rules Configuration Open-XDX DB Mappings Parameters Open Data Send XML
Option #1 – Visual Mapping Mode Data Exchange Mapping Data store connection wizard XML structure viewer Control template contains information of the exchange structure design and DB mapping Drag and Drop Mappings rules of data tables and columns Template Structure Rules Store Configuration Database schema viewer DB Mappings Parameters • Individual column assignments made as DB mapping rules to existing XML structure layout; • Original XML layout imported from industry Existing application SQL tables; e.g. schema (such as NIEM PMIX shown here) Oracle Healthcare, E- Business Suite, custom system, etc.
Option #2 – Visual Designer Mode Data Exchange Design XML structure viewer Drag and Drop Designer EMPTY (Patient Report) Database schema viewer • Start with new empty XML structure; • Toggle database viewer to designer mode.
Visual Designer Mode Data Exchange Design XML structure viewer Control template contains information of the exchange Drag and Drop structure design and DB mapping Designer rules of data tables and columns Template Structure Rules Store Configuration Database schema viewer DB Mappings Parameters • Drag and Drop table into XML structure • Complete XML structure components automatically inserted (with DBMappings); • All component names / definitions conform to NIEM NDR (smart rename wizard converts SQL to XML)
Demonstration – Open-XDX Data Generation Data Exchange Oracle Tools 2 SQL Existing Information XML Designer 1 MySQL Workbench Generate Open-XDX Application Data Tables Open Data Send 3 Live Data Demo XML
SQL DB Mapping Quick Guide • Tables and Views mappable – Direct access only, use of synonyms not supported – Foreign keys for relationships between tables • Primary keys and Foreign keys automatically mapped – Indexes not mapped automatically – must be referenced – Views – no index definitions – so must be referenced • Data - by default all records are retrieved from all tables referenced – Filtering – parameters must be used on all tables to produce subset of matching records as needed – e.g. date range, customerID – Master & Parent / Child table hierarchy automatically deduced from DBMapping rules and XPath to XML structure • Access control via normal account admin and user rights • Tested with Oracle DB and MySQL © 2012 Oracle Corporation – Proprietary and Confidential 14
XML Structure Usage • Repeatable parent element for matching SQL table – Rows of data inserted as child elements of parent • Table joins provided by parameter select statements – Select statements reference key fields (primary or foreign keys) • Optional and Choice elements – If not used for extracted data, then exclude or use default value – Ensure components needed for data are not part of choice or optional • Map to existing elements or add new elements – Attributes also supported • Data hinting value mechanism can be used in tandem with SQL data inputs for fixed values (company name, company address, exchange version #, etc) © 2012 Oracle Corporation – Proprietary and Confidential 15
Tools Check List • SQL Database – Oracle SQL database – MySQL database – JDBC connector for target SQL database • SQL Development tool – MySQL Workbench – SQL Developer • Open-XDX solution – CAM Editor XML visual developer – Open-XDX JAR for XML generation batch component • Secure message delivery – Oracle Weblogic / SOA Suite – Open-XDX integration (JAX-WS) © 2012 Oracle Corporation – Proprietary and Confidential 16
Deployment Usage Scenarios • Rapid prototyping of information exchange packages • Developing NIEM conformant exchange structures / dictionaries • Query / Response interfaces with filter parameters • Publish / Subscribe Daily or Hourly reporting • XML information structures conform to SQL database model • Limited number of SQL tables involved • SQL data model well behaved with primary indexes and foreign keys • Out of Scope – Highly complex reporting and data manipulation – Huge data volumes / massively high query rates per minute – Multiple sets of tables and relationships © 2012 Oracle Corporation – Proprietary and Confidential 17
Key Technology Capabilities • Delivering on the Open Data Digital Strategy Vision for government • Open Standards and Open Source based • Plug and play with code-free templates and rapid development • Supports NIEM and Open XML exchanges • Leverages deployed technology today • Workflow integration • Secure messaging delivery and partner management • Delivered across-platform and device • End-to-end security & governance © 2012 Oracle Corporation – Proprietary and Confidential 18
CAMeditor.ORG Project Statistics SNAPSHOT OF PROJECT ACTIVITIES 50,000+ CAMeditor.org page visits in one year 130+ countries have downloaded tools; 30% of visitors are from U.S.; 400+ downloads weekly 5 to 10 students use online video training resource weekly 6 languages now available www.cameditor.org ‹#›
©2012 Oracle Corporation 20

More Related Content

Introducing Open XDX Technology for Open Data API development

  • 1. Open <Insert Picture Here> Data Exchange Open Data API delivery “Open-XDX” David Webber, Information Architect, Oracle Public Sector
  • 2. Disclaimer Notice The following is intended to outline Oracle general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle. Slide 2
  • 3. Background "Open Data is the new default… anywhere, anytime on any device, and everything should be APIs" Steven VanRoekel Federal CIO – Whitehouse Digital Strategy Architect
  • 4. Decoding the Digital Strategy • What exactly are Open Data APIs? • How can Oracle solutions support them? • What does a solution architecture look like? © 2012 Oracle Corporation – Proprietary and Confidential 4
  • 5. Open Data APIs explained • A way, via the internet, to securely deliver information between entities and systems • API – Application Programming Interface • Security is supported along with roles and permissions for requestors, e.g. – Public information – such as road works, health services, voting – Private information – patient data, student data, company data © 2012 Oracle Corporation – Proprietary and Confidential 5
  • 6. Oracle Solutions for Open Data • Introducing Open-XDX • How Oracle Solutions work with Open-XDX • Open Data APIs – unleashed data • Cross-platform and device delivery © 2012 Oracle Corporation – Proprietary and Confidential 6
  • 7. Oracle Open Data Solution – Open-XDX • Open-XDX is an all new component designed to deliver rapid Open Data APIs • Integrates into Oracle Fusion Middleware foundation and Database products • Uses XML configuration templates and code- less methods and open source NIEM tools • Allows plug-and-play delivery for Oracle customers and applications © 2012 Oracle Corporation – Proprietary and Confidential 7
  • 8. Integration Conceptual View Open XDX deployment Design Test Deploy Data Delivery CAM Editor SQL DB Open XDX XML Open XDX SQL XML FMW CAMV Web • Device • Visual Editor • Generate Data • Browser • SQL Browser • Validate Data • Open XDX • Server • Dictionaries • Send Data • Web Services • Drag and Drop • FMW / BPM
  • 9. Open XDX - Conceptual Overview Data Exchange Existing Information Control template contains Databases information of the exchange structure design and DB mapping SQL rules of data tables and columns SQL JDBC Template connection Rapid Structure Deploy Rules Configuration Open-XDX DB Mappings Parameters Open Data Send XML
  • 10. Option #1 – Visual Mapping Mode Data Exchange Mapping Data store connection wizard XML structure viewer Control template contains information of the exchange structure design and DB mapping Drag and Drop Mappings rules of data tables and columns Template Structure Rules Store Configuration Database schema viewer DB Mappings Parameters • Individual column assignments made as DB mapping rules to existing XML structure layout; • Original XML layout imported from industry Existing application SQL tables; e.g. schema (such as NIEM PMIX shown here) Oracle Healthcare, E- Business Suite, custom system, etc.
  • 11. Option #2 – Visual Designer Mode Data Exchange Design XML structure viewer Drag and Drop Designer EMPTY (Patient Report) Database schema viewer • Start with new empty XML structure; • Toggle database viewer to designer mode.
  • 12. Visual Designer Mode Data Exchange Design XML structure viewer Control template contains information of the exchange Drag and Drop structure design and DB mapping Designer rules of data tables and columns Template Structure Rules Store Configuration Database schema viewer DB Mappings Parameters • Drag and Drop table into XML structure • Complete XML structure components automatically inserted (with DBMappings); • All component names / definitions conform to NIEM NDR (smart rename wizard converts SQL to XML)
  • 13. Demonstration – Open-XDX Data Generation Data Exchange Oracle Tools 2 SQL Existing Information XML Designer 1 MySQL Workbench Generate Open-XDX Application Data Tables Open Data Send 3 Live Data Demo XML
  • 14. SQL DB Mapping Quick Guide • Tables and Views mappable – Direct access only, use of synonyms not supported – Foreign keys for relationships between tables • Primary keys and Foreign keys automatically mapped – Indexes not mapped automatically – must be referenced – Views – no index definitions – so must be referenced • Data - by default all records are retrieved from all tables referenced – Filtering – parameters must be used on all tables to produce subset of matching records as needed – e.g. date range, customerID – Master & Parent / Child table hierarchy automatically deduced from DBMapping rules and XPath to XML structure • Access control via normal account admin and user rights • Tested with Oracle DB and MySQL © 2012 Oracle Corporation – Proprietary and Confidential 14
  • 15. XML Structure Usage • Repeatable parent element for matching SQL table – Rows of data inserted as child elements of parent • Table joins provided by parameter select statements – Select statements reference key fields (primary or foreign keys) • Optional and Choice elements – If not used for extracted data, then exclude or use default value – Ensure components needed for data are not part of choice or optional • Map to existing elements or add new elements – Attributes also supported • Data hinting value mechanism can be used in tandem with SQL data inputs for fixed values (company name, company address, exchange version #, etc) © 2012 Oracle Corporation – Proprietary and Confidential 15
  • 16. Tools Check List • SQL Database – Oracle SQL database – MySQL database – JDBC connector for target SQL database • SQL Development tool – MySQL Workbench – SQL Developer • Open-XDX solution – CAM Editor XML visual developer – Open-XDX JAR for XML generation batch component • Secure message delivery – Oracle Weblogic / SOA Suite – Open-XDX integration (JAX-WS) © 2012 Oracle Corporation – Proprietary and Confidential 16
  • 17. Deployment Usage Scenarios • Rapid prototyping of information exchange packages • Developing NIEM conformant exchange structures / dictionaries • Query / Response interfaces with filter parameters • Publish / Subscribe Daily or Hourly reporting • XML information structures conform to SQL database model • Limited number of SQL tables involved • SQL data model well behaved with primary indexes and foreign keys • Out of Scope – Highly complex reporting and data manipulation – Huge data volumes / massively high query rates per minute – Multiple sets of tables and relationships © 2012 Oracle Corporation – Proprietary and Confidential 17
  • 18. Key Technology Capabilities • Delivering on the Open Data Digital Strategy Vision for government • Open Standards and Open Source based • Plug and play with code-free templates and rapid development • Supports NIEM and Open XML exchanges • Leverages deployed technology today • Workflow integration • Secure messaging delivery and partner management • Delivered across-platform and device • End-to-end security & governance © 2012 Oracle Corporation – Proprietary and Confidential 18
  • 19. CAMeditor.ORG Project Statistics SNAPSHOT OF PROJECT ACTIVITIES 50,000+ CAMeditor.org page visits in one year 130+ countries have downloaded tools; 30% of visitors are from U.S.; 400+ downloads weekly 5 to 10 students use online video training resource weekly 6 languages now available www.cameditor.org ‹#›

Editor's Notes

  1. Share PMIX dataLoad to State databasesPerform data cleansingEndeca Information Discover ServerAnalyze results in Case Management
  2. Share PMIX dataLoad to State databasesPerform data cleansingEndeca Information Discover ServerAnalyze results in Case Management
  3. Share PMIX dataLoad to State databasesPerform data cleansingEndeca Information Discover ServerAnalyze results in Case Management
  4. Share PMIX dataLoad to State databasesPerform data cleansingEndeca Information Discover ServerAnalyze results in Case Management
  5. Step 1 – review application databases using Workbench (MySQL / Oracle Designer)Step 2 – Drag and Drop mappings to XML target structureRun Open XDX engine – read data, build results XMLTest, validate, refine, deployDeployment with WebLogic, BPEL, SOA suite, JAX-WS, etc.