SlideShare a Scribd company logo
EDINA – Delivering solutions with OGC Standards and OSGeo Addy Pope June 2011 OSGIS 2011 – Delivering solutions with OGC Standards and OSGeo
Plan A Standards Open Data & Open Source Software at EDINA Who What How Why Conclusions 0 30 OGC OSGeo
What is EDINA? Open Data & Open Source Software at EDINA is a National Data Centre Based at  Supported by  http:// pafciu17.dev.openstreetmap.org /?module=map&center=-3.18,55.935&zoom=17&width=400&height=400type=cycle
What do we do? Open Data & Open Source Software at EDINA http://www.flickr.com/photos/steverhode/3183290111/sizes/l/in/photostream/ Ensure  continuous access to resources Preservation  initiatives to ensure long term access to scholarly content Repository  services for open access and other licensed material
What do we do? Open Data & Open Source Software at EDINA Authentication Multimedia Services Bibliographic Services Geo Service
Geo – Digimap Collections Open Data & Open Source Software at EDINA
Geo – Accessing the data Open Data & Open Source Software at EDINA Digimap provides access to data in several ways.............. Online mapping now with annotation........... Download the data for use on your desktop
Geo – Digimap Openstream Open Data & Open Source Software at EDINA Stream OS Opendata directly into: Web apps Google Earth Desktop GIS http://openstream.edina.ac.uk/ Over 1000 registered users Non-academic use
GoGeo Open Data & Open Source Software at EDINA Images of front pages here…… Discover  GIS resources Find  Data Create  standards compliant metadata Learn  about metadata standards
ShareGeo Open Open Data & Open Source Software at EDINA Images of front pages here…… Find and Share spatial data http://sharegeo.ac.uk/ Re-use rather than recreate
Geo - Open Boundaries Open Data & Open Source Software at EDINA Images of front pages here…… http://openboundaries.edina.ac.uk Find administrative and electoral boundaries for multiple years Preview the boundary
Unlock Open Data & Open Source Software at EDINA Images of front pages here…… Placename Gazetteer Search Disambiguate place Places are not always just a point. What shape represents a place? Unlock API available for you to use. 3 gazetteers: Geonames OS Open (50k gazetteer) OS Closed (MasterMap) Natural Earth (soon)
What about the data? Open Data & Open Source Software at EDINA Diagram kindly supplied by Snowflake Software Making data available is great, but it should be in a usable format.
Where are we going? Open Data & Open Source Software at EDINA Images of front pages here…… Location Based Service  –  everything goes mobile……. TouchMap Lite app that streams OS Digimap OpenStream to a mobile. Not a native app. Augmented Reality  – Look at the blog for a comparison of AR browsers.  HTML 5 –  making use of html 5 in particular Canvas. http://mab.edina.ac.uk/geomobile-test/osopen.html http://mobilegeo.wordpress.com/
Open Data & Open Source Software at EDINA What standards do we use Just some of the standards that we publish to or use in Geo-services at EDINA Service Standards Digimap WMS Digimap for Schools WMS Openstream WMS UKB/Open Boundaries WMS GoGeo CSW for metadata harvesting and publishing OAI for metadata harvesting ISO 19139 encoded metadata ShareGeo OAI-PMH – for metadata harvesting GeoDoc Xforms (user interface for forms) Xslt (XML schema transformation) eXist (xml based database management)
Open Data & Open Source Software at EDINA Standards http://www.flickr.com/photos/epublicist/3546059144/ Consensus approach Standard design by the community for the community Promotes interoperability “ Plug and play” when combined
Why standards work? Open Data & Open Source Software at EDINA Standards give you something to work towards and test against. Not quite a recipe to follow but you know what you should end up with Allow others to easily consume your service  Should allow different components to fit together –  “plug and play” http://www.flickr.com/photos/indieb0i/101943682/ Not mine, honest
OSGeo Open Data & Open Source Software at EDINA OSGeo projects represent software that: Complies with OGC standards where possible Is tried and tested Is stable Is well documented Has a community of support around it http://www.opengeospatial.org/standards A project has to progress through incubation which helps achieve the criteria listed above and should install confidence in those that use the software.
Digimap case study Open Data & Open Source Software at EDINA So, how does this work in practice?  http://www.flickr.com/photos/andivszf/4962765151/
Carbon Arc - http://www.flickr.com/photos/41002268@N03/4991180505/sizes/l/in/photostream/ Open Data & Open Source Software at EDINA Some figures 2010 logins:  220,000 Screen Maps:  6,000,000   Print maps:  150,000 Data downloads:  87,000 400,000  tiles of data (ex mastermap) 635,000km 2  Mastermap 16,000,000km 2  ITN  45, 000  active registered Digimap users 450 million  objects in spatial databases 1.5 Tb  of accessible data Operates within tight SLA’s We may not be a commercial outfit but our services aren’t small
Open Data & Open Source Software at EDINA WMS WFS TileCache Custom maps Standard maps Map or Data System Architecture Service Delivery
Open Data & Open Source Software at EDINA Replication Current Live Upload to Live Dev A Dev B Live A @ Kings Buildings Live B @ Appleton Tower Live Dev Backup Dev Test in live env
Advantages Open Data & Open Source Software at EDINA From our  users  point of view: Services more functionally rich Improved resilience Fall-over and machine redundancy can be offset by virtualisation and open source software stacks From our  funders  point of view: Improved service delivery with lower recurring costs More flexibility and ability to innovate Open standards  have a definite role, vital for chaining open source products but… They are not an end in themselves Not always as mature (or static) as might wish and can evolve in short time periods
Things to think about….. Slide   of 18 Open Data & Open Source Software at EDINA Support, documentation, development Pick the right tool for the job – open or proprietary. Hybrid systems work Solutions should provide a flexible framework that can grow and evolve Work towards standards, this will make services interoperable and should allow for flexible development Proprietary vendors should integrate their product to fit your architecture Addy Pope Email:  [email_address] Twitter:  @go_geo http://www.gogeo.ac.uk EDINA website: http://edina.ac.uk
Conclusions Slide   of 18 Open Data & Open Source Software at EDINA From our  users  point of view: Services more functionally rich Improved resilience Fail-over and machine redundancy can be offset by virtualisation and open source software stacks From our  funders  point of view: Improved service delivery with lower recurring costs More flexibility and ability to innovate Open standards  have a definite role, vital for chaining open source products but… They are not an end in themselves Not always as mature (or static) as might wish and can evolve in short time periods
Open Source, Geo and Health Workshop Tuesday 9 th  August Napier University, Edinburgh http://geco.blogs.edina.ac.uk/ Free Workshop Open Data & Open Source Software at EDINA Addy Pope Email:  [email_address] Twitter:  @go_geo http://www.gogeo.ac.uk EDINA website: http://edina.ac.uk
Open Interoperability Standards Many of EDINA’s systems implement Open Geospatial Consortium OpenGIS® interoperability standards While we do not offer public WFS/WMS services, we do use: WMS, WFS, SLD, GLS, KML, GML… Through various mapping / data download clients Our subscription services protected by Shibboleth authentication (implementing SAML to provide single sign-on and attribute exchange) and are free at the point of use Open Source Software & Open Interoperability Standards at EDINA
Hybrid Stack Open Data & Open Source Software at EDINA We use a mix of open source and proprietary software. Why? Well, we believe it provides us with the best solution that fits our requirements. Cartographic output better handled by GoLoader and GoPublisher are great for handling Mastermap Migrating away from  this but tied to it for GoPublisher.
Services we run Slide   of 18 Open Data & Open Source Software at EDINA Images of front pages here……

More Related Content

Osgis2011 edina addy_pope

  • 1. EDINA – Delivering solutions with OGC Standards and OSGeo Addy Pope June 2011 OSGIS 2011 – Delivering solutions with OGC Standards and OSGeo
  • 2. Plan A Standards Open Data & Open Source Software at EDINA Who What How Why Conclusions 0 30 OGC OSGeo
  • 3. What is EDINA? Open Data & Open Source Software at EDINA is a National Data Centre Based at Supported by http:// pafciu17.dev.openstreetmap.org /?module=map&center=-3.18,55.935&zoom=17&width=400&height=400type=cycle
  • 4. What do we do? Open Data & Open Source Software at EDINA http://www.flickr.com/photos/steverhode/3183290111/sizes/l/in/photostream/ Ensure continuous access to resources Preservation initiatives to ensure long term access to scholarly content Repository services for open access and other licensed material
  • 5. What do we do? Open Data & Open Source Software at EDINA Authentication Multimedia Services Bibliographic Services Geo Service
  • 6. Geo – Digimap Collections Open Data & Open Source Software at EDINA
  • 7. Geo – Accessing the data Open Data & Open Source Software at EDINA Digimap provides access to data in several ways.............. Online mapping now with annotation........... Download the data for use on your desktop
  • 8. Geo – Digimap Openstream Open Data & Open Source Software at EDINA Stream OS Opendata directly into: Web apps Google Earth Desktop GIS http://openstream.edina.ac.uk/ Over 1000 registered users Non-academic use
  • 9. GoGeo Open Data & Open Source Software at EDINA Images of front pages here…… Discover GIS resources Find Data Create standards compliant metadata Learn about metadata standards
  • 10. ShareGeo Open Open Data & Open Source Software at EDINA Images of front pages here…… Find and Share spatial data http://sharegeo.ac.uk/ Re-use rather than recreate
  • 11. Geo - Open Boundaries Open Data & Open Source Software at EDINA Images of front pages here…… http://openboundaries.edina.ac.uk Find administrative and electoral boundaries for multiple years Preview the boundary
  • 12. Unlock Open Data & Open Source Software at EDINA Images of front pages here…… Placename Gazetteer Search Disambiguate place Places are not always just a point. What shape represents a place? Unlock API available for you to use. 3 gazetteers: Geonames OS Open (50k gazetteer) OS Closed (MasterMap) Natural Earth (soon)
  • 13. What about the data? Open Data & Open Source Software at EDINA Diagram kindly supplied by Snowflake Software Making data available is great, but it should be in a usable format.
  • 14. Where are we going? Open Data & Open Source Software at EDINA Images of front pages here…… Location Based Service – everything goes mobile……. TouchMap Lite app that streams OS Digimap OpenStream to a mobile. Not a native app. Augmented Reality – Look at the blog for a comparison of AR browsers. HTML 5 – making use of html 5 in particular Canvas. http://mab.edina.ac.uk/geomobile-test/osopen.html http://mobilegeo.wordpress.com/
  • 15. Open Data & Open Source Software at EDINA What standards do we use Just some of the standards that we publish to or use in Geo-services at EDINA Service Standards Digimap WMS Digimap for Schools WMS Openstream WMS UKB/Open Boundaries WMS GoGeo CSW for metadata harvesting and publishing OAI for metadata harvesting ISO 19139 encoded metadata ShareGeo OAI-PMH – for metadata harvesting GeoDoc Xforms (user interface for forms) Xslt (XML schema transformation) eXist (xml based database management)
  • 16. Open Data & Open Source Software at EDINA Standards http://www.flickr.com/photos/epublicist/3546059144/ Consensus approach Standard design by the community for the community Promotes interoperability “ Plug and play” when combined
  • 17. Why standards work? Open Data & Open Source Software at EDINA Standards give you something to work towards and test against. Not quite a recipe to follow but you know what you should end up with Allow others to easily consume your service Should allow different components to fit together – “plug and play” http://www.flickr.com/photos/indieb0i/101943682/ Not mine, honest
  • 18. OSGeo Open Data & Open Source Software at EDINA OSGeo projects represent software that: Complies with OGC standards where possible Is tried and tested Is stable Is well documented Has a community of support around it http://www.opengeospatial.org/standards A project has to progress through incubation which helps achieve the criteria listed above and should install confidence in those that use the software.
  • 19. Digimap case study Open Data & Open Source Software at EDINA So, how does this work in practice? http://www.flickr.com/photos/andivszf/4962765151/
  • 20. Carbon Arc - http://www.flickr.com/photos/41002268@N03/4991180505/sizes/l/in/photostream/ Open Data & Open Source Software at EDINA Some figures 2010 logins: 220,000 Screen Maps: 6,000,000 Print maps: 150,000 Data downloads: 87,000 400,000 tiles of data (ex mastermap) 635,000km 2 Mastermap 16,000,000km 2 ITN 45, 000 active registered Digimap users 450 million objects in spatial databases 1.5 Tb of accessible data Operates within tight SLA’s We may not be a commercial outfit but our services aren’t small
  • 21. Open Data & Open Source Software at EDINA WMS WFS TileCache Custom maps Standard maps Map or Data System Architecture Service Delivery
  • 22. Open Data & Open Source Software at EDINA Replication Current Live Upload to Live Dev A Dev B Live A @ Kings Buildings Live B @ Appleton Tower Live Dev Backup Dev Test in live env
  • 23. Advantages Open Data & Open Source Software at EDINA From our users point of view: Services more functionally rich Improved resilience Fall-over and machine redundancy can be offset by virtualisation and open source software stacks From our funders point of view: Improved service delivery with lower recurring costs More flexibility and ability to innovate Open standards have a definite role, vital for chaining open source products but… They are not an end in themselves Not always as mature (or static) as might wish and can evolve in short time periods
  • 24. Things to think about….. Slide of 18 Open Data & Open Source Software at EDINA Support, documentation, development Pick the right tool for the job – open or proprietary. Hybrid systems work Solutions should provide a flexible framework that can grow and evolve Work towards standards, this will make services interoperable and should allow for flexible development Proprietary vendors should integrate their product to fit your architecture Addy Pope Email: [email_address] Twitter: @go_geo http://www.gogeo.ac.uk EDINA website: http://edina.ac.uk
  • 25. Conclusions Slide of 18 Open Data & Open Source Software at EDINA From our users point of view: Services more functionally rich Improved resilience Fail-over and machine redundancy can be offset by virtualisation and open source software stacks From our funders point of view: Improved service delivery with lower recurring costs More flexibility and ability to innovate Open standards have a definite role, vital for chaining open source products but… They are not an end in themselves Not always as mature (or static) as might wish and can evolve in short time periods
  • 26. Open Source, Geo and Health Workshop Tuesday 9 th August Napier University, Edinburgh http://geco.blogs.edina.ac.uk/ Free Workshop Open Data & Open Source Software at EDINA Addy Pope Email: [email_address] Twitter: @go_geo http://www.gogeo.ac.uk EDINA website: http://edina.ac.uk
  • 27. Open Interoperability Standards Many of EDINA’s systems implement Open Geospatial Consortium OpenGIS® interoperability standards While we do not offer public WFS/WMS services, we do use: WMS, WFS, SLD, GLS, KML, GML… Through various mapping / data download clients Our subscription services protected by Shibboleth authentication (implementing SAML to provide single sign-on and attribute exchange) and are free at the point of use Open Source Software & Open Interoperability Standards at EDINA
  • 28. Hybrid Stack Open Data & Open Source Software at EDINA We use a mix of open source and proprietary software. Why? Well, we believe it provides us with the best solution that fits our requirements. Cartographic output better handled by GoLoader and GoPublisher are great for handling Mastermap Migrating away from this but tied to it for GoPublisher.
  • 29. Services we run Slide of 18 Open Data & Open Source Software at EDINA Images of front pages here……