Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies
•
2 likes•1,690 views
The document discusses best practices for geodatabase design, storage, versioning, and performance management. It provides guidance to a new spatial data administrator, Dave, on assessing his organization's existing spatial data needs, creating a data model and governance plan, importing data, and collaborating with the database administrator to optimize database performance over time. Key topics covered include geodatabase design, storage and migration strategies, when and how to implement versioning, using replication to distribute data, and techniques for maintaining optimal performance such as attribute indexing, statistics, and scheduling maintenance tasks.
Report
Share
Related slideshows
Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies
- 2. Agenda • Geodatabase design and how it can assist you • Geodatabase Storage and Migration • Versioning – When to use? – How to manage • Geodatabase Replication • Performance and Maintenance
- 3. Department of Spatial Awareness Dave • New Spatial Data Administrator • Existing Organisation Planning Operations Media
- 4. Department of Spatial Awareness Dave • Lots of Corporate Data stored in “silo’s” • A lot of project data stored on peoples computers • No specified data standards • The data has been stored in SDE – Where no one knows what is there – Everyone complains about poor performance
- 5. Department of Spatial Awareness What should Dave do now? • Identify the workflows in the organisation • Create a data governance document – What do the users need to do to make the data useful to the organisation • • • • Create a Data Model Import the data into the new data model Setup an edit workflow Manage the ongoing performance of the Database
- 6. What’s in a geodatabase design? GIS behavior Rules Tools Elements Single-user Multiuser Geodatabase
- 7. Geodatabase functionality Default attribute values Subtypes Single-user Multiuser Attribute domains Attachments Relationship classes Topology
- 8. Workflow: From design to prototype Design the geodatabase Obtain schema Modify schema Add data Prototype geodatabase
- 9. What should Dave do next? • Speak to Barry • Barry is the Corporate DBA – It is Barry’s job to make sure that the databases perform The key to Enterprise GIS is a collaboration between the business systems and the spatial architecture
- 10. Diagrammer & Case Tools (free tools) • ArcGIS Diagrammer is a productivity tool for GIS professionals to create, edit or analyze geodatabase schema. • Is a visual editor for Esri’s .xml Workspace Document • *Supports complex geodatabase elements such as topology and parcel fabrics http://www.arcgis.com/home/item.html?id=5af1723bab4e413bae63dd89daa87984
- 11. CDB If I build it, they will come ArcGIS Geodatabase and CASE Tools
- 12. What’s in the Geodatabase?
- 13. What’s in the Geodatabase?
- 15. What’s inside the Geodatabase?
- 16. What’s inside the Geodatabase? - Pre-configured table - 370 configuration parameters
- 17. ArcSDE and the DBTUNE table Client Translator Database Server Select… DBTUNE Repository
- 18. ArcSDE compressed binary • Better performance for advance geodatabase elements • Reduce the storage size in the RDBMS • Difficult to access with SQL commands and third party applications
- 19. Spatial field types • The default format in ArcSDE • Easy access with SQL operators and spatial functions.
- 21. Migrating spatial types Supported migration paths SQLServer • • SDE binary to Geometry SDE binary t Geography Oracle • • SDE binary to ST_Geometry SDO_Geometry to ST_Geometry
- 22. WS Put it in the bucket Storage and Migration
- 23. Like a Version D77 SDE_STATE_ID # DELETED_AT Unique object ID Constant for all versions of a row # # SDE_DELETES_ROW_ID A77 SHAPE NAME OBJECTID SDE_STATE_ID Database state Identifies when row was added CELL_TOWERS SHAPE 1 2 3 NAME Riverside NE Riverside SE Riverside W OBJECTID 1 2 3 SDE_STATE_ID 0 0 0
- 24. Like a Version - Adding D77 SDE_STATE_ID SDE_DELETES_ROW_ID DELETED_AT # # # # A77 SHAPE 4 NAME OBJECTID 4 SDE_STATE_ID 1 CELL_TOWERS SHAPE 1 2 3 NAME Riverside NE Riverside SE Riverside W OBJECTID 1 2 3 SDE_STATE_ID 0 0 0
- 25. Like a Version - Deleting D77 # # # SDE_STATE_ID 0 SDE_DELETES_ROW_ID 2 Created at state DELETED_AT 2 Deleted at state A77 SHAPE 4 NAME OBJECTID 4 SDE_STATE_ID 1 CELL_TOWERS SHAPE 1 2 3 NAME Riverside NE Riverside SE Riverside W OBJECTID 1 2 3 SDE_STATE_ID 0 0 0
- 26. Like a Version - Updating D77 # # Riverside Mid SDE_STATE_ID 0 1 SDE_DELETES_ROW_ID 2 4 DELETED_AT 2 3 # A77 SHAPE 4 4 NAME OBJECTID 4 Riverside Mid 4 SDE_STATE_ID 1 3 CELL_TOWERS SHAPE 1 2 3 NAME Riverside NE Riverside SE Riverside W OBJECTID 1 2 3 SDE_STATE_ID 0 0 0
- 27. Versioned Editing Performance • Performance affected by: 0 – Volume of states – Stale statistics – Unnecessary versions* – Proper workflow State 0 Version pinning v2 state tree • Manage your version – Reconcile – Post – Compress v1 v4 DEFAULT
- 28. To Version or not to Version
- 29. CDB Who’s afraid of the big bad version? Version Creation and Management
- 30. What is Geodatabase Replication? • Geodatabase replication allows you to create copies of data across two or more geodatabases and to keep data synchronized. • Geodatabase replication allows to replicate just the elements you want.
- 31. Three types of Replication PARENT CHILD Sync both directions Two-way One-way Sync one direction Check-out once Check-out/ check-in Check-in once
- 32. Preparing data for replication Data requirements Stored in high-precision spatial format Registered as fully versioned in 2wR (no move to base) Non-versioned or fully versioned in 1wR (no move to base) Must have global ids The database user must have write permission to the data
- 33. Create a Replica • Distributed Geodatabase toolbar • Create Replica tool • Arcpy
- 34. WS Replica versus Replicant Using Replication
- 35. No LAN/WAN between offices? Replication using Geodata services
- 36. Real time edits Use Replication to avoid service interruptions
- 37. Privileges • Data set privileges managed from ArcCatalog
- 39. Attribute indexes WHERE value > 10 Use Index
- 40. Spatial indexes Select by Location Use Spatial Index
- 42. Scheduling tasks Windows Scheduler Python Script arcpy.RebuildIndexes_management… arcpy.AnalyzeDatasets_management…
- 43. Responsibilities Dave Barry Compress Analyse Attribute Indexes Attribute Indexes Spatial Indexes Database Statistics
- 44. ALL Keep on Running Performance and Management Techniques
- 45. Summary • Design and maintain your geodatabase to support your business processes. • Every minute you spent thinking about the design of your geospatial database can save you hours of frustration. See you at the Booth * The view of the presenters is not always the views of anybody else
- 46. Training • Building Geodatabases • Configuring and Managing the Multiuser Geodatabase • Implementing Versioned Workflows in a Multiuser Geodatabase • Distributing Data using Geodatabase replication Training website http://esriaustralia.com.au/training
- 47. Other Resources • Come chat to us at the Industry Solution booth on the conference • ArcGIS Resources – Geodatabase Community http://resources.arcgis.com/en/communities/geodata/ • GIS Wiki http://wiki.gis.com/wiki/index.php/Main_Page • Esri Online Training Gateway http://training.esri.com/gateway/index.cfm