Neo4j Spatial - FooCafe September 2015
The world is a big place, and getting bigger all the time. In the last few decade the internet has been at the core of a massive explosion in the amount of data, and the complexity of data out there. The world of databases, and applications that use databases, has responded with some amazing new solutions from well known names like google, amazon and facebook, as well as some less well known, but equally important solutions. One of these comes from right here in Malmö. Neo4j is the leading "graph database", aimed at handling the new world of complex connected data. Neo4j especially well suited at dealing with relationships in data, like social networks and geographically connected data. Neo4j Spatial is a community supported library designed to help you model geographic data in Neo4j and build applications that make the most of location information in a connected way. In this talk we will introduce you to Neo4j, the concept of a "graph database", and why this approach is so well suited to the modern world. We will give you a taste of the various options available for building location aware data applications. And to end off, we will give you a sneak peek at some of the up-coming spatial features planned for future releases of Neo4j, which help make it even easier to model location data with high performance.
Neo4j Spatial - FooCafe September 2015
- 1. Neo4jSpatial Craig Taverner Neo Technology #neo4j @craigtaverner craig@amanzi.com Web Map Data with Neo4j-Spatial and OpenStreetMap
- 2. Where are the Mushrooms?
- 3. Where are the Mushrooms?
- 10. Recommendations
- 11. Access Control
- 12. Fraud Analysis
- 13. What is a graph, anyway?
- 16. Property Graph Data Model
- 17. Nodes
- 18. Relationships
- 19. Relationships
- 20. Labels
- 21. Graph Building Blocks ● Nodes ● entities ● Relationships ● connect entities and structure domain ● Properties ● attributes and metadata ● Labels ● entities roles and grouping
- 23. Neo4j Spatial 2010 ● GSoC 2010 ● Core ● Storage, GeometryEncoder ● Search/RTree, Operations ● I/O (Shapefile) ● Extensions ● Geotools Datastore ● GeoServer & uDig ● Ruby API ● neo4j-spatial.rb (Rubygem) ● OpenStreetMap ● Import OSM, Dynamic Layers (JSON & CQL) ● Export Shapefiles, and SLD styled PNG
- 24. Neo4j OSM in uDig
- 25. OpenStreetMap
- 26. OpenStreetMap
- 27. OpenStreetMap
- 29. Routing on OSM
- 30. Neo4j-Spatial 2011 ● OSM ● Performance ● Changesets and Users ● Geoprocessing ● LBS and SimplePointLayer ● Routing OSM ● GSoC 2011 – Geoprocessing functions ● Data Mining OSM ● What's next ● Geoprocessing pipeline ● Cool domains: artistic maps
- 31. Finding things close to other things http://blog.neo4j.org/2011/03/neo4j-spatial-part1-finding-things.html
- 32. Finding things close to other things http://blog.neo4j.org/2011/03/neo4j-spatial-part1-finding-things.html
- 33. Routing with OSM
- 34. Data Mining OSM timestamp > 1207014810000 and timestamp < 1208310810000 and ( user = 'Zenon' or user = 'tomasCY' or user = 'muffu' or user = 'dcp' or user = 'cartOMike' or user = 'djanda' or user = 'Peter14' or user = 'toaster' or user = 'user_7363' or user = 'lyx' )
- 35. Artistic Maps
- 36. Artistic Maps
- 37. Artistic Maps
- 39. Cellular Network Topology ID Site Latitude Longitude 1 ABC 55.678 12.567 2 XYZ 55.890 12.123 3 PRQ 55.543 12.890 ID Sector SiteID Azimuth Beamwidth 1 1 1 0 100 2 2 1 120 100 3 3 1 240 100 4 1 2 0 90 5 2 2 120 110 6 3 2 240 90 7 1 3 0 180 8 2 3 180 180 O(N) O(ln(N)) O(1)
- 41. What's next?
- 42. Spatial Cypher!
- 43. Spatial Cypher GSoC Demo
- 44. What is Cypher? sel ect skills.name f rom users j oi n user_skills on (...) j oi n skills on (...) where users.name = “Michael“ Consider SQL:
- 45. Cypher is for graph querying! MATCH (me:User {name:'Michael'})-[:HAS_SKILL]->(skill) RETURN skill.name
- 46. Cypher is for graph querying! MATCH (me:Person {name:'Andreas'})-[:FRIEND]->(friend) -[:FRIEND]->(friend2) RETURN friend2
- 47. Point Index
- 50. Index polygons?
- 51. Questions?
Editor's Notes
- The purpose of this presentation is to introduce Neo4j Spatial, and two specific projects, the GSoC and OSM Mention Neo Technologies and AmanziTel, but no more We have a product in the market that uses uDig and Neo4j, but felt that our integration was too specific to our needs, and so decided to collaborate with Neo Technologies to produce a more generalized library available as an extension to the database
- Storage: plugable – dataset, layer, encoder Search: Indexing is currently an R-Tree, but it is possible to plug in any custom mechanism conforming to the interface. Multi-dimensional index Spatial indices (quad-tree, R-tree, kn-tree, SFCs) Composite indices and dynamic indices Lucene