SlideShare a Scribd company logo
GIS & Cloud ComputingGAA-SC Fall SummitFlorence, SCOctober 14th – 15th, 2010Jim Tochterman, VP - Research & Developmentwww.bcs-gis.comwww.facebook.com/bcsgiswww.twitter.com/bcsgis
What is Cloud Computing?Many different variations and meanings depending on who you ask, but the principle tenets are always:Rented physical infrastructure and/or applicationsShared architecture Maintained off premisesDelivered on demand as a serviceTechnology pioneered by AmazonCloud offerings can range from data storage and end-user web applications to other computing services.
Traditional vs. Cloud?Critical difference is the scalability and elastic nature that cloud services provide.  In simpler terms cloud computing allows to:Dynamically scale up and quickly scale down for high reliability, quick response timesFlexibility to handle traffic fluctuations and demand.
Cloud ComponentsSoftware as a Service (SaaS)End-user applications delivered as a service rather than on premise software Salesforce.com -> CRM SoftwareOffice.com -> Productivity SoftwareApps.Google.com -> Document Creation ServicesArcGIS.com -> ArcGIS Explorer, Business Analyst OnlinePlatform as a Service (PaaS) Application platform or middleware as a service that developers can build and deploy custom applicationsSQL Azure -> RDBMSArcGIS.com -> Online API’s
Cloud Computing ComponentsInfrastructure as a Service (IaaS)Encompasses the hardware and technology for computing power, storage, operating systems, or other infrastructure (shared data centers)Amazon Elastic Compute Cloud (EC2)Amazon Simple Storage Service (S3)Amazon Elastic Block Volumes (EBS)Amazon Relational Data Service (RDS)Delivered as off-premises, on demand services rather then dedicated, on-site resources.
How Can I Leverage?
Things To UnderstandCloud Applications:  Accessed by end-usersCloud Platforms: Used by developersPublic Cloud:  Code & data that live in Internet accessible data centers (Amazon, Microsoft, Google, etc.)The technology itself has no value.  The value comes from how it is used!
What is Amazon AWS & EC2?Amazon Web Services provide Virtual Machines & Services for storing unstructured data, relational data and more.Amazon EC2 is a web service that enables you to launch and manage server instances in Amazon’s data centers.Instances are available in different sizes and configurations.
What is an Instance?It’s a Virtual Machine!  Similar to what you might be working with now.Created from an Amazon Machine Image (AMI)Use an image that is already installed and setupUse one available from a different software vendorMicrosoft, Oracle, IBM, EsriAMIs of ArcGIS Server and Geodatabase are available through the product: ArcGIS Server for AWSPricing based on EC2 Compute UnitsEC2 Compute Unit (ECU) – One EC2 Compute Unit (ECU) provides the equivalent CPU capacity of a 1.0-1.2 GHz 2007 Opteron or 2007 Xeon processor.
Amazon EC2 – Standard InstancesSmall Instance: (Default) 1.7 GB of memory, 1 EC2 Compute Unit (1 virtual core with 1 EC2 Compute Unit), 160 GB of local instance storage, 32-bit platformLarge Instance: 7.5 GB of memory, 4 EC2 Compute Units (2 virtual cores with 2 EC2 Compute Units each), 850 GB of local instance storage, 64-bit platformExtra Large Instance: 15 GB of memory, 8 EC2 Compute Units (4 virtual cores with 2 EC2 Compute Units each), 1690 GB of local instance storage, 64-bit platform* Instances of this family are well suited for most applications.
Amazon EC2 – High Memory InstancesExtra Large Instance: 17.1 GB memory, 6.5 ECU (2 virtual cores with 3.25 EC2 Compute Units each), 420 GB of local instance storage, 64-bit platformDouble Extra Large Instance: 34.2 GB of memory, 13 EC2 Compute Units (4 virtual cores with 3.25 EC2 Compute Units each), 850 GB of local instance storage, 64-bit platformQuadruple Extra Large Instance: 68.4 GB of memory, 26 EC2 Compute Units (8 virtual cores with 3.25 EC2 Compute Units each), 1690 GB of local instance storage, 64-bit platform* Instances of this family offer large memory sizes for high throughput applications, including database and memory caching applications.
Amazon EC2 – High CPU InstancesMedium Instance: 1.7 GB of memory, 5 EC2 Compute Units (2 virtual cores with 2.5 EC2 Compute Units each), 350 GB of local instance storage, 32-bit platformExtra Large Instance:  7 GB of memory, 20 EC2 Compute Units (8 virtual cores with 2.5 EC2 Compute Units each), 1690 GB of local instance storage, 64-bit platform* Instances of this family have proportionally more CPU resources than memory (RAM) and are well suited for compute-intensive applications.
Amazon EC2 – Sample Pricing*An online calculator is available for more accurate pricing.       http://calculator.s3.amazonaws.com/calc5.html
Demo…Where do I get started?  Creating an AWS AccountUsing the AWS Management Console    https://console.aws.amazon.com/ec2/home
Why Use Cloud Computing?While not everything will move into the cloud, nearly every organization will use, or is using, this approach in some way.For GIS users, the cloud opens a number of new possibilities.  What are they?  Why might they be better than what I am doing now? Why should I care?
Emerging Usage PatternsPublish large number of servicesHigh LoadHigh Availability
Emerging Usage PatternsOn-Premise System for daily use and editingCloud is used for publishing
Emerging Usage PatternsCache CookingFor 1 instance, a single mask was used to confine cache creation to a rectangular area.For 3 and 5 instances, the same mask was divided into 3 and 5 equal parts, one for each server* Cache throughput varies depending on factors related to working on Amazon Cloud.
Emerging Usage PatternsAmazon S3 Deployment – Disconnected CacheLocal ArcGIS Server is used to create the map cache.Files are uploaded to S3ArcGIS Server API’s (Flex, Silverlight, Javascript) are used to point to the cache files.Pros: CheaperCons: No query on this cache, setup another location for queriesCache completely cooked.  No periodic update.
How Is Esri Using The Cloud?Providing users the ability to deploy ArcGIS Server on AWS.Built ArcGIS.com for offering tools and shared data for GIS applications.Building Cloud versions of applications: ArcGIS Explorer, ArcLogistics, and Business Analyst Online.ArcGIS Server is the platform for delivering GIS Services to software on other systems.  Exposed as RESTful web services, SOAP web services.  Consumed by clients written in various technologies (JavaScript, Adobe Flex, Microsoft Silverlight).
Why Deploy AGS In The Cloud?Easier Deployment: Esri provides a preconfigured AMI so you can create an EC2 VM from this AMI.Faster Deployment:  In most organizations making a VM is a multi-step process that can take weeks.  With AWS, this process can take minutes.Broad Availability: Accessible by anyone with an Internet connection.Better Performance: Through the scalability and bandwidth available to AWS
Benefits and Risks
Benefits and RisksDepending on the industry, compliance and Governmental requirements must be met and securedContinuity of operations and disaster recoverySecurity standards (ISO 27001)Logs and audit trailsSarbanes-OxleyHIPPA
Benefits and RisksThere are specific legal concerns when providing cloud services and consuming themLiability and recourseIntellectual property issuesTerms on vendor transparency regarding location of recovery data centersWhen consuming cloud services it’s important to recognize the potential hazards and risks ahead of time.
Demo…ArcGIS Server running in as EC2 Instance
ConclusionCloud computing is here and it’s effects will be widespread.  Esri is providing clear examples of how these technologies can be used:using cloud platform to provide new deployment options (ArcGIS Server on AWS).using cloud platform to support web sites & applications that provide broadly usable GIS data & tools (ArcGIS.com).offering cloud applications as alternatives to existing on-premises versions (ArcGIS Explorer, ArcLogistics, and Business Analyst Online).This shift will have some impact on your organization (if not already) in both GIS and/or IT.  The time to understand this shift is now.
Questions?
Want More Information?http://aws.amazon.comhttp://resources.arcgis.com/content/arcgisserver/10.0/arcgis-server-amazonO’Reilly Book: Cloud Application Architectures (Reese)ISBN#: 978-0-596-15636-7jtoch@bcs-gis.comtwitter.com/jtochterman

More Related Content

GIS & Cloud Computing - GAASC 2010 Fall Summit - Florence, SC

  • 1. GIS & Cloud ComputingGAA-SC Fall SummitFlorence, SCOctober 14th – 15th, 2010Jim Tochterman, VP - Research & Developmentwww.bcs-gis.comwww.facebook.com/bcsgiswww.twitter.com/bcsgis
  • 2. What is Cloud Computing?Many different variations and meanings depending on who you ask, but the principle tenets are always:Rented physical infrastructure and/or applicationsShared architecture Maintained off premisesDelivered on demand as a serviceTechnology pioneered by AmazonCloud offerings can range from data storage and end-user web applications to other computing services.
  • 3. Traditional vs. Cloud?Critical difference is the scalability and elastic nature that cloud services provide. In simpler terms cloud computing allows to:Dynamically scale up and quickly scale down for high reliability, quick response timesFlexibility to handle traffic fluctuations and demand.
  • 4. Cloud ComponentsSoftware as a Service (SaaS)End-user applications delivered as a service rather than on premise software Salesforce.com -> CRM SoftwareOffice.com -> Productivity SoftwareApps.Google.com -> Document Creation ServicesArcGIS.com -> ArcGIS Explorer, Business Analyst OnlinePlatform as a Service (PaaS) Application platform or middleware as a service that developers can build and deploy custom applicationsSQL Azure -> RDBMSArcGIS.com -> Online API’s
  • 5. Cloud Computing ComponentsInfrastructure as a Service (IaaS)Encompasses the hardware and technology for computing power, storage, operating systems, or other infrastructure (shared data centers)Amazon Elastic Compute Cloud (EC2)Amazon Simple Storage Service (S3)Amazon Elastic Block Volumes (EBS)Amazon Relational Data Service (RDS)Delivered as off-premises, on demand services rather then dedicated, on-site resources.
  • 6. How Can I Leverage?
  • 7. Things To UnderstandCloud Applications: Accessed by end-usersCloud Platforms: Used by developersPublic Cloud: Code & data that live in Internet accessible data centers (Amazon, Microsoft, Google, etc.)The technology itself has no value. The value comes from how it is used!
  • 8. What is Amazon AWS & EC2?Amazon Web Services provide Virtual Machines & Services for storing unstructured data, relational data and more.Amazon EC2 is a web service that enables you to launch and manage server instances in Amazon’s data centers.Instances are available in different sizes and configurations.
  • 9. What is an Instance?It’s a Virtual Machine! Similar to what you might be working with now.Created from an Amazon Machine Image (AMI)Use an image that is already installed and setupUse one available from a different software vendorMicrosoft, Oracle, IBM, EsriAMIs of ArcGIS Server and Geodatabase are available through the product: ArcGIS Server for AWSPricing based on EC2 Compute UnitsEC2 Compute Unit (ECU) – One EC2 Compute Unit (ECU) provides the equivalent CPU capacity of a 1.0-1.2 GHz 2007 Opteron or 2007 Xeon processor.
  • 10. Amazon EC2 – Standard InstancesSmall Instance: (Default) 1.7 GB of memory, 1 EC2 Compute Unit (1 virtual core with 1 EC2 Compute Unit), 160 GB of local instance storage, 32-bit platformLarge Instance: 7.5 GB of memory, 4 EC2 Compute Units (2 virtual cores with 2 EC2 Compute Units each), 850 GB of local instance storage, 64-bit platformExtra Large Instance: 15 GB of memory, 8 EC2 Compute Units (4 virtual cores with 2 EC2 Compute Units each), 1690 GB of local instance storage, 64-bit platform* Instances of this family are well suited for most applications.
  • 11. Amazon EC2 – High Memory InstancesExtra Large Instance: 17.1 GB memory, 6.5 ECU (2 virtual cores with 3.25 EC2 Compute Units each), 420 GB of local instance storage, 64-bit platformDouble Extra Large Instance: 34.2 GB of memory, 13 EC2 Compute Units (4 virtual cores with 3.25 EC2 Compute Units each), 850 GB of local instance storage, 64-bit platformQuadruple Extra Large Instance: 68.4 GB of memory, 26 EC2 Compute Units (8 virtual cores with 3.25 EC2 Compute Units each), 1690 GB of local instance storage, 64-bit platform* Instances of this family offer large memory sizes for high throughput applications, including database and memory caching applications.
  • 12. Amazon EC2 – High CPU InstancesMedium Instance: 1.7 GB of memory, 5 EC2 Compute Units (2 virtual cores with 2.5 EC2 Compute Units each), 350 GB of local instance storage, 32-bit platformExtra Large Instance: 7 GB of memory, 20 EC2 Compute Units (8 virtual cores with 2.5 EC2 Compute Units each), 1690 GB of local instance storage, 64-bit platform* Instances of this family have proportionally more CPU resources than memory (RAM) and are well suited for compute-intensive applications.
  • 13. Amazon EC2 – Sample Pricing*An online calculator is available for more accurate pricing. http://calculator.s3.amazonaws.com/calc5.html
  • 14. Demo…Where do I get started? Creating an AWS AccountUsing the AWS Management Console https://console.aws.amazon.com/ec2/home
  • 15. Why Use Cloud Computing?While not everything will move into the cloud, nearly every organization will use, or is using, this approach in some way.For GIS users, the cloud opens a number of new possibilities. What are they? Why might they be better than what I am doing now? Why should I care?
  • 16. Emerging Usage PatternsPublish large number of servicesHigh LoadHigh Availability
  • 17. Emerging Usage PatternsOn-Premise System for daily use and editingCloud is used for publishing
  • 18. Emerging Usage PatternsCache CookingFor 1 instance, a single mask was used to confine cache creation to a rectangular area.For 3 and 5 instances, the same mask was divided into 3 and 5 equal parts, one for each server* Cache throughput varies depending on factors related to working on Amazon Cloud.
  • 19. Emerging Usage PatternsAmazon S3 Deployment – Disconnected CacheLocal ArcGIS Server is used to create the map cache.Files are uploaded to S3ArcGIS Server API’s (Flex, Silverlight, Javascript) are used to point to the cache files.Pros: CheaperCons: No query on this cache, setup another location for queriesCache completely cooked. No periodic update.
  • 20. How Is Esri Using The Cloud?Providing users the ability to deploy ArcGIS Server on AWS.Built ArcGIS.com for offering tools and shared data for GIS applications.Building Cloud versions of applications: ArcGIS Explorer, ArcLogistics, and Business Analyst Online.ArcGIS Server is the platform for delivering GIS Services to software on other systems. Exposed as RESTful web services, SOAP web services. Consumed by clients written in various technologies (JavaScript, Adobe Flex, Microsoft Silverlight).
  • 21. Why Deploy AGS In The Cloud?Easier Deployment: Esri provides a preconfigured AMI so you can create an EC2 VM from this AMI.Faster Deployment: In most organizations making a VM is a multi-step process that can take weeks. With AWS, this process can take minutes.Broad Availability: Accessible by anyone with an Internet connection.Better Performance: Through the scalability and bandwidth available to AWS
  • 23. Benefits and RisksDepending on the industry, compliance and Governmental requirements must be met and securedContinuity of operations and disaster recoverySecurity standards (ISO 27001)Logs and audit trailsSarbanes-OxleyHIPPA
  • 24. Benefits and RisksThere are specific legal concerns when providing cloud services and consuming themLiability and recourseIntellectual property issuesTerms on vendor transparency regarding location of recovery data centersWhen consuming cloud services it’s important to recognize the potential hazards and risks ahead of time.
  • 25. Demo…ArcGIS Server running in as EC2 Instance
  • 26. ConclusionCloud computing is here and it’s effects will be widespread. Esri is providing clear examples of how these technologies can be used:using cloud platform to provide new deployment options (ArcGIS Server on AWS).using cloud platform to support web sites & applications that provide broadly usable GIS data & tools (ArcGIS.com).offering cloud applications as alternatives to existing on-premises versions (ArcGIS Explorer, ArcLogistics, and Business Analyst Online).This shift will have some impact on your organization (if not already) in both GIS and/or IT. The time to understand this shift is now.
  • 28. Want More Information?http://aws.amazon.comhttp://resources.arcgis.com/content/arcgisserver/10.0/arcgis-server-amazonO’Reilly Book: Cloud Application Architectures (Reese)ISBN#: 978-0-596-15636-7jtoch@bcs-gis.comtwitter.com/jtochterman