SlideShare a Scribd company logo
Computing at Scale: Data Exploration Jerjou Cheng, Barry Brumitt
HELLO / jur' jō/ ɯoɔ˙ǝlƃooƃ@ noɾɹǝɾ MY NAME IS Developer Programs Engineer (Developer Relations) Google Storage
Michael PIERROT http://www.freephotobank.org /v/sky-stars/cloud/Cloud-19.jpg.html
Computing at Scale: Data Exploration Jerjou Cheng, Barry Brumitt

Recommended for you

Preparing for CDN failure: Why and how
Preparing for CDN failure: Why and howPreparing for CDN failure: Why and how
Preparing for CDN failure: Why and how

This document discusses preparing for content delivery network (CDN) failures and how to monitor CDN performance. It provides examples of past CDN outages and failures. It then covers different methods for monitoring CDN performance, including synthetic monitoring and real user monitoring. It emphasizes the importance of measuring failure rates not just speeds. The document also discusses mitigating CDN failures through a multi-CDN approach with dynamic traffic steering based on performance data. It notes some challenges in decision making and with low volume data. Finally, it shares a story about responding to an outage at a company.

dnscdnwebperf
Machine Learning Outside the Kaggle Lines
Machine Learning Outside the Kaggle LinesMachine Learning Outside the Kaggle Lines
Machine Learning Outside the Kaggle Lines

Kaggle competitions are great, but what do you do when you have a cool idea for your own machine-learning project? Learn about all the dirty data, bugs of others, and keeping it all running, when building from zero to production. Hear about the mistakes that I've made so you can avoid them yourself.

machine learningpythondata
To Infinity and Beyond - OSDConf2014
To Infinity and Beyond - OSDConf2014To Infinity and Beyond - OSDConf2014
To Infinity and Beyond - OSDConf2014

The story of how solving one problem the OpenSource way opened doors to so much more. Talk presented by Pranav Prakash and Hari Prasanna at OSDConf 2014, New Delhi.

mapreduce2014osdconf
Overview Google App Engine Google Storage for Developers Prediction API BigQuery
Introductions
Who are these services for?
A World without Clouds Build a web application  Startup costs Maintenance / reliability Scaling Michael Scheltgen flickr.com/mscheltgen/

Recommended for you

From raw data to deployment
From raw data to deployment From raw data to deployment
From raw data to deployment

This document outlines the steps in the data science process from raw data to deployment using KNIME. It begins with an overview of the CRISP-DM process and then discusses each step in more detail, including data preparation, model training, optimization, evaluation, and deployment. It then provides an example classification problem using airline departure delay data and outlines challenges for participants to work through in data access/preparation, model training/optimization, and deployment. Contact information is also provided for KNIME resources.

Start Flying with Python & Apache TinkerPop
Start Flying with Python & Apache TinkerPopStart Flying with Python & Apache TinkerPop
Start Flying with Python & Apache TinkerPop

This document summarizes a presentation about using Python and Apache TinkerPop to work with graph databases. It discusses Gremlin, a graph traversal language, and how Gremlin has been incorporated into Python through Gremlin-Python. It provides an example of building a small web application and APIs to work with an air routes graph stored in a graph database, and deploying the application and database to the cloud.

nosqlopen sourcepython
Stock Price Predictor - Python with AI Student Project
Stock Price Predictor - Python with AI Student ProjectStock Price Predictor - Python with AI Student Project
Stock Price Predictor - Python with AI Student Project

A Python application that uses artificial intelligence to predict stock prices. Student project in the AIClub Python with AI Class

artificial intelligencemachine learningpython
Google App Engine Easy to  start Easy to  maintain Easy to  scale
Users
gigy  Socialize - traffic
Overview Google App Engine Google Storage for Developers Prediction API BigQuery

Recommended for you

Drupal DOMinate
Drupal DOMinateDrupal DOMinate
Drupal DOMinate

Drupal DOMinate was presented by Matt Wrather and Steven Rifkin at the Los Angeles Drupal User Group meetup 5/14/13. The presentation covers the use of the Drupal Javascript API focusing on the behaviors and settings objects.

drupaljavascriptdeveloper
Infrastructure as Code in Government
Infrastructure as Code in GovernmentInfrastructure as Code in Government
Infrastructure as Code in Government

Slides from my Velocity NY 2014 talk, "Infrastructure as Code in Government" http://velocityconf.com/velocityny2014/public/schedule/detail/35839

Creating Contextual Applications with Maslow & The Device API
Creating Contextual Applications with Maslow & The Device APICreating Contextual Applications with Maslow & The Device API
Creating Contextual Applications with Maslow & The Device API

The document discusses using Abraham Maslow's hierarchy of needs as a framework for developing contextual applications with the Device API. It outlines each level of the hierarchy - physiological, safety, love/belonging, esteem, and self-actualization - and provides examples of how existing and future Device API features could address needs within each level, from low-level concerns like connectivity and battery life to higher-level goals around relationships and personal growth. The overall message is that the expanding capabilities of the Device API open opportunities to create applications that respond to users' context in holistic ways.

device apiweb designux
Overview Google App Engine Google Storage for Developers Prediction API BigQuery
A World without Clouds Store data  Reliability Sharing Large objects Michael Scheltgen flickr.com/mscheltgen/
Google Storage for Developers Google infrastructure You control access to your data Store massive data in Google's cloud Easy interface
Example  

Recommended for you

Introduction to Google's Cloud Technologies
Introduction to Google's Cloud TechnologiesIntroduction to Google's Cloud Technologies
Introduction to Google's Cloud Technologies

An overview of the different Cloud technologies available from Google including App Engine, Google Storage, Google Prediction API, and BigQuery. This presentation was given to the San Diego GTUG on Aug 26th, 2011.

restpredictionjava
Intro to Google's Cloud Technologies
Intro to Google's Cloud TechnologiesIntro to Google's Cloud Technologies
Intro to Google's Cloud Technologies

An overview of the different Google Cloud Technologies. Includes coverage of Google App Engine, Google Storage, Google Prediction Api, and BigQuery. This presentation was given to the San Diego GTUG on Aug 26th, 2011.

s3prediction apirest
Building Integrated Applications on Google's Cloud Technologies
Building Integrated Applications on Google's Cloud TechnologiesBuilding Integrated Applications on Google's Cloud Technologies
Building Integrated Applications on Google's Cloud Technologies

This is the presentation "Building Integrated Applications on Google's Cloud Technologies" that was given at GDD 2011 #gdd11 in Sao Paulo and Buenos Aires by Google Developer Advocate Chris Schalk @cschalk.

prediction apis3machine learning
Internal use cases Content hosting        Sharing     Data Import  Google   BigQuery Google   Prediction API
Overview Google App Engine Google Storage for Developers Prediction API BigQuery
Prediction API Cloud-hosted machine learning as service Simple interface over complex analysis Predict results in real-time
The Prediction API finds relevant features  in the sample data during training. How does it work? The Prediction API later searches for those  features during prediction. "english" The  quick brown fox jumped over  the  lazy dog. "english" To  err  is  human, but  to  really foul things up you need a computer. "spanish" No   hay mal  que   por  bien  no  venga. "spanish" La  tercera  es   la  vencida. "english" To  be or not  to  be, that  is   the  question. "spanish" La  fe mueve montañas.

Recommended for you

Google cloud platform
Google cloud platformGoogle cloud platform
Google cloud platform

- The document discusses Google's Prediction API which allows users to build machine learning models and make predictions by uploading training data, training models on that data, and then making predictions on new data. - It provides an example of using the Prediction API to automatically categorize and respond to customer emails by language by training on tagged emails and predicting the language of new emails. - The process involves uploading training data, training a model on that data, and then making predictions on new data using the trained model to receive a predicted language label.

Building Apps on Google Cloud Technologies
Building Apps on Google Cloud TechnologiesBuilding Apps on Google Cloud Technologies
Building Apps on Google Cloud Technologies

This is a presentation on how to use the different Google Cloud technologies to build applications. It was delivered in Mexico City at the "EstoEsGoogle" aka Devfest Mexico event on Aug 9th, 2011 in Mexico City by Google Developer Advocate Chris Schalk.

apipredictiongoogle
Quick Intro to Google Cloud Technologies
Quick Intro to Google Cloud TechnologiesQuick Intro to Google Cloud Technologies
Quick Intro to Google Cloud Technologies

This document provides an introduction to Google's cloud technologies including Google App Engine, Google Storage, the Prediction API, and BigQuery. It describes each technology's capabilities and how developers can use them. Google App Engine is an application development platform, Storage provides cloud data storage, Prediction API enables machine learning predictions, and BigQuery allows fast, SQL-based analysis of large datasets. Examples and demos of each technology are also presented.

prediction apigoogle storageapp engine
Prediction API 1. Upload 2. Train Upload your  training data to Google Storage  Build a model from your data Make new predictions prediction/v1.1/training?data={} POST : a training request prediction/v1.1/training/{}/predict GET : model info POST : a prediction request   Use the API, gsutil or any compatible utility to upload your data to Google Storage 3. Predict
Example  
Prediction API Google's machine learning algorithms Available as RESTful HTTP service Predict results in real-time
Overview Google App Engine Google Storage for Developers Prediction API BigQuery

Recommended for you

Intro to new Google cloud technologies: Google Storage, Prediction API, BigQuery
Intro to new Google cloud technologies: Google Storage, Prediction API, BigQueryIntro to new Google cloud technologies: Google Storage, Prediction API, BigQuery
Intro to new Google cloud technologies: Google Storage, Prediction API, BigQuery

This document introduces several new Google cloud technologies: Google Storage for storing data in Google's cloud, the Prediction API for machine learning and predictive analytics, and BigQuery for interactive analysis of large datasets. It provides overviews and examples of using each service, highlighting their capabilities for scalable data storage, predictive modeling, and fast querying of massive amounts of data.

s3apigoogle
Building Integrated Applications on Google's Cloud Technologies
Building Integrated Applications on Google's Cloud TechnologiesBuilding Integrated Applications on Google's Cloud Technologies
Building Integrated Applications on Google's Cloud Technologies

Presentation given by Google Developer Advocate Chris Schalk on building integrated applications with Google's Cloud Technologies.

predictiongoogleappengine
Introduction to Google Cloud platform technologies
Introduction to Google Cloud platform technologiesIntroduction to Google Cloud platform technologies
Introduction to Google Cloud platform technologies

This is a presentation given by Google Developer Advocate Chris Schalk at Spring One 2GX on Oct 21st, 2010. It introduces Google Storage for Developers, Prediction API, and BigQuery.

s3springone2gxjava
To request access and get more information, go to: http://code.google.com/appengine http://code.google.com/apis/bigquery http://code.google.com/apis/predict http://code.google.com/apis/storage          GET /information HTTP/1.0

More Related Content

What's hot

Hands-on Lab: Visualizing Redshift
Hands-on Lab: Visualizing RedshiftHands-on Lab: Visualizing Redshift
Hands-on Lab: Visualizing Redshift
Amazon Web Services
 
Just add Imagination
Just add ImaginationJust add Imagination
Just add Imagination
KNIMESlides
 
Serverless... Hoe, wat en vooral waarom
Serverless... Hoe, wat en vooral waaromServerless... Hoe, wat en vooral waarom
Serverless... Hoe, wat en vooral waarom
Jan de Vries
 
Preparing for CDN failure: Why and how
Preparing for CDN failure: Why and howPreparing for CDN failure: Why and how
Preparing for CDN failure: Why and how
Aaron Peters
 
Machine Learning Outside the Kaggle Lines
Machine Learning Outside the Kaggle LinesMachine Learning Outside the Kaggle Lines
Machine Learning Outside the Kaggle Lines
Craig Franklin
 
To Infinity and Beyond - OSDConf2014
To Infinity and Beyond - OSDConf2014To Infinity and Beyond - OSDConf2014
To Infinity and Beyond - OSDConf2014
Pranav Prakash
 
From raw data to deployment
From raw data to deployment From raw data to deployment
From raw data to deployment
KNIMESlides
 
Start Flying with Python & Apache TinkerPop
Start Flying with Python & Apache TinkerPopStart Flying with Python & Apache TinkerPop
Start Flying with Python & Apache TinkerPop
Jason Plurad
 
Stock Price Predictor - Python with AI Student Project
Stock Price Predictor - Python with AI Student ProjectStock Price Predictor - Python with AI Student Project
Stock Price Predictor - Python with AI Student Project
aiclub_slides
 
Drupal DOMinate
Drupal DOMinateDrupal DOMinate
Drupal DOMinate
Steven Rifkin
 
Infrastructure as Code in Government
Infrastructure as Code in GovernmentInfrastructure as Code in Government
Infrastructure as Code in Government
annashipman
 
Creating Contextual Applications with Maslow & The Device API
Creating Contextual Applications with Maslow & The Device APICreating Contextual Applications with Maslow & The Device API
Creating Contextual Applications with Maslow & The Device API
Tim Wright
 

What's hot (12)

Hands-on Lab: Visualizing Redshift
Hands-on Lab: Visualizing RedshiftHands-on Lab: Visualizing Redshift
Hands-on Lab: Visualizing Redshift
 
Just add Imagination
Just add ImaginationJust add Imagination
Just add Imagination
 
Serverless... Hoe, wat en vooral waarom
Serverless... Hoe, wat en vooral waaromServerless... Hoe, wat en vooral waarom
Serverless... Hoe, wat en vooral waarom
 
Preparing for CDN failure: Why and how
Preparing for CDN failure: Why and howPreparing for CDN failure: Why and how
Preparing for CDN failure: Why and how
 
Machine Learning Outside the Kaggle Lines
Machine Learning Outside the Kaggle LinesMachine Learning Outside the Kaggle Lines
Machine Learning Outside the Kaggle Lines
 
To Infinity and Beyond - OSDConf2014
To Infinity and Beyond - OSDConf2014To Infinity and Beyond - OSDConf2014
To Infinity and Beyond - OSDConf2014
 
From raw data to deployment
From raw data to deployment From raw data to deployment
From raw data to deployment
 
Start Flying with Python & Apache TinkerPop
Start Flying with Python & Apache TinkerPopStart Flying with Python & Apache TinkerPop
Start Flying with Python & Apache TinkerPop
 
Stock Price Predictor - Python with AI Student Project
Stock Price Predictor - Python with AI Student ProjectStock Price Predictor - Python with AI Student Project
Stock Price Predictor - Python with AI Student Project
 
Drupal DOMinate
Drupal DOMinateDrupal DOMinate
Drupal DOMinate
 
Infrastructure as Code in Government
Infrastructure as Code in GovernmentInfrastructure as Code in Government
Infrastructure as Code in Government
 
Creating Contextual Applications with Maslow & The Device API
Creating Contextual Applications with Maslow & The Device APICreating Contextual Applications with Maslow & The Device API
Creating Contextual Applications with Maslow & The Device API
 

Similar to Computing at scale

Introduction to Google's Cloud Technologies
Introduction to Google's Cloud TechnologiesIntroduction to Google's Cloud Technologies
Introduction to Google's Cloud Technologies
Chris Schalk
 
Intro to Google's Cloud Technologies
Intro to Google's Cloud TechnologiesIntro to Google's Cloud Technologies
Intro to Google's Cloud Technologies
Chris Schalk
 
Building Integrated Applications on Google's Cloud Technologies
Building Integrated Applications on Google's Cloud TechnologiesBuilding Integrated Applications on Google's Cloud Technologies
Building Integrated Applications on Google's Cloud Technologies
Chris Schalk
 
Google cloud platform
Google cloud platformGoogle cloud platform
Google cloud platform
rajdeep
 
Building Apps on Google Cloud Technologies
Building Apps on Google Cloud TechnologiesBuilding Apps on Google Cloud Technologies
Building Apps on Google Cloud Technologies
Chris Schalk
 
Quick Intro to Google Cloud Technologies
Quick Intro to Google Cloud TechnologiesQuick Intro to Google Cloud Technologies
Quick Intro to Google Cloud Technologies
Chris Schalk
 
Intro to new Google cloud technologies: Google Storage, Prediction API, BigQuery
Intro to new Google cloud technologies: Google Storage, Prediction API, BigQueryIntro to new Google cloud technologies: Google Storage, Prediction API, BigQuery
Intro to new Google cloud technologies: Google Storage, Prediction API, BigQuery
Chris Schalk
 
Building Integrated Applications on Google's Cloud Technologies
Building Integrated Applications on Google's Cloud TechnologiesBuilding Integrated Applications on Google's Cloud Technologies
Building Integrated Applications on Google's Cloud Technologies
Chris Schalk
 
Introduction to Google Cloud platform technologies
Introduction to Google Cloud platform technologiesIntroduction to Google Cloud platform technologies
Introduction to Google Cloud platform technologies
Chris Schalk
 
Mobile backends with Google Cloud Platform (MBLTDev'14)
Mobile backends with Google Cloud Platform (MBLTDev'14)Mobile backends with Google Cloud Platform (MBLTDev'14)
Mobile backends with Google Cloud Platform (MBLTDev'14)
Natalia Efimtseva
 
BigData Meets the Federal Data Center
BigData Meets the Federal Data CenterBigData Meets the Federal Data Center
BigData Meets the Federal Data Center
Abe Usher
 
#MBLTdev: Разработка backend для мобильного приложения с использованием Googl...
#MBLTdev: Разработка backend для мобильного приложения с использованием Googl...#MBLTdev: Разработка backend для мобильного приложения с использованием Googl...
#MBLTdev: Разработка backend для мобильного приложения с использованием Googl...
e-Legion
 
Google Opening up to Developers - From 2 to 55 APIs in 3 years
Google Opening up to Developers - From 2 to 55 APIs in 3 yearsGoogle Opening up to Developers - From 2 to 55 APIs in 3 years
Google Opening up to Developers - From 2 to 55 APIs in 3 years
Patrick Chanezon
 
Google Cloud Platform Update
Google Cloud Platform UpdateGoogle Cloud Platform Update
Google Cloud Platform Update
Ido Green
 
Talk in Google fest 2013
Talk in Google fest 2013Talk in Google fest 2013
Talk in Google fest 2013
David Chen
 
[Giovanni Galloro] How to use machine learning on Google Cloud Platform
[Giovanni Galloro] How to use machine learning on Google Cloud Platform[Giovanni Galloro] How to use machine learning on Google Cloud Platform
[Giovanni Galloro] How to use machine learning on Google Cloud Platform
MeetupDataScienceRoma
 
Entrepreneurship Tips With HTML5 & App Engine Startup Weekend (June 2012)
Entrepreneurship Tips With HTML5 & App Engine Startup Weekend (June 2012)Entrepreneurship Tips With HTML5 & App Engine Startup Weekend (June 2012)
Entrepreneurship Tips With HTML5 & App Engine Startup Weekend (June 2012)
Ido Green
 
Google Cloud for Data Crunchers - Strata Conf 2011
Google Cloud for Data Crunchers - Strata Conf 2011Google Cloud for Data Crunchers - Strata Conf 2011
Google Cloud for Data Crunchers - Strata Conf 2011
Patrick Chanezon
 
Big Data Driven At Eway
Big Data Driven At Eway Big Data Driven At Eway
Big Data Driven At Eway
Tu Pham
 
Easy path to machine learning (Spring 2021)
Easy path to machine learning (Spring 2021)Easy path to machine learning (Spring 2021)
Easy path to machine learning (Spring 2021)
wesley chun
 

Similar to Computing at scale (20)

Introduction to Google's Cloud Technologies
Introduction to Google's Cloud TechnologiesIntroduction to Google's Cloud Technologies
Introduction to Google's Cloud Technologies
 
Intro to Google's Cloud Technologies
Intro to Google's Cloud TechnologiesIntro to Google's Cloud Technologies
Intro to Google's Cloud Technologies
 
Building Integrated Applications on Google's Cloud Technologies
Building Integrated Applications on Google's Cloud TechnologiesBuilding Integrated Applications on Google's Cloud Technologies
Building Integrated Applications on Google's Cloud Technologies
 
Google cloud platform
Google cloud platformGoogle cloud platform
Google cloud platform
 
Building Apps on Google Cloud Technologies
Building Apps on Google Cloud TechnologiesBuilding Apps on Google Cloud Technologies
Building Apps on Google Cloud Technologies
 
Quick Intro to Google Cloud Technologies
Quick Intro to Google Cloud TechnologiesQuick Intro to Google Cloud Technologies
Quick Intro to Google Cloud Technologies
 
Intro to new Google cloud technologies: Google Storage, Prediction API, BigQuery
Intro to new Google cloud technologies: Google Storage, Prediction API, BigQueryIntro to new Google cloud technologies: Google Storage, Prediction API, BigQuery
Intro to new Google cloud technologies: Google Storage, Prediction API, BigQuery
 
Building Integrated Applications on Google's Cloud Technologies
Building Integrated Applications on Google's Cloud TechnologiesBuilding Integrated Applications on Google's Cloud Technologies
Building Integrated Applications on Google's Cloud Technologies
 
Introduction to Google Cloud platform technologies
Introduction to Google Cloud platform technologiesIntroduction to Google Cloud platform technologies
Introduction to Google Cloud platform technologies
 
Mobile backends with Google Cloud Platform (MBLTDev'14)
Mobile backends with Google Cloud Platform (MBLTDev'14)Mobile backends with Google Cloud Platform (MBLTDev'14)
Mobile backends with Google Cloud Platform (MBLTDev'14)
 
BigData Meets the Federal Data Center
BigData Meets the Federal Data CenterBigData Meets the Federal Data Center
BigData Meets the Federal Data Center
 
#MBLTdev: Разработка backend для мобильного приложения с использованием Googl...
#MBLTdev: Разработка backend для мобильного приложения с использованием Googl...#MBLTdev: Разработка backend для мобильного приложения с использованием Googl...
#MBLTdev: Разработка backend для мобильного приложения с использованием Googl...
 
Google Opening up to Developers - From 2 to 55 APIs in 3 years
Google Opening up to Developers - From 2 to 55 APIs in 3 yearsGoogle Opening up to Developers - From 2 to 55 APIs in 3 years
Google Opening up to Developers - From 2 to 55 APIs in 3 years
 
Google Cloud Platform Update
Google Cloud Platform UpdateGoogle Cloud Platform Update
Google Cloud Platform Update
 
Talk in Google fest 2013
Talk in Google fest 2013Talk in Google fest 2013
Talk in Google fest 2013
 
[Giovanni Galloro] How to use machine learning on Google Cloud Platform
[Giovanni Galloro] How to use machine learning on Google Cloud Platform[Giovanni Galloro] How to use machine learning on Google Cloud Platform
[Giovanni Galloro] How to use machine learning on Google Cloud Platform
 
Entrepreneurship Tips With HTML5 & App Engine Startup Weekend (June 2012)
Entrepreneurship Tips With HTML5 & App Engine Startup Weekend (June 2012)Entrepreneurship Tips With HTML5 & App Engine Startup Weekend (June 2012)
Entrepreneurship Tips With HTML5 & App Engine Startup Weekend (June 2012)
 
Google Cloud for Data Crunchers - Strata Conf 2011
Google Cloud for Data Crunchers - Strata Conf 2011Google Cloud for Data Crunchers - Strata Conf 2011
Google Cloud for Data Crunchers - Strata Conf 2011
 
Big Data Driven At Eway
Big Data Driven At Eway Big Data Driven At Eway
Big Data Driven At Eway
 
Easy path to machine learning (Spring 2021)
Easy path to machine learning (Spring 2021)Easy path to machine learning (Spring 2021)
Easy path to machine learning (Spring 2021)
 

Recently uploaded

Observability For You and Me with OpenTelemetry
Observability For You and Me with OpenTelemetryObservability For You and Me with OpenTelemetry
Observability For You and Me with OpenTelemetry
Eric D. Schabell
 
20240702 QFM021 Machine Intelligence Reading List June 2024
20240702 QFM021 Machine Intelligence Reading List June 202420240702 QFM021 Machine Intelligence Reading List June 2024
20240702 QFM021 Machine Intelligence Reading List June 2024
Matthew Sinclair
 
Choose our Linux Web Hosting for a seamless and successful online presence
Choose our Linux Web Hosting for a seamless and successful online presenceChoose our Linux Web Hosting for a seamless and successful online presence
Choose our Linux Web Hosting for a seamless and successful online presence
rajancomputerfbd
 
Details of description part II: Describing images in practice - Tech Forum 2024
Details of description part II: Describing images in practice - Tech Forum 2024Details of description part II: Describing images in practice - Tech Forum 2024
Details of description part II: Describing images in practice - Tech Forum 2024
BookNet Canada
 
The Increasing Use of the National Research Platform by the CSU Campuses
The Increasing Use of the National Research Platform by the CSU CampusesThe Increasing Use of the National Research Platform by the CSU Campuses
The Increasing Use of the National Research Platform by the CSU Campuses
Larry Smarr
 
Fluttercon 2024: Showing that you care about security - OpenSSF Scorecards fo...
Fluttercon 2024: Showing that you care about security - OpenSSF Scorecards fo...Fluttercon 2024: Showing that you care about security - OpenSSF Scorecards fo...
Fluttercon 2024: Showing that you care about security - OpenSSF Scorecards fo...
Chris Swan
 
Best Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdfBest Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdf
Tatiana Al-Chueyr
 
Advanced Techniques for Cyber Security Analysis and Anomaly Detection
Advanced Techniques for Cyber Security Analysis and Anomaly DetectionAdvanced Techniques for Cyber Security Analysis and Anomaly Detection
Advanced Techniques for Cyber Security Analysis and Anomaly Detection
Bert Blevins
 
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-InTrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc
 
20240702 Présentation Plateforme GenAI.pdf
20240702 Présentation Plateforme GenAI.pdf20240702 Présentation Plateforme GenAI.pdf
20240702 Présentation Plateforme GenAI.pdf
Sally Laouacheria
 
The Rise of Supernetwork Data Intensive Computing
The Rise of Supernetwork Data Intensive ComputingThe Rise of Supernetwork Data Intensive Computing
The Rise of Supernetwork Data Intensive Computing
Larry Smarr
 
BT & Neo4j: Knowledge Graphs for Critical Enterprise Systems.pptx.pdf
BT & Neo4j: Knowledge Graphs for Critical Enterprise Systems.pptx.pdfBT & Neo4j: Knowledge Graphs for Critical Enterprise Systems.pptx.pdf
BT & Neo4j: Knowledge Graphs for Critical Enterprise Systems.pptx.pdf
Neo4j
 
Implementations of Fused Deposition Modeling in real world
Implementations of Fused Deposition Modeling  in real worldImplementations of Fused Deposition Modeling  in real world
Implementations of Fused Deposition Modeling in real world
Emerging Tech
 
20240705 QFM024 Irresponsible AI Reading List June 2024
20240705 QFM024 Irresponsible AI Reading List June 202420240705 QFM024 Irresponsible AI Reading List June 2024
20240705 QFM024 Irresponsible AI Reading List June 2024
Matthew Sinclair
 
WPRiders Company Presentation Slide Deck
WPRiders Company Presentation Slide DeckWPRiders Company Presentation Slide Deck
WPRiders Company Presentation Slide Deck
Lidia A.
 
Paradigm Shifts in User Modeling: A Journey from Historical Foundations to Em...
Paradigm Shifts in User Modeling: A Journey from Historical Foundations to Em...Paradigm Shifts in User Modeling: A Journey from Historical Foundations to Em...
Paradigm Shifts in User Modeling: A Journey from Historical Foundations to Em...
Erasmo Purificato
 
How Social Media Hackers Help You to See Your Wife's Message.pdf
How Social Media Hackers Help You to See Your Wife's Message.pdfHow Social Media Hackers Help You to See Your Wife's Message.pdf
How Social Media Hackers Help You to See Your Wife's Message.pdf
HackersList
 
Coordinate Systems in FME 101 - Webinar Slides
Coordinate Systems in FME 101 - Webinar SlidesCoordinate Systems in FME 101 - Webinar Slides
Coordinate Systems in FME 101 - Webinar Slides
Safe Software
 
[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf
[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf
[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf
Kief Morris
 
Password Rotation in 2024 is still Relevant
Password Rotation in 2024 is still RelevantPassword Rotation in 2024 is still Relevant
Password Rotation in 2024 is still Relevant
Bert Blevins
 

Recently uploaded (20)

Observability For You and Me with OpenTelemetry
Observability For You and Me with OpenTelemetryObservability For You and Me with OpenTelemetry
Observability For You and Me with OpenTelemetry
 
20240702 QFM021 Machine Intelligence Reading List June 2024
20240702 QFM021 Machine Intelligence Reading List June 202420240702 QFM021 Machine Intelligence Reading List June 2024
20240702 QFM021 Machine Intelligence Reading List June 2024
 
Choose our Linux Web Hosting for a seamless and successful online presence
Choose our Linux Web Hosting for a seamless and successful online presenceChoose our Linux Web Hosting for a seamless and successful online presence
Choose our Linux Web Hosting for a seamless and successful online presence
 
Details of description part II: Describing images in practice - Tech Forum 2024
Details of description part II: Describing images in practice - Tech Forum 2024Details of description part II: Describing images in practice - Tech Forum 2024
Details of description part II: Describing images in practice - Tech Forum 2024
 
The Increasing Use of the National Research Platform by the CSU Campuses
The Increasing Use of the National Research Platform by the CSU CampusesThe Increasing Use of the National Research Platform by the CSU Campuses
The Increasing Use of the National Research Platform by the CSU Campuses
 
Fluttercon 2024: Showing that you care about security - OpenSSF Scorecards fo...
Fluttercon 2024: Showing that you care about security - OpenSSF Scorecards fo...Fluttercon 2024: Showing that you care about security - OpenSSF Scorecards fo...
Fluttercon 2024: Showing that you care about security - OpenSSF Scorecards fo...
 
Best Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdfBest Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdf
 
Advanced Techniques for Cyber Security Analysis and Anomaly Detection
Advanced Techniques for Cyber Security Analysis and Anomaly DetectionAdvanced Techniques for Cyber Security Analysis and Anomaly Detection
Advanced Techniques for Cyber Security Analysis and Anomaly Detection
 
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-InTrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
 
20240702 Présentation Plateforme GenAI.pdf
20240702 Présentation Plateforme GenAI.pdf20240702 Présentation Plateforme GenAI.pdf
20240702 Présentation Plateforme GenAI.pdf
 
The Rise of Supernetwork Data Intensive Computing
The Rise of Supernetwork Data Intensive ComputingThe Rise of Supernetwork Data Intensive Computing
The Rise of Supernetwork Data Intensive Computing
 
BT & Neo4j: Knowledge Graphs for Critical Enterprise Systems.pptx.pdf
BT & Neo4j: Knowledge Graphs for Critical Enterprise Systems.pptx.pdfBT & Neo4j: Knowledge Graphs for Critical Enterprise Systems.pptx.pdf
BT & Neo4j: Knowledge Graphs for Critical Enterprise Systems.pptx.pdf
 
Implementations of Fused Deposition Modeling in real world
Implementations of Fused Deposition Modeling  in real worldImplementations of Fused Deposition Modeling  in real world
Implementations of Fused Deposition Modeling in real world
 
20240705 QFM024 Irresponsible AI Reading List June 2024
20240705 QFM024 Irresponsible AI Reading List June 202420240705 QFM024 Irresponsible AI Reading List June 2024
20240705 QFM024 Irresponsible AI Reading List June 2024
 
WPRiders Company Presentation Slide Deck
WPRiders Company Presentation Slide DeckWPRiders Company Presentation Slide Deck
WPRiders Company Presentation Slide Deck
 
Paradigm Shifts in User Modeling: A Journey from Historical Foundations to Em...
Paradigm Shifts in User Modeling: A Journey from Historical Foundations to Em...Paradigm Shifts in User Modeling: A Journey from Historical Foundations to Em...
Paradigm Shifts in User Modeling: A Journey from Historical Foundations to Em...
 
How Social Media Hackers Help You to See Your Wife's Message.pdf
How Social Media Hackers Help You to See Your Wife's Message.pdfHow Social Media Hackers Help You to See Your Wife's Message.pdf
How Social Media Hackers Help You to See Your Wife's Message.pdf
 
Coordinate Systems in FME 101 - Webinar Slides
Coordinate Systems in FME 101 - Webinar SlidesCoordinate Systems in FME 101 - Webinar Slides
Coordinate Systems in FME 101 - Webinar Slides
 
[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf
[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf
[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf
 
Password Rotation in 2024 is still Relevant
Password Rotation in 2024 is still RelevantPassword Rotation in 2024 is still Relevant
Password Rotation in 2024 is still Relevant
 

Computing at scale

  • 1. Computing at Scale: Data Exploration Jerjou Cheng, Barry Brumitt
  • 2. HELLO / jur' jō/ ɯoɔ˙ǝlƃooƃ@ noɾɹǝɾ MY NAME IS Developer Programs Engineer (Developer Relations) Google Storage
  • 3. Michael PIERROT http://www.freephotobank.org /v/sky-stars/cloud/Cloud-19.jpg.html
  • 4. Computing at Scale: Data Exploration Jerjou Cheng, Barry Brumitt
  • 5. Overview Google App Engine Google Storage for Developers Prediction API BigQuery
  • 7. Who are these services for?
  • 8. A World without Clouds Build a web application  Startup costs Maintenance / reliability Scaling Michael Scheltgen flickr.com/mscheltgen/
  • 9. Google App Engine Easy to start Easy to  maintain Easy to scale
  • 10. Users
  • 11. gigy Socialize - traffic
  • 12. Overview Google App Engine Google Storage for Developers Prediction API BigQuery
  • 13. Overview Google App Engine Google Storage for Developers Prediction API BigQuery
  • 14. A World without Clouds Store data  Reliability Sharing Large objects Michael Scheltgen flickr.com/mscheltgen/
  • 15. Google Storage for Developers Google infrastructure You control access to your data Store massive data in Google's cloud Easy interface
  • 17. Internal use cases Content hosting        Sharing     Data Import  Google BigQuery Google   Prediction API
  • 18. Overview Google App Engine Google Storage for Developers Prediction API BigQuery
  • 19. Prediction API Cloud-hosted machine learning as service Simple interface over complex analysis Predict results in real-time
  • 20. The Prediction API finds relevant features  in the sample data during training. How does it work? The Prediction API later searches for those features during prediction. "english" The quick brown fox jumped over the lazy dog. "english" To err is human, but to really foul things up you need a computer. "spanish" No hay mal que por bien no venga. "spanish" La tercera es la vencida. "english" To be or not to be, that is the question. "spanish" La  fe mueve montañas.
  • 21. Prediction API 1. Upload 2. Train Upload your  training data to Google Storage  Build a model from your data Make new predictions prediction/v1.1/training?data={} POST : a training request prediction/v1.1/training/{}/predict GET : model info POST : a prediction request   Use the API, gsutil or any compatible utility to upload your data to Google Storage 3. Predict
  • 23. Prediction API Google's machine learning algorithms Available as RESTful HTTP service Predict results in real-time
  • 24. Overview Google App Engine Google Storage for Developers Prediction API BigQuery
  • 25. To request access and get more information, go to: http://code.google.com/appengine http://code.google.com/apis/bigquery http://code.google.com/apis/predict http://code.google.com/apis/storage          GET /information HTTP/1.0

Editor's Notes

  1. Few sample graphs from Gigya’s events Very hard to predict traffic demands in advance - Largest event is 10X compared to second largest - Their largest was estimated to be one of the smallest :)