ISAX

•Download as PPTX, PDF•

0 likes•1,253 views

ISAX is a time series data compression algorithm that can group similar patterns in billions of time series datasets. It is implemented on H2O's distributed architecture and can be used for clustering, classification, anomaly detection, and predictive analytics on compressed time series data from fields like IoT, finance, bioinformatics, and image/sound processing. Examples of ISAX code in H2O are provided.

Recommended for you

Intro to H2O in Python - Data Science LA

Erin LeDell's presentation on Intro to H2O Machine Learning in Python at Data Science LA meetup on 1.19.16 - Powered by the open source machine learning software H2O.ai. Contributors welcome at: https://github.com/h2oai - To view videos on H2O open source machine learning software, go to: https://www.youtube.com/user/0xdata

•by Sri Ambati

h2olapython

Scala: the unpredicted lingua franca for data science

Talk given at Strata London with Dean Wampler (Lightbend) about Scala as the future of Data Science. First part is an approach of how scala became important, the remaining part of the talk is in notebooks using the Spark Notebook (http://spark-notebook.io/). The notebooks are available on GitHub: https://github.com/data-fellas/scala-for-data-science.

•by Andy Petrella

spark notebookapache sparkmachine learning

Intro to H2O Machine Learning in Python - Galvanize Seattle

Erin LeDell presents Intro to H2O Machine Learning in Python at Galvanize Seattle, 02.02.16 - Powered by the open source machine learning software H2O.ai. Contributors welcome at: https://github.com/h2oai - To view videos on H2O open source machine learning software, go to: https://www.youtube.com/user/0xdata

•by Sri Ambati

datamachine learningpython

Good H2O code examples
● https://github.com/h2oai/h2o-3/blob/master/h2o-core/src/main/java/water/rapi
ds/ast/prims/reducers/AstCumu.java
● https://github.com/h2oai/h2o-3/blob/master/h2o-core/src/main/java/water/rapi
ds/ast/prims/timeseries/AstIsax.java
● http://blog.h2o.ai/2014/03/h2o-architecture/

What's hot

ArnoCandelAIFrontiers011217

Sri Ambati

How Deep Learning Will Make Us More Human Again While deep learning is taking over the AI space, most of us are struggling to keep up with the pace of innovation. Arno Candel shares success stories and challenges in training and deploying state-of-the-art machine learning models on real-world datasets. He will also share his insights into what the future of machine learning and deep learning might look like, and how to best prepare for it. - Powered by the open source machine learning software H2O.ai. Contributors welcome at: https://github.com/h2oai - To view videos on H2O open source machine learning software, go to: https://www.youtube.com/user/0xdata

H2O intro at Dallas Meetup

Sri Ambati

This document summarizes a Dallas meetup on data science presented by Jorge Luis Hernandez Villapol. The meetup covered Jorge's background, an agenda including a data scientist checklist, an introduction to H2O products and workflow, and a question and answer session. The checklist recommends being passionate about data science, constantly learning, maintaining statistical and coding fundamentals, using the data science cycle, and keeping an updated toolbox of solutions. H2O is introduced as an open source, scalable machine learning platform that allows building models on big data and deploying them easily in an enterprise environment using algorithms like generalized linear models, random forests, gradient boosting machines, and deep learning.

H2O with Erin LeDell at Portland R User Group

Sri Ambati

Intro to H2O in Python - Data Science LA

Sri Ambati

Scala: the unpredicted lingua franca for data science

Andy Petrella

Intro to H2O Machine Learning in Python - Galvanize Seattle

Sri Ambati

Introduction to Machine Learning with H2O and Python

Sri Ambati

This document provides an introduction and agenda for a tutorial on machine learning with H2O and Python. The introduction discusses the presenter's background and qualifications. The agenda outlines topics to be covered including an overview of H2O.ai as a company and machine learning platform, tutorials on using the H2O Python module to import data, build regression and classification models, and improve model performance through techniques like cross-validation, grid search, and stacking. Case study notebooks and examples will be used to demonstrate key machine learning concepts and the H2O framework in Python.

Strata San Jose 2016: Scalable Ensemble Learning with H2O

Sri Ambati

This document discusses scalable ensemble learning using the H2O platform. It provides an overview of ensemble methods like bagging, boosting, and stacking. The stacking or Super Learner algorithm trains a "metalearner" to optimally combine the predictions from multiple "base learners". The H2O platform and its Ensemble package implement Super Learner and other ensemble methods for tasks like regression and classification. An R code demo is presented on training ensembles with H2O.

Spark + H20 = Machine Learning at scale

Mateusz Dymczyk

H2O at Berlin R Meetup

Jo-fai Chow

This document summarizes a presentation given by Joe Chow on machine learning using H2O.ai's platform. The presentation covered: 1) An introduction to Joe and H2O.ai, including the company's mission to operationalize data science. 2) An overview of the H2O platform for machine learning, including its distributed algorithms, interfaces for R and Python, and model export capabilities. 3) A demonstration of deep learning using H2O's Deep Water integration with TensorFlow, MXNet, and Caffe, allowing users to build and deploy models across different frameworks.

Project "Deep Water"

Jo-fai Chow

Transitioning from Traditional DW to Apache® Spark™ in Operating Room Predict...

Databricks

The prevailing issue when working with Operating Room (OR) scheduling within a hospital setting is that it is difficult to schedule and predict available OR block times. This leads to empty and unused operating rooms leading to longer waiting times for patients for their procedures. In this three-part session, Ayad Shammout and Denny will show: 1) How we tried to solve this problem using traditional DW techniques 2) How we took advantage of the DW capabilities in Apache Spark AND easily transition to Spark MLlib so we could more easily predict available OR block times resulting in better OR utilization and shorter wait times for patients. 3) Some of the key learnings we had when migrating from DW to Spark.

Not Your Father's Database: How to Use Apache Spark Properly in Your Big Data...

Databricks

This session will cover a series of problems that are adequately solved with Apache Spark, as well as those that are require additional technologies to implement correctly. Here’s an example outline of some of the topics that will be covered in the talk: Problems that are perfectly solved with Apache Spark: 1) Analyzing a large set of data files. 2) Doing ETL of a large amount of data. 3) Applying Machine Learning & Data Science to a large dataset. 4) Connecting BI/Visualization tools to Apache Spark to analyze large datasets internally. By Vida Ha at Spark Summit East 2016.

Practical Medium Data Analytics with Python (10 Things I Hate About pandas, P...

Wes McKinney

This document discusses pandas, a popular Python library for data analysis, and its limitations. It introduces Badger, a new project from DataPad that aims to address some of pandas' shortcomings like slow performance on large datasets and lack of tight database integration. The creator describes Badger as using compressed columnar storage, immutable data structures, and C kernels to perform analytics queries much faster than pandas or databases on benchmark tests of a multi-million row dataset. He envisions Badger becoming a distributed, multicore analytics platform that can also be used for ETL jobs.

GPU Accelerated Machine Learning

Sri Ambati

Deep learning algorithms have benefited greatly from the recent performance gains of GPUs. However, it has been unclear whether GPUs can speed up machine learning algorithms such as generalized linear modeling, random forests, gradient boosting machines, and clustering. H2O.ai, the leading open source AI company, is bringing the best-of-breed data science and machine learning algorithms to GPUs. We introduce H2O4GPU, a fully featured machine learning library that is optimized for GPUs with a robust python API that is drop dead replacement for scikit-learn. We'll demonstrate benchmarks for the most common algorithms relevant to enterprise AI and showcase performance gains as compared to running on CPUs. Jon’s Bio: https://umdphysics.umd.edu/people/faculty/current/item/337-jcm.html Please view the video here:

Bringing an AI Ecosystem to the Domain Expert and Enterprise AI Developer wit...

Databricks

We’ve all heard that AI is going to become as ubiquitous in the enterprise as the telephone, but what does that mean exactly? Everyone in IBM has a telephone; and everyone knows how to use her telephone; and yet IBM isn’t a phone company. How do we bring AI to the same standard of ubiquity — where everyone in a company has access to AI and knows how to use AI; and yet the company is not an AI company? In this talk, we’ll break down the challenges a domain expert faces today in applying AI to real-world problems. We’ll talk about the challenges that a domain expert needs to overcome in order to go from “I know a model of this type exists” to “I can tell an application developer how to apply this model to my domain.” We’ll conclude the talk with a live demo that show cases how a domain expert can cut through the five stages of model deployment in minutes instead of days using IBM and other open source tools.

h2oensemble with Erin Ledell at useR! Aalborg

Sri Ambati

This document discusses ensemble learning methods for scaling to large datasets using H2O. It introduces ensemble learning and the Super Learner algorithm for combining multiple models. It describes how H2O and the h2oEnsemble R package implement ensemble learning and the Super Learner algorithm in a scalable way using H2O's distributed architecture. This allows ensemble methods to be applied to large datasets that cannot fit in memory.

Introduction to Analytics with Azure Notebooks and Python

Jen Stirrup

H2O Deep Water - Making Deep Learning Accessible to Everyone

Jo-fai Chow

H2O Deep Water is a tool that integrates distributed deep learning with H2O's machine learning platform. It allows users to build, stack, and deploy deep learning models from libraries like TensorFlow, MXNet, and Caffe through a unified interface. Deep Water inherits properties from H2O like scalability, ease of use, and deployment capabilities. It also makes deep learning more accessible by supporting popular network architectures and allowing easy ensemble of deep models with other H2O algorithms.

From Kaggle to H2O - The True Story of a Civil Engineer Turned Data Geek

Jo-fai Chow

What's hot (20)

ArnoCandelAIFrontiers011217

H2O intro at Dallas Meetup

H2O with Erin LeDell at Portland R User Group

Intro to H2O in Python - Data Science LA

Scala: the unpredicted lingua franca for data science

Intro to H2O Machine Learning in Python - Galvanize Seattle

Introduction to Machine Learning with H2O and Python

Strata San Jose 2016: Scalable Ensemble Learning with H2O

Spark + H20 = Machine Learning at scale

H2O at Berlin R Meetup

Project "Deep Water"

Transitioning from Traditional DW to Apache® Spark™ in Operating Room Predict...

Not Your Father's Database: How to Use Apache Spark Properly in Your Big Data...

Practical Medium Data Analytics with Python (10 Things I Hate About pandas, P...

GPU Accelerated Machine Learning

Bringing an AI Ecosystem to the Domain Expert and Enterprise AI Developer wit...

h2oensemble with Erin Ledell at useR! Aalborg

Introduction to Analytics with Azure Notebooks and Python

H2O Deep Water - Making Deep Learning Accessible to Everyone

From Kaggle to H2O - The True Story of a Civil Engineer Turned Data Geek

Viewers also liked

Using Machine Learning For Solving Time Series Probelms

Sri Ambati

The document discusses using machine learning for solving time series problems. It outlines typical steps which include converting irregular time series data to regular samples, preprocessing the data through techniques like tapped delay lines and dynamic filters to capture dynamic aspects for static models, and then applying machine learning. Both static models where dynamic preprocessing is used and dynamic models like recurrent neural networks are suitable. Example applications include time series forecasting, classification, and control/decision making problems.

Deep Learning with MXNet - Dmitry Larko

Sri Ambati

Deep Water - GPU Deep Learning for H2O - Arno Candel

Sri Ambati

1) The document discusses the history and development of artificial intelligence, machine learning, and deep learning from the 1950s to present. 2) It introduces H2O.ai's Deep Water platform for deep learning which leverages popular open source tools like TensorFlow, MXNet, and Caffe to enable large-scale deep learning on CPUs and GPUs. 3) Deep Water allows users to easily train, compare, and deploy deep learning models through H2O's APIs in R, Python, and Flow for big data use cases like image, video, text, and time series analysis.

Top 10 Data Science Practitioner Pitfalls

Sri Ambati

Over-fitting, misread data, NAs, collinear column elimination and other common issues play havoc in the day of practicing data scientist. In this talk, Mark Landry, one of the world’s leading Kagglers, will review the top 10 common pitfalls and steps to avoid them. - Powered by the open source machine learning software H2O.ai. Contributors welcome at: https://github.com/h2oai - To view videos on H2O open source machine learning software, go to: https://www.youtube.com/user/0xdata

Interpretable machine learning

Sri Ambati

Interpreting deep learning and machine learning models is not just another regulatory burden to be overcome. Scientists, physicians, researchers, and analyst that use these technologies for their important work have the right to trust and understand their models and the answers they generate. This talk is an overview of several techniques for interpreting deep learning and machine learning models and telling stories from their results. Speaker: Patrick Hall is a Data Scientist and Product Engineer at H2O.ai. He’s also an Adjunct Professor at George Washington University for the Department of Decision Sciences. Prior to joining H2O, Patrick spent many years as a Senior Data Scientist SAS and has worked with many Fortune 500 companies on their data science and machine learning problems. https://www.linkedin.com/in/jpatrickhall

Cybersecurity with AI - Ashrith Barthur

Sri Ambati

H2O AutoML roadmap - Ray Peck

Sri Ambati

Sparkling Water 2.0 - Michal Malohlava

Sri Ambati

sparklyr - Jeff Allen

Sri Ambati

The Joys of Clean Data with Matt Dowle

Sri Ambati

This document contains the slides from a presentation by Matt Dowle on working with messy data. It discusses Dowle's experiences over his career cleaning and munging data from various financial institutions to prepare it for machine learning models. It highlights some of the common issues encountered, such as data entry errors, id changes, missing values. It also showcases tools that can be used to help with pre-processing large datasets directly on the command line. Finally, it discusses how the size and scale of data has increased significantly over time, to the point where datasets can now easily exceed RAM sizes on standard machines.

H2O World - GLRM - Anqi Fu

Sri Ambati

Generalized low rank models provide a compressed representation of data by identifying important features and representing each data point as a combination of those features. This reduces storage space, speeds up predictions, and helps visualize patterns in the data. Examples show how low rank models can compress walking stance data to identify principal poses and compress zip code data into demographic archetypes to improve compliance predictions across regions.

Better Customer Experience with Data Science - Bernard Burg, Comcast

Sri Ambati

This document discusses using data science and machine learning to improve the customer experience at Comcast. It describes using error data from set-top boxes and customer behavior data to predict when customers will call and the reasons for their calls. H2O machine learning algorithms were able to more accurately predict calls and reasons compared to Spark ML, improving the customer service experience. Overall, adopting H2O's algorithms provided superior results, faster performance, and better use of memory compared to alternative tools.

H2O World - Cancer Detection via the Lasso - Rob Tibshirani

Sri Ambati

H2O Advancements - Arno Candel

Sri Ambati

H2O has announced several new advancements including improved security features, semi-supervised deep learning, and capabilities for large Java models. New features were also added for tree algorithms like gradient boosted machines to improve accuracy, and H2O will now support convolutional and recurrent neural networks for tasks like image recognition and time series analysis. Deep Water was announced as H2O's next generation deep learning platform to bring enterprise deep learning capabilities.

Comcast Enterprise Network Services

vcardona

Predicting Patient Outcomes in Real-Time at HCA

Sri Ambati

Data Scientist Allison Baker and Development Manager of Data Products Cody Hall work with a talented team of data scientists, software engineers, and web developers, and are building the framework and infrastructure to support a real-time prediction application, with the ability to scale across the entire company. Paramount to these efforts has been the capability of integrating the architecture for software production with the predictive models generated by H2O. This talk will review the processes by which HCA is building a pipeline to predict patient outcomes in real-time, heavily relying on H2O’s POJO scoring API and implemented in Clojure data processing. #h2ony - Powered by the open source machine learning software H2O.ai. Contributors welcome at: https://github.com/h2oai - To view videos on H2O open source machine learning software, go to: https://www.youtube.com/user/0xdata

Visual Machine Learning - Tony Chu

Sri Ambati

H2O World - Generalized Low Rank Models - Madeleine Udell

Sri Ambati

This document summarizes generalized low rank models (GLRMs), which can find low dimensional structure in large, heterogeneous datasets. GLRMs approximate a data matrix using the product of two lower rank matrices. They generalize techniques like principal component analysis by allowing different loss functions and regularizers. GLRMs can handle a variety of data types, impute missing values, and provide dimensionality reduction. They can be fitted efficiently using alternating minimization or stochastic gradient methods in parallel and distributed implementations.

Self Guiding User Experience

Sri Ambati

In this talk we will share the idea of developing self guiding application that would provide the most engaging user experience possible using crowd sourced knowledge on a mobile interface. We will discuss and share how historical usage data could be mined using machine learning to identify application usage patterns to generate probable next actions. #h2ony - Powered by the open source machine learning software H2O.ai. Contributors welcome at: https://github.com/h2oai - To view videos on H2O open source machine learning software, go to: https://www.youtube.com/user/0xdata

Advances in automatic time series forecasting

Rob Hyndman

The document discusses advances in automatic time series forecasting. It outlines different methods for time series forecasting, including exponential smoothing methods. Exponential smoothing can include trend and seasonal components that are additive or multiplicative. Common exponential smoothing methods are simple exponential smoothing, Holt's linear method for additive trends, additive damped trend method, and exponential trend method. The document will cover additional forecasting techniques like ARIMA modelling and methods for complex time series data.

Viewers also liked (20)

Using Machine Learning For Solving Time Series Probelms

Deep Learning with MXNet - Dmitry Larko

Deep Water - GPU Deep Learning for H2O - Arno Candel

Top 10 Data Science Practitioner Pitfalls

Interpretable machine learning

Cybersecurity with AI - Ashrith Barthur

H2O AutoML roadmap - Ray Peck

Sparkling Water 2.0 - Michal Malohlava

sparklyr - Jeff Allen

The Joys of Clean Data with Matt Dowle

H2O World - GLRM - Anqi Fu

Better Customer Experience with Data Science - Bernard Burg, Comcast

H2O World - Cancer Detection via the Lasso - Rob Tibshirani

H2O Advancements - Arno Candel

Comcast Enterprise Network Services

Predicting Patient Outcomes in Real-Time at HCA

Visual Machine Learning - Tony Chu

H2O World - Generalized Low Rank Models - Madeleine Udell

Self Guiding User Experience

Advances in automatic time series forecasting

Similar to ISAX

Intro to Machine Learning with H2O and AWS

Sri Ambati

Tna Discovery Portal

Jeremie Charlet

DevOps-Roadmap

BnhNguynHuy1

This document provides a roadmap for learning DevOps skills and technologies. It covers topics such as source code management with Git, programming languages, Linux, networking, servers, containers, orchestration with Kubernetes, infrastructure as code with Terraform, CI/CD, monitoring, cloud providers, Agile methodologies, and automation testing. For each topic, it lists several learning resources like websites, courses, and documentation to gain knowledge in that area. The overall roadmap is intended to help develop the full range of abilities needed for a career in DevOps engineering.

Accumulo Summit 2015: Real-Time Distributed and Reactive Systems with Apache ...

Accumulo Summit

Talk Abstract In this talk we will walk through how Apache Kafka and Apache Accumulo can be used together to orchestrate a de-coupled, real-time distributed and reactive request/response system at massive scale. Multiple data pipelines can perform complex operations for each message in parallel at high volumes with low latencies. The final result will be inline with the initiating call. The architecture gains are immense. They allow for the requesting system to receive a response without the need for direct integration with the data pipeline(s) that messages must go through. By utilizing Apache Kafka and Apache Accumulo, these gains sustain at scale and allow for complex operations of different messages to be applied to each response in real-time. Speaker Joe Stein Principal Consultant, Big Data Open Source Security, LLC Joe Stein is an Apache Kafka committer and PMC member. Joe is the Founder and Principal Architect of Big Data Open Source Security LLC a professional services and product solutions company. Joe has been a developer, architect and technologist professionally for 15 years now having built back end systems that supported over one hundred million unique devices a day processing trillions of events. He blogs and hosts a podcast about Hadoop and related systems at All Things Hadoop and tweets @allthingshadoop

Real-Time Distributed and Reactive Systems with Apache Kafka and Apache Accumulo

Joe Stein

In this talk we will walk through how Apache Kafka and Apache Accumulo can be used together to orchestrate a de-coupled, real-time distributed and reactive request/response system at massive scale. Multiple data pipelines can perform complex operations for each message in parallel at high volumes with low latencies. The final result will be inline with the initiating call. The architecture gains are immense. They allow for the requesting system to receive a response without the need for direct integration with the data pipeline(s) that messages must go through. By utilizing Apache Kafka and Apache Accumulo, these gains sustain at scale and allow for complex operations of different messages to be applied to each response in real-time.

Michael stack -the state of apache h base

hdhappy001

The document provides an overview of Apache HBase, an open source, distributed, scalable, big data non-relational database. It discusses that HBase is modeled after Google's Bigtable and built on Hadoop for storage. It also summarizes that HBase is used by many large companies for applications such as messaging, real-time analytics, and search indexing. The project is led by an active community of committers and sees steady improvements and new features with each monthly release.

APAN Cloud WG (2015/3/2)

Masaharu Munetomo

This document provides an overview of building high-performance inter-cloud infrastructure in Japan. It discusses Masaharu Munetomo's roles and background, Hokkaido University's academic cloud system, the High Performance Computing Infrastructure (HPCI) collaboration, and several use cases of the cloud system including big data processing, simulation environments, and drug design. It also outlines related projects involving remote cloud collaborations, distributed database infrastructure, and inter-cloud resource optimization using evolutionary algorithms.

Technologie Proche: Imagining the Archival Systems of Tomorrow With the Tools...

Artefactual Systems - AtoM

These slides accompanied a June 4th, 2016 presentation made by Dan Gillean of Artefactual Systems at the Association of Canadian Archivists' 2016 Conference in Montreal, QC, Canada. This presentation aims to examine several existing or emerging computing paradigms, with specific examples, to imagine how they might inform next-generation archival systems to support digital preservation, description, and access. Topics covered include: - Distributed Version Control and git - P2P architectures and the BitTorrent protocol - Linked Open Data and RDF - Blockchain technology The session is part of an attempt by the ACA to create interactive "working sessions" at its conferences. Accompanying notes can be found at: http://bit.ly/tech-Proche Participants were also asked to use the Twitter hashtag of #techProche for online interaction during the session.

Estrategias basadas en la interoperabilidad para la incorporación de contenid...

Conferência Luso-Brasileira de Ciência Aberta

M0339_v1_6977127809 (1).pptx

viveknagle4

The document discusses security and privacy considerations for big data systems. It proposes two main areas of focus: 1) developing new security and privacy design patterns tailored for big data, and 2) defining a "big data security fabric" to orchestrate security across big data tools and technologies. The document also provides examples of how security innovations from Apache Storm could be integrated into other frameworks to provide features like authentication, authorization, and data isolation. Finally, it discusses challenges around clarifying the definition of a "security fabric" and leveraging existing models to guide development while addressing the unique aspects of big data technologies and use cases.

Overview of modern software ecosystem for big data analysis

Michael Bryzek

ElasticSearch - Suche im Zeitalter der Clouds

inovex GmbH

Eine performante Suche mit relevanten Ergebnissen in großen Datenbeständen ist inzwischen für uns alle immer und überall selbstverständlich. Suche wird nicht mehr nur in klassischen Szenarien wie Enterprise Search und Web Search eingesetzt, sondern organisiert den Zugriff auf Daten und Informationen in verschiedensten Anwendungen (Stichwort: Search-based Applications). Ein Großteil der gebräuchlichen Suchtechnologien basiert hierbei auf dem Apache-Lucene-Projekt. Im Bereich der Suchserver auf Lucene-Basis gibt es nun neben Apache Solr einen neuen Star in der Open-Soruce-Szene: ElasticSearch. Dieser Vortrag stellt ElasticSearch und die Einsatzszenarien eingehend vor und grenzt die Möglichkeiten gegenüber Lucene und Solr insbesondere im Bereich großer Datenmengen ab.

Measuring Technical Lag in Software Deployments (CHAOSScon 2020)

Tom Mens

Elasticsearch + Cascading for Scalable Log Processing

Cascading

Supreet Oberoi's presentation on "Large scale log processing with Cascading & Elastic Search". Elasticsearch is becoming a popular platform for log analysis with its ELK stack: Elasticsearch for search, Logstash for centralized logging, and Kibana for visualization. Complemented with Cascading, the application development platform for building Data applications on Apache Hadoop, developers can correlate at scale multiple log and data streams to perform rich and complex log processing before making it available to the ELK stack.

Case study

karan saini

This document provides a case study on a project created using open source technology. It discusses analyzing project goals and resources, evaluating open source options based on total cost of ownership, implementing a solution using LAMP stack, and lessons learned. The project was developed using Linux, Apache, MySQL, and PHP based on the needs of a low budget, ability to invest in internal skills, and reduce dependency on external trends. Key steps included preparing the Linux server, using version control and local testing, and engaging the open source community for support.

Reactive Fast Data & the Data Lake with Akka, Kafka, Spark

Todd Fritz

This document discusses a presentation titled "Reactive Fast Data & the Data Lake with Akka, Kafka, Spark" given by Todd Fritz at DevNexus in February 2017. The presentation agenda covers reactive systems and patterns, fast data, data lakes, the intersection of these topics, and architecture considerations for building systems that can scale to millions of users and billions of messages. Key technologies discussed include Akka, Kafka, and Spark.

Apache Arrow: Present and Future @ ScaledML 2020

Wes McKinney

This document discusses Apache Arrow, an open source project that provides cross-language data structures and algorithms for efficient data analytics. It summarizes the history and goals of Arrow, provides examples of how it has been adopted, and outlines ongoing development initiatives. Key points include that Arrow aims to accelerate data processing by standardizing columnar data formats and protocols, it has seen widespread adoption with over 50M installs in 2019, and active areas of work include the C++ development platform and Arrow Flight RPC framework.

Elasticsearch and the Database Market

ObjectRocket

Big data berlin

kammeyer

This document provides an agenda and overview of a talk on big data and data science given by Peter Wang. The key points covered include: - An honest perspective on big data trends and challenges over time. - Architecting systems for data exploration and analysis using tools like Continuum Analytics' Blaze and Numba libraries. - Python's role in data science for its ecosystem of libraries and accessibility to domain experts.

Building real time data-driven products

Lars Albertsson

This presentation will describe how to go beyond a "Hello world" stream application and build a real-time data-driven product. We will present architectural patterns, go through tradeoffs and considerations when deciding on technology and implementation strategy, and describe how to put the pieces together. We will also cover necessary practical pieces for building real products: testing streaming applications, and how to evolve products over time. Presented at highloadstrategy.com 2016 by Øyvind Løkling (Schibsted Products & Technology), joint work with Lars Albertsson (independent, www.mapflat.com).

Similar to ISAX (20)

Intro to Machine Learning with H2O and AWS

Tna Discovery Portal

DevOps-Roadmap

Accumulo Summit 2015: Real-Time Distributed and Reactive Systems with Apache ...

Real-Time Distributed and Reactive Systems with Apache Kafka and Apache Accumulo

Michael stack -the state of apache h base

APAN Cloud WG (2015/3/2)

Technologie Proche: Imagining the Archival Systems of Tomorrow With the Tools...

Estrategias basadas en la interoperabilidad para la incorporación de contenid...

M0339_v1_6977127809 (1).pptx

Overview of modern software ecosystem for big data analysis

ElasticSearch - Suche im Zeitalter der Clouds

Measuring Technical Lag in Software Deployments (CHAOSScon 2020)

Elasticsearch + Cascading for Scalable Log Processing

Case study

Reactive Fast Data & the Data Lake with Akka, Kafka, Spark

Apache Arrow: Present and Future @ ScaledML 2020

Elasticsearch and the Database Market

Big data berlin

Building real time data-driven products

More from Sri Ambati

GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...

Sri Ambati

H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day

Sri Ambati

This document provides an overview of H2O.ai, an AI company that offers products and services to democratize AI. It mentions that H2O products are backed by 10% of the world's top data scientists from Kaggle and that H2O has customers in 7 of the top 10 banks, 4 of the top 10 insurance companies, and top manufacturing companies. It also provides details on H2O's founders, funding, customers, products, and vision to make AI accessible to more organizations.

Generative AI Masterclass - Model Risk Management.pptx

Sri Ambati

Here are some key points about benchmarking and evaluating generative AI models like large language models: - Foundation models require large, diverse datasets to be trained on in order to learn broad language skills and knowledge. Fine-tuning can then improve performance on specific tasks. - Popular benchmarks evaluate models on tasks involving things like commonsense reasoning, mathematics, science questions, generating truthful vs false responses, and more. This helps identify model capabilities and limitations. - Custom benchmarks can also be designed using tools like Eval Studio to systematically test models on specific applications or scenarios. Both automated and human evaluations are important. - Leaderboards like HELM aggregate benchmark results to compare how different models perform across a wide range of tests and metrics.

AI and the Future of Software Development: A Sneak Peek

Sri Ambati

LLMOps: Match report from the top of the 5th

Sri Ambati

The document discusses LLMOps (Large Language Model Operations) compared to traditional MLOps. Some key points: - LLMOps and MLOps face similar challenges across the development lifecycle, but LLMOps requires more GPU resources and integration is faster due to more models in each application. Evaluation is also less clear. - The LLMOps field is around the 5th generation of models, with debates around proprietary vs open source models, and balancing privacy, cost and control. - LLMOps platforms are emerging to provide solutions for tasks like prompting, embedding databases, evaluation, and governance, similar to how MLOps platforms have evolved.

Building, Evaluating, and Optimizing your RAG App for Production

Sri Ambati

The document discusses optimizing question answering systems called RAG (Retrieve-and-Generate) stacks. It outlines challenges with naive RAG approaches and proposes solutions like improved data representations, advanced retrieval techniques, and fine-tuning large language models. Table stakes optimizations include tuning chunk sizes, prompt engineering, and customizing LLMs. More advanced techniques involve small-to-big retrieval, multi-document agents, embedding fine-tuning, and LLM fine-tuning.

Building LLM Solutions using Open Source and Closed Source Solutions in Coher...

Sri Ambati

Sandeep Singh, Head of Applied AI Computer Vision, Beans.ai H2O Open Source GenAI World SF 2023 In the modern era of machine learning, leveraging both open-source and closed-source solutions has become paramount for achieving cutting-edge results. This talk delves into the intricacies of seamlessly integrating open-source Large Language Model (LLM) solutions like Vicuna, Falcon, and Llama with industry giants such as ChatGPT and Google's Palm. As the demand for fine-tuned and specialized datasets grows, it is imperative to understand the synergy between these tools. Attendees will gain insights into best practices for building and enriching datasets tailored for fine-tuning tasks, ensuring that their LLM projects are both robust and efficient. Through real-world examples and hands-on demonstrations, this talk will equip attendees with the knowledge to harness the power of both open and closed-source tools in a coherent and effective manner.

Risk Management for LLMs

Sri Ambati

Patrick Hall, Professor, AI Risk Management, The George Washington University H2O Open Source GenAI World SF 2023 Language models are incredible engineering breakthroughs but require auditing and risk management before productization. These systems raise concerns about toxicity, transparency and reproducibility, intellectual property licensing and ownership, disinformation and misinformation, supply chains, and more. How can your organization leverage these new tools without taking on undue or unknown risks? While language models and associated risk management are in their infancy, a small number of best practices in governance and risk are starting to emerge. If you have a language model use case in mind, want to understand your risks, and do something about them, this presentation is for you!

Open-Source AI: Community is the Way

Sri Ambati

Dr. Alexy Khrabrov, Open Source Science Community Director, IBM H2O Open Source GenAI World SF 2023 In this talk, Dr. Alexy Khrabrov, recently elected Chair of the new Generative AI Commons at Linux Foundation for AI & Data, outlines the OSS AI landscape, challenges, and opportunities. With new models and frameworks being unveiled weekly, one thing remains constant: community building and validation of all aspects of AI is key to reliable and responsible AI we can use for business and society needs. Industrial AI is one key area where such community validation can prove invaluable.

Building Custom GenAI Apps at H2O

Sri Ambati

The document announces the launch of the H2O GenAI App Store, which provides a collection of applications that make it easier for average users to leverage large language models through custom interfaces for specific tasks like getting gardening advice or feedback on code. The app store is designed to accelerate the development of these GenAI apps using the H2O Wave platform and provides access to H2OGPTE for retrieval augmented generation and language model calls. Developers can also contribute their own apps through the GitHub repository listed.

Applied Gen AI for the Finance Vertical

Sri Ambati

Megan Kurka, Vice President, Customer Data Scientist, H2O.ai H2O Open Source GenAI World SF 2023 Discover the transformative power of Applied Gen AI. Learn how the H2O team builds customized applications and workflows that integrate capabilities of Gen AI and AutoML specifically designed to address and enhance financial use cases. Explore real world examples, learn best practices, and witness firsthand how our innovative solutions are reshaping the landscape of finance technology.

Cutting Edge Tricks from LLM Papers

Sri Ambati

This document discusses techniques for improving language models (LLMs) discussed in recent papers. It describes building blocks of LLMs like fine-tuning, foundation training, memory, and databases. Specific techniques covered include LIMA which uses 1,000 carefully curated examples, instruction backtranslation to generate question-answer pairs, fine-tuning models on API examples like Gorilla, and reducing false answers through techniques like not agreeing with incorrect user opinions. The goal is to discuss cutting edge tricks to build better LLMs.

Practitioner's Guide to LLMs: Exploring Use Cases and a Glimpse Beyond Curren...

Sri Ambati

Pascal Pfeiffer, Principal Data Scientist, H2O.ai H2O Open Source GenAI World SF 2023 This talk dives into the expansive ecosystem of Large Language Models (LLMs), offering practitioners an insightful guide to various relevant applications, from natural language understanding to creative content generation. While exploring use cases across different industries, it also honestly addresses the current limitations of LLMs and anticipates future advancements.

Open Source h2oGPT with Retrieval Augmented Generation (RAG), Web Search, and...

Sri Ambati

KGM Mastering Classification and Regression with LLMs: Insights from Kaggle C...

Sri Ambati

This document discusses using large language models (LLMs) for text classification tasks. It begins by describing how LLMs are commonly used for text generation and question answering. For classification, models are usually trained supervised on labeled data. The document then explores using LLMs for zero-shot classification without training, and techniques like fine-tuning LLMs on tasks to improve performance. It provides an example of fine-tuning an LLM on a financial sentiment dataset. The document concludes by describing H2O.ai's LLM Studio tool for fine-tuning and a few Kaggle competitions where LLMs achieved success in text classification.

LLM Interpretability

Sri Ambati

1) Generative AI (GenAI) enables the creation of novel content by learning patterns in unstructured data rather than labeling outputs like traditional AI. 2) Both traditional and generative AI models lack transparency and may contain biases, but generative models can additionally hallucinate or leak private information. 3) To interpret generative models, researchers evaluate accuracy globally by checking for hallucinations or undesirable content, and locally by confirming the quality of individual responses.

Never Reply to an Email Again

Sri Ambati

Introducción al Aprendizaje Automatico con H2O-3 (1)

Sri Ambati

From Rapid Prototypes to an end-to-end Model Deployment: an AI Hedge Fund Use...

Sri Ambati

Numerai is an open, crowd-sourced hedge fund powered by predictions from data scientists around the world. In return, participants are rewarded with weekly payouts in crypto. In this talk, Joe will give an overview of the Numerai tournament based on his own experience. He will then explain how he automates the time-consuming tasks such as testing different modelling strategies, scoring new datasets, submitting predictions to Numerai as well as monitoring model performance with H2O Driverless AI and R.

AI Foundations Course Module 1 - Shifting to the Next Step in Your AI Transfo...

Sri Ambati

In this session, you will learn about what you should do after you’ve taken an AI transformation baseline. Over the span of this session, we will discuss the next steps in moving toward AI readiness through alignment of talent and tools to drive successful adoption and continuous use within an organization. To find additional videos on AI courses, earn badges, join the courses at H2O.ai Learning Center: https://training.h2o.ai/products/ai-foundations-course To find the Youtube video about this presentation: https://youtu.be/K1Cl3x3rd8g Speaker: Chemere Davis (H2O.ai - Senior Data Scientist Training Specialist)

More from Sri Ambati (20)

GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...

H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day

Generative AI Masterclass - Model Risk Management.pptx

AI and the Future of Software Development: A Sneak Peek

LLMOps: Match report from the top of the 5th

Building, Evaluating, and Optimizing your RAG App for Production

Building LLM Solutions using Open Source and Closed Source Solutions in Coher...

Risk Management for LLMs

Open-Source AI: Community is the Way

Building Custom GenAI Apps at H2O

Applied Gen AI for the Finance Vertical

Cutting Edge Tricks from LLM Papers

Practitioner's Guide to LLMs: Exploring Use Cases and a Glimpse Beyond Curren...

Open Source h2oGPT with Retrieval Augmented Generation (RAG), Web Search, and...

KGM Mastering Classification and Regression with LLMs: Insights from Kaggle C...

LLM Interpretability

Never Reply to an Email Again

Introducción al Aprendizaje Automatico con H2O-3 (1)

From Rapid Prototypes to an end-to-end Model Deployment: an AI Hedge Fund Use...

AI Foundations Course Module 1 - Shifting to the Next Step in Your AI Transfo...

Recently uploaded

Choose our Linux Web Hosting for a seamless and successful online presence

rajancomputerfbd

UiPath Community Day Kraków: Devs4Devs Conference

UiPathCommunity

We are honored to launch and host this event for our UiPath Polish Community, with the help of our partners - Proservartner! We certainly hope we have managed to spike your interest in the subjects to be presented and the incredible networking opportunities at hand, too! Check out our proposed agenda below 👇👇 08:30 ☕ Welcome coffee (30') 09:00 Opening note/ Intro to UiPath Community (10') Cristina Vidu, Global Manager, Marketing Community @UiPath Dawid Kot, Digital Transformation Lead @Proservartner 09:10 Cloud migration - Proservartner & DOVISTA case study (30') Marcin Drozdowski, Automation CoE Manager @DOVISTA Pawel Kamiński, RPA developer @DOVISTA Mikolaj Zielinski, UiPath MVP, Senior Solutions Engineer @Proservartner 09:40 From bottlenecks to breakthroughs: Citizen Development in action (25') Pawel Poplawski, Director, Improvement and Automation @McCormick & Company Michał Cieślak, Senior Manager, Automation Programs @McCormick & Company 10:05 Next-level bots: API integration in UiPath Studio (30') Mikolaj Zielinski, UiPath MVP, Senior Solutions Engineer @Proservartner 10:35 ☕ Coffee Break (15') 10:50 Document Understanding with my RPA Companion (45') Ewa Gruszka, Enterprise Sales Specialist, AI & ML @UiPath 11:35 Power up your Robots: GenAI and GPT in REFramework (45') Krzysztof Karaszewski, Global RPA Product Manager 12:20 🍕 Lunch Break (1hr) 13:20 From Concept to Quality: UiPath Test Suite for AI-powered Knowledge Bots (30') Kamil Miśko, UiPath MVP, Senior RPA Developer @Zurich Insurance 13:50 Communications Mining - focus on AI capabilities (30') Thomasz Wierzbicki, Business Analyst @Office Samurai 14:20 Polish MVP panel: Insights on MVP award achievements and career profiling

Best Programming Language for Civil Engineers

Awais Yaseen

The integration of programming into civil engineering is transforming the industry. We can design complex infrastructure projects and analyse large datasets. Imagine revolutionizing the way we build our cities and infrastructure, all by the power of coding. Programming skills are no longer just a bonus—they’re a game changer in this era. Technology is revolutionizing civil engineering by integrating advanced tools and techniques. Programming allows for the automation of repetitive tasks, enhancing the accuracy of designs, simulations, and analyses. With the advent of artificial intelligence and machine learning, engineers can now predict structural behaviors under various conditions, optimize material usage, and improve project planning.

Scaling Connections in PostgreSQL Postgres Bangalore(PGBLR) Meetup-2 - Mydbops

Mydbops

This presentation, delivered at the Postgres Bangalore (PGBLR) Meetup-2 on June 29th, 2024, dives deep into connection pooling for PostgreSQL databases. Aakash M, a PostgreSQL Tech Lead at Mydbops, explores the challenges of managing numerous connections and explains how connection pooling optimizes performance and resource utilization. Key Takeaways: * Understand why connection pooling is essential for high-traffic applications * Explore various connection poolers available for PostgreSQL, including pgbouncer * Learn the configuration options and functionalities of pgbouncer * Discover best practices for monitoring and troubleshooting connection pooling setups * Gain insights into real-world use cases and considerations for production environments This presentation is ideal for: * Database administrators (DBAs) * Developers working with PostgreSQL * DevOps engineers * Anyone interested in optimizing PostgreSQL performance Contact info@mydbops.com for PostgreSQL Managed, Consulting and Remote DBA Services

Transcript: Details of description part II: Describing images in practice - T...

BookNet Canada

This presentation explores the practical application of image description techniques. Familiar guidelines will be demonstrated in practice, and descriptions will be developed “live”! If you have learned a lot about the theory of image description techniques but want to feel more confident putting them into practice, this is the presentation for you. There will be useful, actionable information for everyone, whether you are working with authors, colleagues, alone, or leveraging AI as a collaborator. Link to presentation recording and slides: https://bnctechforum.ca/sessions/details-of-description-part-ii-describing-images-in-practice/ Presented by BookNet Canada on June 25, 2024, with support from the Department of Canadian Heritage.

The Rise of Supernetwork Data Intensive Computing

Larry Smarr

20240704 QFM023 Engineering Leadership Reading List June 2024

Matthew Sinclair

Observability For You and Me with OpenTelemetry

Eric D. Schabell

Are you interested in dipping your toes in the cloud native observability waters, but as an engineer you are not sure where to get started with tracing problems through your microservices and application landscapes on Kubernetes? Then this is the session for you, where we take you on your first steps in an active open-source project that offers a buffet of languages, challenges, and opportunities for getting started with telemetry data. The project is called openTelemetry, but before diving into the specifics, we’ll start with de-mystifying key concepts and terms such as observability, telemetry, instrumentation, cardinality, percentile to lay a foundation. After understanding the nuts and bolts of observability and distributed traces, we’ll explore the openTelemetry community; its Special Interest Groups (SIGs), repositories, and how to become not only an end-user, but possibly a contributor.We will wrap up with an overview of the components in this project, such as the Collector, the OpenTelemetry protocol (OTLP), its APIs, and its SDKs. Attendees will leave with an understanding of key observability concepts, become grounded in distributed tracing terminology, be aware of the components of openTelemetry, and know how to take their first steps to an open-source contribution! Key Takeaways: Open source, vendor neutral instrumentation is an exciting new reality as the industry standardizes on openTelemetry for observability. OpenTelemetry is on a mission to enable effective observability by making high-quality, portable telemetry ubiquitous. The world of observability and monitoring today has a steep learning curve and in order to achieve ubiquity, the project would benefit from growing our contributor community.

論文紹介：A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...

Toru Tamaki

BT & Neo4j: Knowledge Graphs for Critical Enterprise Systems.pptx.pdf

Neo4j

Presented at Gartner Data & Analytics, London Maty 2024. BT Group has used the Neo4j Graph Database to enable impressive digital transformation programs over the last 6 years. By re-imagining their operational support systems to adopt self-serve and data lead principles they have substantially reduced the number of applications and complexity of their operations. The result has been a substantial reduction in risk and costs while improving time to value, innovation, and process automation. Join this session to hear their story, the lessons they learned along the way and how their future innovation plans include the exploration of uses of EKG + Generative AI.

Research Directions for Cross Reality Interfaces

Mark Billinghurst

Best Practices for Effectively Running dbt in Airflow.pdf

Tatiana Al-Chueyr

As a popular open-source library for analytics engineering, dbt is often used in combination with Airflow. Orchestrating and executing dbt models as DAGs ensures an additional layer of control over tasks, observability, and provides a reliable, scalable environment to run dbt models. This webinar will cover a step-by-step guide to Cosmos, an open source package from Astronomer that helps you easily run your dbt Core projects as Airflow DAGs and Task Groups, all with just a few lines of code. We’ll walk through: - Standard ways of running dbt (and when to utilize other methods) - How Cosmos can be used to run and visualize your dbt projects in Airflow - Common challenges and how to address them, including performance, dependency conflicts, and more - How running dbt projects in Airflow helps with cost optimization Webinar given on 9 July 2024

20240705 QFM024 Irresponsible AI Reading List June 2024

Matthew Sinclair

The Increasing Use of the National Research Platform by the CSU Campuses

Larry Smarr

TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In

TrustArc

Six months into 2024, and it is clear the privacy ecosystem takes no days off!! Regulators continue to implement and enforce new regulations, businesses strive to meet requirements, and technology advances like AI have privacy professionals scratching their heads about managing risk. What can we learn about the first six months of data privacy trends and events in 2024? How should this inform your privacy program management for the rest of the year? Join TrustArc, Goodwin, and Snyk privacy experts as they discuss the changes we’ve seen in the first half of 2024 and gain insight into the concrete, actionable steps you can take to up-level your privacy program in the second half of the year. This webinar will review: - Key changes to privacy regulations in 2024 - Key themes in privacy and data governance in 2024 - How to maximize your privacy program in the second half of 2024

20240702 QFM021 Machine Intelligence Reading List June 2024

Matthew Sinclair

Details of description part II: Describing images in practice - Tech Forum 2024

BookNet Canada

This presentation explores the practical application of image description techniques. Familiar guidelines will be demonstrated in practice, and descriptions will be developed “live”! If you have learned a lot about the theory of image description techniques but want to feel more confident putting them into practice, this is the presentation for you. There will be useful, actionable information for everyone, whether you are working with authors, colleagues, alone, or leveraging AI as a collaborator. Link to presentation recording and transcript: https://bnctechforum.ca/sessions/details-of-description-part-ii-describing-images-in-practice/ Presented by BookNet Canada on June 25, 2024, with support from the Department of Canadian Heritage.

Pigging Solutions Sustainability brochure.pdf

Pigging Solutions

Sustainability requires ingenuity and stewardship. Did you know Pigging Solutions pigging systems help you achieve your sustainable manufacturing goals AND provide rapid return on investment. How? Our systems recover over 99% of product in transfer piping. Recovering trapped product from transfer lines that would otherwise become flush-waste, means you can increase batch yields and eliminate flush waste. From raw materials to finished product, if you can pump it, we can pig it.

WhatsApp Image 2024-03-27 at 08.19.52_bfd93109.pdf

ArgaBisma

BLOCKCHAIN FOR DUMMIES: GUIDEBOOK FOR ALL

Liveplex

Recently uploaded (20)

Choose our Linux Web Hosting for a seamless and successful online presence

UiPath Community Day Kraków: Devs4Devs Conference

Best Programming Language for Civil Engineers

Scaling Connections in PostgreSQL Postgres Bangalore(PGBLR) Meetup-2 - Mydbops

Transcript: Details of description part II: Describing images in practice - T...

The Rise of Supernetwork Data Intensive Computing

20240704 QFM023 Engineering Leadership Reading List June 2024

Observability For You and Me with OpenTelemetry

論文紹介：A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...

BT & Neo4j: Knowledge Graphs for Critical Enterprise Systems.pptx.pdf

Research Directions for Cross Reality Interfaces

Best Practices for Effectively Running dbt in Airflow.pdf

20240705 QFM024 Irresponsible AI Reading List June 2024

The Increasing Use of the National Research Platform by the CSU Campuses

TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In

20240702 QFM021 Machine Intelligence Reading List June 2024

Details of description part II: Describing images in practice - Tech Forum 2024

Pigging Solutions Sustainability brochure.pdf

WhatsApp Image 2024-03-27 at 08.19.52_bfd93109.pdf

BLOCKCHAIN FOR DUMMIES: GUIDEBOOK FOR ALL

ISAX

1. ISAX Mark Chan, Hacker & Data Scientist, H2O.ai

2. ISAX • Time series data compression algorithm, implemented on H2O’s distributed architecture • Find groups of similar time series patterns in one billion ○ http://blog.h2o.ai/2016/11/indexing-1-billion-time-series-with-h2o-and-isax/ • ISAX applied to fields such as IoT, Finance, BioInformatics,Image/Sound processing. ○ http://www.cs.ucr.edu/~eamonn/SAX.htm • Compress your time series data and run: • ○ Clustering • ○ Classification • ○ Anomaly Detection • ○ Predictive analytics

6. Good H2O code examples ● https://github.com/h2oai/h2o-3/blob/master/h2o-core/src/main/java/water/rapi ds/ast/prims/reducers/AstCumu.java ● https://github.com/h2oai/h2o-3/blob/master/h2o-core/src/main/java/water/rapi ds/ast/prims/timeseries/AstIsax.java ● http://blog.h2o.ai/2014/03/h2o-architecture/

ISAX

Related slideshows

Recommended for you

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (20)

Similar to ISAX

Similar to ISAX (20)

More from Sri Ambati

More from Sri Ambati (20)

Recently uploaded

Recently uploaded (20)

ISAX