Scylla Summit 2018: Keynote - 4 Years of Scylla

•Download as PPTX, PDF•

1 like•3,517 views

This document summarizes Dor Laor's experience over 4+ years with ScyllaDB, including key milestones and achievements as well as ongoing goals and challenges. It notes Scylla's initial release in 2016 and improvements over time to features such as materialized views and global secondary indexes. It also discusses optimizing performance on cloud infrastructure and addressing challenges related to workload types and capacity planning. Going forward, it outlines priorities like lightweight transactions, change data capture, and improving Cassandra compatibility. The overall message is one of pride in accomplishments while still feeling challenged to achieve further dreams and improvements.

Scylla Summit 2018: Keynote - 4 Years of Scylla

9/2014OSv team meets Cassandra
Cassandra summit 2014

3/2018Shard per Core cloned by competition
Threads Shards

Scylla 3.0
SStable format 3.0
Materialized Views
Global Secondary Index

Cloud workload
▪ YCSB, prepared statements
▪ Workload A, 50%:50% read:update
▪ Requested SLA: 60k write ops, 60k read ops, < 10ms P95
▪ 1TB dataset
▪ i3.8xlarge | 32 vCPU | 244 GiB RAM | 4 x 1.9TB NVMe
▪ 3-node cluster on single DC | RF=3

Not so fast.. #1
We had to add 33% capacity and slow the ingestion

Cloud Uniform Workload
▪ YCSB, prepared statements

The dress that broke the internet database

The dress that broke the internet database
’s BigTable

“I've accomplished a lot, but I still
have more dreams that I want to
achieve.”
- Joe Jonas

PROUD OF CHALLENGED
+ 1 msec P99
+ K/V special mode
+ Many other

PROUD OF CHALLENGED
131GB wide row 131GB wide row

One Click Docker compose:
Spark, Kafka, Scylla, Materialized View

PROUD OF CHALLENGED
sctool repair --cluster mycluster --
dc dc-us-*, !dc-us-west

PROUD OF CHALLENGED
sctool repair --cluster mycluster --
dc dc-us-*, !dc-us-west
Improved repair

PROUD OF CHALLENGED
Linear scale-up Missing APIs
Capture Data Change
Lightweight Transactions
Official RESTapi

LWT
Transient
Replication
Incremental
Repair
UDF
Better
Cassandra

LWT
Transient
Replication
Incremental
Repair
UDF
Better
Cassandra
VPC
Multi DC
Encryption
IOPS model
Dynamic Vnodes
Tiered storage
More protocols
Better
Cloud

Thank You
Please stay in touch
dor@scylladb.com
@dorlaor

What's hot

GPS Insight on Using Presto with Scylla for Data Analytics and Data Archival

ScyllaDB

GPS Insight is a leader in fleet vehicle management using IoT. Internally they use a combination of SQL and NoSQL big data technologies, including distributed SQL data analytics via Presto, an open-source query engine developed by Facebook. Learn how to set up, configure, and use Presto with Scylla for supporting ad hoc non-partition key queries for analytics and data scientists. Plus hear how to use Presto for a Data Archival approach with csv files on S3 or similar storage appliance.

Workshop - How to benchmark your database

ScyllaDB

Why you need benchmarks Finding the right database solution for your use case can be an arduous journey. The database deployment touches aspects of throughput performance, latency control, high availability and data resilience. You will need to decide on the infrastructure to use: Cloud, on-premise or a hybrid solution. Data models also have an impact on finding the right fit for the use case. Once you establish a requirements set, the next step is to test your use case against the databases of choice. In this workshop, we will discuss the different data points you need to collect in order to get the most realistic testing environment. We will cover: Data model impact on performance and latency Client behavior related to database capabilities Failover and high availability testing Hardware selection and cluster configuration impact We will show 2 benchmarking tools you can use to test and benchmark your clusters to identify the optimal deployment scenario for your use case. Attend this virtual workshop if you are: Looking to minimize the cost of your database deployment Making a database decision based on performance and scale data Planning to emulate your workload on a pre-production system where you can test, fail fast and learn.

Introducing Scylla Open Source 4.0

ScyllaDB

Since its inception, Scylla has offered a compelling alternative to Apache Cassandra, providing better performance for a lower cost of ownership. With Scylla Open Source 4.0 we continue to extend our CQL interface features and capabilities and also now provide an open source alternative to DynamoDB, allowing you to run your workloads anywhere, on any cloud provider, or on premises. Join ScyllaDB co-founders, CTO Avi Kivity and CEO Dor Laor, for a look at the new features in Scylla Open Source 4.0, and architectural and cost comparisons with the coming Cassandra 4.0. Topics will include: Improved consistency with our new Lightweight Transactions Scylla Operator for Kubernetes How we stack up against Apache Cassandra 4.0 Our “run anywhere” DynamoDB alternative

How to Build a Scylla Database Cluster that Fits Your Needs

ScyllaDB

Sizing a database cluster makes or breaks your application. Too small and you could sustain spikes in usage and recover from a node loss or an operational slowdown. Too big and your cluster will cost more and waste valuable human resources. Since different workloads have different requirements, successful sizing of your application should be optimized for both throughput and latency performance. However, in many cases, the requirements for each contradicts each other. In this webinar, we explain how to remediate the contradicting forces and build a sustainable cluster to meet both performance and resiliency requirements.

Real-time Fraud Detection for Southeast Asia’s Leading Mobile Platform

ScyllaDB

Grab is one of the most frequently used mobile platforms in Southeast Asia, providing the everyday services that matter most to consumers. Its users commute, eat, arrange shopping deliveries, and pay with one e-wallet. Grab relies on the combination of Apache Kafka and Scylla for a very critical use case -- instantaneously detecting fraudulent transactions that might occur across approximately more than six million on-demand rides per day taking place in eight countries across Southeast Asia. Doing this successfully requires many things to happen in near-real time. Join our webinar for this fascinating real-time big data use case, and learn the steps Grab took to optimize their fraud detection systems using the Scylla NoSQL database along with Apache Kafka.

Under the Hood of a Shard-per-Core Database Architecture

ScyllaDB

Most databases are based on architectures that pre-date advances to modern hardware. This results in performance issues, the need to overprovision, and a high total cost of ownership. In this webinar we will discuss the advances to modern server technology and take a deep dive into Scylla’s shard-per-core architecture and our asynchronous engine, the Seastar framework. Join us to learn how Seastar (and Scylla): Avoid locks and contention on the CPU level Bypass kernel bottlenecks Implement its per-core shared-nothing autosharding mechanism Utilize modern storage hardware Leverage NUMA to get the best RAM performance Balance your data across CPUs and nodes for best and smoothest performance Plus we’ll cover the advantages of unlocking vertical scalability.

Scylla @ Disney+ Hotstar

ScyllaDB

Numberly on Joining Billions of Rows in Seconds: Replacing MongoDB and Hive w...

ScyllaDB

Many organizations struggle to balance traditional big data infrastructure with NoSQL databases. Other organizations do the smart thing and consolidate the two. This presentation explores Numberly’s experience migrating an intensive and join-hungry production workload from MongoDB and Hive to Scylla. Join Alexys Jacob, CTO of Numberly, to learn how they joined billions of rows in seconds and dramatically reduced operational and development complexity by using a single database for their hybrid analytical use case. As a bonus, Alexys will also cover benchmarks for Dask (a flexible parallel computing library for analytic computing) and Spark, highlighting their differences and lessons learned along the way.

Wide Column Store NoSQL vs SQL Data Modeling

ScyllaDB

NoSQL schemas are designed with very different goals in mind than SQL schemas. Where SQL normalizes data, NoSQL denormalizes. Where SQL joins ad-hoc, NoSQL pre-joins. And where SQL tries to push performance to the runtime, NoSQL bakes performance into the schema. Join us for an exploration of the core concepts of NoSQL schema design, using Scylla as an example to demonstrate the tradeoffs and rationale.

NoSQL and NewSQL: Tradeoffs between Scalable Performance & Consistency

ScyllaDB

Webinar how to build a highly available time series solution with kairos-db (1)

Julia Angell

Overcoming Barriers of Scaling Your Database

ScyllaDB

Scaling distributed databases successfully requires meeting myriad challenges from physical distribution of your data across on-premises locations, public cloud vendors, geographies and political entities to adopting technologies to overcome fundamental operational bottlenecks. Join ScyllaDB's Peter Corless, director of technical advocacy, as he interviews Moreno Garcia y Silva, head of solution architecture, about how to navigate both technical ecosystem and database architectural challenges for this next tech cycle. Takeaways: - Recognizing and classifying barriers to scaling - Solutions to overcome scaling challenges - Upfront planning and real-time response

Scylla Summit 2018: Joining Billions of Rows in Seconds with One Database Ins...

ScyllaDB

Many organizations struggle to balance traditional big data infrastructure with NoSQL databases. Other organizations do the smart thing and consolidate the two. This presentation explores Numberly’s experience migrating an intensive and join hungry production workload from MongoDB and Hive to Scylla. Using Scylla, we were able to accommodate a join of billions of rows in seconds, while also dramatically reducing operational and development complexity by using a single database for our hybrid analytical use case. As a bonus, we’ll cover benchmarks for Dask (a flexible parallel computing library for analytic computing) and Spark, highlighting their differences and lessons learned along the way.

Cassandra vs. ScyllaDB: Evolutionary Differences

ScyllaDB

Scylla Summit 2019 Keynote - Avi Kivity

ScyllaDB

Scylla Virtual Workshop 2020

ScyllaDB

Learn how to get started with Scylla Join us for an overview of NoSQL best practices and get a look into the scale-out vs scale up models and the Scylla philosophy for accelerated success. In this session, we will show you how to get fast wins when using Scylla. We will cover architectural concepts, installation best practices, data model antipatterns, use case examples, scale-out vs. scale up approaches and management and monitoring tools. If you’re a database architect, developer, or manager, this session is for you! Architectural concepts Installation of a single cluster of Scylla Using Docker to get a 3-node cluster on your laptop Connecting your application to the database Data model antipatterns Management and monitoring installation

Seastar Summit 2019 Keynote

ScyllaDB

Seastar is a framework for disk, network, compute, and multicore intensive applications such as databases and filesystems. It treats multicore CPUs and disk I/O as asynchronous entities like networking, replacing locks with message passing. This provides benefits like high throughput, low latency, and control over where throughput and latency occur. The keynote discussed Seastar's approach to scheduling, opportunities around coroutines, and its goals for modules, stream revamping, and task co-execution. Compatibility policies were outlined emphasizing community involvement in supported compilers, APIs, and architectures.

Keeping your application’s latency SLAs no matter what

ScyllaDB

Businesses that once measured performance in seconds now measure it down to the millisecond and even the microsecond in order to provide optimal user experience. For a NoSQL database few things are more important than keeping latencies low and bounded. Yet some databases suffer latency spikes from such regular occurrences as Java Virtual Machine (JVM) “garbage collection,” context switches, database repair, cache flushes and so on. This makes long-tail latency very tricky to diagnose and fix, as it’s often a “whack-a-mole” exercise. In this session, we will cover: The systemic causes of latency spikes How to keep latencies bounded and predictable How to manage latency-inducing events How Scylla helps optimize for 99% latency of <1msec

AdGear Use Case with Scylla - 1M Queries Per Second with Single-Digit Millise...

ScyllaDB

Lightweight Transactions in Scylla versus Apache Cassandra

ScyllaDB

Lightweight transactions (LWT) has been a long anticipated feature for Scylla. Join Scylla VP of Product Tzach Livyatan and Software Team Lead Konstantin Osipov for a webinar introducing the Scylla implementation of LWT, a feature that brings strong consistency to our NoSQL database. In this webinar we will cover the tradeoffs typically made between database consistency, availability and latency; how to use lightweight transactions in Scylla; the similarities and differences between Scylla’s Paxos implementation and Cassandra’s, and what it all means to users. From attending this live webinar you’ll learn… The advantages and disadvantages of various consistency options Scylla lightweight transactions: syntax and semantics A design and implementation overview, changes in Paxos Performance comparisons with Apache Cassandra Scylla’s future roadmap for LWT beyond Paxos

What's hot (20)

GPS Insight on Using Presto with Scylla for Data Analytics and Data Archival

Workshop - How to benchmark your database

Introducing Scylla Open Source 4.0

How to Build a Scylla Database Cluster that Fits Your Needs

Real-time Fraud Detection for Southeast Asia’s Leading Mobile Platform

Under the Hood of a Shard-per-Core Database Architecture

Scylla @ Disney+ Hotstar

Numberly on Joining Billions of Rows in Seconds: Replacing MongoDB and Hive w...

Wide Column Store NoSQL vs SQL Data Modeling

NoSQL and NewSQL: Tradeoffs between Scalable Performance & Consistency

Webinar how to build a highly available time series solution with kairos-db (1)

Overcoming Barriers of Scaling Your Database

Scylla Summit 2018: Joining Billions of Rows in Seconds with One Database Ins...

Cassandra vs. ScyllaDB: Evolutionary Differences

Scylla Summit 2019 Keynote - Avi Kivity

Scylla Virtual Workshop 2020

Seastar Summit 2019 Keynote

Keeping your application’s latency SLAs no matter what

AdGear Use Case with Scylla - 1M Queries Per Second with Single-Digit Millise...

Lightweight Transactions in Scylla versus Apache Cassandra

Similar to Scylla Summit 2018: Keynote - 4 Years of Scylla

How we got to 1 millisecond latency in 99% under repair, compaction, and flus...

ScyllaDB

Scylla is an open source reimplementation of Cassandra which performs up to 10X with drop in-replacement compatibility. At ScyllaDB, performance matters but even more importantly, stable performance under any circumstances. A key factor for our consistent performance is our reliance on userspace schedulers. Scheduling in userspace allows the application, the database in our case to have better control on the different priorities each task has and to provide an SLA to selected operations. Scylla used to have an I/O scheduler and recently won a CPU scheduler. At ScyllaDB, we make architectural decisions that provide not only low latencies but consistently low latencies at higher percentiles. This begins with our choice of language and key architectural decisions such as not using the Linux page-cache, and is fulfilled by autonomous database control, a set of algorithms, which guarantees that the system will adapt to changes in the workload. In the last year, we have made changes to Scylla that provide latencies that are consistent in every percentile. In this talk, Dor Laor will recap those changes and discuss what ScyllaDB is doing in the future.

Measuring Database Performance on Bare Metal AWS Instances

ScyllaDB

AWS has recently announced a new type of instance targeted at I/O intensive applications, the i3.metal. That instance does away with the virtualization layer altogether and gives back the resources that would otherwise be used by the hypervisor back to the application. To use all of those resources — 72 CPUs and 512GB of memory — a database needs to be have the ability to scale both up and out. In this webinar we will look into the performance of Scylla running in a few of those instances versus Apache Cassandra running in their sweet spot, a larger fleet of smaller instances. We will discuss how much of the gains come from the database design and how much come from the removal of the virtualization layer. Key takeaways: How to properly compare two different database technologies while being fair to both How to choose the optimal setup for your Scylla deployment How AWS’s bare metal servers enable Scylla users to draw a significant performance boost.

Scylla db deck, july 2017

Dor Laor

Scylla Summit 2018: Kiwi.com Migration to Scylla - The Why, the How, the Fail...

ScyllaDB

At Kiwi.com we never stop innovating our product and our architecture. Over the past couple of years, we saw a significant rise in technology requirements both globally and internally and had already tried several database solutions. The transformation went from small applications to complex microservices architectures. We first migrated to Cassandra from a big PostgreSQL cluster to get better performance and scalability, but our demands never stopped growing. That is why we decided to go with Scylla. In this talk, I will cover how our team approached testing of Scylla, the migration plan, how it impacts our business and how it influenced our high-level architecture of the application and infrastructure. It has a significant impact on disaster recovery and availability of our overall system.

Scala & Spark(1.6) in Performance Aspect for Scala Taiwan

Jimin Hsieh

Scylla Summit 2018: Keeping Your Latency SLAs No Matter What!

ScyllaDB

Dr. Ike Nassi, Founder, TidalScale at MLconf NYC - 4/15/16

MLconf

Scaling Spark – Vertically: The mantra of Spark technology is divide and conquer, especially for problems too big for a single computer. The more you divide a problem across worker nodes, the more total memory and processing parallelism you can exploit. This comes with a trade-off. Splitting applications and data across multiple nodes is nontrivial, and more distribution results in more network traffic which becomes a bottleneck. Can you achieve scale and parallelism without those costs? We’ll show results of a variety of Spark application domains including structured data, graph processing and common machine learning in a single, high-capacity scaled-up system versus a more distributed approach and discuss how virtualization can be used to define node size flexibly, achieving the best balance for Spark performance.

Cassandra EU 2012 - Putting the X Factor into Cassandra

Acunu

Malcolm Box discusses Tellybug's experience using Cassandra to power voting applications for reality TV shows like Britain's Got Talent and The X Factor. They started with Cassandra to handle high write loads from millions of votes but found counting to be more challenging than expected. They implemented sharded counters in Memcached with Cassandra as the source of truth. While Cassandra scaled well for writes, reads had performance issues. Backup and data integrity also presented operational challenges as their usage of Cassandra evolved.

Stream, stream, stream: Different streaming methods with Spark and Kafka

Itai Yaffe

Going into different streaming methods, we will share our experience as early-adopters of Spark Streaming and Spark Structured Streaming, and how we overcame technical barriers (and there were plenty...). We will also present a rather unique solution of using Kafka to imitate streaming over our Data Lake, while significantly reducing our cloud services’ costs. Topics include : * Kafka and Spark Streaming for stateless and stateful use-cases * Spark Structured Streaming as a possible alternative * Combining Spark Streaming with batch ETLs * “Streaming” over Data Lake using Kafka

The Do’s and Don’ts of Benchmarking Databases

ScyllaDB

With so many moving parts, how can you be sure that a tweak to your database is really beneficial or just a measurement fluke? And how can you be sure that your benchmark is measuring the right thing? In this webinar you will learn a set of best practices to improve the quality of your benchmarks, including how to... Evaluate changes to database systems, whether you are a code contributor or a user playing with knobs Determine what to measure for the most accurate results Make benchmarks that are strong, solid, and reliable We will also cover how to judge whether benchmarks with incredible claims are to be trusted.

Spark Summit EU 2015: Lessons from 300+ production users

Databricks

At Databricks, we have a unique view into over a hundred different companies trying out Spark for development and production use-cases, from their support tickets and forum posts. Having seen so many different workflows and applications, some discernible patterns emerge when looking at common performance and scalability issues that our users run into. This talk will discuss some of these common common issues from an engineering and operations perspective, describing solutions and clarifying misconceptions.

What’s New in ScyllaDB Open Source 5.0

ScyllaDB

ScyllaDB Open Source 5.0 is the latest evolution of our monstrously fast and scalable NoSQL database – powering instantaneous experiences with massive distributed datasets. Join us to learn about ScyllaDB Open Source 5.0, which represents the first milestone in ScyllaDB V. ScyllaDB 5.0 introduces a host of functional, performance and stability improvements that resolve longstanding challenges of legacy NoSQL databases. We’ll cover: - New capabilities including a new IO model and scheduler, Raft-based schema updates, automated tombstone garbage collection, optimized reverse queries, and support for the latest AWS EC2 instances - How ScyllaDB 5.0 fits into the evolution of ScyllaDB – and what to expect next - The first look at benchmarks that quantify the impact of ScyllaDB 5.0's numerous optimizations This will be an interactive session with ample time for Q & A – bring us your questions and feedback!

Use ScyllaDB Alternator to Use Amazon DynamoDB API, Everywhere, Better, More ...

ScyllaDB

Alternator is ScyllaDB’s API compatible with Amazon DynamoDB. Alternator allows you to go beyond the AWS perimeter to run your workload everywhere, on any cloud or on premises, without a single line of code change. The session will show how to save costs by moving workloads from Amazon DynamoDB to ScyllaDB Alternator using real-life examples. We will give an insight into the Alternator development process and road-map and demonstrate how to use it on Scylla Cloud for production and your local machine for testing.

How Development Teams Cut Costs with ScyllaDB.pdf

ScyllaDB

Now that teams are increasingly being pressed to cut costs, the database can be a low-hanging fruit for sizable cost reduction – especially if you’re managing terabytes to petabytes of data with millions of read/write operations per second. Join Tzach Livyatan, VP of Product at ScyllaDB, as he shares four ways that teams commonly cut database costs by rethinking their database strategy. We’ll cover topics including: - Cutting admin costs by reducing node sprawl and reducing the need for tuning - ScyllaDB as a better, compatible Amazon DynamoDB - Options to increase price performance through new cloud instances - Ways to safely add more workloads to your cluster without compromising the performance of your latency-sensitive workloads

Cassandra to ScyllaDB: Technical Comparison and the Path to Success

ScyllaDB

What can you expect when migrating from Cassandra to ScyllaDB? This session provides a jumpstart based on what we’ve learned from working with your peers across hundreds of use cases. Discover how ScyllaDB’s architecture, capabilities, and performance compares to Cassandra’s. Then, hear about your Cassandra to ScyllaDB migration options and practical strategies for success, including our top do’s and don’ts.

Under The Hood Of A Shard-Per-Core Database Architecture

ScyllaDB

This document summarizes the key design decisions behind ScyllaDB's shard-per-core database architecture. It discusses how ScyllaDB addresses the challenges of scaling databases across hundreds of CPU cores by utilizing an asynchronous task model with one thread and one data shard per CPU core. This allows for linear scalability. It also overhauls the I/O scheduling to prioritize workloads and maximize throughput from SSDs under mixed read/write workloads. Benchmark results show ScyllaDB's architecture can handle petabyte-scale databases with high performance and low latency even on commodity hardware.

Running Apache Spark on a High-Performance Cluster Using RDMA and NVMe Flash ...

Databricks

This document summarizes a presentation about using the Crail distributed storage system to improve Spark performance on high-performance computing clusters with RDMA networking and NVMe flash storage. The key points are: 1) Traditional Spark storage and networking APIs do not bypass the operating system kernel, limiting performance on modern hardware. 2) The Crail system provides user-level APIs for RDMA networking and NVMe flash to improve Spark shuffle, join, and sorting workloads by 2-10x on a 128-node cluster. 3) Crail allows Spark workloads to fully utilize high-speed networks and disaggregate memory and flash storage across nodes without performance penalties.

Run Scala Faster with GraalVM on any Platform / GraalVMで、どこでもScalaを高速実行しよう by...

scalaconfjp

This document discusses using GraalVM to run Scala faster on any platform. It provides an overview of GraalVM, how it can be used to compile Scala faster than the default compiler, and how GraalVM's native image feature allows building native executables from Scala code for low overhead startup and memory usage. It also discusses how GraalVM could enable building cross-platform mobile apps using Scala and JavaFX that run on iOS and Android.

Big data meetup 2012 01-18 - stripped

Malcolm Box

Dynamic Change Data Capture with Flink CDC and Consistent Hashing

HostedbyConfluent

"Change Data Capture (CDC) is a popular technique for extracting data from databases in realtime. However, many CDC deployments are static: e.g. a single connector is configured to ingest data for one or several tables. At Goldsky, we needed a way to configure CDC for a large Postgres database dynamically: the list of tables to ingest is driven by customer-facing features and is constantly changing. We started using Flink CDC connectors built on top of the Debezium project, but we immediately faced many challenges caused mainly by the lack of incremental snapshotting. But even after implementing incremental snapshotting ourselves, we still faced an issue around using replication slots in Postgres: we couldn't use a single connector to ingest all tables (it's just too much data), and we couldn't create a new connector for every new set of tables (we'd quickly run out of replication slots). So we needed to find a way to maintain a fixed number of replication slots for a dynamic list of tables. In the end, we chose a consistent hashing algorithm to distribute the list of tables across multiple Flink jobs. The jobs also required some customizations to support the incremental snapshotting semantics from Flink CDC. We learned a lot about Debezium, Flink CDC and Postgres replication, and we're excited to share our learnings with the community!"

Similar to Scylla Summit 2018: Keynote - 4 Years of Scylla (20)

How we got to 1 millisecond latency in 99% under repair, compaction, and flus...

Measuring Database Performance on Bare Metal AWS Instances

Scylla db deck, july 2017

Scylla Summit 2018: Kiwi.com Migration to Scylla - The Why, the How, the Fail...

Scala & Spark(1.6) in Performance Aspect for Scala Taiwan

Scylla Summit 2018: Keeping Your Latency SLAs No Matter What!

Dr. Ike Nassi, Founder, TidalScale at MLconf NYC - 4/15/16

Cassandra EU 2012 - Putting the X Factor into Cassandra

Stream, stream, stream: Different streaming methods with Spark and Kafka

The Do’s and Don’ts of Benchmarking Databases

Spark Summit EU 2015: Lessons from 300+ production users

What’s New in ScyllaDB Open Source 5.0

Use ScyllaDB Alternator to Use Amazon DynamoDB API, Everywhere, Better, More ...

How Development Teams Cut Costs with ScyllaDB.pdf

Cassandra to ScyllaDB: Technical Comparison and the Path to Success

Under The Hood Of A Shard-Per-Core Database Architecture

Running Apache Spark on a High-Performance Cluster Using RDMA and NVMe Flash ...

Run Scala Faster with GraalVM on any Platform / GraalVMで、どこでもScalaを高速実行しよう by...

Big data meetup 2012 01-18 - stripped

Dynamic Change Data Capture with Flink CDC and Consistent Hashing

More from ScyllaDB

Unconventional Methods to Identify Bottlenecks in Low-Latency and High-Throug...

ScyllaDB

In this presentation, we explore how standard profiling and monitoring methods may fall short in identifying bottlenecks in low-latency data ingestion workflows. Instead, we showcase the power of simple yet clever methods that can uncover hidden performance limitations. Attendees will discover unconventional techniques, including clever logging, targeted instrumentation, and specialized metrics, to pinpoint bottlenecks accurately. Real-world use cases will be presented to demonstrate the effectiveness of these methods. By the end of the session, attendees will be equipped with alternative approaches to identify bottlenecks and optimize their low-latency data ingestion workflows for high throughput.

Mitigating the Impact of State Management in Cloud Stream Processing Systems

ScyllaDB

Stream processing is a crucial component of modern data infrastructure, but constructing an efficient and scalable stream processing system can be challenging. Decoupling compute and storage architecture has emerged as an effective solution to these challenges, but it can introduce high latency issues, especially when dealing with complex continuous queries that necessitate managing extra-large internal states. In this talk, we focus on addressing the high latency issues associated with S3 storage in stream processing systems that employ a decoupled compute and storage architecture. We delve into the root causes of latency in this context and explore various techniques to minimize the impact of S3 latency on stream processing performance. Our proposed approach is to implement a tiered storage mechanism that leverages a blend of high-performance and low-cost storage tiers to reduce data movement between the compute and storage layers while maintaining efficient processing. Throughout the talk, we will present experimental results that demonstrate the effectiveness of our approach in mitigating the impact of S3 latency on stream processing. By the end of the talk, attendees will have gained insights into how to optimize their stream processing systems for reduced latency and improved cost-efficiency.

Measuring the Impact of Network Latency at Twitter

ScyllaDB

Architecting a High-Performance (Open Source) Distributed Message Queuing Sys...

ScyllaDB

BlazingMQ is a new open source* distributed message queuing system developed at and published by Bloomberg. It provides highly-performant queues to applications for asynchronous, efficient, and reliable communication. This system has been used at scale at Bloomberg for eight years, where it moves terabytes of data and billions of messages across tens of thousands of queues in production every day. BlazingMQ provides highly-available, fault-tolerant queues courtesy of replication based on the Raft consensus algorithm. In addition, it provides a rich set of enterprise message routing strategies, enabling users to implement a variety of scenarios for message processing. Written in C++ from the ground up, BlazingMQ has been architected with low latency as one of its core requirements. This has resulted in some unique design and implementation choices at all levels of the system, such as its lock-free threading model, custom memory allocators, compact wire protocol, multi-hop network topology, and more. This talk will provide an overview of BlazingMQ. We will then delve into the system’s core design principles, architecture, and implementation details in order to explore the crucial role they play in its performance and reliability. *BlazingMQ will be released as open source between now and P99 (exact timing is still TBD)

Noise Canceling RUM by Tim Vereecke, Akamai

ScyllaDB

Noisy Real User Monitoring (RUM) data can ruin your P99! We introduce a fresh concept called ""Human Visible Navigations"" (HVN) to tackle this risk; we focus on the experiences you actually care about when talking about the speed of our sites: - Human: We exclude noise coming from bots and synthetic measurements. - Visible: We remove any partial or fully hidden experiences. These tend to be very slow but users don’t see this slowness. - Navigations: We ignore lightning fast back-forward navigations which usually have few optimisation opportunities. Adopting Human Visible Navigations provides you with these key benefits: - Fewer changes staying below the radar - Fewer data fluctuations - Fewer blindspots when finding bottlenecks - Better correlation with business metrics This is supported by plenty of real world examples coming from the world's largest scale modeling site (6M Monthly visits) in combination with aggregated data from the brand new rumarchive.com (open source) After attending this session; your P99 and other percentiles will become less noisy and easier to tune!

Running a Go App in Kubernetes: CPU Impacts

ScyllaDB

Always-on Profiling of All Linux Threads, On-CPU and Off-CPU, with eBPF & Con...

ScyllaDB

In this session, Tanel introduces a new open source eBPF tool for efficiently sampling both on-CPU events and off-CPU events for every thread (task) in the OS. Linux standard performance tools (like perf) allow you to easily profile on-CPU threads doing work, but if we want to include the off-CPU timing and reasons for the full picture, things get complicated. Combining eBPF task state arrays with periodic sampling for profiling allows us to get both a system-level overview of where threads spend their time, even when blocked and sleeping, and allow us to drill down into individual thread level, to understand why.

Performance Budgets for the Real World by Tammy Everts

ScyllaDB

Performance budgets have been around for more than ten years. Over those years, we’ve learned a lot about what works, what doesn’t, and what we need to improve. In this session, Tammy revisits old assumptions about performance budgets and offers some new best practices. Topics include: • Understanding performance budgets vs. performance goals • Aligning budgets with user experience • Pros and cons of Core Web Vitals • How to stay on top of your budgets to fight regressions

Using Libtracecmd to Analyze Your Latency and Performance Troubles

ScyllaDB

Trying to figure out why your application is responding late can be difficult, especially if it is because of interference from the operating system. This talk will briefly go over how to write a C program that can analyze what in the Linux system is interfering with your application. It will use trace-cmd to enable kernel trace events as well as tracing lock functions, and it will then go over a quick tutorial on how to use libtracecmd to read the created trace.dat file to uncover what is the cause of interference to you application.

Reducing P99 Latencies with Generational ZGC

ScyllaDB

With the low-latency garbage collector ZGC, GC pause times are no longer a big problem in Java. With sub-millisecond pause times there are instead other things in the GC and JVM that can cause application threads to experience unexpected latencies. This talk will dig into a specific use where the GC pauses are no longer the cause of unexpected latencies and look at how adding generations to ZGC help lower the p99 application latencies.

5 Hours to 7.7 Seconds: How Database Tricks Sped up Rust Linting Over 2000X

ScyllaDB

Linters are a type of database! They are a collection of lint rules — queries that look for rule violations to report — plus a way to execute those queries over a source code dataset. This is a case study about using database ideas to build a linter that looks for breaking changes in Rust library APIs. Maintainability and performance are key: new Rust releases tend to have mutually-incompatible ways of representing API information, and we cannot afford to reimplement and optimize dozens of rules for each Rust version separately. Fortunately, databases don't require rewriting queries when the underlying storage format or query plan changes! This allows us to ship massive optimizations and support multiple Rust versions without making any changes to the queries that describe lint rules. Ship now, optimize later"" can be a sustainable development practice after all — join us to see how!

How Netflix Builds High Performance Applications at Global Scale

ScyllaDB

Conquering Load Balancing: Experiences from ScyllaDB Drivers

ScyllaDB

Load balancing seems simple on the surface, with algorithms like round-robin, but the real world loves throwing curveballs. Join me in this session as we delve into the intricacies of load balancing within ScyllaDB Drivers. Discover firsthand experiences from our journey in driver development, where we employed the Power of Two Choices algorithm, optimized the implementation of load balancing in Rust Driver, mitigated cloud costs through zone-aware load balancing and combated the issue of overloading a particular core of ScyllaDB. Be prepared to delve into the practical and theoretical aspects of load balancing, gaining valuable insights along the way.

Interaction Latency: Square's User-Centric Mobile Performance Metric

ScyllaDB

Mobile performance metrics often take inspiration from the backend world and measure resource usage (CPU usage, memory usage, etc) and workload durations (how long a piece of code takes to run). However, mobile apps are used by humans and the app performance directly impacts their experience, so we should primarily track user-centric mobile performance metrics. Following the lead of tech giants, the mobile industry at large is now adopting the tracking of app launch time and smoothness (jank during motion). At Square, our customers spend most of their time in the app long after it's launched, and they don't scroll much, so app launch time and smoothness aren't critical metrics. What should we track instead? This talk will introduce you to Interaction Latency, a user-centric mobile performance metric inspired from the Web Vital metric Interaction to Next Paint"" (web.dev/inp). We'll go over why apps need to track this, how to properly implement its tracking (it's tricky!), how to aggregate this metric and what thresholds you should target.

How to Avoid Learning the Linux-Kernel Memory Model

ScyllaDB

The Linux-kernel memory model (LKMM) is a powerful tool for developing highly concurrent Linux-kernel code, but it also has a steep learning curve. Wouldn't it be great to get most of LKMM's benefits without the learning curve? This talk will describe how to do exactly that by using the standard Linux-kernel APIs (locking, reference counting, RCU) along with a simple rules of thumb, thus gaining most of LKMM's power with less learning. And the full LKMM is always there when you need it!

99.99% of Your Traces are Trash by Paige Cruz

ScyllaDB

Distributed tracing is still finding its footing in many organizations today, one challenge to overcome is the data volume - keeping 100% of your traces is expensive and unnecessary. Enter sampling - head vs tail how do you decide? Let’s look at the design of Sifter and get familiar with why tail-based sampling is the way to enact a cost-effective tracing solution while actually increasing the system’s observability.

Square's Lessons Learned from Implementing a Key-Value Store with Raft

ScyllaDB

To put it simply, Raft is used to make a use case (e.g., key-value store, indexing system) more fault tolerant to increase availability using replication (despite server and network failures). Raft has been gaining ground due to its simplicity without sacrificing consistency and performance. Although we'll cover Raft's building blocks, this is not about the Raft algorithm; it is more about the micro-lessons one can learn from building fault-tolerant, strongly consistent distributed systems using Raft. Things like majority agreement rule (quorum), write-ahead log, split votes & randomness to reduce contention, heartbeats, split-brain syndrome, snapshots & logs replay, client requests dedupe & idempotency, consistency guarantees (linearizability), leases & stale reads, batching & streaming, parallelizing persisting & broadcasting, version control, and more! And believe it or not, you might be using some of these techniques without even realizing it! This is inspired by Raft paper (raft.github.io), publications & courses on Raft, and an attempt to implement a key-value store using Raft as a side project.

Making Python 100x Faster with Less Than 100 Lines of Rust

ScyllaDB

A Deep Dive Into Concurrent React by Matheus Albuquerque

ScyllaDB

The Latency Stack: Discovering Surprising Sources of Latency

ScyllaDB

Usually, when an API call is slow, developers blame ourselves and our code. We held a lock too long, or used a blocking operation, or built an inefficient query. But often, the simple picture of latency as “the time a server takes to process a message” hides a great deal of end-to-end complexity. Debugging tail latencies requires unpacking the abstractions that we normally ignore: virtualization, hidden queues, and network behavior. In this talk, I’ll describe how developers can diagnose more sources of delay and failure by building a more realistic and broad understanding of networked services. I’ll give some real-world cases when high end-to-end latency or elevated failure rates occurred due to factors we ordinarily might not even measure. Some examples include TCP SYN retransmission; virtualization on the client; and surprising behavior from AWS load balancers. Unfortunately, many measurement techniques don’t cover anything but the portion most directly under developer control. But developers can do better by comparing multiple measurements, applying Little’s law, investing in eBPF probes, and paying attention to the network layer. Understanding API performance to find and fix issues faster ultimately means understanding the entire stack: the client, your code, and the underlying infrastructure.

More from ScyllaDB (20)

Unconventional Methods to Identify Bottlenecks in Low-Latency and High-Throug...

Mitigating the Impact of State Management in Cloud Stream Processing Systems

Measuring the Impact of Network Latency at Twitter

Architecting a High-Performance (Open Source) Distributed Message Queuing Sys...

Noise Canceling RUM by Tim Vereecke, Akamai

Running a Go App in Kubernetes: CPU Impacts

Always-on Profiling of All Linux Threads, On-CPU and Off-CPU, with eBPF & Con...

Performance Budgets for the Real World by Tammy Everts

Using Libtracecmd to Analyze Your Latency and Performance Troubles

Reducing P99 Latencies with Generational ZGC

5 Hours to 7.7 Seconds: How Database Tricks Sped up Rust Linting Over 2000X

How Netflix Builds High Performance Applications at Global Scale

Conquering Load Balancing: Experiences from ScyllaDB Drivers

Interaction Latency: Square's User-Centric Mobile Performance Metric

How to Avoid Learning the Linux-Kernel Memory Model

99.99% of Your Traces are Trash by Paige Cruz

Square's Lessons Learned from Implementing a Key-Value Store with Raft

Making Python 100x Faster with Less Than 100 Lines of Rust

A Deep Dive Into Concurrent React by Matheus Albuquerque

The Latency Stack: Discovering Surprising Sources of Latency

Recently uploaded

Shivam Pandit working on Php Web Developer.

shivamt017

WhatsApp Tracker - Tracking WhatsApp to Boost Online Safety.pdf

onemonitarsoftware

Attendance Tracking From Paper To Digital

Task Tracker

一比一原版英国牛津大学毕业证（oxon毕业证书）如何办理

avufu

原版一模一样【微信：741003700 】【英国牛津大学毕业证（oxon毕业证书）成绩单】【微信：741003700 】学位证，留信学历认证（真实可查，永久存档）原件一模一样纸张工艺/offer、在读证明、外壳等材料/诚信可靠,可直接看成品样本，帮您解决无法毕业带来的各种难题！外壳，原版制作，诚信可靠，可直接看成品样本。行业标杆！精益求精，诚心合作，真诚制作！多年品质 ,按需精细制作，24小时接单,全套进口原装设备。十五年致力于帮助留学生解决难题，包您满意。本公司拥有海外各大学样板无数，能完美还原。 1:1完美还原海外各大学毕业材料上的工艺：水印，阴影底纹，钢印LOGO烫金烫银，LOGO烫金烫银复合重叠。文字图案浮雕、激光镭射、紫外荧光、温感、复印防伪等防伪工艺。材料咨询办理、认证咨询办理请加学历顾问Q/微741003700 【主营项目】一.毕业证【q微741003700】成绩单、使馆认证、教育部认证、雅思托福成绩单、学生卡等！二.真实使馆公证(即留学回国人员证明,不成功不��费) 三.真实教育部学历学位认证（教育部存档！教育部留服网站永久可查）四.办理各国各大学文凭(一对一专业服务,可全程监控跟踪进度) 如果您处于以下几种情况： ◇在校期间，因各种原因未能顺利毕业……拿不到官方毕业证【q/微741003700】 ◇面对父母的压力，希望尽快拿到； ◇不清楚认证流程以及材料该如何准备； ◇回国时间很长，忘记办理； ◇回国马上就要找工作，办给用人单位看； ◇企事业单位必须要求办理的 ◇需要报考公务员、购买免税车、落转户口 ◇申请留学生创业基金留信网认证的作用: 1:该专业认证可证明留学生真实身份 2:同时对留学生所学专业登记给予评定 3:国家专业人才认证中心颁发入库证书 4:这个认证书并且可以归档倒地方 5:凡事获得留信网入网的信息将会逐步更新到个人身份内，将在公安局网内查询个人身份证信息后，同步读取人才网入库信息 6:个人职称评审加20分 7:个人信誉贷款加10分 8:在国家人才网主办的国家网络招聘大会中纳入资料，供国家高端企业选择人才办理英国牛津大学毕业证（oxon毕业证书）【微信：741003700 】外观非常简单，由纸质材料制成，上面印有校徽、校名、毕业生姓名、专业等信息。办理英国牛津大学毕业证（oxon毕业证书）【微信：741003700 】格式相对统一，各专业都有相应的模板。通常包括以下部分：校徽：象征着学校的荣誉和传承。校名:学校英文全称授予学位：本部分将注明获得的具体学位名称。毕业生姓名：这是最重要的信息之一，标志着该证书是由特定人员获得的。颁发日期：这是毕业正式生效的时间，也代表着毕业生学业的结束。其他信息：根据不同的专业和学位，可能会有一些特定的信息或章节。办理英国牛津大学毕业证（oxon毕业证书）【微信：741003700 】价值很高，需要妥善保管。一般来说，应放置在安全、干燥、防潮的地方，避免长时间暴露在阳光下。如需使用，最好使用复印件而不是原件，以免丢失。综上所述，办理英国牛津大学毕业证（oxon毕业证书）【微信：741003700 】是证明身份和学历的高价值文件。外观简单庄重，格式统一，包括重要的个人信息和发布日期。对持有人来说，妥善保管是非常重要的。

MVP Mobile Application - Codearrest.pptx

Mitchell Marsh

An MVP (Minimum Viable Product) mobile application is a streamlined version of a mobile app that includes only the core features necessary to address the primary needs of its users. The purpose of an MVP is to validate the app concept with minimal resources, gather user feedback, and identify any areas for improvement before investing in a full-scale development. This approach allows businesses to quickly launch their app, test its market viability, and make data-driven decisions for future enhancements, ensuring a higher likelihood of success and user satisfaction.

Top 10 Tips To Get Google AdSense For Your Website

e-Definers Technology

Wired_2.0_Create_AmsterdamJUG_09072024.pptx

SimonedeGijt

In this talk, we will explore strategies to optimize the success rate of storing and retaining new information. We will discuss scientifically proven ideal learning intervals and content structures. Additionally, we will examine how to create an environment that improves our focus while you remain in the “flow”. Lastly we will also address the influence of AI on learning capabilities. In the dynamic field of software development, this knowledge will empower you to accelerate your learning curve and support others in their learning journeys.

Responsibilities of Fleet Managers and How TrackoBit Can Assist.pdf

Trackobit

dachnug51 - All you ever wanted to know about domino licensing.pdf

DNUG e.V.

Leading Project Management Tool Taskruop.pptx

taskroupseo

CViewSurvey Digitech Pvt Ltd that works on a proven C.A.A.G. model.

bhatinidhi2001

CViewSurvey is a SaaS-based Web & Mobile application that provides digital transformation to traditional paper surveys and feedback for customer & employee experience, field & market research that helps you evaluate your customer's as well as employee's loyalty. With our unique C.A.A.G. Collect, Analysis, Act & Grow approach; business & industry’s can create customized surveys on web, publish on app to collect unlimited response & review AI backed real-time data analytics on mobile & tablets anytime, anywhere. Data collected when offline is securely stored in the device, which syncs to the cloud server when connected to any network.

NBFC Software: Optimize Your Non-Banking Financial Company

NBFC Softwares

NBFC Software: Optimize Your Non-Banking Financial Company Enhance Your Financial Services with Comprehensive NBFC Software NBFC software provides a complete solution for non-banking financial companies, streamlining banking and accounting functions to reduce operational costs. Our software is designed to meet the diverse needs of NBFCs, including investment banks, insurance companies, and hedge funds. Key Features of NBFC Software: Centralized Database: Facilitates inter-branch collaboration and smooth operations with a unified platform. Automation: Simplifies loan lifecycle management and account maintenance, ensuring efficient delivery of financial services. Customization: Highly customizable to fit specific business needs, offering flexibility in managing various loan types such as home loans, mortgage loans, personal loans, and more. Security: Ensures safe and secure handling of financial transactions and sensitive data. User-Friendly Interface: Designed to be intuitive and easy to use, reducing the learning curve for employees. Cost-Effective: Reduces the need for additional manpower by automating tasks, making it a budget-friendly solution. Benefits of NBFC Software: Go Paperless: Transition to a fully digital operation, eliminating offline work. Transparency: Enables managers and executives to monitor various points of the banking process easily. Defaulter Tracking: Helps track loan defaulters, maintaining a healthy loan management system. Increased Accessibility: Cutting-edge technology increases the accessibility and usability of NBFC operations. Request a Demo Now!

AWS Cloud Practitioner Essentials (Second Edition) (Arabic) AWS Security .pdf

karim wahed

React vs Next js: Which is Better for Web Development? - Semiosis Software Pr...

Semiosis Software Private Limited

Software development... for all? (keynote at ICSOFT'2024)

miso_uam

Our world runs on software. It governs all major aspects of our life. It is an enabler for research and innovation, and is critical for business competitivity. Traditional software engineering techniques have achieved high effectiveness, but still may fall short on delivering software at the accelerated pace and with the increasing quality that future scenarios will require. To attack this issue, some software paradigms raise the automation of software development via higher levels of abstraction through domain-specific languages (e.g., in model-driven engineering) and empowering non-professional developers with the possibility to build their own software (e.g., in low-code development approaches). In a software-demanding world, this is an attractive possibility, and perhaps -- paraphrasing Andy Warhol -- "in the future, everyone will be a developer for 15 minutes". However, to make this possible, methods are required to tweak languages to their context of use (crucial given the diversity of backgrounds and purposes), and the assistance to developers throughout the development process (especially critical for non-professionals). In this keynote talk at ICSOFT'2024 I presented enabling techniques for this vision, supporting the creation of families of domain-specific languages, their adaptation to the usage context; and the augmentation of low-code environments with assistants and recommender systems to guide developers (professional or not) in the development process.

dachnug51 - Whats new in domino 14 .pdf

DNUG e.V.

Cultural Shifts: Embracing DevOps for Organizational Transformation

Mindfire Solution

Mindfire Solutions specializes in DevOps services, facilitating digital transformation through streamlined software development and operational efficiency. Their expertise enhances collaboration, accelerates delivery cycles, and ensures scalability using cloud-native technologies. Mindfire Solutions empowers businesses to innovate rapidly and maintain competitive advantage in dynamic market landscapes.

COMPSAC 2024 D&I Panel: Charting a Course for Equity: Strategies for Overcomi...

Hironori Washizaki

FAST Channels: Explosive Growth Forecast 2024-2027 (Buckle Up!)

Roshan Dwivedi

Independence Day Hasn’t Always Been a U.S. Holiday.pdf

Livetecs LLC

Recently uploaded (20)

Shivam Pandit working on Php Web Developer.

WhatsApp Tracker - Tracking WhatsApp to Boost Online Safety.pdf

Attendance Tracking From Paper To Digital

一比一原版英国牛津大学毕业证（oxon毕业证书）如何办理

MVP Mobile Application - Codearrest.pptx

Top 10 Tips To Get Google AdSense For Your Website

Wired_2.0_Create_AmsterdamJUG_09072024.pptx

Responsibilities of Fleet Managers and How TrackoBit Can Assist.pdf

dachnug51 - All you ever wanted to know about domino licensing.pdf

Leading Project Management Tool Taskruop.pptx

CViewSurvey Digitech Pvt Ltd that works on a proven C.A.A.G. model.

NBFC Software: Optimize Your Non-Banking Financial Company

AWS Cloud Practitioner Essentials (Second Edition) (Arabic) AWS Security .pdf

React vs Next js: Which is Better for Web Development? - Semiosis Software Pr...

Software development... for all? (keynote at ICSOFT'2024)

dachnug51 - Whats new in domino 14 .pdf

Cultural Shifts: Embracing DevOps for Organizational Transformation

COMPSAC 2024 D&I Panel: Charting a Course for Equity: Strategies for Overcomi...

FAST Channels: Explosive Growth Forecast 2024-2027 (Buckle Up!)

Independence Day Hasn’t Always Been a U.S. Holiday.pdf

Scylla Summit 2018: Keynote - 4 Years of Scylla

1. 4+ Years of Scylla Dor Laor CEO

2. Digital Transformation is <something>

10. 1000 BCSicily, Scylla and Charybdis

11. 9/2014OSv team meets Cassandra Cassandra summit 2014

12. 9/2015Cassandra summit 2015

13. 2015-2018

14. 3/2016 Scylla 1.0

15. 9/2016 First Scylla Summit

16. 3/2017Scylla Enterprise Release

17. 10/2017MongoDB went public

18. 3/2018Shard per Core cloned by competition Threads Shards

19. 9/2018Elastic went public

20. 11/2018 Scylla 3.0

21. Scylla 3.0 SStable format 3.0 Materialized Views Global Secondary Index

22. 12/2018 Cloud is here

30. Is competitive with ?

31. Cloud workload ▪ YCSB, prepared statements ▪ Workload A, 50%:50% read:update ▪ Requested SLA: 60k write ops, 60k read ops, < 10ms P95 ▪ 1TB dataset ▪ i3.8xlarge | 32 vCPU | 244 GiB RAM | 4 x 1.9TB NVMe ▪ 3-node cluster on single DC | RF=3

32. Not so fast..

33. Not so fast.. #1 We had to add 33% capacity and slow the ingestion

34. Cloud Uniform Workload ▪ YCSB, prepared statements

35. Cloud Uniform Workload ▪ YCSB, prepared statements

36. Cloud Zipfian Workload

37. Not so fast.. #2

38. Not so fast.. #3

39. The dress that broke the internet database

40. The dress that broke the internet database ’s BigTable

41. Simple Flow Chart

42. 12/2018 Service Level Agreement

44. “I've accomplished a lot, but I still have more dreams that I want to achieve.” - Joe Jonas

45. YOU PROUD OF CHALLENGED

46. YOU THE REST PROUD OF CHALLENGED

47. PROUD OF CHALLENGED

48. PROUD OF CHALLENGED

49. Scylla University is coming

50. PROUD OF CHALLENGED

51. PROUD OF CHALLENGED + 1 msec P99 + K/V special mode + Many other

52. PROUD OF CHALLENGED Our controllers!

53. PROUD OF CHALLENGED Our controllers!

54. PROUD OF CHALLENGED 131GB wide row

55. PROUD OF CHALLENGED 131GB wide row 131GB wide row

56. Spark series PROUD OF CHALLENGED

57. Spark series PROUD OF CHALLENGED

58. Linux Kernel work PROUD OF CHALLENGED

59. One Click Docker compose: Spark, Kafka, Scylla, Materialized View

60. PROUD OF CHALLENGED sctool repair --cluster mycluster -- dc dc-us-*, !dc-us-west

61. PROUD OF CHALLENGED sctool repair --cluster mycluster -- dc dc-us-*, !dc-us-west Improved repair

62. PROUD OF CHALLENGED Linear scale-up

63. PROUD OF CHALLENGED Linear scale-up Missing APIs Capture Data Change Lightweight Transactions Official RESTapi

64. PROUD OF

65. PROUD OF “Negative Churn”

66. What’s Next?

67. LWT Transient Replication Incremental Repair UDF Better Cassandra

68. LWT Transient Replication Incremental Repair UDF Better Cassandra VPC Multi DC Encryption IOPS model Dynamic Vnodes Tiered storage More protocols Better Cloud

69. LWT Transient Replication Incremental Repair UDF Better Cassandra VPC Multi DC Encryption IOPS model Dynamic Vnodes Tiered storage More protocols Better Cloud CDC Tiered Storage Columnar format Performance ++ Drivers Better Scylla

70. LWT Transient Replication Incremental Repair UDF Better Cassandra VPC Multi DC Encryption IOPS model Dynamic Vnodes Tiered storage More protocols Better Cloud CDC Tiered Storage Columnar format Performance ++ Drivers Better Scylla Full provisioning Integrated monitor Kubernetes operator Better Management

71. Thank You Please stay in touch dor@scylladb.com @dorlaor

Editor's Notes

Welcome customers, users, developers, partners and associates. I'm excited to open the 3rd annual Scylla summit. We have a packed agenda for you. Make sure to utilize industry use cases along with plenty of information about scylla. Beyond the sessions themselves, you are welcome to network with other users and with our staff, go ahead and exchange info in a peer to peer over beer!
No need to be a visionary to imagine digital transformation. It's here, scylla level. When I look up I can see it
Telluslabs tell us about agricultural and GPS insights provide valuable data from satellites.
Here on Earth, Natura leverages the rain forest with a tiny bit of scylla help.
We’re proud to help General Electric monitors power supplies around the world
Comcast Xfinity reaches plenty of home with a little help from our friends at Scylla
No big data event is complete without automotive, Nauto and future Faraday in automotive there are plenty more exciting usages which to be unlocked in the future
Getting here was quite a journey, let’s cover it
The early days of digital transformation - Not long ago scylla collected marine data to track ships in Sicily
Later the scylla team, then called cloudius, came across Cassandra and we tried to accelerate it with our os without success.
A year later was enough to launch a scylla beta at the Cassandra summit 2015. Boy, we were pretty far then from a full distributed database.
We had lots of fun in the following years.. on the treadmill of iterative improvement
Slowly but safely we iterated, with scylla 1.0
first annual summit of our own
Enterprise release,
The Industry around us continued to evolve with mongo ipo, our space get a great endorsement by wall street
friends who adopted tiny bit of our thread per core,
Elastic IPO is another positive progress and endorsement, many need full text search along the database and it may be a natural progress to us
We're proud to launch scylla 3,0 a Cassandra compatible release, as they say, our best release ever... Scylla 3 finally has x y z
The second big announcement is scylla cloud. Fully managed , self service cloud database. Currently in registration only
Improve repair speed, effect on latency, incremental repair
Improve repair speed, effect on latency, incremental repair
Improve repair speed, effect on latency, incremental repair
2 cloud provider issues Go through walls Beyond support, we’re there for you
Theme - drive cost down! Where is this going? Cassandra/Scylla - affordable data layer - What's our vision? Uncompromised engineering
Theme - drive cost down! Where is this going? Cassandra/Scylla - affordable data layer - What's our vision? Uncompromised engineering
Theme - drive cost down! Where is this going? Cassandra/Scylla - affordable data layer - What's our vision? Uncompromised engineering
Theme - drive cost down! Where is this going? Cassandra/Scylla - affordable data layer - What's our vision? Uncompromised engineering

Scylla Summit 2018: Keynote - 4 Years of Scylla

More Related Content

What's hot

What's hot (20)

Similar to Scylla Summit 2018: Keynote - 4 Years of Scylla

Similar to Scylla Summit 2018: Keynote - 4 Years of Scylla (20)

More from ScyllaDB

More from ScyllaDB (20)

Recently uploaded

Recently uploaded (20)

Scylla Summit 2018: Keynote - 4 Years of Scylla

Editor's Notes