Karan Singh

Data analysis solutions are changing rapidly, shifting from relatively static and rigid analytics clusters
toward more dynamic and scalable environments. Software-defined data services are a big part of
this transition, allowing on-demand provisioning of clusters for analytics and data processing, sharing
of data sets between these clusters, and independent and granular scaling of compute and storage
resources. Working closely together IBM, Red Hat, and Intel engineers designed… Show more

Data analysis solutions are changing rapidly, shifting from relatively static and rigid analytics clusters
toward more dynamic and scalable environments. Software-defined data services are a big part of
this transition, allowing on-demand provisioning of clusters for analytics and data processing, sharing
of data sets between these clusters, and independent and granular scaling of compute and storage
resources. Working closely together IBM, Red Hat, and Intel engineers designed an optimised reference architecture and performed extensive testing in a lab environment. This document describes the test cluster reference architecture in detail along with the performance results achieved in the testing. Show less

The growing embrace of hybrid cloud environments is placing increased focus on cloud-native
storage. Developers and data scientists need to architect and deploy container-native storage
rapidly and per their organization’s governance needs. They need the ability to launch their dataintensive apps and machine learning (ML) pipelines where it makes sense within the hybrid cloud,
with a fundamental assumption of consistent data storage services. Those services must be inherently reliable… Show more

The growing embrace of hybrid cloud environments is placing increased focus on cloud-native
storage. Developers and data scientists need to architect and deploy container-native storage
rapidly and per their organization’s governance needs. They need the ability to launch their dataintensive apps and machine learning (ML) pipelines where it makes sense within the hybrid cloud,
with a fundamental assumption of consistent data storage services. Those services must be inherently reliable and able to scale both in capacity and performance independent of the applications
they support. Red Hat® OpenShift® Container Storage now offers solution architects multiple deployment
options to suit their specific needs. Show less

Cloud-native app developers and data scientists need their data-intensive apps and machine learning (ML) pipelines to work the same wherever they are on the hybrid cloud, without variability in
storage services capabilities, resilience, or performance at scale. Red Hat® OpenShift® Container
Platform coupled with Red Hat OpenShift Container Storage provides these workloads with a consistent, container-based operating environment across the hybrid cloud.

With these challenges in mind, Red Hat recently engaged Evaluator Group to test the scale and per-
performance of a system designed to store over 10 billion objects running on Red Hat® Ceph® Storage.

Scaling to 10 billion objects is a monumental undertaking that requires highly capable hardware,
a balanced configuration, and a software environment that can scale and recover from failure
without placing arbitrary limitations on performance. The tested configuration included Intel… Show more

With these challenges in mind, Red Hat recently engaged Evaluator Group to test the scale and per-
performance of a system designed to store over 10 billion objects running on Red Hat® Ceph® Storage.

Scaling to 10 billion objects is a monumental undertaking that requires highly capable hardware,
a balanced configuration, and a software environment that can scale and recover from failure
without placing arbitrary limitations on performance. The tested configuration included Intel and
Seagate technology: Show less

As organizations embrace containers and Kubernetes orchestration for critical applications, Red Hat®
OpenShift® Container Platform services must be made highly available, implying a significant role
for the storage that supports them. Red Hat OpenShift Container Platform cluster logging requires
persistent storage for reliable operation. Back-end storage for logging services must also be resilient
and highly available to protect against infrastructure failures without data loss.

Organizations are increasingly being tasked with managing billions of files and tens to hundreds of petabytes of data. Object storage is well suited to these challenges, both in the public cloud and on-premise. Organizations need to understand how to best configure and deploy software, hardware, and network components to serve a diverse range of data intensive workloads.

This blog series details how to build robust object storage infrastructure using a combination of Red Hat Ceph… Show more

Organizations are increasingly being tasked with managing billions of files and tens to hundreds of petabytes of data. Object storage is well suited to these challenges, both in the public cloud and on-premise. Organizations need to understand how to best configure and deploy software, hardware, and network components to serve a diverse range of data intensive workloads.

This blog series details how to build robust object storage infrastructure using a combination of Red Hat Ceph Storage coupled with Dell EMC storage servers and networking. Both large-object and small-object synthetic workloads were applied to the test system and the results subjected to performance analysis. Testing also evaluated the ability of the system under test to scale beyond a billion objects. Show less

Ceph is a unified distributed storage system designed for reliability and scalability. This technology has been transforming the software-defined storage industry and is evolving rapidly as a leader with its wide range of support for popular cloud platforms such as OpenStack, and CloudStack, and also for virtualized platforms. Ceph is backed by Red Hat and has been developed by community of developers which has gained immense traction in recent years.

This book will guide you right from… Show more

Ceph is a unified distributed storage system designed for reliability and scalability. This technology has been transforming the software-defined storage industry and is evolving rapidly as a leader with its wide range of support for popular cloud platforms such as OpenStack, and CloudStack, and also for virtualized platforms. Ceph is backed by Red Hat and has been developed by community of developers which has gained immense traction in recent years.

This book will guide you right from the basics of Ceph , such as creating blocks, object storage, and filesystem access, to advanced concepts such as cloud integration solutions. The book will also cover practical and easy to implement recipes on CephFS, RGW, and RBD with respect to the major stable release of Ceph Jewel. Towards the end of the book, recipes based on troubleshooting and best practices will help you get to grips with managing Ceph storage in a production environment. Show less

Learning Ceph, Second Edition will give you all the skills you need to plan, deploy, and effectively manage your Ceph cluster. You will begin with the first module, where you will be introduced to Ceph use cases, its architecture, and core projects. In the next module, you will learn to set up a test cluster, using Ceph clusters and hardware selection. After you have learned to use Ceph clusters, the next module will teach you how to monitor cluster health, improve performance, and troubleshoot… Show more

Learning Ceph, Second Edition will give you all the skills you need to plan, deploy, and effectively manage your Ceph cluster. You will begin with the first module, where you will be introduced to Ceph use cases, its architecture, and core projects. In the next module, you will learn to set up a test cluster, using Ceph clusters and hardware selection. After you have learned to use Ceph clusters, the next module will teach you how to monitor cluster health, improve performance, and troubleshoot any issues that arise. In the last module, you will learn to integrate Ceph with other tools such as OpenStack, Glance, Manila, Swift, and Cinder.

By the end of the book you will have learned to use Ceph effectively for your data storage requirements. Show less

This publication is a reference architecture/performance and sizing guide describing Red Hat Ceph Storage coupled with QCT (Quanta Cloud Technology) storage servers and networking as object storage infrastructure. Testing, tuning, and performance are described for both large-object and small-object workloads. This guide also presents the results of the tests conducted to evaluate the ability of configurations to scale to host hundreds of millions of objects.

After hundreds of hours of… Show more

This publication is a reference architecture/performance and sizing guide describing Red Hat Ceph Storage coupled with QCT (Quanta Cloud Technology) storage servers and networking as object storage infrastructure. Testing, tuning, and performance are described for both large-object and small-object workloads. This guide also presents the results of the tests conducted to evaluate the ability of configurations to scale to host hundreds of millions of objects.

After hundreds of hours of [Test ⇒ Tune ⇒ Repeat] exercises, this reference architecture provides empirical answers to a range of performance questions surrounding Ceph object storage Show less

This book takes you from a basic knowledge of Ceph to an expert understanding of the most advanced features, walking you through building up a production-grade Ceph storage cluster and helping you develop all the skills you need to plan, deploy, and effectively manage your Ceph cluster. Beginning with the basics, you’ll create a Ceph cluster, followed by block, object, and file storage provisioning. Next, you’ll get a step-by-step tutorial on integrating it with OpenStack and building a… Show more

This book takes you from a basic knowledge of Ceph to an expert understanding of the most advanced features, walking you through building up a production-grade Ceph storage cluster and helping you develop all the skills you need to plan, deploy, and effectively manage your Ceph cluster. Beginning with the basics, you’ll create a Ceph cluster, followed by block, object, and file storage provisioning. Next, you’ll get a step-by-step tutorial on integrating it with OpenStack and building a Dropbox-like object storage solution. We’ll also take a look at federated architecture and CephFS, and you’ll dive into Calamari and VSM for monitoring the Ceph environment. You’ll develop expert knowledge on troubleshooting and benchmarking your Ceph storage cluster. Finally, you’ll get to grips with the best practices to operate Ceph in a production environment. Show less

I have contributed my best work to this white paper that comes out of a Proof-of-Concept of Eternus CD10000 system which is Ceph based storage solution from Fujitsu.
This white paper will help you to understand how Ceph-based FUJITSU Storage ETERNUS CD10000 is better than traditional RAID-based storage systems in OpenStack cloud environments

This book will give you all the skills you need to plan, deploy, and effectively manage your Ceph cluster, guiding you through Ceph’s technology overview, architecture, and components. With a step-by-step tutorial-style explanation of the deployment of each Ceph component, the book will take you through Ceph storage provisioning and integration with Openstack. This book will also focus on monitoring, troubleshooting, and benchmarking your Ceph storage cluster.

Beginning with an… Show more

This book will give you all the skills you need to plan, deploy, and effectively manage your Ceph cluster, guiding you through Ceph’s technology overview, architecture, and components. With a step-by-step tutorial-style explanation of the deployment of each Ceph component, the book will take you through Ceph storage provisioning and integration with Openstack. This book will also focus on monitoring, troubleshooting, and benchmarking your Ceph storage cluster.

Beginning with an introduction to Ceph, you will then discover how to deploy and set up your Ceph cluster, discovering the differing components and why we need them. We will then discuss the architecture of the technology and how to plan and organise your own cluster. This leads on deploying your own cluster, and what provisioning and options you have and need to make. The latter part of the book develops your skills further, focusing on integration with OpenStack and performance testing. This book takes you from a basic level of knowledge in Ceph to an expert in its most advanced features. Show less