This document discusses lessons learned from developing a plugin to add Hyper-V hypervisor support to CloudStack. Key lessons include using HTTPRequest to escape Java's limits, serializing JSON objects instead of porting Java classes, writing code with test-driven development, automating tasks with CloudMonkey, adapting existing plugins where possible, using QuickCloud instead of system VMs, and avoiding proprietary tools and libraries. The plugin extends CloudStack using plugins, includes a ServerResource for device access, and implements the hypervisor API via a remote or direct connect agent.
EWD 3 Training Course Part 34: QEWD Resilient Mode
This is part 34 of the EWD 3 Training Course. This presentation explains how you can add resilience to the message queue used by QEWD by making it save all incoming requests to your embedded Global Storage database. In Resilient Mode, QEWD also saves a copy of all responses sent to clients, so the stored activity information can be used as an audit trail.
EWD 3 Training Course Part 36: Accessing REST and Web Services from a QEWD ap...
This document describes how to create a REST proxy using QEWD. It involves:
1. Amending the backend restDemo.js module to extract the REST call logic into a separate function and define a 'proxy' handler function.
2. Setting the module to be a REST module.
3. Having the proxy handler function invoke the extracted REST call logic to proxy requests to the actual REST service.
4. Adding a route in the QEWD startup file to route the /api/proxy URL to the proxy handler function, exposing the REST service via the proxy.
This allows the module to act as a REST proxy to the external JSONPlaceholder service while still supporting normal interactive apps
This presentation explains the new functionality within QEWD that supports the use of JSON Web Tokens and which allows QEWD.js to provide a powerful yet simple-to-use MicroService architecture
Apache httpd v2.4 is well-suited for cloud environments due to improvements that increase performance, flexibility, and dynamic configuration capabilities. It has been enhanced as a reverse proxy with load balancing and support for additional protocols. Benchmark tests show that for transaction speed, the prefork MPM performs best, though other MPMs are on par for concurrency. Apache remains a robust and customizable web server option.
Routage à grande échelle des requêtes via RabbitMQ
The document describes the distributed queuing system used to process tasks in Instances' control plane. Messages from APIs are routed through RabbitMQ exchanges and bindings to Celery worker queues. This allows scaling components independently and processing tasks asynchronously. Key-value headers and routing rules ensure messages are routed to the correct queues and workers.
EWD 3 Training Course Part 43: Using JSON Web Tokens with QEWD REST Services
This is part 43 of the EWD 3 Training Course. In this presentation, you'll learn how to use JSON Web Tokens (JWTs) instead of server-side QEWD Sessions in your REST Services
This presentation is Part 16 of the EWD 3 Training Course. It describes and explains QEWD Services and shows you how to use them to create re-usable back-end message handlers.
EWD 3 Training Course Part 30: Modularising QEWD ApplicationsRob Tweed
This presentation is Part 30 of the EWD 3 Training Course. It explains the main techniques you can use for breaking a QEWD application into separate re-usable modules, allowing for easier maintenance and team development
The document discusses troubleshooting CloudStack. It covers troubleshooting for CloudStack developers and administrators. For developers, it discusses error codes, debugging tips, system virtual machine troubleshooting and port usage. For administrators, it discusses installation, configuration, log analysis, important parameters, best practices, reusing hypervisors and the CloudStack database. The document also provides references and information on getting involved in the CloudStack community.
EWD 3 Training Course Part 45: Using QEWD's Advanced MicroService FunctionalityRob Tweed
This document discusses advanced microservice functionality in QEWD, including templated routes, dynamic path-defined destinations, federated composite microservices, redirection of responses, and chained microservices. It provides an example of extending a previous login microservice example to demonstrate these features. Templated routes allow variable path components that are passed to handler functions. Security is improved by adding authentication against JSON web tokens in the beforeMicroserviceHandler function.
EWD 3 Training Course Part 34: QEWD Resilient ModeRob Tweed
This is part 34 of the EWD 3 Training Course. This presentation explains how you can add resilience to the message queue used by QEWD by making it save all incoming requests to your embedded Global Storage database. In Resilient Mode, QEWD also saves a copy of all responses sent to clients, so the stored activity information can be used as an audit trail.
EWD 3 Training Course Part 36: Accessing REST and Web Services from a QEWD ap...Rob Tweed
This document describes how to create a REST proxy using QEWD. It involves:
1. Amending the backend restDemo.js module to extract the REST call logic into a separate function and define a 'proxy' handler function.
2. Setting the module to be a REST module.
3. Having the proxy handler function invoke the extracted REST call logic to proxy requests to the actual REST service.
4. Adding a route in the QEWD startup file to route the /api/proxy URL to the proxy handler function, exposing the REST service via the proxy.
This allows the module to act as a REST proxy to the external JSONPlaceholder service while still supporting normal interactive apps
This presentation explains the new functionality within QEWD that supports the use of JSON Web Tokens and which allows QEWD.js to provide a powerful yet simple-to-use MicroService architecture
Apache httpd v2.4 is well-suited for cloud environments due to improvements that increase performance, flexibility, and dynamic configuration capabilities. It has been enhanced as a reverse proxy with load balancing and support for additional protocols. Benchmark tests show that for transaction speed, the prefork MPM performs best, though other MPMs are on par for concurrency. Apache remains a robust and customizable web server option.
Routage à grande échelle des requêtes via RabbitMQScaleway
The document describes the distributed queuing system used to process tasks in Instances' control plane. Messages from APIs are routed through RabbitMQ exchanges and bindings to Celery worker queues. This allows scaling components independently and processing tasks asynchronously. Key-value headers and routing rules ensure messages are routed to the correct queues and workers.
EWD 3 Training Course Part 43: Using JSON Web Tokens with QEWD REST ServicesRob Tweed
This is part 43 of the EWD 3 Training Course. In this presentation, you'll learn how to use JSON Web Tokens (JWTs) instead of server-side QEWD Sessions in your REST Services
EWD 3 Training Course Part 16: QEWD ServicesRob Tweed
This presentation is Part 16 of the EWD 3 Training Course. It describes and explains QEWD Services and shows you how to use them to create re-usable back-end message handlers.
This Edureka "Node.js Express tutorial" will help you to learn the Node.js express fundamentals with examples. Express.js is flexible and minimal node.js web application framework that provides robust set of features to develop mobile and web applications. It facilitates the rapid development of node.js applications. Below are the topics covered in this tutorial:
1) Why Express.js?
2) What is Express.js?
3) Express Installation
4) Express Routes
5) Express Middlewares
EWD 3 Training Course Part 19: The cache.node APIsRob Tweed
This presentation is Part 19 of the EWD 3 Training Course. It examines how to access a Global Storage database from JavaScript, by making use of the cache.node APIs
Spring Boot Revisited with KoFu and JaFuVMware Tanzu
This document summarizes a presentation on Spring Boot revisited with KoFu and JaFu. KoFu and JaFu are new flavors of Spring Boot that use functional programming approaches. KoFu uses Kotlin and functional bean registration, while JaFu uses Java and a lambda-based infrastructure. The presentation discusses the benefits of Kotlin and Java evolutions, an overview of Spring Fu which is an incubator for KoFu and JaFu, examples of applications written in each flavor, efficiency gains from using Kotlin and KoFu, the team working on the project, and a roadmap for upcoming features including native application support and automated transformation between configurations.
Continuous Delivery of Cloud Applications with Docker Containers and IBM BluemixFlorian Georg
This document discusses continuous delivery of cloud applications using Docker containers on IBM Bluemix. It provides an overview of benefits of continuous delivery such as increased stability. It then discusses why containers and cloud PaaS platforms are useful for application development. It also demonstrates how to use the IBM Container Service to build, deploy and manage containerized applications on Bluemix through features like private registries, container groups, public IP binding, storage and integration with Cloud Foundry services. The document includes code samples and discusses using a delivery pipeline with Bluemix DevOps services to enable continuous deployment through staging and production environments.
This was a quick (15 minutes!) tour of Cloud Foundry that I gave at JFokus 2012 introducing Cloud Foundry as the answer to the question, "I've got a working web application and Spring made it easy, but where do I host it?"
CloudStack Metering – Working with the Usage DataShapeBlue
Organisations looking to build and offer Cloud services on Apache CloudStack need to be able to either monetize their offerings and charge for usage or monitor and report on their Cloud's consumption.
Majority of such organisations already have existing billing or business support systems and do not require an integrated billing or reporting system, provided the usage data can be exported from CloudStack in a standard and structured format such as XML, JSON, or CSV.
Tariq Iqbal of ShapeBlue provides an overview of the Apache CloudStack Usage Metrics, Usage Server and the multitude of ways for accessing the Usage Data for billing and reporting purposes, including real world use cases of some of the integration projects he has worked on.
CloudStack Metering – Working with the Usage DataTariq Iqbal
Organisations looking to build and offer Cloud services on Apache CloudStack need to be able to either monetize their offerings and charge for usage or monitor and report on their Cloud's consumption.
Majority of such organisations already have existing billing or business support systems and do not require an integrated billing or reporting system, provided the usage data can be exported from CloudStack in a standard and structured format such as XML, JSON, or CSV.
Tariq Iqbal of ShapeBlue provides an overview of the Apache CloudStack Usage Metrics, Usage Server and the multitude of ways for accessing the Usage Data for billing and reporting purposes, including real world use cases of some of the integration projects he has worked on.
Apache CloudStack is open source software for building public, private and hybrid Infrastructure as a Service (IaaS) clouds. The source code is organized into directories that separate core functionality, APIs, plugins, compatibility layers and more. Key directories include Utils, Api, Core, Server, Plugins, Awsapi, Usage, Ui, Agent and Client. Additional information on CloudStack can be found on its website and Apache mailing lists.
This document discusses SQL injection and the sqlmap tool. It provides an overview of SQL injection, describes how sqlmap can be used to find and exploit SQL injection vulnerabilities, and demonstrates how it can be used to enumerate databases and files systems, and in some cases obtain remote access. It also discusses mitigation techniques like input sanitization and using prepared statements.
A performance optimization presentation for WordCamp Sacramento 2016. Presented by Austin Gil.
This presentation addresses issues in design, development, and project management, where performance is most greatly affected. We look at various opportunities and techniques within each stage that may offer more speed. The subjects range from beginner to advanced with tips and advice that just about anyone can walk away with, and we end with a collection of recommended tools.
This presentation was designed so the slides would be useful even out of context of the presentation. Please enjoy.
This document summarizes several Apache Java cloud projects: CloudStack, jclouds, and Whirr. It discusses how they work together and what each can do. CloudStack is an open source IaaS cloud platform. jclouds provides a common Java API to interact with multiple cloud providers. Whirr is a tool built on jclouds that allows deploying distributed systems on clouds. Specifically, Whirr can deploy Hadoop clusters on CloudStack using jclouds in an automated and cloud-agnostic way. The document demonstrates using Whirr to deploy a Cloudera Hadoop cluster managed by Cloudera Manager.
BlueHornet Consumer Views of Email Marketing 2013 BlueHornet
For two consecutive years, BlueHornet has surveyed over 1,000 consumers across the United States to better understand their behavior and sentiment around email marketing. This presentation details the results.
This document provides an overview of the Firebase mobile platform and its features for developing mobile applications. It discusses Firebase services for authentication, realtime database, storage, hosting, remote config, cloud messaging, crash reporting, testing, dynamic links, invites, advertising and analytics. It includes code examples for authentication, database reads and writes, and storage uploads and downloads. The document promotes Firebase as providing a compact team that can build scalable mobile apps with fast iteration while allowing developers to sleep at night through its backend services.
This document provides an overview and introduction to using the libcloud library for multi-cloud management. It discusses key concepts like providers, drivers, images, sizes and locations. It provides examples of how to connect to providers like EC2 and Rackspace, launch nodes, list existing nodes, and destroy nodes. Libcloud supports a common API across many cloud providers for tasks like compute management.
This document discusses how Firebase can be used to develop mobile applications. It introduces various Firebase services including Authentication, Realtime Database, Storage, Hosting, Remote Config, Cloud Messaging, Crash Reporting, Test Lab, Dynamic Links, Invites, App Indexing, AdMob, and Analytics. It provides code examples for implementing Authentication with email/password or Facebook login and interacting with the Realtime Database and Storage. The document emphasizes that Firebase allows developing mobile apps with a compact team and fast iteration by removing the need to set up and manage backend services.
Serverless Angular, Material, Firebase and Google Cloud applicationsLoiane Groner
Presented at DevFest Florida 2019 - January 19, Orlando, FL.
In this talk we'll learn how to use all the power of Google stack technologies (Angular, Material, Firebase and Google Cloud) to develop a full stack application. We'll learn how we can empower a serverless Angular + Material application with Firebase and reactive programming by using realtime database, Firestore, authentication (with different providers) and Firebase hosting. And we if need any other functionality, we can use Cloud Functions or a NodeJS app. This talk will demonstrate the overview of a real world application (40k users), along with CI configuration and some details of the code (the good parts!).
This webinar covered various DevOps topics using AWS services like CloudFormation, OpsWorks, CloudWatch, and WorkSpaces. CloudFormation allows defining infrastructure as code and bootstrapping instances. OpsWorks manages the application lifecycle. CloudWatch provides monitoring and logging. WorkSpaces enables provisioning cloud-based desktops for developers. Questions from attendees were taken using the webinar interface.
This document discusses using Docker to set up a quality assurance (QA) system for web applications. It proposes running each feature branch in its own Docker container to allow simultaneous QA of multiple branches. The solution is demonstrated using a sample Python/Flask app that counts page visits, with the visit counts stored in a Redis container. The document notes some limitations, like only running one container per branch, and proposes using Docker Compose to run multiple related containers together for a more realistic QA environment that can test full applications with APIs and databases. Future plans include more efficient resource sharing and integration with additional container platforms.
Service Worker allows web applications to work offline by intercepting network requests, caching responses, and serving cached responses when there is no network connection. It runs in the background and can handle events like fetch requests and push notifications. Key concepts include registering a service worker script, caching assets on install and user demand, and responding to fetch events by checking the cache first before making network requests. Common patterns are caching static resources on install, caching dynamic resources on each request, and migrating caches on activate. Service workers enable new capabilities like push notifications and progressive web apps.
Real World Lessons on the Pain Points of Node.JS ApplicationBen Hall
This document provides lessons learned from real world experiences with Node.js applications. It discusses the importance of upgrading to newer Node.js versions for security and features. It also emphasizes the importance of error handling, using promises for async flow control, and scaling applications using Docker containers. Debugging and monitoring Node.js applications for performance is also covered.
Burn down the silos! Helping dev and ops gel on high availability websitesLindsay Holmwood
HA websites are where the rubber meets the road - at 200km/h. Traditional separation of dev and ops just doesn't cut it.
Everything is related to everything. Code relies on performant and resilient infrastructure, but highly performant infrastructure will only get a poorly written application so far. Worse still, root cause analysis in HA sites will more often than not identify problems that don't clearly belong to either devs or ops.
The two options are collaborate or die.
This talk will introduce 3 core principles for improving collaboration between operations and development teams: consistency, repeatability, and visibility. These principles will be investigated with real world case studies and associated technologies audience members can start using now. In particular, there will be a focus on:
- fast provisioning of test environments with configuration management
- reliable and repeatable automated deployments
- application and infrastructure visibility with statistics collection, logging, and visualisation
AWS Lambda with Serverless Framework and JavaManish Pandit
Serverless is a node.js based framework that makes creating, deploying, and managing serverless functions a breeze. We will use AWS Lambda as our FaaS (Function-as-a-Service) provider, although Serverless supports IBM OpenWhisk and Microsoft Azure as well.
In this session, we will talk about Serverless Applications, and Create and deploy a java-maven based AWS Lambda API. We will also explore the command line interface to manage lambda, which is provided out of the box by serverless framework.
Continuous Delivery with Maven, Puppet and Tomcat - ApacheCon NA 2013Carlos Sanchez
Continuous Integration, with Apache Continuum or Jenkins, can be extended to fully manage deployments and production environments, running in Tomcat for instance, in a full Continuous Delivery cycle using infrastructure-as-code tools like Puppet, allowing to manage multiple servers and their configurations.
Puppet is an infrastructure-as-code tool that allows easy and automated provisioning of servers, defining the packages, configuration, services,... in code. Enabling DevOps culture, tools like Puppet help drive Agile development all the way to operations and systems administration, and along with continuous integration tools like Apache Continuum or Jenkins, it is a key piece to accomplish repeatability and continuous delivery, automating the operations side during development, QA or production, and enabling testing of systems configuration.
Traditionally a field for system administrators, Puppet can empower developers, allowing both to collaborate coding the infrastructure needed for their developments, whether it runs in hardware, virtual machines or cloud. Developers and sysadmins can define what JDK version must be installed, application server, version, configuration files, war and jar files,... and easily make changes that propagate across all nodes.
Using Vagrant, a command line automation layer for VirtualBox, they can also spin off virtual machines in their local box, easily from scratch with the same configuration as production servers, do development or testing and tear them down afterwards.
We will show how to install and manage Puppet nodes with JDK, multiple Tomcat instances with installed web applications, database, configuration files and all the supporting services. Including getting up and running with Vagrant and VirtualBox for quickstart and Puppet experiments, as well as setting up automated testing of the Puppet code.
This talk (delivered at QConLondon 2016) covers the evolution of Coursera's nearline architecture, delves into our latest generation system, and then covers the flagship application of the architecture (evaluating programming assignments).
Amazon has been using and building workflow services for years now. They use Simple Workflow (SWF) internally to lay down OS and all required software onto a new Amazon server before it joins Amazon fleet. Every Amazon server being put in service is provisioned in a workflow using SWF.
During this brown-bag session you will be taken through the example of real application which uses SWF.
This document discusses serverless architectures and provides examples of building serverless applications. It introduces serverless computing and explains why developers want to adopt serverless and DevOps approaches. Examples are given for static and dynamic websites built with serverless technologies like AWS Lambda, API Gateway, and S3 storage. The document also provides a case study of building a serverless application with services like Cognito, DynamoDB, and Lambda. Alternatives to AWS serverless options are mentioned along with takeaways about paying only for resources used.
This document discusses integrating test automation and code coverage for web service applications. It introduces Postman for calling web services and testing responses, and Jenkins for build automation and tracking test results over time. It then demonstrates setting up a test automation workflow using these tools on a sample Laravel application, including starting and stopping coverage collection, running tests from Postman and PHPUnit, and merging the results. Some best practices and philosophies around test automation and code coverage are also discussed.
The document contains answers to various questions about automated testing using Selenium WebDriver. It discusses topics like how to handle dynamic objects, the WebDriver interface, locating elements, performing keyboard and mouse actions, dropdown handling, getting text from the UI, dealing with dynamic dropdowns, verifying colors, checking which tab is enabled, clicking links, implicit vs explicit waits, checking if elements are enabled, handling windows and alerts, switching frames, using the Actions class for mouse and keyboard actions, autocomplete text boxes, proxy settings, file uploads, calendar popups, reading and writing to Excel, finding row counts in tables, TestNG annotations and advantages, and group execution in TestNG XML files.
Real World Lessons on the Pain Points of Node.js ApplicationsBen Hall
The document discusses several pain points experienced with Node.js applications and solutions for resolving them. It covers creating a strong foundation by upgrading to Node.js v5, locking down NPM dependencies, handling errors properly with try/catch blocks and promises, deploying applications using Docker for scaling, addressing security issues, and using tools like debug and profilers to improve performance.
Andrey Adamovich and Luciano Fiandesio - Groovy dev ops in the cloudDevConFu
The talk is focused on open-source Groovy/Java libraries that we have developed in order to solve our daily DevOps problems including SSH connectivity, cloud instance management, OS image management and integration testing of Puppet modules with the help of Groovy and Junit.
Integration testing is hard, and often teams are tempted to do it in production. Testcontainers allows writing meaningful integration tests spawning Docker containers for databases, queue systems, kv-store, other services. The talk, a blend of slides and live code, will show how we are able to deploy without fear while integrating with a dozen of different datastores. Don't mock your database with fake data anymore, work with real data
This document provides an agenda and overview of various Node.js concepts including the package manager NPM, web frameworks like Express, template engines like Jade and EJS, databases drivers for Redis and MongoDB, testing frameworks like Mocha and Nodeunit, avoiding callback hell using the async library, and debugging with Node Inspector. It discusses installing Node.js, creating HTTP servers, middleware, authentication, internationalization, and more.
Similar to How to add a new hypervisor to CloudStack - Lessons learned from Hyper-V effort (20)
CloudStack provides versatile authentication methods to ensure secure access and identity management. This talk explores key authentication mechanisms within CloudStack, including LDAP, SAML, OAuth2, API keys, etc. LDAP integration enables centralized user authentication, while SAML facilitates single sign-on (SSO) across various services. OAuth2 ensures secure authorization for third-party applications, and API keys offer programmatic access to resources. Additionally, CloudStack supports Two-Factor Authentication for an extra layer of security, enhancing user verification through multiple verification steps.
-----------------------------------------
The CloudStack India User Group 2024 took place in Hyderabad on 23rd February. The conference, arranged by a group of volunteers from the Apache CloudStack Community, saw multiple sessions held about the cloud orchestration platform and its latest advancements.
In this session, Kiran gives a talk about the rich ecosystem of tools (cmk, CAPC, Terraform, Ansible, Packer, csbench, mbx), that support Cloudstack.
Find out how the various tools work and how easy it is to integrate with Apache CloudStack.
This session provides a great way to speed up CloudStack adoption and improve performance by saving valuable time.
-----------------------------------------
The CloudStack India User Group 2024 took place in Hyderabad on 23rd February. The conference, arranged by a group of volunteers from the Apache CloudStack Community, saw multiple sessions held about the cloud orchestration platform and its latest advancements.
Elevating Cloud Infrastructure with Object Storage, DRS, VM Scheduling, and D...ShapeBlue
In this session, Vishesh Jindal and Jithin Raju give a demonstration on Apache CloudStack's 4.19 marquee features - Object Storage, DRS, VM schedule & DRaaS.
-----------------------------------------
The CloudStack India User Group 2024 took place in Hyderabad on 23rd February. The conference, arranged by a group of volunteers from the Apache CloudStack Community, saw multiple sessions held about the cloud orchestration platform and its latest advancements.
VM Migration from VMware to CloudStack and KVM – Suresh Anaparti, ShapeBlueShapeBlue
The support for migrating VMware instances, and importing KVM instances to a CloudStack-managed KVM environment has been added to CloudStack 4.19.
In this talk, Suresh provides the details about the import/migration process in CloudStack along with a demo, and discusses the future improvements.
-----------------------------------------
The CloudStack India User Group 2024 took place in Hyderabad on 23rd February. The conference, arranged by a group of volunteers from the Apache CloudStack Community, saw multiple sessions held about the cloud orchestration platform and its latest advancements.
How We Grew Up with CloudStack and its Journey – Dilip Singh, DataHubShapeBlue
In this session, Senior IT Manager at DataHub Nepal, Dilip Singh, shares how DataHub grew up with CloudStack and details the journey the company had with the cloud orchestration platform.
-----------------------------------------
The CloudStack India User Group 2024 took place in Hyderabad on 23rd February. The conference, arranged by a group of volunteers from the Apache CloudStack Community, saw multiple sessions held about the cloud orchestration platform and its latest advancements.
What’s New in CloudStack 4.19, Abhishek Kumar, Release Manager Apache CloudSt...ShapeBlue
This session gives a brief introduction to the new and exciting feature in the latest CloudStack LTS release, ie, 4.19.0. The discussion includes the details on the timeline of the CloudStack 4.19.0 release, overview of some of the marquee, new feature of the release – Object storage framework, KVM ingestion, Hypervisor agnostic simple DRS, CAPC aware CKS, OAuth2, DRaaS with Multi zone disaster recovery, etc and a summary of improvements added since the previous major LTS release of the CloudStack, ie, 4.18.0.
-----------------------------------------
The CloudStack India User Group 2024 took place in Hyderabad on 23rd February. The conference, arranged by a group of volunteers from the Apache CloudStack Community, saw multiple sessions held about the cloud orchestration platform and its latest advancements.
CloudStack 101: The Best Way to Build Your Private Cloud – Rohit Yadav, VP Ap...ShapeBlue
Apache CloudStack is an open-source software designed to deploy and manage large networks of virtual machines, as a highly available, highly scalable Infrastructure as a Service (IaaS) cloud computing platform. This talk gives an introduction to the technology, its architecture, its history and community.
-----------------------------------------
The CloudStack India User Group 2024 took place in Hyderabad on 23rd February. The conference, arranged by a group of volunteers from the Apache CloudStack Community, saw multiple sessions held about the cloud orchestration platform and its latest advancements.
How We Use CloudStack to Provide Managed Hosting - Swen Brüseke - proIOShapeBlue
Swen shows how proIO utilize Cloudstack to provide customers with managed hosting solutions and versatile public and private cloud solutions, mainly based on open-source software.
-----------------------------------------
The CloudStack Collaboration Conference 2023 took place on 23-24th November. The conference, arranged by a group of volunteers from the Apache CloudStack Community, took place in the voco hotel, in Porte de Clichy, Paris. It hosted over 350 attendees, with 47 speakers holding technical talks, user stories, new features and integrations presentations and more.
In cloud computing environments, VMs require fast access to resources like storage and networking. The hardware that the VMs access is implemented in software and/or by passing through a dedicated hardware device. Software-based solutions consume extra CPU cycles, thus resulting in poor performance. Also, these require to expose a device-model to the guest, thus increasing the attack surface. Conversely, hardware passthrough provides better performance and security but can be expensive in terms of the number of physical resources, since each device is dedicated to a single VM. This talk focuses on how Vates is working on sharing hardware resources among VMs by relying on dedicated processors named Data Processing Units (DPU). More precisely, Vates work on offloading Xen hypervisor of storage emulation by relying on Kalray K200 DPU PCIe controllers, a hardware accelerator based on MPPA architecture.
-----------------------------------------
The CloudStack Collaboration Conference 2023 took place on 23-24th November. The conference, arranged by a group of volunteers from the Apache CloudStack Community, took place in the voco hotel, in Porte de Clichy, Paris. It hosted over 350 attendees, with 47 speakers holding technical talks, user stories, new features and integrations presentations and more.
Zero to Cloud Hero: Crafting a Private Cloud from Scratch with XCP-ng, Xen Or...ShapeBlue
Dive into the seamless integration of the Vates stack as the foundation for your CloudStack deployment. In this workshop, you’ll witness the power and simplicity of XCP-ng and Xen Orchestra. From a blank slate to a fully operational private cloud, Olivier guides you through each pivotal step. Learn how to streamline your cloud setup process and unlock the potential of a private cloud infrastructure that’s both efficient and easy to manage. Watch to discover how to transform bare metal into a cloud powerhouse in mere minutes.
-----------------------------------------
The CloudStack Collaboration Conference 2023 took place on 23-24th November. The conference, arranged by a group of volunteers from the Apache CloudStack Community, took place in the voco hotel, in Porte de Clichy, Paris. It hosted over 350 attendees, with 47 speakers holding technical talks, user stories, new features and integrations presentations and more.
KVM Security Groups Under the Hood - Wido den Hollander - Your.OnlineShapeBlue
They are just a few clicks in the UI or a single API call, but how do security groups work at KVM hypervisor level? How do they filter traffic and what else do they do in addition to firewalling? What Anti-Spoofing policies are implemented by the security groups?
In this talk, Wido dives into the specifics of the security groups on the KVM hypervisor for both IPv4 and IPv6.
-----------------------------------------
The CloudStack Collaboration Conference 2023 took place on 23-24th November. The conference, arranged by a group of volunteers from the Apache CloudStack Community, took place in the voco hotel, in Porte de Clichy, Paris. It hosted over 350 attendees, with 47 speakers holding technical talks, user stories, new features and integrations presentations and more.
How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ...ShapeBlue
Wido den Hollander from Your.Online discusses how the company maximizes the lifespan of its hardware to reduce environmental impact. It uses Apache CloudStack to tag hosts by generation and direct workloads to the appropriate tier, allowing older hardware to still be utilized. Live migrations are enabled by configuring CPU profiles in KVM. Ceph storage clusters can also leverage refurbished hardware. Tracking metrics like kWh consumption of CloudStack deployments could provide further insight into environmental impact.
Use Existing Assets to Build a Powerful In-house Cloud Solution - Magali Perv...ShapeBlue
How to minimize the impact when it’s time to implement a cloud solution for automating internal workloads and delivering efficient solutions? Magali, Joffrey, and Grégoire present a case study of a successful hardware reuse project, including key metrics: Business objectives, Performance objectives and Financial objectives.
-----------------------------------------
The CloudStack Collaboration Conference 2023 took place on 23-24th November. The conference, arranged by a group of volunteers from the Apache CloudStack Community, took place in the voco hotel, in Porte de Clichy, Paris. It hosted over 350 attendees, with 47 speakers holding technical talks, user stories, new features and integrations presentations and more.
Import Export Virtual Machine for KVM Hypervisor - Ayush Pandey - University ...ShapeBlue
This document discusses importing and exporting unmanaged KVM instances in CloudStack. It begins with an introduction to unmanaged instances and the APIs added to support importing and exporting KVM instances. It provides an overview of the import and export flows and requirements. It also demonstrates importing and exporting unmanaged KVM instances through the CloudStack UI and CLI. Finally, it discusses future enhancements such as supporting additional hypervisors and batch operations.
DRaaS using Snapshot copy and destination selection (DRaaS) - Alexandre Matti...ShapeBlue
Apache CloudStack 4.19 introduces the capability for end-users to copy their root disk or volume snapshots to one (or more) ACS Zones without operator intervention. In this talk, Alex shows how this simple yet powerful new feature enables for end-users to control where their data resides and for operators to provide low-cost and robust DRaaS to their customers.
-----------------------------------------
The CloudStack Collaboration Conference 2023 took place on 23-24th November. The conference, arranged by a group of volunteers from the Apache CloudStack Community, took place in the voco hotel, in Porte de Clichy, Paris. It hosted over 350 attendees, with 47 speakers holding technical talks, user stories, new features and integrations presentations and more.
A discussion on the common failures when using CloudStack taking instance deployment as an example. The session includes 15 specific failure scenarios, their causes, and possible mitigation steps.
-----------------------------------------
The CloudStack Collaboration Conference 2023 took place on 23-24th November. The conference, arranged by a group of volunteers from the Apache CloudStack Community, took place in the voco hotel, in Porte de Clichy, Paris. It hosted over 350 attendees, with 47 speakers holding technical talks, user stories, new features and integrations presentations and more.
Elevating Privacy and Security in CloudStack - Boris Stoyanov - ShapeBlueShapeBlue
In an increasingly interconnected digital landscape, safeguarding data privacy and ensuring robust security measures are paramount. CloudStack offers a dynamic ecosystem for deploying and managing cloud resources. However, to fully harness its potential, it is crucial to address privacy and security concerns effectively.
This presentation explores the realm of possibilities and demonstrates how CloudStack can enhance the privacy and security of your cloud deployments. Boris examines practical approaches to protect sensitive data, fortify communications, and secure your infra against emerging threats. Join us on a journey to discover how CloudStack can be your trusted ally in the quest for a more secure and private cloud environment.
-----------------------------------------
The CloudStack Collaboration Conference 2023 took place on 23-24th November. The conference, arranged by a group of volunteers from the Apache CloudStack Community, took place in the voco hotel, in Porte de Clichy, Paris. It hosted over 350 attendees, with 47 speakers holding technical talks, user stories, new features and integrations presentations and more.
Transitioning from VMware vCloud to Apache CloudStack: A Path to Profitabilit...ShapeBlue
In this session, Marco explores the potential of migrating from VMware vCloud to Apache CloudStack with KVM. VMware vCloud Suite is a robust cloud infrastructure and management solution that combines vSphere and vRealize Suite, providing automation and operations capabilities for traditional and modern infrastructure and apps. However, the transition to Apache CloudStack can offer enhanced profitability and competitiveness.
Marco delves into the benefits of Apache CloudStack, including its cost-effectiveness and open-source nature, and discusses how a gradual migration from VMware vCloud can reduce ownership costs, increase profitability, and enhance competitiveness. He also covers the practical steps and considerations in planning and executing this transition effectively.
-----------------------------------------
The CloudStack Collaboration Conference 2023 took place on 23-24th November. The conference, arranged by a group of volunteers from the Apache CloudStack Community, took place in the voco hotel, in Porte de Clichy, Paris. It hosted over 350 attendees, with 47 speakers holding technical talks, user stories, new features and integrations presentations and more.
This document discusses hypervisor agnostic Distributed Resource Scheduler (DRS) in CloudStack 4.19. It describes DRS as a feature that rebalances virtual machines across a cluster to assist with power savings while building on existing live migration capabilities. Two main DRS algorithms are covered - Balanced, which balances load across hosts, and Condensed, which reduces the number of active hosts. Implementation details and how to configure DRS for a cluster are also outlined. The document concludes with an offer to demonstrate DRS and take any questions.
What’s New in CloudStack 4.19 - Abhishek Kumar - ShapeBlueShapeBlue
This session gives a brief introduction of the new and exciting feature in the latest (upcoming) CloudStack LTS release, ie, 4.19.0. The discussion includes the details on the timeline of the CloudStack 4.19.0 release, overview of some of the marquee, new feature of the release – Object storage framework, KVM ingestion, Hypervisor agnostic simple DRS, CAPC aware CKS, OAuth2, DRaaS with Multi zone disaster recovery, etc and a summary of improvements added since the previous major LTS release of the CloudStack, ie, 4.18.0.
-----------------------------------------
The CloudStack Collaboration Conference 2023 took place on 23-24th November. The conference, arranged by a group of volunteers from the Apache CloudStack Community, took place in the voco hotel, in Porte de Clichy, Paris. It hosted over 350 attendees, with 47 speakers holding technical talks, user stories, new features and integrations presentations and more.
Quality Patents: Patents That Stand the Test of TimeAurora Consulting
Is your patent a vanity piece of paper for your office wall? Or is it a reliable, defendable, assertable, property right? The difference is often quality.
Is your patent simply a transactional cost and a large pile of legal bills for your startup? Or is it a leverageable asset worthy of attracting precious investment dollars, worth its cost in multiples of valuation? The difference is often quality.
Is your patent application only good enough to get through the examination process? Or has it been crafted to stand the tests of time and varied audiences if you later need to assert that document against an infringer, find yourself litigating with it in an Article 3 Court at the hands of a judge and jury, God forbid, end up having to defend its validity at the PTAB, or even needing to use it to block pirated imports at the International Trade Commission? The difference is often quality.
Quality will be our focus for a good chunk of the remainder of this season. What goes into a quality patent, and where possible, how do you get it without breaking the bank?
** Episode Overview **
In this first episode of our quality series, Kristen Hansen and the panel discuss:
⦿ What do we mean when we say patent quality?
⦿ Why is patent quality important?
⦿ How to balance quality and budget
⦿ The importance of searching, continuations, and draftsperson domain expertise
⦿ Very practical tips, tricks, examples, and Kristen’s Musts for drafting quality applications
https://www.aurorapatents.com/patently-strategic-podcast.html
Measuring the Impact of Network Latency at TwitterScyllaDB
Widya Salim and Victor Ma will outline the causal impact analysis, framework, and key learnings used to quantify the impact of reducing Twitter's network latency.
An invited talk given by Mark Billinghurst on Research Directions for Cross Reality Interfaces. This was given on July 2nd 2024 as part of the 2024 Summer School on Cross Reality in Hagenberg, Austria (July 1st - 7th)
Coordinate Systems in FME 101 - Webinar SlidesSafe Software
If you’ve ever had to analyze a map or GPS data, chances are you’ve encountered and even worked with coordinate systems. As historical data continually updates through GPS, understanding coordinate systems is increasingly crucial. However, not everyone knows why they exist or how to effectively use them for data-driven insights.
During this webinar, you’ll learn exactly what coordinate systems are and how you can use FME to maintain and transform your data’s coordinate systems in an easy-to-digest way, accurately representing the geographical space that it exists within. During this webinar, you will have the chance to:
- Enhance Your Understanding: Gain a clear overview of what coordinate systems are and their value
- Learn Practical Applications: Why we need datams and projections, plus units between coordinate systems
- Maximize with FME: Understand how FME handles coordinate systems, including a brief summary of the 3 main reprojectors
- Custom Coordinate Systems: Learn how to work with FME and coordinate systems beyond what is natively supported
- Look Ahead: Gain insights into where FME is headed with coordinate systems in the future
Don’t miss the opportunity to improve the value you receive from your coordinate system data, ultimately allowing you to streamline your data analysis and maximize your time. See you there!
Quantum Communications Q&A with Gemini LLM. These are based on Shannon's Noisy channel Theorem and offers how the classical theory applies to the quantum world.
Transcript: Details of description part II: Describing images in practice - T...BookNet Canada
This presentation explores the practical application of image description techniques. Familiar guidelines will be demonstrated in practice, and descriptions will be developed “live”! If you have learned a lot about the theory of image description techniques but want to feel more confident putting them into practice, this is the presentation for you. There will be useful, actionable information for everyone, whether you are working with authors, colleagues, alone, or leveraging AI as a collaborator.
Link to presentation recording and slides: https://bnctechforum.ca/sessions/details-of-description-part-ii-describing-images-in-practice/
Presented by BookNet Canada on June 25, 2024, with support from the Department of Canadian Heritage.
The DealBook is our annual overview of the Ukrainian tech investment industry. This edition comprehensively covers the full year 2023 and the first deals of 2024.
INDIAN AIR FORCE FIGHTER PLANES LIST.pdfjackson110191
These fighter aircraft have uses outside of traditional combat situations. They are essential in defending India's territorial integrity, averting dangers, and delivering aid to those in need during natural calamities. Additionally, the IAF improves its interoperability and fortifies international military alliances by working together and conducting joint exercises with other air forces.
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...Bert Blevins
Today’s digitally connected world presents a wide range of security challenges for enterprises. Insider security threats are particularly noteworthy because they have the potential to cause significant harm. Unlike external threats, insider risks originate from within the company, making them more subtle and challenging to identify. This blog aims to provide a comprehensive understanding of insider security threats, including their types, examples, effects, and mitigation techniques.
Blockchain technology is transforming industries and reshaping the way we conduct business, manage data, and secure transactions. Whether you're new to blockchain or looking to deepen your knowledge, our guidebook, "Blockchain for Dummies", is your ultimate resource.
Kief Morris rethinks the infrastructure code delivery lifecycle, advocating for a shift towards composable infrastructure systems. We should shift to designing around deployable components rather than code modules, use more useful levels of abstraction, and drive design and deployment from applications rather than bottom-up, monolithic architecture and delivery.
7 Most Powerful Solar Storms in the History of Earth.pdfEnterprise Wired
Solar Storms (Geo Magnetic Storms) are the motion of accelerated charged particles in the solar environment with high velocities due to the coronal mass ejection (CME).
How RPA Help in the Transportation and Logistics Industry.pptxSynapseIndia
Revolutionize your transportation processes with our cutting-edge RPA software. Automate repetitive tasks, reduce costs, and enhance efficiency in the logistics sector with our advanced solutions.
論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...Toru Tamaki
Jindong Gu, Zhen Han, Shuo Chen, Ahmad Beirami, Bailan He, Gengyuan Zhang, Ruotong Liao, Yao Qin, Volker Tresp, Philip Torr "A Systematic Survey of Prompt Engineering on Vision-Language Foundation Models" arXiv2023
https://arxiv.org/abs/2307.12980
Comparison Table of DiskWarrior Alternatives.pdfAndrey Yasko
To help you choose the best DiskWarrior alternative, we've compiled a comparison table summarizing the features, pros, cons, and pricing of six alternatives.
How to add a new hypervisor to CloudStack - Lessons learned from Hyper-V effort
1. How to add a new hypervisor to
CloudStack:
Lessons learned from Hyper-V
effort
Donal Lafferty
Friday, 15 November 2013
2. Summary
• Extend CloudStack with Plug-ins
• Include ServerResource for device access
• Lessons:
•
•
•
•
•
•
•
HTTPRequest lets you escape Java
Serialise JSON objects, not ported Java classes
TDD: write you code against tests
Automate with CloudMonkey
Adapt existing plug-ins
QuickCloud instead of System VMs
Plan to avoid proprietary tools & libs
3. Background: Extend CloudStack with
Plug-ins
• Java centric
• Plug-ins are distributed
(e.g. cloud-plugin-hypervisor-hyperv-4.3.0.jar)
(e.g. Discoverer)
• .jar
• Modules are loaded
• Spring config + class loader
• Extensions implement
• .class file implementing
interface
(e.g. Compute)
4. Background: ServerResource for Device
Access
• ServerResource
• Steps around Javas limits
Discoverer Module
Extension: Discoverer
- Brings resource under CloudStack control
• Two Agent types
• implemented directly by
the ServerResource
• E.g. XAPI calls
• running remotely,
connected to mgmt server
• E.g. KVM Agent
ServerResource
- Provides a communication layer in the form of an Agent
Connected Agent
Direct Connect Agent
CloudStack Message Bus
Device-specific
Connection
Remote CloudStack Agent
Extensible API
5. Problem: Create Plug-in for Hyper-V
Support
• VM lifecycle
• Avoid intermediaries
• CIFS for primary & secondary storage
• Analogous to NFS
• Hyper-V is SMB centric
• Advanced networking (ideally)
• Esp. VLANs for tenant isolation
• Console access (ideally)
6. Solution: Remote agent
Phase 1 – Connected Agent
Hyper-V API
(Python)
Server Resource
(Java)
Message Bus Agent
(Java - NIO)
AgentShell
(Windows Service)
Mgmt Server
(AgentManager)
Custom
TCP/JSON
7. Lesson: HTTPRequest lets you escape Java
Phase 2 – Direct Connect Agent
Hyper-V API
(WMI)
Server Resource
(C# - ASP.NET MVC4)
Web Server
(C# - not IIS)
AgentShell
(C# - Windows Service)
Mgmt Server
(Direct Connect Agent)
JSON over
HTTP
10. Lesson: Automate with CloudMonkey
cloudmonkey api createZone networktype="Advanced" securitygroupenabled="false" guestcidraddress="10.1.1.0/24“
name="HybridZone" localstorageenabled="true" dns1="4.4.4.4" internaldns1="10.70.176.118“
internaldns2="10.70.160.66"
…
apirequest=cloudmonkey api addSecondaryStorage zoneid=$zone
url="cifs://10.70.176.4/secondary?user=administrator&password=1pass%40word1"
cacheid=echo $apiresult | sed -e s/^.*"id": //; s/,.*$//
…
apiresult=cloudmonkey api addHost zoneid=$zone podid=$pod url="http://10.70.176.4" password="1pass@word1“
username="root" hypervisor="Hyperv" clusterid=$cluster
hostid=echo $apiresult | sed -e s/^.*"id": //; s/,.*$//
…
apiresult=cloudmonkey api listNetworkOfferings name="QuickCloudNoServices"
qcNetOffId=echo $apiresult | sed -e s/^.*"id": //; s/,.*$//
cloudmonkey api createNetwork zoneid=$zone networkofferingid=$qcNetOffId physicalnetworkid=$physnetid
name="QuickCloudNetName" displaytext="QuickCloudNetDesc" vlan=untagged acltype=domain gateway="10.70.176.1"
netmask="255.255.240.0" startip="10.70.176.124" endip="10.70.176.144"
11. Lesson: Adapt existing plug-ins
• Add CIFS support to NFS plug-in
• Similar workflow
• Mount, use local file system operations
• Can be specified in similar format
• cifs://192.168.1.128/CSHV3?user=root+password=1pass%40word1
• nfs://192.168.1.128/CSHV3
• Avoid scope creep…
“While you’re at Ikea for some towels, could you pick me up a couch?”
– unnamed flatmate
12. Lesson: QuickCloud instead of System
VMs
• System VMs
Virtual
Router VM
CloudStack
Mgmt Server
Console VM
• VM application
• Offload cloud services
• 3 kinds
• Hypervisor specific
• Esp boot args!
• QuickCloud alternative:
Secondary
Storage VM
• Daemon for Secondary Storage
Service
• QuickCloudNoServices network
• No console VM
13. Lesson: Plan to avoid proprietary tools &
libs
• Provide opensource build
• Mono
• Donation process takes time
• Proposal
• Vote
• Post source on Review Board
• SGA
14. Summary
• Extend CloudStack with Plug-ins
• Include ServerResource for device access
• Lessons:
•
•
•
•
•
•
•
HTTPRequest lets you escape Java
Serialise JSON objects, not ported Java classes
TDD: write your code against tests
Automate with CloudMonkey
Adapt existing plug-ins
QuickCloud instead of System VMs
Plan to avoid proprietary tools & libs