How Netflix Directs 1/3rd of Internet Traffic

This document summarizes Haitao Wang's experience working on streaming platforms at Alibaba and Microsoft. It describes Alibaba's data infrastructure challenges in handling large volumes of streaming data. It introduces Alibaba Blink, a distribution of Apache Flink that was developed to meet Alibaba's scale needs. Blink has achieved unprecedented throughput of 472 million events per second with latency of 10s of milliseconds. The document outlines improvements made in Blink's runtime, declarative SQL support, and use cases at Alibaba including real-time A/B testing, search index building, and online machine learning.

ApacheCon Las Vegas 2019 September 9-12 Beam Summit 20th anniversary of the Apache Software Foundation

18 aug2021 Continuous SQL with Apache Streaming (FLaNK and FLiP) https://emamo.com/event/worldfestival-2021/s/pro-talk-continuous-sql-with-flink-WR115a In this talk, I will walk through how someone can set up and run continuous SQL queries against Pulsar topics utilizing Apache Flink. We will walk through creating Pulsar topics, schemas and publishing data. We will then cover consuming Pulsar data, joining Pulsar topics and inserting new events into Pulsar topics as they arrive. This basic overview will show hands-on techniques, tips and examples of how to do this using Pulsar tools. https://github.com/tspannhw/FLiP-IoT https://github.com/tspannhw/SpeakerProfile/tree/main/2021/talks

This presentation was given to the engineering organization at Zendesk. In this presentation, I talk about the challenges that the Netflix API faces in supporting the 1000+ different device types, millions of users, and billions of transactions. The topics range from resiliency, scale, API design, failure injection, continuous delivery, and more.

New Features in Confluent Platform 6.0 / Apache Kafka 2.6, including REST Proxy and API, Tiered Storage for AWS S3 and GCP GCS, Cluster Linking (On-Premise, Edge, Hybrid, Multi-Cloud), Self-Balancing Clusters), ksqlDB.

This document discusses developing an advanced visualization tool for Flink and Spark jobs that provides insight into data characteristics and the physical execution plan. It aims to help developers detect issues, understand distributed systems, and guide testing of adaptive partitioning techniques. The tool enhances existing metrics and APIs to visualize input/output patterns and physical tasks/subtasks. Future plans include public beta release and integrating dynamic repartitioning to mitigate data skew.

http://flink-forward.org/kb_sessions/faster-and-furiouser-flink-drift/ Not long ago, we had the opportunity to test Apache Flink to see just how fast it would go on a moderately realistic task with fast hardware and with a good streaming transport layer underneath. Our goal was not so much careful comparison with other software, but flat-out speed, Flink against Flink. In the process, we learned a lot about what it takes to go fast. Some of the lessons were ones that we had “learned” a number of times before: – the bottleneck isn’t where you thought it was – copying data is expensive – context switches are expensive – measure twice, cut once But there were some real surprises along the way. The really important knobs weren’t quite what people say you should turn. One of the biggest surprises was the degree to which high performance libraries have threading built into them which makes the actual concurrrency much higher than the apparent concurrency. The result was that at least one cluster parameter needed to be adjusted by 30x to get real

In the era of cloud generation, the constant activity around workloads and containers create more vulnerabilities than an organization can keep up with. Using legacy security vendors doesn't set you up for success in the cloud. You’re likely spending undue hours chasing, triaging and patching a countless stream of cloud vulnerabilities with little prioritization. Join us for this live webinar as we detail how to streamline host and container vulnerability workflows for your software teams wanting to build fast in the cloud. We'll be covering how to: Get visibility into active packages and associated vulnerabilities Reduce false positives by 98% Reduce investigation time by 30% Spot a legacy vendor looking to do some cloud washing

Is your service architecture and engineering velocity constrained by organizational concerns? Does it seem impossible to give priority to key initiatives regardless of intent? Are engineers switching tasks so often that they are just treading water? Are critical projects endlessly backlogged? Has staffing up pushed the limits of your team structure? Navigating through challenges like these can be daunting and solutions fraught with uncertainty. How do you know what, where, when to change. And whatever the answer is today it will most certainly vary over time. Effective organizations evolve, at key inflection points, to support critical business and technical goals. There is not only a strong relationship between organizations and the software they produce (Conway’s Law) but many organizational solutions can be derived from analogs in the technical realm. In other words, we can treat organizational improvement as a refactoring exercise. Over the last 20 years Netflix engineering has proven time and again an ability to adapt and grow, resulting in undisputed dominance over the global internet tv market. In this talk we’ll use Netflix as a case study to illustrate how specific strategies, framed as technical analogs, have been employed to maximize engineering agility, velocity, and impact. These powerful, yet simple strategies and solutions provide a useful blueprint for organizational success.

The Netflix API has undergone a transformation since its inception in 2008. It has transitioned from being a public API with a generic RESTful interface to a platform for creating highly optimized, device-centric APIs that are critical to delivering the Netflix streaming experience on over 1000 different device types. This talk covers the design principles that shaped the transformation of the API as well as the technology that powers it, enabling rapid user experience iteration and bringing Netflix streaming to almost 38 million subscribers around the world.

Serverless (also known as function-as-a-service) is fast emerging as an effective architecture for event-driven applications. Apache OpenWhisk is one of the more popular open-source cloud serverless platforms, and has first-class support for Kafka as a source of events. Come to this session for an introduction to building microservices without servers using OpenWhisk. Ill describe the challenges to building applications using serverless stacks, and the serverless design patterns to help you get started. Ill give a demonstration of how you can use Kafka Connect to invoke serverless actions, and how serverless can be an effective way to host event-processing logic.

The document discusses moving a Java server application to the cloud by deploying it on Artifactory SaaS. It describes some benefits of using Artifactory SaaS such as not needing to maintain servers and always having the latest version. It also notes a limitation is not being able to deploy custom plugins. The document then explores different multi-tenancy strategies and their tradeoffs for hosting multiple tenants on Artifactory SaaS.

This is a presentation that I gave to ESPN's Digital Media team about the trajectory of the Netflix API. I also discussed Netflix's device implementation strategy and how it enables rapid development and robust A/B testing.

Part 1. Why Kafka for Digital Native Business? Part 2. 고객과의 대화 - Bagelcode’s Success Story Part 3. Scenario 기반 Demo

Apache Kafka is a widely used open-source platform for building real-time data pipelines and streaming applications. It addresses limitations of using databases to handle high volumes of event data by providing a distributed, scalable, and fault-tolerant event streaming platform. Major companies like Royal Bank of Canada and Carnival Cruise Line rely on Kafka's capabilities for applications like fraud detection, digital marketing, and building event-driven systems.

Velocity Conference 2011 presentation by New Relic CEO Lew Cirne. - New Relic’s multitenant, SaaS web application monitoring service collects and persists over 90,000 metrics every second on a sustained basis, while still delivering an average page load time of 1.5 seconds. In this presentation Lew Cirne discusses how good architecture and good tools can help you handle an extremely large amount of data while still providing extremely fast service. He shows you how we scale to support customer growth, how we monitor our system, and what traps to look out for.

At many high-growth companies, staying at the bleeding edge of innovation and maintaining the highest level of service availability often sideline financial efficiency. This problem is exacerbated in a micro-service environment, where decentralized engineering teams can spin up thousands of instances at a moment’s notice, with no governing body tracking cost. By developing a cost-conscious culture and assigning the responsibility for efficiency to the appropriate business owners, you can deliver innovation efficiently and cost effectively . At Netflix, the Finance and Operations Engineering teams bear the responsibility for ensuring that the rate of innovation is fast and that development is cost effective. In this presentation, we’ll explore the building blocks of AWS cost management and discuss Netflix’s best practices.

Linguist's Software has created font sets for over 2,600 languages that could enable billions of people currently without internet access to get online. The main barrier for most of the unconnected world is a lack of content in their native languages. Linguist's Software's fonts and keyboard software could provide the missing language pieces and allow mobile carriers, tech companies, and others to connect the majority of the remaining global population to the internet for the first time by offering services in their native tongues. Partnering with Linguist's Software would give companies a fast track to achieving global dominance by accessing currently untapped markets.

In the future, technology will work together and make decisions for us, though it may not truly understand humans. Currently, technology can have negative effects like distracting and isolating people. However, if designed well with a focus on empathy, emotional intelligence, and human well-being, technology could have positive impacts like strengthening relationships and empowering personal growth. Creating technology with emotional sensitivity, transparency, and a wellness model may lead to a more human future.

Roope Mokka's presentation on Internet of NO things in technology conference Slush 15. Announcing the release of the foresight report "Gardens and Street" that looks into the social and economic tensions of the post IoT-world. http://nakedapproach.demoshelsinki.fi/2015/11/12/the-internet-of-things-is-not-about-technology-its-about-society/

We Are Social's comprehensive new Digital in 2016 report presents internet, social media, and mobile usage statistics and trends from all over the world. It contains more than 500 infographics, including global data snapshots, regional overviews, and in-depth profiles of the digital landscapes in 30 of the world's key economies. For a more insightful analysis of the numbers contained in this report, please visit http://bit.ly/DSM2016ES.

The council of Europe recently approved and published strong net neutrality guidelines following a meeting in Strasbourg.

This document provides an executive summary for Netflix's 2011 campaign. The campaign aims to increase sales and brand awareness through advertising. Some key points: - Netflix offers the largest selection of DVDs for rental as well as low-cost streaming options. - The campaign goals are to reach more of their target audience and increase customer numbers. - Suggestions are made to improve internet, TV, and unconventional advertising (QR codes on candy). - The goal is to spread awareness of Netflix's services and influence more people to subscribe.

A ten year look back and view into the future of the Personal Loans industry. Why did the Banks pull back at the same time that Lending Club and Prosper emerged? Why haven't the Banks come back? What's next?

Ever wondered how IoT will change the world? In this detailed infographic we discuss the impact IoT will have on different parts of peoples lives.

These are the slides to my talk "Smart Citizens - Populating Smart Cities" given on 19 October 2015 at the IoT Shifts conference in Barcelona.

The document discusses Internet of Things (IoT) and how it is enabling smart cities. It describes technologies that enable IoT like cheap sensors, bandwidth, processing power, and wireless coverage. It discusses the history and challenges of IoT. It outlines how IoT can be used across various sectors and environments like transportation, infrastructure, manufacturing, agriculture and more. It discusses how IoT can provide benefits like improved efficiency, reduced costs, and new revenue streams for cities. Finally, it discusses how citizen engagement and mobile applications can help build smart cities and provide solutions using IoT.

It's a complete marketing plan with background and history, situation analysis, marketing strategies and implementation

A personal take on some of the key data points and takeaways from the Digital News Report 2015 produced by the Reuters Institute for the Study of Journalism at Oxford University. For more information please visit: http://www.digitalnewsreport.org/

This document discusses leadership skills and strategies for being an effective leader beyond campus. It defines leadership as the ability to influence others with or without authority. Key points include: - Leadership requires awareness of oneself and others, the ability to communicate and resolve conflicts, and a commitment to influencing others. - Effective leaders have attributes like vision, passion, integrity, honesty, and the ability to build trust and take risks. - The document distinguishes leadership skills, which are soft skills like communication and motivation, from management skills which are hard skills like scheduling and staffing. - Tips for being a leader include taking responsibility, conveying a positive attitude, giving credit to others, and empowering team members

In this update of his past presentations on Mobile Eating the World -- delivered most recently at The Guardian's Changing Media Summit -- a16z’s Benedict Evans takes us through how technology is universal through mobile. How mobile is not a subset of the internet anymore. And how mobile (and accompanying trends of cloud and AI) is also driving new productivity tools. In fact, mobile -- which encompasses everything from drones to cars -- is everything.

Netflix is the world's leading internet television network. In this presentation, I talk about the aspects of Netflix culture that have contributed to its success. The freedom and responsibility culture, with highly aligned, loosely coupled teams of amazing, enthusiastic, helpful, high performance people with excellent judgement has helped build Netflix to adapt and change quickly, and iterate to make the best service possible. By eliminating rules and processes, and ensuring that employees have the contexts of the business in all aspects, Netflix has enabled employees to use their judgement to get things done rather than relying on control or process. This has resulted in Netflix becoming a leader in not only internet streaming, but also cloud computing, media, and culture. Because of the Netflix culture, we have been able to attract and retain great employees. I give a few examples from my team, Edge Engineering of how the culture enables us to build the high scale, resilient and dynamic services that are the front door to the Netflix streaming application, and how the freedom we have has enabled us to open source core technologies that are needed for large scale, service-oriented architectures in a cloud environment. This slideshow also gives a high level overview of how the streaming service works, and how Netflix's Open Connect Appliance can help ISPs.

TEDx Manchester talk on artificial intelligence (AI) and how the ascent of AI and robotics impacts our future work environments. The video of the talk is now also available here: https://youtu.be/dRw4d2Si8LA

Thinking about your sales team's goals for 2017? Drift's VP of Sales shares 3 things you can do to improve conversion rates and drive more revenue. Read the full story on the Drift blog here: http://blog.drift.com/sales-team-tips

An immersive workshop at General Assembly, SF. I typically teach this workshop at General Assembly, San Francisco. To see a list of my upcoming classes, visit https://generalassemb.ly/instructors/seth-familian/4813 I also teach this workshop as a private lunch-and-learn or half-day immersive session for corporate clients. To learn more about pricing and availability, please contact me at http://familian1.com

Hand drawn presentation updating my work on Data Gravity, thoughts on IoT and relevance to building a Time Series Database.

The document discusses various web application attacks like cross-site scripting, SQL injection, cross-site request forgery, sensitive data exposure, and cookie editing. For each attack, it provides information on threat agents, attack vectors, security weaknesses, impacts, prevalence, detectability, example exploits, and steps to prevent the attack. The overall document serves as an educational guide on common web hacking techniques and how to avoid falling victim to them.

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/2h3bAvP. Haley Tucker discusses how other systems may affect Netflix' services, strategies to protect their systems and make sure they won't fail even if things go wrong. Filmed at qconsf.com. Haley Tucker works on the Playback Features team at Netflix, responsible for ensuring that customers receive the best possible viewing experience every time they click play. Her services fill a key role in enabling Netflix to stream amazing content to 65M+ members on 1000+ devices.

At Comcast, our team has been architecting a customer experience platform which is able to react to near-real-time events and interactions and deliver appropriate and timely communications to customers. By combining the low latency capabilities of Apache Flink and the dataflow capabilities of Apache NiFi we are able to process events at high volume to trigger, enrich, filter, and act/communicate to enhance customer experiences. Apache Flink and Apache NiFi complement each other with their strengths in event streaming and correlation, state management, command-and-control, parallelism, development methodology, and interoperability with surrounding technologies. We will trace our journey from starting with Apache NiFi over three years ago and our more recent introduction of Apache Flink into our platform stack to handle more complex scenarios. In this presentation we will compare and contrast which business and technical use cases are best suited to which platform and explore different ways to integrate the two platforms into a single solution.

The document is a slide presentation about serverless JavaScript. It discusses what serverless architecture is, how it uses functions-as-a-service (FaaS) like AWS Lambda along with routing/API services like API Gateway. It provides examples of building serverless backends with Ember and GraphQL. Benefits discussed include reduced operations overhead and automatic scaling, though lock-in is noted as a downside. Testing serverless applications is also addressed.

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/2wgtbXC. Andrew Hart talks about the architectural, operational, and cultural aspects of evolving a microservice architecture, in the process highlighting both the opportunities and the challenges that microservice architectures present. Filmed at qconnewyork.com. Andrew Hart is the Platform Director for SeatGeek Open, SeatGeek’s primary ticketing solution. A member of the Apache Software Foundation, he was previously CTO of Pogoseat and a software Engineer at NASA. He has had work published in a variety of academic journals and has a long-standing passion for connecting people with data in meaningful ways to enable better decision making.

Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2oA2uI5. Susheel Aroskar talks about Zuul Push, a scalable push notification service that handles millions of "always-on" persistent connections from all the Netflix apps running. He covers the design of the Zuul Push server and reviews the design details of the back-end message routing infrastructure that lets any Netflix microservice push notifications to any connected client. Filmed at qconnewyork.com. Susheel Aroskar works as a software engineer on the Cloud Gateway team at Netflix, which develops and operates Zuul, an API gateway that fronts all of the Netflix cloud traffic and handles more than 100 billion requests/day. Prior to Zuul, he worked on Netflix CDN's control plane in the cloud, which is responsible for steering more than a third of all North American peak evening internet traffic.

David Rosen, Sony VP of Business Development's presentation to the Storage & Archive track at the Media & Entertainment Cloud Symposium on Nov 4, 2016

In this meetup, Kobi Salant - Data Platform Technical Lead & Vladi Feigin - Data System Architect, both from Liveperson will talk about : Making scale a non-issue for real-time Data apps. Have you ever tried to build a system processing in real-time hundreds of thousands events per second and servicing more than 1M concurrent visitors? We're going to talk about the LivePerson real-time stream processing solution doing exactly that. Learn how we empower digital call centers with insights for their critical decision making processes and never-ending efficiency goals.

The document discusses Netflix's approach to handling big data problems. It summarizes Netflix's data pipeline system called Keystone that was built in a year to replace a legacy system. Keystone ingests over 1 trillion events per day and processes them using technologies like Kafka, Samza and Spark Streaming. The document emphasizes Netflix's culture of freedom and responsibility and how it helped the small team replace the legacy system without disruption while achieving massive scale.

Matt Heath from Monzo discusses how they built their banking systems using Go. Some key points include: - Go is well-suited for building microservices due to its lightweight concurrency model with goroutines and channels. - Monzo started with a monolithic application but has transitioned to over 40 microservices as the business has grown. - They use service meshes like Typhon and Linkerd to handle concerns like load balancing, retries, and tracing across services. - Event-driven architectures with message queues help make the system reliable and decoupled. - Context propagation is used to pass request context through distributed calls.

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/2a6wCn2. Emily Reinhold shares stories of how a rapid growth company broke up a monolith into a series of microservices, with practices and lessons that can save time and money. Filmed at qconnewyork.com. Emily Reinhold is a software engineer on Uber's Money team. Since joining Uber in early 2015, Emily has been involved in many aspects of money, including charging riders and paying driver partners. She has recently contributed to the effort to dismantle Uber's monolith while building its microservice architecture.

The document outlines the agenda for the CloudStack European User Group meeting on June 16, 2016. The agenda includes presentations on CloudStack news, networking, SAP system provisioning using CloudStack, containers as a service on CloudStack, and a networking session in the pub. It also discusses the goals of the user group in providing a collaborative space to discuss CloudStack and related technologies through technical talks and case studies.

Learn how broadcast media workflows with Elemental Cloud can provide ingest of heterogeneous video sources, fault tolerance across multiple Availability Zones, time synchronization of video streams, and sustained peak workloads in 24/7 applications.

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/1RJcfss. Juan Batiz-Benet makes a short intro of IPFS (the InterPlanetary File System), a new hypermedia distribution protocol, addressed by content and identities. He also discusses the IPLD data model and example data structures (unixfs, keychain, post). Filmed at qconsf.com. Juan Batiz-Benet is an Independent Scientist.

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/2lXj8Ub. Armon Dadgar talks about HashiCorp Research, its long tradition of basing their tools and products on academic research, how they incorporate research, and what has been particularly useful for them. Filmed at qconnewyork.com. Armon Dadgar is currently the CTO of HashiCorp, where he brings distributed systems into the world of DevOps tooling. He has worked on Terraform, Consul, and Serf at HashiCorp, and maintains the Statsite and Bloomd OSS projects as well.

Real time stock processing with apache nifi, apache flink and apache kafka with Kafka Connect apps, SMM, NiFi Registry, Scheam Registry, Kafka topics, Flink SQL, NiFi

This document provides an overview of the Senior Software Engineer role for Playback Data Systems at Netflix. Playback Data Systems captures and summarizes playback sessions to curate and serve large-scale time series data including viewing history and bookmarks. The team's goals for 2020 include prototyping a strategic architecture to support 2025 scaling needs, reimagining aggregated views of viewing history data, and streamlining session processing. The technology stack includes Cassandra, Kafka, and services built with Node.js. Interested candidates are encouraged to contact the engineering manager for more information.

Across the globe, 75M Netflix members love watching 125M hours per day of TV shows and movies. They love the ease of starting on one device and resuming on another, and the Playback Data Systems team makes that happen. We’re looking for a senior engineering manager to lead this high-impact team at Netflix. Attributions for images: https://www.flickr.com/photos/theholyllama/5738164504/ and https://www.flickr.com/photos/brewbooks/7780990192/, no changes made, https://creativecommons.org/licenses/by-sa/2.0/ https://www.flickr.com/photos/crschmidt/2956721498/, no changes made, https://creativecommons.org/licenses/by/2.0/

Pivotal Korea가 주최한 2018 Cloud Native Day in Seoul의 발표자료 입니다 - 발표자 정윤진 Principal Technologist - Netflix MSA and Pivotal

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/1SbjUWM. Aviran Mordo talks about how microservices and DevOps go hand in hand, and what it takes to operate and build a successful microservices architecture from development to production. Filmed at qconlondon.com. Aviran Mordo is the head of back-end engineering at Wix. He has over 20 years of experience in the software industry and has filled many engineering roles and leading positions, from designing and building the US national Electronic Records Archives prototype to building search engine infrastructures.

Timothy Spann will give a presentation on the new features of Apache NiFi. He will walk through building flows using the latest processors, techniques, and tips in NiFi. He will change some data flows to utilize the newest NiFi version features. The audience can ask questions about any NiFi 1.23 or 2.0 features they want to see. Some of the new processors include GenerateRecord, GetAsanaObject, and AWS ML service processors. NiFi 2.0 will include improvements like Python integration, parameters, and JSON flow serialization.

Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/39NIjLV. Akhilesh Gupta does a technical deep-dive into how Linkedin uses the Play/Akka Framework and a scalable distributed system to enable live interactions like likes/comments at massive scale at extremely low costs across multiple data centers. Filmed at qconlondon.com. Akhilesh Gupta is the technical lead for LinkedIn's Real-time delivery infrastructure and LinkedIn Messaging. He has been working on the revamp of LinkedIn’s offerings to instant, real-time experiences. Before this, he was the head of engineering for the Ride Experience program at Uber Technologies in San Francisco.

Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2x0Fav8. Jose Nino guides the audience through the journey of Mobile APIs at Lyft. He focuses on how the team has reaped the benefits of API generation to experiment with the network transport layer. He also discusses recent developments the team has made with Envoy Mobile and the roadmap ahead. Filmed at qconlondon.com. Jose Nino works as a Software Engineer at Lyft.

The document discusses key trends in software teams and teamwork in 2020 according to a report by InfoQ. Some of the trends discussed include the sudden shift to remote work due to COVID-19, with many teams not fully prepared; the continued spread of agile practices to other areas of organizations beyond software development; and a growing focus on diversity, inclusion, and creating more humanistic and sustainable workplaces. The report aims to help technical leaders and individual contributors navigate these trends and challenges to improve team experiences and organizational success.

Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2QCmmJ0. Mark Stoodley examines some of the strengths and weaknesses of the different Java compilation technologies, if one was to apply them in isolation. Stoodley discusses how production JVMs are assembling a combination of these tools that work together to provide excellent performance across the large spectrum of applications written in Java and JVM based languages. Filmed at qconsf.com. Mark Stoodley joined IBM Canada to build Java JIT compilers for production use and led the team that delivered AOT compilation in the IBM SDK for Java 6. He spent the last five years leading the effort to open source nearly 4.3 million lines of source code from the IBM J9 Java Virtual Machine to create the two open source projects Eclipse OMR and Eclipse OpenJ9, and now co-leads both projects.

Kafka is evolving to remove its dependency on Zookeeper. The Kafka Improvement Proposal 500 (KIP-500) aims to manage Kafka's metadata log with a self-managed Raft consensus algorithm and controller quorum rather than relying on Zookeeper. This will improve scalability, robustness, and make deployment easier. It will take multiple releases to fully implement KIP-500, beginning with removing Zookeeper from clients and ending with a release where Zookeeper is no longer required.

Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2SXXXiD. Katharina Probst talks about what it means to act like an owner and why teams need ownership to be high-performing. When team members, regardless of whether they have a formal leadership role or not, act like owners, magical things can happen. She shares ideas that we can apply to our own work, and talks about how to recognize when we don’t live up to our own expectations of acting like an owner. Filmed at qconsf.com. Katharina Probst is a Senior Engineering Leader, Kubernetes & SaaS at Google. Before this, she was leading engineering teams at Netflix, being responsible for the Netflix API, which helps bring Netflix streaming to millions of people around the world. Prior to joining Netflix, she was in the cloud computing team at Google, where she saw cloud computing from the provider side.

Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2T04Lw4. Sergey Kuksenko talks about the performance benefits inline types bring to Java and how to exploit them. Inline/value types are the key part of experimental project Valhalla, which should bring new abilities to the Java language. Filmed at qconsf.com. Sergey Kuksenko is a Java Performance Engineer at Oracle working on a variety of Java and JVM performance enhancements. He started working as Java Engineer in 1996 and as Java Performance Engineer in 2005. He has had a passion for exploring how Java works on modern hardware.

Do you need service meshes in your tech stack? This on-line guide aims to answer pertinent questions for software architects and technical leaders, such as: what is a service mesh?, do I need a service mesh?, how do I evaluate the different service mesh offerings? In software architecture, a service mesh is a dedicated infrastructure layer for facilitating service-to-service communications between microservices, often using a sidecar proxy.

The document discusses Cloud Native CI/CD and the Tekton project. It begins with an overview of cloud native concepts like containers, Kubernetes, and microservices. It then defines characteristics of cloud native CI/CD like being serverless, using open standards, reusable components, and config as code. The document introduces Tekton as a cloud native CI/CD building block on Kubernetes that uses custom resources for tasks, pipelines, triggers and more. It highlights a demo of Tekton before concluding with the project's roadmap and how to get involved.

Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2S7lDiS. Sasha Rosenbaum shows how a CI/CD pipeline for Machine Learning can greatly improve both productivity and reliability. Filmed at qconsf.com. Sasha Rosenbaum is a Program Manager on the Azure DevOps engineering team, focused on improving the alignment of the product with open source software. She is a co-organizer of the DevOps Days Chicago and the DeliveryConf conferences, and recently published a book on Serverless computing in Azure with .NET.

Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/36epVKg. Todd Montgomery discusses the techniques and lessons learned from implementing Aeron Cluster. His focus is on how Raft can be implemented on Aeron, minimizing the network round trip overhead, and comparing single process to a fully distributed cluster. Filmed at qconsf.com. Todd Montgomery is a networking hacker who has researched, designed, and built numerous protocols, messaging-oriented middleware systems, and real-time data systems, done research for NASA, contributed to the IETF and IEEE, and co-founded two startups. He currently works as an independent consultant and is active in several open source projects.

Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2FWc5Sk. Ben Sigelman talks about "Deep Systems", their common properties and re-introduces the fundamentals of control theory from the 1960s, including the original conceptualizations of Observability & Controllability. He uses examples from Google & other companies to illustrate how deep systems have damaged people's ability to observe software, and what needs to be done in order to regain control. Filmed at qconsf.com. Ben Sigelman is a co-founder and the CEO at LightStep, a co-creator of Dapper (Google’s distributed tracing system), and co-creator of the OpenTracing and OpenTelemetry projects (both part of the CNCF). His work and interests gravitate towards observability, especially where microservices, high transaction volumes, and large engineering organizations are involved.

This document discusses machine learning in the browser using Tensorflow.js. It begins with an introduction and overview of Tensorflow.js, including how it can be used for both authoring models and importing pre-trained models for inference. Examples are provided of using the Ops API to fit a polynomial function and the Layers API to build and train an autoencoder in the browser. Challenges of developing machine learning applications in the browser are also discussed.

Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2s9T3Vl. Colin Eberhardt looks at some of the internals of WebAssembly, explores how it works “under the hood”, and looks at how to create a (simple) compiler that targets this runtime. Filmed at qconsf.com. Colin Eberhardt is the Technology Director at Scott Logic, a UK-based software consultancy where they create complex application for their financial services clients. He is an avid technology enthusiast, spending his evenings contributing to open source projects, writing blog posts and learning as much as he can.

Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2S9tOgy. Satyajit Thadeshwar provides useful insights on how Netflix implemented a secure, token-agnostic, identity solution that works with services operating at a massive scale. He shares some of the lessons learned from this process, both from architectural diagrams and code. Filmed at qconsf.com. Satyajit Thadeshwar is an engineer on the Product Edge Access Services team at Netflix, where he works on some of the most critical services focusing on user and device authentication. He has more than a decade of experience building fault-tolerant and highly scalable, distributed systems.

Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2Ezs08q. Justin Ryan talks about Netflix’ scalability issues and some of the ways they addressed it. He shares successes they’ve had from unintuitively partitioning computation into multiple services to get better runtime characteristics. He introduces us to useful probabilistic data structures, innovative bi-directional data passing, open-source projects available from Netflix that make this all possible. Filmed at qconsf.com. Justin Ryan is Playback Edge Engineering at Netflix. He works on some of the most critical services at Netflix, specifically focusing on user and device authentication. Years of building developer tools has also given him a healthy set of opinions on developer productivity.

Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2Z4ZJjn. Kilian Valkhof discusses the process of making an Electron app feel at home on all three platforms: Windows, MacOS and Linux, making devs aware of the pitfalls and how to avoid them. Filmed at qconsf.com. Kilian Valkhof is a Front-end Developer & User-experience Designer at Firstversionist. He writes about various topics, from design to machine learning, on his personal website, kilianvalkhof.com and is a frequent contributer to open source software. He is part of the Electron governance team that oversees the development of the Electron framework.

Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/344PnB1. Steve Klabnik goes over the deep details of how async/await works in Rust, covering concepts like coroutines, generators, stack-less vs stack-ful, "pinning", and more. Filmed at qconsf.com. Steve Klabnik is on the core team of Rust, leads the documentation team, and is an author of "The Rust Programming Language." He is a frequent speaker at conferences and is a prolific open source contributor, previously working on projects such as Ruby and Ruby on Rails.

Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2OUz6dt. Chris Riccomini talks about the current state-of-the-art in data pipelines and data warehousing, and shares some of the solutions to current problems dealing with data streaming and warehousing. Filmed at qconsf.com. Chris Riccomini works as a Software Engineer at WePay.

The document discusses testing infrastructure as code using automated tests. It recommends writing unit tests to test individual components in isolation by deploying real infrastructure, validating it works through methods like HTTP requests or API calls, and then undeploying it. The document provides an example of using Terratest to write a unit test for a Terraform module that deploys a "Hello World" web app. It shows how to build and deploy the infrastructure, validate it works by making an HTTP request, and clean it up after the test.

Are you interested in dipping your toes in the cloud native observability waters, but as an engineer you are not sure where to get started with tracing problems through your microservices and application landscapes on Kubernetes? Then this is the session for you, where we take you on your first steps in an active open-source project that offers a buffet of languages, challenges, and opportunities for getting started with telemetry data. The project is called openTelemetry, but before diving into the specifics, we’ll start with de-mystifying key concepts and terms such as observability, telemetry, instrumentation, cardinality, percentile to lay a foundation. After understanding the nuts and bolts of observability and distributed traces, we’ll explore the openTelemetry community; its Special Interest Groups (SIGs), repositories, and how to become not only an end-user, but possibly a contributor.We will wrap up with an overview of the components in this project, such as the Collector, the OpenTelemetry protocol (OTLP), its APIs, and its SDKs. Attendees will leave with an understanding of key observability concepts, become grounded in distributed tracing terminology, be aware of the components of openTelemetry, and know how to take their first steps to an open-source contribution! Key Takeaways: Open source, vendor neutral instrumentation is an exciting new reality as the industry standardizes on openTelemetry for observability. OpenTelemetry is on a mission to enable effective observability by making high-quality, portable telemetry ubiquitous. The world of observability and monitoring today has a steep learning curve and in order to achieve ubiquity, the project would benefit from growing our contributor community.

Sustainability requires ingenuity and stewardship. Did you know Pigging Solutions pigging systems help you achieve your sustainable manufacturing goals AND provide rapid return on investment. How? Our systems recover over 99% of product in transfer piping. Recovering trapped product from transfer lines that would otherwise become flush-waste, means you can increase batch yields and eliminate flush waste. From raw materials to finished product, if you can pump it, we can pig it.

This presentation explores the practical application of image description techniques. Familiar guidelines will be demonstrated in practice, and descriptions will be developed “live”! If you have learned a lot about the theory of image description techniques but want to feel more confident putting them into practice, this is the presentation for you. There will be useful, actionable information for everyone, whether you are working with authors, colleagues, alone, or leveraging AI as a collaborator. Link to presentation recording and slides: https://bnctechforum.ca/sessions/details-of-description-part-ii-describing-images-in-practice/ Presented by BookNet Canada on June 25, 2024, with support from the Department of Canadian Heritage.

This presentation explores the practical application of image description techniques. Familiar guidelines will be demonstrated in practice, and descriptions will be developed “live”! If you have learned a lot about the theory of image description techniques but want to feel more confident putting them into practice, this is the presentation for you. There will be useful, actionable information for everyone, whether you are working with authors, colleagues, alone, or leveraging AI as a collaborator. Link to presentation recording and transcript: https://bnctechforum.ca/sessions/details-of-description-part-ii-describing-images-in-practice/ Presented by BookNet Canada on June 25, 2024, with support from the Department of Canadian Heritage.

Profile portofolio

These fighter aircraft have uses outside of traditional combat situations. They are essential in defending India's territorial integrity, averting dangers, and delivering aid to those in need during natural calamities. Additionally, the IAF improves its interoperability and fortifies international military alliances by working together and conducting joint exercises with other air forces.

An invited talk given by Mark Billinghurst on Research Directions for Cross Reality Interfaces. This was given on July 2nd 2024 as part of the 2024 Summer School on Cross Reality in Hagenberg, Austria (July 1st - 7th)