Embracing the Fire: How Outages Shaped My Tech Career

David Campbell
ITNEXT
Published in
4 min readJul 3, 2024

--

My first job in Silicon Valley was in 2009 for an already acquired “startup” called Tellme Networks. If you ever called 411 in the early 2000s, you absolutely used the Tellme platform, which specialized in telephony based applications. I was working in a Network Operation Center (NOC) where I quickly clung to writing software projects during my 12-hour weekend shifts, thus inspiring a career-long obsession with building thoughtful tools. During my two weekday swing shifts, I gravitated toward implementing large, complex changes to the system.

An abstract image featuring a swirling vortex of binary code and circuit patterns. The vortex transitions from chaotic red and orange hues on the left, symbolizing urgency, to calm blues and greens on the right, representing stability. This design symbolizes an SRE tackling an outage, with digital elements and colors blending fluidly to evoke a sense of transformation from chaos to order. There is no depiction of an actual firefighter, emphasizing the abstract and artistic nature of the scene.
Dall-E 3 interpretation of outage mitigation

The primary job of working in an NOC is to ensure the system's reliability. This was after Google coined the term Site Reliability Engineer (SRE), but before many of my colleagues (myself included) would eventually become SREs at various companies.

Jumping into the Fire: Handling Outages

SREs are known for jumping into the fire pit. During the many outages I have mitigated throughout my career, I found early on that I was quite good at it even though I didn’t much like the stress of them. In Season 7 of Game of Thrones, there’s a quote where Daenerys says, “We all enjoy what we are good at,” and Jon, brooding momentarily, replies, “I don’t.” That was me. I hated outages, but I was really good at them. They really stressed me out.

--

--

Writer for

AI Security Risk Lead @ Scale AI, known for an AI Red Teaming platform recognized by the U.S. Congress and the White House, champions ethical AI.