The Web-Tracking Tipping Point

Comment

Image Credits: jambro (opens in a new window) / Shutterstock (opens in a new window)

Justin Krause

Contributor
Justin Krause leads the business intelligence and web development teams at Asana.

We are witnessing a watershed moment on the Internet — with Apple’s content-blocker announcement, the way we see and understand our users on the web is going to profoundly shift.

It doesn’t seem like a very big deal. Adblockers have existed on desktop browsers for years, and products like Google Analytics have still become the industry standard for measuring and monitoring websites. But this is all about to change — individual products and categories will be massively disrupted by a simple technical shift in mobile Safari, and organizations with a web presence will have to adapt or risk being put at a competitive disadvantage.

Why is this the moment? Simply put, the legacy system for web tracking is already broken. It fails to accurately capture web engagement due to existing adblockers, and adding mobile content blockers will further skew the data. It fails on single-page web applications, because it is built around pageloads. It fails more severely in apps — where 90 percent of the action is — for the same reason, and because the multi-stack data is often poorly integrated. The biggest way legacy systems have failed, however, is by siloing data — putting key data about your customers in an inaccessible place, where integrating data and doing automation is impossible without costly and brittle API integrations.

Mobile-content blockers are the final nail in the coffin. They are likely to be much more compelling for users than desktop adblockers — bandwidth savings and faster pageloads really matter on mobile. The privacy gain is just a perk. With the Internet shifting inexorably to smartphones, losing visibility into iOS users — the users who spend the most money and time online — will skew the data and render it unreliable.

It won’t happen on Day One. But adoption of similar technologies on Android will rise with iOS adoption, and users will be even more likely to adopt desktop blockers as they become familiar with these technologies. Browsers may even build them in.

It’s Not Just Publishers

This technology will deeply affect digital advertising and attribution, which will in turn affect publishers and other companies with ad-supported revenue models. But that’s just the beginning.

Inspect any e-commerce or B2B website and witness all the cookies and requests (often made by Google Tag Manager). These networks (and tag managers), will be dramatically impacted — along with all the creative agencies and marketers who work with them. More profoundly, this will affect the companies that sell on these platforms — how will e-commerce companies reliably retarget users?

The most technologically savvy users will be much harder to reach; in essence, there will be growing adverse selection on ad networks. Decaying attribution models will reduce confidence in ROI, making ad programs — and any marketing campaigns — harder to quantify with confidence and harder to justify concretely.

Beyond digital advertising and attribution, front-end web testing frameworks like Optimizely will be affected — because Optimizely is a JavaScript snippet that loads test variations and sends data asynchronously. What happens when your A/B tests only consider a less-mobile, less-technical audience? Are the results still valid and actionable?

At the most basic level, understanding user behavior on the web will become more challenging. Analysts who try to marry data in Google Analytics with data in internal systems already know that a meaningful schism nearly always exists between the two, and this is only going to get worse as more data is withheld from third-party systems. Not having good data will render many product and marketing teams blind — unable to see what’s really happening with their users, and unable to react intelligently.

What’s Next? The Burden Will Shift

The future of web tracking is simple to understand, but painful to acknowledge; we can’t rely on third-party cookies and JavaScript snippets anymore. The burden shifts from the user’s browser back to our own web servers, and this shift will add complexity to web stacks. Yet in this shift, there lies a tremendous opportunity to unify our data and improve the way we understand our users; the most forward-thinking teams will reap the rewards of this effort.

Requests to Google or Optimizely’s servers from the user’s browser will often be blocked under the new content blockers, but requests to the origin are unlikely to be blocked (doing so would break anything resembling AJAX, and break the web as we know it). The logical solution, therefore, is that solutions that rely on asynchronous requests to third-party domains will release server-side libraries. Along with your JavaScript snippet, you’ll be pasting PHP or Ruby libraries on your server, as well; the JavaScript will send requests back to your own servers, which will then communicate with these third-party services REST-fully.

But this presents some fundamental problems. First, only technically savvy developers will be able to confidently adjust server-side code. For most webmasters, they will rely on their hosts or on WordPress plug-ins to do this work for them. Ultimately, this will create more friction and delays around deploying these solutions, reducing their appeal. For technically savvy developers, the question will arise, “If I’m already deploying client- and server-side code, why use a third-party system at all?” Open source analytics solutions will gain traction, and more organizations will opt to do more of their analytics and intelligence in-house.

The other issue is scalability. Most web properties today are optimized to serve pages, not to handle and process an influx of analytics data. The new server-side solutions must be simple, reliable and cohesive. If we add dozens of requests and pixels without thinking about performance, as is the case today, we’ll end up flooding our own servers, adding costs and potential latency. The winning solutions will marry front-end data to server-side handlers in a single, well-designed pipeline, then export the data to data warehouses (and third-party services) from the server, probably in batches.

During this transition, many organizations will fail to act and will rely on imperfect data that is getting steadily worse. Numbers won’t add up and biases will lead to poor intelligence and decision making. It will be a chaotic time for developers, analysts and marketers, and there will be a bifurcation between sophisticated teams that adopt new tools, and those who choose to stick with the old.

We’re Due For A Revolution

Albeit chaotic, this shift will open a major market opportunity to disrupt existing players by going beyond the content-blocking issue to solve deeper issues around web tracking — marrying front-end data with multi-stack internal data, accounting for a web experience that is no longer centered around pageloads, but instead around events and sessions on the web and in apps, and making first-party, owned data a reality for more organizations.

The investments companies are making into marketing and product will demand solutions that really work, and new tools will evolve to fill the void — and, because of the increasing complexity of these tools, a new class of developer-analysts with deep measurement expertise will crop up and will be in high demand.

What should the ideal solution look like? Given that both front- and back-end stacks are diverse, the system will need to be highly flexible. One exciting guidepost for where things could be going is third-party bug tracking — services like Bugsnag have libraries in virtually every language that can operate at the server level and REST-fully interact to stream data about bugs and exceptions — analytics could work the same way.

Hopefully, however, organizations use this opportunity to claim their data for themselves, and open-source tools gain traction that help stream data into first-party data warehouses like Redshift, where it can be joined with internal data and used more flexibly. The community should come together to define a common schema that makes sense for Web 2.0 applications, and third-party BI services like Looker should sit atop this owned data instead of siloing it in inaccessible places as Google Analytics does today.

If this happens, we’ll be trading in an easy-but-broken system of web analytics for a much richer, more complex system capable of delivering much deeper insights. This will require a significant investment and more specialized skills — but the payoff will be better intelligence — and, ultimately, better products, user experiences and business outcomes.

Ultimately, It’s Great For Users

Contrary to claims about content blockers being Apple’s secret scheme to drive more activity into native news readers, the bottom line is that this change is great for users. Reducing bandwidth and cleaning up the tremendous amount of cruft on mobile are worthy goals. Some of this bandwidth will undoubtedly be shifted toward the origin, as described above, but overall, the experience should be better for mobile Safari users (and, ultimately, everyone else as we clean things up across the web).

There is also the privacy consideration — removing third-party cookies should reduce the embarrassing ads about items we abandoned in online shopping carts that follow us all over the web. But overall, the impact on online privacy will likely be muted as companies find other ways to share data — most notably, by simply sharing email lists. Facebook has already brought this approach into the mainstream with Custom Audience targeting. Universal IDs and IP reconciliation will also become more widespread and important to marketers and content platforms.

It’s Also Great For The Web

Apple is forcing us to rethink the Internet — by shifting us to mobile, shifting us into apps and by challenging the status quo of how we measure, track and target on the web, starting with mobile Safari. Just as the app ecosystem created work, chaos and change, the shift in web analytics will not be easy. But it will also create incredible opportunities and new winners. It will open the door to better, more flexible mechanisms for analyzing and understanding our users and products across the ecosystem. It will force us to be better — more integrated, more intentional and more knowledgeable.

It’s about time.

More TechCrunch

Cybersecurity firm Dragos and Ukrainian authorities found a cyberattack targeting critical infrastructure in Lviv.

Hackers shut down heating in Ukrainian city with malware, researchers say

Messaging app Telegram has reached 950M active users, and it aims to cross the 1 billion mark this year, founder Pavel Durov said.

Telegram’s userbase climbs to 950M, plans to launch app store

India’s federal government has removed the so-called “angel tax” for all classes of investors, delivering a major victory to the country’s startup ecosystem that had lobbied for years against the…

India scraps ‘angel tax’ in boost for startups

A Seoul court issued an arrest warrant for Brian Kim, the founder of South Korean internet giant Kakao, on allegations of stock price manipulation related to the company’s takeover of…

Kakao founder issued arrest warrant by Seoul court

Cybersecurity startup Wiz has turned down a $23 billion acquisition offer from Alphabet, Google’s parent company, according to a source familiar with discussions. Despite the offer representing a substantial premium…

Wiz walks away from Google’s $23B acquisition offer: Read the CEO’s note to employees

Monarch Tractor was in a tricky spot late last year as the autonomous electric tractor startup juggled growth and an uncertain fundraising environment. Now, with $133 million in new funds,…

Monarch Tractor CEO says $133M raise will help it escape ‘quite a challenging time’

Hello and welcome back to TechCrunch Space. Before we begin, a quick note: I write this newsletter on Friday and it gets delivered to you on Monday. So if I…

Eric Zhu started building Aviato, an analytical platform for private market data, in a very atypical place for an entrepreneur: the bathroom in his Carmel, Indiana, high school. Now the 17-year-old’s…

17-year-old Eric Zhu’s startup was built in a high school bathroom — now it’s raised $2.3M and is emerging from stealth

Choosing between New York City’s nearly 25,000 restaurants can be overwhelming. The pressure is especially high when you’re trying to impress a first date (or investor) or entertain family from…

The Scene’s new app helps New Yorkers find dining and nightlife spots

Nine months on, and Jigsaw is now formally handing Altitude over to Tech Against Terrorism, which will continue its development and maintenance.

Google’s Jigsaw open sources Altitude to help online platforms weed out extremist content

TechCrunch Disrupt 2024 in San Francisco is fast approaching, and we’re seeking highly motivated volunteers to support our events team. If you dream of becoming a startup founder, marketer, or…

Be a TechCrunch Disrupt 2024 volunteer

Unlike OpenAI, Anthropic, Mistral and many of its generative AI startup rivals, Cohere doesn’t have a big consumer focus.

Cohere raises $500M to beat back generative AI rivals

Indian food delivery and quick commerce startup Swiggy is pivoting one of its smaller businesses, Swiggy Minis, into a link-in-bio service.

Swiggy turns Minis into a link-in-bio platform

Fragment’s digital ledger API applies real-time, double entry accounting to find where things aren’t adding up.

Fintech Fragment eases ledger problems, nabs $9M from Stripe, Jack Altman, BoxGroup, others

Identity management is one of the most common fulcrums around which security breaches have pivoted in the last several years. One of the main reasons it has become the gift…

Linx emerges from stealth with $33M to lock down the new security perimeter: Identity

Featured Article

Pesa unlocks new markets to keep remittances flowing to emerging economies

Founders of Pesa, a remittance fintech, know too well how costly, inaccessible and unreliable remittance services drive people to opt for risky informal channels —  like WhatsApp groups  — to transfer money.  Their firsthand experience using informal channels and realizing how prevalent their use was among Africans living in the…

Pesa unlocks new markets to keep remittances flowing to emerging economies

A little more than a year after launching the ROG Ally, Asus is releasing a refined version of its portable device, the ROG Ally X. This Windows-based machine starts shipping…

The Asus ROG Ally X turns PC gaming into a portable console

As a part of TechCrunch’s ongoing Women in AI series, which seeks to give AI-focused women academics and others their well-deserved — and overdue — time in the spotlight, TechCrunch interviewed Lakshmi…

CIA AI director Lakshmi Raman claims the agency is taking a ‘thoughtful approach’ to AI

With President Joe Biden dropping out of the race, Vice President Kamala Harris may become the Democrats’ new nominee. In announcing his plans, Biden offered his “full support and endorsement…

What Kamala Harris has said about AI, tech regulation and more

U.S. President Joe Biden has announced he no longer plans to seek reelection, a decision that follows weeks of growing pressure from some Democratic Party supporters, including high-profile tech investors…

Joe Biden drops out of presidential race

Google is expected to announce four Pixel devices: the Pixel 9, Pixel 9 Pro, Pixel 9 Pro XL and Pixel 9 Pro Premium, running Android 15.

Made by Google 2024: Pixel 9, Gemini, a new foldable and other things to expect from the event

WazirX, one of India’s largest cryptocurrency exchanges, has “temporarily” suspended all trading activities on its platform days after losing about $230 million, nearly half of its reserves, in a security…

WazirX halts trading after $230 million ‘force majeure’ loss

Featured Article

From Yandex’s ashes comes Nebius, a ‘startup’ with plans to be a European AI compute leader

Subject to shareholder approval, Yandex N.V. is adopting the name of one of its few remaining assets, an AI cloud platform called Nebius AI which it birthed last year.

From Yandex’s ashes comes Nebius, a ‘startup’ with plans to be a European AI compute leader

Employees at Bethesda Game Studios — the Microsoft-owned game developer that produces the Elder Scrolls and Fallout franchises — are joining the Communications Workers of America union. Quality assurance testers…

Bethesda Game Studios employees form a ‘wall-to-wall’ union

This week saw one of the most widespread IT disruptions in recent years linked to a faulty software update from popular cybersecurity firm CrowdStrike. Businesses across the world reported IT…

CrowdStrike’s update fail causes global outages and travel chaos

Alphabet, the parent company of Google, is in advanced talks to acquire cybersecurity startup Wiz for $23 billion, the Wall Street Journal reported on Sunday. TechCrunch’s sources heard similar and…

Unpacking how Alphabet’s rumored Wiz acquisition could affect VC

Around 8.5 million devices — less than 1 percent of Windows machines globally — were affected by the recent CrowdStrike outage, according to a Microsoft blog post by David Weston,…

Microsoft says 8.5M Windows devices were affected by CrowdStrike outage

Featured Article

Some Black startup founders feel betrayed by Ben Horowitz’s support for Trump

Trump is an advocate for a number of policies that could be harmful to people of color.

Some Black startup founders feel betrayed by Ben Horowitz’s support for Trump

Featured Article

Strava’s next chapter: New CEO talks AI, inclusivity, and why ‘dark mode’ took so long

TechCrunch sat down with Strava’s new CEO in London for a wide-ranging interview, delving into what the company is prioritizing, and what we can expect in the future as the company embarks on its “next chapter.”

Strava’s next chapter: New CEO talks AI, inclusivity, and why ‘dark mode’ took so long

Featured Article

Lavish parties and moral dilemmas: 4 days with Silicon Valley’s MAGA elite at the RNC

All week at the RNC, I saw an event defined by Silicon Valley. But I also saw the tech elite experience flashes of discordance.

Lavish parties and moral dilemmas: 4 days with Silicon Valley’s MAGA elite at the RNC