Google: Sometimes Search Experiments Conflict Causing Issues

Jun 14, 2024 - 7:41 am 87 by

Google Test Tubes Smoking

In the last Search Off The Record podcast, Gary Illyes from the Google Search team said that sometimes issues can arise within the Google Search results due to two experiments that conflict with each other. He said at the 19:41 mark, "Very often there are experiments that need to be rolled back because two experiments might interact very badly with each other."

Here is the video embed where he said this:

Lizzi Sassman from Google asked Gary Illyes:

Okay, and then if somebody launched something or pushed out some change and then that could potentially be the most recent thing that happened.

Gary Illyes responded:

Yeah. Very often there are experiments that need to be rolled back because two experiments might interact very badly with each other. Like, some alert is triggering that something is going wrong. And then you root that issue back to faulty experiment or a bad interaction between experiments. I mean, sorry, that's not us. And then they would roll that back or ramp down the experiment.

There's also like data pushes that need to happen every now and then. For example, if you think about, this is a wrong example, but the doodles that we have every now and then, they are part of data pushes. And then, if something goes wrong with the data push, like let's say we lose, on the wire, 100 bytes, and then the doodle is like in the middle, there's a line, a white line, that would be noticed by our monitoring systems that something looks really wrong on the search result page. And then someone would go there, would take a look, it's like, "Oh my God, what's up with that white line?" And then they are like, "Okay, so when did we push this doodle?" And then they would identify a time, what time is it, it was 2:33 PM push, and then they would roll back to the push before that.

Thanks to Glenn Gabe who posted this on X who wrote, "Sometimes problems in the SERPs (or maybe what we see as changes) are due to multiple experiments running that don't work well with each other. When Google sees that, it might need to roll back those experiments (or ramp them down). Also, Gary explains that faulty data pushes could cause issues too. Google could roll back to the data push before that. Just another set of variables to consider when you see weird changes in the SERPs."

He then goes into how one time cosmic rays caused issue for Google Search.

So it is not only Google algorithm updates that cause issues in the search results.

Forum discussion at X.

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
Google Search Console Difficulties, Google Ranking Volatility, Zero Click Study, Google Ads & More - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: July 11, 2024

Jul 11, 2024 - 10:00 am
Google Ads

Google Ads Tests People Also Browsed Carousel

Jul 11, 2024 - 7:51 am
Google Ads

Google Ads: Double Row Carousel Shopping Search Ads

Jul 11, 2024 - 7:41 am
Google Maps

Google Business Profiles Consumer Alerts Document

Jul 11, 2024 - 7:31 am
Google Search Engine Optimization

Google Search Tests Thin Video Snippets

Jul 11, 2024 - 7:21 am
Google Search Engine Optimization

Google: SEO Feedback On The Last Core Update Was Really Helpful

Jul 11, 2024 - 7:11 am
Previous Story: Google Business Profiles Websites No Longer Load - 404