Where We Are Today With Google’s Mobile-First Index

Mobile-first indexing has been a topic for years, but have you stayed up to date? Keep reading for the latest on Google's mobile-first index.

Okay, so it’s been a few years now since Google announced the mobile-first index.

Most sites have been moved over to Google’s mobile-first index and it’s no longer a “hot” topic in SEO.

I found a tweet from John Mueller, Google Search Advocate, in 2021 that sums up the lack of focus on this topic the best:

It's interesting to me that no one has really covered the issue of Google crawling w both desktop and mobilebot. It feels like we've accepted mobile-first dogmatically without discussing what's actually happening. Not sure why though.

— Mordy Oberstein 🇺🇦 (@MordyOberstein) March 12, 2021

Going with that mentality that mobile-first indexing is a “part of life” (which I wholeheartedly agree with), as an SEO, it is helpful to know some of the history and where we are today.

For instance, since the announcement of the mobile-first index years ago, Google has now also placed emphasis on Page Experience, which is a ranking factor and very much incorporates mobile.

Before we jump into that topic, let’s first get into the beginnings of the mobile-first index and what we know so far.

hen, we’ll get into what Google is looking for in mobile usability, what it means to have an identical experience on mobile and desktop, how you can meet Google’s expectations of mobile-first best practices, and more.

Google’s Mobile-First Indexing

No, There Are Not Two Indexes

Google has stated that there isn’t a separate mobile-first index.

Instead, mobile-first indexing means Google primarily uses the mobile version of the webpage for ranking and indexing purposes.

In 2018, Google explained that with mobile-first indexing, the URL of the mobile-friendly version of your site is indexed.

If your website has separate mobile and desktop URLs, Google shows the mobile URL to mobile users and the desktop URL to desktop users.

Regardless, the indexed content will be the mobile version.

Shifting To The Mobile-First Index

At the end of 2017, Google announced that it would start slowly rolling out mobile-first indexing.

By March 2018, Google stated that they were expanding the rollout and instructed websites to prepare.

Fast forward three years later and not all websites have been switched over to the mobile index.

In June 2020, Google stated that while most websites were set to mobile indexing, there were still many that were not.

Google announced at that point that instead of switching in September 2020, it would delay mobile-first indexing until March 2021.

Google cited a number of issues encountered with sites as a reason for delaying the rollout, including problems with robots meta tags, lazy-loading, blocked assets, primary content, and mobile images and videos.

Eventually, Google removed its own self-imposed deadline in November 2021 explaining that there were still sites that were not yet in the mobile-first index because they weren’t ready to be moved over.

Google went on to say that the lack of readiness was due to several unexpected challenges faced by these websites.

According to Google, “because of these difficulties, we’ve decided to leave the timeline open for the last steps of mobile-first indexing.”

Google also stated that “we currently don’t have a specific final date for the move to mobile-first indexing and want to be thoughtful about the remaining bigger steps in that direction.”

Mobile-First Indexing As The Default For New Websites

If your website was published after July 1, 2019, mobile-first indexing is enabled by default.

Google made this announcement in May 2019 and explained that the change applied to websites that were previously unknown to Google Search.

The announcement went into detail about why Google would make mobile-first indexing the default for new websites.

According to Google, after crawling the web with a smartphone Googlebot over the years, they concluded that new websites are typically ready for this type of crawling.

Mobile Usability And Mobile-First Indexing Are Not Synonyms

In January 2019, Mueller explained that if your content does not pass the mobile usability test, it could still be moved to mobile-first indexing.

Even if Search Console’s “mobile usability” report showed that your site had valid URLs, it didn’t mean those pages were ready for mobile-first indexing.

Mobile usability is “completely separate” from mobile-first indexing, according to Mueller. Consequently, pages could be enabled for mobile-first indexing even if they were not considered usable on a mobile device.

“So, first off, again mobile usability is completely separate from mobile-first indexing.

A site can or cannot be usable from a mobile point of view, but it can still contain all of the content that we need for mobile-first indexing.

An extreme example, if you take something like a PDF file, then on mobile that would be terrible to navigate. The links will be hard to click, the text will be hard to read.

But all of the text is still there, and we could perfectly index that with mobile-first indexing.

Mobile usability is not the same as mobile-first indexing.”

In summary, mobile-friendliness and mobile-responsive layouts are not mandatory for mobile-first indexing.

Since pages without mobile versions still work on a mobile device, they were eligible for indexing.

The Mobile & Desktop Experiences Should Be The Same

Google added to their mobile-first indexing best practices in January 2020, and the big emphasis was on providing an identical experience on mobile and desktop.

Matt Southern provided a great summarized list of what Google meant by the same experience:

• Ensuring Googlebot can access and render mobile and desktop page content and resources.
• Making sure the mobile site contains the same content as the desktop site.
• Using the same meta robots tags on the mobile and desktop site.
• Using the same headings on the mobile site and desktop site.
• Making sure the mobile and desktop sites have the same structured data.

Google warns that if you purposefully serve less content on the mobile version of a page than the desktop version, you will likely experience a drop in traffic.

The reason? According to Google, they won’t be able to get as much information from the page as before (when the desktop version was used).

Instead, Google recommends that the primary content on the mobile site be the same as on the desktop site. Google even suggests using the same headings on the mobile version.

To drive this point home, even more, Google mentions in its mobile-indexing documentation that only the content on the mobile site is used in indexing.

Therefore, you should be sure that your mobile site has the same content as your desktop site.

Mueller reiterated this fact during Pubcon Pro Virtual 2020 with the following comment:

“…we’re now almost completely indexing the web using a smart phone Googlebot, which matches a lot more what users would actually see when they search.

And one of the things that we noticed that people are still often confused about is with regards to, like if I only have something on desktop, surely Google will still see that and it will also take into account the mobile content.

But actually, it is the case that we will only index the mobile content in the future.

So when a site is shifted over to mobile first indexing, we will drop everything that’s only on the desktop site. We will essentially ignore that.

…anything that you want to have indexed, it needs to be on the mobile site.”

You can read more about Mueller’s comments here: Google Mobile-First Index – Zero Desktop Content March 2021.

Google’s Mobile-First Indexing Best Practices

Google provides a comprehensive list of best practices for mobile-first indexing “to make sure that your users have the best experience.”

Most of the information Google shares as best practices is not really new.

Instead, the list is a compilation of various recommendations and advice that Google has provided elsewhere over the years.

In addition to the list of recommendations above about creating the same experience on mobile and desktop, other best practices include:

• Making sure the error page status is the same on the mobile and desktop sites.
• Avoiding fragment URLs in the mobile site.
• Making sure the desktop pages have equivalent mobile pages.
• Verifying both the mobile and desktop sites in Search Console.
• Checking hreflang links on separate mobile URLs.
• Making sure the mobile site can handle an increased crawl rate.
• Making sure the robot.txt directives are the same on the mobile and desktop sites.

Google offers an entire section focused on suggestions for separate URLs.

The “Troubleshooting” section of the best practices document is also worth checking out.

It includes common errors that can either cause your site to not be ready for mobile-first indexing or could lead to a drop in rankings once your site is enabled.

Note that Mueller explained nothing has changed with mobile-first indexing related to sites with separate mobile URLs using rel-canonical. Mueller recommends keeping the annotations the same.

Google will use the mobile URL as canonical even if the rel-canonical points to the desktop URL.

Mueller created a helpful graphic that shows a “before and after” indexing process for desktop and m-dot URLs.

Read more: Google’s John Mueller Clears Confusion About Mobile-First Index.

I occasionally get questions about this, so just to be clear: if you have separate mobile URLs (with rel-alternate / rel-canonical links), with mobile first indexing you *don't* need to change anything. Keep the same annotations. No changes needed. pic.twitter.com/nGPucxPXWn

— 🐝 johnmu.rss?utm_medium=large (personal) 🐝 (@JohnMu) January 18, 2021

One last note about best practices.

In Google’s mobile-first indexing best practices documentation, it states, “While it’s not required to have a mobile version of your pages to have your content included in Google’s search results, it is very strongly recommended.”

While it might seem obvious to have a mobile version, I have gotten pushback when speaking about mobile-first.

At one conference, an attendee asked during my session if having a mobile version of the site was necessary if no one was coming from a mobile device.

He kept emphasizing “no one.” My answer? Do it anyway.

Not only does Google very highly recommend it, but visitors, especially repeat visitors, might not be using mobile devices because of the poor experience.

We need to focus not just on getting pages ranked in search results, but also on ensuring that the visitor has a good experience once on the page.

Page Experience Update + Mobile-First

The Page Experience update also needs to be part of the conversation.

The Page Experience update was officially released for mobile devices in 2021 and includes measurement signals regarding how visitors perceive their experience of interacting with your web page.

According to Google, this perception goes beyond just the information value provided on the page. Therefore, Google takes into account loading performance, visual stability, and interactivity of the page, which is known as Core Web Vitals.

Page Experience also looks at mobile-friendliness, HTTPS, and intrusive interstitials, which were already a part of the ranking algorithm.

For instance, mobile-friendliness was announced as a ranking factor in 2015, which led to Mobilegeddon (the industry’s name for the update… not Google’s name).

This factor took into account text readability, spacing of tap targets, and unplayable content.

A year later, Google announced that it was strengthening this ranking factor.

Originally, the mobile-friendly update was meant to apply to mobile search results only, but now with the mobile-first index, it applies overall.

Let’s get back to Core Web Vitals.

Core Web Vitals are factors Google considers important in a user’s overall experience on the webpage, including Largest Contentful Paint (LCP), First Input Delay (FID), and Cumulative Layout Shift (CLS).

Each of these factors contributes to the user experience and is scored as “Good,” “Needs Improvement,” or “Poor.”

Now, let’s see how this relates to mobile-first indexing.

There is a lot of overlap between Core Web Vitals and the mobile-first index because both look at how a page performs on a mobile device.

To tie this together, you can reference one of the mobile-first indexing best practices provided by Google, which is to ensure your mobile site loads fast.

Google offers specific recommendations, including using Google PageSpeed Insights and focusing on the “Speed” section. Note that there are other tools you can use too to test speed, such as GTMetrix and WebPageTest.

Martin Splitt, who works in Google’s Developer Relations, was asked in May 2021 if the Page Experience Update was going to roll out on mobile and desktop pages at the same time.

His response was that it would start with mobile pages first, which it did in August 2021. It would be rolled out on desktop pages in February 2022.

It was also made clear that Google would assess mobile pages separately from desktop pages, meaning there is no aggregate score of mobile and desktop (at least not for now).

You can access both the desktop and mobile Page Experience reports in Google Search Console.

Just as you need to pay attention to the desktop and mobile versions of your site for the mobile-first index, you also need to for the Page Experience update.

Check out Core Web Vitals: A Complete Guide for detailed information about this update and how to implement fixes.

One last note before we move on: When Google scores a page, it will test the speed, stability, and usability of the page version that the user ends up seeing.

Here’s where things get tricky. For Core Web Vitals, if you have an AMP version, Google will use it for page experience scoring (i.e., speed, quality, and usability). The mobile version would not be used.

Yet, the mobile version is what would be crawled for the mobile-first index.

So, to sum it up, the AMP version would be used for Core Web Vitals scoring and the mobile version would be used for mobile-first indexing.

Read Google Mobile-First Indexing and Scoring of Sites with Mobile and AMP Versions for the full explanation from Mueller.

Improve Performance In Google’s Mobile-First Index

Here is a consolidated list of items to check that build on some of the best practices already provided.

1. If You Have Multiple Versions, Make Sure Important Content Is Shown On All

Make sure your important content – including structured data, internal links, images, and so on – is on the mobile version of your website, too.

Google even warns in its mobile-indexing best practices that if you have less content on your mobile page than the desktop page, you will experience some traffic loss when your site is moved to mobile-first indexing,

Read more here: Google: Mobile-Friendly Does Not Mean Ready For Mobile-First Index.

2. Let Googlebot Access And Render Your Content

Google recommends that you use the same meta robots tags on the mobile site, avoid lazy-loading primary content (Googlebot can’t load content that requires user interaction), and allow Googlebot to crawl your resources.

3. Verify Structured Data

Double-check that your structured data is the same on both the desktop and mobile versions of your website and also ensure the URLs are correct.

4. Improve Mobile Page Speed

Page speed has been a factor to consider for a long time and it is even more important with the mobile-first index and Page Experience update.

Advanced Core Web Vitals: A Technical SEO Guide is packed with how-to advice on identifying and addressing speed-related factors that impact Core Web Vitals and mobile-first indexing.

5. Keep An Eye On Mobile Errors

As with most SEO work, getting a site to perform well in the mobile-first index is not a “one and done” task. You need to be closely monitoring Search Console so that you can identify and fix mobile errors.

Make it a habit to regularly view the “mobile usability” and “Core Web Vitals” reports in Search Console.

Keep Reading: Google’s Changelog On Mobile-First Indexing

The changelog in Google’s mobile-first indexing best practices gives a quick recap of the changes since 2016.

• May 4, 2020: Mobile-first indexing will be enabled for all websites starting September 2020.
• May 28, 2019: Mobile-first indexing is enabled by default for all new, previously unknown to Google Search, websites starting July 1, 2019.
• December 19, 2018: We notify the site owner through Search Console when we move the site to mobile-first indexing.
• March 26, 2018: Mobile-first indexing is rolling out more broadly.
• December 18, 2017: We will be evaluating sites for readiness and cautiously rolling out mobile-first indexing for sites that are ready.
• November 4, 2016: We are experimenting with making the index mobile-first.

As you can tell, there is a lot to know and keep in mind on mobile-first indexing.

Make sure you are staying on top of best practices and monitoring your website’s performance to succeed in the world of mobile-first indexing.

Resource: https://www.searchenginejournal.com/