Understanding crawl budget is an often overlooked part of SEO. But a two-year-old post my team wrote about the topic is practically ancient history in the SEO industry. So, in this article, I’ll be explaining how our understanding of crawl budget has changed in the past couple years, what’s stayed the same, and what it […]
How crawl budget has changed in the last 2 years Read More »
In January 2017, Gary Illyes from Google published a document on the Google blog explaining how crawl budget works to webmasters and SEOs. He has now updated the document to make clear that AJAX (i.e. XHR) calls, can and will consume a site’s crawl budget. The clarification. The update (in italics added here) reads,
Google confirms AJAX (i.e. XHR) calls consume crawl budget Read More »
I’ll never forget my first experience surfing – it was the tail end of surfing season in Nicoya Peninsula of Costa Rica. I was 19, in prime shape, and I thought to myself “how hard could it be? I’ll just rent a board and hit the waves.” With no training but plenty of hubris, I
The typical goal of search engine optimization is to have your site’s pages show up on a Google results page in answer to a query. The object is for Google and every other search engine to crawl and index all your product detail pages, blog posts, and articles, and anything else that results in conversions.
It can be intimidating to tackle the challenge of big data. While some tech-thinking companies have led the charge toward analytics, metrics and measurement, many companies are still grounded by the weight of having more questions than answers. How much data should I collect? What metrics are important to me? How do I get the
Crawl, walk, run and fly: The 4 stages of scaling website analytics Read More »
Search engines crawl your site to get the contents into their index. The bigger your site gets, the longer this crawl takes. It’s important that the time spent crawling your site is well spent. If your site has a 1,000 pages or less, this is not a topic you’ll need to think about much. If you intend
Posted by Tom.Capper By now, you’ve probably heard as much as you can bear about mobile first indexing. For me, there’s been one topic that’s been conspicuously missing from all this discussion, though, and that’s the impact on internal linking and previous internal linking best practices. In the past, there have been a few popular
Internal Linking & Mobile First: Large Site Crawl Paths in 2018 & Beyond Read More »
What is a crawl budget? Google’s goal is to make useful information available to people searching the web. To accomplish that, Google wants to crawl and index content from quality sources. Crawling the web is costly: Google uses as much energy per year as the entire city of San Francisco, just to crawl websites. In
5 ways to improve ROI on seasonal pages by optimizing your SEO crawl budget Read More »
Posted by Dr-Pete In June of 2017, Moz launched our entirely rebuilt Site Crawl, helping you dive deep into crawl issues and technical SEO problems, fix those issues in your Moz Pro Campaigns (tracked websites), and monitor weekly for new issues. Many times, though, you need quick insights outside of a Campaign context, whether you’re
NEW On-Demand Crawl: Quick Insights for Sales, Prospecting, & Competitive Analysis Read More »
Google’s Lisa Wang from the News team announced that some features are being deprecated with the recent update to Google News. As we reported a few weeks ago, the standout and original source tags and Editors’ Picks will be going away. Additionally, a the news crawl error tool in Google Search Console and the ability
