Crawler

Custom Extraction Using an SEO Crawler for CRO and UX Insights - Whiteboard Friday

Custom Extraction Using an SEO Crawler for CRO and UX Insights – Whiteboard Friday

SEO BLOG / By

From e-commerce to listings sites to real estate and myriad verticals beyond, the data you can harness using custom extraction via crawler tools is worth its weight in revenue. With a greater granularity of data at your fingertips, you can uncover CRO and user experience insights that can inform your optimizations and transform your customer …

Custom Extraction Using an SEO Crawler for CRO and UX Insights – Whiteboard Friday Read More »

Bing’s Web Crawler Goes Evergreen, Improves JavaScript Crawling

SEO BLOG / By

Microsoft announced today at Pubcon that Bing is adopting Microsoft Edge to run JavaScript and render webpages with Bingbot. In addition, Bingbot will be continually updated to the latest version of Microsoft Edge going forward, making it evergreen like Googlebot. Microsoft says making these changes will create less fragmentation of the web and make lives …

Bing’s Web Crawler Goes Evergreen, Improves JavaScript Crawling Read More »

TechSEO360 Crawler Guide – Sitemaps and Technical SEO Audits

SEO / By

For 10 years now, the crawler I use for the technical SEO website audits I do at Search Engine People is what’s nowadays called TechSEO360. A hidden gem; cost-effective, efficient (crawls any site of any size), forward looking (e.g.: had AJAX support before other such crawler tools did). I’ve written about this website crawler before …

TechSEO360 Crawler Guide – Sitemaps and Technical SEO Audits Read More »

Google’s web crawler Googlebot now runs on the latest version of Chromium: Why that’s a good thing

SEO BLOG / By

Google announced the launch of a new version of its web crawler Googlebot on Tuesday at the Google I/O developer conference. Googlebot will now be “evergreen,” which means the crawler will always be up-to-date on the latest version of Chromium, the open source browser that Google’s popular Chrome web browser is built on. Chrome 74. …

Google’s web crawler Googlebot now runs on the latest version of Chromium: Why that’s a good thing Read More »