Latest Technical SEO News - Page 4
Crawling changes, algorithm updates, rendering fixes, and structured data developments as they happen.
-
A WordPress host silently blocked AI training bots on one site
Logs and curl tests in Search Engine Land show WP Engine refusing ClaudeBot, GPTBot and Amazonbot while PerplexityBot got through, plus a test for your host.
-
Google indexed Next.js pages with an empty title and no canonical
A site owner set Next.js htmlLimitedBots to serve Googlebot blocking metadata, yet Search Console's crawled copy of two of three pages had no canonical or hreflang.
-
Search Console flags failed page resources that logs show loaded
A WooCommerce owner saw URL Inspection mark images and fonts as Other error while logs showed 200 OK. Replies point to the live test's limits and no-cache headers.
-
Google signs some AI agent requests so sites can spot fakes
Google's experimental Web Bot Auth signs some Google-Agent requests with keys published at agent.bot.goog, yet Google still says to keep IP and reverse DNS checks.
-
Google's AI search splits long questions into smaller searches
Google's Liz Reid says AI Mode gets longer, need-based queries that Google breaks apart; SEJ argues each part's classic ranking decides which pages get cited.
-
Check server logs before blocking millions of news tag pages
An r/TechSEO thread on a news site with millions of tag and author pages weighs noindex against robots.txt disallow, and puts a server log check before both.
-
Google says AI agents need real buttons and stable page layouts
Google's web.dev guide says AI agents read pages through screenshots, raw HTML and the accessibility tree, so a div styled as a button can leave them guessing.
-
Test chatbots with web search off to see where brand errors start
Jes Scholz's Search Engine Land piece sorts AI brand errors into training, retrieval and generation faults, with tests for each and fixes via sameAs and schema.
-
Migration rollbacks should hinge on lost revenue, not traffic dips
Candour's Brendan Bennett, in a Sitebulb guide, sets pre-agreed revenue and lead thresholds as the rollback trigger and lists data and crawl checks to run first.
-
Web Components no longer need JavaScript to show their content
DebugBear explains how a template with the shadowrootmode attribute puts shadow DOM content in server HTML, and what that does for Core Web Vitals and crawlers.
-
Google-only SEO misses Bing in Japan and Naver in South Korea
StatCounter puts Bing at 31.63% in Japan and Naver near parity with Google in Korea, while telcos bundle Perplexity and Gemini for hundreds of millions of users.
-
OpenAI's search crawler now outpaces its training bot in logs
Botify's analysis of about 7 billion log events finds OAI-SearchBot up 3.5x since GPT-5, and OpenAI's docs show GPTBot blocks do not cover ChatGPT search.
-
Yoast SEO lets AI tools and dashboards read its content scores
Yoast SEO registers its SEO, readability and inclusive language scores with the WordPress 6.9 Abilities API, so a connected assistant can query recent posts.
-
A fake Google core update ranked on page one and in AI Overviews
An SEO published an AI-hallucinated core update as a test. Google ranked it, AI Overviews repeated it, and other SEO sites copied it with invented details.
-
Chrome feature can leave Web Components empty if one script fails
Chrome 146's scoped registries make components in server-rendered shadow roots wait for a setup script, and global definitions no longer apply.
-
ChatGPT reportedly gets Google results from a scraping service
Botify says OpenAI, Meta and Perplexity reportedly buy scraped Google results from SerpAPI, and explains the jobs of GPTBot, OAI-SearchBot and ChatGPT-User.
-
AI search may read only a couple hundred words of your page
Dan Petrovic's breakdown for Sitebulb traces how AI search rewrites a prompt, scores page passages with a cross-encoder and hands the model extracted snippets.
-
Most AI Overview citations come from pages outside the top 10
Ahrefs checked 863,000 keywords and found 38% of AI Overview citations rank in the top 10, down from 76%, and ties the gap to Google's query fan-out sub-searches.
-
A noindex tag does not stop AI bots from using your bandwidth
Botify ties rising AI crawler traffic to bandwidth and uptime costs. Google's docs show why noindex cannot cut that load: bots must fetch the page to read it.
-
Indexed in Search Console does not mean Google will show the page
A Reddit thread asks why indexed blog posts don't show in Google. Google's guide separates indexing from serving, and the Performance report shows which one failed.
