Signup Page Rejected From Google Index Due to X-Robots-Tag noindex Header
A developer team with 2,478 known pages but only 208 indexed requested indexing for ten pages through Google Search Console's URL Inspection tool. Nine were accepted and queued for priority crawling, while their new signup page was rejected. The rejection came from a noindex directive in an HTTP X-Robots-Tag header, not from a meta tag or robots.txt. The team noted that auth-related pages often receive blanket noindex rules from middleware, which can accidentally affect pages meant to rank. They recommended checking response headers with curl and testing specific routes, since the Request Indexing tool only places pages in a priority queue and does not guarantee inclusion.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)
Log in to join the discussion and vote.
Log in