SShortSingh.
Back to feed

How to find broken links and redirects in your sitemap.xml

0
·6 views

Sitemaps often drift out of date as pages are deleted, URLs are redirected, and noindex tags are added to listed pages. Search Console reports these problems slowly and only for pages Google has crawled. The article describes a simple shell script using curl to check each sitemap URL's status code and redirect count, while warning about limits such as nested sitemap indexes and redirect chains. It also lists existing tools, including Screaming Frog, lychee and linkchecker, and presents a paid cloud option, the Sitemap Link Checker on Apify, which adds redirect-hop tracking and noindex and canonical checks. The author discloses that they built that cloud tool.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingHacker News ·

Nasdaq Falls 5% as Investors Pull Back from AI Stocks Following Election

The Nasdaq composite dropped about 5% in a sharp selloff as investors retreated from artificial intelligence-related trades. The decline followed the election, according to a Wall Street Journal live coverage report. The source material provided is limited to the headline and article link, so further details on specific causes and individual stock moves could not be confirmed. Market participants appeared to reassess AI-linked valuations in the wake of the vote. The item was shared on Hacker News, where it drew modest attention.

0
ProgrammingDEV Community ·

Why IBM's Granite name became shorthand for built-in AI guardrails

IBM's open Granite family of enterprise AI models has become a metaphor for guardrails, with the name meant to evoke durability and structural integrity. The article says Granite models ship with alignment layers, configurable output filters, and safety mechanisms built in during pretraining, rather than added afterward. It draws a comparison to granite's geological formation, describing safety as embedded in the material instead of bolted on. The metaphor reportedly appears in IBM documentation, technical briefings, and Brazilian regulatory discussions on AI governance. The piece also notes that the models support fine-tuning and retrieval-augmented generation while keeping core safety constraints intact.

0
ProgrammingDEV Community ·

Moving a Lovable Cloud App to Your Own Supabase Project: Step-by-Step

A new guide explains how to migrate an app built on Lovable Cloud to a Supabase project the owner controls. Because Lovable Cloud runs on a Supabase project managed by Lovable, it cannot be linked to a personal account, so the move requires creating a new project, copying the database and files, and switching the app's connection settings. The process covers exporting and restoring the database, which carries user accounts and password hashes, while sessions end and files, secrets, sign-in provider settings and connectors must be transferred manually. The guide advises keeping the old backend running until the new one passes all checks, and deleting nothing in Lovable until verified copies are held.

0
ProgrammingDEV Community ·

How Freelancers Can Deduct AI Subscriptions and API Costs at Tax Time

Self-employed people can generally deduct AI services they pay for as business expenses, though rules differ by country and a local tax authority or accountant should confirm the treatment. Subscriptions like ChatGPT are typically filed under internet or software services, with service fees also commonly accepted, and the same category should be used consistently across years. For accounts used for both work and personal purposes, only the business-use share should be deducted, based on a documented basis such as periodic review of chat history. Pay-as-you-go API charges usually fall under the same category, with foreign-currency costs converted at payment time. Costs like courses, books, and equipment have their own treatment, and avoiding a catch-all miscellaneous category keeps records clearer.