SShortSingh.
Back to feed

Common Crawl's 2026 web graph lost over two-thirds of its links while referring domains held steady

0
·3 views

Common Crawl's monthly domain-level link graphs show the number of domains roughly flat from late 2025 to October 2026, while links between them fell from 6.11 billion to 1.82 billion. The author, who runs a backlink API called crawlgraph, compared two quarterly graphs with no crawls in common and found the link total dropped 45% between them. Counts of referring domains for fourteen established sites changed by only -1% to +15%. However, 22% to 37% of each site's referring domains were not observed in the later graph, with a similar number of new domains appearing in their place, so the totals roughly cancel out. The author advises treating a missing referring domain as a possible observation gap and comparing snapshots that share no source crawls.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingHacker News ·

Ask HN thread invites readers to share current projects and curiosities (November 2026)

A Hacker News 'Ask HN' thread from November 2026 asks community members what they are currently building and what topics have recently caught their interest. The post has drawn 12 points and 8 comments at the time of reporting. It is a community discussion prompt rather than a news event, so no specific projects or announcements are reported in the source material. Readers can follow the linked thread to view individual responses.

0
ProgrammingDEV Community ·

Agent-Written Endpoint Triggers N+1 Queries; Query-Count Test Catches It Early

A developer describes an AI coding agent's GET /orders handler that returned correct data but issued one database query per order, 101 queries for a 100-row page. Existing functional tests passed because they only checked the response body, not the query count. The author shows how the N+1 pattern arises in node-postgres and Express code, even though each line looks correct. To catch it, the author proposes a test helper that wraps the pool's query method to record each SQL statement while still executing it. Running this counter within a test lets a branch fail before the regression is merged.

0
ProgrammingDEV Community ·

Running Qwen3.8-Flash-Next Locally Depends on Total Memory, Not Active Parameters

Qwen3.8-Flash-Next activates only 6B parameters per token, but its GGUF files range from about 66 GB for the smallest 1-bit quant to 111 GB for the common UD-Q4_K_XL. The article argues that total memory, not the card's active parameter count, determines whether the model can run locally. A community llama.cpp benchmark reported 39 tok/s for UD-IQ4_XS with experts held in 96 GB of system RAM and a simulated 24 GB VRAM budget. The n-gram embedding table, about 27 GiB in one quant, can sit in system RAM or be paged from SSD because each token reads only a few rows. Qwen's release is an experimental preview under the qwen-community-1.0 license, which is not Apache 2.0.

0
ProgrammingDEV Community ·

Vietnam and South Korea to Hold AI and Semiconductor Conference in Hanoi on November 12-13

Vietnam's Ministry of Science and Technology has announced the First Vietnam-Korea AI and Semiconductor Conference, scheduled for November 12-13, 2026 in Hanoi. The summit is expected to draw more than 400 delegates, 50 semiconductor and AI companies, research institutes, and universities from both countries. Organizers include the ministry's Department of Digital Technology and AI, FPT Corporation, the Korea AI-Semiconductor Fabless Alliance, and VINASA's semiconductor committee. Discussions will focus on aligning bilateral policy, integrating semiconductor supply chains, and building workforce programs tied to Vietnam's national semiconductor strategy and its initiative to train 50,000 semiconductor and AI engineers.