SShortSingh.
TopTechnologyAI & MLStartupsProgrammingScienceBusinessFinanceCrypto & Web3World
Back to feed
Programming

1,000 results, 641 unique jobs — deduping by URL fails because every board rewrites the query string

0
·1 views

A user's job-matching agent kept ranking near-identical listings against each other, burning tokens and crowding out real candidates. I pulled a sample to investigate: one search for "data engineer" in Berlin returned 1,000 results — and 359 of them were duplicates of other entries in the same result set. My dedup key was the URL. That was the bug. Job boards rewrite URLs for tracking.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingDEV Community ·

What Open Source Has Taught Me So Far

What Open Source Has Taught Me So Far I started contributing to open source because I wanted to learn how real projects are built outside of tutorials. Over time, I got comfortable working with technologies like React, Node.js, TypeScript, MongoDB, Next.js, and REST APIs. But the biggest learning didn't come from the technologies themselves. It came from reading someone else's code, understanding an existing codebase, opening issues, reviewing pull requests, fixing bugs, and learning how to communicate with other developers. Being involved in open source has also taught me that you don't need

0 comments Read more at DEV Community
0
ProgrammingDEV Community ·

Core Web Vitals: What Cloudflare's BEACON Data Says to Fix First

I have a bad habit with performance work. I open Lighthouse, see a red number, and start fixing whatever the report lists first. Usually that's an image that's 40KB too big. It feels productive, and it moves the score, and half the time it has nothing to do with what my client's users actually wait for. So when Cloudflare released a dataset of real-user measurements from about 10,000 of the biggest sites on its network, I read the BEACON announcement with a specific question: if I had one afternoon to improve Core Web Vitals on a normal client site, where should it go?

0 comments Read more at DEV Community
0
ProgrammingDEV Community ·

Keeping large chart previews and CSV exports consistent

A user loads a year of minute candles, zooms out to see the whole period, then downloads a CSV. The file should retain the selected resolution even if the chart has to combine candles to draw that view. That requirement connects several parts of a browser export tool: the dataset, viewport, pagination loop, Cancel button and file writer. Each can make a different decision about how much data it needs. Those decisions should remain visible to the user.

0 comments Read more at DEV Community
1,000 results, 641 unique jobs — deduping by URL fails because every board rewrites the query string · ShortSingh