Developer builds YouTube monitor that bypasses Data API quota limits using public HTML
A developer created a tool to track new YouTube videos on specific topics without using the official YouTube Data API, which imposes a daily quota of just 100 searches. The approach works by scraping the public search results page, which embeds full video data as a JSON blob in the HTML without requiring an API key. A key challenge was handling multiple video component types — including videoRenderer, lockupViewModel, and shortsLockupViewModel — each with different data structures, which initially caused many results to be missed. Shorts videos, for instance, lack exact publish timestamps, so the developer flagged approximate time fields clearly to prevent misuse. The tool also accounts for silent blocking by YouTube, which returns a normal HTTP 200 status but with a much smaller page, detectable only by checking response size.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)
Log in to join the discussion and vote.
Log in