Tracking Twitter Spaces in Python: separating Space records from other row types
A scheduled Twitter Space can drop out of a tracker simply because it has started, so an upcoming-only filter cannot show what happened to earlier entries. The article explains that the spaceState filter also applies to exact links, so filtered pulls cannot establish a Space's later status. It recommends using discovery to find Spaces, then keeping their identities across runs. Only rows of type "space" should be counted as Spaces, since other record types merely reference them through spaceId. The author proposes a DuckDB schema that stores the cohort, requested IDs, snapshots and problem rows between runs, with missing follow-ups never shrinking the cohort automatically.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)
Log in to join the discussion and vote.
Log in