Replay test finds 17 stable mismatches between API examples and live responses
A team checked whether the sample request-and-answer examples its paid endpoints publish actually match what the handlers return. They replayed 1,602 services over loopback and compared each real response against its advertised example. Of these, 1,444 matched, while 141 varied naturally and 8 were exempt timestamp fields. The 17 stable mismatches were mostly time-derived or upstream data that changes often, plus one genuine defect in a DNS endpoint that returned A records in inconsistent order. The fix was a small deterministic sorting step, verified by repeated calls producing identical bytes.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in