EU law index finds the correct article more often than web search in 102-question test
A test of 102 EU compliance questions covering 41 acts, including GDPR, the AI Act and DORA, compared a specialised EU law search index against Exa's web search. Each question was tied to an expected article verified against the law's text before either search was run. The index returned the right article first in 76 cases, versus 34 for Exa, and in the top five results in 96 cases, versus 75. The same pattern held on 20 earlier tuning questions, and the authors noted that web search tended to return guidance pages and explainers rather than the articles themselves. Six questions had no correct article in the index's top five, three of them concerning VAT, and English is the only language tested so far.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.


Discussion (0)
Log in to join the discussion and vote.
Log in