Authors' brief claims OpenAI downloaded millions of pirated books to train GPT-3

·1 views

A summary-judgment brief filed September 17 by class-action plaintiffs alleges OpenAI downloaded around 117,500 books from piracy site Library Genesis in 2018, later torrenting roughly 35 TB of data matching its full 4.6-million-book collection. Internal Slack messages, depositions, and a document Sam Altman shared with Bill Gates in April 2019 are cited as evidence, with Altman's note explicitly referencing 'another ~11B words from Library Genesis.' The GPT-3 paper publicly labeled these datasets 'Books1' and 'Books2,' and in 2022 OpenAI deleted them via a Slack channel initially called #excise-libgen. The lawsuit, Alter v. OpenAI and Microsoft, is filed in Manhattan federal court and includes authors such as George R.R. Martin, John Grisham, and Jodi Picoult, covering 194 of their works. OpenAI and Microsoft deny wrongdoing, citing fair use; no ruling has been issued and a hearing is expected in early 2027.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Developer Rebuilds AI Agent Certification After Finding Results Were Non-Deterministic

A developer building HivePlane, an AI agent control plane, ran a field test expecting three pre-built agents to register and certify successfully, but all three failed on day one due to missing dependencies and incompatible environments. The failures revealed a broader portability problem: agents that work within their home repository are not guaranteed to run elsewhere. Further testing exposed a critical flaw where LLM-driven outputs caused certification results to vary across runs, rendering them statistically meaningless. To isolate the control plane's performance from model unpredictability, the developer replaced the original agents with deterministic shims backed by mock tools and fixed data seeds. The redesigned tests ultimately produced consistent, repeatable results — with both test agents passing certification across multiple consecutive runs with signed attestations.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

How to Detect Missing Database Indexes in Small Test Tables Using PostgreSQL

A common blind spot in test suites is the failure to catch missing database indexes when test tables contain only a small number of rows. PostgreSQL's query planner legitimately chooses sequential scans over index scans on small tables, making Seq Scan detection unreliable as a test signal. The workaround involves setting the PostgreSQL planner flag enable_seqscan to off, which penalises sequential scans and forces the planner to reveal whether a usable index exists. If a query still shows a Seq Scan after this setting is applied, it confirms that no suitable index is available, regardless of table size. This technique can be integrated into test frameworks like pytest with SQLAlchemy to automatically flag unindexed queries during development.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Anthropic Launches CCDV-F Certification Exam for Claude Developers

Anthropic has introduced the Claude Certified Developer Foundations (CCDV-F) exam, a proctored certification designed to validate professionals' ability to build and deploy production-grade applications using the Claude platform. The 53-question exam costs $125, runs for 120 minutes, and requires a scaled passing score of 720 out of 1,000. It targets technical professionals such as AI engineers and senior software engineers, with recommended experience of one to five years in software engineering and at least six months working with Claude or similar large language model systems. The exam content spans eight domains, with Applications and Integration carrying the highest weight at 33.1%, followed by Model Selection and Optimization at 16.8%. Certification remains valid for 12 months from the award date, and no mandatory prerequisites or prior courses are required to sit the exam.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Developer Ports Retro RPG Cowboy Casino to Custom C++ Engine VileEngine

A developer is porting Cowboy Casino, a small wild-west role-playing game, into VileEngine, a custom C++ engine built for retro-style games. The project involves more than a simple renderer swap, requiring migration of overworld maps, room transitions, dealer logic, dialogue, save systems, and audio. Key milestones already completed include the campaign map, collision layers, table sessions, versioned save data, converted artwork, and new audio loops. The release build is the next public milestone, with the original game remaining available on itch.io in the meantime. The port is also serving as a practical stress test for VileEngine itself, validating its scene, audio, and editor systems against a real game's demands.

0 comments Read more at DEV Community