OpenAI Trained AI Models on Copyrighted O'Reilly Media Books, Researchers Claim

The AI Disclosures Project conducted a test to see if OpenAI’s AI models could identify content from paywalled O’Reilly Media books.

Advertisement
Written by Akash Dutta, Edited by David Delima | Updated: 2 April 2025 18:42 IST
Highlights
  • O’Reilly Media is said to not have any licensing agreement with OpenAI
  • GPT-4o was said to show the highest recognition of copyrighted content
  • Researchers used a membership inference attack in the test
OpenAI Trained AI Models on Copyrighted O'Reilly Media Books, Researchers Claim

As many as 3,962 paragraph excerpts from 34 O’Reilly Media books were used for the test

Photo Credit: Unsplash/ Levart_Photographer

OpenAI might have trained its artificial intelligence (AI) models on copyrighted content, according to a research paper. A recently published paper from the non-profit organisation AI Disclosures Project, the San Francisco-based AI firm's recent large language models (LLMs) showed a higher recognition of copyrighted content compared to its older models. The researchers used a recently developed method called DE-COP to detect copyrighted content in the AI models' training dataset. Notably, the study found that the GPT-4o mini was not trained on the specific copyrighted content.

Researchers Used DE-COP to Test OpenAI's Training Dataset

The study, titled Beyond Public Access in LLM Pre-Training Data, was conducted to check if OpenAI's AI models were trained on non-public book content. For the study, researchers focused on O'Reilly Media, a US online learning platform, which contains numerous copyrighted books. The founder of the platform, Tim O'Reilly, was also one of the co-authors of the study.

The researchers used DE-COP method to test whether the training data of the AI models contained copyrighted material. This is a relatively new test, introduced in a paper published in 2024. The method, also known as a membership inference attack, quizzes an AI model with a multiple-choice test to see whether it can identify copyrighted content from machine-generated paraphrased alternatives.

The researchers used Claude 3.5 Sonnet to paraphrase the copyrighted material. As many as 3,962 paragraph excerpts from 34 O'Reilly Media books were used for the test.

Advertisement

Based on the tests conducted, the researchers claimed to have found that the GPT-4o AI model showed the highest recognition of the copyrighted and paywalled O'Reilly book content with an 82 percent Area Under the Receiver Operating Characteristic Curve (AURUC) score. Notably, the AURUC score is part of the DE-COP method and is derived from the guess rates from the multiple-choice test.

The study also found that older OpenAI AI models, such as GPT-3.5 Turbo, showed lesser content recognition compared to GPT-4o, but still high enough to be significant. However, GPT-4o mini was found not to be trained on the paywalled O'Reilly Media books. The paper states the reason could be that the test is not effective against smaller language models.

 

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

Advertisement

Related Stories

Popular Mobile Brands
  1. Vivo X200 FE Reportedly Listed on BIS, IMDA Websites Ahead of Launch
  2. Realme GT 7 Series: Launch Date, Expected Price in India and More
  1. X Restores Access After Thousands of Users Report X Website and App Not Working
  2. Made in India iPhones Will Still Be Cheaper in the US, Even With Donald Trump's 25 Percent Tariff: GTRI Report
  3. Xiaomi Surpasses Apple to Lead Wearables Market in Q1 2025 With 19 Percent Market Share: Canalys
  4. Vivo X200 FE Reportedly Listed on BIS, IMDA Certification Websites Ahead of Anticipated Launch in India
  5. Oracle Said to Buy $40 Billion of Nvidia Chips for OpenAI's US Data Center
  6. Trump Threatens 25 Percent Tariffs on Apple If iPhones Not Made in US
  7. iPhone 16 Pro Max, iPhone 15, MacBook Air (M4) and More Get Discounts During Vijay Sales Apple Days Sale
  8. Anthropic CEO Dario Amodei Says AI Models Hallucinate Less Than Humans: Report
  9. UK Government Updates Crypto Reporting Guidelines, Mandates Collection of Crypto Transaction Data
  10. Acer Swift Neo WIth Intel Core Ultra 5, Up to 32GB RAM Launched in India: Price, Specifications
Gadgets 360 is available in
Download Our Apps
Available in Hindi
© Copyright Red Pixels Ventures Limited 2025. All rights reserved.