Meta's Llama model has memorized Harry Potter and private society swinger sex videothe Sorcerer's Stoneso well that it can reproduce verbatim excerpts from 42 percent of the book, according to a new study.
Researchers from Stanford, Cornell, and West Virginia University analyzed dozens of books from the now-infamous Books3 dataset, a collection of pirated books used to train Meta's Llama models. Books3 is also at the center of a copyright infringement lawsuit against Meta,Kadrey v. Meta Platforms, Inc.The study's authors say their findings could have major implications for AI companies facing similar lawsuits.
According to the research paper, the Llama 3.1 model "memorizes some books, like Harry Potterand 1984, almost entirely." Specifically, the study found that Llama 3.1 has memorized 42 percent of the first Harry Potter book so well that it can reproduce verbatim excerpts at least 50 percent of the time. Overall, Llama 3.1 could reproduce excerpts from 91 percent of the book, though not as consistently.
"The extent of verbatim memorization of books from the Books3 dataset is more significant than previously described," said the paper. But the researchers also discovered that "memorization varies widely from model to model and from book to book within each model, as well as varying in different parts of individual books." For example, the study estimated that Llama 3.1 only memorized 0.13 percent of Sandman Slimby Richard Kadrey, one of the lead plaintiffs in the class action copyright suit against Meta.
So, while some of the paper's findings seem damning, don't call it a smoking gun for plaintiffs in AI copyright infringement cases.
"These results give everyone in the AI copyright debate something to latch on to," wrote journalist Timothy B. Lee in his Understanding AI newsletter. "Divergent results like these could cast doubt on whether it makes sense to lump J.K. Rowling, Richard Kadrey, and thousands of other authors together in a single mass lawsuit. And that could work in Meta’s favor, since most authors lack the resources to file individual lawsuits."
Why is Llama able to reproduce some books more than others? "I suspect that the difference is because Harry Potter is a much more famous book. It's widely quoted and I'm sure that substantial excerpts from it on third-party websites found their way into the training data on the web," said James Grimmelmann, a professor of digital and information law at Cornell University, who was cited in the paper.
What this also shows, Grimmelmann said, is that "AI companies can make choices that increase or reduce memorization. It's not an inevitable feature of AI; they have control over it."
Meta and other AI companies have argued that using copyrighted works to train their models is protected under fair use, a complex legal doctrine. However, the extent of memorization could complicate those arguments.
“Yes, I do think that the likelihood that LLMs are memorizing more than previously thought changes the copyright analysis,” Robert Brauneis, a professor with the George Washington University Law School, said in an email to Mashable. He concluded that the study’s findings could ultimately weaken Meta’s fair use argument.
We asked Meta for comment on the study's findings, and we'll update this article if we receive a response.
Disclosure: Ziff Davis, Mashable’s parent company, in April filed a lawsuit against OpenAI, alleging it infringed Ziff Davis copyrights in training and operating its AI systems.
Topics Artificial Intelligence Meta
Skywatching is lit in May, says NASA
The 12 best Android apps of 2016
This Christmas card is definitely not what it seems
29 boozy gifts for the whiskey lover in your life
Fritz vs. Ruud 2025 livestream: Watch Madrid Open for free
India announces its largest solar rooftop tender
Verizon refuses to push out Samsung's Galaxy Note 7 kill switch
The 12 best Android apps of 2016
Best smartwatch deal: Save $40 on the Fitbit Versa 4
The 12 best iPhone apps of 2016
Watch how an old Venus spacecraft tumbled before crashing to Earth
This pro baseball player is willing to go anywhere — except Oakland
Someone made a tiny piano app for the MacBook Touch Bar
Surprise! Taylor Swift and Zayn team up for '50 Shades Darker' soundtrack
NYT Connections hints and answers for April 25: Tips to solve 'Connections' #684.
Singapore museum adds an interactive virtual forest
Please enjoy this young poultry connoisseur's chicken shop reviews
Samsung is taking a drastic step to permanently end the Galaxy Note 7 fiasco
Best JBL deal: Save $80 on JBL Xtreme 4 portable speaker
Rogue groin? When filming a 'Star Wars' movie went kind of NSFW
Working at “The Onion”: Adventures in TastelessnessiPhone 14 vs iPhone 15 price comparison: Which is the better value?Tomi Ungerer on Drawing, Politics, and Pushing the EnvelopeWhy Did the Phrase “Brown Study” Fall Out of Fashion?For Hollywood, scary AI is an old trope. It's now a true threat.Apple Watch Ultra 2 preorder details: How to buy it nowFor Bonnie Slotnick’s Cookbook Store, a Fresh StartCambridge Dictionary announces its word of the year for 2021How verification will change online porn foreverApple launches iPhone 15 Pro and Pro Max with titanium body and new camerasStephen King tweets his 'Pet Sematary: Bloodlines' reviewW. H. Auden‘s Undergraduate Syllabus: 6,000 Pages of ReadingAnnouncing the Winner of Our Windows on the World ContestWordle today: Here's the answer and hints for September 13John Bayley on the Difference Between British Wit and HumorApple Watch's new Double Tap is a reimagining of an accessibility featureCan TikTok's algorithm tell when you’ve had your heart broken?Apple iPhone 15 launch event forgot to bring the funThe Best Breakup Song: Thomas Wyatt’s “They Flee From Me”Staff Picks: Getting On, Getting Away, Getting Organized! by The Paris Review ‘QAnon Shaman’ is seen leading the charge as pro A Girl with a Mind by Sadie Stein Twitter Blue subscribers get 25,000 What We’re Loving: Illuminations and Despair by The Paris Review Does 'Indiana Jones and the Dial of Destiny' have a post The internet celebrates Trump's Twitter suspension with snarky memes Aesthetically Speaking by Ivan Brunetti Where’s Leo? by Lindsay Gellman TikTok Now, the BeReal clone you never used, is being discontinued Telegram to launch its own version of Stories Poetry Must Still Dance: An Interview with Ange Mlinko by Tyler Bourgoise Farewell, Iain Banks, and Other News by Sadie Stein Dolly Parton, Our Lady of Free Books, and Other News by Sadie Stein 'Quordle' today: See each 'Quordle' answer and hints for June 28 DoorDash will now process SNAP and EBT online payments OpenAI is being sued for training ChatGPT with 'stolen' personal data 3 Stories of God: 5, 6, and 7 by Joy Williams Lonely Thinking: Hannah Arendt on Film by Roger Berkowitz Philosophy of Teenagers by Sadie Stein Wordle today: Here's the answer and hints for June 28
1.0318s , 8611.8125 kb
Copyright © 2025 Powered by 【private society swinger sex video】,Evergreen Information Network