【Hannah Harper Archives】

Source：Evergreen Information Network Editor：Social Good Time：2025-06-26 16:53:05

In May,Hannah Harper Archives Reddit announced it would allow OpenAI to train its models on Reddit content for a price. Now, according to The Verge, Reddit will block most automated bots from accessing, learning from, and profiting from its data without a similar licensing agreement.

Reddit plans to do this by updating its robots.txt file, the "basic social contract of the web" that determines how web crawlers can access the site. Most nascent AI companies (including, at one point, OpenAI) train their models on content they've scraped from across the web without considering copyright or the Terms of Service of individual sites.

SEE ALSO: Reddit's traffic is way up – but why? It's Google.

Per The Verge's Alex Heath, search engines like Google got away with this form of scraping thanks to the "give-and-take" of Google sending traffic back to individual sites in exchange for the ability to crawl them for information. Now, AI companies are tipping the balance by taking that same information and providing it to users without sending them back to the sites the information came from.

Mashable Trend Report Decode what’s viral, what’s next, and what it all means. Sign up for Mashable’s weekly Trend Report newsletter. By clicking Sign Me Up, you confirm you are 16+ and agree to our Terms of Use and Privacy Policy. Thanks for signing up!

You May Also Like

Reddit's chief legal officer, Ben Lee, told The Verge that the parameters of robots.txt are not legally enforceable but that publicizing Reddit's intention to enforce its content policy is "a signal to those who don’t have an agreement with us that they shouldn’t be accessing Reddit data."

In a blog post about the change, Reddit noted that "good faith actors – like researchers and organizations... will continue to have access to Reddit content for non-commercial use." These include the Internet Archive, home to the Wayback Machine.

Previous：The best day to book your flight, according to Google

Next：Reality Distortion Field: 10 Things Apple Won't Directly Say But We'll Infer About the iPhone X

【Hannah Harper Archives】

Related Articles

Related Recommendations

Categories

Latest Articles

Popular Articles

Hot Recommendations

Featured Column

Quick Links

Quick Links