OpenAI says it’s “impossible” to create useful AI models without copyrighted material

"Copyright today covers virtually every sort of human expression" and cannot be avoided.

See full article...

 

[Gryphx]

I don't see a way that we shut down LLM technology because of copyright concerns. This horse has left the barn - LLM capabilities are too valuable for folks in power to walk away from. Do you really think the US Govt is going to say - OK, fair enough, let's pack this thing up - while China powers on full speed ahead? This is strategically significant technology that is potentially only the beginning of an exponential curve. And now that the technology to do this is open source, and scraping of public web content is free use - do we really want to setup constraints so that the only people with the power of frontier LLMs are those with the power and money to do it in secret? Guess what - the NSA has all the training data they could ever want (https://nsa.gov1.info/utah-data-center/) - and I for one want to make sure that EVERYONE has access to the productivity increases made possible by generative AI, not just those with power and influence to do what they desire in secret.

 

[Gryphx]

So if I read a NYT article and learn something that is well within my rights (and the intention of the content). If I read a NYT article and copy it and claim it as my own that is plagiarism. You can use materials to inform and construct your own opinions but you need to make those words or content in your own voice, AI can't do that as it's literally designed to just analyze and replicate already existing content.

That's simply not true, they don't just regurgitate - these frontier models can and do make creative connections between learned data. I regularly hand it unique problems that no one else has ever faced exactly and it generalizes and applies patterns it knows to help me solve my unique situation. I see the problem almost as the fact that it has photographic memory, so at times it's repeating back exact training material, rather then synthesizing it as expected.