Latest news with #Llama1
Time of India
16-06-2025
- Science
- Time of India
Why Facebook-parent Meta may face same 'AI copying' problem as ChatGPT-maker OpenAI, Microsoft
Representative image Facebook parent Meta 's newest AI model, Llama 3.1, has been found to replicate passages from well-known books, including Harry Potter, far more frequently than anticipated, as per a new report which also says that many of these works remain under copyright. Researchers claim that the AI has memorised roughly 42% of the first Harry Potter book and can accurately reproduce 50-word sections about half the time. The study, conducted by experts from Stanford, Cornell, and West Virginia University, examined how five leading AI models processed the Books3 dataset, which includes thousands of copyrighted titles. "Llama 3.1 70B—a mid-sized model Meta released in July 2024—is far more likely to reproduce Harry Potter text than any of the other four models, the researchers found . "Interestingly, Llama 1 65B, a similar-sized model released in February 2023, had memorized only 4.4 percent of Harry Potter and the Sorcerer's Stone. This suggests that despite the potential legal liability, Meta did not do much to prevent memorization as it trained Llama 3. At least for this book, the problem got much worse between Llama 1 and Llama 3," the researchers wrote. Meta's Llama 3.1 has been noted for retaining large portions of well-known books, including The Hobbit, 1984, and Harry Potter and the Sorcerer's Stone. In contrast, earlier versions, such as Llama 1, only memorized around 4% of Harry Potter. This suggests that the newer model is preserving significantly more copyrighted content. Why Meta's models are reproducing exact text Researchers suggest several reasons why Meta's AI models may be copying text verbatim. One possibility is that the same books were repeatedly used during training, reinforcing memorisation rather than generalising language patterns. Others speculate that training data could include excerpts from fan websites, reviews, or academic papers, leading the model to inadvertently retain copyrighted content. Additionally, adjustments to the training process may have amplified this issue without developers realizing the extent of its impact. What this means for Meta These findings intensify concerns about how AI models are trained and whether they might be violating copyright laws. As authors and publishers push back against unauthorised use of their work, this could become a major challenge for tech companies like Meta. Earlier this year, The New York Times sued OpenAI and Microsoft for copyright infringement, alleging that their AI models, including ChatGPT, were trained on copyrighted articles without permission. According to the Times, OpenAI, 'can generate output that recites Times' content verbatim, closely summarizes it, and mimics its expressive style.' It said that the AI company essentially stole their intellectual property. AI Masterclass for Students. Upskill Young Ones Today!– Join Now
Time of India
09-05-2025
- Business
- Time of India
Meta appoints former Google DeepMind director Robert Fergus as head of AI Research lab
Representative image Facebook parent Meta has informed its staff that the company has appointed former Google DeepMind director Robert Fergus to lead its artificial intelligence research lab. According to a report by Bloomberg, Fergus will head the Fundamental AI Research (FAIR) lab at Meta. Fergus co-founded the Facebook AI Research lab (FAIR) along with Yann LeCun in 2014. Operation Sindoor IPL 2025 suspended as India-Pakistan tensions escalate Pakistan appeals for loans citing 'heavy losses', later says X account hacked Can Pakistan afford a war with India? Here's a reality check The unit takes care of AI research at the company. The FAIR lab creates models of advanced robotics, generate audio and further push boundaries of AI capabilities. As per Fergus LinkedIn profile, he was associated with Google DeepMind as a research director for five years. Before joining Google, Fergus was working with Meta as a research scientist. As per the report, Chief Product Officer Chris Cox informed the Meta employees that Fergus has joined FAIR labs and has succeeded Joelle Pineau , who announced departure plans last month. 'We're working towards building human-level experiences that transform the way we interact with technology and are dedicated to leading and advancing AI research,' Fergus said in a post on LinkedIn. by Taboola by Taboola Sponsored Links Sponsored Links Promoted Links Promoted Links You May Like New Container Houses Vietnam (Take A Look At The Prices) Container House | Search Ads Search Now Undo According to a report from Fortune, FAIR led research on the company's early AI models, including Llama 1 and Llama 2. However, the report states that many researchers have departed FAIR for other startups, companies, and even Meta's newer GenAI group, which spearheaded the development of Llama 4. AI Masterclass for Students. Upskill Young Ones Today!– Join Now
