Meta unveils new machine learning language model in ongoing AI investment
MF3d

Meta Platforms (NASDAQ:META) is jumping anew into the artificial intelligence news cycle with the reminder that it too is making heavy investments in the space - publicly releasing a new large language model (the AI field that has brought developments like OpenAI's GPT-3).
"As part of Metaâs commitment to open science, today we are publicly releasing LLaMA (Large Language Model Meta AI), a state-of-the-art foundational large language model designed to help researchers advance their work in this subfield of AI," the company said.
Such LLMs have shown new potential to generate creative text, solve math theorems, predict protein structures and much more, Meta said. Recently notable have been the takeoff of chatbots like ChatGPT, and AI advancements brought into Microsoft's (MSFT) Bing search engine.
Meta's LLaMA isn't so much for talking to as for advancing research, though. The company is making LLaMA available at several sizes, it says, for flexibility in addressing tasks. LLaMA 65B and LLaMA 33B were trained on 1.4T tokens, or pieces of words; the smallest model, LLaMA 7B, is trained on 1T tokens.
And Meta says one of its LLaMA models does better than GPT-3 on "most benchmarks."
That model, once it's trained, can also run on a single Nvidia (NVDA) Tesla V100 GPU - allowing for some smaller institutions to run tests using LLaMA. Meta noted that along with the power to "democratize the access" of LLMs due to their small nature, that ability to run on a single GPU also helps reduce carbon emissions.
Last year, Meta released a large language model that became the center of a version of its BlenderBot chatbot.