GPTlanguage model of artificial intelligence OpenIA, now they have a serious rival, backed by one of the most important technology companies in the world. And that’s what Targetformerly known as Facebook, released wholesale (Open pre-trained transformer)your own language model with which they intend for the scientific community to apply artificial intelligence solutions to advance their research.

According to Target, OPT has been trained on a huge amount of publicly available data. which allows you to “create creative text, solve basic math problems, answer reading comprehension questions, and more.” The company, led by Mark Zuckerberg, admits that while other high-performance language models exist, access to them means a lot of money to use their APIs.

“This limited access limits the ability of researchers to understand how and why these large language models work, making further efforts to improve their robustness and mitigate known issues such as bias and toxicity difficult,” they add. OPT, but it will be free to use.; as long as it is not used for commercial purposes.

Meta wants the community to know how OPT works

OPT claims to be a language model with 175 billion parameters. The purpose of the meta is not only to allow the community to use it in various areas, but also to understand how it works. To fulfill its mission, OPT includes pre-trained models and, in addition, the necessary code to carry out the training process.

Clearly, the release of such a powerful tool as the OPT could raise concerns about its possible misuse. To avoid this, Meta will only allow access to the model under non-commercial license and strictly focused on research topics. “The model will be made available to academic researchers, those associated with government organizations, civil society and academia, and industry research labs around the world,” they add.

Meta also intends for the AI ​​community to work together to create guidelines for responsible AI and language models. “A much wider segment of the community needs access to these models to conduct research and collectively advance in this area. With the release of the OPT-175B and smaller scale base models, we hope to increase the diversity of opinions that govern ethical considerations.” such technologies,” they comment.

OPT is also a concern

Of course, we are facing an unprecedented movement in the field of artificial intelligence. For the first time, the company makes its language model available to any researcher interested in using it.. In a message from MIT Technology Overview, some professionals in the sector have welcomed the Meta’s actions. But, at the same time, they expressed concern on various issues.

Margaret Mitchell, who worked at Google as an AI ethics researcher, wonders if OPT has really been tested enough to prevent problems like generating disinformation and racist language. “Publishing a large language model in a world where a general audience is likely to use it or be harmed by its production comes with some responsibility.”

Mitchell believes that it is necessary to analyze not only the potential damage that OPT can cause on its own, but also the tools that are developed on its basis. For her part, Emily M. Bender, an expert in linguistic computing at the University of Washington, believes that OPT-based technologies should be given attention: “What will the system be used for? use?” Will you present the results?

Despite their misgivings, they agree that Meta must be transparent with OPT to convey trust to the artificial intelligence community.

While OPT is infiltrating the scientific community, OpenIA, a company co-founded by Elon Musk, continues to do its thing. Barely in November 2021, the GPT-3 API was released so any developer can implement it. Of course, before doing so, they made important changes to their rules to prevent GPT-3 from being used in “among other things, violent, political, hate speech, or adult content.” This is because at the moment the API cannot distinguish whether the content is dangerous or not.

Source: Hiper Textual

Previous articleMuch more than dancing: these are the new features that the Boston Dynamics Spot robot will debut with.
Next articleAn Apple patent provides for an iPad that uses the macOS interface by connecting a keyboard.

LEAVE A REPLY

Please enter your comment!
Please enter your name here