Underneath the hood
Getting LLaMA 2 able to launch required a variety of tweaking to make the mannequin safer and fewer prone to spew poisonous falsehoods than its predecessor, Al-Dahle says.
Meta has loads of previous gaffes to study from. Its language mannequin for science, Galactica, was taken offline after solely three days, and its earlier LLaMA mannequin, which was meant just for analysis functions, was leaked on-line, sparking criticism from politicians who questioned whether or not Meta was taking correct account of the dangers related to AI language fashions, akin to disinformation and harassment.
To mitigate the chance of repeating these errors, Meta utilized a mixture of totally different machine studying methods aimed toward bettering helpfulness and security.
Meta’s method to coaching LLaMA 2 had extra steps than standard for generative AI fashions, says Sasha Luccioni, a researcher at AI startup Hugging Face.
The mannequin was skilled on 40% extra knowledge than its predecessor. Al-Dahle says there have been two sources of coaching knowledge: knowledge that was scraped on-line, and a knowledge set fine-tuned and tweaked in line with suggestions from human annotators to behave in a extra fascinating method. The corporate says it didn’t use Meta consumer knowledge in LLaMA 2, and excluded knowledge from websites it knew had plenty of private data.
Regardless of that, LLaMA 2 nonetheless spews offensive, dangerous, and in any other case problematic language, similar to rival fashions. Meta says it didn’t take away poisonous knowledge from the info set, as a result of leaving it in would possibly assist LLaMA 2 detect hate speech higher, and eradicating it may threat by chance filtering out some demographic teams.
Nonetheless, Meta’s dedication to openness is thrilling, says Luccioni, as a result of it permits researchers like herself to check AI fashions’ biases, ethics, and effectivity correctly.
The truth that LLaMA 2 is an open-source mannequin will even permit exterior researchers and builders to probe it for safety flaws, which is able to make it safer than proprietary fashions, Al-Dahle says.
Liang agrees. “I am very excited to attempt issues out and I believe will probably be helpful for the group,” he says.
