Yet Sernau asserted that the real threat to Google is coming from open-source communities, where engineers are speedily advancing models that rival the quality of those at big tech companies, and can be made more cheaply.“We have no secret sauce,” Sernau wrote. “Our best hope is to learn from and collaborate with what others are doing outside Google.” He expressed concern that clients would not be willing to pay for models with such high-quality technology on offer for free.
In February, a large language model created by Meta leaked out into the open, jump-starting progress on generative AI in open-source forums.is smaller than the models that Google and OpenAI have been touting, making it easier to work with; researchers currently have to apply to Meta to access LLaMA.“Giant models are slowing us down,” the engineer wrote. “In the long run, the best models are the ones which can be iterated upon quickly.