How to Train Generative AI Using Your Company’s Data

  • 📰 HarvardBiz
  • ⏱ Reading Time:
  • 68 sec. here
  • 3 min. at publisher
  • 📊 Quality Score:
  • News: 30%
  • Publisher: 63%

Business News News

Business Business Latest News,Business Business Headlines

The technology to incorporate an organization’s specific domain knowledge into an LLM is evolving rapidly.

Many companies are experimenting with ChatGPT and other large language or image models. They have generally found them to be astounding in terms of their ability to express complex ideas in articulate language. However, most users realize that these systems are primarily trained on internet-based information and can’t respond to prompts or questions regarding proprietary content or knowledge.

These objectives were also present during the heyday of the “knowledge management” movement in the 1990s and early 2000s, but most companies found the technology of the time inadequate for the task. Today, however, generative AI is rekindling the possibility of capturing and disseminating important knowledge throughout an organization and beyond its walls. As one manager using generative AI for this purpose put it, “I feel like a jetpack just came into my life.

While this is perhaps the easiest of the three approaches for an organization to adopt, it is not without technical challenges. When using unstructured data like text as input to an LLM, the data is likely to be too large with too many important attributes to enter it directly in the context window for the LLM. The alternative is to create vector embeddings — arrays of numeric values produced from the text by another pre-trained machine learning model .

Companies adopting these approaches to generative AI knowledge management should develop an evaluation strategy. For example, for BloombergGPT, which is intended for answering financial and investing questions, the system was evaluated on public dataset financial tasks, named entity recognition, sentiment analysis ability, and a set of reasoning and general natural language processing tasks.

 

Thank you for your comment. Your comment will be published after being reviewed.
Please try again later.
We have summarized this news so that you can read it quickly. If you are interested in the news, you can read the full text here. Read more:

 /  🏆 310. in BUSİNESS

Business Business Latest News, Business Business Headlines

Similar News:You can also read news stories similar to this one that we have collected from other news sources.

Entertainment Industry Has High Anxiety About Generative AI: SurveyEntertainment workers fear toll of generative AI on their livelihood — this and more industry insights in exclusive VIP+ and YouGov survey results
Source: Variety - 🏆 108. / 63 Read more »