Gen AI data management

The first stage of a gen AI task is to build an automated ML pipeline for data collection, data preparation, training and evaluation, including data filtering, data processing, labelling, and embeddings.

In this section

• Using LLMs to process unstructured data
• Vector databases
• Guardrails for data management

See also

• Deploying an LLM using MLRun

• Alerts and notifications