MLRun ecosystem#

This section lists the data stores, development tools, services, platforms, etc., supported by MLRun's open ecosystem.

Data stores#

  • Object (S3, GS, az)

  • Files, NFS

  • Pandas/Spark DF

  • BigQuery

  • Snowflake

  • Databricks

  • Redis

  • Iguazio V3IO object/key-value

  • SQL sources

Event sources#

  • HTTP

  • Cron

  • Kafka

  • Iguazio V3IO streams

Execution frameworks#

  • Nuclio

  • Spark

  • Dask

  • Horovod/MPI

  • K8s Jobs

Dev environments#

  • PyCharm

  • VSCode

  • Jupyter

  • Colab

  • AzureML

  • SageMaker

  • Codespaces

  • Others (set with environment variables)

Machine learning frameworks#

  • SKLearn

  • XGBoost

  • LGBM

  • TF / Keras

  • PyTorch

  • ONNX

  • Custom

Platforms#

  • Kubernetes

    • AWS EKS

    • Azure AKS

    • GKE

    • VMWare

  • Local (e.g., Kubernetes engine on Docker Desktop)

  • Docker

    • Linux/KVM

    • NVIDIA DGX

CI/CD#

  • Jenkins

  • Github Actions

  • Gitlab CI/CD

  • KFP

Browser#

MLRun runs on Chrome and Firefox.