MLRun ecosystem

MLRun ecosystem#

This section lists the data stores, development tools, services, platforms, etc., supported by MLRun's open ecosystem.

In this section

Data stores#

  • Object (S3, GS, GCS, az)

  • Files, NFS

  • dbfs

  • V3IO

Sources#

  • BigQuery

  • SnowFlake

  • SQL

  • CSV

  • Dataframe

  • Parquet

  • S3/Azure

  • Http

Streaming frameworks#

  • Kafka

  • V3IO-stream

Targets#

  • CSV

  • Kafka

  • Parquet

  • Snowflake

  • Stream

  • NoSQL

  • RedisNoSQL

  • SQL

TSDB#

  • V3IO TSDB

  • TDEngine

Event sources#

  • HTTP

  • Cron

  • Kafka

  • Iguazio V3IO streams

Execution frameworks#

  • Nuclio

  • Spark

  • Dask

  • Horovod/MPI

  • K8s Jobs

Dev environments#

  • PyCharm

  • VSCode

  • Jupyter

  • Colab

  • AzureML

  • SageMaker

  • Codespaces

  • Others (set with environment variables)

Machine learning frameworks#

  • SKLearn

  • XGBoost

  • LGBM

  • TF / Keras

  • PyTorch

  • ONNX

  • Custom

Platforms#

  • Kubernetes

    • AWS EKS

    • Azure AKS

    • GKE

    • VMWare

  • Local (e.g., Kubernetes engine on Docker Desktop)

  • Docker

    • Linux/KVM

    • NVIDIA DGX

CI/CD#

  • Jenkins

  • GitHub Actions

  • GitLab CI/CD

  • KFP

Browser#

MLRun runs on Chrome and Firefox.