Marquez

LF AI & Data Foundation Graduated project for metadata collection, aggregation, and visualization. Maintains provenance of how datasets are consumed and produced with global visibility into job runtime and dataset lifecycle management. Integrates with OpenLineage. Apache 2.0 licensed.

View on GitHub Unknown

Guide pending

We haven't written this guide yet.

Guides are drafted from the project's own README and metadata. Until one exists, check the product's repository and documentation for authoritative information.

Nearby on the map

Related projects

MLflow

mlflow/mlflow

End-to-end open platform for the ML/LLM lifecycle.

unknown unknownactivity unknown

DVC (Data Version Control)

iterative/dvc

Git-like versioning for data and models.

unknown unknownactivity unknown

ClearML

clearml/clearml

Open-source platform for experiment tracking, orchestration, data management, and model serving.

unknown unknownactivity unknown

Weights & Biases Weave

wandb/weave

Open-source tracing and experiment tracking.

unknown unknownactivity unknown

Aim

aimhubio/aim

Self-hosted ML experiment tracker designed to handle 10,000s of training runs with performant UI and SDK for programmatic access. Apache 2.0 licensed.

unknown unknownactivity unknown

Feast

feast-dev/feast

Open source feature store for ML. Manages offline/online feature storage with point-in-time correctness to prevent data leakage. Apache 2.0 licensed.

unknown unknownactivity unknown