The MLOps Ecosystem
When it comes to MLOps, no one tool can do it all. It takes an array of best-of-breed tools to truly automate the entire ML lifecycle. That’s why we’re proud founding members of the AI Infrastructure Alliance (AIIA) a global organization of more than 50 of the most cutting edge companies in AI/ML, working together to build seamless integration points and clean APIs for machine learning.
The Machine Learning Lifecycle
-
Prepare
Data, Collection, Preparation, Labeling
-
Experiment
Exploration, Development, Feature, Engineering
-
Train
ML Model Training, Evaluation/Selection, Monitoring
-
Deploy
Model Deployment & Serving, Inference Monitoring
The AI Infrastructure Alliance Wants to Build a ‘Canonical Stack’
Band of AI startups launch ‘rebel alliance’ for interoperability
The Machine Learning Tech Stack
Use the diagram below to see where Pachyderm and other AIIA members fit into the ML Tech Stack
Integrations
Pachyderm integrates with a wide variety of solutions in the ML Tech Stack, and provides sample code and examples for the following partners.
Cloud Deployment in a Snap with Azure
Streamlined cloud deployment of Pachyderm on Azure for integrated ML data pipelines with automated scale and lineage.
ML Lifecycle Management with Seldon
Deploying Seldon and Pachyderm together lets you pull in data from anywhere, build complex models and push them to production with ease.
Version control for data labeling
Now, Label Studio and Pachyderm are integrated to make it super simple to automate data versioning and lineage for labeling datasets – never lose track of your labels or data.
Experimentation and data engineering unified
Uniting ClearML’s comprehensive experimentation and visualization with Pachyderm’s data orchestration engine delivers a complete ML experience.
Other partners
See Pachyderm In Action
Watch a short 5-minute demo which outlines the product in action