Software Engineering for Machine Learning

From experiment to production-level machine learning.

84 resources7 categoriesView Original

Tooling(27 items)

A

Aim

Aim is an open source experiment tracking tool.

Tooling
A

Airflow

Programmatically author, schedule and monitor workflows.

Tooling
A

Alibi Detect

Python library focused on outlier, adversarial and drift detection.

Tooling
A

Archai

Neural architecture search.

Tooling
D

Data Version Control (DVC)

DVC is a data and ML experiments management tool.

Tooling
F

Facets Overview / Facets Dive

Robust visualizations to aid in understanding machine learning datasets.

Tooling
F

FairLearn

A toolkit to assess and improve the fairness of machine learning models.

Tooling
G

Git Large File System (LFS)

Replaces large files such as datasets with text pointers inside Git.

Tooling
G

Great Expectations

Data validation and testing with integration in pipelines.

Tooling
H

HParams

A thoughtful approach to configuration management for machine learning projects.

Tooling
K

Kubeflow

A platform for data scientists who want to build and experiment with ML pipelines.

Tooling
L

Label Studio

A multi-type data labeling and annotation tool with standardized output format.

Tooling
L

LiFT

Linkedin fairness toolkit.

Tooling
M

MLFlow

Manage the ML lifecycle, including experimentation, deployment, and a central model registry.

Tooling
M

Model Card Toolkit

Streamlines and automates the generation of model cards; for model documentation.

Tooling
N

Neptune.ai

Experiment tracking tool bringing organization and collaboration to data science projects.

Tooling
N

Neuraxle

Sklearn-like framework for hyperparameter tuning and AutoML in deep learning projects.

Tooling
O

OpenML

An inclusive movement to build an open, organized, online ecosystem for machine learning.

Tooling
P

PyTorch Lightning

The lightweight PyTorch wrapper for high-performance AI research. Scale your models, not the boilerplate.

Tooling
R

REVISE: REvealing VIsual biaSEs

Automatically detect bias in visual data sets.

Tooling
R

Robustness Metrics

Lightweight modules to evaluate the robustness of classification models.

Tooling
S

Seldon Core

An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models on Kubernetes.

Tooling
S

Spark Machine Learning

Spark’s ML library consisting of common learning algorithms and utilities.

Tooling
T

TensorBoard

TensorFlow's Visualization Toolkit.

Tooling
T

Tensorflow Data Validation (TFDV)

Library for exploring and validating machine learning data. Similar to Great Expectations, but for Tensorflow data.

Tooling
T

Tensorflow Extended (TFX)

An end-to-end platform for deploying production ML pipelines.

Tooling
W

Weights & Biases

Experiment tracking, model optimization, and dataset versioning.

Tooling