Project: mlserver-mlflow

MLflow runtime for MLServer

Project Details

Latest version
1.3.5
Home Page
https://github.com/SeldonIO/MLServer.git
PyPI Page
https://pypi.org/project/mlserver-mlflow/

Project Popularity

PageRank
0.0021079462833816834
Number of downloads
179018

MLflow runtime for MLServer

This package provides a MLServer runtime compatible with MLflow models.

Usage

You can install the runtime, alongside mlserver, as:

pip install mlserver mlserver-mlflow

Content Types

The MLflow inference runtime introduces a new dict content type, which decodes an incoming V2 request as a dictionary of tensors. This is useful for certain MLflow-serialised models, which will expect that the model inputs are serialised in this format.

The `dict` content type can be _stacked_ with other content types, like
[`np`](../../docs/user-guide/content-type).
This allows the user to use a different set of content types to decode each of
the dict entries.