azureml-accel-models 1.25.0

Azure Machine Learning Hardware Accelerated models

Easily create and train a model using various deep neural networks (DNNs) as a featurizer for deployment to Azure or a Data Box Edge device for ultra-low latency inference. These models are currently available:

• ResNet 50

• ResNet 152

• DenseNet-121

• VGG-16

• SSD-VGG

Setup

Follow these instructions to install the Azure ML SDK on your local machine, create an Azure ML workspace, and set up your notebook environment, which is required for the next step.

Once you have set up your environment, install the Azure ML Accel Models SDK:

pip install azureml-accel-models

Note:* This package requires you to install tensorflow >= 1.6. This can be done using:

pip install azureml-accel-models[cpu]

If your machine supports GPU, then you can leverage the tensorflow-gpu functionality using:

pip install azureml-accel-models[gpu]

AzureML-Accel-Models

• Create a featurizer using the Accelerated Models

• Convert tensorflow model to ONNX format using AccelOnnxConverter

• Create a container image with AccelContainerImage for deploying to either Azure or Data Box Edge

• Use the sample PredictionClient for inference on a Accelerated Model Host or create your own GRPC client

Resources

• Read more about FPGAs.