:orphan:



.. _sphx_glr_how_to_deploy_models:

Deploy Deep Learning Models
---------------------------

TVM is capable of deploying models to a variety of different platforms. These
how-tos describe how to prepapre and deploy models to many of the supported
backends.



.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="This is an example of using Relay to compile a keras model and deploy it on Android device. ">

.. only:: html

    .. figure:: /how_to/deploy_models/images/thumb/sphx_glr_deploy_model_on_android_thumb.png

        :ref:`sphx_glr_how_to_deploy_models_deploy_model_on_android.py`

.. raw:: html

    </div>


.. toctree::
   :hidden:

   /how_to/deploy_models/deploy_model_on_android

.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="This is an example of using Relay to compile a ResNet model and deploy it on Raspberry Pi. ">

.. only:: html

    .. figure:: /how_to/deploy_models/images/thumb/sphx_glr_deploy_model_on_rasp_thumb.png

        :ref:`sphx_glr_how_to_deploy_models_deploy_model_on_rasp.py`

.. raw:: html

    </div>


.. toctree::
   :hidden:

   /how_to/deploy_models/deploy_model_on_rasp

.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="For us to begin with, PyTorch should be installed. TorchVision is also required since we will b...">

.. only:: html

    .. figure:: /how_to/deploy_models/images/thumb/sphx_glr_deploy_object_detection_pytorch_thumb.png

        :ref:`sphx_glr_how_to_deploy_models_deploy_object_detection_pytorch.py`

.. raw:: html

    </div>


.. toctree::
   :hidden:

   /how_to/deploy_models/deploy_object_detection_pytorch

.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="This is a tutorial on loading models quantized by deep learning frameworks into TVM. Pre-quanti...">

.. only:: html

    .. figure:: /how_to/deploy_models/images/thumb/sphx_glr_deploy_prequantized_thumb.png

        :ref:`sphx_glr_how_to_deploy_models_deploy_prequantized.py`

.. raw:: html

    </div>


.. toctree::
   :hidden:

   /how_to/deploy_models/deploy_prequantized

.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="Welcome to part 3 of the Deploy Framework-Prequantized Model with TVM tutorial. In this part, w...">

.. only:: html

    .. figure:: /how_to/deploy_models/images/thumb/sphx_glr_deploy_prequantized_tflite_thumb.png

        :ref:`sphx_glr_how_to_deploy_models_deploy_prequantized_tflite.py`

.. raw:: html

    </div>


.. toctree::
   :hidden:

   /how_to/deploy_models/deploy_prequantized_tflite

.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="This article is an introductory tutorial of automatic quantization with TVM. Automatic quantiza...">

.. only:: html

    .. figure:: /how_to/deploy_models/images/thumb/sphx_glr_deploy_quantized_thumb.png

        :ref:`sphx_glr_how_to_deploy_models_deploy_quantized.py`

.. raw:: html

    </div>


.. toctree::
   :hidden:

   /how_to/deploy_models/deploy_quantized

.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="This tutorial demonstrates how to take any pruned model, in this case `PruneBert from Hugging F...">

.. only:: html

    .. figure:: /how_to/deploy_models/images/thumb/sphx_glr_deploy_sparse_thumb.png

        :ref:`sphx_glr_how_to_deploy_models_deploy_sparse.py`

.. raw:: html

    </div>


.. toctree::
   :hidden:

   /how_to/deploy_models/deploy_sparse

.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="This article is an introductory tutorial to deploy SSD models with TVM. We will use GluonCV pre...">

.. only:: html

    .. figure:: /how_to/deploy_models/images/thumb/sphx_glr_deploy_ssd_gluoncv_thumb.png

        :ref:`sphx_glr_how_to_deploy_models_deploy_ssd_gluoncv.py`

.. raw:: html

    </div>


.. toctree::
   :hidden:

   /how_to/deploy_models/deploy_ssd_gluoncv
.. raw:: html

    <div style='clear:both'></div>



.. only:: html

 .. rst-class:: sphx-glr-signature

    `Gallery generated by Sphinx-Gallery <https://sphinx-gallery.github.io>`_