mirrors
/
mmdeploy
mirror of https://github.com/open-mmlab/mmdeploy.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
mmdeploy/docs/en/05-supported-backends/vacc.md

1.6 KiB
Raw Blame History

VACC Backend

  • cmake 3.10.0+
  • gcc/g++ 7.5.0
  • llvm 9.0.1
  • ubuntu 18.04

PCIE

1.package

  • dkms (>=1.95)
  • linux-headers
  • dpkg (Ubuntu)
  • rpm (CentOS)
  • python2
  • python3

Check if there is a vacc card：lspci -d:0100

  1. Requirements

    sudo apt-get install dkms dpkg python2 python3

  2. install driver

    sudo dpkg -i vastai-pci_xx.xx.xx.xx_xx.deb

  3. Verify installation

    dpkg --status vastai-pci-xxx

#output
Package: vastai-pci-dkms
Status: install ok installed
……
Version: xx.xx.xx.xx
Provides: vastai-pci-modules (= xx.xx.xx.xx)
Depends: dkms (>= 1.95)
Description: vastai-pci driver in DKMS format.

lsmod | grep vastai_pci

#output
vastai_pci        xxx  x

  4. Upgrade driver

    sudo dpkg -i vastai-pci_dkms_xx.xx.xx.xx_xx.deb

  5. Uninstall driver

    sudo dpkg -r vastai-pci_dkms_xx.xx.xx.xx_xx

2.reboot pcie

sudo chmod 666 /dev/kchar:0 && sudo echo reboot > /dev/kchar:0

SDK

step.1

pip install torch==1.8.0 torchvision==0.9.0 torchaudio==0.8.0
pip install onnx==1.10.0 tqdm==4.64.1
pip install h5py==3.8.0
pip install decorator==5.1.1 scipy==1.7.3

step.2

sudo vi ~/.bashrc

export VASTSTREAM_PIPELINE=true
export VACC_IRTEXT_ENABLE=1
export TVM_HOME="/opt/vastai/vaststream/tvm"
export VASTSTREAM_HOME="/opt/vastai/vaststream/vacl"
export LD_LIBRARY_PATH=$TVM_HOME/lib:$VASTSTREAM_HOME/lib
export PYTHONPATH=$TVM_HOME/python:$TVM_HOME/vacc/python:$TVM_HOME/topi/python:${PYTHONPATH}:$VASTSTREAM_HOME/python

source ~/.bashrc