98 lines
1.7 KiB
Markdown
98 lines
1.7 KiB
Markdown
# VACC Backend
|
|
|
|
- cmake 3.10.0+
|
|
- gcc/g++ 7.5.0
|
|
- llvm 9.0.1
|
|
- ubuntu 18.04
|
|
|
|
## PCIE
|
|
|
|
### 1.package
|
|
|
|
- dkms (>=1.95)
|
|
- linux-headers
|
|
- dpkg (Ubuntu)
|
|
- rpm (CentOS)
|
|
- python2
|
|
- python3
|
|
|
|
查看是否有瀚博推理卡：`lspci -d:0100`
|
|
|
|
1. 环境准备
|
|
|
|
```bash
|
|
sudo apt-get install dkms dpkg python2 python3
|
|
```
|
|
|
|
2. driver安装
|
|
|
|
```bash
|
|
sudo dpkg -i vastai-pci_xx.xx.xx.xx_xx.deb
|
|
```
|
|
|
|
3. 查看安装
|
|
|
|
```bash
|
|
# 1.查看deb包是否安装成功
|
|
dpkg --status vastai-pci-xxx
|
|
|
|
#output
|
|
Package: vastai-pci-dkms
|
|
Status: install ok installed
|
|
……
|
|
Version: xx.xx.xx.xx
|
|
Provides: vastai-pci-modules (= xx.xx.xx.xx)
|
|
Depends: dkms (>= 1.95)
|
|
Description: vastai-pci driver in DKMS format.
|
|
|
|
# 2.查看驱动是否已加载到内核
|
|
lsmod | grep vastai_pci
|
|
|
|
#output
|
|
vastai_pci xxx x
|
|
```
|
|
|
|
4. 升级驱动
|
|
|
|
```bash
|
|
sudo dpkg -i vastai-pci_dkms_xx.xx.xx.xx_xx.deb
|
|
```
|
|
|
|
5. 卸载驱动
|
|
|
|
```bash
|
|
sudo dpkg -r vastai-pci_dkms_xx.xx.xx.xx_xx
|
|
```
|
|
|
|
### 2.reboot pcie
|
|
|
|
```bash
|
|
sudo chmod 666 /dev/kchar:0 && sudo echo reboot > /dev/kchar:0
|
|
```
|
|
|
|
## SDK
|
|
|
|
### step.1
|
|
|
|
```bash
|
|
pip install torch==1.8.0 torchvision==0.9.0 torchaudio==0.8.0
|
|
pip install onnx==1.10.0 tqdm==4.64.1
|
|
pip install h5py==3.8.0
|
|
pip install decorator==5.1.1 scipy==1.7.3
|
|
```
|
|
|
|
### step.2
|
|
|
|
```bash
|
|
sudo vi ~/.bashrc
|
|
|
|
export VASTSTREAM_PIPELINE=true
|
|
export VACC_IRTEXT_ENABLE=1
|
|
export TVM_HOME="/opt/vastai/vaststream/tvm"
|
|
export VASTSTREAM_HOME="/opt/vastai/vaststream/vacl"
|
|
export LD_LIBRARY_PATH=$TVM_HOME/lib:$VASTSTREAM_HOME/lib
|
|
export PYTHONPATH=$TVM_HOME/python:$TVM_HOME/vacc/python:$TVM_HOME/topi/python:${PYTHONPATH}:$VASTSTREAM_HOME/python
|
|
|
|
source ~/.bashrc
|
|
```
|