Commit Graph

1 Commits (1db050b51f4e722e76e2fcba976255647ae67c0b)

Author SHA1 Message Date
Xingyu Liao cb7a1cb3e1
update deployment toolchain (#428)
Summary:
Remove tiny-tensorrt dependency and rewrite a new tensorrt inference api.
In the new version of trt infer, it can pad the input to fixed batch automatically, so you don't need to worry about dynamic batch size.
2021-03-10 16:48:59 +08:00