TensorRT-LLM（前端 UI 组件与界面模板｜人工智能）
项目简介：TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
- 仓库地址：https://github.com/NVIDIA/TensorRT-LLM
- 源码下载：下载 ZIP 包
- Stars：13101
- 主要语言：Python