rkllm-runtime

Here are 6 public repositories matching this topic...

Entire pipeline for running optimized LLM models on the RK3588S, both on the NPU (RKLLM) or the CPU (llama)

toolchain rk3588s llama-cpp qwen2-5 rkllm qwen3 rkllm-runtime

A fork of exo-explore/exo that adds RKLLM inference engine support for Rockchip RK3588/RK3576 NPU devices.📱💻 🖥️⌚

machine-learning rknn rk3588 rknpu2 rkllm rkllm-runtime

Terraform provider for Turing Pi 2.5 BMC. Use with freed-dev-llc/modules/turingpi for cluster deployment.

Terraform modules for Turing Pi clusters. Use with freed-dev-llc/turingpi provider.

Rust bindings to airockchip/rknn-llm runtime

rust rk3588 rkllm rkllm-runtime

A Gradio Docker image convert to RKLLM model.

rkllm rkllm-runtime

To associate your repository with the rkllm-runtime topic, visit your repo's landing page and select "manage topics."