Resmi Sağlayıcı Skill'iView repo
Stand up vLLM or SGLang serving on Jetson, using upstream vLLM on Thor and Orin JetPack 7.2+, and NVIDIA-AI-IOT vLLM on older Orin.
Dosyalar5 dosya
BENCHMARK.md75 satır
Loading editor…
Kurulum
ÖnerilenTek komut — ajanınız otomatik olarak devreye alır.
Kurulum komutunu görmek için yukarıdan bir AI aracı seçin.
veya
Manuel Kurulum
Daha fazla adımArşivi indirin ve dosyaları projenize manuel olarak ekleyin.
Skill detayları
Versiyonv1.0.0
YazarNVIDIA
Kategoriai-ml
Skill IDNVIDIA/skills/skills/jetson-llm-serve
Dosyalar5 dosya
İlgili skill'ler
Accelerated Computing CudfOfficial NVIDIA-authored guidance for NVIDIA cuDF GPU DataFrames, pandas acceleration, dask-cuDF, ETL, joins, groupby, CSV/Parquet I/O, nullable semantics, and multi-GPU DataFrame workloads.Aiq DeployUse when asked to install, deploy, run, validate, troubleshoot, or stop NVIDIA AI-Q Blueprint infrastructure.Aiq DeployUse when asked to install, deploy, run, validate, troubleshoot, or stop NVIDIA AI-Q Blueprint infrastructure.Aiq ResearchUse when asked to run deep research or AI-Q research through a reachable NVIDIA AI-Q Blueprint backend.Aiq ResearchUse when asked to run deep research or AI-Q research through a reachable NVIDIA AI-Q Blueprint backend.Amc Run Sample CalibrationRun end-to-end calibration on the shipped sample dataset (sdg_08_2_sample_data_010926.zip) against a running AMC microservice. Use when user says 'test sample dataset', 'run sample calibration', 'verify AMC install', or 'launch and test'.