Software Development

Debug Inference

Debug inference clients that use an attached provider and its native endpoint, including hosted APIs and host-local Ollama, vLLM, SGLang, TRT-LLM, LM Studio, or NIM. Use for provider attachment, endpoint policy, credential substitution, topology, and migration from the removed managed inference endpoint. Trigger keywords - debug inference, managed inference endpoint, local inference, ollama, lm studio, vllm, sglang, trtllm, NIM, inference failing, model server unreachable, credential_endpoint_mismatch, host.openshell.internal.

Publisher / source

NVIDIA/OpenShell (found on GitHub top repositories)

Upstream record

NVIDIA/OpenShell

Version

Version 1

Published

2026-11-03

Publication review

Approved for publication · recorded passed scan 2026-11-03

Content fingerprint

58503cbebb6dae8d4856224d4d570b50f2c0163564321c8bf15c946c9036b47f