AI & Machine Learning
Omh Inference Serving
[omh] Self-hosted LLM serving on GPUs: choose the serving engine and quantization from decision tables, prepare deployment as an idempotent runbook with observed-only verification, and measure the endpoint with the standard TTFT/TPOT/goodput protocol. Use when the user says: inference-serving, inference serving, serve this model, serve the model, model serving, serving endpoint, vllm, llama.cpp.
- Publisher / source
- rlaope/oh-my-hermes (found on GitHub top repositories)
- Upstream record
- rlaope/oh-my-hermes
- Version
- Version 1
- Published
- Publication review
- Approved for publication · recorded passed scan 2026-11-05
- Content fingerprint
8e0e7e37b423a4d9cd011500af8a27c5e8164a25bea3263b15806f88ee610056