vllm-studio-backend

vLLM Studio Backend Architecture

Safety Notice

This listing is imported from skills.sh public index metadata. Review upstream SKILL.md and repository scripts before running.

Copy this and send it to your AI assistant to learn

Install skill "vllm-studio-backend" with this command: npx skills add 0xsero/vllm-studio/0xsero-vllm-studio-vllm-studio-backend

vLLM Studio Backend Architecture

Overview

This skill explains how the backend is wired: controller runtime, OpenAI-compatible proxy, Pi-mono agent loop, LiteLLM gateway, and inference process management.

When To Use

  • Modifying controller routes or run streaming.

  • Debugging OpenAI-compatible endpoint behavior.

  • Updating Pi-mono agent runtime or tool execution.

  • Understanding how inference + LiteLLM fit together.

Quick Start

  • Read references/backend-architecture.md for the component map and data flow.

  • Read references/openai-compat.md for /v1/models and /v1/chat/completions behavior.

  • Read references/backend-commands.md for useful run/debug commands.

Core Guarantees

  • Keep OpenAI-compatible endpoints stable (/v1/models , /v1/chat/completions ).

  • /chat UI uses controller run stream (/chats/:id/turn ) and Pi-mono runtime.

  • Tool execution happens server-side (MCP + AgentFS + plan tools).

References

  • references/backend-architecture.md

  • references/openai-compat.md

  • references/backend-commands.md

Source Transparency

This detail page is rendered from real SKILL.md content. Trust labels are metadata-based hints, not a safety guarantee.

Open in GitHubOpen in ClawHub

Related Skills

Related by shared tags or category signals.

General

vllm-studio

No summary provided by upstream source.

Repository SourceNeeds Review
8-0xsero
General

test_skill

import json import tkinter as tk from tkinter import messagebox, simpledialog

Archived SourceRecently Updated
--2023andrewyang
General

neo

Browse websites, read web pages, interact with web apps, call website APIs, and automate web tasks. Use Neo when: user asks to check a website, read a web page, post on social media (Twitter/X), interact with any web app, look up information on a specific site, scrape data from websites, automate browser tasks, or when you need to call any website's API. Keywords: website, web page, browse, URL, http, API, twitter, tweet, post, scrape, web app, open site, check site, read page, social media, online service.

Archived SourceRecently Updated
--4ier
General

image-gen

Generate AI images from text prompts. Triggers on: "生成图片", "画一张", "AI图", "generate image", "配图", "create picture", "draw", "visualize", "generate an image".

Archived SourceRecently Updated
--0xfango