sweet, is there any plans to implement VLLM in the future? | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

nshotton 33 days ago | parent | context | favorite | on: Show HN: Rowboat – Open-source, local-first altern...

sweet, is there any plans to implement VLLM in the future?

segmenta 33 days ago [–]

vLLM works today - it exposes an OpenAI-compatible endpoint, and you can point Rowboat at a custom base URL in model settings.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact