LocalAI

Self-hosted, OpenAI-compatible API for running LLMs locally with consumer hardware.