Skip to content

teff.provider.builtin.openai_compatible

teff.provider.builtin.openai_compatible

Generic OpenAI-compatible provider (vLLM, LM Studio, Azure, ...).

Classes:

Name Description
OpenAICompatible

Any /chat/completions endpoint; set base_url yourself.

OpenAICompatible

Bases: Provider

Any /chat/completions endpoint; set base_url yourself.

Source code in teff/provider/builtin/openai_compatible.py 
 6
 7
 8
 9
10
11
class OpenAICompatible(Provider):
    """Any ``/chat/completions`` endpoint; set ``base_url`` yourself."""

    name = "openai_compatible"
    base_url = ""
    api_key_env = "OPENAI_API_KEY"