Integrações

LiteLLM

Chame a NotHoly pelo LiteLLM com o prefixo openai/ e api_base.

Python

import os
import litellm

r = litellm.completion(
    model="openai/notholy-specter",
    api_base="https://api.notholy.com/v1",
    api_key=os.environ["NOTHOLY_API_KEY"],
    messages=[{"role": "user", "content": "What does EPSS estimate?"}],
)
print(r.choices[0].message.content)

Para o proxy do LiteLLM, adicione ao config.yaml:

YAML

model_list:
  - model_name: notholy-specter
    litellm_params:
      model: openai/notholy-specter
      api_base: https://api.notholy.com/v1
      api_key: os.environ/NOTHOLY_API_KEY
  - model_name: notholy-pulse
    litellm_params:
      model: openai/notholy-pulse
      api_base: https://api.notholy.com/v1
      api_key: os.environ/NOTHOLY_API_KEY
  - model_name: notholy-vector
    litellm_params:
      model: openai/notholy-vector
      api_base: https://api.notholy.com/v1
      api_key: os.environ/NOTHOLY_API_KEY
  - model_name: notholy-wisp
    litellm_params:
      model: openai/notholy-wisp
      api_base: https://api.notholy.com/v1
      api_key: os.environ/NOTHOLY_API_KEY

Próximos passos

SDKs