Skip to content
NotHolyDocs

Integrations

LangChain

Use ChatOpenAI with the NotHoly base URL.

View as Markdown
Python
import os
from langchain_openai import ChatOpenAI

llm = ChatOpenAI(model="notholy-specter", base_url="https://api.notholy.com/v1", api_key=os.environ["NOTHOLY_API_KEY"])
print(llm.invoke("Name the CWE for OS command injection.").content)

Tool binding with llm.bind_tools([...]) works because the models support function calling.

Next