Just high-bpw quantization of functionary for a drop-in OpenAI function calling replacement. See the llama-cpp-python docs:

https://llama-cpp-python.readthedocs.io/en/latest/server/
{"license": "llama2"}
gguf license:llama2 region:us