LLamaCpp Provider

The LlamaCpp provider is a prototype that is currently unmaintained.

This community provider is not yet compatible with AI SDK 5. Please wait for the provider to be updated or consider using an AI SDK 5 compatible provider.

nnance/llamacpp-ai-provider is a community provider that uses Llama.cpp to provide language model support for the AI SDK.

On this page

LLamaCpp Provider

Elevate your AI applications with Vercel.

Trusted by OpenAI, Replicate, Suno, Pinecone, and more.

Vercel provides tools and infrastructure to deploy AI apps and features at scale.