If you don't have an account with these providers, you can sign up and get an API key. Anthropic require a credit card to get an API key. Some OpenAI models and Gemini do not and have a generous free tier for its API. The easiest way to get started with Mastra is by usingcreate...
Agentic is astandard library of AI functions / toolswhich areoptimized for both normal TS-usage as well as LLM-based usage. Agentic works with all of the major TS AI SDKs (Vercel AI SDK, Mastra, LangChain, LlamaIndex, OpenAI SDK, MCP, etc). ...
OpenAI Functions CertainOpenAI models(like gpt-3.5-turbo-0613 and gpt-4-0613) have been explicitlyfine-tunedto detect when a function should be called and respond with the inputs that should be passed to the function. The OpenAI Functions Agent is designedtowork with these models. db=SQLData...
Let’s add the utility functions that will power our server: Copy function isTextContent( content: MessageContentOutput ): content is MessageContentOutput & { type: "text"; text: { value: string } } { return content.type === "text" && !!(content as any).text?.value; } /** * Ini...
Evals can be customized with your own prompts and scoring functions. Quick Start Prerequisites Node.js (v20.0+) Get an LLM provider API key If you don't have an API key for an LLM provider, you can get one from the following services: OpenAI Anthropic Google Gemini If you don't have...
Before using Plurality, you need to set up your OpenAI API key. You have three options: Set the OPENAI_API_KEY environment variable. Pass the API key directly when initializing the Swarm instance. If no API key is provided, you'll be prompted to enter it when running the CLI. Here are...
Evals can be customized with your own prompts and scoring functions. Quick Start Prerequisites Node.js (v20.0+) Get an LLM provider API key If you don't have an API key for an LLM provider, you can get one from the following services: OpenAI Anthropic Google Gemini If you don't have...
OpenAI, Anthropic (native & Vertex), Gemini, Groq, Fireworks, Together.ai, DeepSeek, Ollama CLI and Web interface Human-in-the-loop for: Budget control Agent initiated questions Error handling Flexible deployment options: Run locally from the command line or through the web UI Scale-to-...
Evals can be customized with your own prompts and scoring functions. Quick Start Prerequisites Node.js (v20.0+) Get an LLM provider API key If you don't have an API key for an LLM provider, you can get one from the following services: OpenAI Anthropic Google Gemini Groq Cerebras If ...
LLM Models Mastra uses the Vercel AI SDK for model routing, providing a unified interface to interact with any LLM provider including OpenAI, Anthropic, and Google Gemini. You can choose the specific model and provider, and decide whether to stream the response. Agents Agents are systems where...