web-search
endpoint that you can use to search the web outside of a chat completion. See the web search API guide for more information.
This guide explains how to use the web search tool in a chat completion and provides an example of how to use it.
You need an API key to access the Writer API. Get an API key by following the steps in the API quickstart.We recommend setting the API key as an environment variable in a
.env
file with the name WRITER_API_KEY
.Tool structure
The web search tool allows you to search the web during a chat with a Palmyra model. To use the web search tool, add it to thetools
array in your chat-completion
endpoint request.
The web search tool object has the following structure:
Parameter | Type | Description |
---|---|---|
type | string | The type of tool, which is web_search for the web search tool |
function | object | An object containing the tool’s configuration |
function.include_domains | array | An array of domains to include in the search results |
function.exclude_domains | array | An array of domains to exclude from the search results |
To customize search parameters like including raw source text, limiting the number of sources, or specifying time ranges, include these requirements in your prompt to the model. The model uses these parameters when making the web search call. For example, your message to the model might include:
- “Include raw source text”
- “Limit the number of sources to 5”
- “Search for news articles from the last 30 days”
You can only pass one prebuilt tool in the
tools
array at a time. However, you can pass multiple custom tools in the same request.Prebuilt tools are:- Web search tool
- Knowledge Graph tool
- LLM tool
- Translation tool
- Vision tool
Response format
For non-streaming responses, the search results and answer are in thechoices[0].message.content
field. For streaming responses, the search results and answer are in the choices[0].delta.content
field.
The response also contains a web_search_data
field that contains the following information:
Parameter | Type | Description |
---|---|---|
query | string | The search query that was submitted |
answer | string | Generated answer based on the search results |
sources | array | The search results found |
sources[].url | string | URL of the search result |
sources[].raw_content | string | Raw content from the source URL (if requested) |
You can use the web search tool with streaming chat responses, but the web search tool call is not streamed. The sources comes back in the
choices[0].delta.content
field once the full search is complete. Then, the response from the model is streamed.If you are unfamiliar with the chat completions endpoint or streaming vs. non-streaming responses, learn more in the chat completion guide.Usage example
This example uses the web search tool to find current information about AI developments during a chat completion.Create a tools array containing a web search tool
First, create atools
array that specifies the web search tool you want to use.
Send the request using chat completions
Add the tools array to the chat endpoint call along with your array of messages. Settingtool_choice
to auto
allows the model to choose when to use the web search tool, based on the message provided in the messages
array.
The response contains the search results and generated answer in the choices[0].message.content
field.
web_search_data
field to see the search query, answer, and sources that the web search tool used.