GET
/
query
import requests

url = "https://api.berri.ai/query"

querystring = {
"user_email": "ishaan@berri.ai",
"instance_id": "6663d98e-f3e2-42b9-a79e-2d92199b85fa",
"query": "who is ishaan",
"model": "gpt-3.5-turbo"
}

response = requests.get(url, params=querystring)

print(response.text)

​
Query

user_email
string

The email address you are using on your berri.ai account Example: ishaan@berri.ai

instance_id
string

The instance you want to query, create_app returns an instance_id that you can query here

query
string

The query for your instance Example: “Who is ishaan?”

dynamic_prompt
string

Overwrite the existing prompt for your instance with a prompt passed in at query time!

rationale
boolean

The model is prompted to come up with a rationale/think before giving it’s answer. Always pass in either True or False. The returned format is: Rationale: <model rationale> Answer: <model answer>. Can help improve accuracy by up to 30%.

model
string

There are currently 4 types of models Berri supports.

GPT 3 model: text-davinci-003

[RECOMMENDED] chat GPT model: gpt-3.5-turbo

GPT 4 model: gpt-4

T5 model: t5

t5 is recommended for those looking for an on-prem alternative to GPT.

Try out the different models for your data: https://play.berri.ai/ 🚀

top_k
number

All your data cannot fit into GPT’s context window. So we break it into chunks and give GPT the most relevant chunk at query time. Use this parameter to control how many chunks of data you want to give GPT. By default this is set to 1.

Setting top_k = 1 is the same as saying For a given question, only give the most similar chunk of data to GPT. Setting top_k = 2 is the same as saying For a given question, give the top 2 most similar chunk of data to GPT.

history
string

You can also choose to pass in the chat history as part of your query request. We expect this to be a list that is converted to a JSON String.

How is this being parsed by our API? Our server is a Flask app, and we check if history exists, and if it does we try and evaluate if the JSON string passed is a list.

history = request.args.get('history') history = ast.literal_eval(history)

How does this impact your query? When you pass in history, we summarize it and pass it as additional context (in addition to your query) to the model you selected.

Create AppUpdate your Instance Data