Repository navigation
Api client dspy.Together #766
Unanswered
CostantinoEsposito89
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Hi,
I have an issue with the api client TogetherAI. TogetherAI answered with the below json:
`{
"id":"86e9e164596883a3-MXP",
"object":"chat.completion",
"created":1712155925,
"model":"mistralai/Mixtral-8x7B-Instruct-v0.1",
"prompt":[
],
"choices":[
{
"finish_reason":"eos",
"logprobs":"None",
"index":0,
"message":{
"role":"assistant",
"content":" greet the user. We don\'t have any specific question to answer, so I\'ll just return a friendly greeting.\nOutput: {"answer": "Hello! How can I help you find a TEDx talk today?"}"
}
}
],
"usage":{
"prompt_tokens":260,
"completion_tokens":51,
"total_tokens":311
}
}
For to retrieve llm's response, Dispy didresp_json.get('choices', [])[0].get('message').get('content'), but it retrieved content message with[resp_json['output'].get('choices', [])[0].get('message', {}).get('content', "")]`. TogetherAI's response have not 'output' key, could you help me please?All reactions