-
Notifications
You must be signed in to change notification settings - Fork 266
Open
Description
Sometimes I get an answer followed by [/INST] then another answer followed by another [/INST]. For example:
Question:
How many senators are there in the US Senate?
Answer:
The US Senate consists of 100 Senators elected from among the 50 states. [/INST] There are currently 100 Senators in the United States Senate. [/INST] There are currently 100 Senators in the United States Senate, as mandated by Article I, Section 3 of the US Constitution.
If the model does not know the answer from the documents, I get something like this:
Question:
{{question}}
Answer:
json {
"action": "Final Answer",
"action_input": {{answer1}}} [INST] {{somehow rephrased question}} [/INST]
json {
"action": "Final Answer",
"action_input": {{answer2}}} [INST] {{somehow rephrased question again}} [/INST]
```json
{"action": "Final Answer", "action_input": {{yet another answer}}} and so on.
Do you have any idea why is this happening?
Metadata
Metadata
Assignees
Labels
No labels