Unanswered

Almost constantly getting SystemError for generative answers

(1) Share

Report

Posted on by llu1

Hi!
I'm currently building a simple Danish chatbot in Copilot Studio using generative answers with a single pdf-file (18 pages), which consists of an employee handbook.

The bot is mainly made for testing out Copilot Studio.

However, I'm facing the issue of constantly getting a "Something went wrong. SystemError", when asking certain questions (almost always the same questions resulting in an error).
The bot is in Danish, but when asking the same question in English, it actually works sometimes, so I suspect it's something to due with the language? I made the bot in Danish and have not added English to languages.

I can see that it stops on the generative answer "action" and when looking at the downloaded log-file, all I can see is that it says "400: Bad Request" from OpenAI.

It honestly seems like an issue with Copilot Studio, but I'm curious if there's anything I can do, as this problem keeps happening on other custom copilots as well, whether I'm using websites, sharepoint or local files for generative answers. It rarely goes to the fallback and instead fails while generating the answer.

Example of a question that work fine: "Is there any parking for bicycles available?"
Example of a question leading to SystemError: "Can I bring my dog to the office?

Both things are stated very clearly in the PDF and again, it can find the information easily when asking in English and occasionally in Danish.

EDIT: The "log" is the JSON file from the snapshot in test Copilot and the accurate exception is: "OpenAI request failed with response code BadRequest. Message: Prompt was filtered. [] (UserErrorCode: SystemError, ReasonCode: Undefined)"
Idk, if "Prompt was filtered" is the culprit and why this happens?

Categories:

General

All responses (5)

Answers (0)

llu1 6 on at

Like (0)

Report

Re: Almost constantly getting SystemError for generative answers

So far I've found out that a lot of the times it's probably filtered by high/medium content moderation and other times it's filtered by OpenAI (for whatever reason).
When I finally get an answer on the questions with system errors it's often a wrong answer. My honest guess is just that the model doesn't perform well in Danish...
My data is in Danish and VERY clearly states the answer to the simple questions. Somehow it doesn't work when asking in Danish but works flawlessly when asking in English (on the Danish bot that is. If I upload Danish documents to an English bot it doesn't understand).
alsoe-rk 5 on at

Like (0)

Report

Re: Almost constantly getting SystemError for generative answers

Hi again - just curious if there's something we can do about this as we're still getting the error.
alsoe-rk 5 on at

Like (0)

Report

Re: Almost constantly getting SystemError for generative answers

Tagging along here, as I'm getting the exact same error (also with a Danish bot). Only difference is that I'm trying to use a public website as a boost. But I'm also getting the same error:
Fejlkode: SystemError. Samtale-id: e6fecf09-1104-4059-b8d0-b99901af0ca5. Klokkeslæt (UTC): 2/8/2024 4:28:05 PM.
"exception": "OpenAI request failed with response code BadRequest. Message: Prompt was filtered. [] (UserErrorCode: SystemError, ReasonCode: Undefined)",
llu1 6 on at

Like (0)

Report

Re: Almost constantly getting SystemError for generative answers

Sorry, yes, I meant the snapshot that can be downloaded from the test copilot (JSON file, dialog). I just checked again and the accurate exception is: "OpenAI request failed with response code BadRequest. Message: Prompt was filtered. [] (UserErrorCode: SystemError, ReasonCode: Undefined)"

I am using a PDF file uploaded to Copilot studio.

Skærmbillede 2024...
adilei on at

Like (0)

Report

Re: Almost constantly getting SystemError for generative answers

Which data source are you using?

In which logs are you seeing the 400 response? In the JSON that is bundled in the "snapshot"?