Return response as JSON

(0) Share

Report

Posted on by darylvogan

274

Here is my prompt:

Please extract only "skills", "computer skills", "qualifications", "certifications", "license", "experience level", "location" and "state" in the text below. If no values are found, return "N/A". If the qualifications is abbreviated, please expand it using engineering terms. Convert experience level to "1 - Basic", "2 - Intermediate", "3 - Advanced" or "4 - Expert". Return only one skill and only one computer skill. Return the response formatted as JSON:

I need a PE in Maryland who is experienced in AutoCAD

It is returning JSON, but for a few random calls it includes some text outside of the JSON, at which point my JSON parsing fails. Does anyone know why this happens?

Categories:

AI Builder

I have the same question (0)

All responses (7)

Answers (0)

gbego Microsoft Employee on at

Like (0)

Report
Copy link

Link copied!

Hi @darylvogan

Not sure why this happens. Perhaps you could try solving this by prefacing in the prompt to explicitly NOT PROVIDE any texte outside of the JSON. Don't hesitate to be super explicit on the output format you want and call out things that you don't want the model to do as well.

Hope this helps.

Thanks,
Gwenael

Was this reply helpful? Yes No
darylvogan 274 on at

Like (0)

Report
Copy link

Link copied!

Thanks, but i have tried getting very specific in asking it to "not" this or "only" that but can't find the magic phrasing. I am able to reliably parse the response so it's not a showstopper but would be interested to see how this gets addressed when GPT text intersects with needing structural responses.

Was this reply helpful? Yes No
Andrew7 Microsoft Employee on at

Like (1)

Report
Copy link

Link copied!
I would not try to force it by telling what not to do. Try telling what to do instead:

You are an assistant who extracts skills into JSON. Output Json block should be enclosed in ####
This prompt will wrap your JSON with #### for example and it would be easy to extract this block

Was this reply helpful? Yes No
darylvogan 274 on at

Like (0)

Report
Copy link

Link copied!

thanks, but i still get stray content outside of the "####" block

Was this reply helpful? Yes No
Andrew7 Microsoft Employee on at

Like (0)

Report
Copy link

Link copied!

Can you give prompt you are sending and output?

Was this reply helpful? Yes No
darylvogan 274 on at

Like (0)

Report
Copy link

Link copied!

You are an assistant who extracts information into JSON. Output Json block should be enclosed in ####. Please extract 'skills', 'software skills', 'license', 'experience level', 'certifications', 'city' and 'state' in the text below.. If the license is abbreviated, please expand it using engineering terms with no abbreviations. Convert experience level to '1 - Basic', '2 - Intermediate', '3 - Advanced' or '4 - Expert'.
I need a professional engineer in Baltimore who has AutoCAD experience

Response:
and a Professional Engineer license.
####
{
"skills": "Engineering",
"software skills": "AutoCAD",
"license": "Professional Engineer",
"experience level": "2 - Intermediate",
"certifications": null,
"city": "Baltimore",
"state": "MD"
}

Was this reply helpful? Yes No
Andrew7 Microsoft Employee on at

Like (0)

Report
Copy link

Link copied!

Modified your prompt and tested it with GPT4. I think you need to play with the prompt and be more explicit about what you want:
"Output Json block should start and end with ####"

Was this reply helpful? Yes No