Unanswered

AI Agent Project Discussion – (On-Prem SQL + Public Access)

(1) Share

Report

Posted on by boww1

Hi team,

so our current dept wants an AI agent that connects to their on-prem SQL database and is embedded in our custom website for public use.

Data Source: On-prem SQL (need secure connector or API layer).
Usage: Public-facing, no logins needed.
Host: Their own website – likely as an iFrame, widget, or API integration.
Main Concerns: Security, response filtering, data privacy.

Questions

Best way to connect securely to on-prem SQL?
How do we moderate outputs for public access?
Any compliance or data protection considerations?

Categories:

General topics

I have the same question (0)

All responses (3)

Answers (0)

Romain The Low-Code... 2,111 Super User 2025 Season 2 on at

Like (0)

Report

Hello,

To connect to a SQL on prem you need a data gateway. I will recommand through an Copilot studio Agent flow to keep hand on what happen.

You could also make your custom connector and power automate and use private endpoint.

To moderate answer from the datasource : Microsoft agent have natural guard mecanism and jailbreak protection, anyway you can add pre filtering in the content before showing, it s not the SQL through answer, it passe through your agent so you can do whatever you want.

About compliance and data protection, : it s microsoft so yes

But all this quesiton need to be answered by your IT dude because it involve et lot of technical knolwedge and this place is not tall enough to explain in detail everything.

The important answer : yes everything is possible since copilot studio could be embeded in mobile app, web site, what ever you want, and it could use any source you want
- direct connexion throu data gateway
- Model context protocol between your agent and your data
- dataverse injection/replication/virtual table

if it was in any use , click answer ok :)

good luck in your project :)

Was this reply helpful? Yes No
boww1 27 on at

Like (1)

Report

hi @Romain The Low-Code Bearded Bear,

Do you have any examples on how I can do it?

I tried once using an Azure SQL Databases as the knowledge source of the copilot agent, if I chose the option no auth, then the agent wont give me any answers since its not authenticated?

Also, this on-prem SQL will be the agents knowledge source.

Was this reply helpful? Yes No
Romain The Low-Code... 2,111 Super User 2025 Season 2 on at

Like (0)

Report

@boww1
Ok so i just add an idea, you could try dataverse as datasource (it s a sql server embeded in your environnement and cover by a low code IHM), copilot know how to speak with.

For the rest you will find a lot of tutorial with power automate and on premise connexion, but using data gateway need strong IT permissions, that you seem to don't have.

The most "beautiful" answer for me will be to use Azure AI Search to create a Index to execute the copilot studio RAG on it with the native Azure AI Search connector. But it requiere IT autorisation, Azure souscription and Admin autorisation

Once again, your business case is totally doable but need your IT team to help :)

Was this reply helpful? Yes No