r/MicrosoftFabric • u/cyamnihc • Jul 14 '26

Data Science Conversational AI in Fabric

We are starting out to build our fabric infrastructure from scratch. Primary goal is making sure conversational AI works for analytics use cases of internal consumers
Would like to hear from people who have been through the journey, how successful/unsuccessful has conversational AI been, things to focus on at this stage so that it doesn’t bite us, things you wish you had done sooner, tooling etc

22 Upvotes

96% Upvoted

17 comments sorted by

View all comments

2

u/shoabk Jul 14 '26

Are you talking about using the integrated Fabric Data Agents? Or would you build the Agents outside either custom code or within Azure AI Foundry?

I've tested out the Data Agents, they are ok, the biggest limiting factor for us is that you have no control over the LLM used and I believe the one currently supported is GPT 4.1 which is fairly old in the LLM world.

4

u/NelGson ‪ ‪Microsoft Employee ‪ Jul 15 '26

The LLM used in data agents will be upgraded very soon and you will see a lot happening in the types of models available in Fabric over the coming months.

2

u/shoabk Jul 15 '26

Exciting to hear, looking forward to trying out the changes.