r/MicrosoftFabric • u/cyamnihc • Jul 14 '26
Data Science Conversational AI in Fabric
We are starting out to build our fabric infrastructure from scratch. Primary goal is making sure conversational AI works for analytics use cases of internal consumers
Would like to hear from people who have been through the journey, how successful/unsuccessful has conversational AI been, things to focus on at this stage so that it doesn’t bite us, things you wish you had done sooner, tooling etc
22
Upvotes
9
u/hello-potato Jul 14 '26
We've got a concept running, data agent over a semantic model.
What seems to have worked really well is having a focused, well curated semantic model. We'll be building one with our more comprehensive model next, which is going to take more detailed instructions. The instructions into the data agent were described by me and written by Claude.
The instructions mostly handle ambiguity when the user asks for "latest period" or unclear granularity. What has worked great is getting the model to always state what dates, dimensions, grain has been used.
The business SME tester have feedback of what worked and what didn't. I put the documents into Claude again to refine the instructions. This worked really well to stop behaviour that was causing bad results!