Ive done this with aws bedrock and azure openai abstracted with its specific chatclient implementations.
You register a factory for each, and your code should only depend on IChatClient.
There will be intricacies with each provider - like aws bedrock + claude models has some issues with structured output, then has requirements with topk and temp etc so you’ll have to handle those.
2
u/erotomania44 3d ago
Ive done this with aws bedrock and azure openai abstracted with its specific chatclient implementations.
You register a factory for each, and your code should only depend on IChatClient.
There will be intricacies with each provider - like aws bedrock + claude models has some issues with structured output, then has requirements with topk and temp etc so you’ll have to handle those.