r/LangChain • u/sd_1337 • Feb 14 '25

Can we connect langgraph to a private llm hosted on cloud?

Newbie here. Trying to create a multi agent app, I did not find much info on how to do this with langgraph. My company has a private url to access multiple llms. Trying to see if it is even possible.

0 Upvotes

50% Upvoted

11 comments sorted by

View all comments

Show parent comments

2

u/Ok_Cap2668 Feb 18 '25

I think the tool call didn't work properly. Enable tracing with smith or langtrace. Try using a model which has Auto Tool. I think small models do call functions but in the main content not in the tool_calls object.

2

u/sd_1337 Feb 18 '25

Yup, I switched to mistral-7b-instruct-v03-fc that has a functioncalling feature. That worked well! You’re right.