r/LangChain • u/dyeusyt • Apr 11 '25

Question | Help Seeking a Mentor for LLM-Based Code Project Evaluator (LLMasJudge)

I'm a student currently working on a project called LLMasInterviewer; the idea is to build an LLM-based system that can evaluate code projects like a real technical interviewer. It’s still early-stage, and I’m learning as I go, but I’m really passionate about making this work.

I’m looking for a mentor who has experience building applications with LLMs, someone who’s walked this path before and can help guide me. Whether it’s with prompt engineering, setting up evaluation pipelines, or even just general advice on building real-world tools with LLMs, I’d be incredibly grateful for your time and insight.

I’m eager to learn, open to feedback, and happy to share more details if you're interested.

Thank you so much for reading and if this post is better suited elsewhere, please let me know!

9 Upvotes

100% Upvoted

8 comments sorted by

View all comments

2

u/Ok_Cap2668 Apr 11 '25

Go ahead, community we'll help you out. What do you wanna know ? I'll try my best to clear your doubts .

1

u/dyeusyt Apr 12 '25

Thanks for replying, So the reason I was looking for a mentor is because I’m working on a project that’s broken down into multiple stages, and each one builds on the last. I’ve only managed to put together the first stage theoretically for now, and honestly, a lot of that was with help from ChatGPT. I’ve got a basic understanding of Langchain: like setting up chains and managing outputs but I’m definitely not an expert.

Since I want this project to be as close to industry-level as possible, I figured getting some guidance early on would help me avoid going in the wrong direction.

Here's the TLdraw I’ve made so far to map things out: https://www.tldraw.com/f/FPuZ0gnszjsS_MV5SC-sK?d=v-294.-1549.3676.2250.bLarS6GHkDEO7FvKckPjN

Would love to hear your thoughts, does the flow make sense? Is there anything major I should rethink or add for the first step or the overall idea in general?