Back to Developers
unnati Khane

unnati Khane

LLM Business Analyst – AI Evaluation & Annotation

Mumbai Remote Full-time 0+ yrs exp 81 · Excellent

About

I enjoy building things that are practical, thoughtful, and genuinely useful for people. Over time, I’ve naturally become interested in problem-solving, understanding systems deeply, and finding ways technology can simplify experiences and create real impact. My background is in software engineering and AI-focused work, where I’ve worked on full-stack applications, Android development, and LLM evaluation workflows. I enjoy combining technical thinking with creativity, whether it’s building AI-powered applications, improving user experiences, or solving complex challenges step by step. People usually describe me as adaptable, reliable, and easy to work with. I care about doing meaningful work, learning continuously, and growing in environments that challenge me both technically and personally.

Skills & Expertise (32)

Hallucination Detection Advanced
8.8/10
0.5
Years Exp
LLM Evaluation Advanced
8.8/10
0.5
Years Exp
Data Annotation Advanced
8.4/10
0.5
Years Exp
Jira REST APIs Agile Scrum Workflow Design Process Mapping Stakeholder Management Documentation Git GitHub Python JavaScript React Node.js Tableau Visio Power BI Data Visualization Data Modeling MongoDb Excel SQL SDLC UAT Use Cases User Stories Stakeholder Analysis Requirement Elicitation Business requirements

Work Experience

LLM Business Analyst – AI Evaluation & Annotation

TURING

Mar 2026 - Present

Reviewed LLM responses through SxS comparisons on GHD, rating outputs on accuracy, quality, and task alignment to support iterative model refinement. Scrutinized model outputs for factual inconsistencies and hallucinations, delivering structured, criteria-based rationales for every evaluation decision. Labeled and categorized training data spanning reasoning and comprehension tasks, logging observations to enhance model reliability and output alignment. Applied browser-based tools and CLI workflows to execute evaluation tasks efficiently, escalating key findings to stakeholders per quality benchmarks.

Education

Bachelor of Engineering in Information Technology - Pillai HOC College of Engineering and Technology

2021 - 2025 · India

Certifications

No certifications added yet

Interested in this developer?

Profile Score Breakdown

📷 Photo 10/10
📄 Resume 10/10
💼 Job Title 10/10
✍️ Bio 10/10
🛠️ Skills 20/20
🎓 Education 10/10
⏱️ Experience 6/15
💰 Rate 0/5
🏆 Certs 0/5
Verified 5/5
Total Score 81/100

Profile Overview

Member sinceMay 2026
Work ModeRemote
AvailabilityFull-time

Availability Details

Visa Status

Citizen

Relocation

Not Open to Relocation