Back to Developers
unnati

unnati

LLM Business Analyst – AI Evaluation & Annotation

Remote 0+ yrs exp 70 · Very Good

About

No bio added yet

Skills & Expertise (32)

Hallucination Detection Advanced
8.8/10
0.5
Years Exp
LLM Evaluation Advanced
8.8/10
0.5
Years Exp
Data Annotation Advanced
8.4/10
0.5
Years Exp
Jira REST APIs Agile Scrum Workflow Design Process Mapping Stakeholder Management Documentation Git GitHub Python JavaScript React Node.js Tableau Visio Power BI Data Visualization Data Modeling MongoDb Excel SQL SDLC UAT Use Cases User Stories Stakeholder Analysis Requirement Elicitation Business requirements

Work Experience

LLM Business Analyst – AI Evaluation & Annotation

TURING

Mar 2026 - Present

Reviewed LLM responses through SxS comparisons on GHD, rating outputs on accuracy, quality, and task alignment to support iterative model refinement. Scrutinized model outputs for factual inconsistencies and hallucinations, delivering structured, criteria-based rationales for every evaluation decision. Labeled and categorized training data spanning reasoning and comprehension tasks, logging observations to enhance model reliability and output alignment. Applied browser-based tools and CLI workflows to execute evaluation tasks efficiently, escalating key findings to stakeholders per quality benchmarks.

Education

Bachelor of Engineering in Information Technology - Pillai HOC College of Engineering and Technology

2021 - 2025 · Afghanistan

Certifications

No certifications added yet

Interested in this developer?

Profile Score Breakdown

📷 Photo 10/10
📄 Resume 10/10
💼 Job Title 10/10
✍️ Bio 0/10
🛠️ Skills 20/20
🎓 Education 10/10
⏱️ Experience 5/15
💰 Rate 0/5
🏆 Certs 0/5
Verified 5/5
Total Score 70/100

Profile Overview

Member sinceMay 2026

Availability Details

Visa Status

Citizen

Relocation

Not Open to Relocation