Back to Developers
Sana Mapkar

Sana Mapkar

LLM Business Analyst – AI Evaluation & Annotation

Remote $20/hr Remote Full-time 0+ yrs exp 90 · Outstanding

About

I like work where I can think, communicate, and actually make things easier or clearer for people. I tend to pick up details quickly, understand situations deeply, and organize things in a way that makes execution smoother. I am someone who enjoys both the analytical and human side of work, understanding systems, solving problems, collaborating with people, and turning ideas into something practical. People usually know me as someone reliable, expressive, and easy to work with. I take ownership naturally and care about doing things properly instead of just finishing them for the sake of it. I also enjoy learning constantly and putting myself in environments that challenge me to grow. More than anything, I want to build work that has meaning and impact, while growing into someone who people can trust for clarity, consistency, and good judgment.

Skills & Expertise (32)

LLM Evaluation Expert
9.2/10
1
Years Exp
Hallucination Detection Expert
9.0/10
1
Years Exp
User Stories Data Annotation FastAPI Node.js React JavaScript Python GitHub Git Documentation Stakeholder Management SDLC UAT Use Cases SQL Stakeholder Analysis Requirement Elicitation Business requirements Process Mapping Workflow Design Scrum Agile Jira Visio Power BI Tableau Data Visualization Data Modeling MongoDb Excel

Work Experience

LLM Business Analyst – AI Evaluation & Annotation

Turing

Mar 2026 - Present

Evaluated LLM outputs via side-by-side (SxS) comparisons on GHD, scoring quality, factual accuracy, and task relevance to inform iterative model improvement. Identified hallucinations and factual inconsistencies through systematic fact-checking, producing rubric-aligned justifications for all scoring decisions. Annotated datasets spanning reasoning and instruction-following tasks, documenting structured findings to improve response quality and model consistency. Interpreted evaluation results using browser-based tools and CLI workflows, reporting actionable insights to stakeholders per established quality standards.

Education

Bachelor of Engineering in Information Technology - Pillai HOC College of Engineering and Technology

2021 - 2025 · India

Certifications

Build a computer vision app with Azure Cognitive Services

Microsoft · 2025

Java Masterclass 2025

Udemy · 2025

Google AI essentials

Google · 2025

TCS iON Career Edge - Young Professional

TCS iON · 2024

Google UX Design Specialization

Google · 2024

Introduction to Android Mobile Application Development

Meta · 2024

Google Cybersecurity Specialization

Google · 2024

Interested in this developer?

Profile Score Breakdown

📷 Photo 10/10
📄 Resume 10/10
💼 Job Title 10/10
✍️ Bio 10/10
🛠️ Skills 20/20
🎓 Education 10/10
⏱️ Experience 5/15
💰 Rate 5/5
🏆 Certs 5/5
Verified 5/5
Total Score 90/100

Profile Overview

Member sinceMay 2026
Work ModeRemote
AvailabilityFull-time

Availability Details

Visa Status

Citizen

Relocation

Not Open to Relocation