BA Generalist

Hello,

Greetings from ZettaMine!!!

Fulltime Opportunity: BA Generalist – AI Evaluation Project

We are hiring BA Generalists for a short-term AI evaluation project focused on improving the analytical reasoning, problem-solving, fact-checking, and logical capabilities of next-generation AI systems.

Eligible Locations: India, Bangladesh, Brazil, Colombia, Vietnam, Indonesia(Candidates must currently reside in one of the specified eligible countries to qualify for this project).

Role: BA Generalist – AI Evaluation

Experience: 2+ years

Mode: Remote

Engagement Duration: 1 Week

Start Date: Immediate

Commitment: Up to 40 hours per week

Working Hours: Minimum 4 hours of overlap with PST working hours.

Pay Rate: $9/hour (PPT – Pay Per Task), with an Average Handle Time (AHT) cap of 90 seconds per task.

Mandatory Eligibility Criteria

Educational Qualifications:

• Bachelor's degree or higher in a relevant engineering domain is mandatory.
• Experience in AI evaluation, data annotation, content review, quality assurance, or related analytical roles is an added advantage.

Required Skills:

• English Comprehension & Writing: Strong reading comprehension and native or bilingual written English proficiency, with the ability to explain complex reasoning clearly and accurately.
• Analytical & Critical Thinking: Strong deductive reasoning and problem-solving abilities, with the capability to break down complex, multi-variable problems systematically.
• Research Skills: Ability to conduct rapid and reliable online research, cross-reference information, identify credible sources, and verify facts.
• Constructive Feedback & Annotation: Ability to provide precise feedback, identify errors, annotate responses based on evaluation guidelines, and explain logical inconsistencies.
• Independence & Remote Readiness: Self-motivated and capable of maintaining productivity, accuracy, and consistency in a remote working environment.
• Technical Requirements: Access to a personal desktop or laptop with updated software and a stable, high-speed internet connection.

Role Responsibilities

• Review and evaluate AI-generated responses for accuracy, relevance, and logical consistency.
• Create, solve, and annotate analytical challenges, logical reasoning problems, and real-world decision-making scenarios.
• Develop step-by-step solutions, logical explanations, and detailed rationales to establish gold-standard responses.
• Conduct independent online research to fact-check AI-generated claims and verify information using reliable sources.
• Identify factual inaccuracies, hallucinations, flawed assumptions, and gaps in AI-generated responses.
• Analyze incorrect or suboptimal AI outputs and provide structured feedback, corrections, and annotations.
• Follow detailed project guidelines and evaluation rubrics to ensure consistent and high-quality assessments.
• Contribute to improving the reasoning, analytical capabilities, and reliability of next-generation AI models.

What You'll Work On

• Evaluate the analytical and logical reasoning capabilities of advanced AI models such as GPT.
• Assess AI-generated responses to complex problem-solving and fact-checking tasks.
• Break down large amounts of information into clear and structured logical components.
• Verify factual claims through independent research and credible external sources.
• Generate high-quality explanations and reference solutions for AI training.
• Identify reasoning errors and provide actionable feedback to improve AI performance.

Note: This is a short-term engagement of up to one week, and candidates must be available for up to 40 hours per week with a minimum of 4 hours of overlap with PST working hours.

Interested candidates: Please share your updated CV and LinkedIn profile at vyshnavi.e@zettamine.com.

Thanks & Regards,

Vyshnavi E

ZettaMine