LLM Engineering Expert

Hello,

Greetings from ZettaMine!!!

Freelancing Opportunity: We are hiring LLM Engineering Experts for a short-term AI research and evaluation project focused on engineering simulation, design optimization, and identifying reasoning weaknesses in advanced AI models.

Eligible Locations: Bangladesh, India, Indonesia, Egypt, Ghana, Nigeria, Turkey, Brazil, Colombia, and approved states in the USA.

Role: LLM – Engineering Expert (AI Evaluation Engineer – Engineering Simulation & Design)

Experience: 10+ years of hands-on engineering design experience

Education: Master’s degree or PhD in Electrical, Mechanical, or Aerospace Engineering

Mode: Remote

Commitment: Full-time, 40 hours per week

Working Hours: Minimum 4 hours of overlap with PST working hours

Start Date: Immediate

Mandatory Eligibility Criteria

Technical Qualification:

• Strong engineering design, analytical, problem-solving, and technical research skills.
• Proficiency in at least one relevant open-source engineering simulation tool, such as ngspice, PySpice, OpenFOAM, FEniCSx, CalculiX, python-control, CadQuery, build123d, OpenModelica, Cantera, or Gmsh.
• Strong Python scripting skills for simulation, automation, and testing.
• Hands-on experience with modern Large Language Models (LLMs) and AI coding agents.
• Understanding of AI evaluation concepts, including pass@k, failure-mode analysis, and nondeterministic behavior.
• Ability to analyze AI agent execution logs and identify reasoning, coding, and tool-use failures.
• Strong understanding of physical plausibility, unit consistency, boundary conditions, convergence criteria, and engineering documentation.

Educational Qualification:

• Mandatory: Master’s degree or PhD in Electrical, Mechanical, or Aerospace Engineering.
• Strong engineering design expertise and technical documentation skills are required.

Relevant Engineering Domains:

• Electrical Engineering
• Mechanical Engineering
• Aerospace Engineering
• Control Systems
• Systems Engineering
• Robotics

Experience:

• 10+ years of hands-on engineering design experience.
• Experience in engineering simulation, design optimization, and validation.
• Prior experience with AI evaluation, LLMs, or coding agents is essential to the technical requirements.
• Experience developing automated test benches, objective graders, or engineering benchmarks is an advantage.

Availability:

• Full-time commitment of 40 hours per week.
• Minimum 4 hours of overlap with PST working hours.
• Weekend on-call availability is required.
• Ability to commit to the project for up to 24 weeks.

Others:

• Ability to work independently in a remote environment.
• Personal desktop/laptop with a stable, high-speed internet connection.
• Strong analytical, documentation, and technical communication skills.
• Ability to collaborate with AI researchers, project leads, and engineering domain experts.

What You’ll Work On:

• Design complex, original engineering problems that challenge advanced AI models and coding agents.
• Develop engineering design tasks with competing constraints, clear optimization targets, validated reference solutions, and objective automated graders.
• Build, execute, and validate simulation environments using open-source tools and custom Python test benches.
• Analyze AI agent outputs and execution logs across repeated trials to identify recurring reasoning and tool-use failures.
• Identify issues such as misinterpreted simulator feedback, premature design convergence, and physically impossible geometries.
• Refine benchmark difficulty based on actual model performance while ensuring accuracy and clarity.
• Collaborate with AI researchers, pod leads, and domain experts to improve AI model evaluation.
• Document findings and contribute to high-quality engineering simulation benchmarks.

Perks of Freelancing:

• Fully remote work environment.
• Opportunity to contribute to advanced AI research and evaluation projects.
• Hands-on experience with frontier AI models and engineering simulation benchmarks.
• Opportunity to apply engineering expertise to AI training, testing, and performance improvement.
• Short-term contract engagement of up to 24 weeks.

Application and Evaluation Process

• Interested candidates must complete the job interest form.
• Shortlisted candidates will proceed through the evaluation and delivery review process.

Interested candidates are requested to share their updated CV with us at md.afreen@zettamine.com.

Thanks & Regards,

Saranya M (Afreen)

ZettaMine Labs Pvt. Ltd.