kalinga.ai

Remote AI Engineer Job at Dusker AI: Evaluate and Benchmark Real-World AI Systems

Remote AI Engineer job at Dusker AI for LLM evaluation, AI benchmarking, and safety engineering in India.
Join Dusker AI as a Remote AI Engineer and help build, evaluate, and benchmark next-generation AI systems for real-world reliability.

Dusker AI is actively hiring — and this remote AI Engineer job is designed for people who think beyond accuracy scores. If you want to work on reasoning, robustness, and safety evaluation for intelligent agents, this fully remote role is open now and recruiting across India.


What Is This Remote AI Engineer Job?

A remote AI Engineer job at Dusker AI means you are not just building models — you are stress-testing them against reality. Dusker AI specializes in benchmarking and evaluating AI agents for real-world performance, working with organizations that need to know their AI is truly deployment-ready before shipping.

This remote AI Engineer job places you at the intersection of AI development and quality assurance — a niche that is growing rapidly as the industry moves from proof-of-concept to production-grade AI systems.


About Dusker AI

Dusker AI uses expert-driven evaluation frameworks to assess AI across four critical dimensions: reasoning, reliability, adaptability, and safety. Their clients build conversational AI and autonomous systems, and Dusker serves as the external quality layer that ensures those systems hold up under real-world pressure — not just on benchmarks.


Key Responsibilities

This remote AI Engineer job covers the full arc of AI development and evaluation:

  • Design, develop, and optimize AI models and intelligent agents
  • Build and evaluate neural network architectures for diverse applications
  • Develop NLP solutions including prompt engineering and LLM evaluation
  • Create software tools that support AI benchmarking and testing workflows
  • Analyze model behavior to surface performance gaps and improvement opportunities
  • Design evaluation methodologies covering reasoning, reliability, and safety
  • Contribute to production-quality, reusable, and well-documented codebases
  • Help scale automated benchmarking and evaluation processes across teams

Required vs. Preferred Qualifications

CriterionRequiredPreferred
DegreeCS, Data Science, EE, or equivalent
ProgrammingPython (production-quality)
ML FrameworksPyTorch, TensorFlow, or JAXAdvanced JAX usage
NLP SkillsFine-tuning, prompt engineering, LLM evalLLM agent experience
MLOpsReproducible experimentation basicsAI benchmarking pipelines
Safety WorkEvaluation methodology designAI safety-focused evaluation
Work StyleSelf-directed and collaborativeFully async remote experience

Who Is the Ideal Candidate?

Is this remote AI Engineer job the right fit for you?

Yes — if you have a solid CS foundation, hands-on NLP experience, and you care about how AI systems fail, not just how they succeed. Dusker AI needs engineers who can both build and rigorously critique — people who treat evaluation as a first-class engineering discipline, not an afterthought added before deployment.


Why This Remote AI Engineer Job Stands Out

Most AI roles reward you for shipping new features. This remote AI Engineer job rewards you for finding what breaks.

The core product at Dusker AI is evaluation — meaning your work directly shapes whether AI systems reaching the real world are safe and reliable. For engineers focused on AI quality, robustness, and safety, this is a rare opening in a specialty that is defining its own standards in real time.

Location: India — fully remote Company: Dusker AI


How to Apply

Review the full job description and submit your application through the official listing:

Apply for this Remote AI Engineer Job at Dusker AI →


Leave a Comment

Your email address will not be published. Required fields are marked *

Scroll to Top