At String AI India, we believe that intelligence is nothing without accuracy. As an AI Quality & Evaluation Engineer, you will be the final gatekeeper for our AI-first products, ensuring that the outputs from our OpenAI-based models are reliable, safe, and of the highest quality. You will focus on high-precision testing to identify edge cases and technical flaws in AI-driven web platforms.
To excel in this role, you should be familiar with both quality assurance and AI evaluation tools:
Programming Languages: Proficiency in Python for writing automated evaluation scripts and data validation.
AI Evaluation Tools: Familiarity with frameworks like DeepEval, Giskard, or Ragas to measure RAG and LLM performance.
OpenAI Integration: Understanding of OpenAI APIs to benchmark model responses against ground-truth data.
Testing Frameworks: Hands-on experience with Selenium, Pytest, or Postman for integrated AI-web application testing.
Metrics Mastery: Deep knowledge of evaluation metrics like BLEU, ROUGE, Precision, Recall, and hallucination detection rates.
Model Benchmarking: Developing and executing rigorous test suites to evaluate the accuracy, tone, and reliability of OpenAI-based models.
Hallucination Detection: Identifying and documenting instances where AI models provide incorrect or biased information to ensure Responsible AI.
Performance Monitoring: Tracking the stability and latency of AI-powered web platforms during peak loads.
Cross-Team Collaboration: Working with Generative AI Engineers and Data Scientists to provide feedback for model fine-tuning.
Manual & Automated Evaluation: Combining human-in-the-loop manual testing with automated scripts to ensure 100% product readiness.
Interns & Freshers: Graduates with a sharp eye for detail and a foundational understanding of how AI models work.
Experienced QA Engineers: Professionals with background in manual or automation testing looking to transition into AI Quality Assurance.
Education: Open to candidates who have completed 10th, 12th, Graduation or post graduation .
Mindset: We look for individuals with a strong commitment to real-world problem solving and daily learning.
Location: Based in Bengaluru, Karnataka, India (In-office) to provide structured mentoring and guidance.
Cost: This is a 100% Free of Cost training and entry-level initiative.
Selection Rule: Selection is based on merit, preparedness, and interview performance. Availability of opportunities may vary each year.
WhatsApp
