AI QA Engineer

Description:

·      Solid understanding of Generative AI concepts, including RAG pipelines, embeddings, and LLM evaluation.

·      Proficiency in query analysis and data validation.

·      Familiarity with AI evaluation metrics (accuracy, precision, recall, BLEU/ROUGE, etc.).

·      Experience with feedback loop mechanisms and reinforcement learning principles is an advantage.

·      Basic programming skills (Python preferred) for QA testing and analysis tasks.

·      Strong attention to detail and problem-solving abilities.

·      Ability to design and execute test plans and evaluation protocols for AI systems.

·      Competence in conducting sentiment and text analytics on user feedback.

Requirement:

·      Bachelors degree in Computer Science, Data Science, Engineering, or a related field (Advanced degree is a plus).

·      Experience with GenAI evaluation frameworks (e.g., OpenAI Evals, RAGAS, or custom scoring).

·      Knowledge of cloud-based AI platforms (OpenAI, Gemini, Llama, others).

·      Previous involvement in AI quality assurance or AI ethics & governance projects.

Information :

• Company : Lippo Malls Indonesia
• Position : AI QA Engineer
• Location : Jakarta Barat
• Country : ID