Gen(AI) Test Engineer

Gen(AI) Test Engineer

About us

At Sixsentix, we don't just test software—we accelerate innovation. As a leading provider of quality assurance & software testing services, we empower global enterprises to deliver high-quality solutions continuously faster and smarter. Our secret? A fearless blend of cutting-edge tools, proven methodologies and an approach that thrives on bold ideas.

Across all industries, we are the driving force behind some of the most successful digital transformations and platform innovation in Europe and beyond.

Why Join Us?

• Impact from Day One: Your work will directly shape the digitalization of leading companies
• Expert Collaboration: Work alongside some of the brightest minds in quality assurance and testing
• Global Reach, Local Support: Be part of a diverse, international team with consultants in Switzerland, Serbia, Austria, Germany, Poland and the UAE
• Continuous Learning: We champion growth—through training, mentorship and a culture that celebrates curiosity
• Inclusive Culture: We value diversity and believe that different perspectives make us stronger

Who We're Looking For

You are a driven, team-oriented professional who thrives in dynamic environments. You enjoy solving complex problems, collaborating across borders and delivering exceptional value to clients as consultant. At Sixsentix, you will find a place where your ideas matter and your growth is a priority.

What we offer

• Significant professional development in the rapidly evolving AI governance space
• Chance to work with cutting-edge AI technologies
• Exposure to emerging regulatory frameworks and industry standards
• Opportunities to influence AI strategy at the enterprise level
• Engaging projects across various sectors
• A community of skilled professionals in Quality Assurance and IT
• Flexible working hours with the option to work from home
• Team events designed to help you connect and share knowledge with your colleagues
• Attractive fringe benefits, such as extra holidays, sports support, tenure awards and more

Your responsibilities

AI System Validation & Testing

• Design and implement testing frameworks for LLM-based applications, multi-agent systems and RAG pipelines
• Evaluate AI outputs for conciseness, completeness, semantic accuracy, factual correctness, contextual relevance, tone consistency, bias, safety and compliance
• Implement governance workflows, risk scoring methods and compliance reporting
• Set up continuous monitoring for production AI systems, with automated alerts for anomalies

Testing Infrastructure & Automation

• Validate LLM APIs across multiple providers using tools like Postman, REST Assured and pytest
• Integrate AI testing suites into CI/CD pipelines for regression testing, benchmarking and deployment gates
• Manage version control for prompts and test cases using Git and leverage MLOps tools such as MLflow or Weights & Biases

Data Engineering & Evaluation

• Manage diverse data formats (JSON, CSV, Parquet, JSONL) and build evaluation datasets from real-world scenarios
• Design automated metrics and human-in-the-loop workflows, including inter-annotator agreement processes
• Create and maintain domain-specific evaluation benchmarks and ground truth datasets

Further Responsibilities

• Build a high-performing team and serve as the subject matter expert
• Cultivate and strengthen long-term client relationships, focusing on retention and business growth
• Contribute with your knowledge and experience within the Sixsentix test consulting community

Your profile

• Proven hands-on experience in GenAI application development (prompt engineering, API integrations, output workflows)
• Familiarity with RAG concepts, vector databases, embedding strategies and multi-agent systems
• Strong understanding of GenAI challenges such as hallucinations, prompt sensitivity, consistency issues and output variability
• Solid software testing background in enterprise environments, with the ability to communicate technical concepts to varied stakeholders
• Proficiency in API testing frameworks, CI/CD integration and Git-based collaboration
• Data handling expertise and knowledge of evaluation methodologies for AI performance and risk assessment
• Self-starter mindset, comfortable working in ambiguous environments to define new testing methodologies and quality standards
• Passionate about ensuring AI systems are safe, reliable and beneficial for end users
• Demonstrate outstanding communication and presentation skills beyond pure technical expertise