Context Engineer / Prompt Engineer - AI Testing & Workflow Validation
The Story Behind the Role
What is the most exciting challenge for this role in the first 90 days?
The most exciting challenge for the Prompt Engineer in the first 90 days will be to establish and refine the initial framework for AI output validation. You'll need to design effective prompts, build testing tools, and collaborate with our engineering teams to ensure that AI-generated code and workflows meet our high standards for accuracy and reliability. This isn't just about testing; it's about building the foundation of how we scale our AI-driven features reliably and efficiently.
What is a quality you're looking for that isn't on the formal job description?
Beyond the formal requirements, we're looking for a person who possesses exceptional intellectual curiosity. Our AI landscape is constantly changing, and we need someone who is not only a strong problem-solver but is also passionate about staying on the cutting edge of large language models and prompt-engineering techniques. This proactive, self-driven learning is essential for finding innovative ways to improve our tools and processes.
How does this role contribute to the company's larger mission?
This role is central to Red Hat's mission of open source innovation. By ensuring our AI models are reliable and effective, you directly contribute to our commitment to open, transparent, and ethical use of technology. Your work will empower our developers and associates to be more productive, helping them focus on higher-impact work and creating more innovative solutions for our customers. You will be a key player in shaping the future of how we build and deliver our open source solutions.
As a Prompt Engineer on the AI Testing & Workflow Validation team, you will design, test, and refine prompts for AI models to generate code and execute automated workflows. This role involves a mix of creativity in prompt design and rigorous testing to ensure AI-driven features are accurate and reliable.
What You'll Do
- Design and optimize prompts for AI-assisted code generation.
- Collaborate with product owners and developers to translate requirements into effective prompting strategies.
- Validate AI-generated outputs through structured test cases and regression testing.
- Build or adapt internal tooling to streamline prompt testing and versioning.
- Document prompt patterns and best practices for knowledge sharing.
What You'll Need
- Bachelor’s degree in Computer Science or a related field, or equivalent practical experience.
- Hands-on experience with large language models (e.g., GPT, LLaMA, Claude).
- Strong coding skills in Python.
- Familiarity with testing methodologies and frameworks (unit, integration, regression).
Application Insights
Redirects to a Workday application portal. Expect to create an account and fill out a multi-page form.
Provenance Trail
To ensure authenticity, we track the origin and verification history of our listings.
- Last Verified:September 22, 2025