Senior AI Engineer

Long-Term (12+ months): Platform Architecture & Ownership

• Own the end-to-end document intelligence architecture
• Lead migration from rule-based to LLM-powered systems
• Define engineering standards and best practices

Core Responsibilities 1. Prompt Engineering

• Design prompts for diverse document classification and extraction tasks
• Treat prompts as formal specifications (precise, structured, and edge-case-aware)
• Develop few-shot, chain-of-thought, and structured output templates
• Manage prompt lifecycle: versioning, testing, and rollback

2. LLM Output Evaluation

• Create and maintain ground truth datasets
• Build automated evaluation pipelines (precision, recall, field-level accuracy)
• Identify and resolve conceptually incorrect outputs despite surface correctness

3. AI Agent Orchestration

• Design multi-agent workflows for document processing
• Implement tool-use patterns and integrate MCP servers
• Optimize orchestration for scale and efficiency

4. Software Engineering

• Develop production-grade APIs and backend services
• Apply Clean Architecture / DDD principles
• Write maintainable, testable Python code
• Contribute to CI/CD, deployment, and observability systems

5. Stakeholder Collaboration

• Act as a bridge between business stakeholders and AI systems
• Translate product requirements into technical architectures
• Communicate system behavior, limitations, and quality metrics clearly

Required Skills & Experience

• 5+ years of software engineering experience (Python preferred)
• Advanced prompt engineering and LLM evaluation expertise
• Experience with ground truth dataset design
• Hands-on experience with LLM APIs (OpenAI, Anthropic, Azure AI)
• AI agent orchestration experience
• Strong understanding of Clean Architecture / DDD principles
• REST API development
• Version control (Git), CI/CD practices, containerization
• Experience with AWS or similar cloud platforms

Nice to Have

• Document understanding / OCR tools (e.g., AWS Textract)
• Experience with AWS services (EC2, S3, SQS, Lambda, ECS)
• Familiarity with LangChain / LlamaIndex
• Background in NLP or text classification systems

GHX: It's the way you do business in healthcare Global Healthcare Exchange (GHX) enables better patient care and billions in savings for the healthcare community by maximizing automation, efficiency and accuracy of business processes. GHX is a healthcare business and data automation company, empowering healthcare organizations to enable better patient care and maximize industry savings using our world class cloud-based supply chain technology exchange platform, solutions, analytics and services. We bring together healthcare providers and manufacturers and distributors in North America and Europe - who rely on smart, secure healthcare-focused technology and comprehensive data to automate their business processes and make more informed decisions. It is our passion and vision for a more operationally efficient healthcare supply chain, helping organizations reduce - not shift - the cost of doing business, paving the way to delivering patient care more effectively. Together we take more than a billion dollars out of the cost of delivering healthcare every year. GHX is privately owned, operates in the United States, Canada and Europe, and employs more than 1000 people worldwide. Our corporate headquarters is in Colorado, with additional offices in Europe. Disclaimer *Global Healthcare Exchange, LLC and its North American subsidiaries (collectively, “GHX”) provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, national origin, sex, sexual orientation, gender identity, religion, age, genetic information, disability, veteran status or any other status protected by applicable law. This EEO policy applies to all terms, conditions, and privileges of employment, including hiring, training and development, promotion, transfer, compensation, benefits, educational assistance, termination, layoffs, social and recreational programs, and retirement.*GHX believes that employees should be provided with a working environment which enables each employee to be productive and to work to the best of his or her ability. We do not condone or tolerate an atmosphere of intimidation or harassment based on race, color, national origin, sex, sexual orientation, gender identity, religion, age, genetic information, disability, veteran status or any other status protected by applicable law. GHX expects and requires the cooperation of all employees in maintaining a discrimination and harassment-free atmosphere. Improper interference with the ability of GHX’s employees to perform their expected job duties is absolutely not tolerated.

Read our GHX Privacy Policy