Senior Software Engineer - Retrieval-Augmented Generation (RAG)

Job title: Senior Software Engineer II – Retrieval-Augmented Generation (RAG) System About the role, we are seeking an experienced engineer to work with a team to build and support a healthcare centered production-scale RAG system that combines document retrieval with response generation to deliver accurate, context-aware answers. This engineer we be expected to design, implement, and operate end-to-end RAG pipelines— LLM interaction, API creation, and high-performance, secure delivery of knowledge-grounded capabilities. You will collaborate with data engineers, platform teams, and product partners to ship reliable, scalable, and observable systems. About the team; This collaborative team is entrusted with building the Next Generation Health Solutions through the utilization of cutting-edge technology. Role and responsibilities Architecting, implementing, testing, and operating end-to-end RAG workflows: Ingesting and normalizing documents from diverse sources Generating and managing embeddings; index and query vector databases Retrieve relevant passages, apply reranking or fusion strategies, and feed prompts to LLMs Building scalable, low-latency services and APIs (Python preferred; other languages acceptable) and ensure production-grade reliability (monitoring, tracing, alerting) Integrating with vector databases and embedding pipelines and optimize for latency, throughput, and cost Designing and implementing ML Ops workflows: model/version management, experiments, feature stores, CI/CD for ML-enabled services, rollback plans Developing robust data pipelines and governance around ingestion, provenance, quality checks, and access controls Collaborating with data engineers to improve retrieval quality (embedding strategies, reranking, cross-encoder models, prompt engineering) and implement evaluation metrics (precision/recall, MRR, QA accuracy, user-centric metrics) Implementing monitoring and observability for RAG components (latency, success rate, cache hit rate, retrieval quality, data drift) Ensuring security, privacy, and compliance (authentication, authorization, data masking, PII handling, audit logging) Required qualifications 5+ years of professional software engineering experience designing and delivering production systems Strong programming skills (Python required; NodeJs a plus) Deep understanding of retrieval-augmented or application-scale NLP systems and practical experience building RAG-like pipelines Hands-on experience with ML workflow tooling and MLOps concepts (model serving, versioning, experiments, feature stores, reproducibility) Proficiency with cloud infrastructure and modern software practices (AWS/GCP/Azure; Docker; Kubernetes; CI/CD) Strong problem-solving skills, excellent communication, and ability to work with cross-functional teams Familiarity with data governance, privacy, and security best practices Preferred qualifications Experience with agentic workflow tools (LangGraph) and familiarity with prompt engineering for LLMs Exposure to working with and evaluating different LLMs Knowledge of evaluation methodologies for retrieval and QA systems and the ability to set up A/B tests and dashboards Experience with data processing frameworks (SQL, Pandas, Spark) and working with large-scale data pipelines Background in performance optimization for low-latency AI services (MLflow) Experience with monitoring and logging via New Relic, K9s, Portkey, etc Experience with minimizing token usage and cost optimization Comfortable with design and implementation of security controls for data-intensive AI systems Elsevier is a renowned global information analytics company that primarily focuses on providing scientific, technical, and medical (STM) research content, tools, and services. It is one of the largest publishers of academic journals and scholarly literature in the world. Elsevier operates in various domains, including science, technology, medicine, social sciences, and more. They publish a vast number of peer-reviewed journals covering a wide range of disciplines. These journals act as platforms for researchers and academics to share their findings and contribute to the advancement of knowledge in their respective fields. U.S. National Base Pay Range: $95,300 - $158,800. Geographic differentials may apply in some locations to better reflect local market rates. If performed in New Jersey, the base pay range is $107,646 - $171,954. This job is eligible for an annual incentive bonus. We know your well-being and happiness are key to a long and successful career. We are delighted to offer country specific benefits. Click here to access benefits specific to your location. We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form or please contact 1-855-833-5120. Criminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scams here. Please read our Candidate Privacy Policy. We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law. USA Job Seekers: EEO Know Your Rights. Elsevier is a global leader in advanced information and decision support for science and healthcare. We believe that by working together with the communities we serve, we can shape human progress to go further, happen faster, and benefit all. We support continuous discovery and uphold the highest standards of content integrity, reliability, and reproducibility so the communities we serve can advance their field of science, healthcare or innovation with confidence. By combining high-quality content with powerful analytics, we transform complexity into clarity and deliver mission-critical insights that help professionals make better decisions when it matters most. We deliver insights that help research institutions, governments, and funders achieve their goals. We help researchers discover and share knowledge, collaborate, and accelerate innovation. We help librarians provide verified, quality information to universities. We help innovators turn knowledge into new products. We help health professionals improve patient care and educators train the next generation of doctors and nurses. Connecting quality content and innovative technologies, we make progress go further and happen faster. And by championing inclusion and sustainability, we ensure progress benefits all. With 9,500 employees, over 2,300 technologists in 5 major tech hubs, and more than 60 locations across the globe, we are committed to supporting the scientific and healthcare communities around the world. We offer a diverse range of opportunities across technology, commercial, business, and early career jobs. If you are looking for a career that inspires progress in science, innovation and health, and allows you to grow every day, find your team at Elsevier. Elsevier is part of RELX Group. Let's shape progress together. Join us. elsevier.com/about/careers