[Remote] Principal AI Systems Engineer

Note: The job is a remote job and is open to candidates in USA. Iovance Biotherapeutics aims to be the global leader in innovating, developing and delivering tumor infiltrating lymphocyte (TIL) therapy for people with cancer. This senior role is responsible for the hands-on design, build, validation, and deployment of Artificial Intelligence (AI) systems that deliver measurable business value and support Iovance’s strategy to improve overall operational productivity.

Responsibilities

• Design, build, and ship AI systems against the approved Iovance AI roadmap, including end-to-end ownership of architecture, retrieval pipelines, prompts, evaluation, integrations, and deployment for assigned use cases
• Implement production-grade Retrieval-Augmented Generation (RAG) systems on Iovance’s AWS infrastructure (S3, Redshift, Bedrock), including chunking strategies, embedding selection, vector storage, retrieval and reranking, grounding, and citation handling appropriate to high-accuracy use cases
• Build, maintain, and run evaluation harnesses for AI systems, including held-out test sets, accuracy and grounding metrics, hallucination detection, adversarial inputs, and regression testing across model and prompt changes; treat evaluation as a first-class engineering deliverable, not an afterthought
• Design and implement integrations between AI systems and Iovance enterprise systems using Model Context Protocol (MCP), APIs, and event-driven patterns, applying least-privilege access principles and partnering with IT Security on integration approval
• Own and maintain LLM security controls for production AI systems, including input and output guardrails, prompt injection and jailbreak defenses, sensitive data redaction (PII, PHI, Iovance Confidential Information and Intellectual Property), content moderation, and abuse monitoring, working in partnership with IT Security
• Design, develop, deploy, and maintain AI agents (multi-step reasoning systems that combine LLMs with tools, retrieval, and planning) appropriate for use in a regulated life sciences environment, including bounded scope, defined human oversight, traceability of agent decisions, and safe handling of write-back actions to systems of record
• Establish and uphold modern engineering practices for AI development including version control for code, prompts, and evaluation sets; CI/CD pipelines; environment separation (dev, test, production); and reproducible builds
• Conduct hands-on technical evaluation of AI vendors, tools, and Foundation Models when build-vs-buy decisions are under consideration; produce concise, fact-based recommendations to the IT function lead and AI Governance Committee, including proof-of-concept results where appropriate
• Implement and operate technical controls for production AI systems including audit logging, access management, prompt and model change control, model registry, ongoing performance monitoring, and incident detection, in alignment with Iovance policies
• Author technical documentation appropriate to the system risk tier, including architecture diagrams, data flow diagrams, evaluation reports, runbooks, and validation deliverables; contribute to the Iovance AI Validation Playbook
• Mentor junior engineers who collaborate on AI projects; stay current on rapid advances in AI tooling, models, and engineering best practices, and bring technical recommendations forward

Skills

• 10+ years of progressive software and/or AI/ML engineering experience, with the most recent 1+ years dedicated primarily to LLM-based application development. Demonstrated track record of shipping production AI systems that real users depend on
• Deep, hands-on production experience with Retrieval-Augmented Generation (RAG) including chunking strategies, embedding models, vector stores, retrieval and reranking, and grounding for high-accuracy use cases. Working production experience with Model Context Protocol (MCP) or equivalent agent/tool integration patterns
• Practical working experience across multiple frontier model families (e.g., Anthropic Claude, OpenAI GPT, Google Gemini, leading open-weight models), with the judgment to select among them based on task fit, accuracy, cost, latency, safety properties, and data-handling commitments. Awareness of model capability changes and how to evaluate new model releases
• Strong software engineering fundamentals: production Python (and ideally one other language); modern Agile delivery; version control (Git); CI/CD; containerization; cloud platforms (preferably AWS, with working familiarity with S3, Redshift, and Bedrock); MLOps tooling and practices
• Hands-on, builder disposition; this role spends the majority of its time writing code, designing systems, evaluating models, and producing technical artifacts — not in meetings
• Working production experience with AWS data and AI services is strongly preferred (S3, Redshift, Bedrock, IAM)
• Working knowledge of enterprise search and retrieval services such as OpenSearch, Elasticsearch, or equivalent, including the design of hybrid retrieval patterns (vector plus lexical/BM25) that improve grounding and relevance in production RAG systems
• Relevant cloud and AI/ML certifications (AWS, Azure, etc.)
• Working knowledge of US regulatory requirements applicable to AI in regulated life sciences, including 21 CFR Part 11, GxP, HIPAA, and emerging FDA expectations on AI/ML in pharmaceutical manufacturing and drug development
• Bachelor's or Master's degree in Computer Science, Data Science, Engineering, or related quantitative discipline

Benefits

• This job operates in a professional workplace or remote office environment and requires standard office equipment and keyboards. Employees who work remotely are expected to maintain their workspace and environment safely and free from safety hazards.
• Iovance is committed to cultivating and offering a diverse and inclusive work environment.
• As an equal-opportunity employer, our employees and applicants will be considered without regard to an individual’s race, color, religion, sex, pregnancy, national origin, age, physical and mental disability, marital status, sexual orientation, gender identity, gender expression, genetic information, military and veteran status, and any other characteristic protected by applicable law.
• If you need assistance or accommodation to apply to one of our opportunities, please contact [email protected].

Company Overview

Company H1B Sponsorship