Senior Lead AI Engineer

Job description

Location: Hybrid / Iselin, NJ

Medidata follows a hybrid office policy in which employees who are hired for an in-person position are expected to work on site a certain number of days per week in accordance with Company policy.

About our Company:

About the Team:

The Senior Lead AI Engineer reporting to the Senior Director, Enterprise Technology works within the Information Systems organization with strong expertise in AWS cloud services, machine learning, and large-scale data engineering to lead the design, development, and deployment of AI-driven solutions.

This role requires hands-on engineering and architectural skills to drive AI/ML initiatives from conception to production while ensuring scalability, performance, and security of solutions.

Responsibilities:

• Partner with internal teams on AI initiatives and translate business problems into AI-driven solutions and frameworks.
• Assess emerging AI technologies and stay current with advancements (, LLMs, generative AI, multimodal models) and identify opportunities for adoption or innovation.
• Provide strategic guidance on emerging technologies, including considerations for Bedrock vs.
  
  custom model hosting and hybrid cloud AI approaches.
• Integrate APIs from major LLM providers (OpenAI, Anthropic Claude, Amazon Bedrock, etc.).
• Perform prompt engineering and fine-tune LLMs for domain-specific tasks.
• Optimize model performance, latency, and cost for production workloads.
• Develop and Lead the technical design of AI/ML solutions using AWS services such as Amazon Bedrock, SageMaker, OpenSearch and Python frameworks.
• Develop and fine-tune Large Language Models (LLMs), generative AI models, and predictive Machine Learning models.
• Implement comprehensive security, compliance, and cost optimization strategies for AI workloads on AWS.
• Deploy scalable models incorporating strong MLOps practices including CI/CD pipelines, monitoring, and retraining.
• Integrate Retrieval Augmented Generation (RAG) and vector databases (OpenSearch, Pinecone, etc) for advanced generative AI solutions.
• Implement AI governance, content filtering, and security guardrails using AWS Bedrock Guardrails and IAM policies.
• Architect and manage robust data pipelines, utilizing a hybrid approach with Informatica Cloud and AWS services (S3, Lambda, Step Functions, Redshift).
• Ensure strict adherence to ethical AI practices and regulatory compliance (, GDPR, HIPAA).

Qualifications:

• Bachelor’s or Master’s degree in Computer Science, Data Science, or a related technical field.
• 5+ years of hands-on experience in AI/ML engineering.
• 10+ years of hands-on experience on high volume data engineering solutions.
• Deep expertise in the AWS AI/ML stack, including SageMaker, Bedrock, Redshift, Glue, and Lambda.
• Proficiency in Python, PyTorch, TensorFlow, and MLOps frameworks.
• Hands-on experience with LLMs, RAG architecture, embeddings, and vector search.
• Strong understanding of cloud architecture, IAM, VPC networking, and cost management on AWS.
• Experience in developing multimodal AI solutions (text, image, audio).
• Familiarity with AWS Bedrock Knowledge Bases, Agent Frameworks, and fine-tuning custom models.
• Exposure to data governance and security frameworks relevant to AI workloads.
• Prior experience working with enterprise operational systems (Finance, Sales, Customer Support/Success, etc.).

As with all roles, Medidata sets ranges based on a number of factors including function, level, candidate expertise and experience, and geographic location.

The salary range for positions that will be physically based in the NYC Metro Area is $135,000-180,000

Base pay is one part of the Total Rewards that Medidata provides to compensate and recognize employees for their work.

Most sales positions are eligible for a commission on the terms of applicable plan documents, and many of Medidata's non-sales positions are eligible for annual bonuses.

Medidata believes that benefits should connect you to the support you need when it matters most and provides best-in-class benefits, including medical, dental, life and disability insurance; 401(k) matching; flexible paid time off; and 10 paid holidays per year.

Equal Employment Opportunity:

In order to provide equal employment and advancement opportunities to all individuals, employment decisions at Medidata are based on merit, qualifications and abilities.

Medidata is committed to a policy of non-discrimination and equal opportunity for all employees and qualified applicants without regard to race, color, religion, gender, sex (including pregnancy, childbirth or medical or common conditions related to pregnancy or childbirth), sexual orientation, gender identity, gender expression, marital status, familial status, national origin, ancestry, age, disability, veteran status, military service, application for military service, genetic information, receipt of free medical care, or any other characteristic protected under applicable law.

Medidata will make reasonable accommodations for qualified individuals with known disabilities, in accordance with applicable law.

Applications will be accepted on an ongoing basis until the position is filled.

#LI-EM1

#LI-Hybrid

Required Skill Profession

Computer Occupations