Role overview

Lead Data Engineer- AWS

Requirements and responsibilities

Readable role content extracted into sections for faster review.

Key Responsibilities:

  • GenAI Infrastructure: Architect data pipelines using Amazon Bedrock and Amazon SageMaker to build, deploy, and scale Generative AI applications.
  • Vector Foundations: Implement and optimize vector search capabilities using Amazon OpenSearch Serverless or specialized vector engines for RAG (Retrieval-Augmented Generation).
  • Serverless Data Engineering: Build highly scalable, event-driven ETL pipelines using AWS Lambda, AWS Glue, and Amazon Kinesis.
  • Modern Data Stack: Manage large-scale data lakehouses leveraging Amazon S3, AWS Lake Formation, and Amazon Redshift.
  • LLM Ops: Integrate AWS Step Functions and SageMaker Pipelines to automate the fine-tuning and deployment of foundation models.

Requirements

  • Experience: 8-12 years in Data Engineering with a heavy focus on the AWS Cloud stack.
  • AWS Expertise: Deep hands-on experience with Glue, Athena, EMR, and Redshift.
  • AI/ML Tools: Proficiency in LangChain or LlamaIndex integrated with AWS services to handle unstructured data (text, images, PDFs).
  • DevOps & IAC: Experience deploying infrastructure using AWS CDK or Terraform.
  • Core Skills: Advanced SQL, Python and PySpark skills tailored for distributed processing on AWS.
Similar roles

Keep a backup shortlist.

Browse stack
FocusData EngineeringRole area
Seniority signalSeniorCandidate level
StackAWS, LLM, PythonPrimary skills
Location1 accepted countryEligibility

Stack

Use these tags to compare similar remote roles.

Location eligibility

Candidates should apply only when their profile country is listed here.

Your profileCountry not setSign in to check your country against this role.

Hiring flow

WithMira shows the role, then sends candidates to the company application.

1Check role fit, stack, and location eligibility in WithMira.
2Open the company application page from the tracked apply link.
3Save the role or subscribe for similar opportunities before leaving.
Apply on company siteCompany siteOpen link