Resumo da vaga

Engineer- Data Engineering

Requisitos e responsabilidades

Conteúdo da vaga extraído em seções para revisão mais rápida.

Key Responsibilities

  • Design and develop scalable enterprise-grade data-processing solutions.
  • Build distributed and highly available data applications that support large-scale business requirements.
  • Design, develop, test, and maintain data pipelines connecting multiple source systems and target platforms.
  • Develop ETL and ELT workflows for batch and near-real-time data processing.
  • Process, transform, and validate large volumes of structured and unstructured data.
  • Develop cloud-native data solutions using Google Cloud Platform services.
  • Build data-processing and orchestration workflows using tools such as Airflow and Cloud Composer.
  • Work with services such as BigQuery, Dataflow, Dataproc, Datastream, Pub/Sub, Cloud Functions, and Cloud Run.
  • Support data-processing solutions using AWS services such as Glue, Lambda, EMR, and Data Pipeline when required.
  • Develop data-processing applications using Python, Shell scripting, and SQL.
  • Design and optimize solutions using relational databases, NoSQL databases, and distributed storage engines.
  • Support streaming-data applications using technologies such as Kafka, Pub/Sub, Spark, or similar tools.
  • Contribute to the development of data warehouses, data marts, data lakes, and data-mesh solutions.
  • Apply software-engineering best practices to ensure clean, reusable, maintainable, and high-quality code.
  • Participate in code reviews, technical design discussions, and solution-architecture activities.
  • Implement and maintain Continuous Integration and Continuous Delivery pipelines.
  • Use code-management and automation tools such as GitHub, GitLab, Jenkins, or equivalent platforms.
  • Follow DevOps principles throughout development, testing, deployment, and production support.
  • Monitor application health, data-pipeline performance, and system reliability.
  • Investigate and resolve data-processing failures, performance issues, and production incidents.
  • Use monitoring platforms such as Datadog or equivalent tools when required.
  • Collaborate with software engineers, data engineers, quality engineers, analysts, architects, and product stakeholders.
  • Participate in Agile activities, including sprint planning, daily stand-ups, reviews, and retrospectives.
  • Support technical alignment across team members and contribute to implementation planning.
  • Maintain technical documentation, data mappings, solution designs, and operational procedures.
  • Continuously evaluate new data-engineering tools, cloud services, and development practices.

Candidate Profile

  • Bachelor's degree in Computer Science, Software Engineering, Information Technology, or an equivalent field.
  • Minimum 1 to 2 years of experience developing enterprise-grade data-processing applications.
  • Strong programming skills in Python, Shell scripting, and SQL.
  • Hands-on experience processing large volumes of data.
  • Experience designing and developing ETL or ELT data pipelines.
  • Practical experience with relational databases, NoSQL databases, and distributed storage engines.
  • Hands-on experience with Google Cloud Platform.
  • Experience with GCP services such as BigQuery, Dataflow, Dataproc, Datastream, Pub/Sub, Cloud Functions, Cloud Run, and Cloud Composer.
  • Familiarity with ETL and orchestration tools such as Airflow.
  • Exposure to AWS data services such as Glue, Lambda, EMR, Spark, Hive, or Data Pipeline will be an advantage.
  • Experience working with streaming technologies such as Kafka, Pub/Sub, Storm, or Spark Streaming will be an advantage.
  • Good understanding of distributed systems, scalable architectures, and cloud-based data processing.
  • Experience working within Scrum and Agile delivery environments.
  • Familiarity with DevOps practices and software-development lifecycle processes.
  • Experience with source-control and CI/CD tools such as GitHub, GitLab, and Jenkins.
  • Exposure to application-monitoring tools such as Datadog or an equivalent platform will be an advantage.
  • Understanding of data warehousing, data marts, data lakes, or data-mesh concepts will be preferred.
  • Good knowledge of software-engineering standards, testing practices, and code-quality principles.
  • Strong analytical, troubleshooting, and problem-solving skills.
  • Strong written and verbal communication skills.
  • Ability to communicate technical ideas clearly and influence implementation decisions.
  • Ability to work collaboratively within cross-functional technical teams.
  • Proactive, adaptable, and committed to continuous learning and professional development.
  • Strong interest in building and maintaining reliable, high-performance data solutions.
Vagas similares

Mantenha uma lista reserva.

Ver stack
FocoData EngineeringÁrea da vaga
Sinal de senioridadeSeniorNível do candidato
StackAWS, CI/CD, GCPSkills principais
Localização1 país aceitoElegibilidade

Stack

Use estas tags para comparar vagas remotas similares.

Elegibilidade de localização

Candidatos devem aplicar apenas quando o país do perfil estiver listado aqui.

Seu perfilPaís não definidoEntre para comparar seu país com esta vaga.

Fluxo de contratação

O WithMira mostra a vaga e depois envia candidatos para a aplicação da empresa.

1Confira fit da vaga, stack e elegibilidade de localização no WithMira.
2Abra a página de aplicação da empresa pelo link rastreado.
3Salve a vaga ou assine oportunidades similares antes de sair.
Aplicar no site da empresaSite da empresaAbrir link