Senior Data Engineer (Remote, Any Location, ES)

Details

• Design and optimize complex data storage solutions, including data warehouses and data lakes.
• Develop, automate, and maintain data pipelines for efficient and scalable ETL processes.
• Ensure data quality and integrity through data validation, cleansing, and error handling.
• Collaborate with data analysts, machine learning engineers, and software engineers to deliver relevant datasets or data APIs for downstream applications.
• Implement data security measures and access controls to protect sensitive information.
• Monitor data infrastructure for performance and reliability, addressing issues promptly.
• Stay abreast of industry trends and emerging technologies in data engineering.
• Document data pipelines, processes, and best practices for knowledge sharing.
• Lead data governance and compliance efforts to meet regulatory requirements.
• Collaborate with cross-functional teams to drive data-driven decision-making within the organization.
• Minimum of 7 years plus experience in data engineering.
• Track record of deploying and maintaining complex data systems at an enterprise level within regulated environments.
• Expertise in implementing robust data security measures, access controls, and monitoring systems.
• Proficiency in data modeling and database management.
• Strong programming skills in Python and SQL.
• Knowledge of big data technologies like Hadoop, Spark, and NoSQL databases.
• Deep experience with ETL processes and data pipeline development.
• Strong understanding of data warehousing concepts and best practices.
• Experience with cloud platforms such as AWS and Azure.
• Excellent problem-solving skills and attention to detail.
• Ability to collaborate effectively with cross-functional teams.
• Strong communication skills, both written and verbal.
• Ability to keep abreast of industry trends and emerging technologies in data engineering.
• Bachelors in Computer Science or Engineering
• Excellent command of English.
• French and Spanish language skills are a bonus.
• Programming languages and tools: Python, SQL.
• Big data technologies: Hadoop, Spark, NoSQL databases.
• ETL and data pipeline tools: AWS Glue, Airflow.
• Cloud platforms: AWS, Azure.
• Data visualization tools and data modeling software.
• Version control systems and collaborative development platforms.