Overview

 

We are seeking an experienced Senior Data Engineer to lead the design, development, and optimization of end-to-end data pipelines and cloud-based solutions. You will be responsible for architecting scalable data and analytic systems, ensuring data integrity, and implementing software engineering best practices and patterns. The ideal candidate has a strong background in ETL, big data technologies, and cloud services, with a proven ability to drive complex projects from concept to production.

 

Primary Responsibilities/Essential Functions

 

This job description in no way states or implies that these are the only duties to be performed by the teammate occupying this position. The selected candidate may perform other related duties assigned to meet the ongoing needs of the business.

 

 

Qualifications

 

·         Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.

·         5+ years of experience as a Data Engineer with expertise in building large-scale data solutions.

·         Proficiency in Python, SQL, and scripting languages (Bash, PowerShell). 

·         Deep understanding of big data tools (Hadoop, Spark) and ETL processes.

·         Hands-on experience with cloud platforms (AWS S3, Azure Data Lake, Google BigQuery, Snowflake).

·         Strong knowledge of database systems (SQL, NoSQL), database design, and query optimization.

·         Experience designing and managing data warehouses for performance and scalability.

·         Proficiency in software engineering practices: version control (Git), CI/CD pipelines, and unit testing.

·         Strong experience in software architecture, design patterns, and code optimization.

·         Expertise in Python-based pipelines and ETL frameworks.

·         Experience with Azure Data Services and Databricks.

·         Excellent problem-solving, analytical, and communication skills.

·         Experience working in agile environments and collaborating with diverse teams.