Job Title: Data Engineer (3-5 years experience)
Job Summary:
We are seeking a highly skilled Data Engineer with 3-5 years of experience to join our dynamic team. The ideal candidate will have a strong background in both on-premises data engineering technologies and Cloud services. You will be responsible for designing, implementing, and maintaining scalable data pipelines, ensuring data quality, and supporting various data integration initiatives.
Key Responsibilities:
- Design, develop, and maintain data pipelines to support data integration from various sources.
- Implement ETL/ELT processes for extracting, transforming, and loading data into data warehouses and data lakes.
- Work with Azure cloud services including Azure Data Factory, Azure Synapse Analytics, SQL Managed Instance.
- Manage and optimize on-premises databases using SQL Server, SSIS, and other related tools.
- Ensure data quality, governance, and security are maintained across all environments.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements.
- Monitor and troubleshoot data pipelines for performance and accuracy.
- Participate in data modeling, schema design, and optimization of complex queries.
- Automate data workflows and optimize data storage solutions.
Required Skills & Qualifications:
- Bachelor’s degree in Computer Science, Information Technology, or a related field
- 3-5 years of experience in data engineering or a related field.
- Strong knowledge of ETL/ELT processes, data integration, and data warehousing.
- Proficiency in Azure cloud technologies such as Azure Data Factory, Azure Synapse Analytics/MS Fabric, and Azure Storage
- Hands-on experience with Snowflake advanced features is a plus.
- Experience with on-premises technologies such as SQL Server, SSIS, and Power BI or Tableau.
- Strong SQL skills for querying and transforming data.
- Experience with scripting languages (e.g., Python or PowerShell) for automation.
- Familiarity with version control systems like Git.
- Strong problem-solving skills with the ability to work in a fast-paced environment.
- Excellent communication skills for collaborating with cross-functional teams.
Preferred Qualifications:
- Experience with data governance and security best practices.
- Experience with other cloud platforms (AWS, Google Cloud) is an advantage.