Azure Data Engineer
Summary
Our teams integrate into the client's operations. As a data engineer, you will collaborate with business stakeholders and your data team to deliver a data product that is sustainable and highly maintainable long-term.
You will create data collection, extraction, and transformation frameworks for structured and unstructured data. You will develop data infrastructure systems (e.g. data warehouses, data lakes) including data access points, prepare and manipulate data using Azure Data Factory and other data pipeline tools, and organize data into formats and structures that improve reuse and efficient delivery to business and analytics teams and system applications. You will also integrate data across data lake, data warehouse and system applications to ensure information is delivered across the enterprise, and you will be accountable for efficient architecture and systems design.
What you'll do (roles & responsibilities)
- Lead the architecture, design, and implementation of complex data architecture and integration solutions (best practices across SDLC, coding standards, code reviews, source control, build processes, testing, and operations)
- Lead end-to-end Azure cloud migration projects, ensuring seamless transition from on-premises to cloud environments
- Develop and enforce Azure security best practices and compliance policies in multi-cloud environments
- Provide hands-on expertise in debugging, troubleshooting, and performance tuning Azure environments
- Build and evolve the data service layer, bringing components together for an outstanding customer offering
- Develop data pipelines using modern tools
- Create efficient load processes including logging, exception handling, support notifications, and operational visibility
- Perform database monitoring and collaborate with DBAs to optimize performance
- Lead analysis of models, relationships, and attributes to determine efficient design solutions
- Ensure adherence to standards for code, design, documentation, testing, and deployment
- Collaborate with data governance and strategy to ensure lineage is well understood and supports reuse and simplicity
- Assess opportunities to simplify operations using new tools/technologies and bring forward recommendations
What you should have (Must-Haves)
- Bachelor's degree required (master's an asset) in Software Engineering, Computer Science, or equivalent work experience in a technology or business environment
- Must-have certifications: AZ-900 Azure Fundamentals, Azure Data Fundamentals, Azure Developer Associate, Azure Administration Associate, Azure Solution Architect Expert, DevOps Engineer Expert
- Minimum of 7 years of experience working in structured data engineering work processes
- Minimum of 4 years of experience in Data Solutions Architecture
- Minimum of 4 years of experience in integration solutions development with pipeline tools (Qlik, Talend, Informatica, DataStage, SSIS)
- Demonstrated proficiency in Python, SQL, Databricks, and Azure services
- Experience with cloud platform services such as Azure, AWS
- Proficient in data modelling, data integrations, orchestration, and supporting methodologies
- Proficient in leading large-scale projects (or major project steps) and communicating progress to technical and non-technical stakeholders
- Proficient in multiple programming languages and engineering moderately complex enterprise solutions
- Proficient in data management, governance, data design, and database architecture, including extracting value from large disconnected datasets
- Ability to create Power BI dashboards for Azure performance monitoring, analytics, and reporting
- Experience with DevOps pipelines (Git, Gitlab, Jenkins), CI/CD, automated testing (unit, functional, performance)
- Ability to take initiative, operate independently, and drive complex data management projects to completion
Nice-to-Haves
- Experience with project management and progress tracking tools
- Experience with Agile development methodologies
- Strong knowledge of data governance frameworks and practices (e.g., DAMA, RDM, MDM, Data Quality)
Work details
- Location: Remote (EST timezone for all team members)
- Reporting relationship: You will report to the Product Manager
Compensation
Competitive contract rates, adjusted to your local market and country of residence. Compensation is location-based and reflects regional market standards. We benchmark against leading technology companies in your country to ensure competitive, fair pay.
What happens after you apply
Timeline: We aim to complete our process within 2-3 weeks of application.