Data Engineer
Roles and Responsibilities:
Perform various activities including requirements gathering, solution development and the project implementation throughout the phases of Agile methodology
ELT Engineer / Developer will be responsible for the design, implementation and maintenance of a ELT process to support Cloud Enterprise Data Warehouse (CEDW) and data platform. This includes using cloud-based technologies, establishing best practices and procedures for ETL development, implementing ETL processes
Design, Feature, Test Case, Test Completion report documentation
The ETL Developer will collaborate with the Systems and Operations teams on a day-to-day basis and receive technical guidance from the DSO Manager or Lead Delivery Engineer
Peer Reviews and System testing
Demo the solution to various stakeholders (technical and non-technical)
Deploying the solution using CI/CD pipelines
Leverage standard toolset and develop ETL/ELT code to move data from various internal and external sources into the analytics platform
Participate in agile ceremonies
Skills and Experience Required:
Hands on experience in Large Data Warehouse projects (at least 3+ years)
Strong ELT/ ETL designer/developer experience (5+ years)
Ability to select and implement the appropriate ETL or ELT techniques
Data modelling experience (3NF and Dimension modelling)
Strong SQL & Python Expert level (5+ years)
Performance tuning with SQL
Cloud environment development & operations experience (AWS)
Preference for candidates experienced with:
Airflow (scheduler), git, AWS Redshift, Teradata, DataStage, IWS
br{display:none;}.css-58vpdc ul > li{margin-left:0;}.css-58vpdc li{padding:0;}]]> Gumtree Australia Australia Sydney, Australia Media Production / Technology / Engineering Full-time Job Description Qualifications...
Apply For This Jobbr{display:none;}.css-58vpdc ul > li{margin-left:0;}.css-58vpdc li{padding:0;}]]> Software Engineer – Group Customer API About Bankwest Technology As part of the largest financial...
Apply For This Jobbr{display:none;}.css-58vpdc ul > li{margin-left:0;}.css-58vpdc li{padding:0;}]]> Job Description: Should have exposure to DevOps tools and processes Work with variety of hosting...
Apply For This Jobbr{display:none;}.css-58vpdc ul > li{margin-left:0;}.css-58vpdc li{padding:0;}]]> What’s Your Next Destination? Is it a better technology? A better you? Or a better...
Apply For This Jobbr{display:none;}.css-58vpdc ul > li{margin-left:0;}.css-58vpdc li{padding:0;}]]> At WiseTech Global, we build leading technology solutions that help the logistics industry move goods...
Apply For This Jobbr{display:none;}.css-58vpdc ul > li{margin-left:0;}.css-58vpdc li{padding:0;}]]> Minimum 1 year software development experience Join a nurturing culture: my client is happy to...
Apply For This Job