Data Engineer
Roles and Responsibilities:
Perform various activities including requirements gathering, solution development and the project implementation throughout the phases of Agile methodology
ELT Engineer / Developer will be responsible for the design, implementation and maintenance of a ELT process to support Cloud Enterprise Data Warehouse (CEDW) and data platform. This includes using cloud-based technologies, establishing best practices and procedures for ETL development, implementing ETL processes
Design, Feature, Test Case, Test Completion report documentation
The ETL Developer will collaborate with the Systems and Operations teams on a day-to-day basis and receive technical guidance from the DSO Manager or Lead Delivery Engineer
Peer Reviews and System testing
Demo the solution to various stakeholders (technical and non-technical)
Deploying the solution using CI/CD pipelines
Leverage standard toolset and develop ETL/ELT code to move data from various internal and external sources into the analytics platform
Participate in agile ceremonies
Skills and Experience Required:
Hands on experience in Large Data Warehouse projects (at least 3+ years)
Strong ELT/ ETL designer/developer experience (5+ years)
Ability to select and implement the appropriate ETL or ELT techniques
Data modelling experience (3NF and Dimension modelling)
Strong SQL & Python Expert level (5+ years)
Performance tuning with SQL
Cloud environment development & operations experience (AWS)
Preference for candidates experienced with:
Airflow (scheduler), git, AWS Redshift, Teradata, DataStage, IWS
br{display:none;}.css-58vpdc ul > li{margin-left:0;}.css-58vpdc li{padding:0;}]]> One of S2M’s exclusive partners are hiring a new Frontend Developer to join their remote...
Apply For This Jobbr{display:none;}.css-58vpdc ul > li{margin-left:0;}.css-58vpdc li{padding:0;}]]> 6-month contract opportunity for state government organisation. Your new company A state government organisation providing...
Apply For This Jobbr{display:none;}.css-58vpdc ul > li{margin-left:0;}.css-58vpdc li{padding:0;}]]> Software Engineer – Internship The Software Engineering team delivers next-generation application enhancements and new products...
Apply For This Jobbr{display:none;}.css-58vpdc ul > li{margin-left:0;}.css-58vpdc li{padding:0;}]]> Must be Australian Based (no international applications please) We’re looking for an Australian-based Front-End Web...
Apply For This Jobbr{display:none;}.css-58vpdc ul > li{margin-left:0;}.css-58vpdc li{padding:0;}]]> About Us It’s our mission to build a world that communicates more humanly. Since 2001,...
Apply For This Jobbr{display:none;}.css-58vpdc ul > li{margin-left:0;}.css-58vpdc li{padding:0;}]]> At NTT we believe that by using innovative technology we can solve global challenges and...
Apply For This Job