The role 

As a Senior Data Engineer, you will be at the forefront of designing and building innovative data solutions within a fast-paced agile data engineering team. You will play a crucial role in modernizing our data platform to enhance product offerings, closely collaborating with stakeholders across the organization to maximize the value of data for reporting, analytics, and decision-making processes.

In this role, you'll help transform our multi-cloud data landscape, working with streaming technologies, cloud data warehouses, and Lakehouse architectures to unlock new insights and capabilities for our business units. Additionally, you will leverage automation and generative AI to increase operational efficiency and enhance self-service capabilities across the organization.

Key responsibilities 

• Develop and maintain robust and efficient data solutions and products including data transformation, data modelling and reporting on both on-prem and cloud
• Enhance platform integration by leveraging domain events to enable more efficient and real-time data processing
• Collaborate with business stakeholders and analysts to enable self-service analytics through Power BI and other visualization tools including the use of generative AI features such as Amazon Q and Co-Pilot
• Collaborate with cross-functional teams to translate business requirements into technical solutions, document them as GAPs by aligning them with Architects
• Build sophisticated solutions to deliver actionable insights, with a strong focus on performance, scalability, and driving the adoption of generative AI to enable intuitive self-service analytics
• Enhance data engineering processes through automation, implementing CI/CD pipelines, and optimizing ETL/ELT flows to improve efficiency and maintainability
• Initiates and experiments with new ideas and approaches that support A&I department's strategy
• Facilitate data discovery and enhance data management processes using platforms like Open Metadata and ensure KPIs and documentation remain accurate and up to date
• Be a champion of best development practices on existing and new technologies
• Proactively support and maintain data products, including handling release management, troubleshooting incidents, and providing on-call support as necessary

Skills, knowledge, and experience: 

• 5+ years of experience in data engineering, with demonstrated expertise in designing and implementing scalable, flexible modern data architectures
• Experience building modern data lake/lakehouse architectures (e.g. Apache Iceberg) in cloud environments, with strong knowledge of AWS (S3, Redshift) or Azure data services
• Experience with ETL/ELT processes, data ingestion and using transformation tools such as DBT
• Experience using data pipeline orchestration tools (such as Airflow)
• Experience with developing dashboards and reporting solutions using data visualization tools such as Power BI or Quicksight would be an advantage
• Experience with best practices applied to data e.g., testing, CI/CD
• Good attitude and willingness to learn new skills and technologies
• Self-motivated, proactive with excellent communication skills