Senior Data Engineer
Smartwyre
Data Science
London, UK
Posted on Wednesday, August 16, 2023
About The RoleSmartwyre is seeking to expand our data reporting capabilities by improving our ability to store, process, compute, and rapidly retrieve many different views of our existing datasets. To that end, we are seeking a Data Engineer to help build out this approach to rapid data reporting at scale.The Data Engineer will work closely with established team members and become familiar with our business, the domain, and our existing data systems. The focus will be to build new data management systems and improve our existing ones.Your Responsibilities
- Building and managing data warehouses or data lakes
- Develop and maintain data architecture and data models
- Ensure data quality and consistency across all data sources
- Implement and manage data security protocols and access controls
- Collaborate with prdouct owners, analysts, and other stakeholders to understand their data needs, build supporting systems, and provide structured data for reports
- Monitor and troubleshoot data pipelines and infrastructure
- Evaluate and implement new data tools and technologies to improve the efficiency and scalability of data infrastructure
- Ensure compliance with data security, governance, and privacy regulations
- Develop and maintain documentation related to data infrastructure and data systems
- Guide the design and work with the cloud team to construct and maintain data infrastructure
- Develop and implement ETL pipelines to move and transform data from various sources to internal data structures