Ofertas › Clearwater People Solutions
Clearwater People Solutions · Guildford, United Kingdom · £50,000 - 60,000 per year
Salary: £50,000 - 60,000 per year Requirements: Significant experience in data engineering, preferably across both traditional and cloud-based platforms. Proven track record in designing, implementing, and maintaining scalable data architectures and pipelines. Experience delivering solutions in complex, data-driven organisations where security, compliance, and reliability are critical. Proficiency in some or all relevant technologies and languages, such as Oracle DBMS/SQL Server, Python, SQL, T-SQL/PLSQL, SSIS, SAP Data Services. Experience with cloud data platforms such as Azure, AWS, or Snowflake. Experience with data tools such as Azure Data Factory, Fabric Data Factory, Synapse, Fabric, Spark, and Notebooks. Experience with source control (Git) and the DevOps methodology. Ability to design, maintain, and optimise scalable ETL/ELT pipelines. Ability to troubleshoot complex data issues, monitor performance, and implement automated solutions. Strong analytical and problem-solving capabilities with an emphasis on performance tuning and scalability. Responsibilities: Design, implement, and maintain robust ETL/ELT pipelines to ingest and transform data from diverse internal and external sources. Ensure pipelines are scalable, performant, and reliable, including monitoring overnight loads, resolving failures promptly, and implementing automated alerts to maintain timely data availability. Contribute to the design, build, and optimisation of data architectures, models, warehouses, and data lake solutions that support reporting, analytics, and AI initiatives. Ensure solutions meet performance, scalability, and reliability standards across legacy and modern cloud platforms. Monitor and tune system, pipeline, and query performance. Continuously refine pipelines to enhance efficiency, reduce processing times, and improve scalability, maintainability, and cost-effectiveness. Leverage and maintain modern data engineering tools and frameworks such as Azure Data Factory, Synapse, Microsoft Fabric, Spark, and Python. Evaluate and recommend emerging technologies that align with our organisational strategy and enhance data capabilities. Maintain legacy data warehouses and pipelines such as Oracle, SQL Server, SSIS, and SAP Data Services until replacement by a modern data platform and tooling. Technologies: AI AWS Azure Cloud DevOps ETL Fabric Git Support Oracle Python SAP SQL Security Snowflake Spark SSIS More: We are recruiting for a Senior Data Engineer to join our te