Data Engineer

Join Graphcore, a leading AI hardware and software company, as a Staff Data Engineer – Agentic Applications. In this senior role, you will design, build, and operate Python-based web applications and workflows that improve decision-making and automate operational processes. You will work closely with engineers, analysts, and business stakeholders to translate business needs into practical solutions and provide technical leadership through design reviews, code reviews, and mentoring.

- Design, build, and operate Python-based web applications and agentic workflows to improve decision-making and automate operational workflows. - Collaborate with engineers, analysts, and business stakeholders to understand user needs, identify opportunities for automation, and take applications from prototype to production. - Establish clear ownership, secure interfaces, and appropriate engineering controls to ensure applications remain reliable, maintainable, and supportable.

- Experience building cloud-based solutions using AWS services, including data storage, processing and query technologies - Strong hands-on experience with modern orchestration, automated testing, CI/CD, deployment and monitoring practices in production environments - Strong understanding of security, access control and governance for cloud-based data platforms and applications, including authentication, authorisation, IAM, database permissions and secure secrets management - Experience building and supporting Python web applications, backend services and APIs that integrate data and business systems - Experience using AI-assisted coding tools effectively, with the ability to understand, review, test, debug and maintain generated code rather than relying on generated output without validation - Ability to collaborate effectively with technical and non-technical stakeholders, translate business requirements into practical, scalable solutions and explain technical concepts clearly - Experience providing technical leadership as a senior individual contributor through design reviews, code reviews, engineering standards and mentoring - Ability to coach business colleagues in AI-assisted application development and establish clear boundaries between business-owned interfaces and engineering-owned services - Experience working with both batch and streaming data pipelines, including operational support, troubleshooting and designing systems that recover gracefully from failures - Strong understanding of data modelling, schema design, data quality and performance optimisation across relational and analytical systems - Ability to either build usable web front ends with AI-assisted tools or enable business colleagues to develop and maintain front ends against well-defined backend services. Sufficient understanding of web development to review integrations and troubleshoot application behaviour is required; deep specialist front-end expertise is not essential - Strong experience designing, building and operating production-grade data pipelines and platforms using Python - Practical understanding of the reliability and security considerations of agentic applications, including permission boundaries, evaluation, auditability and appropriate human oversight - Practical experience developing applications or workflows that use large language models or AI agents, including connecting them to tools, APIs and governed data sources - Experience with Python web application frameworks such as Streamlit, Flask or FastAPI - Experience with agent orchestration, retrieval over business data, or automated evaluation of AI-enabled applications - Working knowledge of JavaScript or TypeScript and a modern front-end framework - Experience with streaming or data collection technologies - Experience with Prefect or a similar workflow orchestration platform - Experience with PostgreSQL, Redshift, ClickHouse or similar database and data warehouse technologies - Familiarity with dbt and analytics engineering practices - Experience with Infrastructure as Code and reusable application deployment patterns - Experience improving observability, operational monitoring, application performance and cloud cost optimisation - Experience contributing to technical roadmaps and platform improvements within a collaborative engineering team - Experience working within a fast-moving technology or engineering environment