Nathan Leigh


Software Engineer @Yelp



I am a highly accomplished Software Engineer specializing in the architecture, development, and scaling of large distributed systems and high-throughput streaming infrastructure. With deep technical expertise across AWS, Azure, and Google Cloud, I build resilient, high-availability platforms capable of seamlessly scaling to reliably process massive datasets in real-time.

Tech Skills


Python
Apache Kafka
Apache Flink
Go / Golang
AWS
Google Cloud
Azure
Kubernetes
Docker
Terraform
PostgreSQL
Grafana
Java / Scala
Apache Beam
MySQL
TDD / Agile

Experience


Yelp logo

Yelp

Oct 2021 - Present
Manchester, UK

Software Engineer

Key member of the Stream Processing team responsible for Yelp's entire streaming infrastructure, transporting events reliably with Kafka and processing massive streams of data in real-time using Apache Flink and Beam.

  • Architected large distributed systems scaling to store and crunch terabytes of data.
  • Deep understanding of full end-to-end software development, deployment, and monitoring using Terraform, Jenkins, Docker, Kubernetes, Grafana, and Prometheus.
  • Designed gold standard Flink/Beam service templates written in Python, Java/Scala & Golang.
  • Debugged and resolved critical production issues and led high-impact projects including resolving state compatibility between Flink versions and creating a custom autotune system for Flink JVM resources.
Arm logo

Arm

Jul 2019 - Sep 2021
Manchester Area, UK

Cloud Engineer

Part of an internal start-up generating smart insights from IoT Camera devices running AI software for applications such as office space utilisation and monitoring.

  • Played a critical part in the architecture of the back-end platform using Golang services for ingesting, processing, and data retrieval.
  • Gained significant devops skills by managing resilient and scalable cloud services with Docker, Helm & Kubernetes.
  • Used InfluxDB for real-time data processing and Postgres for managing configuration and data reports.
  • Created front-end applications for analytics using Grafana, and configuration apps using React-Admin and Flutter.
BBC logo

BBC

May 2017 - Jun 2019
Media City, Manchester

Software Engineer

Worked across the DataLab (Connected Data) and Platform API teams, building recommendation systems and managing the critical backbone API for programme information.

  • Developed microservices using Python hosted on Google Cloud Platform, utilizing PubSub, Cloud Functions, Terraform, Kubernetes, and Docker.
  • Collaborated with data scientists and trained neural net models using TensorFlow for BBC News article recommendations.
  • Maintained the backbone API handling thousands of data changes per minute using Clojure and AWS, enforcing strict TDD & Pair Programming.
ao.com logo

ao.com

Sep 2015 - May 2017
Bolton, UK

Software Developer

  • Designed, developed, and maintained high-traffic back-end software in C# .NET for handling payments and peak demand traffic (e.g. Black Friday).
  • Served as Tech Lead on multiple agile projects, collaborating with finance, warehouse logistics, and customer service teams.
  • Gained professional web development skills in HTML5, CSS, and NodeJS.

Education

University of Manchester logo
BSc Computer Science (2.1)

The University of Manchester (2011 - 2014)

First Class honors for final year Android project. Extensive knowledge in Java, Agile Methods, and Distributed Systems.

Resume


Download my full curriculum vitae for a comprehensive overview.

Download PDF

Portfolio


Contact


Medium Articles


Articles written about the disruption that automation technologies pose on society and the economy, and policy suggestions on how to alleviate the negative outcomes.

View Articles

Exponential Disruption


Web page looking at exponential technologies and their potential impact on jobs and society.

In the next 20 years we will face a continuous increasing rate of technological disruption for many of the mass occupations that people perform. If you believe how historically new jobs have always been created and they always will be, then you have to also agree that history indicates if mass labor transitions. It is time to acknowledge huge exponential disruption like we have never seen before is about take place and start preparing for this transition to a new digital age.

Go to Exponential Disruption Page

Live Like A Cat


This website explains how in the future we could build a world where our essential needs are taken care off, and live a life of luxury and play, much like cats do.

Go to Live Like A Cat Website

Android Restaurant System App


My final year uni project was to build an Android Restaurant System Application.

Create and edit any type of customisable menu Item.

Dynamically calculates nutritional information and prices for menu items.

Orders will automatically adjust the stock levels of the ingredients used.

Both waiters and customers can order items which can then be viewed by a kitchen.

Go to Restaurant App