danielroytel@gmail.com

Hi, my name is

Daniel Roytel.

I build big data platforms.

I’m a Data engineering professional specializing in building and administering big data platforms. Currently, I’m focused on supporting a DeltaLake migration at Sportsbet.

About Me

Hello! My name is Daniel. I’m a Data Engineer with over 10 years across banking and wagering. I started at NAB in 2012 working in customer service and internet-banking support, then moved into reporting and analytics in 2014 — building SQL and Excel reporting for banker performance. From there I moved into data design and then data engineering on the Personal Bank Data & Analytics platform.

Today, I’m a Data Engineer on the Data Platforms team at Sportsbet, where I build and operate the AWS Deltalake Platform (ADP) — Spark pipelines for billion-record migrations, event-driven Kafka ingestion, and the CloudFormation and GitHub Actions tooling that keeps it shipping.

Here are a few technologies I’ve been working with recently:

  • Python / PySpark
  • SQL
  • Apache Spark
  • Databricks
  • AWS Glue
  • Apache Kafka
  • Apache Airflow
  • Terraform
  • Docker
  • GitHub Actions

A few certifications along the way:

  • AWS Certified Developer – Associate
  • Databricks Certified Data Engineer Associate
  • Azure Data Engineer Associate
  • Azure Developer Associate
Headshot

Experience

Data Engineer @ Sportsbet

Data Platforms

February 2023 - Current

  • Develop and execute Spark pipelines for migration of data to ADP (AWS DeltaLake Platform) from a legacy data warehouse.
  • Build AWS Glue jobs to perform microbatch processing of data from source systems.
  • Design and implement ETL processes using Databricks and AWS services for data transformation.
  • Manage data catalog, ensure data security, and adhere to governance policies using Databricks and AWS Glue.

What’s Next?

Get In Touch

Although I’m not actively seeking new opportunities, my inbox is always open. Whether you have a question or want to say hi, I’ll try my best to get back to you!