HI THERE I’m Jeffrey Chan
DATA ENGINEER based in Montreal, Québec.

  • 3+ Years Experience
  • 5+ Projects

About Me

I am an experienced Data Engineer with a passion for leveraging data to deliver insights and innovative solutions. I have expertise in migrating databases to the cloud, machine learning, data preparation, and pipelines. Proficient in Python, SQL, Apache Spark, NumPy, scikit-learn, and TensorFlow, I design robust pipelines, optimize storage, and handle structured and unstructured data. At Compass Analytics, I developed a data ingestion engine, designed scalable cloud architecture, and collaborated with stakeholders for smooth integration and analysis. Skilled in advanced analytics, including ensemble modeling and deep learning, I extract valuable insights from complex datasets. With problem-solving and communication skills, I present findings to diverse audiences, driving business success.

Download Resume View Resume

Core Skills

  • Python
  • SQL
  • Scala
  • Databricks
  • TensorFlow 2.0
  • MongoDB
  • JavaScript
  • GitHub
  • HTML 5
  • CSS 3

Other Skills

  • Project Management
  • Data Analytics
  • Microsoft Office

Certifications

Work Experience

January 2024 - Present

Canadian National Railway

Specialist Data Engineer

As a Data Engineer, I develop the data pipelines for ingestion and integration to serve end users spaning analysts, data scientists and C-level executives.

  • Develop Apache Spark code to allow ingestion of raw data and extraction from locomotive engines for data pipelines used by business analysts, and data scientists.
  • Design the cloud architecture for deployment to conform to enterprise architecture while meeting business and technical demands of projects.
  • Facilitate self-serve analytics via data pipelines to various portals at the bronze, silver and gold levels.
Relevant Skills:

Python, Scala, Microsoft Azure, Google Cloud Services, Solution Architecture, Apache Spark, Big Data Analytics

October 2022 - September 2023

Compass Data

Junior Data Engineer

As a Junior Data Engineer, I develop the data ingestion engine from the ground up using web scraping libraries, create and design scalable cloud architecture and deploy it onto AWS, and develop thorough data transformation pipelines for end-user consumption. Working directly with the stakeholders to address business and technical requirements.

  • Develop code to allow ingestion of raw data online and extraction for data pipelines used by business analysts, and data scientists.
  • Design the cloud architecture for deployment to address business and technical demands for scaling and future endeavors.
  • Create various transformations to address business demands and questions.
  • Create various transformations to address business demands and questions
  • Produce layered data cleaning levels from raw data to Gold quality layer.
Relevant Skills:

Amazon Web Services (AWS), Solution Architecture, Python, Big Data Analytics

May 2021 - August 2021

Intact Financial Corporation

Data Engineering Intern

Worked on the migration of data systems used by Intact's machine learning pricing models. I facilitated the transition from on-site storage to a hybrid model involving cloud and on-site systems by working along side Data Engineers, Data Scientists and Software Architects

  • Translated technical requirements of data collection systems.
  • Performed data validation within cataloguing software.
  • Manipulated data structures to conform to Intact’s insurance pricing engine.
  • Worked with Data Engineers in developing a proof of concept after completing the analysis.
Relevant Skills:

Data Analysis, Erwin Data Catalogue, Snowflake

January 2021-April 2021

McGill University

Business Intelligence Developer

Worked on the automation of database maintenance, writing scripts that allowed for the extraction and evaluation on data as a result of addition and/or modification of business rules, ensuring data integrity within systems used by the Business Intelligence team.

  • Extracted requirements, coded, and tested new software, perform maintenance and enhancements to software
  • Generated reports using PowerBI and SSRS.
Relevant Skills:

SQL Server databases. Software Development and Analysis

Education

2020 - 2023

Concordia University

Montreal, Québec Bachelor of Engineering - Software Engineering

Software Engineering with a focus on Data Engineering and Data Science.

Member of the Institute for Co-Operative Education (3.6 GPA)

Relevant Courses:
  • Machine Learning
  • Big Data Analytics
  • Data Structures and Algorithms
  • Operating Systems

Latest Work

Journey of a Data Scientist

Come along for the ride as I begin my journey to becoming a Data Scientist. Read up on the new techniques I'm learning and advice for those looking to enter the field of data.

Details