About the Role

We are seeking a highly skilled Senior Databricks / PySpark Developer to join our data engineering team. In this remote contract role based in Ottawa, you will be responsible for designing and optimising high-volume data pipelines, managing complex data migrations, and leveraging the full power of the Databricks Lakehouse platform to drive business insights.

Key Responsibilities

• Data Pipelines: Design, build, and maintain robust ETL/ELT processes using PySpark and Databricks.

• Platform Expertise: Utilise advanced Databricks features, including Delta Lake, Databricks SQL, and Unity Catalogue.

• Integration: Lead data migration and integration projects for large-scale datasets.

• Engineering Standards: Implement and manage CI/CD pipelines for automated, reliable data workflows.

• Collaboration: Act as a bridge between technical requirements and business outcomes by communicating effectively with diverse stakeholders.

Required Technical Skills

• Big Data Core: Extensive experience with Databricks, Spark, and Scala.

• Programming: Strong proficiency in Python (PySpark) and SQL. (Java is a distinct plus).

• Architecture: Solid understanding of Data Warehouse and Data Lake concepts.

• Development Practices: Proven experience with version control and CI/CD for data workflows.

• Communication: Excellent ability to distil complex data challenges for non-technical stakeholders.

Candidate Profile

• Experience: Proven track record in handling large volumes of data within enterprise environments.

• Location: Remote (Ottawa-based preferred).

• Hire Type: Contract.