Data Engineer (Databricks + Fabric)

NirYu

Remote, Mexico

Posted

Responsibilities:

- Build and run production data platforms for our clients. This is hands-on work, not an architect who only reviews.

- Design and build ETL/ELT pipelines in Databricks and Fabric.

- Set up lakehouses with Medallion architecture (Bronze, Silver, Gold) on Delta Lake.

- Govern data with Unity Catalog: permissions, lineage and quality.

- Automate deployments with CI/CD and infrastructure as code.

- Gather requirements with the client and with other teams.

- Spot improvements in the client's platforms that could turn into new projects.

Requirements:

- Hands-on Databricks in production. PySpark, Delta Lake, Workflows and Unity Catalog (catalogs, permissions and lineage), with Medallion architecture.

- Microsoft Fabric in production, across the full platform. Lakehouse, OneLake, Data Pipelines, Notebooks, Dataflows Gen2 and Warehouse. A proof of concept does not count.

- Advanced SQL and Python.

- A current DP-900 or DP-700 certification, with a commitment to earn the other one within the first 60 days. Verify it with the Microsoft Learn link.

- English B2 or higher and fluent Spanish.

Originally posted on Himalayas

Apply for this job