Help us improve RVC
We use optional analytics cookies to understand how RVC is used. Allow analytics also enables a fully masked diagnostic recording on public vacancy pages. It stops before Apply and excludes page text, form fields, console, and network contents. We do not use advertising cookies. Cookie policy
RVC
JobsFor Employers
Use AILog in
  1. Jobs
  2. /
  3. Sr Data Engineer (Databricks) - (Freelance)

Sr Data Engineer (Databricks) - (Freelance)

Ensitech Careers | Custom software development
11h 49m ago
Worldwide Remote
Freelance
IC

Join #Ensiteam!

We are a company focused on custom software development and have been in the market for over 22 years. At Ensitech we are dedicated to finding highly specialized talent to work with large companies in the United States, Europe, and Canada.

We’re looking for a Senior Data Engineer (Databricks) to serve as technical lead on client-facing data projects for a US-based digital engineering firm specializing in AI, Data, and Software. You’ll architect and build scalable Lakehouse solutions on Databricks, from ingestion and Spark-based pipelines to governed, analytics-ready gold layers, while mentoring engineers and leading client engagements. You bring 5+ years of hands-on data engineering, deep production experience with Databricks, Apache Spark, and Delta Lake, at least 1–2 years as a technical lead, and strong consulting and client communication skills.

Responsibilities

Databricks Architecture & Technical Leadership

  • Serve as technical lead on client engagements, driving Lakehouse architecture and implementation on Databricks.
  • Design medallion architectures (bronze, silver, gold) on Delta Lake, making decisions on storage, partitioning, clustering, and integration patterns.
  • Implement data governance with Unity Catalog, including access control, lineage, and catalog/schema design.
  • Lead infrastructure setup, including workspaces, environments, CI/CD, and automation with Terraform and Databricks Asset Bundles.
  • Evaluate architecture trade-offs and integrate Databricks with other platforms such as Snowflake or Microsoft Fabric when needed.
Data Engineering & Development
  • Build and maintain ETL/ELT pipelines with PySpark, Spark SQL, Databricks Workflows, and Delta Live Tables.
  • Develop real-time, near-real-time, and batch pipelines using Structured Streaming and Auto Loader.
  • Tune Spark jobs and clusters for performance and cost (partitioning, caching, cluster sizing, Photon, liquid clustering/Z-ordering).
  • Implement data validation, quality checks, lineage, and governance standards.
  • Support semantic modeling and gold-layer creation for BI and AI consumption, including Databricks SQL.

Cross-Functional Collaboration

  • Translate BI and AI requirements into actionable data engineering work.
  • Partner with BI developers and analysts to design data structures aligned with business reporting needs.
  • Coordinate with AI engineers and software developers to deliver end-to-end solutions, including ML-ready datasets.

Project Planning & Estimation

  • Break down client requirements into phased, prioritized engineering tasks.
  • Scope ingestion sources, transformation needs, and future enhancements, and estimate durations and dependencies.
  • Drive Jira backlog creation, refinement, and planning.

Oversight & Mentorship

  • Mentor Data Engineers on Databricks and Spark best practices.
  • Review code and validate that solutions meet functional, performance, and cost expectations.
  • Enforce naming conventions, architectural consistency, and documentation quality, keeping projects within budget.

Client Engagement & Delivery

  • Act as the Databricks and data engineering expert on client calls and reviews.
  • Lead technical design walkthroughs and knowledge transfer (KT) sessions.
  • Translate technical options into business impact and identify opportunities for future phases.

Must-haves
  • 5+ years of hands-on data engineering experience, including at least 1–2 years in a technical lead role.
  • Strong, production-level experience with Databricks (3+ years recommended), including Workflows, Delta Live Tables, and Databricks SQL.
  • Advanced Apache Spark skills with PySpark and Spark SQL, including performance tuning and cost optimization.
  • Deep knowledge of Delta Lake and Lakehouse/medallion architecture.
  • Experience with Unity Catalog for data governance, security, and lineage.
  • Experience with streaming and incremental ingestion (Structured Streaming, Auto Loader).
  • Strong Python and SQL.
  • Strong understanding of data modeling for reporting and analytics.
  • Experience with CI/CD, Terraform, and cloud-native infrastructure (Azure or AWS).
  • Strong client communication and consulting experience in agile environments.

Nice-to-have

  • Databricks certifications (Data Engineer Professional or Associate).
  • Experience with Microsoft Fabric and/or Snowflake.
  • Databricks Asset Bundles and the Databricks Terraform provider.
  • MLflow or ML model deployment experience, and interest in AI-driven analytics.
  • Experience with BI tools such as Power BI, Tableau, or Looker.
  • Microsoft Data & AI certifications.
  • Understanding of Azure and AWS networking concepts.
  • Knowledge of data governance frameworks and compliance standards (GDPR, HIPAA, SOC 2).

What do we offer?

  • 100% remote opportunity.
  • Competitive salary and benefits.
  • Custom benefit package aligned to your experience and your needs.
  • Working with foreign clients.

Required Skills

databrickssparkpysparkterraformpython

Required Languages

🇬🇧 English

Related searches

  • Fully Remote Jobs
  • Senior Jobs
1 jobs
Sort by
11h 49m ago

Sr Data Engineer (Databricks) - (Freelance)

Ensitech Careers·Custom software development
databrickssparkpysparkterraformpython
Worldwide Remote
General Data Engineering
No similar jobs match these filters. Try changing or clearing a filter.
Popular job searches ▸
Roles
Python JobsJava JobsReact JobsTypeScript JobsGo JobsDevOps JobsNode.js JobsRemote C# and .NET JobsData Science JobsProduct Manager JobsDesign Jobs
Countries
United StatesUnited KingdomCanadaUS & EMEAGermanyPolandSpainNetherlandsPortugal
Experience
Senior JobsMid-Level JobsJunior Jobs
R© 2026 RVC Globalbuild b492d373
AboutJobs in Claude & ChatGPTPricingContactPrivacyCookiesRefundsTerms & ConditionsFor Employers