Resident Solution Architect (Databricks)

<h3>About the Role</h3><p style="min-height:1.5em">We are a privately held IT and MarTech consultancy working with enterprise clients across regulated industries. We are looking for a senior, hands-on <strong>Resident Solution Architect</strong> with deep expertise in the <strong>Databricks Lakehouse Platform</strong> to join our team on a W2 contract basis. In this role, you will lead and deliver large-scale Databricks implementations, advise clients on platform best practices, and serve as a trusted technical authority across data engineering and analytics engagements.</p><h3>What You'll Do</h3><ul style="min-height:1.5em"><li><p style="min-height:1.5em">Architect, design, and deliver end-to-end Databricks implementations for enterprise clients.</p></li><li><p style="min-height:1.5em">Serve as a hands-on solution architect, guiding technical teams through complex data platform builds.</p></li><li><p style="min-height:1.5em">Apply deep knowledge of the Databricks Lakehouse Platform — including current capabilities, Delta Lake, and best practices — to drive client outcomes.</p></li><li><p style="min-height:1.5em">Leverage Apache Spark expertise (including runtime internals) for performance tuning, optimization, and scalability of large-scale data platforms.</p></li><li><p style="min-height:1.5em">Design and support CI/CD pipelines for production data platform deployments.</p></li><li><p style="min-height:1.5em">Advise on and implement MLOps workflows in collaboration with data science teams.</p></li><li><p style="min-height:1.5em">Work across one or more major cloud platforms (AWS, Azure, GCP) to deliver scalable, cloud-native solutions.</p></li><li><p style="min-height:1.5em">Translate complex technical requirements into actionable architectural recommendations for both technical and non-technical stakeholders.</p></li></ul><h3>What We're Looking For</h3><p style="min-height:1.5em"><strong>Required:</strong></p><ul style="min-height:1.5em"><li><p style="min-height:1.5em">Must be authorized to work in the United States without visa sponsorship (W2 contract — no C2C or 1099).</p></li><li><p style="min-height:1.5em">10+ years of consulting experience, with 7+ years focused on Data Engineering, Data Platforms, and Analytics.</p></li><li><p style="min-height:1.5em">Hands-on delivery of 6–8+ Databricks implementation projects at enterprise scale.</p></li><li><p style="min-height:1.5em">Strong understanding of the Databricks Lakehouse Platform, including platform capabilities and best practices.</p></li><li><p style="min-height:1.5em">Deep expertise in Apache Spark and distributed computing, including Spark runtime internals.</p></li><li><p style="min-height:1.5em">Completed <strong>Databricks Data Engineering Professional Certification</strong>.</p></li><li><p style="min-height:1.5em">Hands-on experience with at least one major cloud platform: AWS, Azure, or GCP.</p></li><li><p style="min-height:1.5em">Proven experience with performance tuning, optimization, and scalability of large-scale data platforms.</p></li><li><p style="min-height:1.5em">Solid understanding of CI/CD pipelines for production deployments.</p></li><li><p style="min-height:1.5em">Working knowledge of MLOps principles and tooling.</p></li></ul><p style="min-height:1.5em"><strong>Nice to Have:</strong></p><ul style="min-height:1.5em"><li><p style="min-height:1.5em">Multi-cloud experience spanning two or more of AWS, Azure, and GCP.</p></li></ul><h3>Compensation &amp; Benefits</h3><ul style="min-height:1.5em"><li><p style="min-height:1.5em"><strong>Pay Rate:</strong> Up to $80/hr on W2</p></li><li><p style="min-height:1.5em">W2 contract engagement</p></li></ul><h3>Location</h3><ul style="min-height:1.5em"><li><p style="min-height:1.5em">Based in <strong>San Ramon, CA</strong></p></li><li><p style="min-height:1.5em">Visa sponsorship is <strong>not available</strong> for this role — candidates must be authorized to work in the US without sponsorship.</p></li></ul><p>Find more <a href="https://www.arbeitnow.co.uk/english-speaking-jobs">English Speaking Jobs in United Kingdom</a> on Arbeitnow</a>