Senior Databricks Architect

*No C2C please - only seeking candidates able to work full-time for any employer without sponsorship

Are you eager to drive change and lead impactful transformations?

We re excited to welcome a Senior Architect to our client s fast-growing Technology & Platforms Practice within the Data Engineering and Analytics group. In this role, you ll shape the future of data solutions for a variety of industries including Healthcare & Life Sciences, Financial Services & Banking, Consumer & Industrial Products, and Energy & Utilities by crafting innovative Big Data strategies with a core focus on DataBricks.

Key Points:

• Ideal candidates are based in Chicago, but we are also open to locations including Seattle, Washington D.C., Los Angeles, San Francisco, New York City, Dallas, and Minneapolis.
• The role requires a hybrid schedule, with approximately 1-3 days per week onsite at our downtown office (specific location and onsite requirement to be determined).
• Open to 100% remote candidates, though this option will be considered last.
• Applicants must have prior or current experience in tech/IT or management consulting.
• Compensation ranges from $185,000 to $245,000, depending on location and experience.

Responsibilities:

• Offer expert guidance on platform selection and DataBricks integration.
• Architect data flow and processing pipelines for in-depth analysis using cutting-edge tools such as Spark on Scala, Storm, Flume, and Sqoop.
• Develop customized data structures to optimize ingestion and reporting aligned with specific use cases and technologies.
• Support clients with in-depth data management insights, including structuring, governance, and architecture, to meet requirements and select and design the appropriate platforms.
• Mentor consultants on best practices, conduct code reviews, and promote a culture of excellence.
• Partner with data source owners to ensure seamless integration between analytics platforms and data source systems.
• Address data integrity issues proactively to ensure high-quality data across solutions.
• Collaborate with cross-functional teams and actively participate in meetings to enhance technical and business outcomes.

Qualifications:

• 10 years of relevant professional experience, with at least 5 years working hands-on with DataBricks.
• 5-10 years of tech/management consulting experience
• Exceptional organizational and communication skills, both written and verbal.
• Deep expertise with DataBricks and advanced knowledge of best practices in Big Data.
• Familiarity with Large Language Models (LLM).
• Strong foundation in Big Data standards, principles, and industry best practices.
• A proactive, team-oriented approach to work, embodying a commitment to diversity and inclusion.
• Willingness to travel up to 50%. (most likely less, but client and engagement dependent)

If you re passionate about data, skilled in Big Data architecture, and ready to make a substantial impact, we d love to hear from you! Join us in redefining data-driven solutions across dynamic industries.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.