Databricks Subject Matter Expert (SME)

Job Title: Databricks Subject Matter Expert (SME)
Location: Dallas, TX or Atlanta, GA
Client: IBM
Payrange:$58/hr on w2
Position Type: On-Site

Job Description:

We are seeking an experienced Databricks Subject Matter Expert (SME) to join our team. In this role, you will be responsible for leveraging the Databricks platform to build and maintain high-quality, scalable data pipelines and models. You will work closely with data engineers, data scientists, and business analysts to ensure data integrity, accuracy, and performance.

As a Databricks SME, your main focus will be on data profiling and data modeling. You will use Databricks capabilities to drive end-to-end data solutions, ensuring the data architecture aligns with business requirements while adhering to industry best practices. This is a critical role in ensuring high-quality data solutions that empower data-driven decision-making.

Skills and Qualifications:

Technical Skills:

8 years of hands-on experience working with Databricks, including Spark, Delta Lake, and other related components of the Databricks ecosystem.
Strong expertise in Data Profiling tools and techniques, with a deep understanding of data quality management practices.
Extensive experience in Data Modeling, including expertise in dimensional models (star schema, snowflake schema) for analytics.
Advanced knowledge of SQL and PySpark, with proficiency in other scripting languages commonly used within the Databricks environment.
Hands-on experience in ETL/ELT processes, data integration, and data pipeline optimization.
Familiarity with cloud platforms such as AWS, Azure, or Google Cloud and experience working with cloud-based data storage technologies.
Proficiency in Python and Scala, commonly used for data transformations within Databricks.
Solid understanding of Data Governance practices and how to apply them to ensure data integrity and accuracy.
Familiarity with Machine Learning workflows in Databricks (desirable but not mandatory).