Azure Databricks Architect

We are Cognizant Artificial Intelligence

Digital technologies, including analytics and AI, give companies a once-in-a-generation opportunity to perform orders of magnitude better than ever before. But clients need new business models built from analyzing customers and business operations at every angle to really understand them.

With the power to apply artificial intelligence and data science to business decisions via enterprise data management solutions, we help leading companies prototype, refine, validate, and scale the most desirable products and delivery models to enterprise scale within weeks.

This is a hybrid position open to any qualified applicant in the United States

Job Title: Azure Databricks Architect

Job Summary

We are seeking a highly experienced Principal Architect with 20 to 24 years of experience to join our team. The ideal candidate will have expertise in Databricks Unity Catalog Delta Live Pipelines Kafka Azure Data Lake Store Azure DevOps Python Databricks SQL Databricks Workflows and PySpark. This is a hybrid work model with day shifts and no travel required.

Key Responsibilities:

• Lead the design and implementation of scalable data architectures using Databricks Unity Catalog and Delta Live Pipelines.

• Oversee the integration of Kafka for real-time data processing and streaming.

• Provide expertise in Azure Data Lake Store to ensure efficient data storage and retrieval.

• Contribute to the companys mission by enhancing supply chain visibility and optimizing distributed order management

• Experience with Delta Lake Delta Sharing Delta Live Tables (DLT) AI/BI Workflows for the end-to-end orchestration Marketplace Lakehouse Federation.

• Strong experience in design and building ingestion patterns for various data loads such as batch real time near real time micro batches

• Knowledge in building deploying, evaluating and governing AI and ML solutions using Mosaic AI

• Utilize Azure DevOps for continuous integration and continuous deployment (CI/CD) processes.

• Develop and maintain Python scripts for data manipulation and analysis.

• Implement Databricks SQL for querying and analyzing large datasets.

• Manage Databricks Workflows to automate data pipelines and workflows.

• Apply PySpark for distributed data processing and big data analytics.

• Ensure data governance and security compliance within the data architecture.

• Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.

• Drive innovation and best practices in data engineering and architecture.

• Mentor and guide junior team members in technical and domain-specific areas.

• Overall Knowledge of data engineering principles including data pipelines data warehousing and data lakes

Qualifications:

• Must have extensive experience with Databricks Unity Catalog Delta Live Pipelines Kafka Azure Data Lake Store Azure DevOps Python Databricks SQL Databricks Workflows and PySpark.

• Should possess strong knowledge in Distributed Order Management and Supply Chain Visibility.

• Must have excellent communication skills in English (Read/Write Speak).

• Should have a proven track record of leading complex data architecture projects.

• Nice to have experience with other cloud platforms and big data technologies.

• Should be able to work effectively in a hybrid work model.

Certifications Required

• Databricks Certified Data Engineer Professional Microsoft Certified: Azure Solutions Architect Expert

Salary and Other Compensation:

Applications will be accepted until May 16, 2025.

The annual salary for this position is between $112,000 - $200,000 depending on experience and other qualifications of the successful candidate.

This position is also eligible for Cognizant’s discretionary annual incentive program, based on performance and subject to the terms of Cognizant’s applicable plans.

Benefits: Cognizant offers the following benefits for this position, subject to applicable eligibility requirements:

• Medical/Dental/Vision/Life Insurance

• Paid holidays plus Paid Time Off

• 401(k) plan and contributions

• Long-term/Short-term Disability

• Paid Parental Leave

• Employee Stock Purchase Plan

Disclaimer: The salary, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.

#LI-EV1 #CB #Ind123