Demo

Data Architect (Databricks, PySpark)

NITYA Software Solutions, Inc.
Sugar, TX Full Time
POSTED ON 1/10/2025 CLOSED ON 1/22/2025

What are the responsibilities and job description for the Data Architect (Databricks, PySpark) position at NITYA Software Solutions, Inc.?

Job Details

Role: Data Architect (Databricks, PySpark)

Location: 14141 Southwest Freeway, Sugar Land, TX 77478 (100% onsite)

C2C

Skills:

  • 10 years - Enterprise Data Management
  • 10 years - SQL Server based development of large datasets
  • 5 years with Data Warehouse Architecture, hands-on experience with Databricks platform. Extensive experience in PySpark coding. Snowflake experience is good to have
  • 3 years Python (NumPy, Pandas) coding experience
  • Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling
  • Good knowledge on Azure Cloud and services like ADF, Active Directory, App Services, ADLS etc
  • Hands on experience on CI/CD pipeline implementations
  • Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills
  • Experience with Snowflake utilities such as SnowSQL and SnowPipe - good to have
  • Capable of discussing enterprise level services independent of technology stack
  • Experience with Cloud based data architectures, messaging, and analytics
  • Superior communication skills
  • Cloud certification(s)
  • Any experience with Reporting is a Plus
  • Excellent written and verbal communication, intellectual curiosity, a passion to understand and solve problems, consulting & customer service
  • Structured and conceptual mindset coupled with strong quantitative and analytical problem-solving aptitude
  • Exceptional interpersonal and collaboration skills within a team environment

Total Exp level: 15 years

Responsibilities:

  • Migrate, Design, develop, and deploy AbInitio graphs to DBT jobs to process and analyze large volumes of data.
  • Collaborate with data engineers and data scientists to understand data requirements and implement appropriate data processing pipelines.
  • Optimize DBT jobs for performance and scalability to handle big data workloads.
  • Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
  • Demonstrated proficiency with Data Analytics, Data Insights
  • Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process
  • Leverage SQL, programming language (Python or similar) and/or ETL Tools (Azure Data Factory, Data Bricks, Talend and SnowSQL) to develop data pipeline solutions to ingest and exploit new and existing data sources.
  • Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.
  • Collaborate with data engineers and data scientists to understand data requirements and implement appropriate data processing pipelines.
  • Optimize Databricks jobs for performance and scalability to handle big data workloads.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Certified ServiceNow Architect (CTA)
SunPlus Data Group, Inc -
Houston, TX
Oracle AI Architect
NTT DATA North America -
Houston, TX
Oracle AI Architect
NTT DATA, Inc. -
Houston, TX

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Data Architect (Databricks, PySpark)?

Sign up to receive alerts about other jobs on the Data Architect (Databricks, PySpark) career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$103,228 - $139,671
Income Estimation: 
$116,726 - $151,072
Income Estimation: 
$124,724 - $161,246
Income Estimation: 
$81,769 - $104,543
Income Estimation: 
$89,551 - $118,439
Income Estimation: 
$103,228 - $139,671
Income Estimation: 
$147,901 - $186,323
Income Estimation: 
$170,841 - $219,163
Income Estimation: 
$116,726 - $151,072
Income Estimation: 
$147,901 - $186,323
Income Estimation: 
$89,551 - $118,439
Income Estimation: 
$116,726 - $151,072
Income Estimation: 
$124,724 - $161,246
This job has expired.
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at NITYA Software Solutions, Inc.

NITYA Software Solutions, Inc.
Hired Organization Address Chicago, IL Contractor
INDEPENDENT VISA's ONLY Position: Power BI Architect Location: Chicago IL Duration: 12 Months Job Description: 15 years ...
NITYA Software Solutions, Inc.
Hired Organization Address Plano, TX Full Time
Job Details Role: Senior Network Security Engineer Location: Mountain View CA / San Diego CA / Plano TX (100% Onsite) Pe...
NITYA Software Solutions, Inc.
Hired Organization Address Chicago, IL Full Time
Job Details Automation Test Lead/Architect Client Location: Chicago, IL 60604 (Onsite Job) Need locals Job Type: Long Te...
NITYA Software Solutions, Inc.
Hired Organization Address Texas, TX Full Time
Job Details Skills Include: Have strong engineering experience in building scalable, resilient, and observable micro ser...

Not the job you're looking for? Here are some other Data Architect (Databricks, PySpark) jobs in the Sugar, TX area that may be a better fit.

Data Architect

Data Spectrum LLC, Houston, TX

Oracle AI Architect

NTT DATA Group Corporation, Houston, TX

AI Assistant is available now!

Feel free to start your new journey!