Senior Data Engineer

City: Las Vegas, NV or Dallas, TX or Atlanta, GA

Onsite/ Hybrid/ Remote: Onsite

Work Authorization: US Citizens ONLY

Fulltime

Client is seeking a highly skilled Senior Data Engineer to fill a full-time role for our client. The Senior Data Engineer is responsible for designing, building, and managing robust data platforms and tools to enable efficient processing and analysis of large-scale data. This role involves developing and maintaining scalable data pipelines, ensuring data quality, and deploying machine learning models into production. The position requires close collaboration with business teams to enhance data models for business intelligence tools, driving accessibility and fostering data-driven decisions across the organization. Responsibilities include creating real-time and batch pipelines to handle high data volumes and translating business requirements into scalable data solutions through collaboration with cross-functional teams.

MUST Have:

• Expertise in Python, SQL and CI/CD practices.
• Hands-on experience with Databricks, Spark, and Fabric or equivalent tools.
• Experience in data migration using Azure services

Key Responsibilities

• Design, develop, and maintain real-time and batch data pipelines to process and analyze large datasets efficiently.
• Create and maintain tools to ingest, curate, and provision first-party and third-party data for analytics, reporting, and data science.
• Develop advanced data products and intelligent APIs while monitoring system performance, troubleshooting, and integrating new features.
• Analyze data and design architecture to support business intelligence, AI/ML, and data products.
• Implement data platform architectures that meet analytical requirements, emphasizing scalability, maintainability, and flexibility.
• Provide technical leadership, mentoring, and code reviews, with a focus on test-driven development and CI/CD practices.

Qualifications

Experience

• 8 years of experience as a data engineer with full-stack capabilities.
• 10 years of programming experience.
• 5 years of experience in cloud technologies (Azure, AWS, or Google Cloud).
• Expertise in Python, SQL and CI/CD practices.
• Hands-on experience with Databricks, Spark, and Fabric or equivalent tools.
• Proficiency in designing and developing data ingestion, processing, and analytical pipelines for big data, NoSQL, and data warehouses.
• Experience in data migration using Azure services (e.g., ADLS, Azure Data Factory, Event Hub, Databricks).
• Advanced knowledge of big data and streaming technologies (e.g., Apache Spark, Kafka).

Skills

• Strong understanding of data architecture, data modeling, and data security best practices.
• Proficiency with BI tools like Power BI and Tableau.
• Knowledge of developing intelligent applications and APIs.
• Experience with RESTful APIs and messaging systems.
• Critical thinking, problem-solving, and process improvement abilities.
• Strong organizational and communication skills to work effectively in dynamic, fast-paced environments.

Preferred Skills

• Experience with machine learning and ML pipelines.
• Familiarity with Agile methodologies.
• Proven ability to create technical documentation and deliver impactful presentations.

Education

• Bachelor’s degree in Computer Science, Information Systems, Data Science, Engineering, or a related field (required).
• Master’s degree in a relevant field (preferred).

Compensation & Benefits:

• Base pay: 150k to 175k Dependent on experience
• Bonus, Vacation, Medical etc.