Demo

Lead Cloud Data Engineer (100% REMOTE/NO C2C)

Amerit Consulting
Fontana, CA Remote Full Time
POSTED ON 1/22/2025
AVAILABLE BEFORE 4/20/2025

Our client, a US Fortune 250 company and a global Medical technology corporation serving customers in Clinical Labs, Health care research & Pharmaceutical industry, seeks an Lead Cloud Data Engineer

NOTE : THIS IS REMOTE ROLE & ONLY W2 CANDIDATES (NO C2C / 1099)

  • Candidate must be authorized to work in USA without requiring sponsorship

Position Title – Lead Cloud Data Engineer (Job ID – CFNJP00050095)

Location : San Diego CA 92130 (100% Remote acceptable)

Duration : 6 months Contract to Hire

As the Senior Engineer, you will lead a team of data engineers in designing, building, and maintaining high-performance software system to manage analytical data pipelines that fuel the organization’s data strategy using software engineering best practices. Beyond technical expertise, you will also serve as a change leader, guiding teams through adopting new tools, technologies, and workflows to improve data management and processing.

This position requires extensive hands-on data system design and coding experience, as well as the development of modern data pipelines (AWS Step functions, Prefect, Airflow, Luigi, Python, Spark, SQL) and associated code in AWS.

You will work closely with stakeholders across the business to understand their data needs, ensure scalability, and foster a culture of innovation and learning within the data engineering team and beyond.

Key Responsibilities :

  • Be responsible for the overall architecture of a specific module within a product (e.g., Data-ingestion, near-real-time-data-processor, etc.), perform design and assist implementation considering system characteristics to produce optimal performance, reliability and maintainability.
  • Provide technical guidance to team members, ensuring they are working towards the product's architectural goals.
  • Create and manage RFCs (Request for Comments) and ADRs (Architecture Decision Records), Design notes and technical documentation for your module, following the architecture governance processes.
  • Lead a team of data engineers, providing mentorship, setting priorities, and ensuring alignment with business goals.
  • Architect, design, and build scalable data pipelines for processing large volumes of structured and unstructured data from various sources.
  • Collaborate with software engineers, architects, and product teams to design and implement systems that enable real-time and batch data processing at scale.
  • Be the go-to person for PySpark-based solutions, ensuring optimal performance and reliability for distributed data processing.
  • Ensure that data engineering systems adhere to the best data security, privacy, and governance practices in line with industry standards.
  • Perform code reviews for the product, ensuring adherence to company coding standards and best practices.
  • Develop and implement monitoring and alerting systems to ensure timely detection and resolution of data pipeline failures and performance bottlenecks.
  • Act as a champion for new technologies, helping ease transitions and addressing concerns or resistance from team members.
  • Ideal Candidate :

  • Experience leading a data engineering team with a strong focus on software engineering principles such as KISS, DRY, YAGNI etc.
  • Candidate MUST have experience in owning large, complex system architecture and hands-on experience designing and implementing data pipelines across large-scale systems.
  • Experience implementing and optimizing data pipelines with AWS is a must.
  • Production delivery experience in Cloud-based PaaS Big Data related technologies (EMR, Snowflake, Data bricks etc.)
  • Experienced in multiple Cloud PaaS persistence technologies, and in-depth knowledge of cloud- based ETL offerings and orchestration technologies (AWS Step Function, Airflow etc.)
  • Experienced in stream-based and batch processing, applying modern technologies
  • Working experience with distributed file systems (S3, HDFC, ADLS), table formats (HUDI, Iceberg), and various open file formats (JSON, Parquet, Csv, etc.)
  • Strong programming experience in PySpark, SQL, Python, etc.
  • Database design skills including normalization / de-normalization and data warehouse design
  • Knowledge and understanding of relevant legal and regulatory requirements, such as SOX, PCI, HIPAA, Data Protection
  • Experience in the healthcare industry, a plus
  • A collaborative and informative mentality is a must!
  • Toolset :

  • AWS, preferably AWS certified Data Engineer and AWS certified Solutions Architect.
  • Proficiency in at least one programming language C#, GoLang, JavaScript or ReactJs
  • Spark / Python / SQL
  • Snowflake / Databricks / Synapse / MS SQL Server
  • ETL / Orchestration Tools (Step Function, DBT etc.)
  • ML / Notebooks
  • Education and experience required

  • Bachelors or Master’s in Computer Science, Information Systems, or an engineering field or relevant experience.
  • 10 years of related experience in developing data solutions and data movement.
  • If you're looking for rewarding employment and a company that puts its employees first, we'd like to work with you. We're driven, people driven.

    Bhupesh Khurana

    Senior Technical Recruiter

    Email : bkhurana@ameritconsulting.com

    Amerit Consulting is an extremely fast-growing staffing and consulting firm. Amerit Consulting was founded in 2002 to provide consulting, temporary staffing, direct hire, and payrolling services to Fortune 500 companies nationally; as well as small to mid-sized organizations on a local & regional level. Currently, Amerit has over 2,000 employees in 47 states. We develop and implement solutions that help our clients operate more efficiently, deliver greater customer satisfaction, and see a positive impact on their bottom line. We create value by bringing together the right people to achieve results. Our clients and employees say they choose to work with Amerit because of how we work with them - with service that exceeds their expectations and a personal commitment to their success. Our deep expertise in human capital management has fueled our expansion into direct hire placements, temporary staffing, contract placements, and additional staffing and consulting services that propel our clients’ businesses forward.

    Amerit Consulting provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

    This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.

    Applicants, with criminal histories, are considered in a manner that is consistent with local, state and federal laws.

    If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
    Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

    What is the career path for a Lead Cloud Data Engineer (100% REMOTE/NO C2C)?

    Sign up to receive alerts about other jobs on the Lead Cloud Data Engineer (100% REMOTE/NO C2C) career path by checking the boxes next to the positions that interest you.
    Income Estimation: 
    $92,369 - $122,605
    Income Estimation: 
    $117,024 - $149,811
    Income Estimation: 
    $71,122 - $96,652
    Income Estimation: 
    $92,929 - $122,443
    Income Estimation: 
    $92,929 - $122,443
    Income Estimation: 
    $122,257 - $154,284
    Income Estimation: 
    $122,257 - $154,284
    Income Estimation: 
    $143,391 - $179,890
    Income Estimation: 
    $168,522 - $211,152
    Income Estimation: 
    $189,259 - $248,928
    View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

    Job openings at Amerit Consulting

    Amerit Consulting
    Hired Organization Address Los Angeles, CA Contractor
    Our client, a Medical Center facility under the aegis of a California Public Ivy university and one of largest health de...
    Amerit Consulting
    Hired Organization Address Los Angeles, CA Contractor
    Overview: Our client, a Medical Center facility under the aegis of a California Public Ivy university and one of largest...
    Amerit Consulting
    Hired Organization Address San Francisco, CA Full Time
    Join a leading Medical Center under a renowned California Public Ivy university as an IT Project Manager . This exciting...
    Amerit Consulting
    Hired Organization Address Los Angeles, CA Full Time
    Overview : Our client, a Medical Center facility under the aegis of a California Public Ivy university and one of the la...

    Not the job you're looking for? Here are some other Lead Cloud Data Engineer (100% REMOTE/NO C2C) jobs in the Fontana, CA area that may be a better fit.

    Lead Support Engineer

    Cloud Software Group, Inc., Fontana, CA

    Cloud SQL Data Engineer - Hybrid

    Applied Statistics & Management Inc., Temecula, CA

    AI Assistant is available now!

    Feel free to start your new journey!