Full-Time Principal Data Engineer

About US: We are a company that provides innovative, transformative IT services and solutions. We are passionate about helping our clients achieve their goals and exceed their expectations. We strive to provide the best possible experience for our clients and employees. We are committed to continuous improvement and innovation, and we are always looking for ways to improve our services and solutions. We believe in working collaboratively with our clients and employees to achieve success.

DS Technologies Inc is looking for Full-Time Principal Data Engineer role for one of our premier clients.

Job Title: Full-Time Principal Data Engineer

Location: Fort Mill, SC or Austin, TX (Hybrid)

Industry: Financial Services

Job Category: Data Engineering

Overview

We are seeking a Principal Data Engineer to lead the design, development, and optimization of ETL pipelines. This role focuses on high-performance data ingestion, transformation, and cloud-based data processing at LPL Financial.Position: Principal Data Engineer (Full-Time)

Responsibilities

• Lead the design, development, and maintenance of scalable ETL pipelines
• Optimize data ingestion, transformation, and storage for performance and scalability
• Work closely with data scientists, analysts, and software engineers to build robust data solutions
• Develop and manage SQL queries for data manipulation and efficient data processing
• Implement data validation and testing frameworks (e.g., Pytest) to ensure data reliability
• Monitor, troubleshoot, and optimize data pipelines for smooth operations
• Stay up-to-date with industry trends and cloud technology best practices
  
  

Required Qualifications:

• 10 years of experience in Data Engineering or a related field
• Expertise in AWS (S3, Glue, Lambda, Redshift, etc.) for cloud-based data processing
• Hands-on experience with Python and Spark for data processing and automation
• Strong understanding of ETL pipelines and data warehousing
• Experience with SQL and writing complex queries
  
  

Additional Information:

• Hybrid role in Fort Mill, SC or Austin, TX
• Opportunity to lead cloud-based data transformation initiatives
  
  

Candidate Details:

• Must have extensive experience in AWS-based data engineering
• Ability to collaborate across teams to drive enterprise data solutions
• Strong knowledge of ETL workflows, SQL, and cloud data processing best practices
  
  

If you are interested, Kindly share your resume to Vamshi@dstechnologiesinc.com

Thanks

DS Technologies - Team