Full-Time Data Engineer

About US: We are a company that provides innovative, transformative IT services and solutions. We are passionate about helping our clients achieve their goals and exceed their expectations. We strive to provide the best possible experience for our clients and employees. We are committed to continuous improvement and innovation, and we are always looking for ways to improve our services and solutions. We believe in working collaboratively with our clients and employees to achieve success.

DS Technologies Inc is looking for Full-Time Data Engineer role for one of our premier clients.

Job Title: Full-Time Data Engineer

Location: Fort Mill, SC or Austin, TX (Hybrid)

Industry: Financial Services

Job Category: Data Engineering

Overview

We are seeking a Data Engineer to design, maintain, and optimize ETL pipelines using AWS, Python, and Spark. This role focuses on data integrity, governance, and scalable data solutions to support LPL Financial's data initiatives.

Position: Data Engineer (Full-Time) Responsibilities:

• Design and maintain ETL pipelines using AWS, Python, and Spark
• Optimize data processing workflows for performance and scalability
• Work with structured and unstructured data, ensuring data integrity and governance
• Develop SQL queries for data extraction and processing from relational databases
• Collaborate with software engineers and data scientists to build scalable data solutions
• Implement and automate testing frameworks (e.g., Pytest) to ensure data accuracy
• Monitor, troubleshoot, and optimize data pipelines for efficiency
  
  

Required Qualifications:

• 5 years of experience in Data Engineering
• Strong experience with AWS services (S3, Glue, Lambda, Redshift)
• Expertise in Python and Spark for data processing
• Solid understanding of ETL pipeline design and data processing
• Proficiency in SQL for querying relational databases
  
  

Additional Information:

• Hybrid role in Fort Mill, SC or Austin, TX
• Opportunity to work on large-scale data engineering projects
  
  

Candidate Details:

• Must have strong experience in AWS-based data engineering
• Ability to collaborate with cross-functional teams to build efficient data solutions
• Strong knowledge of ETL workflows, SQL, and data governance best practices
  
  

If you are interested, Kindly share your resume to Vamshi@dstechnologiesinc.com

Thanks

DS Technologies - Team