Demo

Data Engineer

Thoughtwave Software and Solutions
Illinois, IL Full Time
POSTED ON 4/3/2025
AVAILABLE BEFORE 6/3/2025

Job Details


Only w2

Data Engineer
Contract Length: 12 Months
Location: Irving, TX


Work Overview:
Have over 150 data sources, mostly on-prem relational databases (SQL Server, some Oracle), Teradata, and some files.
Existing data pipelines are batch-driven, using SSIS, Ab Initio, and Informatica, and her existing team has experience in these tools. Refactoring existing data movements and ETL jobs into Python/Spark pipelines.
They do not own the Python/Spark framework and will not be making modifications to it, but adopting it for their data pipelines.
Majority of initial work will be around migrating SSIS packages to Spark, needs strong SQL skills.
In tandem, data architecture team will be setting up Google Cloud Platform environment, will eventually "reroute" pipelines to BigQuery/BigTable and introduce DataProc. Will be using Dremio or Starburst for virtualization, not finalized yet.
Following traditional medallion architecture, ingesting into bronze/raw layer, silver layer usage for more operational workflows, gold layer for reporting/analytics.
Mostly batch processing now, but will get into event-driven architecture down the road a little.
Open to candidates in Charlotte or Dallas

Tech Requirements:
SQL
Python
Spark
Legacy ETL tooling (SSIS preferred, Ab Initio, Informatica)
Cloud experience (Cloud-native warehousing, Google Cloud Platform preferred, Azure/AWS okay.. Does not need a Cloud Data Engineer)

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Data Engineer?

Sign up to receive alerts about other jobs on the Data Engineer career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$92,929 - $122,443
Income Estimation: 
$122,257 - $154,284
Income Estimation: 
$92,929 - $122,443
Income Estimation: 
$122,257 - $154,284
Income Estimation: 
$92,249 - $117,370
Income Estimation: 
$93,716 - $124,745
Income Estimation: 
$118,976 - $146,289
Income Estimation: 
$112,672 - $149,113
Income Estimation: 
$98,475 - $115,895
Income Estimation: 
$118,976 - $146,289
Income Estimation: 
$115,719 - $153,093
Income Estimation: 
$137,343 - $165,639
Income Estimation: 
$135,811 - $184,429
Income Estimation: 
$120,390 - $162,969
Income Estimation: 
$122,257 - $154,284
Income Estimation: 
$143,391 - $179,890

Sign up to receive alerts about other jobs with skills like those required for the Data Engineer.

Click the checkbox next to the jobs that you are interested in.

  • Big Data Skill

    • Income Estimation: $90,112 - $113,166
    • Income Estimation: $116,765 - $144,626
  • Big Data Analytics Skill

    • Income Estimation: $90,112 - $113,166
    • Income Estimation: $116,765 - $144,626
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Thoughtwave Software and Solutions

Thoughtwave Software and Solutions
Hired Organization Address Almont, CO Full Time
Job Details Role: ABAP Engineer Duration: 6 Months Location: Salisbury- must come on-site 1x week as a contractor then u...
Thoughtwave Software and Solutions
Hired Organization Address Arizona, AZ Full Time
Job Details Role: PeopleSoft Payroll Analyst Duration: 12 Months Location: Onsite In Mineola NY Required Skills: 10 year...
Thoughtwave Software and Solutions
Hired Organization Address Maryland, NY Full Time
Job Details Role: Full Stack Developer Duration: Long Term Location: Hybrid (3 days on site) in either Mclean, VA or New...
Thoughtwave Software and Solutions
Hired Organization Address California, CA Full Time
Job Details Role: Epic Willow Inpatient Analyst Duration: 6 Months Location: Danville, PA 17822 Required Skills: Epic Wi...

Not the job you're looking for? Here are some other Data Engineer jobs in the Illinois, IL area that may be a better fit.

Data Engineer

Aroha Technologies, Illinois, IL

Data Engineer

CDC Foundation, Illinois, IL

AI Assistant is available now!

Feel free to start your new journey!