Demo

Big Data Engineer

Agile Enterprise Solutions
Pittsburgh, PA Full Time
POSTED ON 3/19/2025
AVAILABLE BEFORE 5/19/2025

Job Description

Hi,

Hope your are doing great!

My name is Shyam and I am a Professional Recruiter at Agile, Inc. I have an open opportunity that you may be a good fit for. I came across your resume and think that you might be a good fit for the position listed below.

Title: Big Data Engineer

Location: Pittsburgh, PA

Mode: Permanent

Job Description:

We are looking for a Big Data Engineer that will work on the collecting, storing, processing, and analyzing of large sets of data.

The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them.

You will also be responsible for integrating them with the architecture used across the company.

Skills and Qualifications

• Proficient understanding of distributed computing principles

• Management of Hadoop cluster (Cloudera preferred), with all included services

• Ability to solve any ongoing issues with operating the cluster

• Proficiency with Hadoop v2, MapReduce, HDFS, Sqoop

• Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming

• Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala

• Experience with Spark

• Experience with integration of data from multiple data sources such as MsSQL Server, Oracle,

• Good understanding of SQL queries, joins, stored procedures, relational schemas

• Experience with NoSQL databases, such as HBase, Cassandra, MongoDB (preferred)

• Knowledge of various ETL techniques and frameworks, such as Flume

• Experience with various messaging systems, such as Kafka or RabbitMQ

• Experience with Cloudera FS domain knowledge a big plus but not required

Thanks & Regards

Additional Information

All your information will be kept confidential according to EEO guidelines.

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Big Data Engineer?

Sign up to receive alerts about other jobs on the Big Data Engineer career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$92,929 - $122,443
Income Estimation: 
$122,257 - $154,284
Income Estimation: 
$92,929 - $122,443
Income Estimation: 
$122,257 - $154,284
Income Estimation: 
$122,257 - $154,284
Income Estimation: 
$143,391 - $179,890
Income Estimation: 
$168,522 - $211,152
Income Estimation: 
$189,259 - $248,928
Income Estimation: 
$71,122 - $96,652
Income Estimation: 
$92,929 - $122,443

Sign up to receive alerts about other jobs with skills like those required for the Big Data Engineer.

Click the checkbox next to the jobs that you are interested in.

  • Architecture Skill

    • Income Estimation: $80,267 - $99,326
    • Income Estimation: $92,357 - $117,598
  • Building Codes and Regulations Skill

    • Income Estimation: $56,900 - $89,276
    • Income Estimation: $59,820 - $81,544
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Agile Enterprise Solutions

Agile Enterprise Solutions
Hired Organization Address Chattanooga, TN Full Time
Company Description the company domain is into automotive Job Description DUTIES AND RESPONSIBILITIES 1. Represent the q...
Agile Enterprise Solutions
Hired Organization Address Fairfax, VA Full Time
Job Description Job Description: This position is for an experienced design engineer charged with supporting project tea...
Agile Enterprise Solutions
Hired Organization Address Peoria, IL Full Time
Job Description 1 Data Modeler Technology Agnostic 12 Yrs 2-3 months Peoria (IL) -Develops the Enterprise Logical Data M...
Agile Enterprise Solutions
Hired Organization Address Mc Lean, VA Full Time
Job Description Job Description Hope you are doing great today. Let me know if you are interested in below requirement. ...

Not the job you're looking for? Here are some other Big Data Engineer jobs in the Pittsburgh, PA area that may be a better fit.

BIG Data Engineer

Saxon Global, Pittsburgh, PA

AWS AI Data Engineer

NTT DATA Americas, Inc, Pittsburgh, PA

AI Assistant is available now!

Feel free to start your new journey!