Demo

Big Data Engineer

ACS Consultancy Services
Albany, NY Full Time
POSTED ON 2/2/2025
AVAILABLE BEFORE 5/1/2025

Job Title : Big Data Engineer(US Citizens Only)

Location : Remote

We are currently seeking candidates who meet the following qualifications :

Responsibilities :

  • Design, develop, and maintain big data pipelines for collecting, storing, processing, and analyzing large datasets.
  • Implement and optimize ETL / ELT processes to ensure efficient data integration and transformation.
  • Build and maintain data storage solutions such as data lakes, warehouses, and distributed storage systems.
  • Collaborate with data scientists, analysts, and stakeholders to understand requirements and deliver data solutions.
  • Optimize data workflows for performance, scalability, and cost efficiency.
  • Ensure data security, governance, and compliance with industry standards.
  • Monitor and troubleshoot data pipelines and systems to ensure reliability and uptime.
  • Stay up-to-date on emerging big data technologies and best practices.

Qualifications :

  • Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
  • Experience as a Data Engineer or Big Data Engineer.
  • Hands-on experience with big data frameworks such as Apache Hadoop, Spark, or Flink.
  • Proficiency in programming languages like Python, Java, or Scala for data engineering tasks.
  • Strong understanding of distributed computing principles.
  • Experience with cloud platforms (e.g., AWS, Azure, GCP) and their big data services (e.g., EMR, Databricks, BigQuery).
  • Proficiency in working with data storage technologies such as HDFS, Apache Hive, Apache HBase, Cassandra, or Snowflake.
  • Expertise in SQL and database technologies for querying and managing data.
  • Familiarity with streaming data technologies like Apache Kafka, Kinesis, or Pulsar.
  • Knowledge of data modeling and designing efficient data architectures.
  • Experience with data pipeline orchestration tools (e.g., Apache Airflow, Luigi).
  • Strong analytical and problem-solving skills.
  • Excellent communication and collaboration skills.
  • Federal Experience is a plus.
  • Required Security clearance.
  • If you meet these qualifications, please submit your application via link provided in Linkedin.

    Kindly do not call the general line to submit your application.

    If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
    Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

    What is the career path for a Big Data Engineer?

    Sign up to receive alerts about other jobs on the Big Data Engineer career path by checking the boxes next to the positions that interest you.
    Income Estimation: 
    $92,929 - $122,443
    Income Estimation: 
    $122,257 - $154,284
    Income Estimation: 
    $92,929 - $122,443
    Income Estimation: 
    $122,257 - $154,284
    Income Estimation: 
    $71,122 - $96,652
    Income Estimation: 
    $92,929 - $122,443
    Income Estimation: 
    $122,257 - $154,284
    Income Estimation: 
    $143,391 - $179,890
    View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

    Job openings at ACS Consultancy Services

    ACS Consultancy Services
    Hired Organization Address Albany, NY Full Time
    Job Title : Senior IT Project Manager Location : Remote We are currently seeking candidates who meet the following quali...
    ACS Consultancy Services
    Hired Organization Address Albany, NY Full Time
    Job Title : Microsoft 365 Administrator (US Citizens Only) Location : Remote We are currently seeking candidates who mee...
    ACS Consultancy Services
    Hired Organization Address Albany, NY Full Time
    Job Title : Full-Stack .NET Developer(Health Care) Location : Albany,NY(Hybrid) We are currently seeking candidates who ...
    ACS Consultancy Services
    Hired Organization Address New York, NY Full Time
    Job Title : Junior Project manager (Financial Domain) Location : New York, NY(Hybrid) We are currently seeking candidate...

    Not the job you're looking for? Here are some other Big Data Engineer jobs in the Albany, NY area that may be a better fit.

    Big Data Consultant

    Pyramid IT, Latham, NY

    Build Release Engineer

    Hudson Data LLC, Rensselaer, NY

    AI Assistant is available now!

    Feel free to start your new journey!