Demo

BIG DATA ENGINEER

workcog
Albany, MN Full Time
POSTED ON 1/16/2025
AVAILABLE BEFORE 4/15/2025

Company Overview

Workcog is a leading staffing and partnerships company that specializes in providing efficient staffing solutions. Our aim is to offer the best possible partnering experience to our clients by utilizing the most effective staffing practices. We take pride in our quality services and expertise in various industries.

Job Overview

Workcog is seeking a highly skilled Big Data Engineer to join our dynamic team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining our data infrastructure and systems. This role requires expert knowledge of big data technologies and the ability to analyze large datasets to extract valuable insights. The ideal candidate has extensive experience in managing big data projects and a strong understanding of data warehousing concepts.

Qualifications and Skills

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • Minimum of 5 years of experience in big data engineering or a similar role.
  • Strong programming skills in languages like Java, Python, or Scala.
  • Proficiency in big data technologies such as Hadoop, Spark, Kafka, and Hive.
  • Experience with data warehousing concepts and relational databases like Oracle or MySQL.
  • Knowledge of data modeling and database design principles.
  • Familiarity with cloud platforms like AWS or Azure.
  • Excellent problem-solving and analytical skills.
  • Ability to work collaboratively in a team environment.
  • Strong communication and interpersonal skills.

Roles and Responsibilities

  • Design and develop scalable big data solutions using technologies like Hadoop, Spark, and NoSQL databases.
  • Build and maintain data pipelines and ETL processes to collect and transform large volumes of data.
  • Optimize and fine-tune the performance of big data systems to ensure efficient data processing and analysis.
  • Collaborate with cross-functional teams to gather requirements and identify opportunities for leveraging big data technologies.
  • Develop and implement data governance policies and procedures to ensure data integrity and security.
  • Troubleshoot and debug issues in big data systems and provide timely resolutions.
  • Stay up-to-date with emerging trends and technologies in big data and propose innovative solutions to improve data processing and analysis.
  • Conduct performance testing and capacity planning to optimize the performance and scalability of big data systems.
  • Skills : BIg data , data bricks, data factory, azure delta lake, selinium, AWS, hadoop

    If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
    Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

    What is the career path for a BIG DATA ENGINEER?

    Sign up to receive alerts about other jobs on the BIG DATA ENGINEER career path by checking the boxes next to the positions that interest you.
    Income Estimation: 
    $92,929 - $122,443
    Income Estimation: 
    $122,257 - $154,284
    Income Estimation: 
    $92,929 - $122,443
    Income Estimation: 
    $122,257 - $154,284
    Income Estimation: 
    $122,257 - $154,284
    Income Estimation: 
    $143,391 - $179,890
    Income Estimation: 
    $168,522 - $211,152
    Income Estimation: 
    $189,259 - $248,928
    Income Estimation: 
    $71,122 - $96,652
    Income Estimation: 
    $92,929 - $122,443
    View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

    Job openings at workcog

    workcog
    Hired Organization Address Texas, TX Full Time
    Company Overview Workcog is a leading company specializing in staffing and partnerships. We aim to provide the best poss...
    workcog
    Hired Organization Address Texas, TX Full Time
    Company Overview Workcog is a leading IT consulting company that specializes in staffing and partnerships. We strive for...
    workcog
    Hired Organization Address Virginia, VA Full Time
    Role : .NET Developer Location : Richmond, VA (Hybrid ) Duration : : Long term Complete Description Local Richmond, VA c...
    workcog
    Hired Organization Address Murphy, TX Full Time
    SAP ABAP Developer. Job Description / Must Have : Experience in ABAP programming Experience in Data Dictionary Objects i...

    Not the job you're looking for? Here are some other BIG DATA ENGINEER jobs in the Albany, MN area that may be a better fit.

    Data Engineer

    Oowlish Technology, Montevideo, MN

    DATA ENGINEER

    Jam City, Montevideo, MN

    AI Assistant is available now!

    Feel free to start your new journey!