Demo

Big Data Engineer

RIT Solutions, Inc.
Malvern, PA Full Time
POSTED ON 1/25/2025
AVAILABLE BEFORE 4/21/2025

Can send one Person.

Big Data Engineer

Malvern, PA - Hybrid

Job Description

Responsibilities

  • Client's Trading Analytics and Strategy (TAS) team works with our global trading desks to optimize their trading strategies, saving millions of dollars for clients every year.
  • The team works with our trader and portfolio manager partners, across asset classes and passive as well as active mandates, to conduct data-driven analyses and build tools to help shape our trading strategy.
  • s an Engineer on the full stack team, you will be dedicated to help design, implement, and maintain a modern, robust, and scalable platform which will enable the TAS team to meet the increasing demands from the various trading desks.

Qualifications

  • Proficiency in Python programming
  • Strong expertise in SQL, Presto, HIVE, and Spark
  • Knowledge of trading and investment dat
  • Experience in big data technologies such as Spark and developing distributed computing applications using PySpark
  • Experience with libraries for data manipulation and analysis, such as Pandas, Polars and NumPy Understanding of data pipelines, ETL processes, and data warehousing concepts
  • Strong experience in building and orchestrating data pipelines
  • Experience in building APIs Write, maintain, and execute automated unit tests using Python
  • Follow Test-Driven Development (TDD) practices in all stages of software development
  • Extensive experience with key AWS services / components including EMR, Lambda, Glue ETL, Step Functions, S3, ECS, Kinesis, IAM, RDS PostgreSQL, Dynamodb, Timeseries database, CloudWatch Events / Event Bridge, Athena, SNS, SQS, and VPC
  • Proficiency in developing serverless architectures using AWS services
  • Experience with both relational and NoSQL databases
  • Skills in designing and implementing data models, including normalization, denormalization, and schema design
  • Knowledge of data warehousing solutions like Amazon Redshift
  • Strong analytical skills with the ability to troubleshoot data issues
  • Good understanding of source control, unit testing, test-driven development, and CI / CD
  • bility to write clean, maintainable code and comprehend code written by others
  • Strong communication skills
  • Proficiency in data visualization tools and ability to create visual representations of data, particularly using Tableau
  • If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
    Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

    What is the career path for a Big Data Engineer?

    Sign up to receive alerts about other jobs on the Big Data Engineer career path by checking the boxes next to the positions that interest you.
    Income Estimation: 
    $92,929 - $122,443
    Income Estimation: 
    $122,257 - $154,284
    Income Estimation: 
    $92,929 - $122,443
    Income Estimation: 
    $122,257 - $154,284
    Income Estimation: 
    $114,370 - $171,433
    Income Estimation: 
    $200,642 - $510,471
    Income Estimation: 
    $155,740 - $229,397
    Income Estimation: 
    $147,449 - $265,969
    Income Estimation: 
    $200,706 - $326,730
    Income Estimation: 
    $122,257 - $154,284
    Income Estimation: 
    $143,391 - $179,890
    View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

    Job openings at RIT Solutions, Inc.

    RIT Solutions, Inc.
    Hired Organization Address Springs, GA Full Time
    Business Process Analyst / Product Manager Hybrid (Sandy Springs, GA) 6 Months EPBCS experience Experience with financia...
    RIT Solutions, Inc.
    Hired Organization Address Plymouth Meeting, PA Full Time
    Title : Advanced Digital Insight Analyst They want candidates to have in depth Adobe analytics experience, A / B testing...
    RIT Solutions, Inc.
    Hired Organization Address Tampa, FL Full Time
    Title : Technical Project Manager (junior to mid-level) Location : 100% remote Duration : 6 months Skillset : Assist wit...
    RIT Solutions, Inc.
    Hired Organization Address Tampa, FL Temporary
    SCCM administrator. 12 month contract (on-going) On-site Houston Possibly open to relocation if they can be on-site day ...

    Not the job you're looking for? Here are some other Big Data Engineer jobs in the Malvern, PA area that may be a better fit.

    Big Data Engineer

    Sonsoft Inc, King of Prussia, PA

    Big Data Engineer

    Veracity, Malvern, PA

    AI Assistant is available now!

    Feel free to start your new journey!