Demo

Senior Manager, Data Engineering

Shamrock Trading Corporation
Shamrock Trading Corporation Salary
Overland Park, KS Full Time
POSTED ON 2/8/2025
AVAILABLE BEFORE 5/8/2025

Responsibilities

Shamrock Trading Corporation is looking for a Senior Manager of Data Engineering who wants to utilize their leadership expertise to guide the evolution and execution of the Data Services team. Data Service team responsibilities include warehousing, data pipeline creation / support, data platform ownership and analytical reporting. This role is responsible for managing and prioritizing the workload tied to data structuring from several internal and external sources, designing a cloud-focused data platform for machine learning, analytics and business intelligence and delivering projects within deadlines. This role requires significant understanding of data mining and analytical techniques. An ideal candidate will have a history with leading data teams, strong technical capabilities, business acumen and the ability to communicate effectively with cross-functional teams. The Senior Manager of Data Engineering will lead a team of Data Engineers to provide data integration solutions on our cloud data platform to help support data governance, machine learning, analytics and business intelligence reporting.

  • Work with Data Engineers and Architects to understand current data workload and project assignments and ensure timely completion of projects.
  • Oversee the design, build and framework for pipeline observation and monitoring, focusing on reliability and performance of jobs.
  • Develop and implement an enterprise data platform strategy that aligns with Shamrock’s goals and objectives.
  • Responsible for the implementation, dissemination and adherence of Shamrock Data Engineering methodologies, processes & principles.
  • Provide an accurate estimation process for projects and change activity in line with profitability targets.
  • Develop and implement a strategic vision and roadmap for data engineering aligned with organizational goals.
  • Lead and manage the data engineering team using Agile and Scrum methodologies to promote flexible and iterative advancement.
  • Conduct and oversee Scrum ceremonies to maintain project momentum and address challenges swiftly.
  • Engage with business stakeholders to effectively prioritize user-centric enhancements and foster collaborative relationships.
  • Surface data errors to the proper teams and provide coaching and development to correct behaviors.
  • Provide technical consultation for other team members on best practices for automation, monitoring, and deployments.
  • Provide technical consultation for the team with “infrastructure as code” best practices : building deployment processes utilizing technologies such as Terraform or AWS Cloud Formation.
  • Provide leadership and development opportunities to the team, ensuring project excellence and retention of top talent while maintaining a focus on strategic objectives and business value.

Qualifications

  • Bachelor’s degree in computer science, data science or related technical field, or equivalent practical experience.
  • 5 years of experience in data architecture, data management, or a related role.
  • Proven experience in leading Data Engineering teams and managing complex data projects.
  • Excellent problem-solving skills and the ability to troubleshoot complex data issues.
  • Strong communication and interpersonal skills, with the ability to collaborate effectively with technical and non-technical stakeholders.
  • Experience in developing cloud solutions using data services.
  • Experience managing engineers and guiding them through project planning, design, development, quality control and deployment.
  • Experience with the following :
  • Agile project management, specifically with Scrum frameworks
  • Cloud platforms such as AWS, Azure or Google Cloud
  • Python and PySpark
  • Databricks or equivalent
  • Relational and NoSQL databases (. Postgres, Redshift, MongoDB, Elasticsearch).
  • Kafka, Matillion, or Confluent
  • Data governance frameworks and tools
  • Git version control and peer code reviews
  • Preferred Qualifications

  • Experience in the following areas :
  • Building and maintaining AWS based data pipelines (current technologies include AWS Lambda, Docker / ECS, MSK).
  • Data process and analytics using AWS Glue or Apache Spark.
  • Building data-lake style infrastructures using streaming data set technologies, especially Apache Kafka.
  • Kafka and the Kafka Connect ecosystem.
  • Data processing using Parquet and Avro.
  • Developing, maintaining and deploying Python packages.
  • Data visualization techniques using tools such as Grafana, PowerBI, AWS Quick Sight, and Excel.
  • Benefits Package At Shamrock we hire bright, ambitious people and give them the tools they need to be successful. By investing in training and development, we hope to become a long-term career for employees, where there are always opportunities for advancement. Shamrock also offers a premier set of benefits for employees and their families :

  • Medical :  Fully paid healthcare, dental and vision premiums for employees and eligible dependents
  • Work-Life Balance :  Competitive PTO and paid leave policies
  • Financial :  Generous company 401(k) contributions and employee stock ownership after one year
  • Wellness :  Onsite gym and discounted membership to select fitness centers. Jogging trails available at Overland Park offices
  • If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
    Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

    What is the career path for a Senior Manager, Data Engineering?

    Sign up to receive alerts about other jobs on the Senior Manager, Data Engineering career path by checking the boxes next to the positions that interest you.
    Income Estimation: 
    $159,552 - $206,899
    Income Estimation: 
    $192,745 - $244,036
    Income Estimation: 
    $173,814 - $236,842
    Income Estimation: 
    $216,332 - $316,541
    Income Estimation: 
    $122,257 - $154,284
    Income Estimation: 
    $143,391 - $179,890
    Income Estimation: 
    $104,816 - $143,830
    Income Estimation: 
    $130,367 - $181,175
    View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

    Job openings at Shamrock Trading Corporation

    Shamrock Trading Corporation
    Hired Organization Address Franklin, TN Full Time
    Company Overview RTS Financial is part of Shamrock Trading Corporation, a family of brands in transportation, finance an...
    Shamrock Trading Corporation
    Hired Organization Address Atlanta, GA Full Time
    Company Overview RTS Financial is part of Shamrock Trading Corporation, a family of brands in transportation, finance an...
    Shamrock Trading Corporation
    Hired Organization Address Overland Park, KS Intern
    Responsibilities Shamrock Trading Corporation is looking for a Technical Support Intern to join the IT team. This role a...
    Shamrock Trading Corporation
    Hired Organization Address Overland Park, KS Full Time
    Company Overview Shamrock Trading Corporation is the parent company for a family of brands in transportation services, f...

    Not the job you're looking for? Here are some other Senior Manager, Data Engineering jobs in the Overland Park, KS area that may be a better fit.

    Senior Manager, Executive Protection

    QTS Data Centers, Overland Park, KS

    Interior Design Senior Manager

    QTS Data Centers, Overland Park, KS

    AI Assistant is available now!

    Feel free to start your new journey!