What are the responsibilities and job description for the Senior Data Engineer position at Marlins?
Position Summary:
The Miami Marlins are seeking a Senior Data Engineer for the Baseball Systems department. Reporting directly to the Director of Data Engineering, candidates will be responsible for designing, implementing, and optimizing processes that ingest, validate, and organize baseball data from a variety of sources. The Senior Data Engineer will support the data and information requirements of our Baseball Operations department. Strong applicants will have demonstrable experience with modern database systems, cloud technologies, and database management.
Essential Functions:
● Lead design, development, documentation, and maintenance of database infrastructure and data processes that scale and adapt to current and future use cases.
● Break down complex Data Engineering projects into actionable work plans including proposed task assignments with clear design specifications.
● Implement and test collection, mapping, and storage procedures for secure access to internal and external data sources.
● Assess, provision, monitor, and maintain the appropriate infrastructure and tooling to automate and execute data engineering workflows.
● Develop algorithms for quality assurance and imputation to prepare data for exploratory analysis and quantitative modeling.
● Coordinate with data providers around planned changes to data feeds.
● Research, design, test, and implement generalizable software architectures for data ingestion, processing, and integration and guide organizational adoption and strategies for infrastructure maintenance and data-related cost savings.
● Help define and encourage team-wide adoption of data engineering standards.
● Effectively communicate complex technical concepts to both internal and external audiences.
● Assist with recruiting and outreach for the Data Engineering team and provide guidance and technical mentorship for junior engineers.
● Fulfill other related duties and responsibilities, including rotating platform support.
Qualifications & Requirements:
- Demonstrated experience in back-end software design and development.
- Experience with ETL/ELT architecture and development in a cloud-based environment.
- Fluency in SQL and an understanding of database and data warehousing technologies.
- Proficiency with Python (preferred), Scala, and/or other data-oriented programming languages.
- Experience with automated data quality validation across large data sets.
- Strong software engineering and problem-solving skills.
- Expertise developing complex databases and data warehouses (e.g. SQL Server, BigQuery, BigTable, Snowflake) for large-scale, cloud-based analytics systems.
- Experience with cloud computing platforms (GCP, AWS, Azure, etc.) is a plus.
- Experience with task orchestration and workflow automation tools such as Airflow.
- Proficient in designing, deploying, and managing containerized applications with tools such as Docker and Kubernetes.
- Ability to successfully mentor junior engineers to grow in their own careers.
- Understanding of and passion for baseball and baseball research.
- Ability to work extended hours including evenings, weekends, and holidays.
Suggested Education & Experience Guidelines:
- Degree in Computer Science or related Software Engineering Field
- 2 years of relevant professional work experience
We are an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, sex, sexual orientation, age, disability, gender identity, marital or veteran status, or any other protected class.
