What are the responsibilities and job description for the Senior Software Engineer, Data Platform position at Stack AV?
About the Role:
The Data Platform team is part of the Platform Infrastructure Engineering and Reliability group, and is responsible for designing, implementing and maintaining the Stack AV on-premises data platform. The team supports large scale OLAP/OLTP and feature engineering workloads for multiple Product Development groups across the company. The team is tasked with building a highly-available and scalable data infrastructure to power our critical services and pipelines. Members of the team are expected to have a strong focus on requirements gathering and design process to ensure our platform meets the needs of the business and our internal customers.
Responsibilities:
- Design, implement, maintain, and operate the on-premises data platform for large-scale OLAP/OLTP and feature engineering workloads.
- Engage in requirements gathering and participate in the design process to align the platform with business and internal customer needs.
- Provide production-grade support to internal engineering teams, emphasizing observability, instrumentation, and defined service level objectives (SLOs).
- Collaborate cross-functionally within the organization to meet customer use cases and deliver business value.
- Automate routine administrative tasks and create alerts to proactively identify system issues.
- Identify and implement new features in OSS products to support business needs, contribute these improvements back to OSS projects.
- Work with outside vendors by providing critical product feedback and advocating for new features and changes to support business needs.
- Develop and implement security best practices at the data, application, infrastructure layers.
- Troubleshoot performance issues and identify / eliminate performance bottlenecks in any part of the system stack.
Qualifications:
- Computer Science degree (or equivalent experience will be considered).
- 7 years of total experience with at least some of that running a service and providing support to users.
- Expert Level Programming skills in 2 languages like Python, Java, C or SQL, hands on experience running Trino (or Presto), familiarity with Object Storage and open table formats such as Iceberg, DeltaLake, experience with Apache Spark, hands on experience with Terraform, Kubernetes and ArgoCD.
- Strong Communications Skills, ability to provide and receive constructive feedback, willingness to participate in daily stand-ups, desire to learn new technologies and keep up to date with industry trends and technology advancements. #LI-SS1
