What are the responsibilities and job description for the Lead Software Engineer, Data Platform position at Balyasny Asset Management L.P.?
The Lead Software Engineer will be at the forefront of a small data platform team tasked with expanding the core components and APIs that BAM's engineers, analysts and researchers depend on for managing and accessing data.
The team sits as part of Core Data Platform, who manage the firms databases, warehouses, ETL and analytics systems, as well as a number of APIs that sit on top of those foundations.
Operating in a cloud-native, Kubernetes-based ecosystem, the team will focus on supporting existing data access APIs, a firmwide message bus, expanding data streaming architecture, building out new consolidated data access APIs on top of Iceberg and generally working to compose together a broad set of modern open source technologies to build a best-in-class data and analytics platform
.
We are seeking a visionary player-coach who is passionate about crafting high-quality software, thrives on working with data in all its forms, and possesses intense drive to advance initiatives and achieve results. We are looking for leaders who are highly collaborative and who are excited to build products in partnership with stakeholder teams. We expect leads to bring ambitious vision for what a modern data platform can be as well as deep industry/open source awareness and engagement. Advocating for and championing the latest technologies is in your DN
A.
Responsibilities of the Lead Software Engineer inclu
- de:Devising and developing solutions that capitalize on cloud-based data and distributed computing technologies, and a deep intuition on the open-source data ecosyst
- em.Consulting with users of SDKs, APIs and Open source tools that we offer to improve the developer experience and assist them with best practi
- cesPartnering with end-users and collaborating with team members to clarify and expand upon requirements, as well as providing occasional first-level suppo
- rt.Employing creativity and lateral thinking to engineer high-performance solutions for loading and serving vast quantities of investment da
- ta.Working within a tightly-knit engineering team, deeply contributing to technical design discussions, code reviews, and overall team engageme
- nt.Producing software systems that are robust, well designed, rigorously tested, and meticulously document
- ed.Mentoring and leading a small, skilled team of software enginee
- rs.Collaborating with leadership and stakeholders to plan future features and define the product roadm
ap.
QUALIFICATIONS AND REQUIREME
- NTS:A degree in Computer Science or a closely related fi
- eld.Over 8 years of professional software development experience. Experience in the financial industry is a p
- lus.Extensive software development experience in at least 2 object oriented programming languages - one must be Python or Go
- langA fervent desire to build robust data platfo
- rms.Profound knowledge of software engineering best practices, object-oriented principles, and the intricacies of data-centric developm
- ent.Advanced knowledge of SQL both OLAP and OLTP database sys
- temsExperience with Data Lakes, with Iceberg familiarity a p
- lus.Deep understanding of ETL and orchestration technologies. Familiarity with catalogs and metadata management a p
- lus.Advanced knowledge of streaming systems including kafka and fl
- ink.Deep understanding of managing applications and infrastructure in cloud environments and strong experience with Kuberne
- tes.Familiarity with fundamental DevOps practices, including continuous integration/continuous deployment (CI/CD) and infrastructure as c
- ode.Experience in at least one cloud environment, with a preference for those familiar with
- AWS.A self-starter mindset, with a penchant for experimentation, a habit of asking probing questions, and the ability to thrive in a fast-paced, agile sett
- ing.A continuous learner, eager to gain a comprehensive understanding of large and complex systems at every level, who enjoys delving into nuanced problems, conceiving innovative solutions, and conducting thorough tests to grasp both the positive and negative outco