Sr Reliability Engineer

Pennymac (NYSE: PFSI) is a specialty financial services firm with a comprehensive mortgage platform and integrated business focused on the production and servicing of U.S. mortgage loans and the management of investments related to the U.S. mortgage market. 

At Pennymac, our people are the foundation of our success and at the heart of our dynamic work culture. Together, we work towards a unified goal of helping millions of Americans achieve aspirations of homeownership through the complete mortgage journey.

The Senior Reliability Engineer will analyze system performance and reliability challenges, collaborating with engineering teams to develop and implement solutions that ensure high availability, scalability, and optimal performance in alignment with business objectives. As a Senior Reliability Engineer, you'll play a key role in developing and implementing testing strategies, performance monitoring, and telemetry solutions across a range of projects. You'll collaborate closely with development teams to identify and address potential issues, ensuring our systems are robust, scalable, and performant.

The Senior Reliability Engineer will:

• Design and develop backend services and tools using serverless functions, TypeScript, and AWS services. This includes creating RESTful APIs, event-driven architectures, and data processing pipelines.
• Write high-quality, testable code with comprehensive unit and integration tests. Ensure code quality through static analysis, code reviews, and adherence to coding standards.
• Implement end-to-end, load, and performance tests to validate system functionality, scalability, and reliability. Utilize testing frameworks and tools like Jest, Cypress, Artillery, Playwright, or Selenium. Automate testing processes to ensure continuous quality assurance.
• Develop and maintain telemetry systems for collecting, analyzing, and visualizing performance data across all systems. This includes integrating with logging and monitoring tools, and building observability dashboards.
• Configure monitoring and alerting tools to proactively identify and address performance issues and system anomalies. Define and measure key performance indicators (KPIs) and service level objectives (SLOs).
• Collaborate with development teams to promote best practices for building observable and reliable systems. Provide guidance on instrumentation, logging, and performance optimization techniques.
• Stay up-to-date with the latest serverless technologies, testing frameworks, and observability tools. Continuously improve skills and knowledge in relevant areas.
• Participate in incident response and post-mortem analysis to identify root causes and implement preventive measures. Contribute to a culture of continuous improvement and learning.

• Embody and promote the organization's desired culture and values, fostering a positive and collaborative work environment.
• Take ownership of identifying and mitigating technical risks that impact system reliability. Collaborate with engineering teams to define and manage the scope of reliability-focused projects.

• Bachelor’s degree or equivalent work experience
• You will have experience developing scripts and tools
• Experience debugging problems in a highly concurrent environment
• 5 years experience working with IT leadership to create technical strategies and with senior IT groups in an advisory role
• Expertise in multiple technologies such as Typescript and Python across software engineering, security, data interchange, data management, etc.
• Must have experience in developing Enterprise level applications using Microservice architecture in the cloud, testing and observability
• Should be highly skilled in testing frameworks like Selenium, Playwright, etc as well as telemetry tools such as OpenTelemetry, Zipkin, New Relic (APM), etc
• Must have worked in a multi-developer/multi-site environment with multi-site management experience

As one of the top mortgage lenders in the country, Pennymac has helped over 4 million lifetime homeowners achieve and sustain their aspirations of home. Our vision is to be the most trusted partner for home. Together, 4,000 Pennymac team members across the country are guided by our core values: to be Accountable, Reliable and Ethical in all that we do. 

Pennymac is committed to conducting a business that makes positive contributions and promotes long-term sustainable growth and to fostering an equitable and inclusive environment, where all employees and customers feel valued, respected and supported. 

Benefits That Bring It Home: Whether you're looking for flexible benefits for today, setting up short-term goals for tomorrow, or planning for long-term success and retirement, Pennymac's benefits have you covered. Some key benefits include: 

• Comprehensive Medical, Dental, and Vision
• Paid Time Off Programs including vacation, holidays, illness, and parental leave 
• Wellness Programs, Employee Recognition Programs, and onsite gyms and cafe style dining (select locations)
• Retirement benefits, life insurance, 401k match, and tuition reimbursement 
• Philanthropy Programs including matching gifts, volunteer grants, charitable grants and corporate sponsorships

To learn more about our benefits visit: https://pennymacnews.page.link/benefits

Compensation: Individual salary may vary based on multiple factors including specific role, geographic location / market data, and skills and experience as defined below:

• Lower in range - Building skills and experience in the role
• Mid-range - Experience and skills align with proficiency in the role 
• Higher in range - Experience and skills add value above typical requirements of the role 

Some roles may be eligible for performance-based compensation and/or stock-based incentives awarded to employees based on company and individual performance. 

Salary : $90,000 - $150,000