People Data Labs (PDL) is the provider of people and company data. We do the heavy lifting of data collection and standardization so our customers can focus on building and scaling innovative, compliant data solutions. Our sole focus is on building the best data available by integrating thousands of compliantly sourced datasets into a single, developer-friendly source of truth. Leading companies across the world use PDL’s workforce data to enrich recruiting platforms, power AI models, create custom audiences, and more.
In order to make an application, simply read through the following job description and make sure to attach relevant documents.
We’re looking for an experienced software engineer to join our expanding platform team. You will be crucial in accelerating our efforts to build standalone data products that enable data teams and independent developers to create innovative solutions at massive scale. In this role, you will be working with a team defining tools and infrastructure that facilitates big data processing, primarily within AWS.
Roles & Responsibilities
- Manage and improve our growing AWS and data center infrastructures
- Design, implement and maintain a CI / CD pipeline to improve developer workflows
- Utilize centralized monitoring and logging to improve visibility across the team
- Assist development teams in solving issues around scaling and bottlenecks
- Manage AWS services, costs, security and workflows
- Work with teammates to develop high-quality software, balancing security, reliability, and operational concerns
Technical Requirements
5-7 years software development experience with a background in platform or cloud infrastructure engineering and clear examples of strategic technical problem-solving and implementation3 years of experience with Python in a production environmentStrong software development fundamentals and system design experienceStrong experience with our core technologies (AWS, ElasticSearch / OpenSearch, Python, Docker, scaled data processing technologies)AWS, including EC2, Lambda, OpenSearch, API Gateway, ALB, othersExperience with Infrastructure-as-code (IaC) frameworks (e.g. Pulumi, terraform, cloud formation or similar)Experience with network design, including public / private availability, routing, firewalls / security groups and VPNExperience with Identity and Access ManagementExperience with configuration management tools (e.g. Chef, Puppet, Ansible, etc)Experience with observability tools such as Datadog for metrics, logging, etcExperience with build and deploy systems, architecting and developing CI / CD infrastructure, repo management, and integrating with tools like Github Actions (or similar)Experience managing hybrid environments split between local datacenters and AWS; experience managing bare metal / co-location infrastructureProfessional Requirements
Can thrive in a fast-paced environment and be able to work independentlyCan work effectively remotely (able to be proactive about managing blockers, proactive on reaching out and asking questions, and participating in team activities)Strong written communication skills on Slack and in documentationYou are experienced in writing design docs (pipeline design, dataflow, schema design, engineering requirements)You are experienced in translating technical design documents into projects, milestones, and backlogsYou can scope and break down projects, communicate and collaborate progress and blockers effectively with your manager, team, and stakeholdersStrong understanding of agile engineering practicesNice To Haves
Degree in a quantitative discipline such as computer science, mathematics, statistics, or engineeringExpertise with Apache Spark (Java, Scala, and / or Python-based)Experience with SQL Data Pipeline DevelopmentExperience supporting developer-oriented data pipeline and workflow orchestration (e.g., Airflow (preferred), dbt, dagster or similar)Experience with managing, deploying, and ensuring the reliability of streaming platforms (e.g., Kafka)Experience evaluating data quality and maintaining consistently high standards across new feature releases (e.g., consistency, accuracy, validity, completeness)Experience using Databricks or similar data-development platformsGreat people make great teams. We believe in building highly functional, energetic, and engaging teams to serve our customers. People, Customers, Shareholders, in that order, sets us up for success and delivering on our promises.
StockUnlimited paid time offHealth, fitness, and office stipendsThe permanent ability to work wherever and however you wantSalary : $160K - $180K
J-18808-Ljbffr
Salary : $160,000 - $180,000
