Demo

Web Scraping Engineer

REPS & Company Inc.
San Diego, CA Full Time
POSTED ON 4/21/2025
AVAILABLE BEFORE 5/20/2025

Founded in 2017, REPS & Co. has rapidly become a leader in data analytics in the entertainment industry. Recognized on the Forbes list of America's Best Startup Employers, we focus on delivering advanced analytics that support data driven decisions. Our solutions provide comprehensive insights and forecasts, enabling us to have a better understanding and response to supply and demand in the ticketing world. With a commitment to driving innovation, REPS & Co. helps shape a dynamic market environment.

We are looking for an organized, experienced, and driven Senior Software Engineer. The Software Engineer will be responsible for delivering great code and pushing forward our software. We are focusing engineers to build teams with the right people and contribute to successful communication across the company. The ideal candidate for this position is a self-starter who can work well in a fast-paced environment. We are looking for creative problem solvers and diverse thinkers, people who care about culture as well as customers and features.

We believe that how we do things is as important as what we do. You are an inventive, industrious builder that loves all things technology and you are capable of on-time execution. Good strategic thinking, passion for quality, curiosity, and dedication in fun and collaboration are what lead to great results. Great products reflect the teams that build them.

The ideal candidate will be responsible for :

  • On-time delivery of quality software based on various cloud architecture
  • Willingness to collaborate with and mentor your teammates to help them do the same

Qualifications :

  • Scraping developer with over 4 years of experience as a backend software engineer, specializing in C#, Python, and Golang as primary languages. Proficient in JavaScript and TypeScript, with a strong ability to build and optimize robust data scraping solutions.
  • Successful experience with architectural patterns for large, high-scale web applications (well-designed API’s, high-volume pipelines, efficient algorithms) in cloud technologies.
  • Experience in working with a microservices architecture – including strong API design, management, and use, messaging and event-handling (i.e., SQS, SNS, Kafka), and consumable data patterns.
  • Experience coding to write to and read from relational data systems (MySQL, Postgres, Redshift, etc.)
  • In-memory data stores (Redis / Memcached) and NoSQL data systems (MongoDB / CouchDB).
  • Building DevOps (CI / CD) pipelines from code repositories (GitHub) and secure coding practices (OWASP and SANS).
  • Experience in building a platform and user experience that streams individualized, personalized content and that leverages repeatable, data-based patterns
  • Knowledge of Agile and Scrum principles and a willingness to hone your use of agile methods
  • Consistently deliver completed work independently but know how to work within your team to get help as needed
  • Strong team-oriented mindset with heavy focus on collaboration and mentorship
  • Strong communication and interpersonal skills (integrity, patience, empathy, etc.)
  • Technical Skills :

  • Experience in web scraping, leveraging both requests-based scrapers and browser automation. Experienced in bypassing various bot detection schemes
  • AWS Cloud components (Lambda / SAM (Serverless), Step Functions, SQS, SNS, RDS, Airflow, Glue, EC2, S3)
  • Relational Database design and development (preferably with experience handling high volumes of data – millions of records and up)
  • Strong Python experience (or strong C# with a willingness to work in Python, or both)
  • ReactJS
  • Strong experience with SDLC best practices
  • Troubleshooting / Performance tuning
  • Structured Agile experience
  • Availability to work Pacific Time Zone

    If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
    Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

    What is the career path for a Web Scraping Engineer?

    Sign up to receive alerts about other jobs on the Web Scraping Engineer career path by checking the boxes next to the positions that interest you.
    Income Estimation: 
    $140,233 - $181,029
    Income Estimation: 
    $164,835 - $201,088
    Income Estimation: 
    $135,994 - $168,063
    Income Estimation: 
    $161,209 - $233,553
    Income Estimation: 
    $146,673 - $180,130
    Income Estimation: 
    $176,149 - $220,529
    Income Estimation: 
    $77,657 - $95,021
    Income Estimation: 
    $97,257 - $120,701
    Income Estimation: 
    $97,257 - $120,701
    Income Estimation: 
    $123,167 - $152,295
    Income Estimation: 
    $123,167 - $152,295
    Income Estimation: 
    $146,673 - $180,130
    View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

    Job openings at REPS & Company Inc.

    REPS & Company Inc.
    Hired Organization Address Seattle, WA Full Time
    Founded in 2017, REPS & Co. has rapidly become a leader in data analytics in the entertainment industry. Recognized on t...
    REPS & Company Inc.
    Hired Organization Address Washington, DC Full Time
    Founded in 2017, REPS & Co. has rapidly become a leader in data analytics in the entertainment industry. Recognized on t...
    REPS & Company Inc.
    Hired Organization Address Harrisburg, PA Full Time
    Founded in 2017, REPS & Co. has rapidly become a leader in data analytics in the entertainment industry. Recognized on t...
    REPS & Company Inc.
    Hired Organization Address San Diego, CA Full Time
    Founded in 2017, REPS & Co. has rapidly become a leader in data analytics in the entertainment industry. Recognized on t...

    Not the job you're looking for? Here are some other Web Scraping Engineer jobs in the San Diego, CA area that may be a better fit.

    Web Engineer

    Apple, San Diego, CA

    AI Assistant is available now!

    Feel free to start your new journey!