What are the responsibilities and job description for the Senior Data Engineer position at Arturo?
Job Description
What you'll do :
Onboard new geospatial datasets into our systems : imagery, parcels, extracted polygons, and build ETL pipelines to automate these processes
Manage the interface between our AI systems and the input data they need to operate via streaming systems, storage systems, and caching systems
Be aware of, and manage 3rd party provider rate limits, and architect our systems to gracefully deal with these limits while maximizing our throughput
Participate in an agile product development process, where collaboration with stakeholders is a vital step to building what is needed
Challenge and be challenged on a diverse, collaborative, and brilliant team
Write automated test suites to ensure the quality of your code
Contribute to open-source geospatial software
Build solutions that enable new products typically involving large scale or intricate geospatial techniques
Build-in system quality from the beginning by writing unit & integration tests and integrating with logging, metrics, and observability systems
Requirements
What you bring :
Good to Expert level understanding of geospatial systems, concepts, patterns, and software, including both legacy formats and software, as well as the hottest newest open-source packages and tools
Professional experience writing production-ready Python code that leverages modern software development best practices (automated testing, CICD, observability)
Experience working on a team of developers, maintaining a shared codebase, and having your code reviewed before merging
Strong DB Expertise in an Amazon environment (RDS, Postgres, and DynamoDB)
Strong ETL Experience (especially in extraction and ingestion of 3rd party data)
Nice-to-haves :
Familiarity with machine learning concepts
Familiarity with asynchronous programming
Benefits
Key competencies at Arturo :
Willingness to learn - You have an insatiable desire to continue growing, a fearless approach to the unknown, and love a challenge
Teamwork / Collaboration - You like working with others; you participate actively and enjoy sharing the responsibilities and rewards. You pro-actively work to strengthen our team. And you definitely have a sense of humor
Critical Thinking - You incorporate analysis, interpretation, inference, explanation, self-regulation, open-mindedness, and problem-solving in everything you do
Drive for Results - You keep looking forward, solve problems and participate in the success of our growing organization
Keep a pulse on the job market with advanced job matching technology.
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution.
Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right.
Surveys & Data Sets
What is the career path for a Senior Data Engineer?
Sign up to receive alerts about other jobs on the Senior Data Engineer career path by checking the boxes next to the positions that interest you.
