What are the responsibilities and job description for the Applications Engineer 3 position at HireTalent?
Job Title : AWS Senior Data Engineer
Duration : Months
Location : Remote
Job Description : Job Duties :
Develop and support data solutions in support of Sustainability reporting and analytics requirements
Engage with product owner, technology lead, report developers, product analysts, and business partners to understand capability requirements and develop data solutions based on product backlog priorities
Skills / Qualifications :
- years of experience with data engineering with emphasis on data analytics and reporting
Expert level experience with Python which demonstrate :
Proficiency authoring distributable packages
Proficiency authoring and automating unit tests using tools such as tox and pytest, preferably within a CI pipeline
Proficiency enforcing code-quality and formatting consistency using tools such as mypy, flake, and black
Expert level SQL abilities
Experience developing with Spark, preferably leveraging AWS EMR managed service
Experience with AWS data engineering services, resources and architecture
Experience working with source-code management tools such as GitHub and Jenkins
Knowledge of agile delivery methodologies– Scrum, SAFe, Extreme Programming
Understanding of microservices architecture and REST APIs
Ability to partner with business and technology team members, to understand business requirements and translate those into value-add technology solutions
Additional preferences are :
Experience with SQLAlchemy
Experience with Apache Kafka
Experience developing API clients
Python examples demonstrated in publicly visible source code repositories
Experience developing solutions in Snowflake
Experience with workload automation tools such as Airflow, Autosys.
Knowledge of building solutions with data visualization and reporting tools ( Tableau, Metabase)
Must haves :
Expert level in Python & SQL