What are the responsibilities and job description for the Data Engineer II, North America Transportation Services position at Amazon?
DESCRIPTION
At Amazon, we are committed to being the most customer-centric company on earth. The North American Transportation Services (NATS) team at Amazon is comprised of high-powered dynamic teams that are shaping network planning and execution through the development and application of innovative transportation and delivery management concepts.
NATS Transportation Planning team is looking for a customer-focused, detail-oriented, experienced Data Engineer II to help us build an enterprise grade data lake with the latest AWS data services. This role is inherently cross-functional—this leader will work closely with business intelligence engineers, data scientists, software engineers, program management, design, operations, finance, legal, business development, customer service, and executive teams to support analytical framework with efficient data pipelines. As a Data Engineer, you will be responsible for architecture and engineering of data infrastructure across our systems of transportation planning, development, production and test. You will provide analytical support by managing data store, develop and track key performance indicators and help make data driven program decisions. This role will be designing and developing ingestion of data that will provide insights into our business health.
Key job responsibilities
- Design, implement and maintain data infrastructure including data modeling, ETL pipelines, and ongoing maintenance.
- Partner with product, operational, and technical teams to build data pipelines from a wide variety of sources using AWS big data technologies (Lake Formation, Glue, S3, MWAA, Lambda, etc.).
- Able to read, write, and debug data processing and orchestration code written in Python/Scala etc following best coding standards (e.g. version controlled, code reviewed, etc.)
- Build a data dictionary, catalog and governance plan and manage and audit all of the registered data via mechanisms.
- Work with data consumers to provide and correlate the right data for business intelligence and machine learning use-cases.
- Develop automated solutions to minimize manual processes with focus on efficiency and scalability.
- Provide guidance on data stewardship for teams onboarding to the central data systems.
BASIC QUALIFICATIONS
- 5 years of data engineering experience
- Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets
- Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
- Experience with modern SQL data orchestration tools like DBT, Mode, and Airflow
PREFERRED QUALIFICATIONS
- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
- Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)
- Excellent at creating and maintaining working relationships across all levels and disciplines, receptive to feedback and input from others, and quick to apply changes.
- Proven experience as a Data Engineer with a track record of building data solutions from the ground up
Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $118,900/year in our lowest geographic market up to $205,600/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit https://www.aboutamazon.com/workplace/employee-benefits. This position will remain posted until filled. Applicants should apply via our internal or external career site.
Salary : $118,900 - $205,600
