What are the responsibilities and job description for the Python Data Engineer position at AT&M Consulting LLC?
Role Description
This is a full-time Python Data Engineer role at AT&M Consulting LLC located in Phoenix, AZ. As a Python Data Engineer, you will be responsible to build scalable data pipelines which are capable of extracting, transforming, loading, engineering, and maintaining a scalable data ware house. You will work on integrating data from multiple sources, ensuring data consistency, creating data pipelines, developing data analytics, performing transformation of data to drive business use cases efficiently.
Qualifications
- 6 years of experience in Data Engineering with an emphasis on building scalable data Warehousing platform and perform Data Analytics.
- 4 years of experience with Python with working knowledge on Notebooks.
- 4 years of experience in design and build of salable data pipelines that deal with extraction, transformation, and loading.
- 4 years of experience with one of the leading public cloud
- 2 years hands on experience on GCP Cloud data implementation projects (Dataflow, DataProc, Cloud Composer, Big Query, Cloud Storage, GKE, Airflow, etc.).
- 2 years of experience with Kafka, Pub / Sub, Docker, Kubernetes
- Architecture design and documentation experience of 2 years
- Troubleshoot, optimize data platform capabilities
- Ability to work independently, solve problems, update the stake holders.
- Analyze, design, develop and deploy solutions as per business requirements.
- Strong understanding of relational and dimensional data modeling.
- Experience in DevOps and CI / CD related technologies.
- Excellent written, verbal communication skills, including experience in technical documentation and ability to communicate with senior business managers and executives.
