What are the responsibilities and job description for the AWS Python Developer position at Largeton Group?
Job Summary
- Provides advice to top management on significant engineering matters.
- Designs and develops an enterprise data warehouse and data lake.
- Manages complex processes that impact the greater organization.
- Uses methods, processes, tools, and analyses to find relationships and patterns in large amounts of data.
- May lead or manage large projects.
- Delivers an environment that enables strategic decision-making capabilities across the enterprise via analytics and reporting.
- Requires a Bachelor's degree.
- Must have 8 years of diverse Technology experience and minimum 5 years of experience in Software development.
- Experience with AWS capabilities such as Glue, DynamoDB, Lambda, Redshift, and elastic search is necessary.
- Requires proficiency in API and Terraforms, Python, PySpark, Apache Spark, SQL, relational and non-relational databases, query optimization, and data modelling.
- Experience with GitHub, Jenkins, Terraform, Teradata (Vantage) or any RDBMS system/ETL Tools is necessary.
- Good experience on designing and developing data pipelines for data ingestion and transformation using Spark.
- Should be excellent in troubleshooting performance and data skew issues.
- Working knowledge on the implementation of data lake ETL using AWS glue, Databricks etc. is required.
- Must have experience with large scale distributed relational and NoSQL database systems.
- Excellent communication skills are required.
- Must be able to provide recommendations and design optimal configurations for large-scale deployments.
- Requires experience in Healthcare and with Data & Analytics.
- Qualification required is Bachelor of Engineering.