Bigdata Architect with Pyspark _W2

No C2C/ Third-party resumes, this role is open only on W2

Must Have: Python, Pyspark, AWS, transformations exp

Nice to have: Databricks, Data Lake, Big Data transformations, snowflake

Team is on a AWS modernization Journey using Data Lake

• Job Description:
• Proficient in application development skills for more than one technology as well as multiple design techniques
• Working proficiency in development toolset to design, develop, test, deploy, maintain and improve software
• Strong understanding of Agile methodologies with ability to work in at least one of the common frameworks
• Strong understanding of techniques such as Continuous Integration, Continuous Delivery, Test Driven Development, Cloud Development, application resiliency and security
• Proficiency in one or more general purpose programming languages
• Working proficiency in a portion of software engineering disciplines and demonstrates understanding of overall software skills including business analysis, development, testing, deployment, maintenance and improvement of software

Roles and Responsibilities:

• 5 plus years of professional work experience designing and implementing data pipelines in a cloud environment is required.
• 2 plus years of experience migrating/developing data solutions in the AWS cloud is required.
• 1 plus years of experience building/implementing data pipelines using Databricks or similar cloud database.
• Expert level knowledge of using SQL to write complex, highly-optimized queries across large volumes of data.
• Hands-on object-oriented programming experience using Python is required.
• Professional work experience building real-time data streams using Spark and Experience in Spark.
• Knowledge or experience in architectural best practices in building data lakes"