Role: Data Engineer-PySpark, SQL
Location: Minneapolis, MN (Onsite)
Duration: Fulltime
Primary Skills: PySpark, Azure DataFactory, Databricks, SQL
Secondary Skills: DBT, Snowflake
Role Responsibility

• Data Engineer with 8 years of experience
• Must have good experience in pyspark programming and SQL scripting
• Translate business requirement document, functional specification, and technical specification to related coding
• Must have data migration experience using tools like Azure Datafactory and Databricks
• Must have data pipeline creation on Azure Databricks data processing engine
• Must have good experience in complex sql scripts and stored procedures
• Develop efficient code with unit testing and code documentation
• Ensuring accuracy and integrity of data and applications through analysis, coding, documenting, testing, and problem solving
• Setting up the development environment and configuration of the development tools
• Manage, monitor, and ensure the security and privacy of data to satisfy business needs
• Contribute to the automation of modules, wherever required
• To be proficient in written, verbal and presentation communication (English)
• Co-ordinating with the UAT team