What are the responsibilities and job description for the Sr. DataTransformation Engineer position at IrisLogic, Inc?
Job Details
Strong programming skills in Snowflake, Python, AirFlow, DBT, Linux
- Strong server-side programming experience with automation and backend support.
- Experience with Snowflake.
- VERY IMPORTANT SKILL- Strong skills in working with Opensource technologies, Database technologies, micro service architecture, cloud-native development, continuous build, continuous integration and continuous deployment.
- Ability to work effectively with end users to define requirements.
- Experience designing and building cloud-native applications using microservices architecture.
- Hands-On experience with Kafka and overall use for developing an Event driven architecture model
- Experience in Domain Driven Design.
- Experience with continuous integration and collaboration tools like JIRA, Bitbucket, GitHub, and Confluence.
- Experience with building Data pipelines to Snowflake.
Specific Technical Responsibilities:
- Overall (applies to all technology platforms listed below):
- Provide production support for several data analytics solutions used every day
- Ability to perform as a technical lead in addition to being a contributing developer
- Code review of other teams members
- Create and enhance data architecture models
- Ability to troubleshoot and identify root causes for a variety of production and data issues
Snowflake:
- Data transformation (ETL)
- Write Snowflake SQL including stored procedures and complex queries involving CTEs and temp tables
- Help design data models for new data to be ingested
- Snowflake SQL performance tuning
- Help complete migration of existing SQL Server based Data Vault into Snowflake
- Continue to support and work on future enhancements for Snowflake Data Vault
- Data ingestion (familiarity with Python and Kafka connectors is a nice to have but not necessarily required)
- Python/Linux
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.