What are the responsibilities and job description for the Data Engineer position at Golden Technology?
Our client is looking for a Data Engineer to join their team! In this role, you will help the client move their data systems from on-premises to the cloud, specifically using Snowflake and Azure. You will work closely with the client to plan and carry out a smooth transition, making sure their data is securely and efficiently moved to the cloud. Your skills in data modeling, advanced SQL, and cloud tools like Databricks, Azure Data Factory, and Azure Functions will be key to overcoming any challenges during the migration. You'll also be involved in developing APIs to support the new cloud environment. Additionally, your ability to communicate clearly and lead projects will ensure that everyone involved understands the process and that the migration meets the client's needs.
Top skills you need to have :
- A minimum of 7 years of hands-on experience in designing, configuring, implementing, and migrating data for medium to large enterprise data platforms.
- Proficiency in data modeling and advanced SQL.
- Extensive experience with cloud migration processes and tools, such as Snowflake, Fivetran, dbt, Azure Data Factory, Azure Functions, and other Azure data services.
- Mastery of Advanced SQL, Python, Snowflake cloud data warehousing.
- Skilled in working with diverse data file formats, including Avro, JSON, XML, and CSV
- Strong understanding of data warehousing (specifically working with Kimball-style dimensional models), data architecture, data quality processes, and database design, both logical and physical.
- Proven ability to design and implement data ingestion processes for both structured and unstructured data.
- Expertise in developing data cleansing routines using standard data operations.
- Comprehensive knowledge of data management, including master data, metadata standards, and associated processes.
- Proficient in using Azure DevOps / GitHub Actions for CI / CD pipeline deployment.
- Microsoft Azure certifications are highly desirable. Core Technologies :
- Snowflake
- Azure Functions
- Python
- SQL Server
- SSIS
- Fivetran
- Azure Data Factory
- Azure DevOps
- GitHub / GitHub Actions
- T-SQL and SQL stored procedures
- Azure Log Analytics
- Azure Data Lake Storage
About Golden Technology
Golden Technology was founded in 1997 with the goal of developing people and driving innovation. In other words, our aim is to pair world-class technologists like you with amazing companies that are doing impactful work.
After an initially slow start, and way too many late nights playing Final Fantasy 7, Golden Technology built a unique recruiting engine that would quickly prove itself to deliver top-tiered talent to fortune 500 clients across the US, time and time again.
Golden Technology has built a culture around family and helping the people we touch succeed in both their work and personal lives. Oh, everyone says that? Try us, you'll see it.
We're helping people find their calling and their dream jobs; and through our Golden Community initiatives we are actively working to improve the communities in which we work, live, and play.
