What are the responsibilities and job description for the Data Warehouse Engineer position at AdientOne LLC?
Job Details
Role: Data Warehouse Engineer
Location: Austin TX 78735 - Hybrid (Onsite 3 days a week).
Duration: 12 months
Job Description: Team are currently seeking a highly skilled Data Warehouse Engineer to join our dynamic team. The ideal candidate will be instrumental in designing and implementing robust data pipelines, ensuring the integrity and accessibility of data across our organization.
Top 3 skills:
- Databricks Data Warehouse and a solid understanding of data warehousing principles
- Develop and maintain scalable ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) processes
- Programming skills in languages such as Python, SQL, Scala, or Java
Responsibilities:
- Design, build, and maintain efficient and reliable data pipelines to move and transform data (both large and small amounts) within our Azure ecosystem.
- Work closely with Azure Data Lake Storage, Azure Databricks, and Azure Data Explorer to manage and optimize data processes.
- Develop and maintain scalable ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) processes.
- Ensure the seamless integration and compatibility of data solutions with Databricks Unity Catalog Data Warehouse and adhere to general data warehousing principles.
- Collaborate with data scientists, analysts, and other stakeholders to support data-centric needs.
- Implement data governance and quality processes, ensuring data integrity and compliance.
- Optimize data flow and collection for cross-functional teams.
- Provide technical leadership and mentorship to junior team members.
- Stay current with industry trends and developments in data architecture and processing.
Requirements:
- Bachelor's or master's degree in computer science, Engineering, or a related field.
- Minimum of 5 years of experience in a Data Engineering role.
- Strong expertise in the Azure data ecosystem, including Azure Data Lake Storage, Azure Databricks, and Azure Data Explorer.
- Proficient in Databricks Data Warehouse and a solid understanding of data warehousing principles.
- Experience with ETL and ELT processes and tools.
- Strong programming skills in languages such as Python, SQL, Scala, or Java.
- Experience with data modeling, data access, and data storage techniques.
- Ability to work in a fast-paced environment and manage multiple projects simultaneously.
- Excellent problem-solving skills and attention to detail.
- Strong communication and teamwork skills.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
