What are the responsibilities and job description for the Technical Lead / Senior Data Engineer position at CAYS Inc?
Job Details
Technical Lead with Expert knowledge in Snowflake and DBT. And need to lead the team (onshore - offshore), Majority of the work will be in DBT as an individual contributor and need to automate the tasks and workflows using DBT
Job Description:
- 10 years' experience working on cloud data warehouses and data pipelines with a focus on data engineering, building scalable, sustainable and secure data platforms powering intelligent applications.
- Advanced experience in a Data Engineering or ELT Engineering role.
- Expert-level proficiency in SQL query and stored procedure development.
- Good knowledge of Data Modeling and Designing Architecture diagrams as per requirement.
- Advanced SQL knowledge, including writing complex queries, optimizing performance, and working with large datasets.
- Excellent experience with snowflakes and DBT
- Competent with Python, Airflow, GitHub and DAG construction.
- Experience with unstructured datasets and ability to handle Parquet, JSON, AVRO and XML file formats
- Strong understanding of CI/CD principles, DevOps practices, software testing and quality
- Hands-on Experience with cloud-based data engineering and storage technologies such as AWS and orchestration tools such as Apache Airflow Astronomer.
- Advanced experience implementing data quality initiatives, monitoring, and auditing.
- Oversee the design and development of interactive and engaging data visualizations and report using tools such as Looker, Tableau, Power BI, or custom visualization libraries.
- Ensure adherence to best practices, including principles of clarity, accuracy, governance, and effectiveness.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.