What are the responsibilities and job description for the Data & AI Solution Architect position at TVS Next?
What you’ll be doing:
You will design, develop, and implement technology and data solutions to meet current and future data warehousing and reporting needs. You will set the technical direction, establish best practices and partner with all consumers of data to build and support the company's data warehouse and the ETL platform. Your role will include the following:
- Design, build and support stable, scalable data pipelines or ETL processes that structure and integrate big data sets from multiple data sources into DW.
- Collaborate with product and other engineering teams on normalizing and aggregating large data sets based on business needs and requirements.
- Work with different data formats (JSON, CSV, Parquet, Avro) and interact with various on-premise and cloud data sources as well as RESTful APIs
- Establish, maintain and administer DW clusters and other data infrastructure.
- Implement systems for tracking data quality and consistency.
- Coach and mentor team members and promote team development and growth.
What we seek in you:
- 10 years of experience in a data warehousing role.
- Must have 2 years of experience in latest data warehouse systems.
- Experience in designing architecture and implemented the same.
- Strong experience with Data Modeling.
- Very strong SQL skills and experience.
- Knowledge and expertise in system performance and optimization, schema design and capacity planning.
- Proven ability to design, develop, and maintain data warehousing and ETL workflows for large data sets and interact with various sources.
- Working experience with Azure/ AWS.