What are the responsibilities and job description for the Lead Data Engineer - R01549424 position at Brillio?
About Brillio:
Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through innovative digital adoption. Brillio, renowned for its world-class professionals, referred to as "Brillians", distinguishes itself through their capacity to seamlessly integrate cutting-edge digital and design thinking skills with an unwavering dedication to client satisfaction.
Brillio takes pride in its status as an employer of choice, consistently attracting the most exceptional and talented individuals due to its unwavering emphasis on contemporary, groundbreaking technologies, and exclusive digital projects. Brillio's relentless commitment to providing an exceptional experience to its Brillians and nurturing their full potential consistently garners them the Great Place to Work® certification year after year.
Lead Data Engineer
\n- ETL Fundamentals, SQL, SQL (Basic Advanced), Python, Data Warehousing, Modern Data Platform Fundamentals, Data Modelling Fundamentals, PLSQL, T-SQL, Stored Procedures
- Data Engineer
- St. Louis, MO
- Hybrid
- Develop Ingestion process to source data from various type of sources like flat files, databases, json etc to consume in Databricks.
- Develop ETL PySpark code in Databricks to build reporting layer tables for PowerBI and follow the best practices.
- Utilize GitHub to maintain the code inventory and work with the team in terms of testing and deployment
- Utilize Jenkins for CICD and follow the code standards in terms of parametrization, scheduling jobs, email notifications through the terraform scripts.
- Develop reports on PowerBI based on the business and process improvement needs.
- As part of the Agile team attend the regular scrum calls to provide updates and plan and own the work as part of sprint refinement and planning.
- Work with Tech leads for code review and design meetings.
- Good communication
- 8 years of relevant experience .
Know what it’s like to work and grow at Brillio: Click here
Salary : $120,000 - $1,350,000
