What are the responsibilities and job description for the Senior Data Engineer position at Estrada Consulting, Inc?
Minimum Mandatory Qualifications
SENIOR DATA ENGINEER:
Estrada Consulting, Inc. (ECI) delivers technology-enabled services and solutions to clients all over the USA and British Columbia. We provide system integration, custom application development, data warehouse and business intelligence, project management, custom reporting solutions and consulting services to mid-size and large enterprises in all major industries. The Company headquarters is in Sacramento, California, and was established in year 2000. Visit http://www.estradaci.com/ to learn about our projects, managed services, awards and certifications delivering value for a range of businesses and government agencies.
SENIOR DATA ENGINEER:
- A minimum of four (4) years of experience, in developing and monitoring data pipelines, ETL/ELT (Extract Transform Load / Extract Load Transform).
- A minimum of five (5) years of experience developing in SQL and one (1) year of experience translating between different versions of SQL.
- A minimum of five (5) years of experience developing with ETL Tools including SSIS, SAS DI Studio, and AWS Glue, and Lambda.
- A minimum of five (5) years of experience developing Rest APIs, including experience with JSON, C#, and Python.
- A minimum of three (3) years of experience, in database design, database development, and database security.
- A minimum of three (3) years of experience, working as a lead with data conversion and migration efforts involving legacy data formats and legacy data repositories such as IBM Mainframe.
- A minimum of three (3) years of experience with Microsoft Visual Studio and Git Code Repositories.
- A minimum of three (3) years of experience with Cloud Technologies in in AWS (e.g. glue and lambda) and Snowflake.
- A minimum of five (5) years of experience working on a large-scale modernization project involving data conversion and migration projects over $50 million in budget, designing and creating raw, integration, and presentation layers.
- A minimum of three (3) year experience working with Unemployment Insurance and Disability Insurance data.
- A minimum of three (3) years of experience designing and optimizing data warehouses and data lakes.
- A minimum of three (3) years of experience with Terraform, Kubernetes, Docker, and CI/CD pipelines.
- A minimum of three (3) years of experience in automating workflows and data pipelines.
- A minimum of three (3) years of experience in identifying bugs and bottlenecks. Identifying poor performance and optimize ELT/ETL pipeline.
- A minimum of three (3) years of experience working with JSON, API, CSV, SQL and Parquet files.
- *Bachelor’s degree in computer science, engineering, information systems, math or a technology related field. Additional qualifying experience may be substituted for the required education on a year-for-year basis.
- Six (6) or more years of experience in developing and monitoring data pipelines, ETL/ELT (Extract Transform Load / Extract Load Transform).
- Seven (7) or more years of experience developing in SQL and three (3) or more years of experience translating between different versions of SQL.
- Seven (7) or more years of experience developing with ETL Tools including SSIS, SAS DI Studio, and AWS, Glue, and Lambda.
- Seven (7) or more years of experience developing Rest APIs, including experience with JSON, C#, and Python.
- Five (5) or more years of experience in database design, database development, and database security.
- Five (5) or more years of experience working as a lead with data conversion and migration efforts involving legacy data formats and legacy data repositories such as IBM Mainframe.
- Five (5) or more years of experience with Microsoft Visual Studio and Git Code Repositories.
- Five (5) or more years of experience with Cloud Technologies in AWS (e.g. glue and lambda) and Snowflake
- Seven (7) or more years of experience working on large scale modernization projects involving data conversion and migration projects over $50 million in budget, designing and creating raw, integration, and presentation layers.
- Seven (7) or more years of experience working with Unemployment Insurance and Disability Insurance data.
- Five (5) or more years of experience designing and optimizing data warehouses and data lakes
- Five (5) or more years of experience with Terraform, Kubernetes, Docker, and CI/CD pipelines.
- Five (5) or more years of experience in automating workflows and data pipelines.
- Five (5) or more years of experience in identifying bugs and bottlenecks. Identifying poor performance and optimize ELT/ETL pipeline.
- Five (5) of more years of experience working with JSON, API, CSV, SQL and Parquet files.
- *Master's degree in computer science, engineering, information systems, math or a technology related field. Additional qualifying experience may be substituted for the required education on a year-for-year basis.
Estrada Consulting, Inc. (ECI) delivers technology-enabled services and solutions to clients all over the USA and British Columbia. We provide system integration, custom application development, data warehouse and business intelligence, project management, custom reporting solutions and consulting services to mid-size and large enterprises in all major industries. The Company headquarters is in Sacramento, California, and was established in year 2000. Visit http://www.estradaci.com/ to learn about our projects, managed services, awards and certifications delivering value for a range of businesses and government agencies.