What are the responsibilities and job description for the Senior Data Engineer - GCP, BigQuery & CI/CD Implementation position at Artmac?
Who We Are
Artmac Soft is a technology consulting and service-oriented IT company dedicated to providing innovative technology solutions and services to Customers.
Job Description
Job Title : Senior Data Engineer - GCP, BigQuery & CI/CD Implementation
Job Type : W2
Experience : 8-10 Years
Location : Chicago, Illinois
Technical Skills
Artmac Soft is a technology consulting and service-oriented IT company dedicated to providing innovative technology solutions and services to Customers.
Job Description
Job Title : Senior Data Engineer - GCP, BigQuery & CI/CD Implementation
Job Type : W2
Experience : 8-10 Years
Location : Chicago, Illinois
Technical Skills
- Over All 3-5 years of professional experience
- Experience developing Data pipelines using Dataflow. Integrate with Composer/Airflow or any scheduler Components.
- Build and deploy services using Gradle, Maven, Jenkins, GitHub Actions, etc. as part of the CI/CD process
- Knowledge of Data model of OLTP & Datawarehouse.
- Knowledge of ETL products and working on structured and Unstructured data.
- Experience in Bulk Loads and any Streaming load integration is a plus.
- Experience working in Google Cloud Platform –
- GCP knowledge is preferred for onshore but any one cloud knowledge is mandatory
- Experience with any Relational Database (Spanner, Oracle, PostgreSQL, etc.)
- Experience with Datawarehouse Databases – BigQuery
- Designing, developing, and implementing custom software and database application capabilities with limited oversight
- Excellent communication skills – design-related conversations, ability to build and nurture good relationships, and foster an environment for collaboration
- Acting as a member of the team supporting teammates and collaborating with a do-what-it-takes attitude to ensure project and team success
- Be part of a team of engineers in developing elegant and performant code
- Ensure quality practices – unit testing, code reviews / leading tests
- Optimize application for non-functional requirements
- Build and deploy components as part of the CI/CD process
- Will be responsible for end-to-end application delivery including coordination with required teams for production deployment
- Continuously monitors application health and KPIs (Key Performance Indicators), support triage of any production issues as and when needed
- Collaborate in troubleshooting complex data, features, service, and platform issues and perform root cause analysis to proactively resolve product and operational issues
- Be an advocate of security best practices, champion and support the importance of security within engineering
- Bachelor's degree or equivalent combination of education and experience.
