Data Engineer
Position Description
CGI is seeking a skilled and motivated Data Engineer to join our dynamic data engineering team. The ideal candidate will be responsible for building, maintaining, and optimizing data pipelines and architectures.
This position is located in our Pittsburgh, PA or Cleveland OH offices, however a hybrid working model is acceptable
The candidate will be working closely with data scientists, analysts, and other stakeholders to ensure data availability and quality for analytics and reporting purposes. Candidate should have a strong background in data engineering, data management, and data integration techniques, with a specific focus on data virtualization tools and platforms.
This role requires deep expertise in data engineering, strong problem-solving skills, and a solid understanding of distributed data processing frameworks.
Objectives of this role:
Create and manage virtual data layers to integrate disparate data sources, ensuring data consistency, quality, and accessibility.
Design, develop, and maintain scalable data pipelines for data ingestion, processing, and storage.
Integrate data from various sources including databases, data warehouses, data lakes, and cloud-based systems. Also, ensuring data consistency and quality.
Manage and optimize databases, both relational and non-relational, to support data storage and retrieval.
Develop and maintain ETL (Extract, Transform, Load) processes to ensure efficient data flow.
Create and maintain data models that support business requirements and analytics needs.
Optimize data pipelines and databases for performance, scalability, and cost-effectiveness.
Document data virtualization processes, architecture, and solutions.
Ensure compliance with data governance policies and standards.
Your future duties and responsibilities
Develop, implement, and maintain data virtualization solution using tools such as Denodo, Dremio, or similar platforms.
Implement data virtualization solutions to enable seamless data access and integration.
Work with both SQL and NoSQL databases, ensuring optimized query performance and data security.
Design, develop, and optimize data processing pipelines to meet specific business requirements.
Design, develop, and maintain ETL (Extract, Transform, Load) processes.
Ensure data integrity, quality, and performance across various data pipelines.
Manage and optimize data storage solutions, including cloud databases (e.g., AWS Redshift, Google BigQuery).
Integrate data from various sources (on-premises, cloud, APIs) using data virtualization tools.
Document data workflows, architecture, and processes for transparency and maintainability.

Required qualifications to be successful in this role
Bachelor's or master's degree in Computer Science, Information Technology, or related fields.
5-8 years of solid hands-on software development experience with a focus on continuous delivery and deployment and cloud automation.
5 years of proven experience as a Data Engineer, with a focus on data virtualization.
Experience with data virtualization tools & technologies like Denodo, TIBCO Data Virtualization, Dremio.
Proficiency in programming languages such as Python, Scala or Go, with experience in developing scalable and maintainable code.
Experience with big data technologies such as Apache Spark, Hadoop, Apache Flink and AWS Glue.
Experience with databases and storage systems, such as SQL, NoSQL, and data lakes.
Experience with DevOps tools like Jenkins, GitHub, JFrog, uDeploy.
Knowledge of platform tools like VM, Open Shift Container etc.
Understanding and experience of concepts such as Automation, Capacity planning, Monitoring, Performance optimization etc.
Software design patterns, SDLC, Open-Source Development, Test Driven Development (TDD), Continuous Integration and Continuous Delivery.
Knowledge of distributed computing concepts and experience working with distributed data processing systems.
Understanding of data processing concepts, data formats (e.g., Avro, Parquet), and data serialization techniques.
Experience with monitoring tools like Dynatrace, Splunk etc.
Experience with building scalable and efficient data processing pipelines.
Experience with ensuring data accuracy and integrity.
Experience with Optimizing data processing workflows for performance.
Proactive approach to identifying problems, performance bottlenecks, and areas for improvement.
OPTIONAL: Desired qualifications/non-essential skills required
Relevant certifications like Denodo Platform Certification

"CGI is required by law in some jurisdictions to include a reasonable estimate of the compensation range for this role. The determination of this range includes various factors not limited to skill set, level, experience, relevant training, and licensure and certifications. To support the ability to reward for merit-based performance, CGI typically does not hire individuals at or near the top of the range for their role. Compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range for this role in the U.S. is $85,800 - $209,100."

At CGI we call our professionals "members" to reinforce that all who join our team are, as owners, empowered to participate in the challenges and rewards that come from building a world-class company. CGI's benefits include:
- Competitive base salaries.
- Eligibility to participate in an attractive Share Purchase Plan (SPP) in which the company matches dollar-for-dollar contributions made by eligible employees, up to a maximum, for their job category.
- 401(k) Plan and Profit Participation for eligible members.
- Generous holidays, vacation, and sick leave plans.
- Comprehensive insurance plans that include, among other benefits, medical, dental, vision, life, disability, out-of-county emergency coverage in all countries of employment.
- Back-up child care, Pet insurance, a Member Assistance Program, a 529 college savings program, a personal financial management tool, lifestyle management programs and more.
Required qualifications to be successful in this role
Bachelor's or master's degree in Computer Science, Information Technology, or related fields.
5-8 years of solid hands-on software development experience with a focus on continuous delivery and deployment and cloud automation.
5 years of proven experience as a Data Engineer, with a focus on data virtualization.
Experience with data virtualization tools & technologies like Denodo, TIBCO Data Virtualization, Dremio.
Proficiency in programming languages such as Python, Scala or Go, with experience in developing scalable and maintainable code.
Experience with big data technologies such as Apache Spark, Hadoop, Apache Flink and AWS Glue.
Experience with databases and storage systems, such as SQL, NoSQL, and data lakes.
Experience with DevOps tools like Jenkins, GitHub, JFrog, uDeploy.
Knowledge of platform tools like VM, Open Shift Container etc.
Understanding and experience of concepts such as Automation, Capacity planning, Monitoring, Performance optimization etc.
Software design patterns, SDLC, Open-Source Development, Test Driven Development (TDD), Continuous Integration and Continuous Delivery.
Knowledge of distributed computing concepts and experience working with distributed data processing systems.
Understanding of data processing concepts, data formats (e.g., Avro, Parquet), and data serialization techniques.
Experience with monitoring tools like Dynatrace, Splunk etc.
Experience with building scalable and efficient data processing pipelines.
Experience with ensuring data accuracy and integrity.
Experience with Optimizing data processing workflows for performance.
Proactive approach to identifying problems, performance bottlenecks, and areas for improvement.
OPTIONAL: Desired qualifications/non-essential skills required
Relevant certifications like Denodo Platform Certification

"CGI is required by law in some jurisdictions to include a reasonable estimate of the compensation range for this role. The determination of this range includes various factors not limited to skill set, level, experience, relevant training, and licensure and certifications. To support the ability to reward for merit-based performance, CGI typically does not hire individuals at or near the top of the range for their role. Compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range for this role in the U.S. is $85,800 - $209,100."

At CGI we call our professionals "members" to reinforce that all who join our team are, as owners, empowered to participate in the challenges and rewards that come from building a world-class company. CGI's benefits include:
- Competitive base salaries.
- Eligibility to participate in an attractive Share Purchase Plan (SPP) in which the company matches dollar-for-dollar contributions made by eligible employees, up to a maximum, for their job category.
- 401(k) Plan and Profit Participation for eligible members.
- Generous holidays, vacation, and sick leave plans.
- Comprehensive insurance plans that include, among other benefits, medical, dental, vision, life, disability, out-of-county emergency coverage in all countries of employment.
- Back-up child care, Pet insurance, a Member Assistance Program, a 529 college savings program, a personal financial management tool, lifestyle management programs and more.
#dice
#LI-PS1
#CSG-TMC-F24
Together, as owners, let's turn meaningful insights into action.
Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you'll reach your full potential because...

You are invited to be an owner from day 1 as we work together to bring our Dream to life. That's why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company's strategy and direction.
Your work creates value. You'll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.
You'll shape your career by joining a company built to grow and last. You'll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.
Come join our team-one of the largest IT and business consulting services firms in the world.
Qualified applicants will receive consideration for employment without regard to their race, ethnicity, ancestry, color, sex, religion, creed, age, national origin, citizenship status, disability, pregnancy, medical condition, military and veteran status, marital status, sexual orientation or perceived sexual orientation, gender, gender identity, and gender expression, familial status, political affiliation, genetic information, height, weight, or any other legally protected status or characteristics.
CGI provides reasonable accommodations to qualified individuals with disabilities. If you need an accommodation to apply for a job in the U.S., please email the CGI U.S. Employment Compliance mailbox at . You will need to reference the Position ID of the position in which you are interested. Your message will be routed to the appropriate recruiter who will assist you. Please note, this email address is only to be used for those individuals who need an accommodation to apply for a job. Emails for any other reason or those that do not include a Position ID will not be returned.
We make it easy to translate military experience and skills! Click here to be directed to our site that is dedicated to veterans and transitioning service members.
All CGI offers of employment in the U.S. are contingent upon the ability to successfully complete a background investigation. Background investigation components can vary dependent upon specific assignment and/or level of US government security clearance held. Dependent upon role and/or federal government security clearance requirements, and in accordance with applicable laws, some background investigations may include a credit check. CGI will consider for employment qualified applicants with arrests and conviction records in accordance with all local regulations and ordinances.
CGI will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with CGI's legal duty to furnish information.