Data and BI Solutions Engineer

Job Description

• A skilled Data and Business Intelligence Solutions Engineer to design, develop, and maintain robust data pipelines and architectures that support seamless data flow and empower decision-making. The ideal candidate will collaborate with analysts and data scientists, ensure data quality, and optimize systems for evolving organizational needs. This role requires expertise in managing large datasets, cloud platforms, and big data technologies while adhering to best practices in security, compliance, and data engineering.

Essential Duties and Responsibilities :

The essential functions include, but are not limited to the following :

Design, develop, and maintain scalable data pipelines to enable seamless data flow into data

warehouses.

Ensure the reliability and efficiency of data pipelines for real-time, batch and ad hoc data

processing.

Partner with data analysts and scientists to understand and meet data requirements for analysis

and modeling.

Translate organization needs into technical data solutions.

Build and optimize data architectures for efficient storage and transfer of structured and

unstructured data.

Implement solutions that enhance data accessibility and performance.

Perform data validation and cleansing to ensure accuracy, consistency, and reliability.

Establish processes to identify and resolve data discrepancies.

Monitor data pipelines and infrastructure for performance and availability.

Diagnose and resolve issues promptly to minimize disruption.

Adhere to data engineering best practices, including security, compliance, and governance

standards.

Ensure data systems comply with organizational and government regulatory requirements.

Document data processes, workflows, and system designs to maintain a clear knowledge base.

Provide regular updates and reports to stakeholders on system performance and improvements.

Proactively enhance workflows, infrastructure, and technologies to meet evolving organization

needs.

Stay up-to-date with advancements in data engineering and big data technologies.

Manage large datasets using cloud-based platforms (e.g., AWS, Azure, GCP) and big data tools (e.g.,

Hadoop, Spark).

Optimize costs and performance for cloud-based data solutions.

Minimum Qualifications (Knowledge, Skills, and Abilities)

Eight (8) years experience in Data Analysis, Business intelligence, or a related role on programs

and contracts of similar scope, type, and complexity is required.

Takes initiative, detail-oriented, problem solver, willing to ask questions, clear communicator

Proven experience in designing and maintaining data pipelines and architectures

Hands-on experience with cloud-based platforms and big data technologies

Strong background in data validation, cleansing, and quality assurance

Proficiency in data processing tools and languages (e.g., SQL, Python, Apache Spark, or Kafka)

Experience with ETL tools and processes

Strong understanding of data warehousing concepts and platforms (e.g., Snowflake, Redshift,

BigQuery)

Familiarity with data governance, security, and compliance standards

Excellent problem-solving and troubleshooting skills

High emotional intelligence and sensitivity

Excellent communication, interpersonal, and mentoring skills

Able to analyze, think quickly and resolve conflict

Able to adapt to a changing environment

Skilled at supporting multiple clients at a time

Self-motivated, and able to maintain a professional, positive, can-do attitude while staying

focused in the middle of distraction

AWS Certified Data Analytics Specialty, Google Cloud Data Engineer, or similar certifications

Big data or database certifications such as Cloudera or Microsoft Azure Data Engineer Associate

Bachelors degree in Computer Science, Data Engineering, Information Systems or related field

The pay for this position ranges from $48-55 / hr with a conversion salary of $115-120k depending on years of experience.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity / affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and / or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com .

To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy : .

Skills and Requirements

8 years of experience in data analysis and business intelligence

experience in SQL, Python and Apache

experience with ETL tools and processes null

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity / affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and / or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.

Salary : $115,000 - $120,000