Data Engineer

Our enterprise client is seeking a Data Engineer to join their dynamic team. The selected candidate will be instrumental in enhancing data-driven decision-making and operational efficiency across various business units. This role involves close collaboration with data scientists and operating within a cloud environment, requiring proficiency in data engineering, cloud technologies, and team-based problem-solving. If you are enthusiastic about using data to drive business insights and innovation, and have expertise in Power BI visualization and data cataloging, this opportunity is for you!

What you’ll be doing:

Data Modeling and Architecture:

• Develop and implement data models and architectures optimized for data analytics, ensuring efficiency, scalability, and data integrity.
• Implement best practices for data storage, partitioning, and indexing to optimize performance and facilitate analysis.

Data Pipeline Development:

• Assist in designing, building, and maintaining scalable data pipelines to ingest, transform, and store large volumes of data from various sources.
• Collaborate with data scientists to ensure seamless integration of data pipelines with analytical models and AI processes.

Data Cataloging and Documentation:

• Catalog and document data sources, datasets, and metadata to facilitate data discovery, lineage, and governance.
• Implement data cataloging best practices to ensure the availability and accessibility of data assets.

Cloud Environment Management:

• Work within cloud environments - Azure to deploy, manage, and optimize data engineering solutions.
• Collaborate with cloud architects and administrators to ensure security, compliance, and cost-effectiveness of cloud infrastructure.

Visualization and Reporting:

• Develop and maintain Power BI dashboards and reports to visualize data insights and facilitate data-driven decision-making.
• Create custom UI/UX applications
• Ensure the accuracy, reliability, and usability of visualizations to meet business requirements.

Collaboration and Support:

• Collaborate with cross-functional teams to understand data requirements and support analytical initiatives.
• Provide technical support and troubleshooting for data-related issues, ensuring the reliability and availability of data infrastructure.

What you need to have:

Responsibilities:

• Design, develop, and maintain scalable data pipelines and systems.

• Collaborate with cross-functional teams to understand data requirements and deliver solutions.

• Optimize and troubleshoot SQL queries for performance and efficiency.

• Develop and maintain ETL processes using Python.

• Integrate and manage data from various sources, including Oracle databases.

• Create and maintain reports and dashboards using Power BI.

• Ensure data quality, integrity, and security.

• Perform data visualization and analysis to support business decisions.

• Stay up-to-date with the latest industry trends and technologies.

Qualifications:

• Bachelor's degree in Computer Science, Information Technology, or a related field.

• 5 years of experience working with data in an enterprise environment.

• 5 years of experience with SQL queries and Python.

• Proven experience with Power BI and Oracle databases.

• Strong understanding of data modeling, ETL processes, and data warehousing.

• Strong communication and collaboration skills.

• Ability to work independently and as part of a team.