What are the responsibilities and job description for the Data Engineer position at Mudrasys?
Job title : Data Engineer
Job Responsibilities :
- Design, build, and maintain scalable and reliable data pipelines to extract, transform, and load (ETL) data from various sources into data warehouses or data lakes. Ensure data quality, consistency, and reliability across different stages of the data pipeline.
- Develop and maintain data architecture, ensuring it meets the requirements of data storage, retrieval, and analysis. Design and implement efficient and scalable data models that support the organization's analytics and reporting needs.
- Integrate data from various internal and external sources, ensuring seamless data flow and availability for analysis. Work with APIs, databases, and other data integration tools to ensure smooth data ingestion.
- Manage and optimize databases and data warehouses, ensuring they operate efficiently and effectively. Implement database solutions that ensure data security, backup, and recovery.
- Implement data quality checks and validation processes to ensure the accuracy and reliability of data. Establish and enforce data governance policies and practices to maintain data integrity and compliance.
- Collaborate with data scientists, analysts, and other stakeholders to understand data needs and provide appropriate solutions. Work closely with business units to gather requirements and ensure data solutions align with business objectives.
- Monitor and optimize the performance of data pipelines, databases, and data processing systems. Identify and resolve bottlenecks and inefficiencies in data workflows. Implement measures to protect data against unauthorized access and breaches.
- Evaluate and select appropriate data tools and technologies that align with the organization's data strategy and architecture. Stay updated with the latest trends and advancements in data engineering and recommend improvements.
- Maintain thorough documentation of data architecture, data flows, and data models. Provide regular reports and updates on data engineering projects and initiatives. Ensure that data infrastructure and processes comply with relevant security and privacy regulations
Degree Requirement : This position requires, at a minimum, a bachelor's degree in computer science, computer information systems, information technology or a combination of education and experience equating to the U.S. equivalent of a Bachelor's degree in one of the aforementioned subjects.
Work Schedule : Full Time, 40 Hours / Week
