What are the responsibilities and job description for the Data Pipeline Specialist Role position at Technogen International Company?
About the Role
We are seeking a highly skilled Data Pipeline Specialist to join our team at Technogen International Company. As a key member of our data engineering team, you will be responsible for designing and developing large-scale data pipelines that support business growth and decision-making.
Key Responsibilities:
- Design, develop, and deploy scalable data pipelines using SQL, Python, and relevant packages like Pandas and Apache Spark.
- Collaborate with cross-functional teams to identify data requirements and translate them into technical specifications.
- Work closely with the team to build visualizations in Power BI and ensure data security best practices are implemented.
Requirements:
- Proven experience in designing and maintaining robust data pipelines.
- A strong foundation in data modeling, architecture, and data warehousing.
- Experience working in a CI/CD environment and deploying pipelines.
- Hands-on experience with a cloud platform, preferably Azure.
Education:
- Bachelor's degree in Computer Science, Engineering, Statistics, or equivalent professional experience.
