What are the responsibilities and job description for the Data Engineer" position at Technogen International Company?
Data Engineer
We are seeking an experienced Data Engineer to join our team for a remote project lasting 10 months. The ideal candidate will have expertise in designing and maintaining efficient data pipelines using big data sets.
Key Responsibilities:
- Design and maintain robust data pipelines that are performant on big data sets
- Write clean code utilizing object-oriented paradigms when appropriate
- Develop a strong foundation in data modeling, architecture, and data warehousing
- Deploy pipelines in a CI/CD environment
- Utilize cloud platforms, preferably Azure (Azure SQL, Synapse, Databricks, etc.)
- Build visualizations in Power BI
- Translate data asks into technical specs for a pipeline and visualization
Requirements:
- 3 years of experience programming in SQL, Python, and relevant packages like Pandas and Apache Spark
- Hands-on experience with a cloud platform, preferably Azure
- A strong foundation in data modeling, architecture, and data warehousing
- Experience working in a CI/CD environment and deploying pipelines
- Communication skills to translate data asks into technical specs for a pipeline and visualization
- An understanding of data security best practices and how to implement them
- Possession of a Bachelor's degree in Computer Science, Engineering, Statistics, or equivalent professional experience
Desired Skills:
- Experience in agile development methodologies and version control systems (e.g., Git)
- Experience working with NoSQL databases
- An ability to work with cross-functional, inter-agency teams
- Experience working on small teams in fast-paced environments
The successful candidate will be passionate about staying updated on emerging technologies in data engineering and will contribute to a culture of continuous improvement and innovation within the team.
