What are the responsibilities and job description for the Data Engineer position at Precision Technologies?
We are looking for a highly skilled Data Engineer with hands-on experience in Azure Databricks to join our growing data team. In this role, you will design and implement scalable data solutions using Azure-based tools, enabling real-time and batch processing for business-critical applications. If you're passionate about big data technologies and cloud computing, this is your opportunity to make a big impact.
Key Responsibilities
- Build and maintain scalable ETL/ELT pipelines using Azure Databricks (Spark-based).
- Work with structured and unstructured data from various sources (SQL databases, APIs, flat files, etc.).Develop data transformation workflows using PySpark/Scala/Spark SQL.
- Collaborate with analysts, data scientists, and business stakeholders to deliver clean, enriched data models.
- Implement data quality, validation, and monitoring processes.Integrate data pipelines with Azure services such as:
- Azure Data Lake Storage (ADLS)
- Azure Synapse Analytics
- Azure Data Factory
- Azure SQL / Cosmos DB
- Optimize data processing for cost and performance.
- Contribute to best practices in data engineering, security, and compliance.
Required Skills and Qualifications
- Bachelor’s or Master’s degree in Computer Science, Information Systems, or a related field.
- 3 years of experience in data engineering with strong exposure to Azure ecosystem.
- Proficient in Azure Databricks, PySpark, Spark SQL, and distributed data processing.
- Experience with Azure Data Factory, Azure Data Lake, and Synapse Analytics.
- Strong SQL skills for data querying, transformation, and modeling.
- Solid understanding of data warehousing concepts, data lakes, and modern data architectures.
- Familiar with CI/CD practices and DevOps for data workflows.