What are the responsibilities and job description for the Azure data engineer position at Raas Infotek LLC?
Job Details
Position: Azure Data Engineer
Location: Houston, TX, USA
Employment Type: W2 and 10 only
Job Summary:
We are looking for a skilled Azure Data Engineer to design, build, and maintain scalable data solutions using Microsoft Azure. The ideal candidate will have experience working with cloud-based data platforms, data pipelines, and analytics solutions, ensuring efficient data processing and storage.
Responsibilities:
- Design and implement data pipelines using Azure Data Factory (ADF), Azure Synapse Analytics, and Data bricks.
- Develop ETL/ELT processes to ingest, transform, and store structured and unstructured data.
- Manage and optimize Azure SQL, Cosmos DB, and Data Lake for efficient data storage and retrieval.
- Implement data governance, security, and compliance best practices in Azure.
- Develop and maintain Azure Data Bricks notebooks for data processing and machine learning use cases.
- Work with Azure Synapse Analytics and Azure Analysis Services for building analytical models.
- Optimize data pipeline performance and troubleshoot issues related to data ingestion and transformation.
- Collaborate with data scientists, analysts, and business teams to support reporting and AI/ML initiatives.
- Implement monitoring and logging solutions to track data pipeline health and performance.
Required Skills:
- Hands-on experience with Azure Data Factory (ADF), Azure Databricks, and Azure Synapse Analytics.
- Strong expertise in SQL and database management (Azure SQL, Cosmos DB, PostgreSQL, or other NoSQL databases).
- Experience in ETL/ELT development and working with structured & unstructured data.
- Proficiency in big data processing frameworks like Apache Spark and Python/PySpark.
- Knowledge of Azure Storage solutions (Blob Storage, Data Lake, Delta Lake).
- Strong understanding of data modeling, warehousing concepts, and performance tuning.
- Experience with Power BI, Azure Analysis Services, or other data visualization tools.
- Familiarity with Azure DevOps, CI/CD, and Infrastructure as Code (IaC) tools like Terraform or ARM templates.
- Good understanding of data security and governance (RBAC, encryption, access controls).
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
