What are the responsibilities and job description for the Azure Data Engineer position at Bluo Software LLC?
Role – Azure Data Engineer
Location - Houston, TX
Experience - 8 years
Contract Job - Need someone who can come to the office 4 days a week.
Summary
We are seeking a skilled Azure Data Engineer with Software Development Skills to join our dynamic team. This role primarily emphasizes data engineering tasks, such as designing and maintaining data pipelines and infrastructure, experienced in AWS, Azure Data Factory, Databricks, Data Lake, Hana, Hadoop while also involving secondary responsibilities in full stack development. The ideal candidate blends expertise in data engineering with strong software development skills to deliver scalable and efficient data-driven solutions while contributing to application enhancements.
Key Responsibilities
- Develop and maintain scalable ETL/ELT pipelines for processing structured and unstructured data.
- Design and maintain scalable data lakes using Azure Data Lake Storage for high-performance data storage and analysis.
- Monitor and optimize data workflows for reliability, performance, and efficiency.
- Implement and manage big data processing workflows using Azure Databricks and Apache Spark.
- Collaborate with data scientists and analysts to deliver data solutions aligned with business goals.
- Leverage Azure Synapse Analytics to create efficient data warehouses and enable advanced analytics
- Build and maintain APIs to enable seamless integration between applications and data systems.
- Develop front-end user interfaces to visualize data insights using modern frameworks (e.g., React, Angular, Vue.js).
- Debug, troubleshoot, and optimize full stack applications to improve functionality and user experience.
Required Skills and Qualifications
- Bachelor’s or master’s degree in computer science, Engineering, or a related field.
- 8 years of experience in data engineering and application development.
- Proficiency in data processing frameworks such as Apache Spark, Hadoop, or Kafka.
- Experience with cloud platforms (AWS, Azure, or Google Cloud) and associated data services.
- Strong knowledge of SQL and NoSQL databases.
- Hands-on experience with Azure Data Factory, Azure Synapse Analytics, and Azure Databricks for building data workflows and pipelines.
- Experience with Azure Storage services (Blob Storage, Data Lake Storage) and Azure SQL Database.
- Experience in front-end technologies such as React, Angular, or Vue.js.
- Understanding of API design, RESTful services, and GraphQL.
- Strong problem-solving and debugging skills.
- Excellent communication skills.
Preferred Qualifications
- Experience with Azure DevOps for CI/CD pipelines and version control.
- Experience with machine learning workflows or data analytics.
- Knowledge of data governance frameworks and compliance standards.
- Hands-on experience with Git for version control and Agile development methodologies.