What are the responsibilities and job description for the Azure Data Engineer position at DVARN?
Job Details
Job Title Azure Data Engineer.
Location Need candidates local to Richmond, VA or Dallas, TX (Hybrid role)
Duration 6 Months
Rate - $70-75/hr on W2
Must have Linkedin profile
Job Summary: This role involves designing, developing, and maintaining data solutions on the Azure platform to support our data-driven initiatives. The initial assignment is for 6 months, with potential extension up to 2 years.
Requirements:
- Azure Data Factory
- Azure Data Lake Storage
- Databricks
- Spark (using Python, open to seeing Scala/Java)
- SQL
Nice to Have:
- JD Edwards
- Salesforce
- Azure Functions
Key Responsibilities:
- Design and implement scalable data pipelines and ETL processes using Azure Data Factory and PySpark.
- Develop and maintain data storage solutions using Azure SQL Database, Azure Data Lake, and Databricks.
- Migrate data from various sources including Salesforce, JD Edwards, Oracle, Postgres, NoSQL databases, and OLTP systems to Databricks Lakehouse and Data Lake.
- Implement Medallion architecture, focusing on ingesting data into the bronze layer and supporting additional modeling and refinement to drive to the gold reporting layer.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
- Optimize and tune data solutions for performance, reliability, and cost-efficiency.
- Ensure data quality, integrity, and security across all data solutions.
- Monitor and troubleshoot data pipelines and systems to ensure smooth operation.
- Stay up-to-date with the latest Azure technologies and best practices in data engineering.
Qualifications:
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- 5 years of experience in data engineering, with a focus on cloud-based solutions.
- Strong expertise in Microsoft Azure, including Azure Data Factory, Azure Databricks, Azure SQL Database, and Azure Data Lake.
- Proficiency in SQL, Python, and other relevant programming languages.
- Experience with data modeling, ETL processes, and data warehousing.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills.
- Experience with JD Edwards and Mulesoft API integrations is a plus.
- Familiarity with Azure Functions for serverless compute is a plus.
Preferred Qualifications:
- Master's degree in a related field.
- Azure certifications (e.g., Azure Data Engineer Associate).
- Experience with big data technologies such as Hadoop and Spark.
- Knowledge of machine learning and AI concepts
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Salary : $70 - $75
