What are the responsibilities and job description for the Data Engineer position at Trident Consulting?
Trident Consulting is seeking a "Data Engineer” for one of our clients in Des Moines, IA/ Onsite. A global leader in business and technology services
Job Title: Data Engineer
Job Location: Des Moines, IA/ Onsite – Only Locals
Job Type: Contract (W2)
Job Description:
We are seeking a highly experienced Data Engineer to join our dynamic team and lead our data engineering initiatives using Azure ML and Databricks.
senior Data Engineer with Utility domain experience
Responsibilities:
- Design, develop, and maintain scalable data pipelines and ETL processes to support data science and analytics initiatives.
- Utilize Azure ML and Databricks to build and optimize data architectures and workflows.
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and ensure data availability and quality.
- Implement data integration solutions to consolidate data from various sources into a unified data platform.
- Analyze the generation patterns from various Solar Generation facilities and help filed teams to identify the anomalies in generation.
- Ensure data security, privacy, and compliance with relevant regulations and best practices.
- Monitor and troubleshoot data pipelines and workflows to ensure reliability and performance.
- Stay up-to-date with the latest advancements in data engineering, big data technologies, and cloud platforms, and apply them to improve existing processes and systems.
Qualifications:
- Bachelor’s degree in computer science, Data Engineering, or a related field.
- looking for a senior Data Engineer with Utility domain experience
- 10 years of experience in data engineering, data integration, and ETL processes.
- Extensive experience with Azure ML and Databricks, including hands-on experience in building and optimizing data pipelines.
- Proficiency in programming languages such as Python, SQL, and Scala.
- Strong understanding of data engineering principles and best practices.
- Experience with big data technologies such as Hadoop, Spark, and Kafka.
- Excellent problem-solving skills and the ability to work independently and as part of a team.
- Strong communication and interpersonal skills, with the ability to convey complex technical information to a non-technical audience.
- Experience in solar generation data analysis is a plus.
About Trident:
Trident Consulting is an award-winning IT/engineering staffing company founded in 2005 and headquartered in San Ramon, CA. We specialize in placing high-quality vetted technology and engineering professionals in contract and full-time roles. Trident's commitment is to deliver the best and brightest individuals in the industry for our clients' toughest requirements.
Some of our recent awards include:
• 2022, 2021, 2020 Inc. 5000 fastest-growing private companies in America
• 2022, 2021 SF Business Times 100 fastest-growing private companies in Bay Area
