What are the responsibilities and job description for the Software Engineer-Data Engineering position at American Association Of Motor Vehicle Admin.?
Job Details
Position Summary:
The IT Division is responsible for the development and operations of information systems for the State and Federal agencies doing business related to or using information from the administration of motor vehicles and driver licenses.
The Data Engineer position has core responsibilities for the design, development, maintenance, optimization, and operational support of components which move and ingest data from sources into the analytics systems.
Essential Duties and Responsibilities:
We are seeking a talented Mid-Level Data Engineer to join our team. You will work with cutting-edge technologies to build and maintain our data platform, focusing on batch and stream processing workflows. You will leverage the Microsoft Azure ecosystem, particularly Azure Synapse Analytics, Apache Spark, and Delta Lake, to create efficient and reliable data solutions that power our analytics and reporting capabilities.
As a detail-oriented professional, you have a strong track record of independently managing projects and driving them to successful completion. Your exceptional business acumen and communication skills enable you to collaborate effectively with stakeholders, identify vital business questions, and make informed, data-driven decisions.
Key responsibilities include:
Direct Reports:
None
QUALIFICATIONS
Formal Education:
Bachelor's degree in computer science, Data Science, or related field. Equivalent work experience may be substituted.
Knowledge, Skills, and Abilities:
Basic Qualifications
Preferred Qualifications
Technical Stack
Disclaimer Statement: The preceding job description has been written to reflect management's assignment of essential functions. It does not prescribe or restrict the tasks that may be assigned.
AAMVA is an Equal Opportunity Employer-M/F/D/V
The IT Division is responsible for the development and operations of information systems for the State and Federal agencies doing business related to or using information from the administration of motor vehicles and driver licenses.
The Data Engineer position has core responsibilities for the design, development, maintenance, optimization, and operational support of components which move and ingest data from sources into the analytics systems.
Essential Duties and Responsibilities:
We are seeking a talented Mid-Level Data Engineer to join our team. You will work with cutting-edge technologies to build and maintain our data platform, focusing on batch and stream processing workflows. You will leverage the Microsoft Azure ecosystem, particularly Azure Synapse Analytics, Apache Spark, and Delta Lake, to create efficient and reliable data solutions that power our analytics and reporting capabilities.
As a detail-oriented professional, you have a strong track record of independently managing projects and driving them to successful completion. Your exceptional business acumen and communication skills enable you to collaborate effectively with stakeholders, identify vital business questions, and make informed, data-driven decisions.
Key responsibilities include:
- Designing and implementing scalable data pipelines using Azure Synapse Analytics and Apache Spark
- Building and maintaining streaming data solutions using Azure Event Hubs and Spark Structured Streaming
- Developing and maintaining C# applications for data processing and integration
- Implementing Delta Lake architecture for reliable data storage and processing
- Optimizing data workflows for performance and cost efficiency
- Collaborating with cross-functional teams to understand data requirements and deliver solutions
- Ensuring data quality and implementing data governance practices
Direct Reports:
None
QUALIFICATIONS
Formal Education:
Bachelor's degree in computer science, Data Science, or related field. Equivalent work experience may be substituted.
Knowledge, Skills, and Abilities:
Basic Qualifications
- 3-5 years of hands-on experience in data engineering
- Microsoft Certified: Azure Data Engineer Associate (DP-203) certification required
- Strong proficiency with Azure Synapse Analytics and Apache Spark
- Hands-on experience with Azure Event Hubs and stream processing
- Experience building and maintaining data pipelines using Delta Lake
- Proficiency in Python and SQL
- Experience with version control systems (Git) and CI/CD practices
- Strong problem-solving skills and attention to detail
Preferred Qualifications
- C# development experience, particularly with Azure Functions and .NET Core
- Additional Azure certifications (e.g., Azure Solutions Architect, Azure Developer)
- Knowledge of data modeling and dimensional modeling concepts
- Familiarity with Azure Data Factory
- Experience with real-time analytics and stream processing
- Knowledge of data governance and security best practices
- Experience with Power BI or similar visualization tools
- Azure or Databricks certifications
Technical Stack
- Core Technologies: Azure Synapse Analytics, Apache Spark, Delta Lake, Azure Event Hubs
- Languages: Python, SQL, PySpark, C#
- Cloud Services: Azure Functions, Azure Data Factory, Azure Key Vault
- Streaming: Azure Event Hubs, Spark Structured Streaming
- Optional: Databricks, Lakehouse Architecture
- Visualization: Power BI, Synapse Analytics Studio
- Development: .NET Core, Azure DevOps
Disclaimer Statement: The preceding job description has been written to reflect management's assignment of essential functions. It does not prescribe or restrict the tasks that may be assigned.
AAMVA is an Equal Opportunity Employer-M/F/D/V
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Lead Software Engineer
Data Society -
Washington, DC
AI Software Engineer
Software Engineering Institute | Carnegie Mellon University -
Arlington, VA
Associate AI Software Engineer
Software Engineering Institute | Carnegie Mellon University -
Arlington, VA