What are the responsibilities and job description for the Lead Data Engineer (F2F Interview) position at IT Engagements, Inc.?
Greetings from IT Engagements
Role: Data Architect/ Engineer (15Y EXP - NO OPT)
Location: Richmond, VA (Hybrid, F2F Interview)
Qualifications
Skill Required / Desired Amount of Experience
Role: Data Architect/ Engineer (15Y EXP - NO OPT)
Location: Richmond, VA (Hybrid, F2F Interview)
Qualifications
- Need 15 y expeience
- Strong Data engineering fundamentals
- Utilize Big data frameworks like Spark/Databricks
- Training LLMs with structed and unstructured data sets.
- Understanding of Graph DB
- Experience with Azure Blob Storage, Azure Data Lakes, Azure Databricks
- Experience implementing Azure Machine Learning, Azure Computer Vision, Azure Video Indexer, Azure OpenAI models, Azure Media Services, Azure AI Search
- Determine effective data partitioning criteria
- Utilize data storage system spark to implement partition schemes
- Understanding core machine learning concepts and algorithms
- Familiarity with Cloud computing skills
- Strong programming skills in Python and experience with AI/ML frameworks.
- Proficiency in vector databases and embedding models for retrieval tasks.
- Expertise in integrating with AI agent frameworks.
- Experience with cloud AI services (Azure AI).
- Experience with GIS spatial data
- Strong leadership, excellent problem-solving and communication skills
- Proven experience in leading projects and teams, including the mentorship of AI engineers
- The ability to engage in critical evaluation of information, hypothesis testing, and scenario analysis.
- Flexibility in learning and adopting new technologies, methodologies, and tools to stay at the forefront of AI trends.
- Experience with Department of Transportation Data Domains developing an AI Composite Agentic Solution designed to identify and analyze data models, connect & correlate information to validate hypotheses, forecast, predict and recommend potential strategies and conduct What-if analysis.
- Bachelor’s or master’s degree in computer science, AI, Data Science, or a related field.
Skill Required / Desired Amount of Experience
- Understanding the Big data Technologies Required 1 Years
- Experience developing ETL and ELT pipelines Required 1 Years
- Experience with Spark, GraphDB, Azure Databricks Required 1 Years
- Expertise in Data Partitioning Required 1 Years
- Experience with Data conflation Required 3 Years
- Experience developing Python Scripts Required 3 Years
- Experience training LLMs with structured and unstructured data sets Required 2 Years
- Experience with GIS spatial data Required 3 Years
