What are the responsibilities and job description for the Data Architect - Generative AI & Digital Automation -Full Time Role position at Vaiticka Solution?
Job Title: Data Architect - Generative AI & Digital Automation
Location: Tarry Town, NY
Employment Type: Full-Time
Mode of work: Hybrid (3 days in office in Tarry Town, NY)
Overview
Seeking a Data Architect to design, develop, and implement cutting-edge solutions leveraging generative AI technology, integration and Digital automation. The ideal candidate will play a pivotal role in architecting scalable, secure, and efficient applications that transform business processes, enhance decision-making, and deliver measurable value. This role requires a good understanding of architecture, AI/ML frameworks, Cloud, and modern automation tools, combined with a passion for solving complex problems.
Key Responsibilities
Data Architecture:
- Design, develop, and implement comprehensive enterprise data strategies, data models and architectures, including data modeling (conceptual, logical), database structures, data warehouses, and data lakes.
- Analyze structural (data) requirements for applications
- Optimize information systems and database systems for performance, scalability, and integrity.
- Define and implement data standards, security procedures, data governance policies, and backup procedure.
- Collaborate with stakeholders, development teams, data scientists, data engineers, and other IT professionals to understand requirements, implement solutions, and ensure data needs are met.
- Evaluate and database management technologies, data integration tools, and emerging data technologies.
- Create and maintain data models.
- Troubleshoot data-related technical issues.
- Ensure data quality, integrity, security, and compliance with relevant regulations.
Technical Leadership:
- Provide technical guidance to development teams during implementation, ensuring adherence to architectural standards.
- Conduct reviews, performance tuning, and troubleshooting of complex issues.
Collaboration & Innovation:
- Work closely with cross-functional teams (e.g., data science, DevOps, security) to ensure seamless deployment and operation of solutions.
- Identify opportunities to leverage emerging technologies to improve existing systems.
- Contribute to proofs-of-concept (PoCs) and pilot projects to validate new ideas.
Compliance & Security:
- Ensure solutions comply with industry standards, data privacy regulations (e.g., GDPR, CCPA), and security best practices.
- Design systems with robust authentication, encryption, and auditability features.
Qualifications
- Experience/Knowledge:
- 10 years of experience in data architecture, software engineering, or a related role.
- Proven expertise in designing and deploying applications with generative AI technologies (e.g., TensorFlow, PyTorch, Hugging Face Transformers).
- Hands-on experience with intelligent document processing.
- Strong background in automation technologies.
- Experience with cloud platforms (AWS)
- Experience with Streaming Data Integration / Event-Driven Integration
- Expertise in processing large amounts of diverse data types, including structured, semi-structured, and unstructured data.
- Familarity with Data Federation & Data Virtualization
- Hands-on experience in ensuring data privacy, security (e.g., encryption, access control), and compliance with regulations, particularly when dealing with potentially sensitive data used in AI models.
- Experience in architecting and optimizing Retrieval-Augmented Generation (RAG) pipelines, including, integrating vector databases and complex data retrieval logic.
- Technical Skills:
- Proficiency in Python, Databricks, NoSQL, Vector & Graph databases
- Familiarity with Python
- Familiarity with AI/ML frameworks, APIs, and model deployment
- Familiarity with data visualization tools (e.g., Tableau, Power BI)
- Knowledge of data pipeline tools (e.g., Apache Kafka, Airflow).
- Understanding of DevOps practices as in relates to Data (e.g. Data Pipelines)
- Proficiency in analyzing data requirements for new software and applications.
- Soft Skills:
- Exceptional problem-solving and analytical skills.
- Strong communication skills to articulate complex technical concepts to non-technical stakeholders.
- Ability to work collaboratively in a fast-paced, agile environment.