Job Title: Data and AI Architect

Duration: Contract

Locations: NYC NY

Job Description:

Recommended Qualifications and Experience:

• Data Governance and Security – using tools such as Purview to manage data governance and ensure data security
• Azure AI Services – implementing solutions using a range of Azure AI services, including:
• Azure Cognitive Services – integrating pre-built APIs for vision, speech, language, and decision-making capabilities
• Azure Bot Services – developing intelligent chatbots that can engage with users across multiple channels
• Azure Machine Learning (AML) – building, training, deploying, and operationalizing machine learning models, including monitoring, and maintaining models in production
• Azure Form Recognizer – extracting information from documents
• Azure Language Understanding (LUIS) – creating natural language understanding capabilities
• Azure Cognitive Search – implementing AI-powered search capabilities
• Azure Personalizer – providing personalized user experiences
• Azure Metrics Advisor – monitoring and diagnosing issues in time-series data
• Responsible AI – ensuring AI models are built and used ethically, addressing fairness, transparency, accountability, and security
• Prompt Engineering – designing and refining prompts for AI models to improve response quality and relevance
• OpenAI Experience – working with OpenAI models and APIs to create advanced AI solutions
• Application Development – using Python, Flask, and App Service Environment for building and deploying applications
• Infrastructure as Code – using Bicep for Azure infrastructure deployment
• DevOps – implementing CI/CD pipelines using Azure DevOps, Git
• Understanding Network Requirements – ensuring solutions meet the necessary network configurations and bandwidth requirements
• Security Requirements – implementing robust security measures to protect data and applications
• Performance Optimization – optimizing the performance of data pipelines and Spark applications to ensure efficiency and scalability
• Delta Sharing – implementing secure and scalable data sharing across organizations using Delta Sharing
• Unity Catalog – managing and securing data lakes with Unity Catalog for centralized governance and auditing
• 2 years of SQL Server or advanced database or advanced analytics experience
• 3 years of technical expertise in an enterprise environment
• Deep technical or architectural knowledge of at least 2 of the following areas preferred:
• Database administration (preferably with SQL, including Azure SQL) – performance tuning, troubleshooting, high availability/disaster recovery, security
• Database development (preferably with SQL, including Azure SQL) – designing and building database solutions (tables, stored procedures, forms, queries, etc.)
• Business intelligence – combining knowledge of SSIS/SSAS/SSRS/Power BI technologies with a deep understanding of data structures/data models to design, develop, and tune BI solutions and reports
• Advanced data analytics – designing and building solutions using technologies such as Azure Data Factory, Azure Data Lake, HD Insights, SQL DWH, Stream Analytics, Machine Learning, R Server, Synapse, Azure Machine Learning (AML), Azure Kubernetes Service (AKS) for model deployments, Vector and Retrieval-Augmented Generation (RAG) implementation
• Big Data implementation – using Open Source and NoSQL technologies such as Databricks, Spark, Spark Streaming, Kafka, Storm, Zeppelin, Scala, Software development, Hadoop Hive, Hadoop Map Reduce, Hadoop Clusters, Cosmos DB, Azure Data Lake Storage (ADLS)
• Additional Qualifications:
• B.S./B.A. or equivalent work experience combined with relevant industry experience in a consulting role
• Ability to travel domestically and internationally and work with diverse cultures and customers; able to obtain a valid passport within 90 days of joining the team
• Fluency in written and spoken English and local language if applicable; ability to speak other languages is a plus
• Ability to communicate with a variety of different audiences and strong presentation skills
• Ability to lead and motivate technical communities
• Ability to effectively recognize and adapt to change
• Ability to quickly grasp customers’ business challenges and drive positive change
• For Solution Architect
• Provide technical oversight
• Verify that Microsoft-recommended practices are being followed
• Take responsibility for overall solution design
• Help evaluate the implications of trade-off decisions
• Capture key architecture decisions
• Effectively communicate, collaborate, and align with relevant IT and business stakeholders
• Provide technical oversight and governance