What are the responsibilities and job description for the Senior Azure Data Engineer at New York City, NY (Onsite) position at ICS Global Soft, Inc.?
Job Details
Hello ,
Hope you are doing well.
This is Ram from ICS Global Soft. Kindly find the below job description and let me know your availability
Role: Senior Data Engineer
Location: New York City, NY 10007 USA (Hybrid)
Duration: Long-term
Required Skills & Qualifications:
Cloud & Data Technologies:
- Expertise in Azure Data Factory (ADF), Azure Databricks, Data Lake, and Azure Blob Storage.
- Strong knowledge of Azure Synapse Analytics, Azure SQL Database, and Cosmos DB.
- Hands-on experience with Apache Spark, Python, Scala, and SQL for data processing.
ETL/ELT & Data Pipelines:
- Proven experience in building end-to-end ETL/ELT data pipelines.
- Strong understanding of data lake architecture, structured & unstructured data management.
Machine Learning & AI Integration: Good to have
- Experience with MLflow and Kubernetes for deploying machine learning models.
- Understanding of MLOps best practices in an enterprise environment.
Data Visualization & BI:
- Proficiency in Power BI for creating dashboards, data models, and reports.
- Ability to integrate multiple data sources for in-depth analytics.
Big Data & Performance Optimization: Good to have
- Experience in data partitioning, indexing, and query optimization techniques.
- Familiarity with parallel computing, distributed data processing, and real-time analytics.
Soft Skills:
- Excellent problem-solving, analytical thinking, and communication skills.
- Ability to collaborate with cross-functional teams, stakeholders, and leadership.
Preferred Qualifications:
- Bachelor s/master s degree in computer science, Data Engineering, or a related field.
- Certifications in Azure Data Engineering (DP-203), Azure Solutions Architect (AZ-305), or Azure Data Engineer. Good to have.
- Experience with Kafka, Event Hubs, or other real-time data streaming technologies. Good to have.
- Knowledge of data security, GDPR, and compliance regulations. Good to have.