What are the responsibilities and job description for the Data Engineer position at HSK Technologies INC?
Position : Data EngineerLocation : Atlanta, GA (Hybrid, 3 days onsite)Responsibilities : Design and develop high-performance data ingestion pipelines using Azure Databricks & Azure Data FactoryWork with event-based streaming technologies for data ingestion and processingDesign and implement Data Lakehouse solutionsCollaborate with the project team on API interfaces and Search componentsEnsure the design and implementation of technologies meet security standardsReview and approve code before migration to productionWork in Agile / DevOps environments to deliver solutions in iterative sprintsCollaborate on successful pilots with bottlers and measure valueRequirements : 10 years of relevant experienceStrong knowledge of data management principlesHands-on experience with Azure technologies, including Azure Storage, Azure Data Factory, PySpark, Python, Azure Data Lake, Azure Cosmos DB, Azure Stream AnalyticsExperience with structured and unstructured dataFamiliarity with ETL pipelinesAbility to adapt to changing priorities and scopesStrong communication, problem-solving, and collaboration skillsDemonstrated commitment to diversity and inclusionJoin a dynamic and innovative team where you'll have the opportunity to work on exciting projects and shape the future of data engineering.Interested? Apply today or share with someone who would be a great fit!