Senior Software Engineer

Senior Software Engineer - Data Technologies Senior Software Engineer - Data Technologies, Multiple Openings: Clifton Park, NY, & various unanticipated client sites throughout U.S. SME interactions, gather, analyze and validate requirements. Design conceptual, logical and physical data models, writing complex SQL queries, create datasets, linked services, and pipelines. Create data models adhering to PPDM and UDM standards, using SQL data modeler/Infosphere Data Architect. Ingest source data from various relational and non-relational data sources into Azure Data Lake and Azure Synapse using ADF pipelines. Handle large datasets using Partitions, Spark in Memory capabilities, Broadcasts in Spark, effective & efficient Joins and Transformations during data ingestion process itself. Develop Spark applications using Spark-SQL in Data bricks for ETL to uncover the insights into customer usage patterns. Optimize code for business requirements and convert a large volume of data into required ready-to-use information. Requires minimum of MS or equiv. in CS, CIS, IT-related engineering, or related. Extended travel and/or relocation throughout U.S. $115,500 per year. Mail resumes to: Kloudhive LLC, 1 Barney Road, Ste 248, Clifton Park, NY 12065, or email resumes to careers@kloudhive.com.