What are the responsibilities and job description for the Senior Software Engineer position at Kaygen, Inc.?
We are looking for a highly experienced Senior Data Engineer with over 10 years of expertise in software development, particularly in Python, to lead and implement cutting-edge data solutions for IoT devices in Azure. This role will involve ingesting data from Edge devices into Azure Data Lake Storage (ADLS), implementing robust security and governance frameworks, and creating Python-based APIs and SDKs for external data sharing.
Mandatory experience: Python API building experience( FAST API)
Azure Skills: Storage, Compute, CIC
Required Skills:
- 10 years of professional experience in software development, with a strong focus on Python.
- 5 years of experience in cloud computing with Azure .
- 5 years of experience in PySpark and Kafka streaming.
- Proven track record of developing and deploying solutions on Microsoft Azure, especially Azure Data Lake Storage, EventHub, AKS etc.
- Strong experience in developing REST APIs in Python and building SDKs in Python.
- In-depth knowledge of IoT data ingestion, device integration
- Strong understanding of data security, encryption, and governance frameworks.
- Strong experience in using GitHub for version control and collaborative development.
- Familiarity with data serialization formats (JSON, Avro, Parquet)
- Experience with API documentation tools like Swagger or Postman.
- Familiarity with Data Lakehouse concepts
- Strong problem-solving skills and attention to detail.
