What are the responsibilities and job description for the Data Engineer position at CYNET SYSTEMS?
Job Description
Job Description
Job Description :
Pay Range : $55hr - $60hr
- Should have experience in using Pyspark.
- Working experience on KUSTO for telemetry data.
- Should be able to write python code in Azure Synapse Notebook.
- Good understanding & working experience of Azure Synapse end-to-end.
- Should have experience in working with Spark ( structured streaming data - possibly from Event hubs).
- Should have experience in handing large volume of data (possibly in 100s of GB).
- Should be able to debug and fine tune the jobs / notebook for optimum memory consumption and processing.
- Should have knowledge of Data warehousing, data management for efficient data handling.
- Should have good knowledge of data modeling & data engineering work.
- Experience working with large data sets using SQL / Azure Data. Lake / PySpark / ADF / Synapse, etc., to derive actionable insights is highly desirable.
- They should be productive soonest possible post joining.
Nice To Have :
Salary : $55 - $60