What are the responsibilities and job description for the Data Engineer position at Quiddity Infotech LLC?
Role: GCP Data Engineer
Location: Charlotte, NC (OR) Iselin, NJ (Onsite)
Preferred Locals only.
W2 Position only
Key Responsibilities:
- Extensive experience designing and delivering data solutions in Google Cloud Platform (GCP), leveraging services such as DataProc, DataFlow, BigQuery, and other GCP tools.
- Expertise in Big Data platforms (e.g., MapR, Cloudera) using technologies like HDFS, Spark, PySpark, and Hive.
- Proficiency in event-driven solutions using Java, REST APIs, Apache Flink, and Kafka technologies.
- Experience with relational and NoSQL databases, including MongoDB, SQL Server, Atlas, and Azure SQL.
- Strong familiarity with wire formats such as XML, JSON, Avro, and CSV, along with serialization/deserialization techniques.
- Knowledge of security protocols (e.g., Kerberos, JWT) and their integration into data platforms and solutions.
- Solid understanding of Agile methodologies, including writing user stories and participating in ceremonies such as sprint planning and retrospectives.
Thank you,
Arjun,
arjun@quiddityinfotech.com
