What are the responsibilities and job description for the Kafka Admin position at SysMind Tech?
Query Snowflake DB from standalone tools like Kafka Connectors, APIs, Bash Scripts
- Perform Read / Write CRUD operations on Snowflake (viz. Warehouse, Schema, DB, Tables, Views)
- Integrate ETL process with Snowflake leveraging Dataops pipeline concept
- Able to write Python / Scala code to load / index data from Snowflake via OAuth2.0 connectivity
- Setup on-prem monitoring & HealthCheck's on Azure Snowflake instances viz. Grafana / Prometheus, ApplicationInsights
- Creation of Kafka Topics, Zookeeper instances viz. KafkaConnector implementation
- Configuring index pipeline & setup Kafka based indexing (Partial updates / inserts)
- Configuring Kafka Connector to read Streaming Data from Topics & ingest data into Snowflake DB
- Error handling - retry / replay of connectors if upstream / downstream system fails. Report errors via Splunk dashboards, Skype / Symphony notifications
