What are the responsibilities and job description for the Data Architect position at VLink Inc?
Job Description:
10 years of overall experience required.
Strong knowledge on data bricks architecture and tools
Deep understanding of distributed computing and how to use spark for data processing.
SQL and pyspark : strong command over querying databases and proficiency in pyspark.
Cloud platform: Preferred Azure for data bricks deployment.
Qualifications
- Bachelor's degree in Computer Science, Engineering, or related field, or equivalent work experience
- 5 years of experience in data engineering with Databricks and Spark
- Proficient in SQL and Python and Pyspark
- Experience with Azure Databricks Medallion Architecture with DLT, Iceberg
- Financial/Corporate Banking context would be a plus
- Experience with data integration and ETL tools, such as Azure Data Factory
- Experience with Azure cloud platform and services
- Experience with data warehouse and data lake concepts and architectures
- Good to have experience with big data technologies, such as Kafka, Hadoop, Hive, etc
- Strong analytical and problem-solving skills
- Excellent communication and teamwork skills