What are the responsibilities and job description for the Sr. Data Engineer - Locals position at radient.ai?
Job Details
Job Description:
1. Design and implementation of Data Pipeline authoring and deployment framework using cloud native technologies - composer, dataflow, bigquery and vertex ai
2. Implement feature generation pipelines for models
3. Implement training data generation pipelines for models
4. Implement data pipeline observability and data quality monitoring
Special Requirements
Dynamic server-side OOP languages; Scala, Java, C , PHP, Python, Perl, Ruby, or similar; design patterns, algorithms, statistics, programming languages, networking and operating systems; web application internals and common technologies; deployment strategies
Production infrastructure:
Kafka, BigQuery, Dataflow, Spark, Akka-Http, GRPC, BigTable, JavaScript frameworks; application scalability at any application tier; SQL, relational database schema design and ORM technologies; and Agile/Scrum practices.