What are the responsibilities and job description for the Junior Data Engineer position at Talent Groups?
Duration: 5 months to start
Job Description
Job Description
- Develop and implement a HIPAA compliant cloud-based data aggregation system.
- Design and develop ETL processes based on AWS Athena Lake and MS SQL platform
- Automate ETL solutions for data cleansing, validation, preparation and related processes using tools as AWS Glue, AWS data quality and Lambda
- Build operational dashboards to monitor data aggregation process using custom function and PowerBI
- Strong SQL skills including all complex queries, stored procedures, performance tuning
- Some of SQL functions like window function and analytic functions
- AI Knowledge - Need good knowledge on LLM and how to using LLM on common use cases like RAG and classification, data feature extraction
