What are the responsibilities and job description for the AWS Data Engineer position at Numentica LLC?
Job Description
Job Description
This is a remote position.
No C2C only W2
- Hands on experience leading large-scale global data warehousing and analytics projects
- Hands-on technologist fluent in Python and other relevant languages
- Strong experience in Pyspark, Redshift.
- Strong experience in SQL query and optimizations.
- Complete working knowledge and experience of Amazon DynamoDB, serverless NoSQL database
- Experience as a data engineer with AWS Redshift
- Experience with serverless data integration like Glue, AWS S3
- Experience with AWS Aurora and other relational database management systems.
- Experience in developing and maintaining Extract, Transform, Load (ETL) processes to ingest, clean, and transform data from various sources into a format suitable for analysis and reporting.
- Experience in creating and managing data models, data warehouses, and data lakes to support both structured and unstructured data
- Experience in implementing data governance and data quality standards to ensure data accuracy, consistency, and compliance with regulations.
- Deep knowledge of integration patterns & technologies and experience designing and implementing integrated, distributed systems
- Experience in Monitoring and optimizing data pipelines, queries, and database performance to meet the demands of real-time analytics and reporting.
- Knowledge of distributed systems & services, messaging, object orientation, database solutions, web application development, security, and open-source technologies
- Knowledge of design patterns and architectural concepts including microservices, low latency systems, data warehousing, APIs, event brokers, and cloud services, preferably AWS (Amazon Web Services)
- Provide guidance and mentorship to junior data engineers and team members, sharing best practices and fostering a culture of continuous learning.
