What are the responsibilities and job description for the Staff Data Engineer position at TMS, LLC?
Role: Staff Data Engineer
Location: Austin, TX (Day 1 Onsite and need only local candidates to TX)
Duration: 12 Months
Experience: 12 Years
Note: AWS Certification is mandatory for this role
Responsibilities
Location: Austin, TX (Day 1 Onsite and need only local candidates to TX)
Duration: 12 Months
Experience: 12 Years
Note: AWS Certification is mandatory for this role
Responsibilities
- Data Architecture: Design, develop, and maintain scalable data architectures and pipelines on AWS to support data analytics and business intelligence.
- ETL Processes: Build and manage ETL processes to extract, transform, and load data from various sources into data warehouses and data lakes.
- Data Integration: Integrate data from multiple sources, ensuring data quality, consistency, and security.
- Performance Optimization: Optimize data processing workflows for performance, scalability, and cost-efficiency.
- Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
- Monitoring: Implement monitoring and alerting systems to ensure data pipeline reliability and performance.
- Documentation: Maintain comprehensive documentation of data architectures, pipelines, and processes.
- Education: Bachelor/Master’s degree in computer science, Engineering, or a related field.
- Experience:
- 10 years of experience in data engineering, with a focus on AWS-based solutions.
- Proven experience in designing and implementing data pipelines and architectures.
- Technical Skills:
- AWS Services: Proficiency in AWS services such as S3, Redshift, Glue, Lambda, EMR, and RDS.
- Programming Languages: Strong programming skills in Python.
- Big Data Technologies: Experience with big data technologies like Hadoop, Spark, and Kafka.
- Database Management: Proficiency in SQL and NoSQL databases.
- Data Modeling: Strong understanding of data modeling, data warehousing, and data lake concepts.
- DevOps: Familiarity with DevOps practices and tools (e.g., Docker, Kubernetes, Jenkins).
- Security: Knowledge of data security best practices and compliance requirements.
- Certifications:
- AWS Certified Data Engineer - Associate
- AWS Certified Data Analytics – Specialty
- Problem-Solving: Strong analytical and problem-solving skills.
- Communication: Excellent communication and interpersonal skills to interact with various stakeholders.
- Teamwork: Ability to work effectively in a collaborative team environment.
- Adaptability: Flexibility to adapt to changing business requirements and technologies.
