What are the responsibilities and job description for the Senior Data Engineer position at True Tech Professionals?
Job Title: Senior Data Engineer
Location: Parsippany-Troy Hills, New Jersey
Engagement: 5 days a week, on-site (office-based)
Key Responsibilities:
- Design and develop scalable ETL workflows using PySpark and Python.
- Build and optimize complex SQL queries for efficient data transformation and reporting.
- Leverage AWS Cloud services (S3, Glue, Redshift, Lambda) to manage and automate data processes.
- Integrate and manage cross-cloud operations using Oracle Cloud Infrastructure (OCI).
- Collaborate on hybrid cloud solutions between AWS and OCI for seamless data processing.
- Ensure performance optimization, scalability, and reliability of data pipelines.
- Maintain and enforce data quality, security, and governance standards across platforms.
- Lead efforts to troubleshoot, debug, and optimize large-scale data solutions.
Qualifications:
- 5 years of experience as a Data Engineer or similar role.
- Advanced expertise in designing and implementing ETL pipelines using PySpark.
- Proficient in scripting and building data workflows with Python.
- Strong expertise in writing and optimizing complex queries using SQL.
- In-depth knowledge of AWS Cloud services (S3, Redshift, Glue, Lambda).
- Hands-on experience with Oracle Cloud Infrastructure (OCI) and cross-cloud integrations.
- Practical experience with big data frameworks and data processing pipelines.
- Familiarity with data governance standards, including security, quality, and compliance.
- Exposure to CI/CD pipelines and automated deployments (preferred).
Good to Have:
- Adaptability to new challenges and changing conditions.
- Strong problem-solving skills with the ability to brainstorm effective solutions.
- Collaborative mindset, working seamlessly within cross-functional teams.
- Excellent time management and task prioritization skills.
- Innovative thinking and ability to propose creative solutions.
- Willingness to travel as needed.
What We Offer:
- Opportunities for national and international business travel to expand your professional network and gain global industry insights.
- A culture that prioritizes knowledge sharing and ongoing professional development through structured training programs.
- A modern, vibrant work environment that fosters creativity and innovation.
- Opportunities to contribute to the industry through activities like writing books and participating in leading conferences.
- International assignments offering significant career advancement and global exposure.
- Relocation opportunities for personal and professional growth across new geographies and cultural landscapes.
Salary : $106,600 - $144,800