What are the responsibilities and job description for the Data Engineer/ Architect - Data Bricks position at Global Alliant Inc?
Senior Data Engineer/Architect - Remote - Full Time
Responsibilities:
As part of a team involved in a project doing data analytics to support the project team, a successful Data Engineer candidate will have the following responsibilities:
• Maintain and enhance processing pipelines using tools and frameworks in the AWS ecosystem.
• Maintain architecture specifications and detailed design documentation.
• Conduct data engineering functions including data extraction, transformation, loading, and integration in an AWS environment leveraging Snowflake and Databricks.
• Work with large data sets and other Data Engineers and Data Scientists on data analysis tasks.
• Implement and configure big data technologies as well as tune processes for performance at scale.
• Design and build ETL pipelines to automate the ingestion and data migration of structured and unstructured data.
• Work with DevOps engineers on CI, CD, and IaC (Continuous Integration, Continuous Delivery, and Infrastructure as Code) processes; read specifications and translate them into code and design documents; and perform code reviews and develop processes for improving code quality.
Basic Qualifications:
7 years' experience with Python or another OOP language.
5 years' Experience with NoSQL products, such as JSON.
5 years' Experience with Databricks.
5 years' experience with advanced SQL features - regular expressions, analytical functions (e.g., RANK, PARTITION, LEAD, LAG, etc.).
4 years' experience using a query planner and database metrics to analyze and optimize queries, table structure, indices, and partitioning strategies.
Federal Government contracting work experience.
Need very good Databricks experience
If interested in applying for this position, please reach out to me at mayuri.s@globalalliantinc.com
Our Benefits:
Competitive pay and 401K retirement saving plan
Flexible and remote work opportunities as per the client's requirement
Health care benefits (medical, dental, vision)
Tuition reimbursement
Employee Referral Program
Short term and long-term disability insurance
Flexible Savings Account
Global Alliant, Inc. provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, genetic information, marital status, amnesty, or status as a covered veteran in accordance with applicable federal, state and local laws. We especially invite women, minorities, veterans, and individuals with disabilities to apply.
