342 senior data engineer Jobs in dallas, tx
Coforge is Hiring a Senior Data Engineer Near Dallas, TX
Job Title: Senior Data Engineer
Skills: Snowflake, Data Analysis & Data Modeling
Experience: 8-10 Years
Location: Dallas, TX
Job Type: Full-time
We at Coforge are Senior Data Engineer with the following skillset:
- A Senior Data Engineer is proficient in the development of all aspects of data processing including data warehouse architecture/modeling and ETL processing. The position focuses on development and delivery of analytical solutions using various tools including AWS Glue, Coalesce, Airflow, Snowflake and AWS.
- Data Engineer must be able to work autonomously with little guidance or instruction to deliver business value.
- Bachelor’s degree in computer science or MIS related area required or equivalent experience (industry experience substitutable).
- 6-8 years of total experience in Data engineering/Cloud development activity.
- 1 years of experience in Banking and financial domain is Nice to have.
- Must be extremely proficient in Data Warehouse ETL Design/Architecture, dimensional/relational data modeling.
- Experience in at least one ETL development project, writing/analyzing complex stored procedures.
- Entry-level to intermediate experience in Python/Py Spark – working knowledge on Spark/pandas data frame, Spark multi-threading, exception handling, familiarity with different boto3 libraries, data transformation and ingestion methods, ability to write UDF.
- Familiarity with Snowflake – Familiarity with stages and external tables, commands in snowflake like copy, unload data to/from S3, working knowledge of variant data type, flattening nested structure through SQL, familiarity with marketplace integrations, role-based masking, pipes, data cloning, logs, user and role management is nice to have.
- Familiarity with Coalesce/dbt is an added advantage for this job.
- Collibra integration experience for Data Quality and Governance in ETL.
- AWS – Should have hands-on experience with S3, Glue (jobs, triggers, workflow, catalog, connectors, crawlers), CloudWatch, RDS and Secrets Manager.
- Knowledge of AWS VPC, IAM, Lambda, SNS, SQS, and MWAA is a plus.
- Hands-on experience with version control tools like GitHub and working knowledge of configuring CI/CD pipelines using YAML and pip files.
- Streaming Services – Familiarity with Confluent Kafka or Spark Streaming, or Kinesis (or equivalent) is nice to have.
- Experience with Data Vault 2.0 (hubs, satellites, links) is a plus.
- Highly proficient in Publisher, PowerPoint, SharePoint, Visio, Confluence and Azure DevOps.
- Working knowledge of best practices in value-driven development (requirements management, prototyping, hypothesis-driven.
Job Summary
Full Time
$117k-144k (estimate)
08/27/2024
09/14/2024
niit-aasha.com
3,000 - 7,500
2004
SUDHIR SINGH
$200M - $500M
IT Outsourcing & Consulting
Related Companies
The following is the career advancement route for Senior Data Engineer positions, which can be used as a reference in future career path planning. As a Senior Data Engineer, it can be promoted into senior positions as a Database Engineer IV that are expected to handle more key tasks, people in this role will get a higher salary paid than an ordinary Senior Data Engineer. You can explore the career advancement for a Senior Data Engineer below and select your interested title to get hiring information.
If you are interested in becoming a Senior Data Engineer, you need to understand the job requirements and the detailed related responsibilities. Of course, a good educational background and an applicable major will also help in job hunting. Below are some tips on how to become a Senior Data Engineer for your reference.
Step 1: Understand the job description and responsibilities of an Accountant.
Quotes from people on Senior Data Engineer job description and responsibilities
The Senior Data Engineer builds data processing frameworks that handle the business’s growing database.
03/09/2022: Billings, MT
The Senior Data Engineer owns and extends the business’s data pipeline through the collection, storage, processing, and transformation of large data-sets.
01/05/2022: Melbourne, FL
Create architecture for real-time, big data applications with minimal maintenance effort.
03/23/2022: Benton Harbor, MI
Work with both structured and unstructured data, with focus on ETL (Extract, Transfer, Load) and stabilizing pipelines and code.
01/22/2022: Greenville, MS
Provides successful deployment and provisioning of data solutions to production or other required environments.
01/12/2022: Dothan, AL
Step 2: Knowing the best tips for becoming an Accountant can help you explore the needs of the position and prepare for the job-related knowledge well ahead of time.
Career tips from people on Senior Data Engineer jobs
Apply for an entry-level data engineer role and gain experience.
02/06/2022: Providence, RI
Earn a bachelor’s degree related to data engineering and begin working on projects.
02/16/2022: Denver, CO
Consider pursuing additional professional engineering or big data certifications.
03/06/2022: Raleigh, NC
Gain knowledge with new data architecture principles and concepts, thorough understanding of layered systems architectures.
01/24/2022: Abilene, TX
Senior data engineers should also have an understanding of other programming languages that help with statistical analysis and modeling, such as Python.
01/02/2022: New York, NY
Step 3: View the best colleges and universities for Senior Data Engineer.
