Data Engineer

Direct Client – Job Opportunity for Data Engineer - Onsite Interview at Fort Worth, TX is a must.

Job Title: Data Engineer - Onsite Interview

Location: Fort Worth, TX ( Onsite Interview Hybrid Work )

Contract: Long term extendable Contract

KEY FACTORS FOR SUCCESS: Skills we are looking for.

• Databricks with Pyspark
• Worked on Databricks atleast in last few projects)
• SQL and Python
• Azure and ADF

Description:

• Work closely with source data application teams and product owners to design, implement and support analytics solutions that provide insights to make better decisions
• Implement data migration and data engineering solutions using Azure products and services: (Azure Data Lake Storage, Azure Data Factory, Azure Functions, Event Hub, Azure Stream Analytics, Azure Databricks, etc.)
• Perform multiple aspects involved in the development lifecycle – design, cloud engineering (Infrastructure, network, security, and administration), ingestion, preparation, data modeling, testing, CICD pipelines, performance tuning, deployments, consumption, BI, alerting, prod support
• Collaborate within a team environment as well as work independently
• Be a part of a DevOps team that completely owns and supports their product
• Implement batch and streaming data pipelines using cloud technologies
• Understands and follows development of coding standards, best practices and privacy and security guidelines

· Minimum Qualifications:

• 3 years software solution development using agile, DevOps, operating in a product model that includes designing, developing, and implementing large-scale applications or data engineering solutions
• 3 years data analytics experience using SQL
• 2 years of cloud development and data lake experience (prefer Microsoft Azure) including Azure EventHub, Azure Data Factory, Azure Databricks, Azure DevOps, Azure Blob Storage, Azure Data Lake, Azure Power Apps and Power BI
• Combination of Development, Administration & Support experience in several of the following tools/platforms required:
• Scripting: Python, Spark, Unix, SQL
• Data Platforms: Teradata, SQL Server, ADLS, Snowflake
• Azure Cloud Technologies: Azure Data Factory, Azure Databricks, Azure Blob Storage, Azure Data Lake, Azure Power Apps and Azure Functions
• CI/CD: GitHub, Jenkins, Azure DevOps, Terraform

All you'll need for success

Preferred Qualifications- Education & Prior Job Experience

• 3 years software solution development using agile, dev ops, product model that includes designing, developing, and implementing large-scale applications or data engineering solutions
• 3 years data analytics experience using SQL
• 3 years of cloud development and data lake experience (prefer Microsoft Azure) including Azure EventHub, Azure Data Factory, Azure Functions, ADX, ASA, Azure Databricks, Azure DevOps, Azure Blob Storage, Azure Data Lake, Azure Power Apps and Power BI
• Airline Industry Experience
• Skills, Licenses & Certifications
• Expertise with the Azure Technology stack for data management, data ingestion, capture, processing, curation and creating consumption layers
• Expertise in providing practical direction within the Azure Native cloud services
• Azure Development Track Certification (preferred)
• Spark Certification (preferred)