16 Data Engineer Jobs in Louisville, KY
Smart IT Frame LLC is Hiring a Data Engineer Near Louisville, KY
Job Title: Azure Data Engineer
Location – Louisville, KY(Hybrid)
Job Description:
We are seeking a skilled Azure Data Engineer to join our dynamic data engineering team. The ideal candidate will be responsible for designing, developing, and implementing data solutions on Microsoft Azure, enabling the storage, processing, and analysis of large-scale data. This role requires strong expertise in Azure data services such as Azure Data Lake Storage, Azure Databricks, Azure Data Lake, and Azure Synapse Analytics, along with programming skills in Python and PySpark.
Key Responsibilities:
Design, build, and maintain scalable data pipelines and architectures on Azure cloud services.
Develop and optimize data processing workflows using Azure Data Lake Storage, Azure Databricks, and Azure Synapse.
Implement ETL (Extract, Transform, Load) processes with Azure Data Factory and other Azure tools to efficiently move and transform data.
Manage and configure storage solutions such as Azure Blob Storage and Azure Data Lake for optimal data access and security.
Utilize Azure Data Explorer to perform data exploration and interactive analysis on large datasets.
Write optimized code using Python and PySpark for data transformation, aggregation, and processing.
Work closely with cross-functional teams, including data scientists, BI developers, and software engineers, to support their data needs.
Ensure data security, governance, and compliance with best practices and regulatory requirements.
Monitor and troubleshoot data pipelines and storage environments for performance issues.
Collaborate in building and improving data models, ensuring data quality and consistency.
Required Skills and Qualifications:
Bachelor's degree in Computer Science, Information Technology, or a related field.
3 years of experience as a Data Engineer, with a focus on Azure data services.
Expertise in Azure Data Lake Storage, Azure Databricks, and Azure Data Lake.
Proficient in Azure Data Factory for building ETL pipelines.
Strong hands-on experience with Azure Blob Storage, Azure Synapse Analytics, and Azure Data Explorer.
Advanced programming skills in Python and PySpark.
Experience with large-scale data ingestion, transformation, and storage.
Solid understanding of data governance, data security, and compliance in a cloud environment.
Ability to work with structured and unstructured data.
Strong problem-solving skills and attention to detail.
Preferred Skills:
Familiarity with CI/CD pipelines for data workflows.
Knowledge of SQL, T-SQL, and other database management systems.
Experience with Azure DevOps or other CI/CD platforms.
Data visualization experience using Power BI or similar tools.
Job Summary
Contractor
$86k-111k (estimate)
09/11/2024
10/09/2024
smartitframe.com
Somerset, NJ
<25
Related Companies
The job skills required for Data Engineer include SQL, Python, Data Engineering, Computer Science, Analysis, Azure, etc. Having related job skills and expertise will give you an advantage when applying to be a Data Engineer. That makes you unique and can impact how much salary you can get paid. Below are job openings related to skills required by Data Engineer. Select any job title you are interested in and start to search job requirements.
The following is the career advancement route for Data Engineer positions, which can be used as a reference in future career path planning. As a Data Engineer, it can be promoted into senior positions as a Database Engineer III that are expected to handle more key tasks, people in this role will get a higher salary paid than an ordinary Data Engineer. You can explore the career advancement for a Data Engineer below and select your interested title to get hiring information.
If you are interested in becoming a Data Engineer, you need to understand the job requirements and the detailed related responsibilities. Of course, a good educational background and an applicable major will also help in job hunting. Below are some tips on how to become a Data Engineer for your reference.
Step 1: Understand the job description and responsibilities of an Accountant.
Quotes from people on Data Engineer job description and responsibilities
The data engineer develops and maintains the enterprise data framework for continued use.
03/12/2022: Dothan, AL
A data engineer prepares data for analytical or operational uses.
03/03/2022: Boulder, CO
Data engineers simplify complex data structure and prevent the reduplication of data.
03/28/2022: New Suffolk, NY
Data Engineers are the technical professionals who prepare data that can be used by data scientists for valuable decisions and strategies.
04/13/2022: Harrisburg, PA
Step 2: Knowing the best tips for becoming an Accountant can help you explore the needs of the position and prepare for the job-related knowledge well ahead of time.
Career tips from people on Data Engineer jobs
Changing oil, running basic checks, topping off fluids and checking tire pressure are common job duties.
01/22/2022: Fort Wayne, IN
Oil changes are an essential component of preventative maintenance.
02/26/2022: Newark, NJ
A data engineer should be aligned with a data scientist’s needs while creating a data system.
04/10/2022: Fayetteville, NC
Start with an entry-level position.
02/10/2022: Winston Salem, NC
Consider pursuing additional professional engineering or big data certifications.
03/09/2022: Saginaw, MI
Step 3: View the best colleges and universities for Data Engineer.
Similar Jobs
Popular Articles
