859 Senior Data Engineer Jobs in Austin, TX
Softrams is Hiring a Senior Data Engineer Near Austin, TX
Recognized as a Top Workplace USA (2024)Recognized as one of the Top Workplaces in Technology (2023, 2021) INC 5000, Fastest growing companies in America (2023, 2022) Washington Business Journal Top 75 Fastest Growing Companies in Greater Washington area 2020 NXT UP - Top Federal Emerging Technology and consulting firms 2020 Inaugural DC Metro’s Most Successful Companies 2020 Washington Technology Fast 50 NVTC Tech 100 (2020, 2019) Job DescriptionSoftrams is seeking a Data Engineer for a position in federal health IT solutions.The selected candidate will wrangle large, complex datasets and set up data pipelines to provide select data for quality analysis and network with appropriate internal sources to gather and/or exchange data on specialized matters.
This position requires a combination of technical expertise, strong problem-solving skills, and a comprehensive understanding of data engineering within a cloud environment. The ideal candidate will play a key role in building and maintaining robust data pipelines and infrastructure, ensuring the availability, quality, and security of data to support business intelligence and advanced analytics initiatives.
Federal Requirements:
- Ability to obtain a U.S. Federal Position of Trust clearance designation.
- Must reside in and be able to perform work in the United States.
- Must have lived in the United States for 3 of the last 5 years.
- Master's degree in computer science, Data Engineering, or a related field with a minimum of 4 years of experience in data engineering (PhD is a plus).
- At least 5 years of experience in programming with Python, focusing on data engineering tasks and scripting.
- A minimum of 3 years of hands-on experience with Apache Spark for large-scale data processing, including building data visualizations using PySpark and Jupyter Notebooks.
- Proficiency in data manipulation and analysis using Python libraries such as NumPy and Pandas.
- Proven expertise in designing and managing data pipelines using AWS services, including AWS EMR and AWS S3.
- 4 years of experience working with relational databases and AWS Redshift, with a strong understanding of SQL for data manipulation and querying.
- At least 2 years of experience utilizing Jupyter Notebooks for data exploration, analysis, visualization, and collaboration.
- Strong knowledge of handling various data formats, including CSVs and Parquet files.
- Extensive experience with cloud infrastructure, specifically AWS, and a thorough understanding of its services and capabilities.
- 2 years of experience in Scala programming.
- Familiarity with EMR Studios and Anaconda for data engineering and analytics.
- Experience working with AWS Bedrock and other LLM SaaS platforms (such as OpenAI or similar) for AI/ML projects.
- Proven experience in curating datasets for use in DAGs or model training processes.
- Background in data engineering within the healthcare domain, particularly with administrative claims data or health insurance claims data.
- Knowledge of CMS (Center for Medicare and Medicaid Services) protocols and experience with CMS’s Integrated Data Repository (IDR).
- Understanding of the Hadoop ecosystem and distributed computing concepts.
- Develop, implement, and optimize scalable data pipelines on AWS to ensure efficient processing and storage of large datasets.
- Collaborate with cross-functional teams to define data requirements and establish effective data governance frameworks.
- Design and maintain robust data infrastructure to support diverse data workloads, including batch processing using AWS EMR.
- Manage large volumes of structured and unstructured data, utilizing AWS S3 and AWS Redshift for efficient storage and querying.
- Create, maintain, and enhance data ingestion processes using Apache Spark to ensure data quality, integrity, and consistency.
- Utilize PySpark and Jupyter Notebooks to build data visualizations that support data-driven decision-making and provide insights.
- Work closely with stakeholders to understand data needs and develop innovative solutions that drive data-driven decision-making.
- Utilize Jupyter Notebooks for data exploration, visualization, and sharing of insights to support data science and analytics efforts.
- Implement and enforce best practices for data security and compliance, particularly when handling sensitive healthcare data.
- 65%-75% company-sponsored (including dependents) premiums towards medical, dental and vision insurance. For eligible plans and tiers, we provide 100% company-paid medical insurance. 100% employer sponsored STD, LTD and life insurance (min $100K). Voluntary life insurance option available.
- Retirement 401(k) plan with employer matching. Immediate vesting.
- Vacation and sick leave.
- Maternity and parental leave.
- Discretionary bonuses, spot awards, gifts, and tenure-based rewards.
- Company-sponsored role-based training and certifications.
- Monthly DoordashDashPass subscription.
- Group discounts via LifeMart ADP
Work Location:We have open-collaboration offices in Leesburg VA and Baltimore MD for those who may prefer to work on-site. However, Softrams is a 100% remote-first team environment. Softrams works in the eastern time zone and standard work hours are 9am ET to 5pm ET with flexibility around start and end times based on team needs.
About SoftramsSoftrams is a Maryland and Virginia-based small business information technology, consulting, and solutions provider specializing in emerging technologies for UX/UI, mobile apps, DevOps, big data analytics, data science, and cyber security. We offer innovative technology implementations and build customer-centric services that are simple, intuitive, scalable, efficient and usable.
EEO StatementSoftrams, LLC. is an affirmative action and equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, disability, age, sexual orientation, gender identity, national origin, veteran status, or genetic information. Softrams is committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, its services, programs, and activities. To request reasonable accommodation, or to participate in the job application or interview process, contact the Talent Acquisition Team at recruiting@softrams.com
Know your rights poster: https://www.eeoc.gov/sites/default/files/2023-06/22-088_EEOC_KnowYourRights6.12ScreenRdr.pdf
Job Summary
Full Time
$114k-141k (estimate)
09/09/2024
10/03/2024
softrams.com
Leesburg, VA
100 - 200
Related Companies
The job skills required for Senior Data Engineer include SQL, Python, Data Engineering, AWS, Computer Science, Analysis, etc. Having related job skills and expertise will give you an advantage when applying to be a Senior Data Engineer. That makes you unique and can impact how much salary you can get paid. Below are job openings related to skills required by Senior Data Engineer. Select any job title you are interested in and start to search job requirements.
The following is the career advancement route for Senior Data Engineer positions, which can be used as a reference in future career path planning. As a Senior Data Engineer, it can be promoted into senior positions as a Database Engineer IV that are expected to handle more key tasks, people in this role will get a higher salary paid than an ordinary Senior Data Engineer. You can explore the career advancement for a Senior Data Engineer below and select your interested title to get hiring information.
If you are interested in becoming a Senior Data Engineer, you need to understand the job requirements and the detailed related responsibilities. Of course, a good educational background and an applicable major will also help in job hunting. Below are some tips on how to become a Senior Data Engineer for your reference.
Step 1: Understand the job description and responsibilities of an Accountant.
Quotes from people on Senior Data Engineer job description and responsibilities
The Senior Data Engineer builds data processing frameworks that handle the business’s growing database.
03/09/2022: Billings, MT
The Senior Data Engineer owns and extends the business’s data pipeline through the collection, storage, processing, and transformation of large data-sets.
01/05/2022: Melbourne, FL
Create architecture for real-time, big data applications with minimal maintenance effort.
03/23/2022: Benton Harbor, MI
Work with both structured and unstructured data, with focus on ETL (Extract, Transfer, Load) and stabilizing pipelines and code.
01/22/2022: Greenville, MS
Provides successful deployment and provisioning of data solutions to production or other required environments.
01/12/2022: Dothan, AL
Step 2: Knowing the best tips for becoming an Accountant can help you explore the needs of the position and prepare for the job-related knowledge well ahead of time.
Career tips from people on Senior Data Engineer jobs
Apply for an entry-level data engineer role and gain experience.
02/06/2022: Providence, RI
Earn a bachelor’s degree related to data engineering and begin working on projects.
02/16/2022: Denver, CO
Consider pursuing additional professional engineering or big data certifications.
03/06/2022: Raleigh, NC
Gain knowledge with new data architecture principles and concepts, thorough understanding of layered systems architectures.
01/24/2022: Abilene, TX
Senior data engineers should also have an understanding of other programming languages that help with statistical analysis and modeling, such as Python.
01/02/2022: New York, NY
Step 3: View the best colleges and universities for Senior Data Engineer.
Similar Jobs
Popular Articles
