What are the responsibilities and job description for the Staff Engineer position at Automation Technologies LLC?
Responsibilities
Develop product features to ingest and augment data about insurance Claims, Providers, Billing, Legal, Medical Images, etc from multiple sources.
Build frameworks to handle data at high scale using technologies like Apache Spark and data cataloging tools like Apache Hive, AWS Glue on top of a multi-tiered data lake storage.
Use exploration and analytic tools like Apache Zeppelin, AWS Athena / Presto on top of Apache Hive to probe and validate data.
Build ETL pipelines using Apache Airflow and integrate with multiple components and data sources and sinks.
Be an ardent code contributor to multiple product domains spanning insurance Claims, Bills, Providers and Attorneys affiliated with the claim to augment the data and help with Feature Engineering work for the AI modules.
Design and architect new product features and be a strong proponent of using up-to-date tools and help the team adopt such tools.
Qualifications & Experience
Candidates with 5 years’ experience in data engineering, who have either obtained a Graduate degree in the field of Computer Science or related field, or Bachelor's degree with 7 years of relevant experience in the above fields.
Experience with the following software / tools is highly desired :
Apache Spark, Kafka, Hive, etc.
SQL and NoSQL databases like MySQL, Postgres, DynamoDB.
Familiarity with Spark programming paradigms (batch and stream-processing).
RESTful API services.
Strong programming skills in at least one of the following languages : Java, Scala, C . Familiarity with a scripting language like Python as well as Unix / Linux shells.
Experience implementing software around data processing, metadata management, ETL pipeline tools like Airflow.
Experience working with cross-functional teams in a fast-paced environment.
Knowledge of healthcare data pertaining to insurance claims is helpful.
Ability to translate data needs into detailed functional and technical designs for development, testing and implementation.
Ability to identify and communicate risks and issues affecting business rules, functional requirements and specifications.
Ability to serve as a liaison between technical, quality assurance and non-technical stakeholders throughout the development and deployment process.
Keep a pulse on the job market with advanced job matching technology.
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution.
Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right.
Surveys & Data Sets
What is the career path for a Staff Engineer?
Sign up to receive alerts about other jobs on the Staff Engineer career path by checking the boxes next to the positions that interest you.