What are the responsibilities and job description for the Big Data Architect position at Star HRM?
Company Description
www.Starhrm.com
Job Description
Job Description
Responsibilities:
- Validate the reference architecture and provide details and shared ownership for the architecture of our next generation data warehousing system, leading and working hands-on towards implementation and delivery to production
- Help lead the charge on a data warehouse/operational data store strategy, ensuring rapid delivery while taking responsibility for applying standards, principles, theories, and concepts
- Responsible for design and delivery of data models, which power BI initiatives, dashboards, syndicated reporting, and ad-hoc data exploratory canvases for IMS solutions
- Work with data architects on the logical data models and physical database designs optimized for performance, availability and reliability
- Tuning and optimization of backend and frontend data operations
- Serve as a query tuning and optimization technical expert, providing feedback to team
- Design and develop ETL and master data management processes
- Scripting and automation to support development, QA and production database environments and deployments to production
- Define and help enforce data governance and security policy
- Mentors development team members
- Proactively helps to resolve difficult technical issues
- Provide technical knowledge to teams during project discovery and architecture phases
- Keep management informed of work activities and schedules
- Assess new initiatives to determine the work effort and estimate the necessary time-to-completion
- Document new development, procedures or test plans as needed
- Participate in data builds and deployment efforts
- Participate in projects through various phases
- Performs other related duties as assigned
- Partner with the business units to develop effective solutions that solve business challenges
Required Experience (in order of importance):
- Hadoop, Hive, Impala, and related technologies
- Spark
- MPP, shared nothing database systems, NoSQL systems
- Lambda architectures
- Linux
- Data Warehousing design and concepts
Minimum Education, Experience, & Specialized Knowledge Required:
- Computer Science Degree
- 5 years strong native SQL skills
- 5 years strong experience in database and data warehousing concepts and techniques. Must understand: relational and dimensional modeling, star/snowflake schema design, BI, Data Warehouse operating environments and related technologies, and ETL, MDM, and data governance practices.
- 5 years experience working in Linux
- 3 years experience with Hadoop, Hive, Impala, HBase, and related technologies
- 2 years strong experience with low latency (near real time) systems and working with Tb data sets, loading and processing billions of records per day
- 1 years experience with MapReduce/YARN
- 1 years experience with Spark
- 1 years experience with Lambda architectures
- 1 years experience with MPP, shared nothing database systems, and NoSQL systems
- Ability to work in a fast-paced, team oriented environment
- Ability to complete the full lifecycle of software development and deliver on time
- Ability to work with end-users to gather requirements and convert them to working documents
- Strong interpersonal skills, including a positive, solution-oriented attitude
- Must be passionate, flexible and innovative in utilizing the tools, their experience, and any other resources, to effectively deliver to very challenging and always changing business requirements with continuous success
- Must be able to interface with various solution/business areas to understand the requirements and prepare documentation to support development
- Healthcare experience is a plus
Qualifications
Bachelors Degree
Additional Information
All your information will be kept confidential according to EEO guidelines.
