What are the responsibilities and job description for the Data Scientist position at Luna Data Solutions, Inc.?
Job Details
We are currently seeking a qualified Data Reconciliation specialist with a proven track record in managing and supporting large-scale data reconciliation testing projects, particularly involving Oracle and SQL Server environments. This will be a long-term contract position in Austin, TX with a hybrid work setting of 2 days onsite. (To be considered, you must currently reside in the Austin metropolitan area).
The ideal consultant will have a strong background in large-scale data reconciliation, performance optimization, and data integrity validation, focusing on testing and ensuring the accuracy and completeness of conversion data. If selected, you will assist the client by providing guidance, frameworks, and tools to address challenges in data comparison and validation.
Description of Duties: Data Reconciliation Strategy:
- Provide strategies to ensure accurate and efficient data reconciliation between Oracle to SQL Server environments.
- Recommend best practices for comparing millions of converted data rows and validating data integrity.
Data Validation & Testing:
- Deliver efficient and scalable data comparison techniques to validate data accuracy post-migration.
- Propose solutions for data chunking, batch processing, and data hashing to address memory and performance challenges.
- Automate data validation processes to reduce manual intervention and improve testing efficiency.
- Perform detailed data reconciliation testing to identify discrepancies such as mismatches, missing rows, or invalid data.
Scalable Testing Approaches:
- Design methods for incremental data validation and parallelized comparison tasks.
- Suggest solutions to enhance scalability and performance.
- Support in performance tuning of SQL queries to optimize data comparison processes.
Best Practices & Frameworks:
- Recommend tools and frameworks for handling large-scale data comparisons in Oracle and SQL Server.
- Share case studies or examples of successful large-scale data reconciliation testing projects.
Collaboration and Knowledge Transfer:
- Provide training and mentorship to client teams on data governance, validation strategies, and scalable testing practices.
Required Minimum Qualifications:
- 8 yrs. of demonstrated expertise in enterprise data management, ETL processes, and large-scale data reconciliation testing projects.
- 8 yrs. of work experience with Oracle, SQL Server, SSIS, and T-SQL scripting.
- 8 yrs. of experience in data reconciliation, automated testing, and performance tuning of SQL queries.
- 8 yrs. of work experience with data validation, chunking, batch processing, and data hashing techniques.
- 5 yrs. experience providing utilizing methodologies, frameworks, and tools that support large-scale data comparison.
- 5 yrs. of experience with automation tools and scalable testing frameworks.
- 5 yrs. of work experience in data auditing and monitoring tools.
- Current resident of the Austin Metropolitan area with reliable transportation to Austin, TX.
What We Offer:
- Competitive compensation
- Generous benefits package including Medical, Dental, Vision, Short-Term Disability, Critical Illness insurance options and more
- Hybrid Work Setting
This is a long-term contract opportunity in Austin, TX and no sponsorship can be provided. Candidates must be able to pass a background check. Luna Data Solutions, Inc. provides equal employment opportunities to all employees. All applicants will be considered for employment and prohibits discrimination and harassment of any type without regard to age, race, color, religion, sexual orientation, gender identity, sex, national origin, genetics, protected veteran status, and/or disability status.