Data Engineering Manager (Onsite)

Job Description

Job Description

Salary : $90,000-$120,000

About Actfore :

Trusted by over 25 insurance carriers and 35 law firms, including premier Am Law 10 and Magic Circle firms worldwide, Actfore is the only company that takes a technology-first approach to data mining for cyber incident response. With advanced AI / ML-powered data mining solutions to swiftly detect and uncover sensitive information compromised in cyber breaches, Actfore can process over 1 million files per hour, offering clients the fastest and most accurate assessment of compromised information. For two years and counting, Actfore sets new standards in the digital forensics and incident response space.

Job Summary :

We are seeking a skilled Data Engineer Manager to join our dynamic team. The ideal candidate will have experience with data integration, data architecture, and creating efficient pipelines to transform raw data into usable formats for analysis. This role requires working with millions of records to deduplicate by combining rows with unique identifiers, ensuring that the final deliverables are accurate and of high quality for our clients. You will collaborate with data scientists, analysts, and other business units to create a final deliverable that meets client expectations. You will also play a key role in managing the data pipeline processes and maintaining data quality, scalability, and strict deadlines.

Key Responsibilities :

• Collaborate with business units, data scientists, analysts, and other stakeholders to understand the types of data required, how it will be used, and ensure that it aligns with analytical goals.
• Develop logic to clean, transform, and format data into a usable state for further analysis, including tasks such as filtering, merging, aggregating, and reformatting data.
• Process large volumes of data (millions of records) and apply deduplication techniques by combining rows with unique identifiers to ensure data accuracy and integrity.
• Implement checks for data accuracy, completeness, and consistency, including validation processes that ensure new data meets expected formats and thresholds.
• Implement automated data cleaning scripts to handle repetitive data issues like missing values, duplicate records, or incorrect formatting, thus reducing the need for manual data quality checks.
• Set up custom validation rules (e.g., range checks, data type checks) to automatically detect and correct data errors during the ingestion and transformation phases.
• Collaborate with cross-functional teams to ensure data pipelines are scalable and maintainable, meeting project deadlines while addressing any issues that arise while creating the final deliverable that may affect deadlines.
• Apply data engineering best practices to ensure the efficient handling of large datasets, optimizing performance and minimizing processing time.
• Ensure deliverables meet client specifications and are produced on time, with particular attention to the accuracy and quality of data.
• Lead and manage a team of data engineers, ensuring they are meeting deadlines, delivering high-quality work, and following best practices in data engineering.
• Monitor team performance and workflow to ensure that project milestones are achieved on time, within scope, and aligned with organizational goals
• Provide mentorship, monthly performance meetings and coaching to team members, helping them to grow in their roles, improve technical skills, and resolve any technical challenges that arise.

Qualifications :

Typical Schedule :

Salary : $90,000 - $120,000