What are the responsibilities and job description for the Database Architect / Modeler - Expert position at Aditi Consulting?
Pay Rate : $80 - $90 / hr.
Summary :
We are seeking an experienced, hands-on Senior Data Engineer to join our CASM Platform team. Ideal candidates bring a deep understanding of data engineering within a cybersecurity context, extensive experience with cloud-native tools (especially AWS), and a passion for automation, security, intelligent orchestration, and resilience. You'll work in high-paced Agile Product & Engineering cross-functional teams, including Product, AI application, DevOps, and Data Quality Management (DQM), to transform the CASM platform into a single pane of glass for secure and insightful network asset and risk visibility. We have multiple openings for this role, and it is open to candidates with varying levels of experience.
Role Responsibilities
- Data Integration & API Development : Integrate diverse cybersecurity data sources using variety of API mechanisms and to standardize and streamline data across the data and user planes. Build and maintain data APIs for seamless access to data pipelines, enabling real-time insights for applications, machine learning models, and analytical layers.
- Data Pipeline Engineering & Optimization : Design, develop, and optimize large-scale ETL / ELT pipelines on Databricks to efficiently process and transform cybersecurity data. Utilize Python, PySpark, and Databricks to automate and standardize data workflows across stages (raw, cleaned, curated), ensuring scalability and high performance.
- Data Quality & Governance : Implement automated data quality checks, leveraging Databricks DQM tools and CI / CD pipelines to uphold data integrity and governance standards. Ensure data lineage, metadata management, and compliance with cybersecurity and privacy regulations, applying rigorous quality standards across data ingestion and processing workflows.
- Data Analytics & Visualization : Design centralized data models and perform in-depth data analysis to support cybersecurity and risk management objectives. Develop visualizations and dashboards using tools like Databricks, encapsulate data to spin up to React.js application layer to provide stakeholders with actionable insights into threat landscapes, vulnerability trends, and performance metrics across the platform.
- Scalable & Secure Data Architecture : Architect and manage secure, high-performance data environments on Databricks, utilizing AWS services such as S3, ELB, and Lambda. Ensure data availability, consistency, and security, aligning with AWS best practices and data encryption standards to safeguard sensitive cybersecurity data.
- Agile Product & Engineering Continuous Delivery : Collaborate with advanced Agile Product & Engineering cross-functional teams to deliver data-driven insights through analytics tools and custom visualizations that inform strategy and decision-making. Empower stakeholders with timely, actionable intelligence from complex data analyses, enhancing their ability to respond to evolving cybersecurity risks.
- Data Science & ML Integration : deploy machine learning models, including predictive analytics, anomaly detection, and risk scoring algorithms, into the CASM platform. Leverage Python and PySpark to enable real-time and batch processing of model outputs, enhancing CASM Platform's proactive threat detection and response capabilities.
- Mentorship & Best Practices Promotion : Mentor junior engineers, establishing best practices in data engineering, DevOps, data science, and analytics. Encourage high standards in model deployment, data security, performance optimization, and visualization practices, fostering a culture of innovation and excellence.
Minimum Qualifications
Preferred Experience
Compensation :
The pay rate range above is the base hourly pay range that Aditi Consulting reasonably expects to pay someone for this position (compensation may vary outside of this range depending on several factors, including but not limited to, a candidate's qualifications, skills, competencies, experience, location and end client requirements).
Benefits and Ancillaries :
Medical, dental, vision, PTO benefits and ancillaries may be available for eligible Aditi Consulting employees and vary based on the plan options selected by the employee.
Aditi Consulting LLC uses AI technology to engage candidates during the sourcing process. AI technology is used to gather data only and does not replace human-based decision making in employment decisions.
AditiConsulting
Salary : $80 - $90
