What are the responsibilities and job description for the Software Engineer — Data Engineer position at Intellibus?
Imagine working at Intellibus to engineer platforms that impact billions of lives around the world. With your passion and focus we will accomplish great things together!
Our Platform Engineering Team is working to solve the Multiplicity Problem. We are trusted by some of the most reputable and established FinTech Firms. Recently, our team has spearheaded the Conversion & Go Live of apps that support the backbone of the Financial Trading Industry.
Are you a data enthusiast with a natural ability for analytics? We’re looking forward skilled Data/Analytics Engineers to fill multiple roles for our exciting new client. This is your chance to shine, demonstrating your dedication and commitment in a role that promises both challenge and reward.
What We Offer:
A dynamic environment where your skills will make a direct impact. The opportunity to work with cutting-edge technologies and innovative projects. A collaborative team that values your passion and focus.
We are looking for Engineers who can
- Implement ETL Processes: Use Azure tools and services for ETL (Extract, Transform, Load) processes.
- Manage Data Assets: Utilize Microsoft Azure cloud data platform, including Azure Data Lake Storage Gen2, Azure Synapse Analytics, and Azure Data Factory.
- Develop and Maintain Data Pipelines: Ingest, transform, and load data from various sources into our data warehouse.
- Design Data Models: Create efficient data models and schemas within Azure for reporting, analytics, and business intelligence.
- Integrate Systems: Connect Azure with external systems and data sources, including on-premises databases, cloud storage, and third-party APIs.
- Monitor and Optimize Queries: Use query profiling and optimization techniques to improve performance and resource utilization.
- Resolve Bottlenecks: Identify and resolve performance issues, optimizing data warehouse configurations.
- Data Modeling and SQL Tuning: Work on data modeling and perform SQL performance tuning and database optimization.
- Implement Security Measures: Apply data security measures such as Data Masking, Encryption, and Tokenization.
- Develop Workflows: Manage data pipelines and workflows using tools like Airflow.
- Collaborate and Mentor: Work with cross-functional teams to integrate Azure and PowerBI, and mentor junior developers.
Key Skills & Qualifications:
Education: Bachelor’s degree in Computer Science, Engineering, or a related field is preferred. Relevant work experience may be considered in lieu of a degree.
- ETL: Extensive experience with ETL processes for data integration.
- SQL: Strong SQL skills for querying and data manipulation.
- Python: Proficient in Python, especially with Azure SDKs, JSON handling, and dictionary operations.
- Unix: Competent in Unix for file operations, searches, and regular expressions.
- Azure: Deep expertise in Azure services including Data Factory, Synapse Analytics, Blob Storage, and Logic Apps for scalable cloud solutions.
- Database Modeling: Solid understanding of database design principles, including logical and physical data models, and change data capture (CDC) mechanisms.
- PowerBI: Experience in integrating and leveraging PowerBI for business intelligence and reporting needs.
- Airflow: Fundamental knowledge of Airflow for orchestrating complex data workflows and setting up automated pipelines.
We work closely with
- Data Wrangling
- Azure
- Power BI
- ETL
- Talend
- Jasper
- Java
- Python
- Unix
- AWS
- Data Warehousing
- Data Modeling
- Database Migration
- RBAC model
- Data migration
Our Process
- Schedule a 15 min Video Call with someone from our Team
- 4 Proctored GQ Tests (< 2 hours)
- 30-45 min Final Video Interview
- Receive Job Offer
If you are interested in reaching out to us, please apply and our team will contact you within the hour.
