What are the responsibilities and job description for the IT Infrastructure Design - Cloud Engineer Cloud Engineer position at LanceSoft?
Job Description :
1. Data Integration and Management :
o Develop and maintain data pipelines to ingest, process, and store financial data from various sources (internal and external).
o Integrate structured and unstructured data from multiple systems such as accounting software, trading platforms, financial databases, and market feeds.
2. Database Design and Optimization :
o Build and optimize relational and non-relational databases (e.g., SQL, NoSQL) to store financial data.
o Ensure efficient querying and retrieval of financial data to support reporting and analytics.
3. Data Quality and Governance :
o Implement data quality checks to ensure data accuracy, consistency, and completeness.
o Establish and enforce data governance policies to ensure compliance with financial regulations and standards (e.g., GDPR, SOX).
4. Automation and Optimization :
o Automate repetitive data processing tasks to improve operational efficiency.
o Continuously monitor and improve the performance of data pipelines and systems to handle large volumes of financial data.
AWS and Snowflake experience is a Must. I would also like to add experience working with Oracle database is a nice to have.
Engineers in Product Platforms work collaboratively on small, autonomous teams reporting to a Development Manager. We create products or enable data consumption for end users as well as frameworks and tools used by developers across the organization. Teams and engineers are empowered to create solutions and find the right tools for the job. We use a variety of modern technologies to solve complex problems across a wide range of business domains for users all over the world.
In this Development community there are quarterly hackathons (during business hours) that all engineers are encouraged to participate in as a way of exploring new technologies and solutions outside of their assigned product and daily backlog. Additionally, there are innovation days on the last Friday of every month that all engineers are encouraged to participate in to improve their technical skills or collaborate on solutions outside of their daily backlog.
Team and project specific details :
We are looking for a candidate who has an interest in back end development, devOps, ETL, and cloud engineering. We are specifically looking for a candidate who has experience with GCP and / or AWS. We would like the candidate to have experience with ETL using the service catalogue offerings of either AWS or GCP.
Team Digital Triplet manages the data lake, modeling, and a number of cloud accounts associated with various LIMS instances. Digital Triplet will be creating a pipeline between AWS and a (new to Bayer) data warehouse in Google Big Query, configuring multiple accounts, and investigating new technologies that we could utilize to more efficiently manage the lake, ETL, and reporting capabilities for our users and for our full stack development teams. We are looking for a candidate that wants to continuously improve by introducing new ideas, tools, and solutions to this space.
7 years of professional experience working with :
- NodeJS, Python, Java, SQL
- Databases (Oracle, MSSQL, Postgres, etc...)
- Lambda
- Codebuild
- Postgresql
- Mongo Atlas
- DynamoDB
- Cloudformation
- Docker
- Fargate
- Cloud Data Fusion
- Experience with stream processing (SNS, SQS, Kafka, etc...)
- Ability to communicate across diverse audience of business analysts, architect, business user, and development teams
- Self-starter, capable of driving towards goals independently
- Strong organization and interpersonal skills. Ability to deal with and balance multiple priorities. Ability to deal with ambiguity and rapid change.
- Hands-on role requiring rigorous attention to detail.
- Have demonstrable understanding and awareness of technology and an ability to learn and acquire new technologies as needed.
- Knowledge of data lakes and data warehousing
- Bonus experience :
- ETL tools (Informatica, SSIS, Talend, etc...)
- Mulesoft
Seven or more years of experience in solving challenging technical problems in two or more of the following areas :
Key Tasks and Responsibilities :
Bonus Experience :
Teams that you collaborate with utilize this tech stack :
Comments for Vendors :
