What are the responsibilities and job description for the [Job - 20610] Mid Level Databricks Data Developer, Brazil position at CI&T?
We are tech transformation specialists, uniting human expertise with AI to create scalable tech solutions.
With over 6,500 CI&Ters around the world, we’ve built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality.
When applying for one of our positions, you’re agreeing to the use of AI in the early phases of the selection process, where your profile will be evaluated by our virtual assistant. For more information, access our opportunities’ page.
Since 2017, CI&T and Databricks have collaborated to help enterprise customers gather valuable insights from their data. Together, we significantly influence our clients' Data, AI, and ML journeys. With over 200 seasoned Databricks practitioners and a track record of successful enterprise projects, the partnership between CI&T and Databricks is exceptionally robust.
We're growing fast and seeking a talented, motivated Databricks Data Developer to join our team. You'll play a crucial role in developing and maintaining scalable data pipelines and infrastructure to drive data analytics and machine learning solutions for our clients.
Responsibilities
- Design, develop, and maintain scalable data pipelines using Databricks, Apache Spark, and SQL.
- Implement data ingestion processes from various sources, ensuring data quality and accessibility.
- Optimize data workflows and pipelines for performance and cost-effectiveness.
- Monitor and troubleshoot data pipelines and infrastructure to ensure high availability and reliability.
- Contribute to architecture discussions and provide input on best practices for data engineering.
- Document data models, workflows, and technical processes for team knowledge sharing.
- Collaborate with data scientists and analysts to understand data requirements and translate them into technical specifications.
- Stay updated with industry trends and emerging technologies in data engineering, AI, and ML.
Requirements for this challenge:
- Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field.
- Experience in data engineering, with a strong focus on Databricks, Spark, and SQL.
- Proficiency in programming languages such as Python, Scala, or Java.
- Experience with SQL and NoSQL databases (e.g., PostgreSQL, MongoDB).
- Hands-on experience with ETL (Extract, Transform, Load) processes and data pipeline orchestration tools (e.g., Apache Airflow, Azure Data Factory).
- Understanding of cloud platforms (e.g., Azure, AWS, Google Cloud) and their data services.
- Analytical and problem-solving skills with an attention to detail.
- Excellent communication skills and ability to work collaboratively in a team environment.
Nice to Have:
- Certification in Databricks, Azure, AWS, or GCP Data Engineering.
- Knowledge of data governance and data quality best practices.
- Familiarity with data visualization tools (e.g., Tableau, Power BI) and techniques.
- Experience with machine learning frameworks (e.g., TensorFlow, PyTorch) and deployment practices.
- Experience in Agile methodologies and working in cross-functional teams.
- Previous experience in a consulting environment, particularly with enterprise clients.
- Ability to communicate in English and Portuguese and engage with clients.
#LI-JP3
#MidSenior
\nOur benefits:
-Health and dental insurance
-Meal and food allowance
-Childcare assistance
-Extended paternity leave
-Wellhub (Gympass)
-TotalPass
-Profit-sharing (PLR)
-Life insurance
-CI&T University
-Discount club
-Free online platform dedicated to physical, mental, and overall well-being
-Pregnancy and responsible parenting course
-Partnerships with online learning platforms
-Language learning platform
And many more!
More details about our benefits here: https://ciandt.com/br/pt-br/carreiras
Collaboration is our superpower, diversity unites us, and excellence is our standard.
We value diverse identities and life experiences, fostering a diverse, inclusive, and safe work environment. We encourage applications from diverse and underrepresented groups to our job positions.
