What are the responsibilities and job description for the Machine Learning Engineer position at Aarna Software and Solutions LLC?
Qualifications
- Required
- Excellent and demonstrable programming ability in Python
- Significant experience with writing complex SQL queries
- Experience deploying solutions as Databricks jobs/ dockerized containers
- Hands-on experience with big data technologies and cloud (Spark, Azure/AWS/GCP)
- Understanding of LLM functionality and inference techniques
- Solid understanding of databases and ETL/ELT best practices
- Experience with architecting and consuming APIs in a scalable (multi-threaded/batched) fashion
- Ability to multi-task, learn new things quickly, and have excellent problem solving & communication skills
- A mindset for collaboration, knowledge sharing and keeping up to date on emerging industry trends
- Experience with at least one other programming language (JavaScript, Java, C /C)
- Experience with Azure suite of applications
- Comfortable with command line (Linux, Windows) scripting
- Strong expertise in authoring ETL pipelines and processing data at scale
- Nice to have
- Exposure to technologies such as DBT, Apache AirFlow or Luigi
- Working knowledge of containers, specifically Dockerizing APIs
- Exposure to CI-CD pipelines
- Comfortable with at least one NoSQL database (MongoDB, ElasticSearch, CosmosDB, etc.)
