What are the responsibilities and job description for the Python Developer position at TekSalt Solutions?
Job Description
We are looking for a skilled Python Developer with 4-6 years of hands-on experience in Python development, database management, and integration in cloud-based or big data environments. The ideal candidate will be proficient in Python development, Apache Spark, Airflow, Kubernetes & Docker, and possess a strong ability to work independently while contributing to dynamic and complex projects. You will be responsible for the development of Power BI Reports, performing data ETL tasks, and ensuring the effective integration and query execution on large-scale data systems.
Key Responsibilities
We are looking for a skilled Python Developer with 4-6 years of hands-on experience in Python development, database management, and integration in cloud-based or big data environments. The ideal candidate will be proficient in Python development, Apache Spark, Airflow, Kubernetes & Docker, and possess a strong ability to work independently while contributing to dynamic and complex projects. You will be responsible for the development of Power BI Reports, performing data ETL tasks, and ensuring the effective integration and query execution on large-scale data systems.
Key Responsibilities
- Develop and maintain Python applications to integrate data from various sources using APIs.
- Design and implement ETL pipelines for data ingestion, processing, and transformation in a big data environment.
- Leverage Apache Spark and Airflow for data processing workflows.
- Manage and deploy Kubernetes and Docker containers to streamline development and deployment pipelines.
- Work with PostgreSQL databases to query, manipulate, and store large datasets efficiently.
- Collaborate with cross-functional teams to integrate and optimize Python-based solutions across various systems.
- Create and optimize Power BI Reports, leveraging advanced data visualization and reporting techniques.
- Develop and maintain continuous integration and delivery (CI/CD) pipelines using Jenkins and other DevOps tools.
- Troubleshoot, debug, and optimize code to ensure performance, scalability, and reliability.
- 4-6 years of hands-on experience in Python development.
- Strong experience working with Apache Spark and Airflow for data workflows.
- Familiarity with Kubernetes and Docker for containerization and deployment.
- Expertise in working with PostgreSQL and SQL databases for data storage and queries.
- Hands-on experience in ETL processes and development.
- Experience with CI/CD tools, including Jenkins, to manage deployment pipelines.
- Strong problem-solving skills with a focus on optimizing performance for large-scale data.
- Ability to work independently and take ownership of development tasks from start to finish.
- Knowledge of Power BI report development, including designing and building interactive visualizations.
- Understanding of big data environments and technologies.