What are the responsibilities and job description for the Sr. Databricks / Pyspark developer (offshore) position at DATAMAXIS?
Fully remote; India location only
Job Summary :
Looking for an offshore Senior Developer who has experience in Databricks / PySpark, is willing to learn new technologies if needed and is able to work with team. This position is replacement position for existing Senior developer. Position is long term and will likely be renewed annually.
Minimum Qualifications and Job Requirements :
Must be a team player.
Must have at least 5 years of IT development experience.
Must have strong analytical and problem-solving skills.
Must have experience in designing solutions, performing code reviews, mentoring junior engineers.
Must have strong SQL and backend experience, and working on data driven projects.
Must have following experience :
Python / PySpark
Databricks
SCALA
Spark / Spark Streaming
Big Data Tool Set
Linux
Kafka
Experience collaborating with dev team, project managers, and engineers.
Excellent communication and teamwork skills
Essential Job Functions :
Design and development of data ingestion pipelines (Databricks background preferred).
Performance tune and optimize the databricks jobs.
Evaluated new features and refractors existing code.
Develop and integrate software applications using suitable development methodologies and standards, applying standard architectural patterns, taking into account critical performance characteristics and security measures.
Collaborate with Business Analysts, Technical Manager, Architects and Senior Developers to establish the physical application framework (e.g. libraries, modules, execution environments).
Perform end to end automation of ETL process for various datasets that are being ingested into the big data platform.
Must be willing to flex work hours accordingly to support application launches and manage production outages if necessary.
Works on best practices and documenting the process code merges and releases (Bitbucket).
Works with architect and manager on designs and best practices. Responsible for design of application considering the cost and best practices.
Good data analysis skills.
Must be willing to self-learn new technologies, become SMEs and develop high quality code in a fast-paced environment.
Mentor junior developers and be hands on in development work.
Work with QA and automation team. Must have attention to detail to cover all scenarios for testing.
Handles and supports current production applications.
Performs code reviews and discussion on the changes with Technology Manager.
Other Responsibilities :
Safeguard the company's assets.
Adhere to the company's compliance program.
Maintain comprehensive knowledge of industry standards, methodologies, processes, and best practices.
Maintain a focus on customer-service, efficiency, quality, and growth.
Keep a pulse on the job market with advanced job matching technology.
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution.
Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right.
Surveys & Data Sets
What is the career path for a Sr. Databricks / Pyspark developer (offshore)?
Sign up to receive alerts about other jobs on the Sr. Databricks / Pyspark developer (offshore) career path by checking the boxes next to the positions that interest you.
Not the job you're looking for? Here are some other Sr. Databricks / Pyspark developer (offshore) jobs in the Dearborn, MI area that may be a better fit.
We don't have any other Sr. Databricks / Pyspark developer (offshore) jobs in the Dearborn, MI area right now.
