Demo

Senior Manager - Technical Solutions (Spark)

Coatue
San Francisco, CA Full Time
POSTED ON 2/7/2025
AVAILABLE BEFORE 5/5/2025

CSQ426R84

As a Senior Manager of the Spark Technical Solutions team, you will lead & manage a team of Technical Solution Engineers (Spark) and be responsible for driving deep dive technical solutions for any issues reported by Databricks customers. We expect the manager to resolve challenges with comprehensive technical and customer communication skills. You will assist our customers in their Databricks journey and provide them with the guidance, knowledge, and expertise that they need to realise value and achieve their strategic objectives using our products.

The impact you will have :

  • As a manager and member of the leadership team, you will be directly responsible for the management of Technical solution engineers, team leads and operations personnel.
  • Responsible for directly monitoring, reporting, and driving improvements to team-level metrics and KPIs, acting as an escalation point with customers and internal teams, and optimising and developing support processes and tools.
  • Responsible for working across multiple cross functional teams that include Engineering, product management, sales and customer success; manage Hiring, mentoring and onboarding new support engineers.
  • Regularly meet one-on-one with your direct reports, conducting annual reviews and career development discussions throughout the year.
  • Be a hands-on manager to assist the team members in resolving issues related to Spark core internals, Spark SQL, Structured Streaming, Delta, Lakehouse and other Databricks runtime features.
  • Manage and drive best practices guidance around Spark runtime performance and usage of Spark core libraries and APIs for custom-built solutions developed by Databricks customers; contribute in the development of tools / automation initiatives.
  • Own Engineering JIRA tickets and proactively work to bring quicker resolutions to customer reported issues; participate in creation of knowledge base articles.
  • Participate in weekend and weekday on-call rotation and run escalations during Databricks runtime outages, incident situations, ability to multitask and plan day-to-day activities and provide escalated level of support for critical customer operational issues.

What we look for :

  • Min 10-12 years of experience in designing, building, testing, and maintaining Python / Java / Scala / Spark based applications in a typical project delivery and consulting environments with 4 years working as a Manager.
  • 5 years of hands-on experience in developing and leading any two or more of the Big Data, Hadoop, Spark, Machine Learning, Artificial Intelligence, Streaming, Kafka, Data Science, ElasticSearch related industry use cases at the production scale.
  • Big Data / Spark hands-on experience is mandatory.
  • Hands-on experience in the performance tuning / troubleshooting of Hive and Spark based applications at production scale. Real-time experience in JVM and Memory Management techniques such as Garbage collections, Heap / Thread Dump Analysis is preferred.
  • Working and hands-on experience with Data lakes and any SQL-based databases, Data Warehousing / ETL technologies like Informatica, DataStage, Oracle, Teradata, SQL Server, MySQL is preferred.
  • Hands-on experience with AWS or Azure or GCP is preferred.
  • Experience in implementing CI / CD, Monitoring / alerting for Production Systems.
  • Technical lead in design, implementation and support of large scale data and analytics solutions that are highly reliable, flexible, and scalable.
  • Experience in leading and managing end-to-end projects and have reported and escalated to top levels.
  • Experience in managing and leading teams in an organisation involving multiple reporting lines.
  • About Databricks

    Databricks is the data and AI company. More than 10,000 organizations worldwide — including Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500 — rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark, Delta Lake and MLflow. To learn more, follow Databricks on Twitter , LinkedIn and Facebook .

    Benefits

    At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region, please visit https : / / www.mybenefitsnow.com / databricks .

    Our Commitment to Diversity and Inclusion

    At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics.

    Compliance

    If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.

    J-18808-Ljbffr

    If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
    Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

    What is the career path for a Senior Manager - Technical Solutions (Spark)?

    Sign up to receive alerts about other jobs on the Senior Manager - Technical Solutions (Spark) career path by checking the boxes next to the positions that interest you.
    Income Estimation: 
    $101,020 - $131,637
    Income Estimation: 
    $95,435 - $126,957
    Income Estimation: 
    $130,171 - $173,458
    Income Estimation: 
    $172,979 - $241,697
    Income Estimation: 
    $200,717 - $281,464
    Income Estimation: 
    $135,811 - $184,429
    Income Estimation: 
    $176,131 - $238,730
    Income Estimation: 
    $172,979 - $241,697
    View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

    Job openings at Coatue

    Coatue
    Hired Organization Address San Francisco, CA Full Time
    Airbyte is the open-source standard for Data Movement. We enable data teams to move data from applications, APIs, unstru...
    Coatue
    Hired Organization Address San Francisco, CA Full Time
    MKTQ125R27 While candidates in the listed locations are encouraged for this role, we are open to remote candidates in ot...
    Coatue
    Hired Organization Address New York, NY Full Time
    Scale is seeking an experienced, strategic, and analytical marketer to lead our growth marketing function. In this role,...
    Coatue
    Hired Organization Address New York, NY Full Time
    Scale AI accelerates AI development by providing high-quality training data and infrastructure. We work with leading org...

    Not the job you're looking for? Here are some other Senior Manager - Technical Solutions (Spark) jobs in the San Francisco, CA area that may be a better fit.

    Senior Software Engineer

    Tara Technical Solutions (TTS), San Mateo, CA

    SAP ABAP Technical Lead - Senior Manager - 61614951

    Cognizant Technology Solutions, San Francisco, CA

    AI Assistant is available now!

    Feel free to start your new journey!