939 Senior Data Engineer Jobs in San Francisco, CA
Sorry! This job is no longer available. Please explore similar jobs listed on the left.
Logic Hire Software Services LTD is Hiring a Senior Data Engineer Near San Francisco, CA
Job Type: Full-TimeAbout Us: Logic Hire Software Solutions is an innovative data-centric organization committed to leveraging advanced analytics and data engineering practices to inform strategic business decisions and improve client engagement. We are seeking a seasoned Senior Data Engineer to join our team and contribute to the optimization and expansion of our data infrastructures.
Job DescriptionWe are in search of a highly proficient Senior Data Engineer with over 8 years of hands-on experience in architecting and maintaining data infrastructure. The ideal candidate will possess extensive expertise in leveraging the Google Cloud Platform (GCP) and the BigQuery ecosystem, alongside strong commands in SQL, SSIS (SQL Server Integration Services), SSRS (SQL Server Reporting Services), and Python. This role necessitates a combined technical acumen and strong interpersonal skills to successfully engage with business units while supporting the overall project lifecycle.Key Responsibilities
- Architect, implement, and maintain high-performance data pipelines utilizing GCP services, particularly BigQuery, Cloud Storage, Cloud Functions, and Dataflow, ensuring optimal data flow and accessibility.
- Design and write highly efficient, scalable SQL queries, including complex joins, CTEs, and aggregations, to enable robust data analysis and reporting across multiple operational facets.
- Develop ETL (Extract, Transform, Load) processes using SSIS for operational data integration and leverage SSRS for generating executive-level reporting and analytics dashboards.
- Employ Python to create production-quality scripts and applications for data ingestion, transformation, and visualization, utilizing libraries such as Pandas, NumPy, or Apache Airflow for orchestrating workflows.
- Engage with cross-functional teams to elicit, document, and analyze business requirements, subsequently translating these into comprehensive technical specifications, data models, and workflows.
- Implement and uphold data governance frameworks to ensure data integrity, quality control, and security protocols across all data engineering processes.
- Monitor data pipelines and system performance metrics, identifying bottlenecks and implementing solutions to optimize throughput and minimize downtime.
- Provide analytical insights and recommendations to project and client management, facilitating data-driven decision-making.
- Mentor junior data engineering staff, cultivating an environment of knowledge sharing and professional development.
- Stay abreast of latest trends in data engineering technologies, tools, and methodologies to continually refine our data practices.
- Bachelor’s degree in Computer Science, Engineering, Data Science, or a related discipline; a Master’s degree is highly desirable.
- A minimum of 8 years of experience in the field of data engineering, particularly within GCP and the BigQuery architecture.
- Profound experience in formulating and executing complex SQL queries and a solid understanding of relational database design principles.
- Advanced proficiency with SSIS for ETL processes and SSRS for business intelligence reporting.
- Strong programming skills in Python, with a focus on data manipulation and the development of scalable ETL solutions.
- Demonstrated ability in constructing, deploying, and maintaining data engineering pipelines utilizing modern best practices.
- Strong verbal and written communication skills, complemented by an ability to liaise effectively between technical teams and business stakeholders.
- Exceptional analytical and problem-solving capabilities, with a proactive approach towards diagnosing and resolving issues.
- Working knowledge of data governance principles, compliance with data privacy regulations, and industry best practices.
- Familiarity with additional GCP services such as Cloud Dataflow for stream/batch processing, Dataproc for managing Hadoop/Spark clusters, or Pub/Sub for messaging services.
- Understanding of machine learning concepts and frameworks (e.g., TensorFlow, scikit-learn) to integrate predictive analytics within data solutions.
- Experience working within Agile environments and proficiency with project management tools (e.g., JIRA, Trello).
- A competitive salary and comprehensive benefits package.
- Opportunities for continued professional development and advancement within a cutting-edge environment.
- A collaborative workspace that encourages innovation and creativity.
- Flexible working options to support work-life balance.
Job Summary
Full Time
$144k-177k (estimate)
09/01/2024
09/11/2024
The job skills required for Senior Data Engineer include SQL, Python, Data Engineering, Computer Science, Insight, Machine Learning, etc. Having related job skills and expertise will give you an advantage when applying to be a Senior Data Engineer. That makes you unique and can impact how much salary you can get paid. Below are job openings related to skills required by Senior Data Engineer. Select any job title you are interested in and start to search job requirements.
The following is the career advancement route for Senior Data Engineer positions, which can be used as a reference in future career path planning. As a Senior Data Engineer, it can be promoted into senior positions as a Database Engineer IV that are expected to handle more key tasks, people in this role will get a higher salary paid than an ordinary Senior Data Engineer. You can explore the career advancement for a Senior Data Engineer below and select your interested title to get hiring information.
If you are interested in becoming a Senior Data Engineer, you need to understand the job requirements and the detailed related responsibilities. Of course, a good educational background and an applicable major will also help in job hunting. Below are some tips on how to become a Senior Data Engineer for your reference.
Step 1: Understand the job description and responsibilities of an Accountant.
Quotes from people on Senior Data Engineer job description and responsibilities
The Senior Data Engineer builds data processing frameworks that handle the business’s growing database.
03/09/2022: Billings, MT
The Senior Data Engineer owns and extends the business’s data pipeline through the collection, storage, processing, and transformation of large data-sets.
01/05/2022: Melbourne, FL
Create architecture for real-time, big data applications with minimal maintenance effort.
03/23/2022: Benton Harbor, MI
Work with both structured and unstructured data, with focus on ETL (Extract, Transfer, Load) and stabilizing pipelines and code.
01/22/2022: Greenville, MS
Provides successful deployment and provisioning of data solutions to production or other required environments.
01/12/2022: Dothan, AL
Step 2: Knowing the best tips for becoming an Accountant can help you explore the needs of the position and prepare for the job-related knowledge well ahead of time.
Career tips from people on Senior Data Engineer jobs
Apply for an entry-level data engineer role and gain experience.
02/06/2022: Providence, RI
Earn a bachelor’s degree related to data engineering and begin working on projects.
02/16/2022: Denver, CO
Consider pursuing additional professional engineering or big data certifications.
03/06/2022: Raleigh, NC
Gain knowledge with new data architecture principles and concepts, thorough understanding of layered systems architectures.
01/24/2022: Abilene, TX
Senior data engineers should also have an understanding of other programming languages that help with statistical analysis and modeling, such as Python.
01/02/2022: New York, NY
Step 3: View the best colleges and universities for Senior Data Engineer.
Similar Jobs
Popular Articles
