What are the responsibilities and job description for the Staff Data Engineer position at Currency Cloud?
Company Overview
Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.Making an Impact at Visa
Make an impact with a purpose-driven industry leader.Job Description
As a Staff Data Engineer, you will establish data processes, data solutions, and automations, based on business and technical requirements by leveraging Visa supported big data technologies and third-party tools.Essential Functions:
- Deliver small to large data engineering projects either individually or as part of a project team.
- Extract and manipulate large datasets using standard tools such as Hadoop (Hive), Spark, Python (pandas, NumPy), Presto, SQL etc.
- Utilize Visa's data analytics capabilities, technology, and industry expertise to develop, standardized and implement BI data sets.
- Find opportunities to create and automate repeatable analyses or build streamlined data flows for business owners.
- Develop solutions within an agile development process leveraging Visa's core data.
- Participate in business requirements gathering, effort sizing, and architecture planning.
- Provide operational monthly production support.
- Communicate complex concepts and the results of the analyses in a clear and effective manner.
Qualifications
Basic Qualifications:- 5 or more years of relevant work experience with a Bachelors Degree or at least 2 years of work experience with an Advanced degree (e.g. Masters, MBA, JD, MD) or 0 years of work experience with a PhD.
- 6 or more years of work experience with a Bachelors Degree or 4 or more years of relevant experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or up to 3 years of relevant experience with a PhD.
- 5 years of work experience with a bachelor's degree in STEM field or at least 3 years of work experience with an Advanced degree (e.g. Masters).
- Build and maintain high performing ETL processes in Hadoop including data quality and testing.
- Advanced knowledge of SQL with experience with HQL, Presto, etc.
- Experience in Python, Spark, and exposure to scheduling tools like Apache Airflow is preferred.
- Experience working in an Agile or fast-paced and dynamic environment.
- Should have strong problem-solving capabilities and ability to quickly propose feasible solutions.
- Create data dictionaries, setup/monitor data validation alerts and execute periodic jobs to maintain data pipelines for completed projects.
- Effectively communicate status, issues, and risks in a precise and timely manner.
- Experience with visualization software (e.g. Tableau/PowerBI) is a strong plus.
- Visa experience or knowledge of payments industry is a plus, but not mandatory.
Additional Information
Work Hours: Varies upon the needs of the department.Travel Requirements: This position requires travel 5-10% of the time.
Mental/Physical Requirements: This position will be performed in an office setting. The position will require the incumbent to sit and stand at a desk, communicate in person and by telephone, frequently operate standard office equipment, such as telephones and computers.