As a Lead Big Data Engineer, you will be a member of Internova's Data & Analytics Center of Excellence that provides enablement for traditional reporting and advanced analytics throughout Internova through efficient ingest, storage, and consumption of data using Big Data technologies. In this position, you will be expected to architect solutions in Azure based cloud deployments of big data platforms to integrate data from various sources and position them to perform analytics, reporting, visualizations, and quick access for online applications. As a Lead Big Data Engineer, you will lead a group of Data Engineers and be responsible for design, development and support of Data projects and applications within Internova. You will also serve as a Junior Architect and help enable Modern data architecture and assist building and maintaining efficient data pipelines.

You will work in collaboration with Infrastructure and other IT teams to design, create and maintain organization's data infrastructure including data lakes, databases, data warehouses and data pipelines. You will also be responsible for translating business requirements into technical specifications and models for small, medium and large sized information technology projects and programs.

The salary range on this job posting/advertising has been developed to give applicants a wide range to comply with pay transparency laws in all states and geographical areas. Many factors, such as years of experience, geographical location, budget etc. are considered when determining the starting rate of pay.

This role may be eligible for an incentive, commission, bonus, or a discretionary bonus program based on the company's financial goal achievement and individual performance.

Design and support data solutions that will help the organization modernize the data platform
• UML modeling including creating and maintaining data models, business domain models, class diagrams, and use case diagrams
• Develop, optimize, and maintain data architecture and pipelines including development related to data acquisition, storage, data quality, integration, normalization, and data delivery/distribution
• Own the majority of deliverables for the Data team from a delivery perspective
• Work hand-on and assist with development and integration of Big Data technologies such as Azure Data Lake Store, Azure Storage, Azure Data Lake Analytics, using Hive, Pig, or custom Map/Reduce jobs in an HDInsight Hadoop cluster, or using C#, Scala, or Python programs in an HDInsight Spark cluster, Azure Event Hubs, Azure IoT Hubs, and Kafka, Azure Synapse Analytics, Azure Data Factory
• Partner with business stakeholders and technology partners to translate business requirements and business process/problems into efficient and robust technology solutions and design including conceptual and logical data models and proposed technical implementation plan.
• Assign work to team members based on their skills and availability. Ensure the quality of the team's work
• Build solutions to assemble large, complex data sets from various operational and reporting systems into a centralized data environment
• Build solutions to deliver, distribute or share transformed, cleansed, standardized and optimized data from centralized data environment, data warehouses and data marts to key business applications and reporting systems.
• Identify, design, and implement internal process improvements and automation of manual processes
• Adhere to good code practices within an agile environment with a DevOps approach to development and implementation.
• Work with internal and external stakeholders to assist with data-related technical issues and support data infrastructure needs
• Identify and resolve complex system and process design issues including researching solution alternatives
• Provide operation support on key applications.
• Recruit, train, and manage a team of Data Engineers (both full-time associates and/or third-party vendors and contractors)

• BA/BS or master's degree in MIS, CS, or an industry equivalent
• 5 years of experience implementing data pipelines and data solutions in Azure cloud environment
• 5 years of experience in C# AND Python/Scala or related frameworks
• 3 years of experience Azure and Apache technologies such as Azure Data Lake Store, Azure HDInsight, Azure Event Hubs, Azure Cognitive Search, Spark, Kafka, Azure Synapse Analytics
• 2 years of Dimensional Modeling experience implementing data warehouse solutions on a cloud platform such as Snowflake, Redshift or similar
• Hands-on experience with Azure implementation, Data lakes, Spark
• Experience with at least one data pipeline and ETL tool like Databricks, Azure Data Factory, and Talend
• Experience working with database systems like SQL and NoSQL
• Solid experience manipulating, processing and extracting value from large, disconnected datasets
• Solid understanding of the basics of distributed systems
• Knowledge of different software development methodologies (Agile, Scrum, Waterfall, SDLC, etc.)
• Experience with modeling tools such as MS Visio, Lucid Charts, Enterprise Architect
• Familiarity with Product development, sales, support and adoption.
• Experience leading teams
• Effective written and verbal communication skills with users of all backgrounds in a complex environment
• Self-starter, ability to work independently to research problems and identify solutions

Desired but not required

• Experience in Travel industry
• Data Engineering certifications such as Azure Data Engineer Associate
• Machine Learning development experience
• Working knowledge of stream processing
• Experience with Project management and tracking software (Jira)
• Back-Office system knowledge
• Experience managing offshore and remote resources
• Lucid charts

Internova Travel Group is an Equal Opportunity Employer. We make employment decisions without regard to age, race, religion, national origin, gender, disability, veteran status, genetic information, sexual orientation and gender identity or any other protected class.

Our benefit offerings include choice of two medical plans and two dental plans, vision insurance, flexible spending accounts (FSAs), company-paid life insurance and AD&D, optional additional life insurance and AD&D, disability insurance, paid parental leave, paid time off, 401k Plan with company match, discounted employee travel options, access to LinkedIn Learning webinars and courses. Discounted pet insurance and auto, home, & renters insurance.

#LI-remote