What are the responsibilities and job description for the Big Data Engineer position at Insight Global?
Job Description
Purpose : A new team focused on utilizing generative AI to create a conversational experience similar to a digital store associate.
Responsibilities :
Design, develop, and maintain big data solutions using vector store technologies like Pinecone, Google Vector Store, Vespa, or AstraDB.
Work with NoSQL databases such as BigTable, Cassandra, or HBase to manage and store large datasets.
Utilize big data platforms like BigQuery, Apache Spark, and Apache Beam to process and analyze data.
Implement and manage data orchestration tools like Google Cloud Composer or Apache Airflow to ensure smooth data workflows.
Compensation :
50 / hr to $60 / hr. Exact compensation may vary based on several factors, including skills, experience, and education.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity / affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and / or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com .
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy : .
Skills and Requirements
Must Haves :
Vector Stores : Experience with technologies like Pinecone, Google Vector Store, Vespa, or AstraDB
NoSQL : Proficiency with BigTable, Cassandra, or HBase
Big Data Platforms : Experience with BigQuery, Apache Spark, and Apache Beam
Orchestration Tools : Familiarity with Google Cloud Composer or Apache Airflow null
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity / affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and / or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.
Salary : $50 - $60
