What are the responsibilities and job description for the Data Engineer position at Crexi?
About Crexi
Crexi is reimagining commercial real estate, building industry-leading software for professionals to more effectively market, analyze, and trade commercial property. With a suite of due diligence tools, transaction services, deal pipeline support, and a dynamic listing marketplace, Crexi accelerates deal efficiency and has empowered millions of monthly users to close more than $615 billion in deals and market over $7 trillion in property value.
What You'll Do
Crexi is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Crexi will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.
Crexi is reimagining commercial real estate, building industry-leading software for professionals to more effectively market, analyze, and trade commercial property. With a suite of due diligence tools, transaction services, deal pipeline support, and a dynamic listing marketplace, Crexi accelerates deal efficiency and has empowered millions of monthly users to close more than $615 billion in deals and market over $7 trillion in property value.
What You'll Do
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of SQL/NoSQL databases and data stores like MSSQL , Dynamodb.
- Building and optimizing 'big data' data pipelines, architectures and data sets using AWS cloud services and SnowFlake
- Design & support a multi-tenant SnowFlake data warehouse
- Performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
- Build processes supporting data transformation, data structures, metadata, dependency and workload management using DBT and Airflow or similar tools.
- Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores using Hadoop, Spark, Kafka, etc.
- Creating a strong test suite, alerting, monitoring and documentation for all the pipelines
- BS degree in Computer Science or relevant work experience
- 5 years of experience in developing data pipelines and databases
- Proficient in Python and SQL
- Experience with Data Engineering best practices including Test Automation, Quality Controls, Reconciliation, Documenting data flows, etc.
- Have thorough knowledge of data structures and algorithms
- Have experience working with customers to understand and capture requirements
- Experience building highly scalable and reliable data pipelines using technologies like Spark, Hive, Trino/Presto, Airflow, Kafka, and/or Flink.
- Experience with data stores like Snowflake, Postgres, Feast
- Experience with cloud service providers, including AWS, Azure, or Google
- Experience supporting multi-tenant data warehouses
- Familiarity with Analytical tools like Tableau
- Knowledge of data service and deployment frameworks, including Docker, and Kubernetes
- Experience with data compliance and governance tools like OneTrust or DataGrail
- Experience with the Kafka
Crexi is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Crexi will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.
Salary : $145,000 - $173,000
