What are the responsibilities and job description for the AWS Big Data Platform Engineer position at Sansar Tec LLC?
Job Description. This is a potential hybrid role in New York, mostly remote
We are looking for AWS Big Data Platform Engineers who are passionate about resolving the challenges of building robust and scalable data systems aligned to enterprise data strategy.
As Senior Data Platform Engineer you will be part of a team that leads the design and implementation of data platform to support the strategic data needs & support enterprise reporting needs including datamarts, reporting and business intelligence. You will build data capabilities and support a wide range of data flows and usecases to advance the data-driven investment decisioning and deliver transformational programs.
Required skills
- Experience with AWS Data & Analytics, Cloud data platforms, data warehouse, data lakes and analytics products
- Experience with batch job scheduling, leveraging Apache Airflow, AWS EMR (Multi Tenant ), PySpark, YARN, EKS, S3, HDFS, AWS Athena, AWS Glue, Lakeformation, AWS Step Functions, DMS
- Experience building data tools using spark , performance tuning , AQE, Spark Listener Events,
- Experience in data architecture and familiarity with ETL tools, data warehousing & big data architecture.
- Knowledge of cloud-native approaches to build fast, flexible, and cost-effective data applications on any data lake, open-source column oriented DBMS and / or big data OLAP engines for analytical processing (Apache Pinot, Apache Hudi, Iceberg etc.)
Good to Have
None
