What are the responsibilities and job description for the Sr. Machine Learning Data Engineer position at Xlysi?
This is a Fulltime position for one of our clients. Client cannot sponsor any kind of work visa for this position.
Required Qualifications
- Experience working in Data engineering and ETL teams and on managing implementation projects that utilize big data, advanced analytics and machine learning technologies.
- Hands-on experience in building pipelines from variety of sources such as data warehouses and in-memory OLAP models, as well as experience in NoSQL/cloud.
- Strong understanding of data, Big Data, Relational databases, streaming and batch data processing.
- Strong experience building end-to-end data view with focus on integration.
- Demonstrated experience in teaching and/or mentoring professionals.
- Hands-on experience Developing, implement data solutions using technologies such as:
- Data Exploration and ETL: Alteryx, Talend, H2O, Informatica, Data Stage, Azure Data explorer, Azure Data Factory.
- Programming languages use (SQL, Spark, Python, R, Jupyter Notebooks, Java, Scala).
- Data Warehouse Solutions: Redshift, Snowflake, Postgres, Data Lake.
- Big Data technologies, Azure, AWS, Hadoop, Spark, Hive, Kafka, Flume, NoSQL stores (HBase, Cassandra, DynamoDB, MongoDB).
- Cloud storage: S3, GCS, ADLS, Blob.
- Data Visualization Solutions: MS Power BI, Looker, Tableau, Azure Streaming Analytics, Data Lake Analytics, Azure Time Series Insights, Azure Synapse Analytics.
- CI/CD and Code Management: Git, Maven, Docker , Jenkins, Azure Dev Ops.
