What are the responsibilities and job description for the Data Engineer position at VRK IT Vision Inc.?
Role Data Engineer
Location Redmond, WA
Remote Yes
Apache Nifi Must have.
Data Engineer (BI not must have)
Internal use Only USC and GC
Required Qualifications For BI Profile
Location Redmond, WA
Remote Yes
Apache Nifi Must have.
Data Engineer (BI not must have)
Internal use Only USC and GC
Required Qualifications For BI Profile
- BE/B.Tech in Computer Science or related field
- 5 years of enterprise software design and development experience
- Proficiency in SQL, with experience in writing and optimizing complex queries
- Professional, practical programming using Spark, SQL, Scala/Python
- Strong technical expertise in Azure, Big Data, Apache Nifi, Hadoop, HDInsights, ADF, ADW etc.
- Experience working with reporting and visualization tools like Power BI, Tableau, or similar.
- Hands-on experience with scripting languages like Powershell/Bash for automation and data manipulation tasks.
- Extensive knowledge and experience in data warehousing, Streaming data processing (ETL), e-metrics/measurement, business intelligence, information retrieval, parallel and distributed computation
- Experience in implementation of Cloud Computing concepts and platforms
- Experience in analyzing very large real world datasets and hands-on approach in data analytics
- Experience with Test Driven Development, Continuous Integration, Continuous Deployment, Telemetry etc.
- Great design and problem-solving skills, with a strong bias for quality and engineering excellence
- Excellent verbal and written communications skills
- Excellent problem-solving and debugging skills with a solid understanding of testing practices
- Proven sense of high accountability and self-drive to take on and see through big challenges
- Experience working in a global delivery model
- Experience with SCRUM, Devops or similar Agile development/implementation methodologies
- Familiarity with automation tools Visual Studio etc