What are the responsibilities and job description for the ETL Developer - AA position at Infojini Consulting?
Job Functions & Responsibilities
1. ETL Development : - Design, build, and maintain efficient ETL workflows to process and integrate solar, Interval, etc., data from multiple sources. - Optimize ETL processes for performance and scalability. 2. Data Integration : - Collaborate with data providers and stakeholders to ensure accurate data ingestion and transformation. - Develop mechanisms for real-time and batch solar data processing. 3. Data Quality & Validation : - Implement robust data validation and cleansing techniques. - Ensure data accuracy and consistency. 4. Collaboration : - Work closely with the business, and analysts. - Coordinate with IT teams to deploy ETL pipelines in production environments. 5. Documentation : - Document ETL processes, workflows, and best practices. - Maintain clear and concise technical documentation for stakeholders.
Skills
Technical Skills : - Proficiency in ETL tools such as Pentaho / Microsoft ADF. - Strong SQL and database management skills (e.g., SQL Server). - Experience with cloud platforms (e.g., AWS, GCP, Azure). - Knowledge of Python, Spark, or other programming languages for data processing. Preferred Skills : - Familiarity with energy management systems or renewable energy analytics. - Experience with REST APIs and integrating IoT data, timeseries and Utility Data. Soft Skills : - Strong problem-solving skills and attention to detail. - Excellent communication and teamwork abilities.
Education & Certifications
1. Education : - Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field. 2. Experience : - 5 years of experience as a Data Engineer or ETL Developer. - Proven experience in integrating energy, interval data, is preferred.
