Data Engineer
Responsibilities
• Builds prototypes, products and systems that meets the project quality standards and requirements
• Provides technical leadership and documentation to developers and stakeholders
• Contributes to and supports re-use through common components that are well documented and tested.
• Provide timely corrective actions on all assigned defects and issues.
• Design and implement solutions for problems arising out of large-scale and high velocity data processing
• Ensure end-to-end ownership of all tasks being aligned
• Design, build & maintain efficient, reusable & reliable code
• Test implementation, troubleshoot & correct problems
• Ensure high quality software development with complete documentation and traceability
• Conduct technical training sessions, write whitepapers, case studies, blogs etc.
Background
• Bachelor’s degree or higher in Computer Science or related with minimum 10 years working experience
• 2 – 3 years’ experience in data warehousing, data engineering/processing/parallel processing – developing pipelines, troubleshooting, performance tuning
• Good experience with Spark/Pyspark (2y)
• SQL & NoSQL experience (2y)
• Python
Preferred:
• Experience with Databrick – highly valued
• 5 or more years of experience
• Experience with alternate data processing technologies
• Cloud platform expertise(any)
• Other dev languages
