Data Processing Quality Engineer at Datapelago
Datapelago is hiring a Data Processing Quality Engineer in Hyderabad, India. On-site.
About Datapelago
DataPelago develops DataPelago Nucleus, a data processing engine that accelerates analytics and GenAI data processing, including training models, fine-tuning AI, powering RAG, and extracting insights. It handles structured, semi-structured, and unstructured data, works with existing infrastructure without vendor lock-in, and supports frameworks such as Apache Spark, Apache Flink, and Ray through hardware-accelerated computing.
Data Processing Quality Engineer job description
Ensure quality of the data processing engine, in terms of result accuracy, performance fidelity, and robust execution at scale.
Requirements
• BS EE/CS or equivalent
• 5+ years of experience in data processing quality or performance testing for database, data warehouse, or query engine applications. Experience testing for platforms such as Apache Spark, Gluten, Velox, DataFusion preferred.
• Solid knowledge of SQL, Python, and similar data processing languages
• Automation-first mindset, experienced with programming/scripting languages and automation tools.
• Strong in problem-solving and coming up with the test strategy for the complex system.
• Strong in debugging, root cause, and narrowing down the failures.
• Experience in Functional, Performance, Integration, System Level testing
• Experience with the use of public cloud platforms such as AWS, GCP, and MS Azure
• Good Knowledge of tools like Jira, Confluence, Git, Jenkins.
• Good understanding of SDLC and agile methodologies.
• Good understanding of CI/CD implementations.
Apply now
Applications go straight to Datapelago. We never sit between you and the employer.
Apply now ↗
