Manual QA

Position Overview: 

We are seeking a skilled Manual Test Engineer with a strong background in testing Machine Learning (ML) systems, specifically testing end to end machine learning application, in a Python environment. As a Manual Test Engineer, you will play a vital role in ensuring the quality and reliability of our ML systems throughout the development and deployment phases. The ideal candidate should have a deep understanding of ML concepts, excellent testing skills, and hands-on experience in conducting
comprehensive manual testing for ML-driven applications.

Responsibilities:

• Test Planning: Collaborate with cross-functional teams, including data scientists, ML engineers,
  and developers, to understand project requirements and develop test plans and strategies for ML
  systems.
• Test Case Design: Create detailed and comprehensive test cases that cover data ingestion, data
  preprocessing, model training, evaluation, and result serving.
• Data Validation: Verify the accuracy, completeness, and integrity of input data used in ML
  pipelines to ensure reliable model training and inference.
• Model Evaluation: Conduct rigorous testing of ML models, including performance evaluation,
  accuracy, precision, recall, and other relevant metrics.
• Result Serving Validation: Verify that ML model outputs are correctly served and integrated into
  the application’s frontend or backend.
• Regression Testing: Perform regression testing to ensure new code changes do not introduce
  defects or negatively impact existing ML functionalities.
• Bug Reporting: Document and track defects, issues, and enhancements using bug tracking
  systems, and work closely with the development team to ensure timely resolution.
• Test Automation: Collaborate with the automation team to identify opportunities for test
  automation and contribute to the development of automated test scripts for ML components.
• Data Security and Compliance: Ensure data privacy and compliance with relevant regulations
  in ML systems, especially when handling sensitive data.
• Documentation: Prepare detailed test reports, test matrices, and test summary documents to
  communicate test results and provide actionable feedback.

Qualifications:

• Bachelor’s or higher degree in Computer Science, Engineering, or a related field.
• Minimum of 5 years of experience as a Manual Test Engineer with a focus on testing Machine
  Learning systems in a Python environment.
• Strong understanding of ML concepts, including model training, evaluation, hyperparameter
  tuning, and ML pipelines.
• Proficiency in Python programming and experience with Python testing frameworks (e.g., unittest,
  pytest).
• Experience in data validation and familiarity with data quality and integrity testing.
• Knowledge of software testing methodologies, test design, and best practices.
• Familiarity with data science tools such as NumPy, Pandas, and scikit-learn for data manipulation
  and analysis.
• Experience with version control systems like Git for collaborative development.
• Strong analytical and problem-solving abilities to identify and resolve complex issues in ML
  systems.
• Excellent communication skills to effectively collaborate with cross-functional teams and convey
  testing results to stakeholders.
• Familiarity with popular ML frameworks such as TensorFlow or PyTorch is a plus.