Fundamentals of AI Testing

This introductory course to Artificial Intelligence (AI), gives you a broad insight into the AI methods used to test AI-based solutions and how AI-based solutions can be used to test other IT-systems.

High satisfaction

97.2% recommend our courses to others.

High Pass Rate

92% of our students pass their exams.

Experienced tutors

Tutors with many years of practical experience

Need help?

Feel free to contact us at +45 44 979 979 or e-mail us at


Course description

Learning objective

This fundamental course to AI, Artificial Intelligence, gives you a broad insight into the AI methods used to test AI-based solutions and how AI-based solutions can be used to test other IT-systems. Furthermore the following outcome:

  • Understand the current state and expected trends of AI
  • Experience the implementation and testing of a ML model and recognize where testers can best influence its quality
  • Understand the challenges associated with testing AI-Based systems, such as their self-learning capabilities, bias, ethics, complexity, non-determinism, transparency and explainability
  • Contribute to the test strategy for an AI-Based system
  • Design and execute test cases for AI-based systems
  • Recognize the special requirements for the test infrastructure to support the testing of AI-based systems
  • Understand how AI can be used to support software testing

Target audience

The course is aimed at people who are seeking to extend their understanding of artificial intelligence and/or deep (machine) learning, most specifically testing AI based systems and using AI to test. It could be the following profiles:

  • Testers and QA Engineers
  • Test Managers
  • Data Scientist
  • Developers
  • Project Managers / Scrum Masters / Product Owners


There is no official prerequisites to attend the course, but it’s a good idea to have basic knowledge and understanding of the following areas:

  • Programming language – Java/Python/R
  • Statistics
  • Experience with software development and testing

Course overview

The course contains both a theoretical review, practical exercises, and discussion. There will be a high degree of participant involvement.


Our instructors are not only used to teaching software testing and in Artificial Intelligence — they also have many years of practical experience from various IT projects, to give you the best possible instruction and acquisition. We are offering this course with a partner trainer, who is expert within Artificial Intelligence.

Course content

The course covers the following subjects:

  1. Introduction to AI
    1. Definition of AI and AI Effect
    2. Narrow, General and Super AI
    3. AI-Based and Conventional Systems
    4. AI Technologies
    5. AI Development Frameworks
    6. Hardware for AI-Based Systems
  2. Machine Learning (ML) – Overview
    1. Forms of ML
    2. ML Workflow
    3. Selecting a Form of ML
  3. ML – Data
    1. Data Preparation as Part of the ML Workflow
    2. Training, Validation and Test Datasets in the ML Workflow
    3. Dataset Quality Issues
  4. ML Functional Performance Metrics
    1. Confusion Matrix – hands-on exercise
  5. ML – Neural Networks and Testing
    1. Neural Networks
    2. Coverage Measures for Neural Networks
  6. Testing AI-Specific Quality Characteristics
    1. Challenges Testing Complex AI-Based Systems
    2. Testing the Transparency, Interpretability and Explainability of AI-Based Systems
    3. Test Oracles for AI-Based Systems
    4. Testing for Concept Drift
    5. Selecting a Test Approach for an ML System
    6. Test Objectives and Acceptance Criteria
    7. Back-to-Back Testing
    8. A/B Testing
    9. Hands-On Exercise: Metamorphic Testing
    10. Experience-Based Testing of AI-Based Systems
  7. Using AI for Testing
    1. Using AI for Defect Prediction
    2. Using AI for Testing User Interfaces


This is a 2 days course

Fundamentals of AI Testing

Fundamentals of AI Testing

Sign up