Latest CT-AI_v1.0_World Exam Dumps ISQI Exam from Training Expert TrainingQuiz
Pass ISQI ISTQB Certified Tester AI Testing (v1.0) PDF Dumps | Recently Updated 40 Questions
NEW QUESTION # 18
Which ONE of the following types of coverage SHOULD be used if test cases need to cause each neuron to achieve both positive and negative activation values?
SELECT ONE OPTION
- A. Neuron coverage
- B. Value coverage
- C. Sign change coverage
- D. Threshold coverage
Answer: C
Explanation:
Coverage for Neuron Activation Values:Sign change coverage is used to ensure that test cases cause each neuron to achieve both positive and negative activation values. This type of coverage ensures that the neurons are thoroughly tested under different activation states.
Reference:ISTQB_CT-AI_Syllabus_v1.0, Section 6.2 Coverage Measures for Neural Networks, which details different types of coverage measures, including sign change coverage.
NEW QUESTION # 19
A system was developed for screening the X-rays of patients for potential malignancy detection (skin cancer).
A workflow system has been developed to screen multiple cancers by using several individually trained ML models chained together in the workflow.
Testing the pipeline could involve multiple kind of tests (I - III):
I.Pairwise testing of combinations
II.Testing each individual model for accuracy
III.A/B testing of different sequences of models
Which ONE of the following options contains the kinds of tests that would be MOST APPROPRIATE to include in the strategy for optimal detection?
SELECT ONE OPTION
- A. Only II
- B. I and III
- C. Only III
- D. I and II
Answer: D
Explanation:
The question asks which combination of tests would be most appropriate to include in the strategy for optimal detection in a workflow system using multiple ML models.
* Pairwise testing of combinations (I): This method is useful for testing interactions between different components in the workflow to ensure they work well together, identifying potential issues in the integration.
* Testing each individual model for accuracy (II): Ensuring that each model in the workflow performs accurately on its own is crucial before integrating them into a combined workflow.
* A/B testing of different sequences of models (III): This involves comparing different sequences to determine which configuration yields the best results. While useful, it might not be as fundamental as pairwise and individual accuracy testing in the initial stages.
References:
* ISTQB CT-AI Syllabus Section 9.2 on Pairwise Testing and Section 9.3 on Testing ML Models emphasize the importance of testing interactions and individual model accuracy in complex ML workflows.
NEW QUESTION # 20
Which ONE of the following tests is LEAST likely to be performed during the ML model testing phase?
SELECT ONE OPTION
- A. Testing the API of the service powered by the ML model.
- B. Testing the speed of the prediction by the model.
- C. Testing the accuracy of the classification model.
- D. Testing the speed of the training of the model.
Answer: D
Explanation:
The question asks which test is least likely to be performed during the ML model testing phase. Let's consider each option:
* Testing the accuracy of the classification model (A): Accuracy testing is a fundamental part of the ML model testing phase. It ensures that the model correctly classifies the data as intended and meets the required performance metrics.
* Testing the API of the service powered by the ML model (B): Testing the API is crucial, especially if the ML model is deployed as part of a service. This ensures that the service integrates well with other systems and that the API performs as expected.
* Testing the speed of the training of the model (C): This is least likely to be part of the ML model testing phase. The speed of training is more relevant during the development phase when optimizing and tuning the model. During testing, the focus is more on the model's performance and behavior rather than how quickly it was trained.
* Testing the speed of the prediction by the model (D): Testing the speed of prediction is important to ensure that the model meets performance requirements in a production environment, especially for real-time applications.
References:
* ISTQB CT-AI Syllabus Section 3.2 on ML Workflow and Section 5 on ML Functional Performance Metrics discuss the focus of testing during the model testing phase, which includes accuracy and prediction speed but not the training speed.
NEW QUESTION # 21
In a conference on artificial intelligence (Al), a speaker made the statement, "The current implementation of Al using models which do NOT change by themselves is NOT true Al*. Based on your understanding of Al, is this above statement CORRECT or INCORRECT and why?
SELECT ONE OPTION
- A. This statement is incorrect. Current Al is true Al and there is no reason to believe that this fact will change over time.
- B. This statement is correct. In general, what is considered Al today may change over time.
- C. This statement is correct. In general, today the term Al is utilized incorrectly.
- D. This statement is incorrect. What is considered Al today will continue to be Al even as technology evolves and changes.
Answer: B
Explanation:
A: This statement is incorrect. Current AI is true AI and there is no reason to believe that this fact will change over time.
* AI is an evolving field, and the definition of what constitutes AI can change as technology advances.
B: This statement is correct. In general, what is considered AI today may change over time.
* The term AI is dynamic and has evolved over the years. What is considered AI today might be viewed as standard computing in the future. Historically, as technologies become mainstream, they often cease to be considered "AI".
C: This statement is incorrect. What is considered AI today will continue to be AI even as technology evolves and changes.
* This perspective does not account for the historical evolution of the definition of AI. As new technologies emerge, the boundaries of AI shift.
D: This statement is correct. In general, today the term AI is utilized incorrectly.
* While some may argue this, it is not a universal truth. The term AI encompasses a broad range of technologies and applications, and its usage is generally consistent with current technological capabilities.
NEW QUESTION # 22
Which ONE of the following hardware is MOST suitable for implementing Al when using ML?
SELECT ONE OPTION
- A. Hardware supporting fast matrix multiplication.
- B. Hardware supporting high precision floating point operations.
- C. High powered CPUs.
- D. 64-bit CPUs.
Answer: A
Explanation:
* A. 64-bit CPUs.
* While 64-bit CPUs are essential for handling large amounts of memory and performing complex computations, they are not specifically optimized for the types of operations commonly used in machine learning.
* B. Hardware supporting fast matrix multiplication.
* Matrix multiplication is a fundamental operation in many machine learning algorithms, especially in neural networks and deep learning. Hardware optimized for fast matrix multiplication, such as GPUs (Graphics Processing Units), is most suitable for implementing AI and ML because it can handle the parallel processing required for these operations efficiently.
* C. High powered CPUs.
* High powered CPUs are beneficial for general-purpose computing tasks and some aspects of ML, but they are not as efficient as specialized hardware like GPUs for matrix multiplication and other ML-specific tasks.
* D. Hardware supporting high precision floating point operations.
* High precision floating point operations are important for scientific computing and some specific AI tasks, but for many ML applications, fast matrix multiplication is more critical than high precision alone.
Therefore, the correct answer isBbecause hardware supporting fast matrix multiplication, such as GPUs, is most suitable for the parallel processing requirements of machine learning.
NEW QUESTION # 23
Which ONE of the following options is the MOST APPROPRIATE stage of the ML workflow to set model and algorithm hyperparameters?
SELECT ONE OPTION
- A. Data testing
- B. Deploying the model
- C. Tuning the model
- D. Evaluating the model
Answer: C
Explanation:
Setting model and algorithm hyperparameters is an essential step in the machine learning workflow, primarily occurring during the tuning phase.
* Evaluating the model (A): This stage involves assessing the model's performance using metrics and does not typically include the setting of hyperparameters.
* Deploying the model (B): Deployment is the stage where the model is put into production and used in real-world applications. Hyperparameters should already be set before this stage.
* Tuning the model (C): This is the correct stage where hyperparameters are set. Tuning involves adjusting the hyperparameters to optimize the model's performance.
* Data testing (D): Data testing involves ensuring the quality and integrity of the data used for training and testing the model. It does not include setting hyperparameters.
Hence, the most appropriate stage of the ML workflow to set model and algorithm hyperparameters isC.
Tuning the model.
References:
* ISTQB CT-AI Syllabus Section 3.2 on the ML Workflow outlines the different stages of the ML process, including the tuning phase where hyperparameters are set.
* Sample Exam Questions document, Question #31 specifically addresses the stage in the ML workflow where hyperparameters are configured.
NEW QUESTION # 24
Which ONE of the following describes a situation of back-to-back testing the LEAST?
SELECT ONE OPTION
- A. Comparison of the results of a current neural network model ML model implemented in platform A (for example Pytorch) with a similar neural network model ML model implemented in platform B (for example Tensorflow), for the same data.
- B. Comparison of the results of a home-grown neural network model ML model with results in a neural network model implemented in a standard implementation (for example Pytorch) for same data
- C. Comparison of the results of a neural network ML model with a current decision tree ML model for the same data.
- D. Comparison of the results of the current neural network ML model on the current data set with a slightly modified data set.
Answer: C
Explanation:
Back-to-back testing is a method where the same set of tests are run on multiple implementations of the system to compare their outputs. This type of testing is typically used to ensure consistency and correctness by comparing the outputs of different implementations under identical conditions. Let's analyze the options given:
* A. Comparison of the results of a current neural network model ML model implemented in platform A (for example Pytorch) with a similar neural network model ML model implemented in platform B (for example Tensorflow), for the same data.
* This option describes a scenario where two different implementations of the same type of model are being compared using the same dataset. This is a typical back-to-back testing situation.
* B. Comparison of the results of a home-grown neural network model ML model with results in a neural network model implemented in a standard implementation (for example Pytorch) for the same data.
* This option involves comparing a custom implementation with a standard implementation, which is also a typical back-to-back testing scenario to validate the custom model against a known benchmark.
* C. Comparison of the results of a neural network ML model with a current decision tree ML model for the same data.
* This option involves comparing two different types of models (a neural network and a decision tree). This is not a typical scenario for back-to-back testing because the models are inherently different and would not be expected to produce identical results even on the same data.
* D. Comparison of the results of the current neural network ML model on the current data set with a slightly modified data set.
* This option involves comparing the outputs of the same model on slightly different datasets. This could be seen as a form of robustness testing or sensitivity analysis, but not typical back-to-back testing as it doesn't involve comparing multiple implementations.
Based on this analysis, optionCis the one that describes a situation of back-to-back testing the least because it compares two fundamentally different models, which is not the intent of back-to-back testing.
NEW QUESTION # 25
An image classification system is being trained for classifying faces of humans. The distribution of the data is
70% ethnicity A and 30% for ethnicities B, C and D. Based ONLY on the above information, which of the following options BEST describes the situation of this image classification system?
SELECT ONE OPTION
- A. This is an example of sample bias.
- B. This is an example of algorithmic bias.
- C. This is an example of expert system bias.
- D. This is an example of hyperparameter bias.
Answer: A
Explanation:
* A. This is an example of expert system bias.
* Expert system bias refers to bias introduced by the rules or logic defined by experts in the system, not by the data distribution.
* B. This is an example of sample bias.
* Sample bias occurs when the training data is not representative of the overall population that the model will encounter in practice. In this case, the over-representation of ethnicity A (70%) compared to B, C, and D (30%) creates a sample bias, as the model may become biased towards better performance on ethnicity A.
* C. This is an example of hyperparameter bias.
* Hyperparameter bias relates to the settings and configurations used during the training process, not the data distribution itself.
* D. This is an example of algorithmic bias.
* Algorithmic bias refers to biases introduced by the algorithmic processes and decision-making rules, not directly by the distribution of training data.
Based on the provided information, optionB(sample bias) best describes the situation because the training data is skewed towards ethnicity A, potentially leading to biased model performance.
NEW QUESTION # 26
A company producing consumable goods wants to identify groups of people with similar tastes for the purpose of targeting different products for each group. You have to choose and apply an appropriate ML type for this problem.
Which ONE of the following options represents the BEST possible solution for this above-mentioned task?
SELECT ONE OPTION
- A. Classification
- B. Regression
- C. Clustering
- D. Association
Answer: C
Explanation:
* A. Regression
* Regression is used to predict a continuous value and is not suitable for grouping people based on similar tastes.
* B. Association
* Association is used to find relationships between variables in large datasets, often in the form of rules (e.g., market basket analysis). It does not directly group individuals but identifies patterns of co-occurrence.
* C. Clustering
* Clustering is an unsupervised learning method used to group similar data points based on their features. It is ideal for identifying groups of people with similar tastes without prior knowledge of the group labels. This technique will help the company segment its customer base effectively.
* D. Classification
* Classification is a supervised learning method used to categorize data points into predefined classes. It requires labeled data for training, which is not the case here as we want to identify groups without predefined labels.
Therefore, the correct answer isCbecause clustering is the most suitable method for grouping people with similar tastes for targeted product marketing.
NEW QUESTION # 27
Upon testing a model used to detect rotten tomatoes, the following data was observed by the test engineer, based on certain number of tomato images.
For this confusion matrix which combinations of values of accuracy, recall, and specificity respectively is CORRECT?
SELECT ONE OPTION
- A. 0.84.1,0.9
- B. 1,0.9, 0.8
- C. 0.87.0.9. 0.84
- D. 1,0.87,0.84
Answer: C
Explanation:
To calculate the accuracy, recall, and specificity from the confusion matrix provided, we use the following formulas:
* Confusion Matrix:
* Actually Rotten: 45 (True Positive), 8 (False Positive)
* Actually Fresh: 5 (False Negative), 42 (True Negative)
* Accuracy:
* Accuracy is the proportion of true results (both true positives and true negatives) in the total population.
* Formula: Accuracy=TP+TNTP+TN+FP+FN\text{Accuracy} = \frac{TP + TN}{TP + TN + FP + FN}Accuracy=TP+TN+FP+FNTP+TN
* Calculation: Accuracy=45+4245+42+8+5=87100=0.87\text{Accuracy} = \frac{45 + 42}{45 + 42
+ 8 + 5} = \frac{87}{100} = 0.87Accuracy=45+42+8+545+42=10087=0.87
* Recall (Sensitivity):
* Recall is the proportion of true positive results in the total actual positives.
* Formula: Recall=TPTP+FN\text{Recall} = \frac{TP}{TP + FN}Recall=TP+FNTP
* Calculation: Recall=4545+5=4550=0.9\text{Recall} = \frac{45}{45 + 5} = \frac{45}{50} =
0.9Recall=45+545=5045=0.9
* Specificity:
* Specificity is the proportion of true negative results in the total actual negatives.
* Formula: Specificity=TNTN+FP\text{Specificity} = \frac{TN}{TN + FP}Specificity=TN+FPTN
* Calculation: Specificity=4242+8=4250=0.84\text{Specificity} = \frac{42}{42 + 8} =
\frac{42}{50} = 0.84Specificity=42+842=5042=0.84
Therefore, the correct combinations of accuracy, recall, and specificity are 0.87, 0.9, and 0.84 respectively.
References:
* ISTQB CT-AI Syllabus, Section 5.1, Confusion Matrix, provides detailed formulas and explanations for calculating various metrics including accuracy, recall, and specificity.
* "ML Functional Performance Metrics" (ISTQB CT-AI Syllabus, Section 5).
NEW QUESTION # 28
A software component uses machine learning to recognize the digits from a scan of handwritten numbers. In the scenario above, which type of Machine Learning (ML) is this an example of?
SELECT ONE OPTION
- A. Regression
- B. Reinforcement learning
- C. Classification
- D. Clustering
Answer: C
Explanation:
Recognizing digits from a scan of handwritten numbers using machine learning is an example of classification.
Here's a breakdown:
* Classification: This type of machine learning involves categorizing input data into predefined classes.
In this scenario, the input data (handwritten digits) are classified into one of the 10 digit classes (0-9).
* Why Not Other Options:
* Reinforcement Learning: This involves learning by interacting with an environment to achieve a goal, which does not fit the problem of recognizing digits.
* Regression: This is used for predicting continuous values, not discrete categories like digit recognition.
* Clustering: This involves grouping similar data points together without predefined classes, which is not the case here.
References:The explanation is based on the definitions of different machine learning types as outlined in the ISTQB CT-AI syllabus, specifically under supervised learning and classification.
NEW QUESTION # 29
Which ONE of the following options does NOT describe a challenge for acquiring test data in ML systems?
SELECT ONE OPTION
- A. Test data being sourced from public sources.
- B. Compliance needs require proper care to be taken of input personal data.
- C. Data for the use case is being generated at a fast pace.
- D. Nature of data constantly changes with lime.
Answer: C
Explanation:
Challenges for Acquiring Test Data in ML Systems:Compliance needs, the changing nature of data over time, and sourcing data from public sources are significant challenges. Data being generated quickly is generally not a challenge; it can actually be beneficial as it provides more data for training and testing.
Reference:ISTQB_CT-AI_Syllabus_v1.0, Sections on Data Preparation and Data Quality Issues.
NEW QUESTION # 30
"Splendid Healthcare" has started developing a cancer detection system based on ML. The type of cancer they plan on detecting has 2% prevalence rate in the population of a particular geography. It is required that the model performs well for both normal and cancer patients.
Which ONE of the following combinations requires MAXIMIZATION?
SELECT ONE OPTION
- A. Maximize precision and accuracy
- B. Maximize accuracy and recall
- C. Maximize recall and precision
- D. Maximize specificity number of classes
Answer: C
Explanation:
* Prevalence Rate and Model Performance:
* The cancer detection system being developed by "Splendid Healthcare" needs to account for the fact that the type of cancer has a 2% prevalence rate in the population. This indicates that the dataset is highly imbalanced with far fewer positive (cancer) cases compared to negative (normal) cases.
* Importance of Recall:
* Recall, also known as sensitivity or true positive rate, measures the proportion of actual positive cases that are correctly identified by the model. In medical diagnosis, especially cancer detection, recall is critical because missing a positive case (false negative) could have severe consequences for the patient. Therefore, maximizing recall ensures that most, if not all, cancer cases are detected.
* Importance of Precision:
* Precision measures the proportion of predicted positive cases that are actually positive. High precision reduces the number of false positives, meaning fewer people will be incorrectly diagnosed with cancer. This is also important to avoid unnecessary anxiety and further invasive testing for those who do not have the disease.
* Balancing Recall and Precision:
* In scenarios where both false negatives and false positives have significant consequences, it is crucial to balance recall and precision. This balance ensures that the model is not only good at detecting positive cases but also accurate in its predictions, reducing both types of errors.
* Accuracy and Specificity:
* While accuracy (the proportion of total correct predictions) is important, it can be misleading in imbalanced datasets. In this case, high accuracy could simply result from the model predicting the
* majority class (normal) correctly. Specificity (true negative rate) is also important, but for a cancer detection system, recall and precision take precedence to ensure positive cases are correctly and accurately identified.
* Conclusion:
* Therefore, for a cancer detection system with a low prevalence rate, maximizing both recall and precision is crucial to ensure effective and accurate detection of cancer cases.
NEW QUESTION # 31
Which ONE of the following options is an example that BEST describes a system with Al-based autonomous functions?
SELECT ONE OPTION
- A. A system that is fully able to respond to its environment.
- B. A system that utilizes human beings for all important decisions.
- C. A fully automated manufacturing plant that uses no software.
- D. A system that utilizes a tool like Selenium.
Answer: A
Explanation:
AI-Based Autonomous Functions:An AI-based autonomous system is one that can respond to its environment without human intervention. The other options either involve human decisions or do not use AI at all.
Reference:ISTQB_CT-AI_Syllabus_v1.0, Sections on Autonomy and Testing Autonomous AI-Based Systems.
NEW QUESTION # 32
A ML engineer is trying to determine the correctness of the new open-source implementation *X", of a supervised regression algorithm implementation. R-Square is one of the functional performance metrics used to determine the quality of the model.
Which ONE of the following would be an APPROPRIATE strategy to achieve this goal?
SELECT ONE OPTION
- A. Drop 10% of the rows randomly and create another model and compare the R-Square scores of both the models.
- B. Train various models by changing the order of input features and verify that the R-Square score of these models vary significantly.
- C. Compare the R-Square score of the model obtained using two different implementations that utilize two different programming languages while using the same algorithm and the same training and testing data.
- D. Add 10% of the rows randomly and create another model and compare the R-Square scores of both the model.
Answer: C
Explanation:
* A. Add 10% of the rows randomly and create another model and compare the R-Square scores of both the models.
* Adding more data to the training set can affect the R-Square score, but it does not directly verify the correctness of the implementation.
* B. Train various models by changing the order of input features and verify that the R-Square score of these models vary significantly.
* Changing the order of input features should not significantly affect the R-Square score if the implementation is correct, but this approach is more about testing model robustness rather than correctness of the implementation.
* C. Compare the R-Square score of the model obtained using two different implementations that utilize two different programming languages while using the same algorithm and the same training and testing data.
* This approach directly compares the performance of two implementations of the same algorithm.
If both implementations produce similar R-Square scores on the same training and testing data, it suggests that the new implementation "X" is correct.
* D. Drop 10% of the rows randomly and create another model and compare the R-Square scores of both the models.
* Dropping data can lead to variations in the R-Square score but does not directly verify the
* correctness of the implementation.
Therefore, optionCis the most appropriate strategy because it directly compares the performance of the new implementation "X" with another implementation using the same algorithm and datasets, which helps in verifying the correctness of the implementation.
NEW QUESTION # 33
"AllerEgo" is a product that uses sell-learning to predict the behavior of a pilot under combat situation for a variety of terrains and enemy aircraft formations. Post training the model was exposed to the real- world data and the model was found to bebehaving poorly. A lot of data quality tests had been performed on the data to bring it into a shape fit for training and testing.
Which ONE of the following options is least likely to describes the possible reason for the fall in the performance, especially when considering the self-learning nature of the Al system?
SELECT ONE OPTION
- A. The difficulty of defining criteria for improvement before the model can be accepted.
- B. The unknown nature and insufficient specification of the operating environment might have caused the poor performance.
- C. There was an algorithmic bias in the Al system.
- D. The fast pace of change did not allow sufficient time for testing.
Answer: A
Explanation:
* A. The difficulty of defining criteria for improvement before the model can be accepted.
* Defining criteria for improvement is a challenge in the acceptance of AI models, but it is not directly related to the performance drop in real-world scenarios. It relates more to the evaluation and deployment phase rather than affecting the model's real-time performance post-deployment.
* B. The fast pace of change did not allow sufficient time for testing.
* This can significantly affect the model's performance. If the system is self-learning, it needs to adapt quickly, and insufficient testing time can lead to incomplete learning and poor performance.
* C. The unknown nature and insufficient specification of the operating environment might have caused the poor performance.
* This is highly likely to affect performance. Self-learning AI systems require detailed specifications of the operating environment to adapt and learn effectively. If the environment is insufficiently specified, the model may fail to perform accurately in real-world scenarios.
* D. There was an algorithmic bias in the AI system.
* Algorithmic bias can significantly impact the performance of AI systems. If the model has biases, it will not perform well across different scenarios and data distributions.
Given the context of the self-learning nature and the need for real-time adaptability, optionAis least likely to describe the fall in performance because it deals with acceptance criteria rather than real-time performance issues.
NEW QUESTION # 34
......
Updated Test Engine to Practice CT-AI_v1.0_World Dumps & Practice Exam: https://pass4sure.trainingquiz.com/CT-AI_v1.0_World-training-materials.html
