Friday, February 8, 2008

How can I test my model once it is successfully uploaded into ADAPA?

This is a good question. Given that you built your model outside of ADAPA, you want to make sure that both ADAPA and your development environment produce exactly the same results.

ADAPA provides an integrated testing process to make sure your model was uploaded and works as expected. It allows for a test file containing from 1 to thousands of records with all the necessary input variables and the expected result for each record to be uploaded for score matching.

This can be done easily through its web management console. After processing the file, ADAPA returns statistics on total amount of matched and unmatched records, percentages, etc. If any records failed the matching test, a complete list of all failed records is displayed. One can then peer through computed information for each record to locate where expected and computed values differed and thus pinpoint the source of the problem.

PMML also offers a Model Verification element for similar testing purposes. In this way, verification records are part of the PMML file itself. As of now, ADAPA does not support the Model Verification PMML element.

0 comments: