Yes, it is OK. Warnings are generated whenever ADAPA finds inconsistencies in the PMML file which do not affect scoring. However, you should check all warnings even if you get a perfect score match, i.e. your model validates fine.
For example, if you upload the model "Iris_SVM" from the PMML Examples page of the Zementis website, you will get warnings. If you click on the "warnings" hyperlink in the ADAPA Predictive Analytics demo, you will get a file back entitled "uploadedFile.xml". By opening this file in your XML editor, you will be able to see the PMML model you just uploaded with all detected warnings embedded into it as PMML extensions. ADAPA will also generate a comment on the top of the file giving a summary of its findings. For the "Iris_SVM" model, this reads as follows:
Comment generated by ADAPA: There are at least 6 warnings in this PMML document.
Detailed information can be found as comments or as Extension elements embedded in the appropriate locations within this document.
The first warning talks about the timestamp which is not in the right format. For all other warnings look for PMML extensions with name = "WARNING".
Showing posts with label ADAPA Warning Messages. Show all posts
Showing posts with label ADAPA Warning Messages. Show all posts
Friday, March 21, 2008
Monday, March 17, 2008
How do I use the ADAPA Predictive Analytics demo?
For a video tutorial on how to use the ADAPA Predictive Analytics demo, click here ...
When you first launch the ADAPA Predictive Analytics demo, we will see a single tab entitled "New Model" ... this is where you upload your PMML 3.2 model. You can browse for your model file and once you locate it, click on "Upload".
In the example below, the model named "Audit_NN" was uploaded successfully into ADAPA. This model can be found among the PMML examples supplied in the Zementis website.
You then need to click on the model tab, which in this case is "Audit_NN" to be able to upload a data file for verification or scoring. Note that the tab will contain the model description together with a link to a file containing possible warnings that were generated by ADAPA during model uploading.
Note that the ADAPA Predictive Analytics demo will only accept files for uploading up to 1MB.
You can now browse for the data validation file, in this case "Audit_NN.csv" which contains 2000 records with inputs as well as the expected output value for the "Audit_NN" model. This file is also available in the PMML examples page of the Zementis website.
Once the data file is uploaded and results are generated, the ADAPA Predictive Analytics demo will display the first five records as shown below.
Note that in this case, there is a perfect match between computed and expected values for the predicted field. If, for any reason, the results do not match, the first five mismatched records will be displayed instead. All values under the "Computed Value" column are hyperlinks. By clicking on one of these values, you will have access to debugging information which can be very useful in case you do get a mismatch.
Once you are able to validate that the model is working as expected, you can browse and upload a file for scoring.
When you first launch the ADAPA Predictive Analytics demo, we will see a single tab entitled "New Model" ... this is where you upload your PMML 3.2 model. You can browse for your model file and once you locate it, click on "Upload".
In the example below, the model named "Audit_NN" was uploaded successfully into ADAPA. This model can be found among the PMML examples supplied in the Zementis website.
You then need to click on the model tab, which in this case is "Audit_NN" to be able to upload a data file for verification or scoring. Note that the tab will contain the model description together with a link to a file containing possible warnings that were generated by ADAPA during model uploading.
Note that the ADAPA Predictive Analytics demo will only accept files for uploading up to 1MB.
You can now browse for the data validation file, in this case "Audit_NN.csv" which contains 2000 records with inputs as well as the expected output value for the "Audit_NN" model. This file is also available in the PMML examples page of the Zementis website.
Once the data file is uploaded and results are generated, the ADAPA Predictive Analytics demo will display the first five records as shown below.
Note that in this case, there is a perfect match between computed and expected values for the predicted field. If, for any reason, the results do not match, the first five mismatched records will be displayed instead. All values under the "Computed Value" column are hyperlinks. By clicking on one of these values, you will have access to debugging information which can be very useful in case you do get a mismatch.
Once you are able to validate that the model is working as expected, you can browse and upload a file for scoring.
Friday, February 8, 2008
ADAPA refuses to upload my model, what should I do?
Before successfully uploading a PMML file, ADAPA will make sure that it is a valid PMML 3.2 file. During this phase, you may get many syntax errors. All errors need to be resolved before ADAPA successfully uploads a model. Syntax errors (your model is not a valid model according to the PMML 3.2 schema) are displayed as embedded comments in your model file - try clicking on the "details" hyperlink and open the file in an XML editor.
Once your file passes schema validation, it will also be semantically checked (ADAPA will ask: does this model make sense?). Semantic errors and warning are displayed in the model file as embedded PMML extenstions.
If you are using a licensed version of ADAPA through its web management console, errors and warnings are displayed in the console itself.
Use the information you get back from ADAPA to correct your PMML file and give it another try. If you use a PMML element not currently supported by ADAPA, feel free to let us know. You can find our contact information in the Zementis website, contacts page.
Once your file passes schema validation, it will also be semantically checked (ADAPA will ask: does this model make sense?). Semantic errors and warning are displayed in the model file as embedded PMML extenstions.
If you are using a licensed version of ADAPA through its web management console, errors and warnings are displayed in the console itself.
Use the information you get back from ADAPA to correct your PMML file and give it another try. If you use a PMML element not currently supported by ADAPA, feel free to let us know. You can find our contact information in the Zementis website, contacts page.
Subscribe to:
Posts (Atom)
