For multiclass-classification with k classes, k > 2, the R ksvm function uses the `one-against-one'-approach, in which k(k-1)/2 binary classifiers are trained; the appropriate class is found by a voting scheme.
In order to implement such a scheme in ADAPA, we needed to extend PMML 3.2. Basically, PMML asks for a single target category to be associated with each Support Vector Machine. In case of a binary classifier, PMML actually asks for the alternate binary target category.
So, in order to implement the one-against-one approach, we needed to give each machine an extra alternate target category given that all k(k-1)/2 machines are binary classifiers.
Note that ADAPA also supports one-against-all approach (also known as one-against-rest) for which the PMML extension is not necessary.
Voting schemes for multiclass-classification problems in SVM are described in:
C.-W. Hsu and C.-J. Lin
A comparison on methods for multi-class support vector machines
IEEE Transactions on Neural Networks, 13(2002) 415-425.
http://www.csie.ntu.edu.tw/~cjlin/papers/multisvm.ps.gz
Showing posts with label Extending PMML. Show all posts
Showing posts with label Extending PMML. Show all posts
Friday, February 8, 2008
Subscribe to:
Posts (Atom)