5-dehydro-4-deoxyglucarate dehydratase: Difference between revisions
en>RJFJR Enzyme class |
en>RJFJR remove {{Cleanup|date=November 2007}} |
||
Line 1: | Line 1: | ||
{{technical|date=November 2011}} | |||
{{overly detailed|date=November 2011}} | |||
'''Dominance-based rough set approach''' ('''DRSA''') is an extension of [[rough set|rough set theory]] for [[multi-criteria decision analysis]] (MCDA), introduced by Greco, Matarazzo and Słowiński.<ref name="Greco_et_al_2001"> | |||
Greco, S., Matarazzo, B., Słowiński, R.: Rough sets theory for multi-criteria decision analysis. European Journal of Operational Research, '''129''', 1 (2001) 1–47</ref><ref> | |||
Greco, S., Matarazzo, B., Słowiński, R.: Multicriteria classification by | |||
dominance-based rough set approach. In: W.Kloesgen and J.Zytkow (eds.), Handbook of Data Mining and Knowledge Discovery, Oxford University Press, New York, 2002</ref><ref> | |||
Słowiński, R., Greco, S., Matarazzo, B.: Rough set based decision support. Chapter 16 [in]: E.K. Burke and G. Kendall (eds.), Search Methodologies: Introductory Tutorials in Optimization and Decision Support Techniques, Springer-Verlag , New York (2005) 475–527</ref> The main change comparing to the classical [[rough sets]] is the substitution of the indiscernibility relation by a dominance relation, which permits to deal with inconsistencies typical to consideration of '''criteria''' and '''preference-ordered decision classes'''. | |||
==Multicriteria classification (sorting)== | |||
'''[[Multicriteria classification]]''' ([[Multicriteria sorting|sorting]]) is one of the problems considered within [[MCDA]] and can be stated as follows: given a set of objects evaluated by a set of [[criterion (MCDA)|criteria]] (attributes with preference-order domains), assign these objects to some pre-defined and preference-ordered decision classes, such that each object is assigned to exactly one class. Due to the preference ordering, improvement of evaluations of an object on the criteria should not worsen its class assignment. The sorting problem is very similar to the problem of [[Statistical classification|classification]], however, in the latter, the objects are evaluated by regular attributes and the decision classes are not necessarily preference ordered. The problem of multicriteria classification is also referred to as [[ordinal classification problem with monotonicity constraints]] and often appears in real-life application when [[Ordinal scale|ordinal]] and [[monotonic function|monotone]] properties follow from the domain knowledge about the problem. | |||
As an illustrative example, consider the problem of evaluation in a high school. The director of the school wants to assign students (''objects'') to three classes: ''bad'', ''medium'' and ''good'' (notice that class ''good'' is preferred to ''medium'' and ''medium'' is preferred to ''bad''). Each student is described by three criteria: level in Physics, Mathematics and Literature, each taking one of three possible values ''bad'', ''medium'' and ''good''. Criteria are preference-ordered and improving the level from one of the subjects should not result in worse global evaluation (class). | |||
As a more serious example, consider classification of bank clients, from the viewpoint of bankruptcy risk, into classes ''safe'' and ''risky''. This may involve such characteristics as "[[return on equity]] (ROE)", "[[return on investment]] (ROI)" and "[[return on sales]] (ROS)". The domains of these attributes are not simply ordered but involve a preference order since, from the viewpoint of bank managers, greater values of ROE, ROI or ROS are better for clients being analysed for bankruptcy risk . Thus, these attributes are criteria. Neglecting this information in [[knowledge discovery]] may lead to wrong conclusions. | |||
==Data representation== | |||
===Decision table=== | |||
In DRSA, data are often presented using a particular form of [[decision table]]. Formally, a DRSA decision table is a 4-tuple <math>S = \langle U, Q, V, f \rangle</math>, where <math>U\,\!</math> is a finite set of objects, <math>Q\,\!</math> is a finite set of criteria, <math>V=\bigcup {}_{q \in Q} V_q</math> where <math>V_q\,\!</math> is the domain of the criterion <math>q\,\!</math> and <math>f \colon U \times Q \to V</math> is an ''information function'' such that <math>f(x,q) \in V_q</math> for every <math>(x,q) \in U \times Q</math>. The set <math>Q\,\!</math> is divided into ''condition criteria'' (set <math>C \neq \emptyset</math>) and the ''decision criterion'' (''class'') <math>d\,\!</math>. Notice, that <math>f(x,q)\,\!</math> is an evaluation of object <math>x\,\!</math> on criterion <math>q \in C</math>, while <math>f(x,d)\,\!</math> is the class assignment (decision value) of the object. An example of decision table is shown in Table 1 below. | |||
===Outranking relation=== | |||
It is assumed that the domain of a criterion <math>q \in Q</math> is completely [[preorder]]ed by an '''[[outranking relation]]''' <math>\succeq_q</math>; <math>x \succeq_q y</math> means that <math>x\,\!</math> is at least as good as (outranks) <math>y\,\!</math> with respect to the criterion <math>q\,\!</math>. Without loss of generality, we assume that the domain of <math>q\,\!</math> is a subset of [[real number|reals]], <math>V_q \subseteq \mathbb{R}</math>, and that the outranking relation is a simple order between real numbers <math>\geq\,\!</math> such that the following relation holds: <math>x \succeq_q y \iff f(x,q) \geq f(y,q)</math>. This relation is straightforward for gain-type ("the more, the better") criterion, e.g. ''company profit''. For cost-type ("the less, the better") criterion, e.g. ''product price'', this relation can be satisfied by negating the values from <math>V_q\,\!</math>. | |||
===Decision classes and class unions=== | |||
Let <math>T = \{1,\ldots,n\}\,\!</math>. The domain of decision criterion, <math>V_d\,\!</math> consist of <math>n\,\!</math> elements (without loss of generality we assume <math>V_d = T\,\!</math>) and induces a partition of <math>U\,\!</math> into <math>n\,\!</math> classes <math>\textbf{Cl}=\{Cl_t, t \in T\}</math>, where <math>Cl_t = \{x \in U \colon f(x,d) = t\}</math>. Each object <math>x \in U</math> is assigned to one and only one class <math>Cl_t, t \in T</math>. The classes are preference-ordered according to an increasing order of class indices, i.e. for all <math>r,s \in T</math> such that <math>r \geq s\,\!</math>, the objects from <math>Cl_r\,\!</math> are strictly preferred to the objects from <math>Cl_s\,\!</math>. For this reason, we can consider the '''upward and downward unions of classes''', defined respectively, as: | |||
:<math> | |||
Cl^{\geq}_t = \bigcup_{s \geq t} Cl_s \qquad Cl^{\leq}_t= \bigcup_{s \leq t} Cl_s \qquad t \in T | |||
</math> | |||
==Main concepts== | |||
===Dominance=== | |||
We say that <math>x\,\!</math> '''dominates''' <math>y\,\!</math> with respect to <math>P \subseteq C</math>, denoted by <math> x D_p y\,\!</math>, if <math>x\,\!</math> is better than <math>y\,\!</math> on every criterion from <math>P\,\!</math>, <math>x \succeq_q y, \, \forall q \in P</math>. For each <math>P \subseteq C</math>, the dominance relation <math>D_P\,\!</math> is [[Reflexive relation|reflexive]] and [[Transitive relation|transitive]], i.e. it is a [[preorder|partial pre-order]]. Given <math>P \subseteq C</math> and <math>x \in U</math>, let | |||
:<math> | |||
D_P^+(x) = \{y \in U \colon y D_p x \} | |||
</math> | |||
:<math> | |||
D_P^-(x) = \{y \in U \colon x D_p y \} | |||
</math> | |||
represent '''''P''-dominating''' set and '''''P''-dominated''' set with respect to <math>x \in U</math>, respectively. | |||
===Rough approximations=== | |||
The key idea of the [[rough set]] philosophy is approximation of one knowledge by another knowledge. In DRSA, the knowledge being approximated is a collection of upward and downward unions of decision classes and the "granules of knowledge" used for approximation are ''P''-dominating and ''P''-dominated sets. | |||
The '''''P''-lower''' and the '''''P''-upper approximation''' of <math>Cl_t^{\geq}, t \in T</math> with respect to <math>P \subseteq C</math>, denoted as <math>\underline{P}(Cl_t^{\geq})</math> and <math>\overline{P}(Cl_t^{\geq})</math>, respectively, are defined as: | |||
:<math> | |||
\underline{P}(Cl_t^{\geq}) = \{x \in U \colon D_P^+(x) \subseteq Cl_t^{\geq} \} | |||
</math> | |||
:<math> | |||
\overline{P}(Cl_t^{\geq}) = \{x \in U \colon D_P^-(x) \cap Cl_t^{\geq} \neq \emptyset\} | |||
</math> | |||
Analogously, the ''P''-lower and the ''P''-upper approximation of <math>Cl_t^{\leq}, t \in T</math> with respect to <math>P \subseteq C</math>, denoted as <math>\underline{P}(Cl_t^{\leq})</math> and <math>\overline{P}(Cl_t^{\leq})</math>, respectively, are defined as: | |||
:<math> | |||
\underline{P}(Cl_t^{\leq}) = \{x \in U \colon D_P^-(x) \subseteq Cl_t^{\leq} \} | |||
</math> | |||
:<math> | |||
\overline{P}(Cl_t^{\leq}) = \{x \in U \colon D_P^+(x) \cap Cl_t^{\leq} \neq \emptyset\} | |||
</math> | |||
Lower approximations group the objects which ''certainly'' belong to class union <math>Cl^{\ge}_t</math> (respectively <math>Cl^{\le}_t</math>). This certainty comes from the fact, that object <math>x \in U</math> belongs to the lower approximation <math>\underline{P}(Cl^{\ge}_t)</math> (respectively <math>\underline{P}(Cl^{\le}_t)</math>), if no other object in <math>U\,\!</math> contradicts this claim, i.e. every object <math>y \in U</math> which ''P''-dominates <math>x\,\!</math>, also belong to the class union <math>Cl^{\ge}_t</math> (respectively <math>Cl^{\le}_t</math>). Upper approximations group the objects which ''could belong'' to <math>Cl^{\ge}_t</math> (respectively <math>Cl^{\le}_t</math>), since object <math>x \in U</math> belongs to the upper approximation <math>\overline{P}(Cl^{\ge}_t)</math> (respectively <math>\overline{P}(Cl^{\le}_t)</math>), if there exist another object <math>y \in U</math> ''P''-dominated by <math>x\,\!</math> from class union <math>Cl^{\ge}_t</math> (respectively <math>Cl^{\le}_t</math>). | |||
The ''P''-lower and ''P''-upper approximations defined as above satisfy the following properties for all <math>t \in T</math> and for any <math>P \subseteq C</math>: | |||
:<math> | |||
\underline{P}(Cl_t^{\geq}) \subseteq Cl_t^{\geq} \subseteq \overline{P}(Cl_t^{\geq}) | |||
</math> | |||
:<math> | |||
\underline{P}(Cl_t^{\leq}) \subseteq Cl_t^{\leq} \subseteq \overline{P}(Cl_t^{\leq}) | |||
</math> | |||
The '''''P''-boundaries''' (''P-doubtful regions'') of <math>Cl_t^{\geq}</math> and <math>Cl_t^{\leq}</math> are defined as: | |||
:<math> | |||
Bn_P(Cl_t^{\geq}) = \overline{P}(Cl_t^{\geq})-\underline{P}(Cl_t^{\geq}) | |||
</math> | |||
:<math> | |||
Bn_P(Cl_t^{\leq}) = \overline{P}(Cl_t^{\leq})-\underline{P}(Cl_t^{\leq}) | |||
</math> | |||
===Quality of approximation and reducts=== | |||
The ratio | |||
:<math> | |||
\gamma_P(\textbf{Cl}) = \frac{\left|U - \left( \left( \bigcup_{t \in T} Bn_P(Cl_t^{\geq}) \right) \cup \left( \bigcup_{t \in T} Bn_P(Cl_t^{\leq}) \right) \right)\right|}{|U|} | |||
</math> | |||
defines the '''quality of approximation''' of the partition <math>\textbf{Cl}\,\!</math> into classes by means of the set of criteria <math>P\,\!</math>. This ratio express the relation between all the ''P''-correctly classified objects and all the objects in the table. | |||
Every minimal subset <math>P \subseteq C</math> such that <math>\gamma_P(\mathbf{Cl}) = \gamma_C(\mathbf{Cl})\,\!</math> is called a '''[[reduct]]''' of <math>C\,\!</math> and is denoted by <math>RED_{\mathbf{Cl}}(P)</math>. A decision table may have more than one reduct. The intersection of all reducts is known as the ''core''. | |||
==Decision rules== | |||
On the basis of the approximations obtained by means of the dominance relations, it is possible to induce a generalized description of the preferential information contained in the decision table, in terms of '''[[decision rules]]'''. The decision rules are expressions of the form ''if'' [condition] ''then'' [consequent], that represent a form of dependency between condition criteria and decision criteria. Procedures for generating decision rules from a decision table use an inducive learning principle. We can distinguish three types of rules: certain, possible and approximate. Certain rules are generated from lower approximations of unions of classes; possible rules are generated from upper approximations of unions of classes and approximate rules are generated from boundary regions. | |||
Certain rules has the following form: | |||
: | |||
if <math>f(x,q_1) \geq r_1\,\!</math> and <math>f(x,q_2) \geq r_2\,\!</math> and <math>\ldots f(x,q_p) \geq r_p\,\!</math> then <math>x \in Cl_t^{\geq}</math> | |||
: | |||
if <math>f(x,q_1) \leq r_1\,\!</math> and <math>f(x,q_2) \leq r_2\,\!</math> and <math>\ldots f(x,q_p) \leq r_p\,\!</math> then <math>x \in Cl_t^{\leq}</math> | |||
Possible rules has a similar syntax, however the ''consequent'' part of the rule has the form: <math>x\,\!</math> ''could belong to'' <math>Cl_t^{\geq}</math> or the form: <math>x\,\!</math> ''could belong to'' <math>Cl_t^{\leq}</math>. | |||
Finally, approximate rules has the syntax: | |||
: | |||
if <math>f(x,q_1) \geq r_1\,\!</math> and <math>f(x,q_2) \geq r_2\,\!</math> and <math>\ldots f(x,q_k) \geq r_k\,\!</math> and <math>f(x,q_{k+1}) \leq r_{k+1}\,\!</math> and <math>f(x,q_{k+2}) \leq r_{k+2}\,\!</math> and <math>\ldots f(x,q_p) \leq r_p\,\!</math> | |||
then <math>x \in Cl_s \cup Cl_{s+1} \cup Cl_t</math> | |||
The certain, possible and approximate rules represent certain, possible and ambiguous knowledge extracted from the decision table. | |||
Each decision rule should be minimal. Since a decision rule is an implication, by a minimal decision rule we understand such an implication that there is no other implication with an antecedent of at least the same weakness (in other words, rule using a subset of elementary conditions or/and weaker elementary conditions) and a consequent of at least the same strength (in other words, rule assigning objects to the same union or sub-union of classes). | |||
A set of decision rules is ''complete'' if it is able to cover all objects from the decision table in such a way that consistent objects are re-classified to their original classes and inconsistent objects are classified to clusters of classes referring to this inconsistency. We call ''minimal'' each set of decision rules that is complete and non-redundant, i.e. exclusion of any rule from this set makes it non-complete. | |||
One of three induction strategies can be adopted to obtain a set of decision rules:<ref>Stefanowski, J.: On rough set based approach to induction of decision rules. In Skowron, A., Polkowski, L. (eds.): Rough Set in Knowledge Discovering, Physica Verlag, Heidelberg (1998) 500--529</ref> | |||
* generation of a minimal description, i.e. a minimal set of rules, | |||
* generation of an exhaustive description, i.e. all rules for a given data matrix, | |||
* generation of a characteristic description, i.e. a set of rules covering relatively many objects each, however, all together not necessarily all objects from the decision table | |||
The most popular rule induction algorithm for dominance-based rough set approach is DOMLEM,<ref> | |||
Greco S., Matarazzo, B., Słowiński, R., Stefanowski, J.: An Algorithm for Induction of Decision Rules Consistent with the Dominance Principle. In W. Ziarko, Y. Yao (eds.): Rough Sets and Current Trends in Computing. Lecture Notes in Artificial Intelligence '''2005''' (2001) 304--313. Springer-Verlag</ref> which generates minimal set of rules. | |||
==Example== | |||
Consider the following problem of high school students evaluations: | |||
:{| class="wikitable" style="text-align:center" border="1" | |||
|+ Table 1: Example—High School Evaluations | |||
! ''object'' (student) !! <math>q_1</math> <br> <small>(Mathematics)</small> !! <math>q_2</math> <br> <small>(Physics)</small> !! <math>q_3</math> <br> <small>(Literature)</small> !! !! <math>d</math> <br> <small>(global score)</small> | |||
|- | |||
!<math>x_1</math> | |||
|medium || medium || bad || || bad | |||
|- | |||
!<math>x_2</math> | |||
|good || medium || bad || || medium | |||
|- | |||
!<math>x_3</math> | |||
|medium || good || bad || || medium | |||
|- | |||
!<math>x_4</math> | |||
|bad || medium || good || || bad | |||
|- | |||
!<math>x_5</math> | |||
|bad || bad || medium || || bad | |||
|- | |||
!<math>x_6</math> | |||
|bad || medium || medium || || medium | |||
|- | |||
!<math>x_7</math> | |||
|good || good || bad || || good | |||
|- | |||
!<math>x_8</math> | |||
|good || medium || medium || || medium | |||
|- | |||
!<math>x_9</math> | |||
|medium || medium || good || || good | |||
|- | |||
!<math>x_{10}</math> | |||
|good || medium || good || || good | |||
|} | |||
Each object (student) is described by three criteria <math>q_1,q_2,q_3\,\!</math>, related to the levels in Mathematics, Physics and Literature, respectively. According to the decision attribute, the students are divided into three preference-ordered classes: <math>Cl_1 = \{bad\}</math>, <math>Cl_2 = \{medium\}</math> and <math>Cl_3 = \{good\}</math>. Thus, the following unions of classes were approximated: | |||
* <math>Cl_1^{\leq}</math> i.e. the class of (at most) bad students, | |||
* <math>Cl_2^{\leq}</math> i.e. the class of at most medium students, | |||
* <math>Cl_2^{\geq}</math> i.e. the class of at least medium students, | |||
* <math>Cl_3^{\geq}</math> i.e. the class of (at least) good students. | |||
Notice that evaluations of objects <math>x_4\,\!</math> and <math>x_6\,\!</math> are inconsistent, because <math>x_4\,\!</math> has better evaluations on all three criteria than <math>x_6\,\!</math> but worse global score. | |||
Therefore, lower approximations of class unions consist of the following objects: | |||
:<math>\underline{P}(Cl_1^{\leq}) = \{x_1,x_5\}</math> | |||
:<math>\underline{P}(Cl_2^{\leq}) = \{x_1,x_2,x_3,x_4,x_5,x_6,x_8\} = Cl_2^{\leq}</math> | |||
:<math>\underline{P}(Cl_2^{\geq}) = \{x_2,x_3,x_7,x_8,x_9,x_{10}\}</math> | |||
:<math>\underline{P}(Cl_3^{\geq}) = \{x_7,x_9,x_{10}\} = Cl_3^{\geq}</math> | |||
Thus, only classes <math>Cl_1^{\leq}</math> and <math>Cl_2^{\geq}</math> cannot be approximated precisely. Their upper approximations are as follows: | |||
:<math>\overline{P}(Cl_1^{\leq}) = \{x_1,x_4,x_5,x_6\}</math> | |||
:<math>\overline{P}(Cl_2^{\geq}) = \{x_2,x_3,x_4,x_6,x_7,x_8,x_9,x_{10}\}</math> | |||
while their boundary regions are: | |||
:<math>Bn_P(Cl_1^{\leq}) = Bn_P(Cl_2^{\geq}) = \{x_4,x_6\}</math> | |||
Of course, since <math>Cl_2^{\leq}</math> and <math>Cl_3^{\geq}</math> are approximated precisely, we have <math>\overline{P}(Cl_2^{\leq})=Cl_2^{\leq}</math>, <math>\overline{P}(Cl_3^{\geq})=Cl_3^{\geq}</math> and <math>Bn_P(Cl_2^{\leq}) = Bn_P(Cl_3^{\geq}) = \emptyset</math> | |||
The following minimal set of 10 rules can be induced from the decision table: | |||
# ''if'' <math>Physics \leq bad</math> ''then'' <math>student \leq bad</math> | |||
# ''if'' <math>Literature \leq bad</math> ''and'' <math>Physics \leq medium</math> ''and'' <math>Math \leq medium</math> ''then'' <math>student \leq bad</math> | |||
# ''if'' <math>Math \leq bad</math> ''then'' <math>student \leq medium</math> | |||
# ''if'' <math>Literature \leq medium</math> ''and'' <math>Physics \leq medium</math> ''then'' <math>student \leq medium</math> | |||
# ''if'' <math>Math \leq medium</math> ''and'' <math>Literature \leq bad</math> ''then'' <math>student \leq medium</math> | |||
# ''if'' <math>Literature \geq good</math> ''and'' <math>Math \geq medium</math> ''then'' <math>student \geq good</math> | |||
# ''if'' <math>Physics \geq good</math> ''and'' <math>Math \geq good</math> ''then'' <math>student \geq good</math> | |||
# ''if'' <math>Math \geq good</math> ''then'' <math>student \geq medium</math> | |||
# ''if'' <math>Physics \geq good</math> ''then'' <math>student \geq medium</math> | |||
# ''if'' <math>Math \leq bad</math> ''and'' <math>Physics \geq medium</math> ''then'' <math>student = bad \lor medium</math> | |||
The last rule is approximate, while the rest are certain. | |||
==Extensions== | |||
===Multicriteria choice and ranking problems=== | |||
The other two problems considered within [[multi-criteria decision analysis]], [[multicriteria choice]] and [[ranking]] problems, can also be solved using dominance-based rough set approach. This is done by converting the decision table into [[pairwise comparison table]] (PCT).<ref name="Greco_et_al_2001"/> | |||
===Variable-consistency DRSA=== | |||
The definitions of rough approximations are based on a strict application of the dominance principle. However, when defining non-ambiguous objects, it is reasonable to accept a limited proportion of negative examples, particularly for large decision tables. Such extended version of DRSA is called '''[[Variable-Consistency DRSA]] model (VC-DRSA)'''<ref>Greco, S., B. Matarazzo, R. Slowinski and J. Stefanowski: Variable consistency model of dominance-based rough set approach. In W.Ziarko, Y.Yao (eds.): Rough Sets and Current Trends in Computing. Lecture Notes in Artificial Intelligence '''2005''' (2001) 170–181. Springer-Verlag</ref> | |||
===Stochastic DRSA=== | |||
In real-life data, particularly for large datasets, the notions of rough approximations were found to be excessively restrictive. Therefore an extension of DRSA, based on stochastic model ('''[[stochastic dominance-based rough sets|Stochastic DRSA]]'''), which allows inconsistencies to some degree, has been introduced.<ref>Dembczyński, K., Greco, S., Kotłowski, W., Słowiński, R.: Statistical model for rough set approach to multicriteria classification. In Kok, J.N., Koronacki, J., de Mantaras, R.L., Matwin, S., | |||
Mladenic, D., Skowron, A. (eds.): Knowledge Discovery in Databases: PKDD 2007, Warsaw, Poland. Lecture Notes in Computer Science '''4702''' (2007) 164–175.</ref> Having stated the probabilistic model for ordinal classification problems with monotonicity constraints, the concepts of lower approximations are extended to the | |||
stochastic case. The method is based on estimating the conditional probabilities using the nonparametric [[maximum likelihood]] method which leads | |||
to the problem of [[isotonic regression]]. | |||
Stochastic dominance-based rough sets can also be regarded as a sort of variable-consistency model. | |||
== Software == | |||
[http://idss.cs.put.poznan.pl/site/software.html 4eMka2] is a [[decision support system]] for multiple criteria classification problems based on dominance-based rough sets (DRSA). [http://idss.cs.put.poznan.pl/site/jamm.html JAMM] is a much more advanced successor of 4eMka2. Both systems are freely available for non-profit purposes on the [http://idss.cs.put.poznan.pl Laboratory of Intelligent Decision Support Systems (IDSS)] website. | |||
== See also == | |||
* [[Rough sets]] | |||
* [[Soft computing]] | |||
* [[Granular computing]] | |||
* [[MCDA|Multicriteria Decision Analysis (MCDA)]] | |||
== References == | |||
{{reflist}} | |||
== External links == | |||
* [http://www.roughsets.org The International Rough Set Society] | |||
* [http://idss.cs.put.poznan.pl Laboratory of Intelligent Decision Support Systems (IDSS)] at [http://put.poznan.pl Poznań University of Technology]. | |||
* Extensive list of DRSA references on the [http://idss.cs.put.poznan.pl/site/rslowinski.html Roman Słowiński] home page. | |||
[[Category:Theoretical computer science]] | |||
[[Category:Decision theory]] | |||
[[Category:Machine learning algorithms]] |
Latest revision as of 20:42, 4 October 2012
My name is Winnie and I am studying Anthropology and Sociology and Modern Languages and Classics at Rillieux-La-Pape / France.
Also visit my web site ... hostgator1centcoupon.info
Template:Overly detailed
Dominance-based rough set approach (DRSA) is an extension of rough set theory for multi-criteria decision analysis (MCDA), introduced by Greco, Matarazzo and Słowiński.[1][2][3] The main change comparing to the classical rough sets is the substitution of the indiscernibility relation by a dominance relation, which permits to deal with inconsistencies typical to consideration of criteria and preference-ordered decision classes.
Multicriteria classification (sorting)
Multicriteria classification (sorting) is one of the problems considered within MCDA and can be stated as follows: given a set of objects evaluated by a set of criteria (attributes with preference-order domains), assign these objects to some pre-defined and preference-ordered decision classes, such that each object is assigned to exactly one class. Due to the preference ordering, improvement of evaluations of an object on the criteria should not worsen its class assignment. The sorting problem is very similar to the problem of classification, however, in the latter, the objects are evaluated by regular attributes and the decision classes are not necessarily preference ordered. The problem of multicriteria classification is also referred to as ordinal classification problem with monotonicity constraints and often appears in real-life application when ordinal and monotone properties follow from the domain knowledge about the problem.
As an illustrative example, consider the problem of evaluation in a high school. The director of the school wants to assign students (objects) to three classes: bad, medium and good (notice that class good is preferred to medium and medium is preferred to bad). Each student is described by three criteria: level in Physics, Mathematics and Literature, each taking one of three possible values bad, medium and good. Criteria are preference-ordered and improving the level from one of the subjects should not result in worse global evaluation (class).
As a more serious example, consider classification of bank clients, from the viewpoint of bankruptcy risk, into classes safe and risky. This may involve such characteristics as "return on equity (ROE)", "return on investment (ROI)" and "return on sales (ROS)". The domains of these attributes are not simply ordered but involve a preference order since, from the viewpoint of bank managers, greater values of ROE, ROI or ROS are better for clients being analysed for bankruptcy risk . Thus, these attributes are criteria. Neglecting this information in knowledge discovery may lead to wrong conclusions.
Data representation
Decision table
In DRSA, data are often presented using a particular form of decision table. Formally, a DRSA decision table is a 4-tuple , where is a finite set of objects, is a finite set of criteria, where is the domain of the criterion and is an information function such that for every . The set is divided into condition criteria (set ) and the decision criterion (class) . Notice, that is an evaluation of object on criterion , while is the class assignment (decision value) of the object. An example of decision table is shown in Table 1 below.
Outranking relation
It is assumed that the domain of a criterion is completely preordered by an outranking relation ; means that is at least as good as (outranks) with respect to the criterion . Without loss of generality, we assume that the domain of is a subset of reals, , and that the outranking relation is a simple order between real numbers such that the following relation holds: . This relation is straightforward for gain-type ("the more, the better") criterion, e.g. company profit. For cost-type ("the less, the better") criterion, e.g. product price, this relation can be satisfied by negating the values from .
Decision classes and class unions
Let . The domain of decision criterion, consist of elements (without loss of generality we assume ) and induces a partition of into classes , where . Each object is assigned to one and only one class . The classes are preference-ordered according to an increasing order of class indices, i.e. for all such that , the objects from are strictly preferred to the objects from . For this reason, we can consider the upward and downward unions of classes, defined respectively, as:
Main concepts
Dominance
We say that dominates with respect to , denoted by , if is better than on every criterion from , . For each , the dominance relation is reflexive and transitive, i.e. it is a partial pre-order. Given and , let
represent P-dominating set and P-dominated set with respect to , respectively.
Rough approximations
The key idea of the rough set philosophy is approximation of one knowledge by another knowledge. In DRSA, the knowledge being approximated is a collection of upward and downward unions of decision classes and the "granules of knowledge" used for approximation are P-dominating and P-dominated sets.
The P-lower and the P-upper approximation of with respect to , denoted as and , respectively, are defined as:
Analogously, the P-lower and the P-upper approximation of with respect to , denoted as and , respectively, are defined as:
Lower approximations group the objects which certainly belong to class union (respectively ). This certainty comes from the fact, that object belongs to the lower approximation (respectively ), if no other object in contradicts this claim, i.e. every object which P-dominates , also belong to the class union (respectively ). Upper approximations group the objects which could belong to (respectively ), since object belongs to the upper approximation (respectively ), if there exist another object P-dominated by from class union (respectively ).
The P-lower and P-upper approximations defined as above satisfy the following properties for all and for any :
The P-boundaries (P-doubtful regions) of and are defined as:
Quality of approximation and reducts
The ratio
defines the quality of approximation of the partition into classes by means of the set of criteria . This ratio express the relation between all the P-correctly classified objects and all the objects in the table.
Every minimal subset such that is called a reduct of and is denoted by . A decision table may have more than one reduct. The intersection of all reducts is known as the core.
Decision rules
On the basis of the approximations obtained by means of the dominance relations, it is possible to induce a generalized description of the preferential information contained in the decision table, in terms of decision rules. The decision rules are expressions of the form if [condition] then [consequent], that represent a form of dependency between condition criteria and decision criteria. Procedures for generating decision rules from a decision table use an inducive learning principle. We can distinguish three types of rules: certain, possible and approximate. Certain rules are generated from lower approximations of unions of classes; possible rules are generated from upper approximations of unions of classes and approximate rules are generated from boundary regions.
Certain rules has the following form:
Possible rules has a similar syntax, however the consequent part of the rule has the form: could belong to or the form: could belong to .
Finally, approximate rules has the syntax:
The certain, possible and approximate rules represent certain, possible and ambiguous knowledge extracted from the decision table.
Each decision rule should be minimal. Since a decision rule is an implication, by a minimal decision rule we understand such an implication that there is no other implication with an antecedent of at least the same weakness (in other words, rule using a subset of elementary conditions or/and weaker elementary conditions) and a consequent of at least the same strength (in other words, rule assigning objects to the same union or sub-union of classes).
A set of decision rules is complete if it is able to cover all objects from the decision table in such a way that consistent objects are re-classified to their original classes and inconsistent objects are classified to clusters of classes referring to this inconsistency. We call minimal each set of decision rules that is complete and non-redundant, i.e. exclusion of any rule from this set makes it non-complete. One of three induction strategies can be adopted to obtain a set of decision rules:[4]
- generation of a minimal description, i.e. a minimal set of rules,
- generation of an exhaustive description, i.e. all rules for a given data matrix,
- generation of a characteristic description, i.e. a set of rules covering relatively many objects each, however, all together not necessarily all objects from the decision table
The most popular rule induction algorithm for dominance-based rough set approach is DOMLEM,[5] which generates minimal set of rules.
Example
Consider the following problem of high school students evaluations:
Each object (student) is described by three criteria , related to the levels in Mathematics, Physics and Literature, respectively. According to the decision attribute, the students are divided into three preference-ordered classes: , and . Thus, the following unions of classes were approximated:
Notice that evaluations of objects and are inconsistent, because has better evaluations on all three criteria than but worse global score.
Therefore, lower approximations of class unions consist of the following objects:
Thus, only classes and cannot be approximated precisely. Their upper approximations are as follows:
while their boundary regions are:
Of course, since and are approximated precisely, we have , and
The following minimal set of 10 rules can be induced from the decision table:
- if then
- if and and then
- if then
- if and then
- if and then
- if and then
- if and then
- if then
- if then
- if and then
The last rule is approximate, while the rest are certain.
Extensions
Multicriteria choice and ranking problems
The other two problems considered within multi-criteria decision analysis, multicriteria choice and ranking problems, can also be solved using dominance-based rough set approach. This is done by converting the decision table into pairwise comparison table (PCT).[1]
Variable-consistency DRSA
The definitions of rough approximations are based on a strict application of the dominance principle. However, when defining non-ambiguous objects, it is reasonable to accept a limited proportion of negative examples, particularly for large decision tables. Such extended version of DRSA is called Variable-Consistency DRSA model (VC-DRSA)[6]
Stochastic DRSA
In real-life data, particularly for large datasets, the notions of rough approximations were found to be excessively restrictive. Therefore an extension of DRSA, based on stochastic model (Stochastic DRSA), which allows inconsistencies to some degree, has been introduced.[7] Having stated the probabilistic model for ordinal classification problems with monotonicity constraints, the concepts of lower approximations are extended to the stochastic case. The method is based on estimating the conditional probabilities using the nonparametric maximum likelihood method which leads to the problem of isotonic regression.
Stochastic dominance-based rough sets can also be regarded as a sort of variable-consistency model.
Software
4eMka2 is a decision support system for multiple criteria classification problems based on dominance-based rough sets (DRSA). JAMM is a much more advanced successor of 4eMka2. Both systems are freely available for non-profit purposes on the Laboratory of Intelligent Decision Support Systems (IDSS) website.
See also
References
43 year old Petroleum Engineer Harry from Deep River, usually spends time with hobbies and interests like renting movies, property developers in singapore new condominium and vehicle racing. Constantly enjoys going to destinations like Camino Real de Tierra Adentro.
External links
- The International Rough Set Society
- Laboratory of Intelligent Decision Support Systems (IDSS) at Poznań University of Technology.
- Extensive list of DRSA references on the Roman Słowiński home page.
- ↑ 1.0 1.1 Greco, S., Matarazzo, B., Słowiński, R.: Rough sets theory for multi-criteria decision analysis. European Journal of Operational Research, 129, 1 (2001) 1–47
- ↑ Greco, S., Matarazzo, B., Słowiński, R.: Multicriteria classification by dominance-based rough set approach. In: W.Kloesgen and J.Zytkow (eds.), Handbook of Data Mining and Knowledge Discovery, Oxford University Press, New York, 2002
- ↑ Słowiński, R., Greco, S., Matarazzo, B.: Rough set based decision support. Chapter 16 [in]: E.K. Burke and G. Kendall (eds.), Search Methodologies: Introductory Tutorials in Optimization and Decision Support Techniques, Springer-Verlag , New York (2005) 475–527
- ↑ Stefanowski, J.: On rough set based approach to induction of decision rules. In Skowron, A., Polkowski, L. (eds.): Rough Set in Knowledge Discovering, Physica Verlag, Heidelberg (1998) 500--529
- ↑ Greco S., Matarazzo, B., Słowiński, R., Stefanowski, J.: An Algorithm for Induction of Decision Rules Consistent with the Dominance Principle. In W. Ziarko, Y. Yao (eds.): Rough Sets and Current Trends in Computing. Lecture Notes in Artificial Intelligence 2005 (2001) 304--313. Springer-Verlag
- ↑ Greco, S., B. Matarazzo, R. Slowinski and J. Stefanowski: Variable consistency model of dominance-based rough set approach. In W.Ziarko, Y.Yao (eds.): Rough Sets and Current Trends in Computing. Lecture Notes in Artificial Intelligence 2005 (2001) 170–181. Springer-Verlag
- ↑ Dembczyński, K., Greco, S., Kotłowski, W., Słowiński, R.: Statistical model for rough set approach to multicriteria classification. In Kok, J.N., Koronacki, J., de Mantaras, R.L., Matwin, S., Mladenic, D., Skowron, A. (eds.): Knowledge Discovery in Databases: PKDD 2007, Warsaw, Poland. Lecture Notes in Computer Science 4702 (2007) 164–175.