Variable-Precision Dominance-Based Rough SetApproachMasahiro Inuiguchi and Yukihiro YoshiokaDepartment of Systems InnovationGraduate School of Engineering Science,Osaka University1-3,Machikaneyama,Toyonaka,Osaka560-8531,Japan inuiguti@sys.es.osaka-u.ac.jp,yoshioka@inulab.sys.es.osaka-u.ac.jp Abstract.In order to treat the ordinality and the monotonicity betweencondition and decision attributes in decision tables,the dominance-basedrough set approach(DRSA)has been developed.Moreover,to treat thehesitation in evaluation,the variable-consistency dominance-based roughset approach(VC-DRSA)has been proposed.However,the VC-DRSA isnot always suitable to treat errors and outliers.In this paper,we proposea new approach called a variable-precision dominance-based approach(VP-DRSA)to be suitable for accommodating errors and outliers.1IntroductionRough sets proposed by Pawlak[1]provide useful tools for reasoning from data. It is applied to variousfields such as medicine,engineering,management,econ-omy and so on.It is also useful in decision problems[2,3,4].When the monotonic-ity between condition attributes and decision attributes is assumed and some inconsistency is included in the given data,results by the classical rough set approach are often inconsistent with the monotonicity.This is because the nom-inality of all condition and decision attributes are assumed in the classical rough set approach.In order to overcome this inexpedience,the dominance-based rough set ap-proach(DRSA)has been proposed by Greco et al.[3,4].DRSA can treat ordinal condition and decision attributes as well as nominal ones so that the results are inconsistent with the monotonicity.Nevertheless,when a given data includes strong inconsistency,lower approximations become very small and then,we may not obtain useful results.Some sources of the inconsistency are conceivable:(1)hesitation in evalua-tion of decision attribute values,(2)errors in recording,measurement and ob-servation,(3)missing condition attributes related to the evaluation of decision attribute values,and so on.To treat the hesitation,the variable-consistency dominance-based rough set approach(VC-DRSA)[5,4]has been proposed.How-ever,to treat errors and missing condition attributes,as far as the authors know, no approach has proposed,so far.In this paper,we propose an approach to treat errors and missing condi-tion attributes in the frame work of DRSA.For this purpose,we introduce the S.Greco et al.(Eds.):RSCTC2006,LNAI4259,pp.203–212,2006.c Springer-Verlag Berlin Heidelberg2006204M.Inuiguchi and Y.YoshiokaTable 1.A decision table of student evaluationStudentMathematics Literature Passing Status S1Excellent Very Good Yes S2Excellent Medium Yes S3Very Good Very Good No S4Very good Good Yes S5Very Good Bad Yes S6Very Good Utterly Bad No S7Good Excellent Yes S8Medium Excellent Yes S9Medium Bad Yes S10Bad Medium No S11Bad Very Bad No S12Very Bad Very Bad No S13Very Bad Utterly Bad No S14Utterly Bad Medium No S15Utterly Bad Bad No S16Utterly Bad Very Bad No S17Utterly Bad Utterly Bad Noidea of variable precision rough set approach proposed by Ziarko [6].Therefore,the proposed approach is called the variable-precision dominance-based rough set approach (VP-DRSA).Corresponding to lower and upper approximations,positive and non-negative regions are defined.Then we define variable-precision dominance-based rough sets as pairs of positive and non-negative regions and ex-amine their properties.Moreover,we show differences among DRSA,VC-DRSA and VP-DRSA using a simple numerical example.This paper is organized as follows.In Section 2,we review DRSA and ing a simple example,we show the inexpediences of DRSA and VC-DRSA.We emphasize that DRSA and VC-DRSA do not always work well when given decision tables include outliers.In order to treat outliers properly,we propose VP-DRSA in Section 3.The properties of positive and non-negative regions in VP-DRSA are investigated.The proposed VP-DRSA is applied to the simple example to show how it analyzes the example appropriately.Finally concluding remarks are given in Section 4.2Dominance-Based Rough Set Approach 2.1Decision Table with Dominance RelationsConsider a decision table T = U,C ∪{d },V,ρ shown in Table 1.A decision table T is characterized by an object set U ,a condition attribute set C and a decision attribute d ,an attribute value set V = a ∈C ∪{d }V a (V a is a set of all values of attribute a )and an information function ρ:U ×C ∪{d }→V .In Table 1,we have U ={S1,S2,...,S17},C ={Mathematics (Math ),Literature (Lit )},Variable-Precision Dominance-Based Rough Set Approach205 d=Passing Status(P S)and V={Utterly Bad(UB),Very Bad(VB),Bad(B), Medium(M),Good(G),Very Good(VG),Excellent(E),Yes(Y),No(N)}.The information functionρis characterized by the table so that we know,for example,ρ(S2,Math)=E andρ(S11,P S)=N.In cases such as Table1,we assume that the better condition attribute values are,the better the decision value ly,in Table1,we assume a student having better evaluations in Math and Lit,he/she can have a better value in PS.However,an inconsistency with this monotonicity is found in Table1.For example,an inconsistency is found in evaluation between S3and S9.S3takes much better evaluations in Math and Lit but a worse result in P S than S9.In cases when inconsistencies are included in given decision tables,the results of the classical rough set approach are often inconsistent with the monotonicity,too.To overcome this inexpedience,the dominance-based rough set approach(DRSA) has been proposed by Greco et al.[3,4].In DRSA,we can treat nominal and ordinal condition attributes at the same time but in this paper,for the sake of simplicity,we consider a case that all condition attributes are ordinal.By this simplification,we do not loose the essence of the proposed approach.2.2DRSALet Cl k,k=1,2,...,n be decision ly,to each decision attributevalue v dk ,we define Cl k={x∈U:ρ(x,d)=v dk}.We assume a total order fordecision attribute values such that v d1≺v d2≺···≺v d n,where v dk≺v d j meansthat v dj is better than v dk.According to this total order we write Cl1≺Cl2≺···≺Cl n.We also assume a dominance relation on condition attribute values.A dominance relation with respect to condition attribute p is denoted by p and “v1 p v2”means that v1dominates(is better than)v2.In Table1,we have N≺Y for decision attribute and E p VG p G p M pB p VB p UB (p=Math,Lit)for condition attributes.In order to reflect the weak order and dominance relations,the following upward and downward unions of decision classes are considered:Cl≥t=s≥t Cl s,Cl≤t=s≤tCl s.(1)Then,we haveCl≥1=Cl≤n=U,Cl≤1=Cl1,Cl≥n=Cl n,(2)Cl≥t=U−Cl≤t−1,Cl≤t=U−Cl≥t+1,(3) where we define Cl≤0=Cl≥n+1=∅so that the second equalities are valid for t=1,2,...,n.On the other hand,using dominance relations on condition attribute values,a dominance relation between objects with respect to a set of condition attributes P⊆C is defined byxD P y⇔ρ(x,p) pρ(y,p)for all p∈P,(4)206M.Inuiguchi and Y.Yoshiokawhere v1 p v2if and only if v1 p v2or v1=v2.Then,given P⊆C and x∈U, we defineD+P (x)={y∈U:yD p x},D−P(x)={y∈U:xD p y}.(5)Given P⊆C,P-lower and P-upper approximations of Cl≥t and Cl≤t are defined as follows:P(Cl≥t)={x∈U:D+P (x)⊆Cl≥t},P(Cl≥t)={D+p(x):x∈Cl≥t},(6)P(Cl≤t)={x∈U:D−P (x)⊆Cl≤t},P(Cl≤t)={D−p(x):x∈Cl≤t}.(7)Using those upper and lower approximations,decision tables with dominance relations can be analyzed in the same way as the classical rough set approach. The properties of P-upper and P-lower approximations are shown in Greco et al.[3,4].Some of them are shown as follows:P(Cl≥t)⊆Cl≥t⊆P(Cl≥t),P(Cl≤t)⊆Cl≤t⊆P(Cl≤t).(8) Moreover,when D p is reflexive and transitive,we haveP(Cl≥t)={D+P(x):D+P(x)⊆Cl≥t},(9)P(Cl≤t)={D−P(x):D−P(x)⊆Cl≤t}.(10)By definition,upper approximations P(Cl≥t)and P(Cl≤t)can be represented byunions of D+P (x)and D−P(x),respectively.When D p is reflexive and transitive,lower approximations P(Cl≥t)and P(Cl≤t)can be also represented by unions ofD+P (x)and D−P(x),respectively,as shown in(9)and(10).2.3VC-DRSAThe inconsistency with the monotonicity can be understood as the decision maker’s hesitation in evaluation.In order to treat the hesitation,Greco et al.[4,5] proposed the variable-consistency dominance-based rough set approach.The degree of consistency of a fact that an object x∈U belongs to Cl≥t with respect to P⊆C is defined byα=|D+P(x)∩Cl≥t||D+P(x)|,(11)where|X|stands for the cardinality of a set X.Then,given a consistency level l∈[0,1],a P-lower approximation of Cl≥t with respect to P⊆C is defined as a set of objects x∈Cl≥t whose consistency degrees are not less than l,i.e.,P l(Cl≥t)=x∈Cl≥t:|D+P(x)∩Cl≥t||D+P(x)|≥l.(12)Variable-Precision Dominance-Based Rough Set Approach 207Similarly,a P -lower approximation of Cl ≤t with respect to P ⊆C is defined byP l (Cl ≤t )= x ∈Cl ≤t :|D −P (x )∩Cl ≤t ||D −P (x )|≥l .(13)By using the duality,P -upper approximations of Cl ≥t and Cl ≤t with respectto P ⊆C can be defined byP l (Cl ≥t )=U −P l (U −Cl ≥t )=U −P l (Cl ≤t −1)=Cl ≥t ∪ x ∈Cl ≤t :|D −P (x )∩Cl ≥t ||D −P (x )|>1−l ,(14)P l (Cl ≤t )=U −P l (U −Cl ≤t )=U −P l (Cl ≥t +1)=Cl ≤t ∪ x ∈Cl ≥t :|D +P (x )∩Cl ≤t ||D +P (x )|>1−l .(15)P -lower and P -upper approximations in VC-DRSA satisfyP l (Cl ≥t )⊆Cl ≥t ⊆P l (Cl ≥t ),P l (Cl ≤t )⊆Cl ≤t ⊆P l (Cl ≤t ).(16)This equation corresponds to (8).However,P -lower and upper approximations in VC-DRSA do not have properties corresponding to (9)and (10).Namely,P -lower and P -upper approximations are not always represented by unions of D +P(x )and D −P (x ).2.4Inexpediences of DRSA and VC-DRSAThe following example demonstrates the inexpediences of DRSA and VC-DRSA.We show only P -lower approximations since P -upper approximations can be obtained as the complements of P -lower approximations (see Greco et al.[3,4]).Example 1.Consider a decision table given in Table 1.As described already,this decision table include inconsistencies.The data of S3can be regarded as an outlier.This inconsistency may be caused by some error in recording or observation.Let us see what inexpediences can happen in such cases.From Table 1,we have Cl ≥Y ={S1,S2,S4,S5,S7,S8,S9}and Cl ≤N ={S3,S6,S10,S11,...,S17}.Let P =C then we obtainP (Cl ≥Y )={S1,S2,S7,S8},P (Cl ≤N )={S6,S10,S11,...,S17}.Based on these results,we can induce the following decision rules:–if ρ(x,Math ) M E then ρ(x,P S ) P S Y,–if ρ(x,Lit ) L E then ρ(x,P S ) P S Y,–if ρ(x,Math ) M B then ρ(x,P S ) P S N,–if ρ(x,Lit ) L VB then ρ(x,P S ) P S N.208M.Inuiguchi and Y.YoshiokaFig.1.Decision rules in DRSA Fig.2.Decision rules in VC-DRSA where M, L, M and L denote Math, Lit, Math and Lit,respectively. The obtained rules can be illustrated on the Math-Lit coordinate as in Figure1. By the existence of an outlier,the P-lower approximation of Cl≥Ybecomes small.Thus decision rules induced from P(Cl≥Y )covers only small areas.A relativelybig area on the Math-Lit coordinate has no estimated values of P S.Now let us apply VC-DRSA with l=0.75.We haveP l(Cl≥Y )={S1,S2,S5,S7,S8,S9},P l(Cl≤N)={S3,S6,S10,S11,...,S17}.Based on these results,we can induce the following decision rules with consis-tency degrees(see Greco et al.[5]for reference):–ifρ(x,Math) M E thenρ(x,P S) P S Y[α=1],–ifρ(x,Math) M VG andρ(x,Lit) L B thenρ(x,P S) P S Y[α=0.8],–ifρ(x,Lit) L E thenρ(x,P S) P S Y[α=1],–ifρ(x,Math) M M andρ(x,Lit) L B thenρ(x,P S) P S Y[α=0.875],–ifρ(x,Math) M VG andρ(x,Lit) L VG thenρ(x,P S) P S N[α=0.769],–ifρ(x,Math) M B thenρ(x,P S) P S N[α=1],–ifρ(x,Lit) L VB thenρ(x,P S) P S N[α=1].These rules are illustrated in Figure2.By VC-DRSA,we obtained more decision rules which covers large area on the Math-Lit coordinate.The conflictions occur in the shaded box with bold edges in Figure2.This area implies the hesitant area for the decision maker in VC-DRSA.It is large because of the outlier.Moreover, note that S4∈Cl≥Ywhich takes better values in both Math and Lit than S5andS9is not included in P l(Cl≥Y )but S5and S9are.A similar strange result can bealso found in the obtained decision ly,the second rule obtained from S5has stronger condition than the forth rule obtained from S9but the second takes smaller consistency level than the forth.Such strange results can happen in VC-DRSA applications to decision tables including outliers.Variable-Precision Dominance-Based Rough Set Approach 209Finally,we note that,under the policy inducing only rules with stronger con-sistency,this strange result will never appear.This kind of modification in de-finitions of P -lower and upper approximations can be found in S l owi´n ski and Greco [7].At any rate,VC-DRSA is applicable to cases when the inconsistency comes from the hesitation in evaluation.3VP-DRSA 3.1Definitions and PropertiesIn order to treat the inconsistency caused by errors in recording,measurement,observation,and so on,we propose a variable-precision dominance-based rough set approach (VP-DRSA).As a counterpart of consistency degree in VC-DRSA,we define the precision of x ∈Cl ≥t byβ=|D −P (x )∩Cl ≥t ||D −P (x )∩Cl ≥t |+|D +P (x )∩Cl ≤t −1|.(17)Let us interpret the precision β.For any y ∈D −P (x ),from the dominancerelation D P ,we may infer that ρ(x,d ) d ρ(y,d ),i.e.,x is included in a decision class not worse than the decision class to which y belongs.Thus for any y ∈D −P (x )∩Cl ≥t ,we may infer x ∈Cl ≥t .Hence |D −P (x )∩Cl ≥t |is the number of objects which endorses x ∈Cl ≥t .On the contrary,by the same consideration,for any z ∈D +P (x )∩Cl ≤t −1,we may infer x ∈Cl ≤t −1=U −Cl ≥t .Hence |D +P (x )∩Cl ≤t −1|is the number of objects which endorses x ∈Cl ≥t .Other objects endorse neither x ∈Cl ≥t nor x ∈Cl ≥t .Therefore,βis the ratio of objects endorsing x ∈Cl ≥t to all objects endorsing x ∈Cl ≥t or x ∈Cl ≥t .Then,given a precision level l ∈[0,1],corresponding to the P -lower approxi-mation of Cl ≥t ,a P -positive region of Cl ≥t with respect to P ⊆C is defined as a set of objects x ∈U whose degrees of precision are not less than l ,i.e.,P OS l P (Cl ≥t )= x ∈U :|D −P (x )∩Cl ≥t ||D −P (x )∩Cl ≥t |+|D +P (x )∩Cl ≤t −1|≥l .(18)Similarly,a P -positive region of Cl ≤t with respect to P ⊆C is defined byP OS l P (Cl ≤t )= x ∈U :|D +P (x )∩Cl ≤t ||D +P (x )∩Cl ≤t |+|D −P (x )∩Cl ≥t +1|≥l .(19)By using the duality,corresponding to P -upper approximations,P -non-negative regions of Cl ≥tand Cl ≤t with respect to P ⊆C can be defined by NNG l P (Cl ≥t )=U −P OS l P (U −Cl ≥t )=U −P OS l P (Cl ≤t −1)= x ∈U :|D −P (x )∩Cl ≥t ||D −P (x )∩Cl ≥t |+|D +P (x )∩Cl ≤t −1|>1−l ,(20)210M.Inuiguchi and Y.YoshiokaNNG l P (Cl ≤t )=U −P OS l P (U −Cl ≤t )=U −P OS l P (Cl ≥t +1)= x ∈U |D +P (x )∩Cl ≤t ||D +P (x )∩Cl ≤t |+|D −P(x )∩Cl ≥t +1|>1−l .(21)We can prove that P -positive and P -non-negative regions satisfyP OS l P (Cl ≥t )⊆NNG l P (Cl ≥t ),P OS l P (Cl ≤t )⊆NNG l P (Cl ≤t ).(22)However,P OS l P (Cl ≥t )⊆Cl ≥t ,Cl ≥t ⊆NNG l P (Cl ≥t ),P OS l P (Cl ≤t )⊆Cl ≤t and Cl ≤t ⊆NNG l P (Cl ≤t )are not always valid.This property is same as the classicalvariable precision rough sets [6].When D p is reflexive and transitive,we haveP OS l P (Cl ≥t )= D +P (x ) |D −P (x )∩Cl ≥t ||D −P (x )∩Cl ≥t |+|D +P (x )∩Cl ≤t −1|≥l ,(23)P OS l P (Cl ≤t )= D −P (x ) |D +P (x )∩Cl ≤t ||D +P (x )∩Cl ≤t |+|D −P (x )∩Cl ≥t +1|≥l ,(24)NNG l P (Cl ≥t )= D +P (x ) |D −P (x )∩Cl ≥t ||D −P (x )∩Cl ≥t |+|D +P (x )∩Cl ≤t −1|>1−l ,(25)NNG l P (Cl ≤t )= D −P (x ) |D +P (x )∩Cl ≤t ||D +P (x )∩Cl ≤t |+|D −P(x )∩Cl ≥t +1|>1−l .(26)These properties correspond to (9)and (10)in DRSA.These properties are important to obtain decision rules with fewer conflictions.Moreover when D p is reflexive and transitive,we haveP OS l P (P OS l P (Cl ≥t ))=NNG l P (P OS l P (Cl ≥t ))=P OS l P (Cl ≥t ),(27)P OS l P (P OS l P (Cl ≤t ))=NNG l P (P OS l P (Cl ≤t ))=P OS l P (Cl ≤t ),(28)NNG l P (NNG l P (Cl ≥t ))=P OS l P (NNG l P (Cl ≥t ))=NNG l P (Cl ≥t ),(29)NNG l P (NNG l P (Cl ≤t ))=P OS l P (NNG l P (Cl ≤t ))=NNG l P (Cl ≤t ).(30)These properties are not always satisfied with P -lower and P -upper approxima-tions in VC-DRSA but with P -lower and P -upper approximations in DRSA.3.2Application to Example 1Let us apply VP-DRSA to Table 1which is treated in Example 1.As discussed in Example 1,applications of DRSA and VC-DRSA to decision tables including outliers were not very successful.We will see how Table 1is analyzed appropri-ately by the proposed VP-DRSA.Let l =0.75.Then we haveP OS l P (Cl ≥Y )={S1,S2,S3,S4,S7,S8},P OS l P (Cl ≤N )={S6,S10,S11,...,S17}.Variable-Precision Dominance-Based Rough Set Approach211Fig.3.Decision rules in VP-DRSABased on these results,we can induce the following decision rules with degrees of precision:–ifρ(x,Math) M E thenρ(x,P S) P S Y[β=1],–ifρ(x,Math) M VG andρ(x,Lit) L G thenρ(x,P S) P S Y[β=0.75],–ifρ(x,Lit) L E thenρ(x,P S) P S Y[β=1],–ρ(x,Math) M B thenρ(x,P S) P S N[β=1],–ρ(x,Lit) L VB thenρ(x,P S) P S N[β=1].These rules are illustrated in Figure3.In VP-DRSA,the decision attribute value of the outlier S3which can be regarded as error data is changed to P S=Y by endorsements based on S4,S5and S9.P-lower approximations in VP-DRSA become larger than that in DRSA.By the change of decision attribute value of S3,an additional decision rule with0.75precision is obtained from decision rules in DRSA.By reduction of l to0.6,S5is included in the P-positive region of Cl≤Y in VP-DRSA and another additional decision rule with0.67precision,“ifρ(x,Math) M VG andρ(x,Lit) L G thenρ(x,P S) P S Y[β=0.67]”is obtained.Evenif S5is added to the P-positive region of Cl≤Y ,no strange result is obtained.Namely,the precision of S4is larger than that of S5.On the other hand,byaugmentation of l to0.8,the P-positive region of Cl≤Y in VP-DRSA degeneratesto that in DRSA.4Concluding RemarksIn this paper,we have proposed a variable-precision dominance-based approach (VP-DRSA)in order to treat inconsistent data caused by errors in recording, measurement,observation and so on.The properties of P-positive and P-non-negative regions are investigated.Inexpediences of DRSA and VC-DRSA are212M.Inuiguchi and Y.Yoshiokademonstrated using an example.We showed that these inexpediences may be solved by the proposed VP-DRSA.As the classical variable precision rough set approach[6]is applied to cases when a condition attribute somewhat related to the decision attribute is miss-ing,the proposed VP-DRSA may be applied to the same cases with dominance relations.As DOM-LEM[8],a dominance-based rule induction algorithm is pro-posed based on DRSA,an extended DOM-LEM algorithm can be designed based on VP-DRSA.Moreover,as the consistency degree used in VC-DRSA is useful for inducing a decision tree(see Giove et al.[9]),the precision used in VP-DRSA may be useful,too.AcknowledgementThe authors wish to thank anonymous reviewers for their constructive comments. Thefirst author acknowledges that this work has been partially supported by the Grant-in-Aid for Scientific Research(B)No.17310098.References1.Pawlak,Z.:Rough sets,p.Sci.11(5)(1982)341–356.2.Pawlak,Z.,S l owi´n ski,R.:Rough set approach to multi-attribute decision analysis,Eur.J.Oper.Res.72(3)(1994)443–459.3.Greco,S.,Matarazzo,B.,S l owi´n ski,R.:The use of rough sets and fuzzy sets inMCDM,in:T.Gal,T.J.Stewart and T.Hanne(eds.),Multicriteria Decision Mak-ing:Advances in MCDM Models,Algorithms,Theory,and Applications,Kluwer Academic Publishers,Boston(1999)14.1–14.59.4.Greco,S.,Matarazzo,B.,S l owi´n ski,R.:Decision Rule Approach,in:J.Figueira,S.Greco and M.Ehrgott(eds.),Multiple Criteria Decision Analysis,Springer-Verlag, New York(2005)507–561.5.Greco,S.,Matarazzo,B.,S l owi´n ski,R.,Stefanowski,J.:Variable consistency modelof dominance-based rough set approach,in W.Ziarko,Y.Yao(eds.)Rough Sets and Current Trends in Computing,LNAI2005,Springer-Verlag,Berlin,(2001)170–181.6.Ziarko,W.:Variable precision rough sets model,Journal of Computer and SystemsSciences46(1)(1993)39–59.7.S l owi´n ski,R.,Greco,S.:Inducing robust decision rules from rough approxima-tions of a preference relation,in L.Rutkowski,J.Siekmann,R.Tadeusiewicz, L.A.Zadeh(eds.)Artificial Intelligence and Soft Computing,LNAI3070,Springer-Verlag,Berlin,(2004)118–132.8.Greco,S.,Matarazzo,B.,S l owi´n ski,R.,Stefanowski,J.:An algorithm for inductionof decision rules consistent with the dominance principle,in W.Ziarko,Y.Yao(eds.) Rough Sets and Current Trends in Computing,LNAI2005,Springer-Verlag,Berlin, (2001)304–313.9.Giove,S.,Greco,S.,Matarazzo,B.,S l owi´n ski,R.:Variable consistency monotonicdecision trees,in J.J.Alpigini,J.F.Peters,A.Skowron,N.Zhong(eds.)Rough Sets and Current Trends in Computing,LNAI2475,Springer-Verlag,Berlin,(2002) 247–254.。