max planck institut
informatik
informatik
In order to support the suitability of the PCA* Confidence metric for prediction of new facts, we carried an experiment which uses the rules without constants mined on YAGO2 (training KB) to predict facts in the newer YAGO2s (target KB). We took all rules mined by AMIE with head coverage threshold 0.01 and ranked them by standard and PCA confidence. Then we took every rule and generated facts beyond the KB using our experimental setup. The following table shows top 30 rules ranked by standard confidence and their actual precisions beyond the database. For further details, please refer to the detailed evaluation information as well as to the full list of rules mined by AMIE on YAGO2.
| Rule | Precision in the unknown region | Std. Confidence | PCA Confidence | New Predictions | Total predictions |
|---|---|---|---|---|---|
| ?e <isMarriedTo> ?a ?e <hasChild> ?b => ?a <hasChild> ?b | 34.48% | 57.57% | 57.57% | 1865 | 1865 |
| ?a <isMarriedTo> ?f ?f <hasChild> ?b => ?a <hasChild> ?b | 33.33% | 56.11% | 56.11% | 1068 | 1986 |
| ?b <isMarriedTo> ?a => ?a <isMarriedTo> ?b | 100.00% | 53.01% | 91.79% | 5158 | 5158 |
| ?a <created> ?b ?a <produced> ?b => ?a <directed> ?b | 3.33% | 49.83% | 58.68% | 976 | 976 |
| ?a <actedIn> ?b ?a <created> ?b => ?a <directed> ?b | 3.45% | 38.29% | 45.23% | 518 | 608 |
| ?a <isMarriedTo> ?c ?c <livesIn> ?b => ?a <livesIn> ?b | 75.00% | 33.71% | 69.88% | 326 | 326 |
| ?a <dealsWith> ?f ?f <dealsWith> ?b => ?a <dealsWith> ?b | 20.00% | 28.19% | 28.19% | 75 | 75 |
| ?c <dealsWith> ?b ?a <dealsWith> ?c => ?a <dealsWith> ?b | 26.67% | 28.19% | 28.19% | 0 | 75 |
| ?e <isMarriedTo> ?a ?e <livesIn> ?b => ?a <livesIn> ?b | 100.00% | 22.81% | 68.42% | 299 | 542 |
| ?a <actedIn> ?b ?a <created> ?b => ?a <produced> ?b | 18.52% | 20.64% | 38.98% | 790 | 790 |
| ?a <directed> ?b => ?a <created> ?b | 24.14% | 18.75% | 32.46% | 26980 | 26980 |
| ?a <livesIn> ?f ?f <hasCapital> ?b => ?a <livesIn> ?b | 16.67% | 18.53% | 18.53% | 2851 | 2852 |
| ?a <livesIn> ?f ?f <isLocatedIn> ?b => ?a <livesIn> ?b | 89.66% | 17.80% | 17.80% | 4225 | 4227 |
| ?a <hasChild> ?c ?b <hasChild> ?c => ?a <isMarriedTo> ?b | 76.67% | 17.32% | 40.98% | 1170 | 1720 |
| ?a <created> ?b ?a <directed> ?b => ?a <produced> ?b | 0.00% | 16.11% | 37.47% | 4973 | 5258 |
| ?c <dealsWith> ?a ?c <dealsWith> ?b => ?a <dealsWith> ?b | 42.86% | 15.44% | 21.78% | 471 | 473 |
| ?c <hasOfficialLanguage> ?b ?c <isLocatedIn> ?a => ?a <hasOfficialLanguage> ?b | 33.33% | 14.29% | 64.29% | 100 | 100 |
| ?b <dealsWith> ?a => ?a <dealsWith> ?b | 100.00% | 13.64% | 18.32% | 152 | 219 |
| ?b <hasCapital> ?f ?a <livesIn> ?f => ?a <livesIn> ?b | 48.28% | 13.49% | 13.49% | 2856 | 3209 |
| ?c <hasAcademicAdvisor> ?a ?c <graduatedFrom> ?b => ?a <worksAt> ?b | 6.67% | 13.44% | 39.04% | 552 | 552 |
| ?a <imports> ?b => ?a <exports> ?b | 3.33% | 13.10% | 14.47% | 94 | 94 |
| ?a <produced> ?b => ?a <directed> ?b | 0.00% | 11.26% | 13.40% | 16262 | 17188 |
| ?a <dealsWith> ?c ?c <imports> ?b => ?a <imports> ?b | 46.43% | 10.58% | 14.88% | 438 | 438 |
| ?c <isCitizenOf> ?b ?a <influences> ?c => ?a <isCitizenOf> ?b | 3.33% | 10.56% | 51.96% | 1199 | 1199 |
| ?a <produced> ?b => ?a <created> ?b | 10.34% | 10.06% | 15.69% | 16272 | 17463 |
| ?c <dealsWith> ?a ?c <imports> ?b => ?a <imports> ?b | 26.67% | 9.28% | 14.10% | 271 | 355 |
| ?a <worksAt> ?b => ?a <graduatedFrom> ?b | 3.57% | 8.99% | 16.25% | 2217 | 2217 |
| ?a <diedIn> ?b => ?a <wasBornIn> ?b | 0.00% | 8.85% | 22.53% | 20196 | 20196 |
| ?a <exports> ?b => ?a <imports> ?b | 3.45% | 8.68% | 10.33% | 380 | 393 |
| ?c <hasAcademicAdvisor> ?a ?c <worksAt> ?b => ?a <worksAt> ?b | 23.33% | 8.66% | 21.86% | 430 | 486 |
| ?c <dealsWith> ?a ?c <hasOfficialLanguage> ?b => ?a <hasOfficialLanguage> ?b | 9.68% | 7.78% | 9.65% | 275 | 275 |
*PCA = Partial Completeness Assumption