Catalogue of Artificial Intelligence Techniques
Aliases: Statistical Inference
Keywords: cycle cutset, hugin, tree clustering
Categories: Inference and Reasoning
Author(s): Robert Corlett , Judea Pearl
Bayesian inference is one means by which knowledge based systems can reason when uncertainty is involved. Given a set of mutually exclusive hypotheses and an evidence event , we obtain from an expert estimates of the prior probabilities , and the conditional probabilities . Bayes' Rule then gives the probability of given evidence :
where is a normalising constant ensuring that sum to unity. In practical problems may be any subset of the set of all possible evidence events and the hypothesis of interest may be any subset of the set of all possible hypotheses. This tends to require a vast number of conditional probabilities to be calculated. A solution is provided by techniques based on Bayesian Networks. To specify such a network one need only estimate the conditional probabilities of each elementary event given its immediate causes. When the network formed by these cause-effect relationships is loop free, the probability for any subset of evidence events and any subset of hypotheses can be calculated by distributed message-passing techniques. When cycles are unavoidable, tree clustering and cycle cutset techniques (see Constraint Networks) can be used to compute . An example of the use of Bayesian inference is the HUGIN system.
- Andersen, S.K., Olesen, K.G., Jensen, F.V. and Jensen, F., Hugin--a shell for building Bayesian belief universes for expert systems. Proceedings of IJCAI-89, 1080--1085.
- Pearl, J., Probabilistic Reasoning in Intelligent Systems:
networks of plausible inference
, Morgan Kaufmann, San Mateo, California, 1988.