Lecture for PPSD session for Year 1 Semester 1 Med PPSD on 27th August 2008 by Professor Omar Hasan Kasule, Sr.
1.0 DEFINITIONS
Probability is a quantitative measure of the likelihood of occurrence for chance events. The concept of pure chance is not absolutely true because all events are pre-determined. Humans use chance or probability estimates because of their limited knowledge. What appears random or chance to humans has an underlying deterministic order known only to the Creator. The consistency of probabilities and predictions is based on underlying physical laws that govern the universe.
Probability is commonly defined as relative frequency of an event on repeated trials under the same conditions. Each possible outcome is called a sample point. The set of all possible outcomes is called the probability space, S. If the probability space consists of a finite number of equally likely events, probability of event ‘A’ is defined as: Pr (A) = n (A) / n (S) where n(A) = number of events of type A and n(S) = the total number in the probability space. Special mathematical techniques called arrangements, permutations and combinations, can enable us calculate the probability space theoretically without having to carry out the trials.
2.0 CLASSIFICATION OF PROBABILITY
Probability can be subjective (based personal feelings or intuition) or objective (based on real data or experience). Objective probability can be measured or computed. Prior probability is knowable or calculable without experimentation. Posterior probability is calculable from results of experimentation. Bayesian probability combines prior probability (objective, subjective, or a belief) with new data (from experimentation) to reach a conclusion called posterior probability. Bayesian probability is a good representation of how conclusions are made from empirical observation in real life. Conditional probability is employed when there is partial information or when we want to make probability computations easier by assuming conditionality. In conditional probability, the event depends on occurrence of a previous event.
3.0 TYPES OF EVENTS
On the scale of exclusion, events are classified as mutually exclusive or non-mutually exclusive. Mutually exclusive events are those that cannot occur together like being dead and being alive. Not all mutually exclusive events are equally likely. On the scale of independence, events are classified as independent or dependent. Under independence, the occurrence of one event is not affected by occurrence or non-occurrence of another. Independent events can occur at the same instant or subsequently. Some independent events are equally likely while others are not. On the scale of exhaustion, two events A and B are said to be exhaustive if between them they occupy all the probability space ie A U B = S and Pr (A U B) = 1.
4.0 LAWS OF PROBABILITY and MATHEMATICAL PROPERTIES
The total probability space is equal to 1.0. If the probability of occurrence is p, the probability of non-occurrence is 1-p. For two events p and q, p + q =1 where p is probability of occurrence of an event and q is probability of its non-occurrence. The additive law, also called the ‘OR’ rule, refers to occurrence of any or both events and is stated as Pr (A u B) = Pr (A) + Pr (B) - Pr (A n B) where Pr (A n B) = 0 for mutually exclusive events. The multiplicative law for independent events refers to the joint occurrence of the events or the ‘AND’ rule and is stated as Pr (A n B) = Pr (A) x Pr (B). The range of probability is 0.0 to 1.0 and cannot be negative. Pr = 0.0 means the event is impossible. Pr = 1.0 means the event is absolutely certain.
5.0 USES OF PROBABILITY
Probability is used in classical statistical inference, Bayesian statistical inference, clinical decision-making, queuing theories, and probability trees.