Hand Hygiene Auditing: Ontario PIDAC and PHO Expectations vs US CDC and HICPAC

Aurelia DermaSeptyl 2-in-1 moisturising hand sanitizer with NPN 80122015, clinic pack

Hand hygiene auditing looks like the simplest compliance task in a health care facility and is one of the least standardised. Ontario's provincial guidance tells you to monitor, to use a validated observer tool and trained observers, and to feed the result back. United States guidance tells you that direct observation is the reference method and that no accepted standard exists for how many observations are enough. Neither jurisdiction hands over a finished audit form. The work is deciding what to observe, how many times, what to write down, and who has to see it.

This article sets out what Ontario guidance, United States guidance and the World Health Organization's framework each actually require of a hand hygiene audit, and then gives a field list an audit record can be built from.

Quick facts

  • Ontario's provincial hand hygiene guidance recommends routine monitoring of compliance with timely feedback, using a reliable, validated observer tool and a trained observer process (recommendation 47, graded AII), and says monitoring should assess compliance with each of the four moments (recommendation 48, BIII).
  • In Ontario, staff hand hygiene rates have been reportable annually as a mandatory patient safety indicator since 2009.
  • United States guidance describes direct observation as the reference method for hand hygiene monitoring, and states that there is no accepted standard for the number of observations.
  • Adherence is calculated the same way on both sides of the border: actions divided by opportunities, multiplied by 100.
  • The World Health Organization's five moments are an international framework. They are not an Ontario requirement and are not, by themselves, a Canadian standard.

What does Ontario guidance actually require you to monitor?

The obligation to run a hand hygiene program is not voluntary in Ontario. In long-term care, the Fixing Long-Term Care Act, 2021, s.23(2)(e) lists a hand hygiene program as one of the six elements every infection prevention and control program must contain, and O. Reg. 246/22 s.102(7)11 places hand hygiene, including access to product at the point of care, among the duties of the home's infection control professional. Provincial long-term care guidance then requires the home to implement a comprehensive hand hygiene program that follows Public Health Ontario's PIDAC-IPC hand hygiene guidance.

The monitoring expectations sit in three recommendations of that guidance, and the wording is precise enough to audit against:

Recommendation What it states Grade
47 Routinely monitor hand hygiene compliance with the provision of timely feedback, by using a reliable, validated observer audit tool and a training process AII
48 Monitoring should assess compliance with each of the four moments, to direct education and provide reliability BIII
49 Review results of hand hygiene compliance as part of the ongoing safety agenda of facility committees, such as Joint Health and Safety, Infection Prevention and Control, Medical Advisory Committee and Senior Management BIII

Two details in that guidance are easy to miss and hard to defend if they are absent. The guidance defines a hand hygiene opportunity as an observed indication for hand hygiene, and states that each opportunity must correspond to an action; several indications may combine into one opportunity. That definition is what makes the arithmetic defensible. The guidance also states that a plan of action should be evident where compliance persistently fails, and that aggregate unit compliance results should form part of the performance appraisal of the unit manager. An audit programme that stops at the percentage has not met recommendation 49.

Ontario also publishes. Staff hand hygiene rates have been reportable annually as a mandatory patient safety indicator since 2009, which means the number a facility reports should be reconstructible from observation records rather than from a separate estimate.

Aurelia DermaSeptyl 2-in-1 moisturising hand sanitizer with NPN 80122015, clinic pack

Observation or consumption: which method does each jurisdiction expect?

Direct observation and product-volume measurement answer different questions, and the trade-offs are described explicitly in United States training material issued to accompany the CDC and HICPAC hand hygiene guideline. The table below reproduces that comparison.

Method What it shows Limitations
Direct observation of technique Whether the product was applied correctly, and how long the person spent at the sink or with hand rub Watching correct technique does not show whether the person adheres during a busy shift
Direct observation of adherence Which staff, on which shift, on which unit performed hand hygiene at the opportunity Time and resource intensive; the presence of an observer can change behaviour
Indirect measurement of hand rub or soap volume used A consistent consumption trend that can be compared between units Consumption may not correlate with appropriate use, and is biased by bulk purchasing and storage
Self-report by staff Perceptions of barriers to hand hygiene Unreliable; reported rates are often inflated
Patient satisfaction survey A proxy where direct observation is impractical, such as ambulatory settings No established correlation with actual adherence

Observation can itself be done in three ways, and the choice changes the reliability of the number. Covert observation, sometimes called the secret shopper method, may produce more reliable results, but sustaining a covert programme over time is difficult. Overt observation allows coaching in the moment and introduces a measurement effect: observation plus intervention measures something different from observation alone. Technology-assisted observation, including video review by trained auditors and automated systems using wearable devices, removes selection and observer bias but is expensive and not equally available.

Whichever method a facility uses, the training material for the United States guideline is explicit that a single method is weaker than a combination. Self-reported compliance rates run higher than observed rates, which is why self-report alone is not treated as a substitute for a multi-modal audit.

How many observations are enough?

This is where the two jurisdictions diverge most visibly, and where a facility is most likely to invent a number that no guidance supports.

Ontario's guidance sets no numeric minimum. It requires that monitoring assess each of the four moments, which is a coverage requirement rather than a volume requirement: a facility that observes two hundred room exits and never once observes an opportunity before a clean procedure has not met recommendation 48, however large the sample looks.

United States training material states plainly that there is no accepted standard for the number of observations, and then gives the working figures that facilities actually use: many hospitals use 30 or more observations per month per unit, and the Institute for Healthcare Improvement suggests measuring at least 10 observations of multidisciplinary personnel per month. Those are practice figures, not regulatory thresholds, and they are presented as such.

Element Ontario provincial guidance United States guidance and training material
Minimum sample No numeric minimum stated; must cover each of the four moments No accepted standard; many hospitals use 30 or more per month per unit; a common working figure is at least 10 multidisciplinary observations per month
Stratification Assessment across the four moments Reported by staff role type and by shift
Observer requirement Reliable, validated observer tool plus a training process Trained observers, with inter-rater reliability checked
Denominator definition Each observed indication corresponds to one opportunity; several indications may combine into one opportunity Actions divided by opportunities, multiplied by 100

A useful way to hold both requirements at once is to report two things every cycle: the compliance percentage, and the number of opportunities counted in each moment. The first satisfies a numeric target; the second satisfies the coverage requirement.

Which fields should a hand hygiene audit record contain?

This is the part that most audit programmes leave thin. The fields below are drawn from what the Ontario guidance asks monitoring to demonstrate, from what United States audit guidance lists as the components of a data collection tool, and from what a third party would need in order to re-derive the reported rate.

Field Question it answers Basis
Observation date and time When was the sample taken? Audit tool design
Unit, care area or room Where was it taken? Sampling by unit or floor
Observer identity and training record Was the observer validated? Ontario recommendation 47
Moment observed (1 to 4) Which indication was counted? Ontario recommendation 48
Staff role category Whose practice was measured? Role-specific reporting
Shift Which part of the day was covered? Shift-based reporting
Action performed (yes or no) Numerator Actions divided by opportunities
Product used (hand rub or soap and water) Which product type was in use? Technique observation
Technique adequacy, where technique is the subject Was the application correct? Technique observation
Opportunities counted in the period Denominator Adherence arithmetic
Contributing factor where hand hygiene was missed Why the opportunity was missed Contributing-factor documentation
Feedback given, to whom and when Was timely feedback provided? Ontario recommendation 47
Reporting reference Which committee received the result? Ontario recommendation 49
Action plan reference where the threshold was missed What happened next? Persistent-failure action plan

The value of the last two fields is disproportionate. Without them the file proves that measurement happened. With them it proves that the measurement changed something, which is the difference between a monitoring record and a compliance record.

CliniEco Medical 3-ply ASTM level 3 face masks, 250 masks per case

Who receives the results, and what has to happen next?

The reporting path differs by jurisdiction and by care setting.

In Ontario, the provincial hand hygiene guidance asks that results be reviewed as part of the ongoing safety agenda of named facility committees, including the Joint Health and Safety Committee, the infection prevention and control committee, the Medical Advisory Committee and senior management. In long-term care the route is narrower and scheduled: the interdisciplinary infection prevention and control team must meet at least quarterly, and the same regulation requires the programme itself to be evaluated and updated at least annually, with a written record showing the date of the review, the participants, a summary of the changes and the date those changes were implemented. Corrective action for persistent non-compliance is expected to be documented, and aggregate unit results are expected to appear in the unit manager's performance appraisal.

In the United States, the hand hygiene guideline itself carries the monitoring recommendation at the strongest evidence grade: monitor health care workers' adherence with recommended practices and provide personnel with information regarding their performance. The same guideline treats improved adherence as an institutional priority requiring administrative support and financial resources, and calls for a multidisciplinary programme rather than a single intervention. United States audit guidance adds the framing that audits are an opportunity for improvement rather than a punishment, which shapes how corrective action is expected to be documented.

Where a facility also reports to a regulator, the recording duty is worth knowing exactly. 42 CFR 483.80(a)(4) requires the infection prevention and control programme to include a system for recording incidents identified under the programme and the corrective actions taken, with no retention period stated in the regulation itself.

Ontario and the United States side by side

Question Ontario United States
Where does the duty come from? Fixing Long-Term Care Act, 2021 s.23(2)(e) and O. Reg. 246/22 s.102(7)11, with provincial PIDAC-IPC guidance supplying the method CDC and HICPAC hand hygiene guideline recommendations, with 42 CFR 483.80 for the programme structure in nursing facilities
Strongest stated method Validated observer audit tool with a training process Direct observation of adherence, described as the reference method
Sample size No numeric minimum; coverage of the four moments required No accepted standard; working figures from published practice
Public reporting Annual reporting as a mandatory patient safety indicator since 2009 Facility-level reporting to programme oversight rather than a single national hand hygiene publication
Corrective action Documented plan of action for persistent failure; unit results in the manager's appraisal Audits framed as improvement rather than punishment; recording of incidents and corrective actions

The World Health Organization's five moments remain the common international vocabulary, and are worth citing as a reference frame: before touching a patient, before a clean or aseptic procedure, after body fluid exposure risk, after touching a patient, and after touching patient surroundings. They describe when hand hygiene is indicated. They do not, on their own, create an Ontario monitoring requirement, and treating them as a Canadian standard is a common documentation error.

Aurelia Protégé nitrile examination gloves, 4.0 mil, powder free, chemo grade

Where hand hygiene audits fail in practice

Five failure patterns account for most of the gap between an audit programme and a defensible audit record.

  • The percentage is reported without the opportunity count behind it, so nobody can re-derive the rate.
  • Moment coverage collapses to room entry and room exit, because those are the easiest opportunities to observe, and the clean-procedure moment is never sampled at all.
  • Observers are not retested after initial training, so inter-rater reliability is assumed rather than checked.
  • Feedback is given informally and never recorded, so recommendation 47's feedback element cannot be evidenced.
  • Results reach the person who collected them and not the committee named in the guidance.

Each of these is fixed by adding a field rather than by adding staff time, which is why the field list above is the practical place to start.

Related reading

Hand hygiene consumables for a monitored programme — sealed-pouch soap systems, hand sanitizer clinic packs, nitrile examination gloves and face masks — are grouped on the clinic consumables page, and the adjacent sterilizer monitoring side of the same programme uses 24-hour self-contained biological indicators or a five-pack biological indicator trial for a single sterilizer. Case quantities order through a wholesale and institutional supply account, and ready-made guidance is collected in the learning hub.

Frequently Asked Questions

Does Ontario specify how many hand hygiene observations a facility must collect?

No. Ontario's provincial hand hygiene guidance sets no numeric minimum. It requires monitoring to assess compliance with each of the four moments, which is a coverage requirement rather than a volume requirement. United States guidance states there is no accepted standard for the number of observations, and cites a working figure of at least 10 multidisciplinary observations per month from the Institute for Healthcare Improvement, with many hospitals using 30 or more per month per unit.

Is counting hand sanitizer or soap consumption a valid way to audit hand hygiene?

It is a valid supplement and not a substitute. Product volume can show a consumption trend and can be compared between similar units with little effort, but consumption may not correlate with appropriate use and is distorted by bulk purchasing and storage. Direct observation of adherence remains the reference method in United States guidance, and Ontario guidance asks for a validated observer audit tool with trained observers.

What is a hand hygiene opportunity, and does each indication count separately?

Provincial guidance defines a hand hygiene opportunity as an observed indication for hand hygiene, and states that each opportunity must correspond to an action. Several indications may come together to create one opportunity. That definition matters because it fixes the denominator: an audit that counts indications rather than opportunities will not produce a rate that can be compared with another unit or another month.

Who has to receive the hand hygiene audit results?

In Ontario, the provincial guidance asks that results be reviewed as part of the ongoing safety agenda of named committees, including the Joint Health and Safety Committee, the infection prevention and control committee, the Medical Advisory Committee and senior management, and states that aggregate unit compliance results should form part of the unit manager's performance appraisal. In long-term care, the interdisciplinary infection prevention and control team must meet at least quarterly.

Are the WHO five moments a Canadian requirement?

No. The five moments are an international framework published by the World Health Organization describing when hand hygiene is indicated. They are useful as a common vocabulary and are referenced in United States training material, but an Ontario facility's monitoring requirement comes from Ontario legislation and Public Health Ontario's PIDAC-IPC guidance, not from the World Health Organization document.

What should an observer be trained on before collecting audit data?

An observer should be trained on the policy and the steps for how hand hygiene is to be performed, and on how to observe and document findings accurately, so that inter-rater reliability can be checked. United States audit guidance lists the preparation steps as choosing the audit tool, training the observer, choosing the sample size, and defining the frequency of audits. Ontario guidance requires a reliable, validated observer tool together with a training process.

CliniEco Medical supplies clinics, long-term care homes and laboratories in Canada. Establishment licence MDEL #35334.

0 comments

Leave a comment

Please note, comments need to be approved before they are published.