Low interrater agreement when attempting to retrospectively analyze adverse events is a well-documented problem in the safety literature. This study found relatively poor agreement between registered nurses regarding the severity and preventability of adverse events.