Needs assessment: towards a more responsive Canadian Society of Nephrology Annual General Meeting (CSN AGM) program

Barry A. Cohen, Mark J. Courtney, Louise M. Moist, James Barton

A critical feature of any continuing medical education (CME) program is the inclusion of a needs assessment for its target audience. This assessment must identify both perceived and unperceived needs, so as to best capture the entire spectrum of learning opportunities for the group. We describe the process developed by the Canadian Society of Nephrology (CSN) to enhance the educational effectiveness of its Annual General Meeting program. The design of this study is the analysis of a survey questionnaire and of the Canadian Organ Replacement Registry (CORR) database. We surveyed members of the CSN and analyzed patient data from CORR aggregated by center. We tabulated votes in the survey by topic. We assessed the extent to which centers achieved CSN guideline targets on the clinical management of patients on dialysis. Perceived needs: a CSN panel constructed a list of topics, which was amplified by the inclusion of topics based on members' text responses to open-ended questions during previous iterations of this process. CSN members specified their top five choices, using an online survey instrument. Unperceived needs: an expert panel determined achievable thresholds for a number of quality metrics associated with dialysis. The quality metrics were identified from CSN guidelines. Using patient data in the CORR database, we generated center-specific performance estimates for each quality metric and constructed ratios comparing the performance of each center with the achievable threshold. We triangulated the results of the two assessments. The response rate for the perceived needs assessment survey was 16 %. This assessment identified "Primary and Secondary Glomerulonephritis" as the non-dialysis topics and "Infectious Complications of Dialysis Access" and "Volume Status and Hypertension on Dialysis" as the dialysis topics with the highest perceived learning needs. In the unperceived needs assessment, "Vascular Access Type" and "Vascular Access Monitoring" were identified as having the highest learning needs. Triangulation identified "Vascular Access Type" and "Vascular Access Monitoring" as high needs topics. Perceived needs assessment: Some topics were much more general than others, which could have led to over-selection. The response rate of 16 % limits the robustness of generalization to the membership as a whole or to all meeting attendees. Unperceived needs assessment: The assessment was limited by the data that CORR actually collects; many aspects of general nephrology practice, including glomerulonephritis, are not covered. The level of evidence underlying the various guidelines was variable, and in some cases, poor. A validated approach to data analysis in this area is lacking. To our knowledge, this is the first published example of a needs assessment for a nephrology CME event that considers both the perceived and unperceived needs of the membership. The results of this exercise are currently being used to assist in the development of a more responsive CME program.