Article Text
Abstract
Background The International Olympic Committee (IOC) Medical and Scientific Commission has supported collating and sharing evidence globally by developing sports medicine consensus statements (‘Statements’'). Publishing the Statements requires substantial resources that must be balanced by use and impact on policy and practice. This study aimed to gain a better understanding of awareness and uptake of the Statements globally through a survey of the National Olympic Committees (NOC), National Paralympic Committees (NPC) and International Federations (IF).
Method A cross-sectional survey of medical commission representatives from NOCs/NPCs/IFs. A structured questionnaire was distributed through the IOC head office, informed by prior research. Questions comprised a mix of closed and open-text responses with results presented descriptively by organisation type and total.
Results 55 responses were included: 29 (52%) from NOC/NPC representatives (response rate 14%) and 26 (47%) from IF representatives (response rate 63%). All Statements had been used by at least one respondent, with the Statement addressing concussion ranked highest (used by 33/55). The main barriers to use were financial limitations (n=21), club/sport culture and behaviours (n=19) and lack of understanding from coaches/team sport personnel (n=19). Participants believed the Statements were a successful strategy for improving athlete health (n=39/51 agree or strongly agree).
Conclusion There was clear support for the continued development of sports medicine guidance, including in the format of these Statements. To ensure Statements lead to demonstrable health benefits for athletes, input from athletes, coaches and supporting staff is needed, as well as clearer identification of the purpose and audience of each topic developed.
- Sports & exercise medicine
- Sporting organisation
- Olympics
- Knowledge translation
- Consensus statement
Data availability statement
All data relevant to the study are included in the article or uploaded as supplementary information.
This is an open access article distributed in accordance with the Creative Commons Attribution 4.0 Unported (CC BY 4.0) license, which permits others to copy, redistribute, remix, transform and build upon this work for any purpose, provided the original work is properly cited, a link to the licence is given, and indication of whether changes were made. See: https://creativecommons.org/licenses/by/4.0/.
Statistics from Altmetric.com
WHAT IS ALREADY KNOWN ON THIS TOPIC
There are 29 International Olympic Committee (IOC) Medical and Scientific Commission statements addressing a wide range of athlete health issues. Development of the Statements requires substantial resourcing that is ideally balanced by their use and value to athlete health globally. The impact of the IOC statements has not been evaluated.
WHAT THIS STUDY ADDS
A small number of Statements have gained strong traction, whereas others have not had nearly as much influence. Participants perceived the Statements to be relevant, trustworthy, up-to-date and informative and that they provided a common understanding of evidence for decisions and medical care. Most respondents believed that the Statements are currently written for doctors and health professionals but that they should be written for everyone.
HOW THIS STUDY MIGHT AFFECT RESEARCH, PRACTICE OR POLICY
There is a clear need and desire for guidance around the evidence of sports medicine. When developing Statements, the audience and purpose should be defined and a wide stakeholder group consulted, including athletes, coaches and support staff. Planning for dissemination of new Statements should also be a focus from the outset of their development. The statements are currently only published in English, and this study evaluated their use in English. Expansion of language options is recommended for the Statements and in turn, the inclusion of a more diverse user group can be included in future evaluations.
Background
For professional athletes to achieve their peak performance, a coordinated team of coaches, managers and health professionals among others, operate behind the scenes.1 2 Injury or illness can be devastating; even a seemingly insignificant health problem can be the difference between success and failure.3 As such, the sports medicine community has focused on preventing injury and illness and understanding safe approaches to build performance.4 5
The International Olympic Committee (IOC) has a global focus and vision to ‘build a better world through sport’.6 Through its medical and scientific commission, the IOC’s goal is to ‘provide a guiding reference for all other sports organisations on matters relating to the protection of the health of athletes’.7 One of the ways knowledge from the IOC is shared globally is through the development and dissemination of sports medicine consensus statements (‘the Statements’). There are 29 Statements published on the IOC website (October 2023) covering a wide range of issues, from the use of platelet-rich plasma to concussion prevention and management to youth athletic development.8
In previous research, we reported on the academic impact8 and the policy/practice impact from National Olympic/Paralympic committee members of two countries.9 The results of those studies highlighted there was awareness of the Statements but a potential gap in their application globally. Citation impact was driven by academically well-resourced geographical regions (eg, USA, Canada, Australia, UK and Western Europe) with poor representation across much of Asia, Africa, the Middle East and Oceania.8 In particular, topics perceived to have the potential for ambiguous or contentious outcomes for clinical decisions were cited most (ie, concussion)10 11 as well as those that had supporting decision tools (eg, RED-s (Relative Energy Deficiency in Sport)).12 Co-publishing the Statements as peer-reviewed journal publications has also enhanced citations.8
The utility of the Statements on policy and best practice decisions was subsequently explored through a case study focused on two countries, finding the two settings had distinct priorities and required substantially different types of support for athletes.9 Australia is a high-resourced setting with a strong sports medicine industry in research, medicine and allied health.13 14 South Africa was chosen as a contrast to Australia in terms of health equity and resources, though notably, it also has a strong scientific influence and presence in sports medicine.8 15 Interviewees from Australia described an abundance of high-quality and setting/context-specific information and resources from other (non-IOC) organisations at their fingertips. At the same time, South African participants placed greater value on the IOC as a conduit for information generation and distribution. For example, South African interviewees had explained access issues, with few having university library resources, let alone those in neighbouring countries.9 This current study sought to establish which of those earlier case study findings were consistent across a wider range of settings and sports bodies.
To better understand awareness and uptake of the Statements globally, an international survey of representatives from the Medical Commissions of National Olympic Committees (NOCs), National Paralympic Committees (NPCs) and International Federations (IFs) of Sport was undertaken. This paper presents findings in relation to the awareness, access, application, acceptability and adoption of the Statements by these global stakeholder groups. A secondary aim was to compare findings by organisation type to determine if there were any important differences in their knowledge needs.
Methods
Study design
This cross-sectional study is the third component of a larger project designed to formally assess the impact of the 27 Statements published before 2019. The survey design and administration approach was based on a previous survey with the same target respondents.5 Participants provided their consent on the initiation of the survey questions.
Patient and public involvement
The study addresses the issue of representation and utility of the IOC consensus statements globally with sports medicine staff as target respondents. The questionnaire was developed following a previous qualitative study in a high and low resource setting. The survey was discussed at a meeting of the IOC research centres of excellence, focusing on question wording and format. Further, five authors (WD, CE, MS, EV, CF) have been involved in the development of one or more Statements. We determined there was sufficient input to the design of the study and preferred to maximise potential participants from the NOCs/NPCs and IFs.
Target survey respondents (participants)
Medical commission representatives of NOCs/NPCs and IFs were the survey’s target because they were the IOC’s initial intended audience for the Statements. At the time of the survey, there were 206 NOCs currently recognised by the IOC,16 182 NPCs recognised by the International Paralympic Committee17 and 41 IFs recognised by the IOC.18 The IOC Medical and Scientific Department maintains an up-to-date mailing list of the positions and contact details within these committees. For this reason, the IOC facilitated the distribution of information about the survey, including the details to participate, as per our previous research.5 The request to participate was sent to an estimated 300 email addresses. Due to restrictions on privacy, the authors were unable to confirm any follow-up information, for example, the number of people who received and opened the email.
Questionnaire design
A structured questionnaire was designed to be completed relatively quickly, taking approximately 15 min to complete. The questionnaire draft was developed by authors LVF, MB and CFF, informed from the citation analysis8 to identify the Statements of interest and interviews undertaken through the case study.9 The interviews provided a rich contextual understanding of some of the key issues to highlight, and the collation of interviewee discussion points was used to form the response options in the survey.
The questionnaire was designed with four sections. The first section comprised three questions. Question 1 focused on the type of organisation (NOC/NPC or IF). For NOCs, follow-up questions asked the specific country (open text) or, if unwilling to disclose, a request for the estimated size of the Olympic team (Summer, Winter, Youth) and World Bank income group (low, lower-middle, upper-middle, high). For NOCs/NPCs, there was also a question on whether there was a formal sport and exercise medicine accreditation programme. For IFs, only the respondent’s name of the federation being represented was requested (open text).
The second section (five questions) addressed broad knowledge about athlete health concerns and prior experience with the Statements. Specifically, respondents were asked to select issues they thought were relevant from a list of 37 topics derived from the interviews. Open text allowed for additional written answers. Awareness of the Statements was asked through a yes/no response. For those who were aware (responded yes), a list of the 27 Statements was presented, and respondents were asked to select all they had used. Use was defined as sharing, discussing, adapting or promoting them and informing clinical practice decisions.
The third section of the questionnaire (two questions) explored perceived barriers to the (wider) application of the Statements, from problems with access to resources to implementing their recommended actions. The final part of the questionnaire asked about beliefs in relation to the intended audience of the Statements, opportunities for improvement of their value and leadership and responsibility for athlete health (eight questions).
Questions were written in English language only. Most questions required respondents to select from various predetermined response options (see below). There was also the opportunity to provide additional free-text answers where the provided response options did not suit the respondent. Variations to the question order and wording were presented depending on the type of organisation represented (NOC/NPC or IF) and if respondents did or did not have familiarity with the Statements.
A paper version of the questionnaire was available by request from participants to the authors for those who wished to consult on responses with their colleagues. Six requests were received for a paper copy of questions; all responses were completed online. A copy of the paper version of the questionnaire is available in the online supplemental file 1.
Supplemental material
Survey administration
Edith Cowan University’s Survey Research Centre (SRC) in-house programming team prepared the survey for online delivery and secure data capture through November and December 2019. Pilot testing was completed for functionality with the SRC and flow and content among the author team members who were not involved in the initial development of the survey.
An invitation email and link were provided to the IOC office for distribution by email to the NOCs/NPCs and IFs. The email was addressed to the Chief Medical Officers and included the survey link, plain language information and a pdf copy of the questionnaire. A reminder email was sent after 2 weeks and again just before closing the survey at 6 weeks. The authors promoted the project and requested participation through direct contact with some organisations and discussions in professional networks.
Data analysis
To be included in data analysis, participants must have completed the consent question and first set of questions (refer to online supplemental file 1). The questionnaire responses are presented descriptively, as frequency or proportions, and reported for total valid responses of participants, or total responses where more than one answer was allowed and split by organisation type (NOC/NPC, IF). The number of valid and missing responses is reported for each question. No statistical comparisons were conducted due to the small number of respondents. Thematic content analysis was used to code open-text responses deductively to one of the existing response options, or a new response category was established (inductively) where relevant and noted in results as such.19 Open-text quotes were presented (with anonymity to respond) where they enhanced the results and meaning of the quantitative findings.
Results
Participants
A total of 101 participants opened the questionnaire (34% of approximately 300 emails sent). 25 people did not answer any question, and 9 participants did not formally consent to participate on page 1 (n=9, 9%), so they were excluded from further analysis. Four responses were removed as they did not represent IFs or NOCs/NPCs. Eight entries from five responding NOCs/NPCs were removed as they were repeat responses from the same organisation: two provided duplicate responses and three provided triplicate (all could be confirmed as the same respondent). For two of these five respondents one entry was incomplete (the complete response was kept), and three had provided detailed more detail in open-text entries (the response with more open text was kept).
In total, 55 responses were included for analysis: 29 (52%) from NOC/NPC representatives and 26 (47%) from IF representatives.
Among NOCs/NPCs, the response rate was 14% (using the 206 NOCs as potential participants). Most NOCs/NPCs were from Europe (n=15), with eight from Eastern Europe and seven from Northern/Western Europe regions (combined). Six responses represented countries from the Americas, four from Africa, two from Asia, one from Oceania and one lower middle-income country that did not wish to disclose their location. Among IFs, the response rate was 63%. The IF representatives came from various sports that covered summer and winter sports; water and land; indoor and outdoor; judged and score-based; team and individual; and traditional and newer Olympic inclusions.
Awareness and use
Three respondents were unaware of the Statements before taking part in the survey. Having been made aware through participation in the survey, two organisations indicated they would now consider using the Statements, and one was unsure, commenting: ‘I don’t think the medical provision is developed enough at this stage, and the NOC is small. I’ve also only been involved for a short period’.
At least one respondent had used all consensus Statements (table 1). The most used Statements were Concussion in sport (n=33), followed by Sports nutrition (n=27) and Nutritional supplements (n=26). The Statements that were least used were Fasting in sports (n=4), Molecular basis of connective tissue and muscle injuries in sport (n=5) and Age determination in high-level young athletes (n=6). No IF reported use of the two anterior cruciate ligament (ACL)-focused Statements (Non-contact ACL in the female athlete; Prevention, diagnosis and management of paediatric ACL injuries). Harassment and abuse in sport were reportedly used by more of the IFs (n=14) than NOCs/NPCs (n=8).
The Statements were used in various ways, including presentations, education and continuing professional development (table 1). Some organisations have used them in policy or formal guidelines or to plan medical coverage. When sharing, Statements were sometimes kept in their original format and at other times summarised into their own words/key points. 11 descriptors about the Statements derived from the interviews9 (eg, useful, relevant, up to date) were presented to participants to indicate their agreement or disagreement. There was agreement across all response options except for ‘easy to access’, from which 17 responses were neutral (n=11) or disagreed (n=6).
Participants were asked about barriers to or greater use of the Statements in practice. The top three combined responses were financial limitations (n=21), club/sport culture and behaviours (n=19) and lack of understanding for coaches/team sport personnel (n=19). Responses from NOCs/NPCs were more often aligned to organisational barriers (eg, barriers in financial resources (NOC/NPC=14 vs IF=7); organisational barriers (NOC/NPC=6 vs IF=1)) while responses from IFs were more towards relevance of topics (eg, topics are not aligned to our priorities (IF=5 vs NOCs/NPCs=1). They are not relevant for our sports or athletes (IF=4 vs NOC/NPC=0)). From a list of potential facilitators for increasing Statement use, popular responses were presentations at the advanced team physician course and variations in format to include plain-language, magazine-style articles and infographics.
There was also support for seeing the Statements published in different languages. Four written responses focused on making the Statements easier to access.
Intended audience
Both NOCs/NPCs and IFs provided similar responses relating to who they believed the Statements are currently written for and who the Statements should be written for. Most respondents believed that the Statements are currently written for doctors (n=38/51) and/or other medical professionals (n=33/51) (figure 1). When asked who the Statements should be written for, there was greater variation in responses, with 20 respondents selecting ‘everyone’.
Improving athlete health
Participants largely believed the Statements serve the purpose of improving athlete health (n=39/51 agree or strongly agree) (table 2). Almost half (24/51) of the participants thought the IOC Statements were, or could be, useful to improve the health of athletes, the same number were unsure (n=24), and three disagreed (n=3). Overall, both NOC/NPC and IF respondents considered the Statements to provide useful supporting evidence and a common understanding on which to base discussion, decisions, guidelines and medical care. Two examples of responses were:
It’s easier to introduce and improve our medical guidelines with the support of IOC medical consensus statements.
The consensus guidelines are a critical source of current best practices, especially for concussion: because so little is known and because it is changing SO rapidly.
Discussion
This survey confirms previous findings that some Statements have gained strong traction, whereas others have not had nearly as much influence. Most notably, the concussion in sport statement was found to have a strong citation impact, had good awareness among South African and Australian NOC/NPC representatives and was the most used Statement identified by NOCs/NPCs and IFs globally. It was not clear from this survey why some Statements were preferred over others. However, our previous case study suggested a leaning toward topics with the potential for controversial direction debate or uncertainty in clinical decisions.9 Two of the Statements reportedly least used addressed ACL injury,20 21 an injury with substantial clinical guidance available and, arguably, relatively clear prevention, treatment and rehabilitation pathways.22 23
Participants were generally positive toward a range of Statement descriptors, perceiving them to be relevant, trustworthy, up-to-date and informative, among other features. The weakest result was seen for ease of access, with 17 responses being neutral or negative. Improving access was also notable in the written responses to potential facilitators of use. Challenges with accessing the Statements confirm our findings from the case study.9 While we cannot disclose which specific organisations selected these responses, there was no discernible pattern in the location or sport with European, African and South American countries represented, as well as sports from both Summer and Winter events and individual and team pursuits. Thus, a broad strategy to support dissemination and accessibility to all IFs and NOCs/NPCs is needed.
Dissemination is the ‘purposive distribution of a guideline to a specific audience to enhance awareness, attitudes, and knowledge of a guideline’.24 One successful dissemination strategy that has seen increased readership for the documents was to co-publish them as open-access peer-reviewed journal publications.8 However, this strategy targets those more academically inclined and confident to read a scientific-style journal. Beyond the peer-reviewed publications, it could be argued that the purposive element has been largely missing in disseminating the Statements (with more of a passive ‘diffusion’ process wherein the information is simply provided with no active planning.) A good dissemination plan will consider a range of strategies that address the audience, the message, the format and who will deliver this. Potentially, a lack of clarity on these features underlies some of the difficulty in dissemination and, in turn, access and use of the Statements.
Survey respondents indicated the Statements are written for doctors and allied health practitioners; however, they believe they should be written for everyone, including team staff, management and athletes. Establishing clarity with the audience aligns closely with a clear purpose or aim statement. Identified through our earlier work, interviewees asked, ‘What is the intention of the statements? Who are they for?’9 Different audiences—and different document purposes—will demand different strategies for dissemination. It is necessary to be clear on these directions before considering the best ways to support expanding reach and use.25 The intended audience, whether athletes or coaches, for example, should also be involved in their design and development.
In 2023, the WHO reported on a workshop focused on principles to improve the usability and impact of WHO guidelines.26 The seven design principles featured (eg, principle 2—design for access and accessibility) are potentially a good starting place for the Statements targeting the same intended global audience to ‘provide recommendations on public health policy or for health interventions’ and ‘to ensure the usability and impact of these products in countries’.26 In order to meet the needs of ‘everyone’ as indicated by respondents, an initial solution for the IOC Statements, could be the co-production of plain language summaries targeted at athletes or a community audience, designed with their input.
The development of the Statements has changed since 2019 and there has been a shift to include authors from wider geographical representation and transparency in their development, for example, seeking nominations to contribute to development27 using an online survey for input from a global audience28 and transparent reporting of methods.29 Follow-up will be important to evaluate how these changes influence the future use and acceptability of the Statements, and ultimately, if they result in their intended improvement to athlete health.
This descriptive, cross-sectional study has several limitations to consider. A survey design was chosen as it enabled a cost-effective method to include sporting and medical commissions from across the world. Two preceding studies informed the questions but were not formally tested for reliability. A pdf version of the questionnaire was provided so respondents could consider their responses and discuss them with teams before submitting them. Five NOCs/NPCs provided repeat responses (same respondent); two were incomplete (the complete response was kept), and three had open text in detail (this response with more open text was kept). While small differences for these five repeat respondents were observed in the selected item responses, these were not large enough to make important changes to results or conclusions.
The included organisations were from a variety of geographical regions and sports but overall, there was a smaller than anticipated number of survey respondents. We do not have information on why emails were not opened or responded to by potential participants. While lower than desired, 55 medical officers from high-performance sport in a study of this nature is valuable and comparable to previous research.5 There was low inclusion from non-English speaking geographical areas and there remains a need to identify the sports medicine resources that are currently used and most impactful in these regions. We hope this evaluation will inform a broader analysis of resources (beyond the IOC statements) that are useful to a range of organisations, extending from the NOC/NPCs and IFs. While unique insights will differ, the take-home messages of needing clarity of audience and purpose to support purposive dissemination are unlikely to be impacted by the inclusion of additional responses.
The survey was provided only in English, on the basis that international sports medicine practitioners will likely be familiar though the language barrier is still important to consider. Some open-text responses were provided in French (which the authors could understand sufficiently to translate) suggesting the questions may not have been straightforward for all representatives and understanding some concepts is difficult. It is possible that respondents’ prior interactions with the IOC influenced their choice to respond (or not) and how they interpreted the questions. We do not know how many Paralympic committees were involved in responses, though we believe them to be under-represented. We also do not have confirmation that the responses were provided or informed by the medical officers, despite them being our target respondent. Ideally, being able to link directly with potential participants could help with representation from all groups, however, this was not possible with our preference to maintain anonymity of respondents. This research considered only the IOC-supported Statements, and readers may not separate the use of consensus guidelines from the organisation that funds or supports their development. Potentially, responses about Statements may be mixed up with Statements from other organisations.
Conclusion
There appears to be a clear need and desire for sports medicine guidance documents like the Statements considered in this work. To ensure they lead to demonstrable health benefits for athletes, however, any ongoing development of such Statements and strategies for their implementation should engage a wide audience. The audience could include one or more of a range of interested groups stakeholders such as athletes, coaches, support staff, parents, administrators or referees.
We have previously documented the limited authorship representation in the published Statements.8 For the increased global reach of this important health guidance, it is strongly recommended that the IOC consider more opportunities for contributions to the Statements from relevant experts outside Western Europe, the USA, Australia, Canada and Scandinavia.
For those wishing to develop sports medicine guidelines in the future, the following recommendations are made with respect to their preparation:
Identify their purpose/s up-front and clearly state the purpose of each statement.
Consider the target audience for each tailored output, and state this clearly. Some high-resource countries may not require information on certain topics in contrast to low-resource settings, which may strongly desire these topics.
Plan, define and prepare associated documents in multiple formats to support reach to different audiences. Exploration of the requirements of the low/high resource settings in knowledge availability more generally should inform decisions about dissemination. Tailored and targeted information for coaches and athletes is particularly important and should include infographics, videos and other non-written formats.
Consider creating a uniform identity across guidelines and their linked resources. Present consistent terminology and branding on them to enable recognition and ensure confidence in the quality of the information being presented.
Importantly, planning for dissemination of guidelines needs to be a focus from the outset. Incorporating this planning through the stages above will ensure that the developed guidelines will have maximal benefit for their intended users.
Data availability statement
All data relevant to the study are included in the article or uploaded as supplementary information.
Ethics statements
Patient consent for publication
Ethics approval
Ethical approval was obtained from the Edith Cowan University Human Research Ethics Committee (No. 21497 FINCH). Participants gave informed consent to participate in the study before taking part.
Acknowledgments
The authors are grateful for support from the IOC Medical and Scientific Department, especially Fiona Trabelsi and Dr Torbjorn Soligard. The authors acknowledge the contribution of the ECU Survey Research Centre, particularly Mr Cassidy Hill for the development of the survey platform. Thank you to Dr Rebecca Handcock, Dr Sarah Harris, Dr Ashlee Morgan, Dr Ruth Sibson and Dr Caroline Bolling who all helped shape this study through their contributions to the larger project in which this work sits.
References
Supplementary materials
Supplementary Data
This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.
Footnotes
X @lfortington, @caemery@CarolynAEmery, @evertverhagen, @CarolineFinch
Contributors CFF and LVF designed the study with contributions from EV, KP, CE, MS and WD. LVF, CFF and MB drafted the manuscript with critical input from all coauthors. LVF is the study guarantor and accepts full responsibility for the work and the conduct of the study, had access to the data, and controlled the decision to publish. Several authors have been contributors to the published IOC-Statements reviewed in this paper. CE, CFF, EV, MS and WD all coauthored the injury and illness surveillance statement. CE coauthored the following statements: concussion and the developing youth athlete. WD coauthored the following statements: pain management in the elite athlete. WD and MS coauthored the prevention and management of chronic disease. WD and MS both coauthored the following statements: molecular basis of connective tissue and muscle injuries in sport. MS coauthored the following statements: periodic health evaluation of elite athletes, use of platelet-rich plasma in sports medicine and health consequences of a saturated sports calendar (part 1 and part 2).
Funding The research was supported by a research grant from the International Olympic Committee Medical and Scientific Commission awarded to CFF, LVF, WD, CE, KP, MS and EV.
Competing interests All authors are members of a centre affiliated with the IOC Medical Research Network, recognised for their research into the protection of athlete health research. Early results were presented and discussed in two meetings linked to the network, with attendance from representatives of 11 research centres and the IOC Medical and Scientific Commission. Neither the IOC nor its Medical Commission contributed to details and decisions about the study design, its conduct or the interpretation and discussion of results.
Patient and public involvement Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.
Provenance and peer review Not commissioned; externally peer reviewed.
Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.