Outside the Box

M. Buchheit. Outside the Box. IJSPP 2017, 12, 1001 -1002.


When I submitted my first paper in the early 2000’s, web-based editorial manager systems were in their infancy. I posted via regular mail three hard copies of my manuscript -with a neatly hand-written cover letter- to the editor in chief of the American Journal of Physiology, who sent copies to two reviewers (contacted by email, but also often by phone or mail!). I then had to wait for a couple of months for those annotated copies to be returned… with the final decision being…’rejected’. At this time, irrespective of the outcome, submitting and getting a paper reviewed was already an achievement. The procedure in itself was a lesson of patience and humility, which likely made academics think twice before starting the overall process. Today with electronic platforms, submissions can be completed in 15 min and reviewers, secured within a few clicks. Considering the ongoing development of new technologies that facilitate data collection, and more importantly the increased need for achieving greater academic levels and the associated ‘necessity’ to publish, the number of research paper submissions has never been so high. The acceptance rate in well-ranked journals ranges from <10% (e.g., Nature) to 20-30%. For IJSPP, on the 795 papers submitted in 2016, only 214 made it in print. In overall, publishing papers has never been so competitive.

An even greater level of competitiveness can be seen when it comes to work as a practitioner in high-profile institutions and clubs. Back in the days, these positions were mainly accessible for former top athletes, who would drag with them the practitioners that worked with them during their career. With the expansion of individual athlete care in elite structures and the development of sport analytics as a whole, some of these jobs are now also accessible to people from outside the sport itself; further increasing the competitiveness of those positions. Every year, >1000-1500 Sport Sciences and/or Strength & Conditioning master students graduate in each European country;1 the number of available positions, in contrast, likely stagnates or may only grow at a very slow rate.

So, how do researchers get their papers within the 10-25%? How do aspiring coaches/sport scientists get the job everyone dreams of? The answer is simple: they break from the pack, make the choice to become a “linchpin”,2 surpass their peers while doing differently and better. They do what the others are not prepared to do. In addition to the necessary levels of knowledge, skills and experience that make great researchers and practitioners, some specific character traits are required to make an impact.3-5 Here, I wish to discuss further this aspect, using the example of 3 personality archetypes in relation to people’s ability and willingness to grow, share knowledge, collaborate and adopt an open-minded attitude. The archetypes are based on the idea that people’s mindset travels continually back and forth through an infinity-shape loop (Figure 1), between more (left) and less (right) comfortable zones; its however where people sit for most of the time that define their profile and allows them to make a substantial difference (or not).

Figure 1

Figure 1. Schematic representation of the three personality archetypes. The archetypes are based on the idea that people’s mindset travels continually back and forth through an infinity-shape loop (Figure 1), between more (left) and less (right) uncomfortable zones. Drive for dev: derive for development.

  • Type 1. Balanced profile, which reflects the mindset of the majority of people. They spend most of their time in their comfort zone (Figure 1), but can, when required and/or when pushed by others, step out transiently to grow and make substantial progress. Most of them stay nevertheless for a long time on the left side of the loop by laziness and/or naively believing that “it will be ok”. The others miss a strong drive for improvement, and/or self-confidence to make the Type 3. Their chances to make the 10-25% are real but limited; those for the good jobs are almost null.
  • Type 2. These people have often been working in high-level positions for a long time, both at the academic (e.g., head of faculty or departments, journal editors) and practitioner (e.g., head coaches, head physios and strength coaches) levels. They have chosen to ‘be’, rather than to do, even though this meant compromising their integrity at some stages. This is not a problem for them, as long as their titles, salary, public roles are secured and allow them to feel unique and important. Centred on themselves, they check the boxes, and continue within the same looping circle that keeps them in their own comfort zone (Figure 1). They purposely avoid challenges and can’t be bothered listening to others. They are “more satisfied with old problems than committed to finding new solutions”.6 When it comes to giving lectures, they teach what they know, not what the students need. They want to have their names on papers as last authors, but they wouldn’t be able to collect the data or discuss the stats and study findings. Their blindness keeps them away from the recent literature and the reality of journal requirements (i.e., topics, quality, designs), which inevitably leads to inappropriate and irrelevant submissions, likely to be directly rejected by editors. In some extreme scenarios, people keep digging deeper against the evidence. For example, while the need to move away from the null hypothesis testing approach is in the process of being accepted,7,8 those running into their own circle (or staying on orbit9) still ignore effect magnitudes10 and chose to further decrease the P value threshold to make decisions (<0.005)11!? In high-performance sports, those people don’t read research papers either, never update their skills and methods. They avoid to use new technologies and keep delivering outdated programs. They purposively don’t share what they do to protect themselves. Their focus on their own personal comfort is so prevalent that it often derails the optimal training or recovery process of the athletes they are in charge of. “They want to wear the tracksuit but not run the laps”.3 Providing any advice to help those people is a waste of space here, since they would not be reading these lines anyway. While they made some of the 10-25% or got some of the good jobs by luck and opportunism, their future is related to their political and survival strategies.
  • Type 3. Complete opposite of Type 2. Ultimate progression of Type 1 toward the right side of the shape (Figure 1). Those people are selfless, open-minded, curious, ambitious, accountable for their actions and show a critical mind. They know well that getting “out of the box” is necessary to learn, grow, innovate, create and eventually, succeed. They have understood that life is continuously brought into question, and are always willing to do better. They have embraced the uncomfortable truth that natural assets and talent can be outmatched through consistent efforts, deliberate practice,12 and in turn, the development of skills. There are open to constructive criticism.13 They listen more than they talk. They are not afraid to ask for help. They accept and acknowledge their errors to learn from them. In fact, they set very high standards for themselves, apply strict self-discipline and tend to be long-life learners:14 they read daily, listen to podcasts from various fields, travel, seek for information in different disciplines and always say yes when it comes to share experience and knowledge. They are more concerned by the process than by the results. They are interested in “doing”, and act to keep their integrity. They treat everyone the same, regardless of their status.14 They are those the more likely to make the 10-25% and to get some of the highly-competitive jobs.

Everyone is free to take the life path they want, and there are likely as many ways to follow as there are people. While I’ll never feel entitled to give any lessons to anybody, there is a feeling that less ego, more open-mindedness and collaborative work (i.e., Type 3 archetype) should help getting more quality papers out and delivering better programs to athletes. Successful people manage to enjoy life daily and keep doing what they want, which helps them to realize their potential both at the academic or field level. Getting out of box is likely compulsory to achieve this on the long term.

Martin Buchheit

Associate Editor IJSPP

 Acknowledgements: Many thanks to my Type 3 friends Mathieu Lacome, Ben Simpson and Yann LeMeur for their insightful comments on a draft of the present manuscript.


  1. Ingham S, A letter to the 15000. Https://www.Supportingchampions.Co.Uk/single-post/2015/09/27/a-letter-to-the-15000-updated-for-2016, in Supporting Champions. 2015.
  2. Godin S, Linchpin: Are you indispensable? 2011, London: Peunguin Books.
  3. Close GL, Changing an athlete’s behaviour: What can we learn from sport psychology? Http://www.Closenutrition.Com/?P=619, in Close Nutrition. 2017.
  4. Buchheit M. Chasing the 0.2. Int J Sports Physiol Perform, 2016;11(4):417-418.
  5. Mujika I. Winning the big medals. Int J Sports Physiol Perform, 2017;12(3):273-274.
  6. Maxwell JC, Thinking for a change: 11 ways highly successful people approach life and work 2005: Warner Books, Inc.
  7. Buchheit M. The numbers will love you back in return-i promise. Int J Sports Physiol Perform, 2016;11(4):551-4.
  8. Nuzzo R. Scientific method: Statistical errors. Nature, 2014;506(7487):150-2.
  9. Buchheit M. Houston, we still have a problem. Int J Sports Physiol Perform, 2017:1-13.
  10. Cohen J. Things i have learned (so far). American Psychologist, 1990;45:1304-1312.
  11. Benjamin DJ, Berger OJ, Johannesson M, et al. Redefine statistical significance. Nature Human Behaviour, 2017. DOI: doi:10.1038/s41562-017-0189-z.
  12. Ericsson KA and Pool E, Peak: Secrets from the new science of expertise. 2016: Boston: Houghton Mifflin Harcourt.
  13. Cressey E, The success is in the struggle. Https://ericcressey.Com/the-success-is-in-the-struggle, in Eric Cressey. 2017.
  14. McCaw A, 7 keys to being a great coach: Become your best and they will too, ed. K. Whyte. 2016: PrintShopCentral.com.

Houston, we still have a problem

M. Buchheit. Houston, we still have a problem. IJSPP, In press 2017.


Apollo 13 was launched at 1313 Houston time on Saturday, April 11, 1970. Following months of meticulous preparation, highly-skilled and experienced commandant J.A. Lovell and his crew were on their way for the third lunar landing in the history of humanity. Apollo 13 was looking like it would be the smoothest flight ever.1 When the astronauts finished their TV broadcast, wishing us earthlings a good evening, they didn’t imagine that an oxygen tank would explode a few moments later, rendering them close to spending the rest of their lives in rotation around the planet. While the crew eventually reached Earth safely, I wished to use this well-known incident to discuss further the link, or lack thereof, between sport sciences research and current field practices.2,3 My feeling is that failure to rethink the overall research/publishing process will keep us on orbit ad aeternum. That is, the sport sciences as a field will remain only at the periphery of elite sport practice.


Sport sciences in orbit. The somewhat extreme point I want to make is that there is a feeling that the academic culture and its publishing requirements have created a bit of an Apollo 13-like orbiting world (e.g., journals and conferences) that is mostly disconnected from the reality of elite performance.2,3 For example, how many coaches read publications or attend to sport sciences conferences?4 These guys are competition beasts, so if they could find any winning advantage, why wouldn’t they read or attend these? The reality is that what matters the most for coaches and players is the outcome, which is unfortunately rarely straightforward with the sport sciences. As one example, the first thing that Steve Redgrave (5 times Rowing Olympian) asked Steve Ingham (Lead Physiologist, English Institute of Sport) was if he was going to win more medals with his scientific support.5 Likewise, the first time I offered some amino acids to Zlatan Ibrahimović (top Swedish soccer player), he asked me straight up: “are these going to make me score more goals?” Adding to the problem, support staff in elite clubs often have high egos and as recently tweeted by R. Verheijen (Dutch football coach), they often can’t distinguish between experience (which they have) and knowledge (which they don’t always have). Such workers often don’t want to hear about the evidenced-based approach that we endlessly try to promote6 and devalue the importance of sharing data.7 Personal development courses and research & development departments are perceived as a waste of time and money, or as trivial undertakings that sport scientists pursue to promote themselves. To justify such an aggressive attitude against sport sciences, they often cite poorly designed, poorly interpreted and misleading studies, which is, in effect an argument that we have to accept.

Poor research discredits our profession. Life has told me that people rarely change. However, I believe that sport science can (and should). Today, we, sports scientists, are rarely asked to land on the moon. In fact, the majority of us spend our time and energy building the spaceship. We often don’t realize that keeping our feet on earth is the only way we can make an impact.3 When we meet other sport scientists either at conferences or otherwise, we talk about papers, PhD defenses and complain about idiot reviewers that we just wrestled with. We rarely chat about winning trophies or servicing athletes. The reality we have to accept however is that most of our studies can’t help coaches or practitioners, and in fact some of our investigations are so illogical that they directly discredit our profession and keep us 36 000 km in the sky. Which conditioning coach working in a club is naïve enough to believe that muscle metabolite contents could predict match running performance, knowing the importance of contextual variables (scoreline, team formation, position-specific demands8)? Which physiotherapist could be bothered enough to look at the recovery kinetic of fatigue markers following a treadmill run, from which all field-specific muscle damaging actions have been removed? British Journal of Sports Medicine surveys often blame practitioners for not following certain interventions believed to be optimal, when in reality, personnel in the field are often implementing things that are more advanced than what the academic ‘experts’ are trying to advise. Additionally, poor use of statistics in research often leads to the wrong conclusions,9,10 which creates confusion in clubs where such benefits might be expected for individual athletes. Poor research and translation keeps us in orbit.


The research doesn’t always apply.11 There are many situations where (often successful) practitioners and athletes don’t apply what the sport sciences might suggest. Does it mean that these people are all wrong? Shall we systematically blame all practices that are not “Evidenced-Based”? With the huge quantity of research produced nowadays, it is easy to find contradictory studies. The findings from one day are often refuted the next. So what is “the evidence” in the end? Meta-analyses are likely a part of the answer, but the quality of the studies included and the profile of the populations involved can always be discussed. Shouldn’t we be more pragmatic and reconsider the importance of “best practice” instead?11 Here are some examples of clear disconnects between current practices and scientific evidence:

  • There is almost no evidence that massage provides any sort of physiological recovery benefit.12 Fact: every single athlete in the world loves to be massaged after competition/heavy training.
  • Beta-alanine and beetroot juice have both been shown to have clear ergogenic effects on some aspects of performance.13 Fact: the majority of athletes can’t be bothered using them for their constraining ingestion protocols (2-3 doses/day for 4-10 weeks for beta-alanine13) and awful tastes, respectively.
  • Load monitoring has been shown to be key to understanding training and lowers injury risk. 14 Fact: many of the most successful coaches, teams and athletes in the world win major championships and keep athletes healthy without use of a single load monitoring system.
  • The importance of sleep for recovery and performance is clearly established.15 Fact: teams often train in the morning the day following an away game, which comprises sleep, mainly for social (time with family in the afternoon) and business (sponsors operations) aspects. And they still win trophies.
  • Training at the same time of the day as matches may help body clock adjustments and subsequence performance.16 Fact: Most teams train in the morning for the reasons mentioned above.
  • The optimal quantity of the various macronutrients to be ingested for athletes has been described for decades.17 Fact: most elite athletes have actual nutrition practices that are substantially different to what is prescribed,18,19 and they still win trophies.

We don’t have the right answers. Here is a discussion I had with a colleague a couple of years ago while observing their cold water immersion protocol after an away match:

  • MB: Hey buddy, what’s the temperature of the cold bath?
  • Physio: (looking busy) 9 °C
  • MB: Wow! how long do the players immerse themselves?
  • Physio: 2 minutes!
  • MB: hum…, thanks. 2 minutes only? Are you aware of the literature20 suggesting that it might be best if we can get them to stay for 10-15 min, with the temperature at 11-15°C instead?
  • Physio: (rolling his eyes over and looking bothered) THANK YOU. With 2 bath containers and the bus leaving in 35 min, how do you want me to deal with each of the 10 players? They’ve got press interviews and selfies with the fans on their plate before we take off… what temperature do you suggest for 2 min then? And while you’re thinking of that, pass me my tape, I need to pack!
  • MB: …. (In fact, as far as I know, none of the ˜300 studies on cold water immersion has addressed this specific question yet … he just sent me back to orbit!)

This discussion, together with the above-mentioned examples when research doesn’t apply show that often, instead of a “what is best”-type of answer, practitioners need a “what is the least worst option in our context”-type of answer. Do we really need to know the effect of total sleep deprivation on performance? We rather need to know if there is a difference between sleeping 8, 6 or only 4 hours but with a catch-up nap in the afternoon. Do we really need to know the effect of a 6-week hypoxic training intervention using repeated all-out cycling efforts 3 times/week, while in most soccer clubs conditioning is systematically done with the ball on the pitch? We are likely more interested in the optimal exercise formats that should be used in the specific context of congested training and match situations. We rather need to know what is the minimum volume of high-intensity sessions necessary to keep substitute players fit. In fact, it is very likely that an academic would shot himself a bullet in the foot (or send himself to orbit) if he decides by himself the topic of a research question, simply because things are way more complex than he may think.


How do we bring Sport Sciences back to earth? One solution might be for us to start where the questions actually arise (i.e., in clubs or federations) and then develop the structures required to conduct applied research, through research & development departments.21-23 Such sport scientists, who attempt to apply a degree of scientific rigor in a world of beliefs,3 are more than capable of creating relevant knowledge and best practice guidance within only a few weeks (Figure 1). This model contrasts with academic research that takes years to reach publication, before remaining inaccessible to the majority of coaches, athletes and practitioners (e.g., paper format,4 cost of journal subscription24). However, this type of in-house research can’t be the only research model for at least two reasons. First, club scientists don’t always have the opportunity (population, materials, skills, funding) to investigate the questions they are asking (e.g., should players sleep for 6 or 4 + 2 h following games?). Second, the knowledge that club scientists produce, if any, remains generally inside the clubs. While this is sometimes intentional (trying to keep a competitive advantage over the opposition), often club scientists have neither the need nor the skills and time to publish papers. For club practitioners, their mission is to improve club practices. A better use of their time is to multiply in-house data analyses/research projects than writing papers. Additionally, given the heavy requirements of peer-reviewed research (ethical approval, need for balanced study designs, control of external variables, large sample sizes, submission processes and reviewing battles), only the tip of the iceberg work ends up being published. In order for the rest of the iceberg to be disseminated outside of the club in the name of science, an option might be to offer shorter submission formats that are more accessible for busy club scientists, i.e., extended abstracts with figures, which is more or less what most people only have time to read anyway. Case studies, which reflect more the type of data and interest of club practitioners, should also be promoted. Editors should also encourage authors to adjust their data for confounding variables when possible, which can help to account for the noise related to real-life data collection. For larger-scale projects, clubs must strengthen their links with universities so that their data can be analyzed appropriately, and full papers can be written by academics with the time, experience and club level understanding. Similarly, experiments that can’t be conducted at the club level can be continued and refined in the laboratory environment. Only the latter conducted ‘academic’ studies may find their relevance in the real world of applied sport. Nevertheless, even with such a club-university partnership, it may not be as smooth as it looks. The ‘most rejected paper’,25 which was only published because we paid for it (7 rejections, despite the elite population, the robust study design, the data analysis and variables measured including hemoglobin mass and performance) illustrates the failure of the overall publishing process26 and the difficulties of publishing 100% club-driven research. It is also worth noting that by the time a ‘club paper’ is published, the coaching staff have likely already been replaced, a fact that may limit return on investment.

Fig 1

Figure 1. Possible research processes both in Universities/Laboratories and Clubs/Federations. In addition to its likely increased relevance, the ‘delivery time’ is much faster for club/federation- vs. university-driven research. See a Club/Uni collabortion example (among others thankfully) that fits the model

Conclusion. To conclude, if we as sport scientists want to have a word to say about the game that matters, we need to work towards keeping our feet on the earth and produce BETTER research; research tailored toward practitioner needs rather than aimed at being published per se. For such research to find its audience, we probably need to rethink the overall publishing process, starting with promotion of relevant submission types (e.g., short paper format types, short reports, as provided by IJSPP or the new web platform “Sport Performance & Science Reports”27), improving the review process (faster turnaround, reviewers identified to increase accountability and in turn, review quality), and media types (e.g., free downloads, simplified versions published into coaching journals, book chapters, infographics, dissemination via social media).24 Once these first steps are achieved, and only after, club sport scientists may then be in better position to personally transfer research findings to staff and/or educate athletes.3 When it comes to guiding practitioners and athletes, instead of using an evidence-based approach, we’d rather promote an “evidence-lead” or “informed practice” approach; one that appreciates context over simple scientific conclusions.11

Acknowledgements. Sincere thanks to Paul Laursen and David Pyne for their insightful comments on drafts of the present manuscript.


  1. Lovell, J.A., Houston, we’ve had a problem. Apollo expeditions to the moon. https://science.ksc.nasa.gov/history/apollo/apollo-13/apollo-13.html 1975.
  2. Burke, E.R., Bridging the gap in sports science. Athletic Purchasing and Facilities, 1980;4(11):24-15.
  3. Buchheit, M., Chasing the 0.2. Int J Sports Physiol Perform, 2016;11(4):417-418.
  4. Reade, I., R. W., and N. Hall, Knowledge transfer: How do high performance coaches access the knowledge of sport scientists? Int J Sport Sci Coach, 2008;3(3):319-334.
  5. Ingham, S.A., How to support a champion: The art of applying science to the elite athlete, ed. Simply Said. 2016.
  6. Sackett, D.L., Protection for human subjects in medical research. JAMA, 2000;283(18):2388-9; author reply 2389-90.
  7. Rolls, A., No more poker face, it is time to finally lay our cards on the table. Bjsm blog, http://blogs.Bmj.Com/bjsm/2017/03/06/no-poker-face-time-finally-lay-cards-table/. 2017.
  8. Carling, C., Interpreting physical performance in professional soccer match-play: Should we be more pragmatic in our approach? Sports Med, 2013;43(8):655-63.
  9. Buchheit, M., The numbers will love you back in return-i promise. Int J Sports Physiol Perform, 2016;11(4):551-4.
  10. Buchheit, M., Does beetroot juice really improve sprint and high-intensity running performance? – probably not as much as it seems: How (poor) stats can help to tell a nice story. Https://martin-buchheit.Net/2017/01/04/does-beetroot-juice-really-improve-sprint-and-high-intensity-running-performance-probably-not-as-much-as-it-seems-how-stats-can-help-to-tell-a-nice-story/. 2017.
  11. Burgess, D.J., The research doesn’t always apply: Practical solutions to evidence-based training-load monitoring in elite team sports. Int J Sports Physiol Perform, 2017;12(Suppl 2):S2136-s2141.
  12. Poppendieck, W., et al., Massage and performance recovery: A meta-analytical review. Sports Med, 2016;46(2):183-204.
  13. Burke, L.M., Practical issues in evidence-based use of performance supplements: Supplement interactions, repeated use and individual responses. Sports Med, 2017;47(Suppl 1):79-100.
  14. Blanch, P. and T.J. Gabbett, Has the athlete trained enough to return to play safely? The acute:Chronic workload ratio permits clinicians to quantify a player’s risk of subsequent injury. Br J Sports Med, 2016;50(8):471-5.
  15. Fullagar, H.H., et al., Sleep and recovery in team sport: Current sleep-related issues facing professional team-sport athletes. Int J Sports Physiol Perform, 2015;10(8):950-7.
  16. Chtourou, H. and N. Souissi, The effect of training at a specific time of day: A review. J Strength Cond Res, 2012;26(7):1984-2005.
  17. Burke, L.M., The complete guide to food for sports performance: Peak nutrition for your sport. 1996: Allen & Unwin; Second edition edition.
  18. Bilsborough, J.C., et al., Changes in anthropometry, upper-body strength, and nutrient intake in professional australian football players during a season. Int J Sports Physiol Perform, 2016;11(3):290-300.
  19. Burke, L.M., et al., Guidelines for daily carbohydrate intake: Do athletes achieve them? Sports Med, 2001;31(4):267-99.
  20. Machado, A.F., et al., Can water temperature and immersion time influence the effect of cold water immersion on muscle soreness? A systematic review and meta-analysis. Sports Med, 2016;46(4):503-14.
  21. Coutts, A.J., Working fast and working slow: The benefits of embedding research in high performance sport. Int J Sports Physiol Perform, 2016;11(1):1-2.
  22. McCall, A., et al., Can off-field ‘brains’ provide a competitive advantage in professional football? Br J Sports Med, 2016;50(12):710-2.
  23. Eisenmann, J.C., Translational gap between laboratory and playing field: New era to solve old problems in sports science. Translational Journal of the American College of Sports Medicine, 2017;2(8):37-43.
  24. Barton, C., The current sports medicine journal model is outdated and ineffective. Aspetar – Sports Medicine Journal, 2017;7:58-63.
  25. Buchheit, M., et al., Adding heat to the live-high train-low altitude model: A practical insight from professional football. Br J Sports Med, 2013;47 Suppl 1:i59-69.
  26. Buchheit, M., The most rejected paper -heat + altitude, accepted- illustrates the failure of the publication process https://martin-buchheit.Net/2013/09/13/adding-heat-to-the-live-high-train-low-altitude-model-a-practical-insight-from-professional-football/. 2013.
  27. Sport Performance & Science Reports. https://sportperfsci.com/


Chasing the 0.2

Buchheit M. Chasing the 0.2. IJSPP 2016, 11, 417-418. Original publication here



“A life is not important except in the impact it has on other lives” once said Jackie Robinson, the 6-time US All-Star baseball player. Making an impact is probably what drives most of us working as academics, applied sport scientists, or both. While academics may leave their footprint in the research community via their ground-breaking publication records, they can also indirectly help practitioners and athletes in the field through relevant research findings. Sport scientists, on the other hand, have direct contact with coaches and athletes and the responsibility to act daily to help them succeed.1 But making an impact—reaching a 0.2 as we are now used to saying in reference to the smallest important (standardized) effect in statistics2—is everything but easy. I heard Chris Carling (British sport scientist) once say that researchers and sport scientists often answer questions that are not asked.

The publication path is a long and winding road. From the first study protocol draft to an ahead-of-print manuscript, there are often months or even years of work, blood, sweat, and tears. Considering that sport science overall is not a major research field compared with medicine, for example, and that most peer-reviewed journals are not open-access, what is the actual audience for our manuscripts? Often it is apparent when dealing with practitioners that they couldn’t be bothered reading even the abstract of a paper and would rather ask directly, “Ok, but in the end what does the paper say?” The great success of Yann Le Meur’s infographics,3 Jacquie Tran’s sketchnotes,4 and the rise of personal blogs using advanced data-visualization techniques5 is evidence of the disconnect between journal manuscripts’ focus, format, and accessibility in comparison with practitioners’ needs and science-information literacy. I am not saying that researchers should give up publishing, but the choice of their research questions could sometimes be wiser and more relevant to the field. The informative nature and clarity of manuscript figures may also deserve more attention to allow nonscientists to better extract the pertinent information.

For academics, the benefit of better research questions is multiple. It may not only translate into greater impact on the field but also directly increase their paper citations and, in turn, their holy grail: the H factor. As exemplified with my personal publication records available on Google Scholar,6 a study in which I was involved during my PhD studies—using heart-rate arousals to detect changes in sleep stages, published in 2004 in a prestigious journal7—has only been cited 7 times since (8 times now!), while our recent review on high-intensity training8 has reached 164 citations in less than 3 years. Heart-rate patterns during sleep are probably interesting, but how to program interval training in athletes seems much more important to other researchers. Note, however, that in addition to generating large numbers of citations, some papers can also seduce a very large audience in terms of readership, exemplified by high altmetric9 scores, for example (eg, reads, downloads, shares on social media). Nonetheless, over the last 15 years, I have certainly published too many interesting-only papers that lacked clear practical applications. Who, in the field, has the time and the resources to detect ventilatory thresholds using electromyographic signals?10 Mea culpa! For sport scientists working in the field, continuing to publish high-quality research may also ensure their professional stability—if a club they work for ends their employment, having maintained minimal research activity likely increases their ability to “fall back” into academia.

So, how do researchers come to ask questions that make their working hours relevant and impactful? How do sport scientists select the area in which to put their efforts at their club? The first steps toward a 0.2 progress may be as simple as focusing on the “big rocks” (the rest being just pebbles and sand). Practically, this means targeting the 3 to 5 most important areas clearly identified as having a meaningful impact on the athletes’ programs and performance. In an extreme case, I would say that in our field, research studies that can’t help guide or change practice are not far from useless. Forget the unessential, forget big data strategies. Save time, energy, and resources to focus on what is known to matter to practitioners and athletes. Do simple but powerful. Ideally, academic researchers should always be aligned with practitioners’ (eg, sport scientists, strength and conditioning coaches, nutritionists) needs, who should, in the best-case scenario, be the researchers themselves, or at least those initiating the research questions. However, since the majority of coaches, support staff, and athletes often don’t know what to expect from applied research and scientific support at the club, it is only by sitting right next to them during training sessions and team debriefs, by sharing meals and cups of coffee, living daily with them in “the trenches,” that we can appreciate what they may find useful and which information they rely on to make their decisions. Whether a given coach or athlete better understands visual data (eg, printed reports, e-mails) versus verbal and informal feedback or relies more on quantitative versus qualitative information cannot be predicted. Understanding the specific codes of a sport or a very specific community of athletes takes many years. Having the respect and trust of high-profile athletes is often more a matter of personality and behavior than scientific knowledge and skills. While this sounds obvious for people already in the “industry,” master’s degrees and PhD qualifications often are of little benefit in the quest to create such a collaborative and productive environment. As described by the fantastic David T. Martin, we sport scientists (monkeys) and coaches and athletes (felines and big cats) don’t belong to the same species. We have different expectations, behave differently, and tend to make our decisions based on evidence and facts, while they rely on feelings and experience. Creating these links, building these bridges, connecting rather than collecting the dots, requires time and effort. Having a strong character is often compulsory to survive in most places, but open-mindedness, humility, and a form of kindness are probably some of the most important personality traits to develop to make a 0.2 in this world.

With these engaging personal and social skills in mind, it is not surprising that the majority of the most renowned researchers, sports scientists, and performance managers to date have, in parallel to their academic journeys, exposed themselves deeply to the elite sport culture, either directly (as coaches) or indirectly (as athletes). Joint positions (university and elite clubs) as typically offered in the United Kingdom, Australia, and New-Zealand or self-created similar environments (ie, working and/or playing in an elite club during one’s undergraduate program or PhD) represent in my eyes the optimal training options for a new generation of sport scientists to emerge. Only they may manage to ask the right questions, publish worthy papers for our journal, and have, in turn, >0.2 impacts on elite performance.

Martin Buchheit
Associate Editor, IJSPP


1. Pyne DB. Working with the coach. Int J Sports Physiol Perform. 2016;11(2):153. http://dx.doi.org/10.1123/IJSPP.2016-0034
2. Hopkins WG, Marshall SW, Batterham AM, Hanin J. Progressive statistics for studies in sports medicine and exercise science. Med Sci Sports Exerc. 2009;41(1):3–13. doi:10.1249/MSS.0b013e31818cb278
3. Le Meur Y. Infographics. http://ylmsportscience.blogspot.fr/. Accessed April 5, 2016.
4. Tran J. Sketchnotes. https://phdblog.jacquietran.com/category/sketchnotes/.
5. Prestidge B. https://public.tableau.com/profile/brian.prestidge#!/vizhome/EPLInjuries_4/Intro. Accessed April 5, 2016.
6. Buchheit M. https://scholar.google.com/citations?user=JwnPRl4AAAAJ&hl=en. Accessed April 5, 2016.
7. Viola AU, Brandenberger G, Buchheit M, et al. Sleep as a tool for evaluating autonomic drive to the heart in cardiac transplant patients. Sleep. 2004;27(4):641–647. PubMed
8. Buchheit M, Laursen PB. High-intensity interval training, solutions to the programming puzzle: part I: cardiopulmonary emphasis. Sports Med, 2013;43(5):313–338.
9. Altmetric. https://frontiers.altmetric.com/details/2124380. Accessed April 5, 2016.
10. Racinais S, Buchheit M, Girard, O. Breakpoints in ventilation, cerebral and muscle oxygenation, and muscle activity during an incremental cycling exercise. Front Physiol. 2014;5:142

The numbers will love you back in return – I promise

Buchheit M. The numbers will love you back in return – I promise. IJSPP 2016, 11, 551 – 554

Full text here

Abstract: The first sport science-oriented and comprehensive paper on magnitude-based inferences (MBI) was published 10 years ago in the first issue of this journal. While debate continues, MBI is today well-established in sports science and in other fields, particularly clinical medicine where practical/clinical significance often takes priority over statistical significance. In this commentary, some reasons why both academics and sport scientists should abandon null hypothesis significance testing (NHST) and embrace MBI are reviewed. Apparent limitations and future areas of research are also discussed. The following arguments are presented: P values and in turn, study conclusions, are sample-size dependent, irrespective of the size of the effect; significance doesn’t inform on magnitude of effects, yet magnitude is what matters the most; MBI allows authors to be honest with their sample size and better acknowledge trivial effects; the examination of magnitudes per se helps provide better research questions; MBI can be applied to assess changes in individuals; MBI improves data visualisation; and lastly, MBI is supported by spreadsheets freely available on the internet. Finally, recommendations to define the smallest important effect and improve the presentation of standardized effects are presented.

Keywords: magnitude-based inferences; null hypothesis significance testing; sample size; trivial effect; smallest important effect.


Figure 3 MBI

Figure 3. Differences in various anthropometric, physiological and performance measures between two groups of young soccer players differing by their maturity status (0.9 ± 0.3 vs. -0.2 ± 0.4 years from predicted peak height velocity)30 when expressed in percentages (A), using Cohen’s effect size principle (B) and as a factor of variable-specific smallest worthwhile differences (SWD) (C):28 0.2 x between-athletes SD for height, MAS and matches tracking data; performance-related changes for HRR and MSS (723 and 222%, respectively). The numbers of * indicate the likelihood for the between-group differences to be substantial, with 1 symbols referring to possible difference, 2 to likely, 3 to very likely and 4 to almost certain differences. Note that that magnitude of the between-group differences and their likelihood varies between the panels. My suggestion is to use the method used in panel C (with a variable-specific SWD). MSS: maximal sprinting speed, MAS: maximal aerobic speed, HRR: heart rate recovery after submaximal exercise, D>16 km/h: distance ran above 16 km/h during matches, #HIR: number of high intensity runs during matches.