Performance Monitoring

Introduction

Technological innovation has made it possible to monitor athlete performance (other-tracking) in unobtrusive ways (Dhruv Seshadri et al., 2017) and develop athlete management systems. The growth in personal fitness and well-being devices has made it possible to track one's own performance (self-tracking) too (Gina Neff and Dawn Nafus, 2016). Shona Halson (2014) provides an overview of a range of approaches that combine other- and self-tracking measures of training load. She contributes to the discussion of the use made in the monitoring of performance of objective and subjective measures of well-being (Anne Saw, Luana Main & Paul Gastin, 2015).

Some of the resources for this topic can be found in this mindmap and in the recommended and suggested reading shared here on this page.

There are three components to this theme:

  • Background
  • Wearable technologies
  • Motion and Video Tracking

These components raise some fundamental philosophical, as well as logistical, issues to do with the Quantified Self, Algorithmic Skin and the Transparent Self.

As we engage in the process of monitoring other and self performance, we must consider how we: acquire performance data; (pre)process and transform the data; develop models about personal and collective performance; and share these data with a range of audiences. A consensus statement about monitoring athlete training loads (Pitre Bourdon et al, 2017:S2-167) concluded "we acknowledge that the decision on which monitoring tools or techniques to use should remain with the professionals working in sport".

As we contemplate the quantification of performance in training and competition, we should be mindful of the debate about the validity, reliability and sensitivity of measures of sporting performance (see, for example, Kevin Currell & Asker Jeukendrup, 2008; Anna Saw, Luana Main & Paul Gastin, 2015).

Background

Some of the issues raised by the monitoring of performance are discussed in these five papers.

  • Roland Tharp and Ronald Gallimore (1976) on the basketball coach, John Wooden.
  • Ian Franks and Gary Miller (1991) on training coaches to observe and remember.
  • Andrew Borrie, Gudberg Jonsonn and Magnus Magnusson (2002) on temporal pattern analysis.
  • Jürgen Edelmann-Nusser, Andreas Hohmann and Bernd Henneberg (2002) on swimming performance.
  • Muneaki Ohshima, Ning Zhong, Y Yao and Sinchi Murata (2004) on video tracking.

These papers give a feel for how the observation and analysis of performance changed over three decades.

Wearable Technologies

Antonio Salazar and his colleagues (2010) observed:

Monitoring technology has experienced a boom in the past decade. Not only have sensors, mixed-signal components, transceivers become smaller, more powerful and more energy efficient; so have the contributions in communication protocols, textile electronics, and the general interest for body-centric devices for fields such as ... sports.

This boom is accelerating in pace (see, for example, Shona Halson, 2014; Thomas Page, 2015; Ryan Li et al., 2016; Dhruv Seshadri et al., 2017).

This is one view of the presence of wearable technologies in sport (location and inertial sensing).

As you explore this topic you might like to consider the benefits pervasive computing brings to the monitoring performance (through the combination of informatics and analytics) whilst reflecting on the validity and reliability of data acquired through observation and remote sensing (Macfarlane Scott, Tannath Scott & Vincent Kelly, 2016; James Malone et al., 2016; Thomas Haugen & Martin Buchheit, 2016; Ryu Nagahara et al., 2016; Matthew Varley et al., 2017). You might consider some of the ethical issues about surveillance too.

Motion and Video Tracking

Sian Barris and Chris Button (2008) provided a state of the art review of vision-based motion analysis in sport (publications in the years 1970-2007). They distinguish:

  • Manual vision-based tracking systems
  • Automated vision-based tracking systems
  • Commercially available vision-based analysis systems

Their paper concludes with the observation "a wealth of fascinating information related to multiple player interaction will soon become available that has the potential to enhance understanding of sports performance to a new level" (2008: 1041).

João Serrano, Shakib Shahidian & Orlando Fernandes (2014) provide an example of a mixed methods approach to motion tracking. Their study presents "a validation protocol using a global positioning system with real-time differential correction to assess the validity and the reliability of a semi-auto tracking software used to quantify the movement patterns of football players".

Julian Castellano, David Alvarez-Pastor & Paul Bradley (2014) reviewed two commercially available vision-based systems in football. They note:

Current Computerised tracking systems in elite soccer still provide adequate detail on the physical and technical performances of players but must develop further to compete with the array of additional parameters offered by new technologies such as global or local positioning system technology.

Robert Rein & Daniel Memmert (2016) discuss how the increasing amount of data from such systems (tracking technologies and physiological training data collected through miniature sensor technologies) might be used.

Dominic Southgate, Joe Prinold & Robert Weinert-Aplin (2016) have provided a recent review of motion analysis in sport.

This is an example (from the Disney Research Hub, 2017) of where some of this work produced by vision tracking is taking practice:

Another illustration of the rich data available from tracking technologies is MAProgress. Their service uses live GPS tracking systems. This is an example of the functionality available in a case study of a coast to coast bicycle race in New Zealand.

MAProgress provide details of the resources they use to deliver their service to events such as the Indian Pacific Wheel Race 2017.

Jun Burden and his colleagues (2010) report the development of an automated video tracking system to track changeovers in team pursuit cycling races.Their system used a single camera in burst mode, and employed background subtraction, edge detection and predictive tracking. The system was implemented in Python and OpenCV.

Marco Beato & Mikael Jamil (2017) consider the intra-system reliability of a digital tracking system for performance analysis in football. The conclude "actions of high intensity, high speed, and power data are usually associated with low levels of reliability, but this study revealed that the Digital.Stadium® VTS is more than capable of recording this data accurately".

Employment Examples

Sport Scientist

In October 2017, the Crusaders rugby union team advertised for a sport scientist. The job description included the following:

  • Reporting to the Crusaders’ Head Strength and Conditioning Coach, you will be responsible for overseeing and coordinating all aspects of the Crusaders’ performance monitoring systems including further enhancement of data collection, processing and reporting methods.
  • You will also be responsible for collating and reporting on all performance monitoring data to ensure optimal player loading for conditioning and recovery.
  • In addition, you will undertake research projects to support the Medical, Strength and Conditioning and Performance Analysis Departments to ensure they remain best practice leaders in elite sport.
  • To be successful in this role, you will need to be appropriately qualified by training and/or experience, including a proven ability in research, data analysis and reporting including an outstanding level of understanding of performance monitoring and analysis tools ideally in a rugby environment.
  • You will also need to demonstrate extensive experience in the use of GPS Technology both hardware and software and a deep understanding and love of rugby including the position specific demands it places on professional athletes.
  • You will be a team player and have the ability to develop strong working relationships and effectively communicate analytical information.
  • Prior experience in an elite sports team environment would be an advantage.

Recommended Reading

Jeremy Alexander, Trent Hopkinson, Daniel Wundersitz and Nick Ball (2016). Validity of a wearable accelerometer device to measure average acceleration values during high speed running. Journal of Strength and Conditioning.

Marco Altini (2016). From the Quantified Self to Epidemiological Research.

Marco Altini & Oliver Amft (2016). HRV4 Training: Large-Scale Longitudinal Training Load Analysis in Unconstrained Free-Living Settings Using a Smartphone Application.

Steve Barrett (2017). Monitoring Elite Soccer Players External Loads Using Real-Time Data. International Journal of Sports Physiology and Performance.

Thomas Blobel & Martin Lames (2016). Information Systems for Top Level Football. In Proceedings of the 10th International Symposium on Computer Science in Sports (ISCSS), 51-58. Springer International Publishing: Berlin.

Thiago Borges, Nicola Bullock, Christine Duff & Aaron Coutts (2014). Methods for Quantifying Training in Sprint Kayak. Journal of Strength and Conditioning Research, 28(2), 474-482.

Martin Bucheit (2014). Monitoring training status with HR measures: do all roads lead to Rome? Frontiers in Physiology, 5:73.

John Burn-Murdoch (2016). Djokovic's 2015 was the greatest ever men's tennis season. Financial Times, 27 January.

Danny Castillo, Jesus Camara & Yanci Javier (2017). Validity of 10 Hz global positioning system devices to measure performance in an incremental cardiovascular field test.

Cain Clark, Claire Barnes, Kelly Mackintosh & Melitta Mcnarry (2016). A Review of Emerging Analytical Techniques for Objective Physical Activity Measurement in Humans. Sports Medicine.

Joao Claudino, John Cronin, Alberto Amadio, & Julio Serrão (2016). How can the Training Load be Adjusted Individually in Athletes with an Applied Statistical Approach?. Journal of Athletic Enhancement 5, (6).

Mark Connor (2017a). Individualisation of player monitoring: Speed Zones - Part 1.

Mark Connor (2017b). Individualisation of player monitoring: Speed Zones - Part 2.

Chris Cothern (2016). What is "Evidence-led Research'?

Micael Couceiro, Gonçalo Dias, Duarte Araújo, and Keith Davids (2016). The ARCANE Project: How an Ecological Dynamics Framework Can Enhance Performance Assessment and Prediction in Football. Sports Medicine, 1-6.

Diogo Coutinho et al (2017). Mental Fatigue and Spatial References Impair Soccer Players' Physical and Tactical Performances. Frontiers in Psychology, https://doi.org/10.3389/fpsyg.2017.01645

Carla Dellaserra, Yong Gao, & Lynda Ransdell (2014). Use of Integrated Technology in Team Sports: A Review of Opportunities, Challenges, and Future Directions for Athletes. Journal of Strength & Conditioning Research, 28(2), 556-573.

Paul Dijkstra, N. Pollock, R. Chakraverty, & J. M. Alonso (2014). Managing the health of the elite athlete: a new integrated performance health management and coaching model. British journal of sports medicine 48(7), 523-531.

Steven Duhig et al (2016). Effect of high-speed running on hamstring strain injury risk. British Journal of Sports Medicine.

Andrew Edwards, Joshua Guy & Florentina Hettinga (2016). Oxford and Cambridge Boat Race: Performance, Pacing and Tactics Between 1890 and 2014. Sports Medicine 46(10), 1553-1562.

Javier Fernández, Daniel Medina, Antonio Gómez, Marta Arias, & Ricard Gavaldà (2016). Does Training Affect Match Performance? A Study Using Data Mining And Tracking Devices. Proceedings of the Workshop on Machine Learning and Data Mining for Sports Analytics 2016, Riva del Garda, Italy, September.

Tim Gabbett et al (2017). The athlete monitoring cycle: a practical guide to interpreting and applying training monitoring data. British Journal of Sports Medicine. http://dx.doi.org/10.1136/bjsports-2016-097298

Alden Gonzalez (2017). Counting the steps: how Rams use player tracking to optimize availability.

Mahanth Gowda (2017). Bringing IoT to Sports Analytics.

Joachim Gudmundsson & Michael Horton (2016). Spatio-Temporal Analysis of Team Sports - A Survey.

Shona Halson (2014). Monitoring Training Load to Understand Fatigue in Athletes. Sports Medicine, 44(2), 139-147.

Philippe Hellard et al (2017). Modelling of optimal training load patterns during the 11 weeks preceding major competition in elite swimmers. Applied Physiology, Nutrition and Metabolism. https://doi.org/10.1139/apnm-2017-0180.

Kayla Heffernan, Frank Vetere & Shanton Chang (2017). Towards insertables: Devices inside the human body.

Jeremy Hochstedler (2016). Finding the Open Receiver: A Quantitative Geospatial Analysis of Quarterback Decision-Making.

Megan Hodun et al. (2016). Global Positioning System Analysis of Running Performance in Female Field Sports: A Review of the Literature. Strength & Conditioning Journal, 38(2), 49-56.

Will Hopkins, John Hawley & Louise Burke (1999). Design and analysis of research on sport performance enhancement. Med Sci Sports Exerc., 31(3), 472-485.

Garrett Hynes, Michael O'Grady, & Gregory O'Hare (2013). Towards Accessible Technologies for Coaching. International Journal of Sports Science and Coaching, 8(1), 105-114.

International Journal of Sports Physiology and Performance (2017). 2nd ASPIRE Sport Science Conference on Monitoring Athlete Training Loads. International Journal of Sports Physiology and Performance 12 (suppl 2).

Daniel James & Petrone, N. (2016). Sensors and Wearable Technologies in Sport. SpringerBriefs in Applied Sciences and Technology.

Kinexon (2017). Beyond Player Load: context-based performance analysis – impressions from NABC Convention 2017 at NCAA Final Four.

Daniel Link & Michael de Lorenzo (2016). Seasonal Pacing - Match Importance Affects Activity in Professional Soccer. PLoS ONE, 11(6): e0157127.

Daniel Link, Otto Kolbinger, Hendrik Weber & Michael Stöckl (2016). A topography of free kicks in soccer. Journal of Sports Sciences, 34(24), 2312–2320.

Daniel Link, Steffan Lang & Philipp Seidenschwarz (2016). Real Time Quantification of Dangerousity in Football Using Spatiotemporal Tracking Data. PLoS ONE, 11(12): e0168768.

Deborah Lupton (2016). Interesting HCI research on self-tracking: a reading list.

Ralph Maddison et al. (2017). Quantifying Human Movement Using the Movn Smartphone App: Validation and Field Study. JMIR Mhealth Uhealth, 5(8).

James Malone, Ric Lovell, Matthew Varley & Aaron Coutts (2016). Unpacking the Black Box: Applications and Considerations for Using GPS Devices in Sport. International Journal of Sports Physiology and Performance.

DJ McNamara, Tim Gabbett, Peter Blanch & L Kelly (2017). The Relationship Between Wearable Microtechnology Device Variables and Cricket Fast Bowling Intensity. International Journal of Sports Physiology and Performance.

Daniel Medina, Eduard Pons, Antonio Gomez, Marc Guitart, Andres Martin, Jairo Vazquez-Guerrero, Ismael Camenforte, Berta Carles, & Roger Font (2017). Are there potential safety issues concerning the safe usage of electronic personal tracking devices? The experience of a multi-sport elite club." International journal of sports physiology and performance.

Martin O’Reilly, Darragh Whelan, Tomas Ward, Eamonn Delahunt, and Brian Caulfield (2017). Technology in S&C: Tracking Lower Limb Exercises with Wearable Sensors. Journal of Strength and Conditioning Research.

Adam Owen, Gordon Dunlop, Mehdi Rouissi & Karim Chamari (2016). Analysis of positional training loads (ratings of perceived exertion) during various-sided games in European professional soccer players. International Journal of Sports Science & Coaching, 11(3).

Louis Passfield et al (2016). Knowledge is power: Issues of measuring training and performance in cycling. Journal of Sports Sciences.

Carl Petersen, David Pyne, Marc Portus, & Brian Dawson (2009). Validity and reliability of GPS units to monitor cricket-specific movement patterns. International Journal of Sports Physiology & Performance, 4(3).

Daniel Plews, Ben Scott, Marco Altini & Paul Larsen (2017). Comparison of heart rate variability recording with smart phone photoplethysmographic, Polar H7 chest strap and electrocardiogram methods.

Antii Poikola, Kai Kuikkaniemi & Harri Honko (2017). MyData.

E. Rampinini, G. Alberti, M. Fiorenza, M. Riggio, R. Sassi, T. Borges, & A. Coutts (2015). Accuracy of GPS devices for measuring high-intensity running in field-based team sports. International journal of sports medicine, 36(1), 49-53.

Sam Robertson (2016). A statistical approach to enhancing player skill in Australian Rules Football: applications to team sport.

Sam Robertson, Peter Kremer, Brad Aisbett, Jacqueline Tran & Ester Cerin (2017). Consensus on measuremenr properties and feasibility of performance tests for the exercise and sport sciences: a Delphi study. Sports Medicine - Open.

Science for Sport (2016a). GPS (Wearables): Part 1 - Technology, Validity and Reliability.

Dhruv Seshadri et al (2017). Wearable devices for sport.

Tony Strudwick (2017). Reshaping the future of sports science in football.

Mark Thorklein (2015). SportVU Data Analytics.

Robin Thorpe, Anthony Strudwick, Martin Bucheit, Greg Atkinson, Barry Drust & Warren Gregson (2016). The tracking of morning fatigue status across in-season training weeks in elite soccer players. International Journal of Sports Physiology and Performance.

Matt Turck (2016). Internet of Things: Are we There Yet? (The 2016 IoT Landscape).

Matthew Varley, Arne Jaspers, Werner Helsen, and James Malone (2017). Methodological Considerations When Quantifying High-Intensity Efforts in Team Sport Using Global Positioning System Technology. International Journal of Sports Physiology and Performance.

Ben Williamson (2015). Algorithmic skin: health-tracking technologies, personal analytics and the biopedagogies of digitized health and physical education. Sport, Education and Society, 20(1), 133-151.

Suggested Reading

Richard Akenhead & George Nassis (2016). Training Load and Player Monitoring in High-Level Football: Current Practice and Perceptions.

Linda Becker (2016). Evaluation of joint angle accuracy using markerless silhouette-based tracking and hybrid tracking against traditional marker tracking. Masters thesis, Otto von Guericke University, Magdeburg.

Martin Buchheit et al (2014). Monitoring fitness, fatigue and running performance during a pre-season training camp in elite football players. Journal of Science and Medicine in Sport, 16(6): 550-5.

John Burn-Murdoch (2015). Man United's struggles in the post-Ferguson era. FT Data.

Damien Demaj (2014). Visualizing Player Movement in Sport using 3D Web GIS.

Damien Demaj (2013). Using spatial analytics to study spatio-temporal patterns in sport.

Damien Demaj (2012). Using ArcGIS for sports analytics.

Matthew Driller, Nattai Borges & Daniel Plews (2016). Evaluating a new wearable lactate threshold sensor in recreational to highly trained cyclists. Sports Engineering.

Bryce Dyer (2015). The Progression of Male 100 m Sprinting with a Lower-Limb Amputation 1976–2012. Sports, 3(1), 30-39.

Fabian Ehrmann et al (2015). GPS and Injury Prevention in Professional Soccer. Journal of Strength and Conditioning Research.

Javier Fernandez et al (2016). Does Training Affect Match Performance? A study Using Data Mining And Tracking Devices.

Firstbeat (2016). Firstbeat completes the picture for Australian Rules Football Club Port Adelaide.

Andrew Flatt, Bjoern Hornikel & Michael Esco (2016). Heart rate variability and psychometric responses to overload and tapering in collegiate sprint-swimmers. Journal of Science and Medicine in Sport.

Anthony Fox (2017). Scaling exactEarth's satellite vessel-tracking service using GeoMesa on Google Cloud Platform.

Robert Harle et al (2012). Towards real-time profiling of sprints using wearable pressure sensors. Computer Communications, 35, 650-660.

Mark Harris (2016). How Zano raised millions on Kickstarter and left most backers with nothing.

Courtney Hess (2015). The Lived Experiences of an Injured Athlete and Members of a Performance Management Team During Injury Rehabilitation: an Interpretative Phenomenological Analysis. PhD Thesis, University of Wisconsin-Milwaukee.

Richard Johnston et al (2014). Validity and Interunit Reliability of 10 Hz and 15 Hz GPS Units for Assessing Athlete Movement Demands. Journal of Strength and Conditioning Research, 28(6), 1649-1655.

Stephanie Kovalchik (2016). AO Leaderboard - Women's Distances.

Giuseppe Lippi et al (2008). Updates on improvement of human athletic performance: focus on world records in athletics. British Medical Bulletin, 87(1), 7-15.

Deborah Lupton (2015). Data assemblages, sentient schools and digitised health and physical education (response to Gard). Sport, Education and Society, 20(1), 122-132.

Carol McDonald (2017). Fast Cars, Big Data - How Streaming Data Can Help Formula 1.

Dean McNamara, Tim Gabbett, Geraldine Naughton & John Orchard (2016). How submarine and guided missile technology can help reduce injury and improve performance in cricket fast bowlers. British Journal of Sports Medicine.

Andy Miah and Emma Rich (2016). Digital Health: Medicine, Methods and Mobile Devices.

Bradley Millington (2016). Fit for Prosumption: Interactivity and the Second Fitness Boom. Media, Culture & Society.

Le Nguyen et al (2015). Basketball activity recognition using wearable inertial measurement units. Proceedings of the XVI International Conference on Human Computer Interaction.

Daniel Plews, Paul Laursen, Jamie Stanley, Andrew Kidling & Martin Bucheit (2013). Training adaptation and heart rate variability in elite endurance athletes: opening the door to effective monitoring. Sports Medicine, 43(9): 773-81.

Jure Rejec (2016). How Big data is Changing the World of Soccer.

Jeff Sackmann (2016). Tennis Abstract.

Macfarlane Scott, Tannath Scott & Vincent Kelly (2015). The Validity and Reliability of Global Positioning Systems In Team Sport: A Brief Review. Journal of Strength and Conditioning Research.

Daniel Setterwall (2003). Computerised Video Analysis of Football - Technical and Commercial possibilities for Football Coaching. Masters Thesis, Royal Institute of Technology, Stockholm.

Sean Steffen (2016a). Does Finishing Skill Matter in MLS?

Sean Steffen (2016b). Finishing in MLS Part 2.

Lee Wallace, Katie Slattery and Aaron Coutts (2014). A comparison of methods for quantifying training load: relationships between modelled and actual training measures. European Journal of Applied Physiology, 114(1): 11-20.

Lee Wallace, Katie Slattery and Aaron Coutts (2009). The ecological validity and application of the session-RPE method for quantifying training loads in swimming. Journal of Strength and Conditioning Research, 23(1), 33-38.

Kaitlyn Weiss, Sian Allen, Mike McGuigan & Chris Whatman (2017). The Relationship Between Training Load and Injury in Men's Professional Basketball Players. International Journal of Sports Physiology and Performance.

Frank Wyatt, Alissa Donaldson & Elise Brown (2013). The Overtraining Syndrome: A Meta-Analytic Review. Journal of Exercise Physiologyonline, 16(2), 12-23.

Photo Credit

Ten swimmers lining up to start a race at Green Lake ... (University of Washington Digital Collections, No Known Copyright Restrictions).