Reliability outcomes of studies included in the second step
| Author(s) | Rugby code | Skill tested | Subjects (N) | Reliability | Variable | Result | Evidence | COSMIN |
| Green25 | Union | Reactive agility | 11 | Test–retest | Reactive agility speed (s) | ICC=0.88, SEM=0.09 | + | Poor |
| Gabbett24 | League | Reactive agility | 42 | Test–retest | Movement time (s) | ICC=0.92, TE=2.1% | + | Fair |
| Decision time (ms) | ICC=0.95, TE=7.8% | + | ||||||
| Response accuracy | ICC=0.93, TE=3.9% | + | ||||||
| Serpell26 | League | Reactive agility | 15 | Test–retest | Total agility time (s) | ICC=0.82, SEM=0.01 | + | Fair |
| Perception and response time (s) | ICC=0.31, SEM=0.01 | – | ||||||
| Participants’ confidence about decision made (%) | ICC=0.50, SEM=2.12 | – | ||||||
| Gabbett9 | League | Technical and perceptual skills | 58 | Test–retest | Tackling assessment | ICC=0.83, TE=3.3% | + | Poor |
| Draw and pass assessment | ICC=0.86, TE=5.3% | + | ||||||
| Reactive agility, decision accuracy | ICC=0.93, TE=3.9% | + | ||||||
| Reactive agility, decision time | ICC=0.95, TE=7.8% | + | ||||||
| Pattern recall | ICC=0.80, TE=9.3% | + | ||||||
| Pattern prediction | ICC=0.85, TE=8.7% | + | ||||||
| Intra-rater | Playing performance | ICC>0.80, TE<5.0% | + | |||||
| Pienaar10 | Not specified | Catching and passing | 36 | Test–retest | Passing for distance | PCC=0.74 | – | Fair |
| Passing for accuracy, 7 m | PCC=0.66 | – | ||||||
| Passing for accuracy, 4 m | PCC=0.39 | – | ||||||
| Running and catching | PCC=0.53 | – | ||||||
| Stuart22 | Union | Simulated rugby games | 9 | Between-subjects CoV | Offensive sprint | CoV=13% | Poor | |
| Defensive sprint | CoV=9.2% | |||||||
| Tackle sprint | CoV=9.8% | |||||||
| Passing accuracy | CoV=20% | |||||||
| Gabbett14 | League | Game-specific skills during match | 86 | Intra-rater | ICC=0.85–0.98, TE=5.1%–5.3% | + | Poor | |
| Inter-rater | ICC=0.84–0.94, TE=7.0%–9.0% | + | ||||||
| Kempton28 | League | Game-specific skills during match | 10 | Intra-rater | Attempted tackle | α=0.81 | + | Poor |
| Kick receive | ||||||||
| Pass | ||||||||
| ‘Dummy-half’ pass | ||||||||
| Ball carry | ||||||||
| Kick (attacking) | ||||||||
| Kick (territory) | ||||||||
| Sirotic27 | League | Game-specific skills during match | 39 | Intra-rater | Ball carries | ICC=0.996, TEM=0.008 | + | Fair |
| Support runs | ICC=0.986, TEM=0.010 | + | ||||||
| Touches of the ball | ICC=0.997, TEM=0.022 | + | ||||||
| Play-the-balls | ICC=0.997, TEM=0.008 | + | ||||||
| Tackles made | ICC=0.991, TEM=0.015 | + | ||||||
| Bennett23 | League | Game-specific skills during match | 45 | Intra-rater | Ball carry | ICC=0.98, TEM=0.053 | + | Fair |
| Support run | ICC=0.86, TEM=0.077 | + | ||||||
| Offensive miss | ICC=0.71, TEM=0.061 | + | ||||||
| Line break | ICC=0.86, TEM=0.007 | + | ||||||
| Line break assist | ICC=1.00, TEM=0.000 | + | ||||||
| Tackle completed | ICC=1.00, TEM=0.064 | + | ||||||
| Tackle not completed | ICC=0.99, TEM=0.000 | + |
‘+’, strong evidence; ‘–‘, limited evidence; α, Cronbach’s alpha; COSMIN, Consensus-based Standards for the selection of health Measurement Instruments; CoV, coefficient of variation; ICC, intraclass correlation coefficient; PCC Pearson’s correlation coefficient, SEM, standard error of measurement; TE, typical error of measurement; TEM, technical error of measurement.