Intended for healthcare professionals

CCBYNC Open access
Research

Performance of the Innova SARS-CoV-2 antigen rapid lateral flow test in the Liverpool asymptomatic testing pilot: population based cohort study

BMJ 2021; 374 doi: https://doi.org/10.1136/bmj.n1637 (Published 07 July 2021) Cite this as: BMJ 2021;374:n1637

Linked Editorial

Asymptomatic rapid testing for SARS-CoV-2

Read our latest coverage of the coronavirus pandemic

  1. Marta García-Fiñana, professor1,
  2. David M Hughes, lecturer1,
  3. Christopher P Cheyne, postdoctoral research associate1,
  4. Girvan Burnside, senior lecturer in biostatistics1,
  5. Mark Stockbridge, head of service evaluation2,
  6. Tom A Fowler, public health lead23,
  7. Veronica L Fowler, virology scientific advisor2,
  8. Mark H Wilcox, professor of medical microbiology4,
  9. Malcolm G Semple, professor of outbreak medicine and child health56,
  10. Iain Buchan, professor of public health and clinical informatics7
  1. 1Department of Health Data Science, Institute of Population Health, University of Liverpool, Liverpool, UK
  2. 2Department of Health and Social Care, London, UK
  3. 3William Harvey Research Institute, Queen Mary University of London, London, UK
  4. 4Leeds Institute of Medical Research, University of Leeds, Leeds, UK
  5. 5NIHR Health Protection Research Unit in Emerging and Zoonotic Infections and Institute of Translational Medicine, Faculty of Health and Life Sciences, University of Liverpool, Liverpool, UK
  6. 6Respiratory Medicine, Alder Hey Children’s Hospital, Liverpool, UK
  7. 7Institute of Population Health Sciences, University of Liverpool, Liverpool, UK
  1. Correspondence to: M García-Fiñana martaf{at}liverpool.ac.uk
  • Accepted 22 June 2021

Abstract

Objective To assess the performance of the SARS-CoV-2 antigen rapid lateral flow test (LFT) versus polymerase chain reaction testing in the asymptomatic general population attending testing centres.

Design Observational cohort study.

Setting Community LFT pilot at covid-19 testing sites in Liverpool, UK.

Participants 5869 asymptomatic adults (≥18 years) voluntarily attending one of 48 testing sites during 6-29 November 2020.

Interventions Participants were tested using both an Innova LFT and a quantitative reverse-transcriptase polymerase chain reaction (RT-qPCR) test based on supervised self-administered swabbing at testing sites.

Main outcome measures Sensitivity, specificity, and predictive values of LFT compared with RT-qPCR in an epidemic steady state of covid-19 among adults with no classic symptoms of the disease.

Results Of 5869 test results, 22 (0.4%) LFT results and 343 (5.8%) RT-qPCR results were void (that is, when the control line fails to appear within 30 minutes). Excluding the void results, the LFT versus RT-qPCR showed a sensitivity of 40.0% (95% confidence interval 28.5% to 52.4%; 28/70), specificity of 99.9% (99.8% to 99.99%; 5431/5434), positive predictive value of 90.3% (74.2% to 98.0%; 28/31), and negative predictive value of 99.2% (99.0% to 99.4%; 5431/5473). When the void samples were assumed to be negative, a sensitivity was observed for LFT of 37.8% (26.8% to 49.9%; 28/74), specificity of 99.6% (99.4% to 99.8%; 5431/5452), positive predictive value of 84.8% (68.1% to 94.9%; 28/33), and negative predictive value of 93.4% (92.7% to 94.0%; 5431/5814). The sensitivity in participants with an RT-qPCR cycle threshold (Ct) of <18.3 (approximate viral loads >106 RNA copies/mL) was 90.9% (58.7% to 99.8%; 10/11), a Ct of <24.4 (>104 RNA copies/mL) was 69.4% (51.9% to 83.7%; 25/36), and a Ct of >24.4 (<104 RNA copies/mL) was 9.7% (1.9% to 23.7%; 3/34). LFT is likely to detect at least three fifths and at most 998 in every 1000 people with a positive RT-qPCR test result with high viral load.

Conclusions The Innova LFT can be useful for identifying infections among adults who report no symptoms of covid-19, particularly those with high viral load who are more likely to infect others. The number of asymptomatic adults with lower Ct (indicating higher viral load) missed by LFT, although small, should be considered when using single LFT in high consequence settings. Clear and accurate communication with the public about how to interpret test results is important, given the chance of missing some cases, even at high viral loads. Further research is needed to understand how infectiousness is reflected in the viral antigen shedding detected by LFT versus the viral loads approximated by RT-qPCR.

Introduction

The global SARS-CoV-2 pandemic has been responsible for many deaths and has had a profound, enduring effect on the livelihoods and life chances of people worldwide. Identifying those with covid-19 has become a key strategy for limiting the spread of the disease, with quantitative reverse-transcriptase polymerase chain reaction (RT-qPCR) testing being used as the reference standard in the diagnosis of covid-19. In a public health rather than clinical context, however, the hours or days taken to receive a RT-qPCR test result is time when infected people might be transmitting the virus to others. The cost and capacity of RT-qPCR testing also limit its value for public health uses. As a consequence, low cost, rapid lateral flow technology (LFT), such as that used in pregnancy test kits, was developed to detect the nucleocapsid protein antigen of SARS-CoV-2, the virus responsible for covid-19.1 The LFT provides results within 30 minutes and can be carried out without the need for a laboratory, offering the potential to rapidly identify people with covid-19, ideally leading to quick isolation, and breaking transmission chains.

The Innova LFT was adopted for large scale English pilots of community testing in response to covid-19, including open access testing for asymptomatic residents of Liverpool in England. An initial evaluation, undertaken as part of the test development and evaluation programme commissioned by the Department of Health and Social Care, and conducted by Public Health England Porton Down laboratory and the University of Oxford, reported test sensitivity compared with RT-qPCR of 79% when the LFT was read by laboratory scientists, 73% when read by trained healthcare workers, and 58% when read by self-trained staff members at a test and trace centre.2 The study considered both people with and without symptoms and found no evidence of a difference in sensitivity. However, the study participants were part of a testing service for people with symptoms and details are lacking as to why asymptomatic people were tested. A recent review suggested that LFT can be less accurate in asymptomatic people than in those with symptoms.3

We assessed the performance of LFT to detect current SARS-CoV-2 infection in the general population without symptoms attending covid-19 testing centres. The use of RT-qPCR as the reference standard test is, however, questionable because RT-qPCR can detect SARS-Cov-2 for an average of 17 days, and often for longer. For much of this period, the individual is likely to have stopped being infectious.456 The RT-qPCR cycle threshold (Ct) offers an indication of viral load, which is understood to be linked to the level of infectiousness of someone with covid-19. Nevertheless, the precise relation in any individual between Ct and viral load, and between viral load and infectiousness is still unclear.78 The PHE evaluation2 indicated that LFT was able to identify more than 90% of people with a Ct <25, corresponding approximately to a viral load of >105 RNA copies/mL, indicating that the LFT has the potential to identify most of those who are infectious. Some concerns remain about the use of LFT, however, most noticeably about the accuracy reported by self-trained or non-expert readers in the asymptomatic population.9

On 6 November 2020 a community testing programme, piloted in Liverpool and sponsored by the Department of Health and Social Care, started with the aim of identifying more infected people earlier in their infection cycle so they could self-isolate and break transmission chains. To assess the performance and appropriate implementation of the Innova LFT in Liverpool, we performed a quality assurance exercise. We compared the sensitivity, specificity, and predictive values of the LFT with a RT-qPCR test sampled within minutes of self-administered swabbing by the same individual at the testing site. The sensitivity of the LFT as a function of PCR Ct (viral load proxy) was also investigated.

Some initial results from this Liverpool pilot have been reported previously1011 and have been debated in the literature,1213141516171819 but to date have not been published in the peer reviewed literature. We report the quality assurance findings of that study.

Methods

Study design and participants

Asymptomatic people attending testing sites in Liverpool between 8 and 29 November 2020 were invited to participate in this prospective quality assurance exercise. Eligible participants were adults (≥18 years) who did not display any of the UK government’s list of symptoms for covid-19 (new continuous cough, high temperature, or loss of, or change in, normal sense of taste or smell). Participants provided verbal consent (recorded) to take part. Recruitment rotated between 48 test sites until the team had either recruited 200 participants at a site, or two days of recruitment at that site had elapsed without the target being reached. Reasons for not being invited to participate were age younger than 18 years old or the volume of people at a test centre prohibited this additional recruitment step. Otherwise all individuals consecutively attending the relevant test centres were invited to participate.

Sample size was predefined by NHS Test and Trace service at 200 in each testing site and not based on statistical calculations from the evaluation team. This balance was pragmatic to account for potential variability across sites (eg, differences in personal and socioeconomic characteristics). Similar numbers of participants (n=200) were recruited in each site. Assuming about a 1% prevalence for covid-19, the sample size was anticipated to provide on average one or two positive test results in each test site. Participants received both an Innova LFT and an RT-qPCR test to be self-administered swabs (combined throat and nose) under supervision and taken at the same appointment within minutes. The LFT test was always taken first and graded within 30 minutes. Trained observers monitored this process to ensure that the manufacturer’s instructions were followed. The site team analysed the LFT directly according to the Department of Health and Social Care standard protocol, with the result confirmed by the quality assurance team. The team were members of the armed forces who were provided with a set of standard operating instructions, detailing how to process the swab sample and how to interpret the results. The same version of the Innova LFT (product code BT1309) was used for the city-wide testing pilot. The second swab was sent for RT-qPCR analysis at one of the Lighthouse laboratories using its standard RT-qPCR SARS-CoV-2 assay (TaqPath; ThermoFisher Scientific). Neither test result was graded with knowledge of the other test result. The results were sent from NHS Test and Trace to Liverpool’s integrated health and social care and public health data system (www.cipha.nhs.uk) and analysed by an independent team at the University of Liverpool. The supplementary file provides further information on the quality assurance protocol developed by the Department of Health and Social Care.

Ct values and connection with viral load

Ct is defined as the number of cycles required for the sample fluorescence in the laboratory to exceed a chosen threshold for positivity. Ct values provide an indication of the concentration of viral RNA in a sample tested by the RT-qPCR method, such that low Ct values tend to be linked to high viral loads and, conversely, high Ct values tend to be linked to low viral loads. Lack of standardisation of Ct values across different laboratories and equipment makes it challenging to compare Ct values between studies using difference laboratories. The RT-qPCR test used here corresponds to the standard test used in UK Lighthouse laboratories studies, and we have used the same Ct thresholds to calculate sensitivity of LFT compared with RT-qPCR to allow easy comparison.8 Our study protocol had no prespecified Ct cut-offs. Ct values were converted into approximate viral loads using the calibration curve performed for the Glasgow laboratory (log10(viral load)=12−0.328×Ct), since it is understood to be generalisable to other Lighthouse laboratories using similar methods.8

Statistical analysis

We used the Clopper-Pearson exact method to estimate the sensitivity, specificity, positive predictive value, and negative predictive values along with corresponding 95% confidence intervals. For the purposes of this analysis, we regarded RT-qPCR as the reference standard, although we acknowledge that viral shedding (reflected by LFT) and viral loads (reflected by RT-qPCR Ct) are temporally aligned processes. Estimates of sensitivity were provided for each Ct interval, which we calculated as the combined average of existing genes (such that if a particular gene had a missing value, the average was calculated over the remaining Ct scores). Void results were not included in calculation of accuracy variables for the main analysis. However, for completeness, we also assessed accuracy taking into account void results (for either test) by grouping them with the negative results.20 A voided RT-qPCR test is one that is either operationally non-analysable (eg, insufficient sample for analysis) or has an analytically inconclusive fluorescence amplification curve. In some of these cases amplification might have been observed for one of the target genes, but this was determined to be based on either background signal or sample contamination. A voided LFT test result is one where the control line fails to appear within 30 minutes. Estimates of sensitivity were also generated based on the N gene (the nucleocapsid antigen that LFT is designed to detect) as well as based on the S (spike protein) gene and ORF1ab (open reading frame 1ab) for completeness.

When multiple LFT and RT-qPCR tests were identified from the same participant, we included only one pair of test results in the main analysis following predefined selection criteria (see supplementary file). Sensitivity analyses were performed to consider scenarios where agreement between LFT and RT-qPCR results was maximised and minimised based on the results from multiple tests for each individual. An additional analysis including all multiple tests (assuming independence) was also conducted. Statistical analyses were carried out in R (version 3.6.1 or later) and checked by a second statistician using SAS software (version 9.4).

Patient and public involvement

This study uses data from Liverpool’s integrated health and social care and public health data system, and it is an urgent public health research study in response to a public health emergency of international concern. Patients and the public were not involved in the design, conduct, or reporting of the study.

Results

Personal characteristics of the participants were not collected as part of this quality assurance study. It was, however, possible to use the Combined Intelligence for Population Health Action platform to access results for all but 116 of the LFT tests conducted in the study to extract basic personal information. The mean age of the participants was 50 years (SD 18 years), 54% were women, and most were of white ethnicity (82%). Supplementary table S4 and figures S1-S4 provide additional information on the characteristics of the study cohort, flowchart, distribution of the number of tests by test centre, and test results over time. Personal characteristics were similar between the study participants and those who attended the test centres on the same day as the study team (supplementary table S5).

Forty participants had taken part in the study on more than one occasion—30 had the same LFT and RT-qPCR paired results and 10 showed inconsistent results for LFT or RT-qPCR, or both (see supplementary file).

Overall, 5869 asymptomatic adults from 48 testing sites in Liverpool participated in this study. Table 1 shows the results for pairs of LFT and RT-qPCR tests for each participant. After excluding void test results, the sensitivity was found to be 40.0% (95% confidence interval 28.5% to 52.4%; 28/70), specificity 99.9% (99.8% to 99.99%; 5431/5434), positive predictive value 90.3% (74.2% to 98.0%; 28/31), and negative predictive value 99.2% (99.0% to 99.4%; 5431/5473). Positive and negative predictive values were directly estimated from the data, which showed a 1.3% prevalence; the Office for National Statistics reported a prevalence of 2.3% for West Lancashire, Liverpool, Knowsley, and Sefton on 20 November.21 The lower percentage of positive test results in the current study reflects that all testing was conducted in people without covid-19 symptoms.

Table 1

Results of rapid lateral flow test (LFT) and quantitative reverse-transcriptase polymerase chain reaction (RT-qPCR) tests in quality assurance dataset (5869 participants)

View this table:

When the void results for either test were grouped with the negative results, a sensitivity was observed for LFT of 37.8% (26.8% to 49.9%; 28/74), specificity of 99.6% (99.4% to 99.8%; 5431/5452), positive predictive value of 84.8% (68.1% to 94.9%; 28/33), and negative predictive value of 93.4% (92.7% to 94.0%; 5431/5814). Including void results in this way provides a more conservative estimate of sensitivity, given that void LFT results linked to a positive PCR result are assumed to be negative.20

Figure 1 and table 2 present the results for sensitivity of the LFT against RT-qPCR by viral load. In the context of a positive RT-qPCR test result with high viral load (>106 RNA copies/mL) the LFT was able to detect 90.9% (58.7% to 99.8%; 10/11) of cases. The LFT detection rate of participants with a positive RT-qPCR result decreased substantially as viral load decreased. For example, for those with a viral load <104 RNA copies/mL the sensitivity was only 9.7% (1.9% to 23.7%; 3/34). Figure 2 shows LFT sensitivity against mean Ct value.

Fig 1
Fig 1

Number of participants with negative and positive lateral flow test (LFT) results by quantitative reverse-transcriptase polymerase chain reaction (RT-qPCR) viral load (based on mean cycle threshold (Ct) score across three gene targets). Intervals show the 95% confidence interval for the cumulative sensitivity to detect viral loads >1, >102, >104, and >106 RNA copies/mL

Table 2

Results of rapid lateral flow test (LFT) with a breakdown by cycle threshold (Ct) value

View this table:
Fig 2
Fig 2

Cumulative sensitivity of Innova lateral flow test (LFT) against quantitative reverse-transcriptase polymerase chain reaction (RT-qPCR) cycle threshold (Ct). Dashed orange lines show approximate viral loads (RNA copies/mL)

The LFT results assessed on site showed a high level of concordance (99.9%) with the quality assurance team’s readings, with 5845 concordant and two discordant samples (99.9% concordance, excluding voids, almost identical if voids are included; see supplementary table S2). Interobserver agreement did not differ noticeably across test sites.

Two additional analyses based on agreement or disagreement between LFT and RT-qPCR test results for those participants with multiple tests showed that the selection criteria followed had a minor effect on the accuracy variables (see supplementary table S3). Results remained similar when multiple tests were included (ie, treating multiple pairs of tests for the same individuals as if they were independent observations; supplementary table S4).

Discussion

We report a city-scale evaluation of Innova LFT versus RT-qPCR test results among the general population attending asymptomatic testing centres voluntarily in Liverpool between 8 and 29 November 2020. Participants declared that they did not have classic symptoms of covid-19 and we have drawn no conclusions about those who may have been (pre-; pauci-) symptomatic. The sample was representative of those attending asymptomatic testing centres concurrently (supplementary table S5). Contrasts with the wider population have been described elsewhere.22

The overall sensitivity of the Innova LFT was 40%—a potentially misleading statistic if RT-qPCR detects a large proportion of people post-infection.18 RT-qPCR is exquisitely sensitive for detecting SARS-CoV-2 RNA in those with replicating virus or those whose immune systems have controlled the infection and are less likely to be infectious. So a substantial proportion (depending on the epidemic phase) of people with a positive RT-qPCR test result will no longer be infectious.57 In our study, LFT achieved 90% sensitivity compared with people found to be positive by RT-qPCR testing with a high viral load >106 RNA copies/mL, and the corresponding 95% confidence interval indicated that LFT is likely to detect at least three fifths and at most 998 in every 1000 people with a positive RT-qPCR test result with high viral load. For comparison, LFT achieved a sensitivity of 72.4% (52.8% to 87.3%) in those with an approximate viral load >105 RNA copies/mL.

Comparison with other studies

Other rapid antigen tests have been assessed for their ability to detect people with confirmed covid-19 by RT-qPCR testing, reporting broadly similar sensitivity and specificity in asymptomatic people as we report for the Innova LFT in the Liverpool pilot.232425 All three studies also report similar ability to detect lower Ct values with higher sensitivity. Although our study involved mainly white British people, comparable results have been recorded in other countries and ethnic groups.2627

The association between covid-19 viral load and infectiousness has not yet been fully characterised.828 Analysis of NHS Test and Trace contact data suggests that a lower Ct in the index case (ie, higher viral load) increases the likelihood of contacts testing positive for covid-19.8 This study traced 64% of all contacts and observed that 13% of case-contact pairs with a contact who tested positive by RT-qPCR had case viral loads <104 RNA copies/mL, 40% of case-contact pairs had case viral loads between 104 and 106 RNA copies/mL, and around 47% of case-contact pairs with contacts who tested positive by RT-qPCR- had case viral loads >106 RNA copies/mL. A recent Spanish contact tracing study28 identified that more than 85% of transmission events occurred in clusters linked to an index case with a viral load of >105 RNA copies/mL. These studies indicate that LFT can identify most of the those with a higher chance of infecting others, but they also show that transmission of covid-19 can occur in those with low viral load. It is nevertheless possible that some of these instances of transmission were confounded by third party transmission, or that the transmission occurred when the individual’s viral load was much higher. However, the evidence gathered to date suggest that people with a low viral load (about ≤105 RNA copies/mL) could still be infectious, although the chance of infecting others is lower than for those with a higher viral load. Although our study, conducted in an asymptomatic population, shows that LFT can detect most people with a high viral load, and therefore those at a higher risk of transmitting SARS-CoV-2, the LFT missed 10% of people with a high viral load >106 RNA copies/mL, 30% of cases with a viral load >104 RNA copies/mL, and most of the cases with a viral load <104 RNA copies/mL who might have contributed to virus transmission.8 This suggests that care is needed when conveying negative LFT results so as not to give false reassurance.15 Both of these contact tracing studies were in people with symptoms, who generally had higher viral loads than observed in our study. Contact tracing studies are currently the best instruments we have of transmission in whole populations. However, contact tracing systems evolve over time, and selection biases might be present related both to the recall of the original case and to the response of the contacts. In addition, these studies provide a snapshot of people at the point of PCR testing, so do not necessarily reflect the interaction between people or the progression of the virus in people before being tested. For these reasons caution is needed in using contact tracing studies to infer the proportion of infectious people detected by LFT.

Limitations of this study

A technical limitation is that RT-qPCR targeting the N gene might detect fragments of RNA and hence could overestimate the number of viral copies in a sample. The ORF1ab gene is only detected on viral genomic RNA and might be a better estimate of the actual number of genome copies per millilitre.29 In our study we found an insubstantial reduction in sensitivity for detecting high viral loads when only the ORF1ab cycle thresholds were considered (table 2).

Although RT-qPCR tests can detect small amounts of RNA, sensitivity can be affected by swabbing technique and by substantial and largely unexplained heterogeneity between studies in sensitivity to detect SARS-Cov-2 positivity in people who might have tested positive with a different swab sample. A recent systematic review identified 34 studies with RT-qPCR false negative rates (1−negative predictive value) ranging from 2% to 58%.30 The sensitivity of the LFT is also substantially affected by the quality of the sample and swabbing technique.23132 The LFT was always done first. In theory this could have depleted the source material and hence virus nucleic acid available for the subsequent swab for RT-qPCR testing, although it is also possible that the second swab benefited from a training effect. In addition, variation in LFT device build quality, lack of quality assurance certification by batch of test, and storage temperatures are additional sources of heterogeneity that are poorly recorded.10 The instructions for use of the LFT state that the tests should be stored between 2°C and 30°C and used at room temperature of between 15°C and 30°C. Given the relatively mild autumn temperatures in the UK, ambient storage conditions should have remained within these ranges and therefore we do not anticipate this had an impact on the performance of the LFTs.

Conclusions

Our study suggests that the LFT can be a useful tool among wider public health measures for the control of SARS-CoV-2 transmission and to mitigate risk of covid-19. The predictive value of testing, and in particular of LFT, varies with the phase of the epidemic curve and the population prevalence of infection,33 which was declining at the time of this quality assurance study in Liverpool.18 Our study also shows that about one 10th of the people with higher viral load (>106 RNA copies/mL) detected by RT-qPCR are missed, which highlights the need to assess the impact that false negative test results might have in specific contexts. Some false negative LFT results occur at a time when an individual’s viral load is declining, and therefore they might no longer be highly infectious. A proportion of false negative LFT results are expected to correspond to the early phase of the infectious trajectory, when viral load might increase in the next 48 hours. For such individuals, serial testing could improve sensitivity, and optimal testing regimens need further study. Although false negative results might reflect those who are no longer infectious, there is a risk of false reassurance leading to behaviours that increase transmission. Careful communication is needed around all negative test results, and symptomatic people should continue to be encouraged to attend for PCR testing, allowing LFT to be seen to be an early screening for the most infectious cases.

The Innova LFT seems, in combination with other health protection measures, to be a valuable tool in wider public health responses to covid-19 for identifying those with higher viral loads who are more likely to be infectious but do not report classic symptoms. To maximise the value of LFT, care should be taken to train test operatives, communicate the meaning of results to tested people, target testing with reference to background case rates, and avoid single LFT results for access to vulnerable settings (such as care homes) where the consequences of infection are severe (unless comprehensive additional risk reduction measures are considered). Further studies are needed to understand the relation between LFT results and infectiousness.

What is already known on this topic

  • The Innova SARS-CoV-2 antigen rapid lateral flow test (LFT) was adopted for large scale UK pilots of community testing in response to covid-19, including open access testing for asymptomatic residents of Liverpool, UK

  • Although the evaluation of the test’s accuracy in people with symptoms is well documented, limited data are available for its use in asymptomatic people

What this study adds

  • Innova LFT results were positive for most people with high viral load (likely to be infectious) who tested positive using reverse-transcriptase polymerase chain reaction (RT-qPCR), whereas results were negative for most people with viral load <104 RNA copies/mL (expected to be less infectious)

  • Policy makers need to consider LFT utility in context sensitive ways, regarding population levels of infection, phases of epidemic curves, and the transmission risks and consequences in specific settings

Ethics statements

Ethical approval

Ethical approval: The University of Liverpool provided secondary data analysis as part of a UK national service evaluation with data collected by the Department of Health and Social Care (DHSC; sponsor) for quality assurance of Innova lateral flow tests in a public health service intervention. As per the National Health Service Health Research Authority guidelines, this work did not require ethical approval. This work forms part of a quality audit of a testing service and device. Participants only received the results of the LFT as the standard of testing of the Liverpool pilot of asymptomatic community testing, and participation in this quality assurance evaluation did not impact their onward treatment. No randomisation was performed. The quality assurance exercise does, however, form part of the clinical standard operating procedures signed off as part of NHS Test and Trace mass testing roll-out by the DHSC Public Health and Clinical Oversight team.

Data availability statement

Data sharing: Data are accessible through Combined Intelligence for Population Health Action. Requests can be made to the data access committee for extracts of the larger scale data, which cannot be released openly owing to information governance requirements. All R code is accessible from the corresponding author.

Acknowledgments

We thank the Combined Intelligence for Population Health Action analytics team, in particular Sarah Adams and Helen Duckworth.

Footnotes

  • Contributors: MGF and DMH contributed equally to this work as joint first authors. IB and MGS contributed equally to this work as joint last authors. IB, MGS, and MS designed the study and contributed to the protocol. TF and MS were responsible for the rollout and quality assurance data collection. MS, DMH, CPC, and GB managed the data. DMH conducted the initial analysis and CPC and GB conducted independent analyses in R and SAS, under supervision of MGF. MGF, DMH, and IB drafted the initial manuscript. VGF, MHW, IB, and MGS provided clinical interpretation and all authors contributed to the revision of the manuscript. IB is the guarantor. The corresponding author attests that all listed authors meet authorship criteria and that no others meeting the criteria have been omitted.

  • Funding: MGF acknowledges the support of the UK Engineering and Physical Sciences Research Council (grant EP/N014499/1). DMH acknowledges the support of a Medical Research Council UK innovation fellowship (research project MR/R024847/1). MHW is supported by the National Institute for Health Research infrastructure at Leeds. This report is independent research funded by the Department of Health and Social Care (DHSC). The views expressed in this publication are those of the authors and not necessarily those of the National Health Service or the DHSC.

  • Competing interests: All authors have completed the ICMJE uniform disclosure form at www.icmje.org/coi_disclosure.pdf and declare: MGF reports grants from the Engineering and Physical Sciences Research Council; DMH reports grants from the Medical Research Council (MRC); IB reports grants from the National Institute for Health Research (NIHR), during the conduct of the study; personal fees and other from AstraZeneca, personal fees from Microsoft Research, outside the submitted work; MGS reports grants from the Department of Health and Social Care (DHSC) NIHR UK, grants from MRC UK, grants from NIHR Health Protection Research Unit in Emerging and Zoonotic Infections, University of Liverpool, during the conduct of the study, and a minority shareholder in Integrum Scientific, Greensboro, NC, USA, a company that has interests in covid-19 testing but not with lateral flow technology, outside the submitted work; IEB, MGF, MGS, DMH, GB, and CPC received grant funding from the DHSC to evaluate LFT in the Liverpool pilot discussed in this article; MHW reports grants for the NIHR, during the conduct of the study. VGF, MS, and TF are employed by the DHSC who commissioned and designed the study. The views expressed in this publication are those of the authors and not necessarily those of the National Health Service or the DHSC.

  • The lead authors (MGF, IB) affirm that the manuscript is an honest, accurate, and transparent account of the study being reported; that no important aspects of the study have been omitted; and that any discrepancies from the study as planned (and, if relevant, registered) have been explained.

  • Dissemination to participants and related patient and public communities: This topic has garnered interest from academia, policy makers, social commentators, and many parts of the media. We will disseminate using traditional academic publications such as this, push to traditional press through our media offices and with support of the Science Media Centre, and disseminate on contemporary social media platforms.

  • Provenance and peer review: Not commissioned; externally peer reviewed.

http://creativecommons.org/licenses/by-nc/4.0/

This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

References