Biochemical profiling provides a low-cost and globally accessible method to detect falsified vaccines and insulin

biochemical-profiling-provides-a-low-cost-and-globally-accessible-method-to-detect-falsified-vaccines-and-insulin
Biochemical profiling provides a low-cost and globally accessible method to detect falsified vaccines and insulin

Abstract

For many decades, there have been numerous reported cases of falsified liquid medical products, including vaccine and insulin preparations worldwide, but to date, there has been a lack of affordable and accessible analytical methods for biological medicines and vaccine authenticity testing. A conventional clinical chemistry analyser (Abbott Architect c16000) was used to determine the concentrations of analytes in genuine liquid biological products (vaccines and insulin) and falsified vaccine surrogates. Eight analytes were measured for each sample: sodium, potassium, chloride, calcium, magnesium, phosphate, glucose and protein. Each genuine liquid product had unique concentrations of analytes when tested using the eight methods applied, allowing clear differentiation from the falsified surrogates. In a blinded study, reproducibility was significantly high when the samples were run intra- and inter-batch up to 9 times over 9 different days, and it was possible to identify most of the samples by analyte presence alone. Imprecision was < 1.0 CV% for ion-selective electrode methods and typically < 5 CV% for spectrophotometric methods. A decision tree was created which was able to identify all samples. We demonstrate for the first time that a conventional clinical chemistry analyser provides a low-cost method to accurately differentiate genuine products from falsified surrogate liquid medicines and vaccines. This novel method has the potential to be used globally due to widespread use of clinical chemistry analysers in hospitals across the world, including in low- and middle-income countries where many cases of falsified medicines have been identified.

Introduction

One in ten medical products in low- and middle-income countries (LMICs) are estimated to be either substandard or falsified1. Substandard products are those which, although authorised, fail to meet either their quality standards or specifications, or both. In contrast, falsified products are those with a composition or source that is deliberately and/or fraudulently misrepresented through criminal activities1. Such substandard and falsified (SF) medical products pose significant, but neglected, health threats as the disease or condition will not be effectively prevented or managed, and/or the product may cause adverse health effects without a quality assurance system implemented2. This may lead to ineffective treatment, toxicity, and harm to patients, their communities, governments and the pharmaceutical industry. They also risk reduced public confidence, reducing trust in genuine products3.

A range of reference analytical techniques can be applied to assess the quality of medicines and thereby the detection of falsified and substandard products. These include optical microscopy, X-ray fluorescence, infrared spectroscopy, Raman spectroscopy, gas chromatography and mass spectrometry4,5,6. One of the challenges of applying these techniques in practice is access to the costly instrumentation and analytical expertise required for their operation in geographically remote or rural areas, especially in LMICs where the SF medicines and vaccines are more often found. There has been increased interest in accessible screening devices to detect SF vaccines and liquid medicines (such as insulin and cough medicines) in supply chains7 to rapidly detect them and improve selection of samples for reference pharmacopeial testing. The Vaccine Identity Evaluation Consortium has been evaluating novel techniques for detecting SF vaccines in supply chains, including spatially offset Raman spectroscopy (SORS)8, rapid diagnostic tests9, and matrix-assisted laser desorption ionization time-of-flight mass spectrometry (MALDI-ToF MS), which is available in many hospitals10,11. Here we introduce an inexpensive alternative technique which could be used globally for the detection of falsified vaccines and liquid medicines.

The chemical composition of vaccines and many pharmaceutical solutions includes the active vector/ingredient, and buffering and stabilising excipients, all of which, in genuine materials, are of highly purified grade and at precise concentrations. For any individual liquid biological product, it should therefore be possible to detect and measure inorganic ions, protein(s) and lipid components that are specific for a particular product. Many of these components can be detected and their concentrations measured with methods that are routinely available on clinical laboratory analysers used in hospitals and clinical laboratories worldwide. Whilst these clinical analyser methods may not individually have the analytical sensitivity or specificity of instrumentation used in the reference pharmaceutical analysis setting, we hypothesised that they may allow a multianalyte approach to detect falsified materials using an analyte concentration pattern recognition approach. Importantly, this approach would be greatly facilitated by clinical analysers being widely available and found in most hospitals worldwide, including in LMICs where there have been most cases of falsified medicines.

In this proof-of-concept study, our aim was to test whether repurposing of a clinical chemistry analyser, a low-cost technique available in many hospitals around the world, could be used to differentiate genuine vaccines and liquid medicines from falsified versions by using liquid surrogates which have previously been found or are likely to be found in falsified products. We provide evidence that this approach is accurate and has the potential to be deployed for the detection of falsified vaccines and insulin in risk-based supply chain surveillance.

Results

The biochemical profiling method used to differentiate genuine vaccines and insulin from falsified surrogates was evaluated in four stages (Fig. 1).

Fig. 1
figure 1

The four stages used in this study to evaluate the biochemical profiling method to differentiate genuine vaccines and insulin from falsified surrogates.

Full size image

Stage 1: testing the method using samples of known identity

Genuine vaccines, insulin and falsified vaccine surrogates were initially run on the clinical chemistry analyser to test if the method could establish a unique analyte concentration pattern for each sample. The responses of the eight methods observed in the test solutions are presented in Table S1 and the mean concentrations are shown in Table 3. Each sample had a unique panel of responses relative to the eight methods applied with respect to being, or not being, detected and quantified. When detected and quantified, the results were within the working range except for the glucose concentration of 5% glucose, which was above the upper limit of linearity. Importantly, when the response was within the working analytical concentration, good reproducibility was noted for all samples tested (Table 1). Reproducibility was lowest for the ion-selective electrode methods (sodium, potassium and chloride), with 16 of the 18 precision measurements being below 2.0 CV% across the concentration ranges in the materials tested. The spectrophotometric methods had slightly higher reproducibility with 10 of 11 precision measurements being < 5.0 CV%, with one outlier, for protein measurement of Novorapid, at 28 CV%.

Table 1 Biochemical methods used with their analytical characteristics and imprecision (expressed as CV%). For the instrument reporting range, the lowest value is based on the limit of quantitation and the highest value is based on the upper limit of linearity.

Full size table

Table 3 Analyte profiles of the test materials analysed intra-batch in stages 1 and 2 for eight test parameters using a clinical chemistry analyser. Values in bold indicate if the analytes could be detected and quantified showing their mean concentration followed by standard deviation in parentheses except for glucose which had a glucose concentration higher than the upper limit of linearity. All other values were below the limit of quantitation (LoQ), and the lower LoQ is shown as in Table 1.

Full size table

Stage 2: blinded study

Genuine vaccines, insulin and falsified vaccine surrogates were provided to the operator of the clinical chemistry analyser in glass vials labelled with a code but without the identity of the samples (Fig. 1). The responses of the eight methods observed for these blinded samples are presented in Table S2 and the mean values are shown in Table 3. The additional vaccines, Engerix B and Pneumovax 23, had unique panels of responses in a similar way to the other vaccines. Samples already analysed in Stage 1 gave similar responses. For most of the initial Engerix B runs, no protein was detected. However, protein was detected with 333 mg/L for the last run of the sample in syringe 1 and 288, 356, 152 mg/L for the last three runs of syringe 2 (Table S2). As in Stage 1, good reproducibility was noted for all materials tested. One-way ANOVA indicated good consistency (p > 0.05) in analyte concentrations between the three different vials, syringes and ampoules for all runs except for amikacin (p < 0.001) where vial 2 showed slightly lower concentrations for sodium and calcium, only 3 and 6% lower, respectively, compared to vials 1 and 3. The analyte concentrations between vials 1 and 3 were very similar (p > 0.05).

Stage 3: analysis of different vaccine batches

Three different batches of COVISHIELD™ vaccine were analysed with the operators blinded as in Stage 2. The responses of the eight methods, along with p-values for one-way ANOVA, are presented in Table S3 and the mean values are shown in Table 4. Similar concentrations were observed for all eight analytes when analysing the vaccine in three different vials of the same batch (4122Z004). All analytes showed good consistency between the three batches (p > 0.05) with the exception of protein (p < 0.001), which was below the limit of quantitation in batch 4122Z005, 79.1 mg/L for batch 4122Z003 and 96.1 mg/L for batch 4122Z004.

Table 4 Inter-batch data for the COVISHIELD™ vaccine in the stage 3 analysis. Analyte profiles are shown for the eight test parameters. Values in bold indicate if the analytes could be detected and quantified showing their mean concentration followed by standard deviation in parentheses. All other values were below the limit of quantitation (LoQ), and the lower LoQ is shown as in table 1. The intra-batch data for COVISHIELD™ is shown in table S3.

Full size table

Stage 4: A decision tree for identification of genuine and falsified products

Results were analysed using recursive partitioning to build a classification model and construct a decision tree12,13. The tree provides a proof-of-concept visual representation of how the different biochemical signatures may be interpreted in a simple binary algorithm to identify the different vaccines (Fig. 2).

Fig. 2
figure 2

Decision tree for identification of an unknown test material to determine identification.

Full size image

Discussion

There is a global and urgent need for accessible screening devices to detect SF liquid medicines in supply chains, with mutliple alerts for falsified vaccines and insulin (Table 2). The composition, concentration and quality of excipients in genuine injectable vaccines and liquid medicines, such as insulin, are tightly controlled in the manufacturing process, which would be much less likely in falsified products. Liquid medicines often have constituents that have physiological relevance and are routinely analysed in blood and/or urine to support clinical patient management. In this study, we have used a clinical chemistry analyser, available in hospital settings worldwide, to provide a profile using simple biochemical methods. While the method cannot confirm or differentiate the components present in each injectable medicine, it can accurately measure the concentrations of eight analytes which serves as a distinctive profile to confirm authenticity. The profile response across eight simple methods with respect to authentic vaccines and insulin differs from those of solutions used in falsified medical products. The responses were reproducible on the same instrument over time (Table 3, S1 and S2). For the ion-selective electrode methods, the imprecision was typically < 2.0 CV%, which was consistent with the imprecision commonly seen when testing clinical specimens. The typical reagent and consumable costs are <£10 for the eight-test profile undertaken here. The concentrations of analytes between different syringes and vials intra-batch were found to be very consistent (Table S2). We do not expect this technique to be accurate in the detection of substandard vaccines and liquid medicines, due to errors in manufacturing, unless gross, in supply chains.

Table 2 The genuine vaccines, insulin and falsified vaccine surrogates tested in this study.

Full size table

The specific analyser on which the tests were determined was an Abbott analyser, and this has enabled demonstration of the proof-of concept of this approach. Equivalent testing for all the methods mentioned are available from a range of manufacturers, which could be utilised in the same manner, and all provide high throughput (hundreds of tests per hour) and use low specimen volumes (typically around 100 µL). It is also of note that some vaccines, such as mRNA vaccines and those with lipid-based adjuvants, contain lipid components which could also be determined. Chemistry analysers can also be set up for methods beyond those provided by the primary instrument provider for the range of analytes described. If a spectrophotometric method can be developed, it could, in principle, be applied to these systems as user-defined methods14 to provide unique profiles for detection of a much wider range of SF products to meet evolving trends in falsification15.

All methods used, with the exception of protein analysis (where a specific urine method was applied), can be utilised in two modes, one optimised for analysing serum specimens and the other optimised for urine specimens. The method differences may utilise different sample volumes, different calibration strategies, and consequently different working ranges applicable to clinical samples. As the analyte matrix of vaccines and medication solutions are generally simple aqueous solutions with low concentrations of protein relative to those in serum, we used the testing mode designed for urine. For most tests this provides a wider working range of concentrations and can be used with matrix-matched calibrators for improved analytical accuracy, for example the methods used in the current study for sodium, potassium and chloride. In general, this extends the upper limit of linearity at the expense of increasing the lower limit of quantitation. This achieved good differentiation of the products profiles, but if the profiling of any suspected material required greater sensitivity, i.e. for detection at lower concentrations, the serum mode of analysis could be utilised.

All the methods utilised were electrochemical or spectrophotometric methods, available on semi-automated or automated chemistry analysers which are on the WHO model list of essential in-vitro diagnostics16. Therefore, testing capability is widespread worldwide including in LMICs where many cases of falsified medicines and vaccines have been identified. Whilst not investigated in this study, many of these experiments could be undertaken using handheld point-of-care devices. This is an additional analytical option that could be explored for application in the field.

For the detection of vaccine excipients, we have recently demonstrated that SORS can be used to generate spectra of sucrose and ethanol8 while MALDI-ToF is suitable for detecting polysorbate 80 and histidine11. While the clinical chemistry analyser cannot detect these excipients, it was able to successfully detect and quantify up to eight different analytes at low cost, which serves as a signature for vaccines and insulin products. We have also shown that low-cost rapid diagnostic tests can detect the active ingredients in vaccines9. While the clinical chemistry analyser could not specifically detect active ingredients in vaccines, it was able to confirm the presence of proteins when present, e.g. successful detection of HBsAg in Engerix B (Table S2). There will be no single device to help screen medicines and vaccines throughout the supply chain and different devices would be required at various stages and locations, also ensuring comprehensive monitoring. In detecting the criminal activity of falsification, diverse technologies will be needed, as in checking for dangerous agents in airline security, to inhibit sophisticated criminals countering these systems. Clinical chemistry analysers, SORS and MALDI-ToF MS could help to screen liquid medicines in proximal locations of the supply chain whereas SORS and rapid diagnostic tests could help in provincial and distal locations, thereby enabling end-to-end vaccine supply chain monitoring. This highlights the complementarity of the clinical chemistry analyser and these other three approaches.

A decision tree was created which could be used to successfully determine not only the identity of the genuine liquid product but also could help to determine the falsified sample. By analysing which analytes were observed for each sample, it was possible to identify most of them even without prior knowledge of the excipient concentrations. The mean concentrations for the blinded samples in Stage 2 was used to correctly identify all of the samples with information only on the excipients and not their concentrations, except for Nimenrix and Pneumovax 23 which had the same analytes present. However, these vaccines could be successfully differentiated by taking into consideration the analyte concentrations determined for Nimenrix in the Stage 1 analysis. The application of a decision tree in this study allowed a simple visual flowchart for the identification of the different samples. However, further development would be required to implement the analysis in a real-world setting, due to the risks of false negatives/positives from samples outside of the sample set included in this study. Equally, alternative predictive modelling tools would need to be explored with larger datasets and additional types of vaccines and vaccine surrogates. For example, a chemometric approach such as Principal Component Regression (PCR) and Partial Least Squares Regression (PLS) can help to automate sample classification in developed countries with well-equipped clinical settings. In LMIC settings, a simple “cue card” verification-focused approach could be used where a cue card/checklist acts as a reference with the expected analyte concentrations for each known biologic/vaccine, and further evaluation undertaken if it did not demonstrate expected results.

All surrogates of falsified liquid medicines were successfully identified from the blinded data in Stage 2. As expected, the ultrapure water samples (Milli-Q water and water for injection), had no analytes present. Tap water did not have any of the measured analytes present except for calcium which was expected since it is known to be the mineral at the highest concentration17. The water dispensed from the tap in Stages 1 and 2 were collected on different days and the analyser was able to detect minor differences between these different dispenses (2.51 mmol/L calcium in Stage 1 and 2.07 mmol/L in Stage 2). The 5% glucose sample was the only sample which had glucose and at a high level above the upper limit of linearity (> 222 mmol/L). This was expected since the 5% glucose sample is expected to be 278 mmol/L. Saline is sodium chloride in water and therefore was easily identified since there was only one sample where sodium and chloride ions were present, at the same concentration and was close to the expected concentration of 154 mmol/L for both ions. The antibiotics, amikacin and gentamicin, contain sodium metabisulfite and sodium citrate dihydrate and were the only samples which contained sodium ions but lacked other ions such as chloride, potassium and phosphate. Amikacin from two different manufacturers were tested and while both showed the presence of sodium ions, only one additionally showed a very low concentration of calcium in the same way as gentamicin.

Insulin samples were also tested in Stages 1 and 2. Insulatard contains disodium phosphate dihydrate and could be easily identified since it was the only sample with sodium and phosphate and no other ions. In both Stage 1 and 2, no protein was identified for Insulatard, even though it is known to contain a high concentration of insulin (3.5 mg/mL). However, 945 mg/L of protein was detected for Novorapid, another insulin product also known to contain 3.5 mg/mL of insulin. Differences in the actual amount of protein in the sample and measured values are expected since the analyser method has been optimised to be used for urine samples and not insulin or vaccines where the sample matrix is considerably different and could interfere with the assay. These differences are not a problem since the pattern of analyte concentrations are reproducible and could be used to confirm authenticity. The imprecision measurements when analysing Novorapid, being 28 CV%, were atypical of performance in routine clinical practice when testing human urine and this may suggest that characteristics of the sample may contribute to variability and therefore requires further investigation.

For the Stage 2 analysis, the Oxford COVID-19 ChAdOx1-S could be identified simply by analyte presence without analysing their concentrations. This vaccine is known to contain magnesium ions (magnesium chloride) and as expected was the only sample in Stage 2 where magnesium was identified. Sodium and chloride ions were also identified in this sample which was expected since the vaccine also contained sodium chloride and edetate disodium. Pfizer BioNTech COVID-19 vaccine contains potassium chloride, monobasic potassium phosphate, sodium chloride and dibasic sodium phosphate dihydrate. The sodium and chloride ions were detected but not potassium or phosphate ions due to low concentrations below the analyser’s lower limit of quantitation. This vaccine is known to not contain any protein, but the analyser estimated the protein concentration in the vaccine to be 132 mg/L. The analyser’s method for protein uses benzethonium chloride to denature proteins which are then detected by turbidimetry. However, benzethonium chloride is a cationic surfactant which may have interacted with the lipids and disrupted the lipid nanoparticles in the mRNA vaccine. This false positive for protein is therefore expected and would not be a problem with the analyser’s intended and optimised use of analysing urine samples. Also, this false positive is not a problem for confirming the authenticity of this mRNA vaccine since the pattern of analyte concentrations, including the false positive for protein, was reproducible. Alternative urine protein methods are dye based, rather than turbidimetric, and may offer additional flexibility within a test profile to detect falsified vaccines. These alternative protein methods may provide greater reproducibility within the context of the current application.

Some of the blinded non-COVID-19 vaccine samples in Stage 2 were identified simply by noting which analytes were present without the need to analyse the analyte concentrations. Quadrivalent influenza vaccine contains inactivated influenza virus, sodium chloride, potassium chloride, disodium phosphate dihydrate and potassium dihydrogen phosphate. As expected, protein, sodium, potassium, chloride and phosphate were identified and, since this was the only sample in which potassium was detected, it could be easily identified among both other vaccines and falsified surrogates. Engerix B contains sodium chloride, disodium phosphate dihydrate and sodium dihydrogen phosphate. As expected, the ions observed were sodium, chloride and phosphate which were only observed for this sample making it easy to identify among the other blinded samples. Engerix B contains 20 µg/mL hepatitis B surface antigen (HBsAg). This concentration of HBsAg is below the analyser’s lower limit of quantitation for protein (68 µg/mL) and therefore as expected no protein was observed for most of the runs. However, protein was detected in the last 1–3 runs for the vaccines from two syringes with high, and variable, concentrations ranging from 152 to 356 µg/mL (Table S2). HBsAg is adsorbed onto aluminium hydroxide which settles to the bottom of the syringe by gravity if the syringe is left undisturbed. This explains why protein was only detected in the last few runs since the HBsAg adsorbed onto aluminium hydroxide would have settled to the bottom of the tube in the analyser resulting in concentrations above the 20 µg/mL for HBsAg.

Nimenrix and Pneumovax 23 are both sodium chloride-containing vaccines, and the presence of sodium, chloride and protein were detected in both. Although these vaccines had the same analytes, they could be easily differentiated since Nimenrix is lyophilised and requires reconstitution in saline whereas Pneumovax 23 is a ready to use liquid vaccine. However, if two liquid vaccines had the same ions in this way, it would be difficult to confirm their identity unless there was prior knowledge of the concentrations of these analytes. By referencing the analyte concentrations determined for Nimenrix in the Stage 1 study, it was possible to correctly identify this vaccine in the Stage 2 blinded study (Table 3). Liquid vaccines are made up precisely by the vaccine manufacturer but in the case of dried vaccines, such as Nimenrix, there is the possibility of minor variation since the final concentration of analytes may vary to a small degree if a slightly different volume of saline is added by the end user when reconstituting. However, three different vials of Nimenrix were analysed and each vial was made up separately with the provided saline syringe. Despite being made up separately with saline, the concentrations of both sodium and chloride were very consistent among vials (p > 0.05; see Table S2). Although the average difference in sodium and chloride ions between these vaccines was only 15.6 and 19.4 mmol/L, respectively, an independent two-sample t-test comparing Nimenrix and Pneumovax showed p < 0.05 for both sodium (p = 2.07 × 10⁻¹⁷) and chloride (p = 1.86 × 10⁻¹⁸) ions confirming that there were significantly different. Analysis of sodium and chloride ions in different batches of Nimenrix and other powdered vaccines requires further investigation.

In the Stage 3 analysis the method was tested on three different vials of the same batch (intra-batch) and three different batches (inter-batch) of the COVISHIELD™ vaccine (Table 4 and Table S3). The intra-batch analysis showed similar concentration for all eight analytes. The panel of responses for COVISHIELD™ were similar to the Oxford COVID-19 ChAdOx1-S vaccine (i.e. with magnesium, sodium and chloride) and overlapped in the decision tree (Fig. 2) which was expected since both are ChAdOx1 vaccines with a similar excipient composition (Table 2). The inter-batch analysis showed good consistency for the concentration of sodium, chloride and magnesium. This confirms excellent batch-to-batch consistency which is expected since vaccine manufacturers tightly control the concentrations of excipients among batches. We also analysed these three batches in previous studies and found them to have very similar spectra by both SORS8 and MALDI-ToF MS11, further supporting the high level of consistency of these batches. Although excipient levels are always made up precisely, the number of viral particles in viral vector vaccines can vary. For example, the Oxford-AstraZeneca COVID-19 ChAdOx1 vaccine must have equal to or more than 0.7 × 1011 viral particles per mL.18 Therefore, the protein levels can differ among different batches, and as expected, we observed different levels of protein in the three different batches of COVISHIELD™ (Table 4; p < 0.001). This inter-batch data highlights that while a clinical chemistry analyser can be used to establish a library of analyte concentrations for each vaccine, care should be taken if proteins are present and their concentrations are known to vary slightly among batches. Although it was possible to identify most of the solutions in this study without prior knowledge of the excipient concentrations, we had only analysed a limited number of vaccines, insulin and falsified surrogates. Nimenrix and Pneumovax 23 are examples of vaccines with similar excipients but not at similar concentrations. There are other liquid medicines with similar excipients but at different concentrations highlighting the importance of establishing the exact concentrations of the analytes for each genuine liquid medicine.

Conclusion

In this study, it was demonstrated that a clinical chemistry analyser, conventionally used in hospitals worldwide, could successfully determine unique analyte concentrations of authentic liquid medical products (vaccines and insulin) and distinguish these from falsified medicine surrogates. Hence, a low-cost assay using a clinical chemistry analyser could be used to detect falsified vaccines and liquid medicines in supply chain surveillance. Although a decision tree was able to successfully identify all the different samples, alternative chemometric approaches need to be investigated especially with larger datasets.

Methods

Instrumentation and method principles

We tested a wide range of genuine vaccines, insulin and surrogate liquids found in falsified vaccines. The clinical laboratory analyser utilised was a commonly available device, the Abbott Architect c16000 analyser (Abbott Laboratories, Maidenhead, UK). Method principles were either spectrophotometric or ion-selective electrodes, developed and optimised by the manufacturer to be used for clinical purposes and had analytical concentration ranges designed to meet the clinical requirements of testing biological specimens. The method optimised for urine specimens was used. Specific performance characteristics for these methods are defined according to standard protocols recommended by the Clinical and Laboratory Standards Institute (CLSI) (prior to 2005 known as the National Committee for Clinical Laboratory Standards (NCCLS)).

Selected analytical characteristics of the eight methods applied in the current study, determined using CLSI protocol NCCLS EP6-P are presented in Table 1. For both spectrophotometric and ion selective electrode methods the lower and upper limits of linearity are defined.

Study approach

Four stages were undertaken to evaluate the detection methodology (Fig. 1). Stage one tested the method by characterising the response of the selected methods for a range of genuine vaccines and materials historically found to be used in falsified vaccines (Table 2). Each material was tested with 4 repeats, except for the Pfizer BioNTech COVID-19 vaccine and Nimenrix for which only 2–3 replicates were possible due to limited sample availability. All samples analysed were liquids except for Nimenrix which is supplied as a dried powder. Nimenrix was reconstituted by adding the entire contents of the supplied pre-filled syringe of solvent (0.5 mL saline) to the vial containing the powder. This mixture was shaken well until the powder was completely dissolved in the solvent. Testing of all samples was conducted over the course of one week to evaluate the method and assess its reproducibility. The mean concentration of each response within the working analytical range of the test was calculated together with the standard deviation (SD). From these a percentage coefficient of variation was calculated (SD/mean*100).

The second stage involved a blinded analysis of the same falsified vaccine surrogates, Insulatard, Nimenrix and two additional vaccines (Engerix B and Pneumovax 23) which were not analysed in Stage 1. These samples were provided to the operator of the clinical chemistry analyser in glass vials labelled with a code but without the identity of the samples (Fig. 1). All samples were blinded for comparison against the responses determined in stage 1. This was a more in-depth study aimed at evaluating vial-to-vial and syringe-to-syringe reproducibility within a batch, using a greater number of replicates. Samples were analysed from three different vials/ampoules/syringes from the same batch of each vaccine and falsified surrogate, except for Insulatard, for which only a single syringe was available. Each of the three vials/syringes were analysed nine times over nine separate days, i.e. a total of 27 runs for each sample, except for Nimenrix and Pneumovax 23 where there was only enough sample for 11 and 14 repeats, respectively. The tap water used in Stage 2 consisted of three fresh dispenses, distinct from the one used in Stage 1. One-way ANOVA was carried out for all analyte concentrations above the limit of quantitation, with p > 0.05 indicating intra-batch consistency and no statistically significant differences.

The third stage involved analysing different batches of a vaccine in a blinded study. For this stage, the COVISHIELD™ vaccine kindly provided by the Serum Institute of India, Pvt. Ltd. was evaluated. In a similar way to Stage 2, vaccines from three different vials from the same batch (4122Z004) were analysed. In addition, one vial from two other batches (4122Z003 and 4122Z005) were analysed (Fig. 1). One-way ANOVA was carried out for all analyte concentrations above the limit of quantitation and p > 0.05 was used to confirm consistency intra- and inter-batch with no statistically significant difference.

Stage four focused on developing a decision tree for application in practice. R version 4.5.0 was used with the package ‘‘rpart’ to perform recursive partitioning to construct the decision tree12.

Data availability

All data generated or analysed during this study are included in this published article and its supplementary information files.

References

  1. World Health Organization. Substandard and falsified medical products – Key facts. (2024). https://www.who.int/news-room/fact-sheets/detail/substandard-and-falsified-medical-products

  2. Newton, P. N. et al. COVID-19 and risks to the supply and quality of tests, drugs, and vaccines. Lancet Glob Health. 8, e754–e755 (2020).

    Article  PubMed  PubMed Central  Google Scholar 

  3. Nahum, A., Drekonja, D. M. & Alpern, J. D. The erosion of public trust and SARS-CoV-2 Vaccines— more action is needed. Open. Forum Infect. Dis. 8, ofaa657 (2021).

    Article  PubMed  PubMed Central  Google Scholar 

  4. Bakker-’t Hart, I. M. E., Ohana, D. & Venhuis, B. J. Current challenges in the detection and analysis of falsified medicines. J. Pharm. Biomed. Anal. 197, 113948 (2021).

    Article  PubMed  Google Scholar 

  5. Kimani, M. M., Smith, S. W., Lanzarotta, A., Brueggemeyer, J. L. & Batson, J. S. Screening suspect pharmaceuticals for illicit designer benzodiazepines using raman, SERS, and FT-IR prior to comprehensive analysis using LC-MS. Forensic Sci. Int. 338, 111390 (2022).

    Article  PubMed  Google Scholar 

  6. Nguyen, L. et al. Genuine and counterfeit prescription pill surveillance in Washington. D C Forensic Sci. Int. 339, 111414 (2022).

    Article  Google Scholar 

  7. Vickers, S. et al. Field detection devices for screening the quality of medicines: a systematic review. BMJ Glob Health. 3, e000725 (2018).

    Article  PubMed  PubMed Central  Google Scholar 

  8. Mosca, S. et al. Innovative method for rapid detection of falsified COVID-19 vaccines through unopened vials using handheld spatially offset Raman spectroscopy (SORS). Vaccine 41, 6960–6968 (2023).

    Article  PubMed  PubMed Central  Google Scholar 

  9. Bharucha, T. et al. Repurposing rapid diagnostic tests to detect falsified vaccines in supply chains. Vaccine 42, 1506–1511 (2024).

    Article  PubMed  PubMed Central  Google Scholar 

  10. Clarke, R. et al. Using matrix assisted laser desorption ionisation mass spectrometry combined with machine learning for vaccine authenticity screening. Npj Vaccines. 9, 155 (2024).

    Article  PubMed  PubMed Central  Google Scholar 

  11. Arman, B. Y. et al. Identifying falsified COVID-19 vaccines by analysing vaccine vial label and excipient profiles using MALDI-ToF mass spectrometry. Npj Vaccines. 10, 19 (2025).

    Article  PubMed  PubMed Central  Google Scholar 

  12. Breiman, L., Friedman, J., Olshen, R. A. & Stone, C. J. Classification and Regression Trees (Chapman and Hall/CRC, 1984).

  13. Therneau, T. M. & Atkinson, E. J. An Introduction To Recursive Partitioning Using the RPART Routines (Divsion of Biostatistics, 1997).

  14. James T. Chapter 2 Automation in N. Ahmed (ed.), Clinical Biochemistry 2nd Edition, Oxford University Press, 33-52 (2017).

  15. Saliou, P., Duteil, Q., Plotkin, S. A. & Gentilini, M. The scourge of vaccine falsification. Vaccine 40, 2126–2128 (2022).

    Article  PubMed  PubMed Central  Google Scholar 

  16. World Health Organization. WHO model list of essential in vitro diagnostics. (2025). https://edl.who-healthtechnologies.org/

  17. Michael, K. G. F. T. & Somani, B. K. Variation in tap water mineral content in the united kingdom: is it relevant for kidney stone disease? J. Clin. Med. 11, 5118 (2022).

    Article  PubMed  PubMed Central  Google Scholar 

  18. Phase, A. Z. A. & Randomized, I. I. I. Double-blind, Placebo-controlled multicenter study in adults to determine the Safety, Efficacy, and immunogenicity of AZD1222, a Non replicating ChAdOx1 vector Vaccine, for the prevention of COVID-19. (2021). https://cdn.clinicaltrials.gov/large-docs/46/NCT04516746/Prot_000.pdf

  19. World Health Organization. Medical Product Alert N°7/2021: Falsified COVID-19 Vaccine AstraZeneca. WHO (2021). https://www.who.int/news/item/04-11-2021-medical-product-alert-n-7-2021-falsified-covid-19-vaccine-astrazeneca

  20. World Health Organization. Medical Product Alert N°6/2021: Falsified Pfizer-BioNTech COVID-19 Vaccine. WHO (2021). https://www.who.int/news/item/04-11-2021-medical-product-alert-n-6-2021-falsified-pfizer-biontech-covid-19-vaccine

  21. World Health Organization. Medical Product Alert N°5/2021: Falsified COVISHIELD vaccine (Update). (2021). https://www.who.int/news/item/31-08-2021-medical-product-alert-n-5-2021-falsified-covishield-vaccine

  22. da Costa, J. A. C. et al. Ensuring vaccine safety: case studies of falsified influenza vaccines detected in Brazil. Vaccine X. 14, 100343 (2023).

    Article  PubMed  PubMed Central  Google Scholar 

  23. World Health Organization. Medical Product Alert N°5/2019: Falsified Meningitis vaccines. (2019). https://www.who.int/news/item/28-01-2020-medical-product-alert-n-5-2019-(english-version)

  24. World Health Organization. Medical Product Alert N°3/2018: Falsified Hepatitis B Vaccines. (2018). https://www.who.int/news/item/23-03-2018-medical-product-alert-n-3-2018–falsified-hepatitis-b-vaccines

  25. NAFDAC. Public Alert No. 02/2025 – Illegal Distribution and Sale of Substandard and Falsified (SF) Knowit Insulin Syringe 40 IU 29 g X 1/2. (2025). https://nafdac.gov.ng/public-alert-no-02-2025-illegal-distribution-and-sale-of-substandard-and-falsified-sf-knowit-insulin-syringe-40-iu-29g-x-1-2/

  26. Medicine Quality Research Group, University of Oxford. Medical Product Quality Report – COVID-19 Issues. Issue 15, January, February & March 2022. (2022). https://www.iddo.org/sites/default/files/publication/2022-09/Medical%20Product%20Quality%20Report_Covid-19_Issue15_January-March2022_V1.1.pdf

Download references

Acknowledgements

We would like to thank Adrian Hill, Andrew Pollard, Islip Surgery, Chris Conlon, Ali Amini, Audrey Dubot-Peres, Raymond A. Dwek, Cathrin Hauk and Kerlijn Van Assche for generous support of this project and expert advice.

Funding

We are grateful to two anonymous donor families and the Oak Foundation who provided dedicated funds to the University of Oxford to support this research of the Vaccine Identity Evaluation Consortium (VIE). The Medical and Life Sciences Translational Fund (MLSTF), from the Translational Research Office of the Medical Sciences Division at the University of Oxford, supported the analysis of the samples on the clinical chemistry analyser. We thank the WHO for their grant support to the STFC Rutherford Appleton Laboratory (Ref. 2021/1170671-0). S.D acknowledges funding from NIHR Global Research Professorship (NIHR300791). M.D, C.C and P.N.N are supported by the Wellcome Trust (222506/Z/21/Z). B.Y.A is funded by the Indonesian Education Scholarship (Beasiswa Pendidikan Indonesia) from the Ministry of Education, Culture, Research, and Technology of the Republic of Indonesia (Kemendikbudristek) within a funding scheme from Indonesia Endowment Fund for Education (LPDP). B.G and L.G.F were partly supported by the Oxford Glycobiology Endowment and B.G. is currently supported by the MLSTF. This work was funded in part, by the Wellcome Trust [220211/Z/20/Z, 222506/Z/21/Z and 202935/Z/16/Z]. For the purpose of Open Access, the author has applied a CC BY public copyright license to any Author Accepted Manuscript version arising from this submission. The funder played no role in the study design, data collection, analysis and interpretation of data, or the writing of this manuscript.

Author information

Author notes

  1. Tehmina Bharucha

    Present address: The Francis Crick Institute, London, NW1 1AT, UK

  2. Tehmina Bharucha

    Present address: Imperial College Healthcare NHS Trust, London, W2 1NY, UK

  3. Tehmina Bharucha

    Present address: Imperial College London, London, SW7 2AZ, UK

  4. Benediktus Yohan Arman

    Present address: Exeins Health Initiative, Jakarta, 12870, Indonesia

  5. These authors contributed equally: Paul N. Newton, Bevin Gangadharan and Tim James.

Authors and Affiliations

  1. Department of Clinical Biochemistry, John Radcliffe Hospital, Oxford University Hospitals NHS Foundation Trust, Oxford, OX3 9DU, UK

    Jennifer Brook & Tim James

  2. Department of Biochemistry, University of Oxford, Oxford, OX1 3QU, UK

    Tehmina Bharucha, Benediktus Yohan Arman, Laura Gomez Fernandez, Nicole Zitzmann & Bevin Gangadharan

  3. Kavli Institute for Nanoscience Discovery, University of Oxford, Oxford, OX1 3QU, UK

    Tehmina Bharucha, Benediktus Yohan Arman, Laura Gomez Fernandez, Nicole Zitzmann & Bevin Gangadharan

  4. Medicine Quality Research Group, NDM Centre for Global Health Research, Nuffield Department of Medicine, University of Oxford, Oxford, OX3 7LG, UK

    Céline Caillet, Michael Deats, Pavel Matousek & Paul N. Newton

  5. Mahidol-Oxford Tropical Medicine Research Unit, Faculty of Tropical Medicine, Mahidol University, Bangkok, 10400, Thailand

    Céline Caillet, Michael Deats, Susanna Dunachie & Paul N. Newton

  6. Infectious Diseases Data Observatory, Centre of Tropical Medicine & Global Health, Nuffield Department of Medicine, University of Oxford, Oxford, OX3 7LG, UK

    Céline Caillet, Michael Deats & Paul N. Newton

  7. Pandemic Sciences Institute, Nuffield Department of Medicine, University of Oxford, Oxford, OX3 7TY, UK

    Susan Morris & Sarah Gilbert

  8. Hospital Pharmacy, Oxford University Hospitals NHS Foundation Trust, Oxford, UK

    Michelle Taylor-Siddons

  9. Department of Chemistry, University of Oxford, Oxford, OX1 3TA, UK

    John Walsby-Tickle, Isabelle Legge & James McCullagh

  10. Central Laser Facility, Research Complex at Harwell, STFC Rutherford Appleton Laboratory, UKRI, Harwell Campus, Didcot, OX11 0QX, UK

    Sneha Banerjee & Pavel Matousek

  11. Serum Institute of India Pvt. Ltd., 212/2, Hadapsar, Pune, 411028, India

    Rajender Jena, Dnyanesh S. Ranade, Shrikrishna R. Chunekar, Kundan D. Patil & Sunil Gairola

  12. Department of Microbiology and Infectious Diseases, Oxford University Hospitals NHS Foundation Trust, Oxford, OX3 9DU, UK

    Susanna Dunachie

  13. NIHR Oxford Biomedical Research Centre, Oxford University Hospitals NHS Foundation Trust, Oxford, OX3 9DU, UK

    Susanna Dunachie

  14. Department of Bioscience, School of Health, Sport and Bioscience, University of East London, Water Lane, London, E15 4LZ, UK

    Hamid A. Merchant

  15. Agilent Technologies LDA UK, Becquerel Avenue, Didcot, OX11 0RA, UK

    Robert Stokes

  16. Regulation and Safety Unit, Regulation and Prequalification Department, Health Systems, Access and Data Division, World Health Organization (WHO), Geneva, Switzerland

    Rutendo Kuwana & Alexandrine Maes

Authors

  1. Jennifer Brook
  2. Tehmina Bharucha
  3. Benediktus Yohan Arman
  4. Céline Caillet
  5. Susan Morris
  6. Michelle Taylor-Siddons
  7. Laura Gomez Fernandez
  8. John Walsby-Tickle
  9. Isabelle Legge
  10. Sneha Banerjee
  11. Michael Deats
  12. Rajender Jena
  13. Dnyanesh S. Ranade
  14. Shrikrishna R. Chunekar
  15. Kundan D. Patil
  16. Sunil Gairola
  17. Susanna Dunachie
  18. Hamid A. Merchant
  19. Robert Stokes
  20. Rutendo Kuwana
  21. Alexandrine Maes
  22. Sarah Gilbert
  23. James McCullagh
  24. Pavel Matousek
  25. Nicole Zitzmann
  26. Paul N. Newton
  27. Bevin Gangadharan
  28. Tim James

Contributions

T.J, B.G, P.N.N, N.Z and T.B designed the study. J.B, T.B, T.J and B.G performed the experiments and/or data analysis. T.J, B.G and P.N.N prepared the original draft. All authors contributed to the writing, reviewing, and editing the manuscript. P.N.N, N.Z, J.M and P.M were involved in funding acquisition. T.J, B.G, P.N.N, N.Z, C.C, J.M and P.M were involved in project management. S.M, M.T-S, R.J, D.S.R, S.R.C, K.D.P, S.G, R.K, A.M and S.G. provided vaccines for this project. T.B, B.Y.A, C.C, L.G.F, J.W-T, I.L, S.B, M.D, S.D, H.A.M, R.S, J.M, P.M, N.Z, P.N.N, B.G and T.J are members of the Vaccine Identity Evaluation Consortium (VIE). All authors read and approved the final manuscript.

Corresponding authors

Correspondence to Bevin Gangadharan or Tim James.

Ethics declarations

Competing interests

P.M declares consultancy for Agilent Technologies, of which R.S is an employee. All other authors have no competing interests. The authors alone are responsible for the views expressed in this paper, and they do not necessarily represent the views, decisions or policies of the institutions with which they are affiliated.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Brook, J., Bharucha, T., Arman, B.Y. et al. Biochemical profiling provides a low-cost and globally accessible method to detect falsified vaccines and insulin. Sci Rep 16, 6581 (2026). https://doi.org/10.1038/s41598-026-37281-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Version of record:

  • DOI: https://doi.org/10.1038/s41598-026-37281-9