Introduction
Vitamin K antagonists (VKAs) were widely used until various, so-called, direct oral anticoagulants (DOACs) became popularized [1]. Despite more limited use than before [2, 3], VKAs are still the standard of care in atrial fibrillation (AF) patients with hemodynamically overt mitral stenosis and a mechanical heart valve. PT-INR measurements are necessary to achieve the best balance between antithrombotic effects and the risk of serious bleeding complications upon using VKAs. Practice guidelines recommend PT-INR 2–3 for the vast majority of patients on the glove [4, 5]. But, a lower target PT-INR of 1.6–2.6 is recommended in elderly Japanese patients [6]. PT-INR in nature is neither accurate nor convenient [7–9]. Separation of plasma from whole blood and transfer to a central laboratory take considerable time. Several point-of-care (POC) devices enabling the measurement of PT-INR with whole blood have been developed [10, 11]. However, values obtained by POC devices and traditional laboratory measurements have not been compared widely in real world clinical practice. Target PT-INR using a specific POC device may differ substantially from the values recommended using lab-INR.
Several POC devices have been used in warfarin arms of clinical trials developing DOACs in patients with non-valvular atrial fibrillation (AF) [12–14]. The POC devices were necessary in these clinical trials because the trials were conducted in double blinded fashion. Neither physicians nor patients knew whether the patients were treated with warfarin or the DOAC. The number of tablets (either warfarin or placebo) should be increased/decreased based on the values that appeared on the POC devices during the trial. The POC devices used in these trials should have a function to show the measured values in the warfarin arm but provide dummy values in the DOAC arm. In the four of the DOAC developmental trials in stroke prevention in AF, target PT-INR was established as 2-3 assuming there are no differences among values obtained by each POC devices and lab-INR [12–15]. All 4 DOAC development trials demonstrated that the quality of warfarin controls are high enough, meaning the time in the therapeutic range (TTR) in warfarin arm was more than 60%. However, the apparent quality of warfarin therapy may be influenced by the accuracy of the POC device used in each trial. Indeed, the accuracy of PT-INR measurements with POC devices is reported not to be high enough to replace lab-INR [16]. Moreover, the US Food and Drug Administration (FDA) issued a medical device recall notice for the Alere INRatio Monitor System (formally known as the HemoSense INRatio device: INRatio) because the values obtained from this whole blood POC device become low in anemic condition as compared to the values obtained by traditional plasma-based lab measurements [17]. Thus, we proposed the clinical hypothesis that the PT-INR values obtained with POC devices may differ from those measured with lab-INR in a real world setting.
Here we report the difference among values of PT-INR obtained from 2 of the POC devices (INRatio/INRatio 2, CoaguChek XS) with traditional plasma-based laboratory measurement (lab-INR).
Material and methods
Patient population
This is a single-center, retrospective analysis of prothrombin time (PT)-international normalized ratio (INR) measurements in patients treated with the VKA warfarin. The study was approved by the ethics committee of Komatsu Cardiovascular Clinic. According to local regulatory requirements, the approved protocol was posted in the clinic where every patient was able to see it. The study was conducted as a hypothesis generation study with no pre-determined sample size. Two of the POC devices, namely INRatio/INRatio 2 (Alere, San Diego, US) and CoaguChek XS (Roche, Switzerland), were selected as testing POCs due to availability to compare with traditional plasma-based laboratory measurements in 3 phases of 2011-2012, 2015, and 2016 of consecutive patients.
Blood sampling and PT-INR measurements
Blood sampling was conducted by standard venipuncture. For measurements of PT-INR with POC devices (INRatio/INRatio 2 and CoaguChek XS), collected blood was directly applied to the devices with the standard procedure. For laboratory measurements, collected blood was anticoagulated with 3.2% sodium citrate. Then, the samples were centrifuged at 1,500 g for 10 min to separate plasma, and then sent to the testing center (SYSMEX, Co, Ltd, Tokyo, Japan).
PT-INR was measured using POC devices of INRatio/INRatio 2 and CoaguChek XS at the clinic. The values were represented as INRatio and CoaguChek, respectively. For traditional plasma-based measurements, PT-INR measurements were conducted with a full-auto analyzer CA7000 (Sysmex Corporation, Kobe, Japan), and CS5100 (Sysmex Corporation, Kobe, Japan) at the central laboratory. Tissue factor Thromborel S (ISI 0.94-1.02, Sysmex Corporation, Kobe, Japan) was used as the thromboplastin agent. The measured values were represented as lab-INR.
Statistical analysis
All measured values were expressed as mean ± SD unless otherwise specified. The difference between the values measured by POC devices and lab-INR were shown as Δ = (values measured by regular laboratory data) – (values measured by POC). The Δ was also shown as a Bland-Altman plot where the x-axis represent mean PT-INR values measured with both lab-INR and by the POC device. The Δ values were shown with the 95% confidential interval. The Δ was assumed as statically high/low when the 95% CI did not cross each other. Pearson’s correlation coefficients were calculated to quantify the relationship between lab-INR and POC measured values.
Results
Patient population
In total 393 patients were included in this study. As shown in Table I, warfarin was used for stroke prevention in non-valvular atrial fibrillation (AF). The major comorbidities in the target patient population were hypertension (143 patients), type 2 diabetes mellitus (52 patients), chronic kidney disease (32 patients), and ischemic heart disease (31 patients). The mean CHADS2 score of patients was 2.0.
Table I
Baseline characteristics
PT-INR values measured with traditional plasma-based laboratory measurements (lab-INR) and those measured by INRatio/INRatio 2 and CoaguChek XS
The total number of PT-INR measurements was 1,347. The vast majority of measurements were multiple measurements during the course of our study from the same patients as shown in Table II. There were no apparent trends among PT-INR values and number of replicated measurements. The comparison between INRatio and lab-INR were available in 1,342 measurements. Figure 1 A shows the distribution of –Δ, which represents the values obtained by Lab-INR – those obtained by INRatio. It is of note that the values differ substantially when PT-INR values are 2.5 or higher. As shown in Figure 1 B, the values obtained by INRatio had a correlation of 0.7839 with lab-INR. PT-INR values measured as INRatio were higher than Lab-INR with Δ of –0.33 ±0.38 (mean ± SD, 95% CI: –0.31 – –0.35).
Table II
Number of patients in multiple PT-INR measurement
Figure 1
Comparison between PT-INR Values Measured by Traditional Plasma-Based Measurements (Lab-INR) and by Point-Of-Care Device of INRatio/INRatio2 (INRatio). A – PT-INR values measured by traditional plasma-based measurements (lab-INR) and by point-of-care device of INRatio/INRatio 2 (INRatio) as a Bland-Altman plot. The horizontal axis represent the mean of lab-INR and PT-INR measured as INRatio. The vertical axis represents the Δ, which is the difference between PT-INR values measured by lab-INR and INRatio. The apparent difference becomes larger at PT-INR 2.5 or more. B – the relationship between the PT-INR values measured by lab-INR and INRatio. There was a positive correlation between the two values with a regression coefficient of 0.784

Figure 2 A shows the relationship between the values obtained by CoaguChek XS and lab-INR in 1,345 measurements. There was no difference between the value measured by CoaguChek XS and lab-INR as measured with Δ of –0.08 ±0.16 (mean ± SD, 95% CI: –0.07 – 0.09). As shown in Figure 2 B, there was a strong positive correlation between PT-INR measured by CoaguChek XS and lab-INR with correlation coefficient of 0.9508.
Figure 2
Comparison between PT-INR Values Measured by Traditional Plasma-Based Measurements (Lab-INR) and by Point-Of-Care Device CoaguChek XS (CoaguChek XS). A – the PT-INR values measured by traditional plasma-based measurements (lab-INR) and by point-of-care device CoaguChek XS as a Bland-Altman plot. The horizontal axis represents the mean of lab-INR and PT-INR measured by CoaguChek XS. The vertical axis represents the Δ, which is the difference between PT-INR values measured by lab-INR and CoaguChek XS. The apparent difference becomes larger at PT-INR 2.5 or more. B – the relationship between the PT-INR values measured by lab-INR and CoaguChek XS. There was a positive correlation between the two values with a regression coefficient of 0.951

Discussion
PT-INR measurements are widely used for controlling anticoagulation therapy with the use of VKAs [12–15]. Laboratory measurement of PT-INR with a plasma sample is an established standard procedure [18]. However, it is neither easy nor convenient to separate plasma, send to a central laboratory, and wait for measured values. POC devices, enabling direct PT-INR measurements from whole blood, provide substantial advantages for daily clinical practice to reduce the risk of stroke in AF patients [19–21]. Moreover, POC devices were necessary to conduct double blind clinical trials comparing quality controlled VKAs and newly developed direct oral anticoagulants (DOACs) [12–15]. Previous publications suggest the accuracy of the POC device as compared to lab-INR in various clinical conditions [22–25]. But, the majority of the publications were limited to the use of CoaguChek XS [22–25]. Here, we confirmed that the PT-INR measured with CoaguChek XS had no difference compared to lab-INR. However, the values measured by INRatio/INRatio 2 were approximately 0.3 higher than lab-INR. Similar differences may be observed by other whole blood based POCs. Neither INRatio nor INRatio 2 is widely used in clinical practice, but they were used in some of the clinical trials such as the Rivaroxaban Once Daily Oral Direct Factor Xa Inhibition Compared with Vitamin K Antagonism for Prevention of Stroke and Embolism Trial in Atrial Fibrillation (ROCKET AF) and the J-ROCKET AF study [17, 26]. The differences are not negligible because the PT-INR recommendation with the use of INRatio and INRatio 2 should be changed from 2–3 or 1.6–2.6 to 2.3–3.3 or 1.9–2.9. Our study raises caution for the selection and use of a POC device when considering its use in clinical trials that include controlled VKA arm(s).
Despite wide use of PT-INR in clinical practice, PT-INR is not an accurate predictor for the onset of thrombotic/bleeding complications [27, 28]. PT-INR also does not reflect the activity of vitamin K dependent coagulant factors precisely. Indeed, serious hemophilia B patients having a coagulation factor IX activity below 1% still have PT-INR in the normal range [29]. Practice guidelines in various regions of the world recommend a target PT-INR of 2–3 in various pathological conditions. It is of note that the guideline recommendation is only a guide. Recently developed computer-based artificial intelligence found more precise prediction of future clinical events from serially measured PT-INR [30], but a one-time measurement is still the standard.
In nature, PT-INR is calculated from the ratio of clotting time of plasma anticoagulated by relatively weak calcium ion chelating agent of citrate by addition of excess calcium ion and thromboplastin. Conceptional “thromboplastin” is identified as the complex of tissue factor [31, 32] and phospholipids [33, 34]. There are many thromboplastin agents with various activity to induce coagulation. Adjustment of measured prothrombin time ratio by the internationalized ratio is recommended. Despite adjustments, PT-INR values are known to differ substantially when using different reagents. PT-INR is one measure for evaluating the anticoagulant effect(s) of warfarin, but various values may appear with various reagents.
In December 2014, the FDA issued a recall notice for a medical device correction of the Alere INRatio Monitor System (formally known as the HemoSense INRatio device). (INRatio/INRatio2) because this POC device may provide PT-INR results which are lower than standard plasma-based laboratory INR in patients with abnormal hematocrit levels, increased fibrinogen, and so on [35]. The authors of the ROCKET-AF trials conducted comparable analysis between the 8942 of 14,236 total patients (63%) without a recall condition and 5294 (37%) in whom there was a recall condition in the ROCKET-AF trial. In both sub-groups, there was noninferiority of rivaroxaban versus warfarin for preventing stroke and systemic embolism, with similar rates of overall bleeding [35]. Similar confirmative results were published from the group of authors of the J-ROCKET AF [36]. Although lower values in INRatio/INRatio2 as compared to the lab-INR were cautioned by the FDA, our results here show the opposite: a higher value of PT-INR with INRatio/INRatio2. There are many potential factors influencing the PT-INR values measured with INRatio/INRatio2, not limited to the ones raised by the FDA. The important issue of note is that the values of PT-INR measured by POCs are not the same as standard lab-INR. The variability of values with various measurements is not surprising. Preventive effects or rivaroxaban on thrombus formation are true [1], but the physician has to be aware of the variability among values obtained by various devices [37].
Our study has a strong limitation in regard to generalization of our results to the global scale because the study was performed as a single-center registry in a single country, Japan. Standard lab-INR may differ substantially with the use of thromboplastin with different International Sensitivity Index (ISI) values. Moreover, the study was designed as a hypothesis generation study without prior prediction of necessary sample size or power calculation. The decision to use INRatio/INRatio 2 and CoaguChek XS as the devices to measure POC derived PT-INR were not made systematically by selecting from all available POC devices but were dependent upon their availability in the study clinic. Due to these strong limitations, this paper should be considered only as hypothesis generating and the findings of the variability among PT-INR values obtained by different measurement methods should be confirmed by further future studies with a larger sample size, making it possible to clarify the potential parameters influencing the values obtained by various devices.
In conclusion, our results strongly suggested the presence of variability among PT-INR values obtained by different methods.

