Systematic review of quantitative preference studies of treatments for rheumatoid arthritis among patients and at-risk populations

Abstract

Treatments used for rheumatoid arthritis (RA) are under investigation for their efficacy to prevent RA in at risk groups. It is therefore important to understand treatment preferences of those at risk. We systematically reviewed quantitative preference studies of drugs to treat, or prevent RA, to inform the design of further studies and trials of RA prevention. Stated preference studies for RA treatment or prevention were identified through a search of five databases. Study characteristics and results were extracted, and the relative importance of different types of treatment attributes was compared across populations. Twenty three studies were included 20 of RA treatments (18 of patients; 2 of the general public) and 3 prevention studies with first-degree relatives (FDRs). Benefits, risks, administration method and cost (when included) were important determinants of treatment choice. A benefit was more important than a risk attribute in half of the studies of RA treatment that included a benefit attribute and 2/3 studies of RA prevention. There was variability in the relative importance of attributes across the few prevention studies. In studies with non-patient participants, attributes describing confidence in treatment effectiveness/safety were more important determinants of choice than in studies with patients. Most preference studies relating to RA are of treatments for established RA. Few studies examine preferences for treatments to prevent RA. Given intense research focus on RA prevention, additional preference studies in this context are needed. Variation in treatment preferences across different populations is not well understood and direct comparisons are needed.

Background

Rheumatoid arthritis (RA) is a common chronic inflammatory disease-causing joint pain, swelling, stiffness and fatigue. Persistent inflammation leads to erosive joint damage, functional impairment and disability [1,2,3]. RA is associated with significant extra-articular manifestations including cardiovascular disease [4] and therefore reduced life expectancy.

RA usually requires long-term treatment with associated risks of drug toxicity [5]. As a result, decisions to initiate or step up therapy are preference sensitive and understanding patient preferences is important to facilitate patient-centred strategies. Quantitative studies of patient preferences for RA treatments have been systematically reviewed [6].

There is increased research interest in the identification and treatment of ‘at risk’ individuals in order to delay or even prevent the onset of RA. The European League Against Rheumatism (EULAR) has identified terminology to describe five ‘at risk’ groups where preventive intervention may be possible. These are individuals without a diagnosis of RA who have either (i) genetic risk factors for RA, (ii) environmental risk factors for RA, (iii) systemic autoimmunity associated with RA, (iv) symptoms without clinical arthritis or (v) unclassified arthritis [7]. Core risk factors for RA have now been defined [8], and EULAR guidelines for conducting clinical trials and observational studies in individuals at risk of rheumatoid arthritis have been published [9].

Several completed and ongoing prevention trials are assessing the effectiveness of drugs currently used to treat RA, to delay or prevent the onset of RA (e.g. [10,11,12,13,14]). Initiatives to develop novel cellular treatments to prevent the RA are ongoing [15]. The decision to initiate a treatment to reduce the risk of developing RA is complex, as there is considerable uncertainty around the potential for benefit. Over recent years, some studies have begun to focus on the preferences of individuals at risk of RA for preventive treatments [16]. Understanding treatment preferences of those at risk is important to inform the development of ethical and efficient prevention trials and clinical translation. It is likely that treatment preferences of those who have a diagnosis of RA differ from those at risk.

Given the increasing focus on prevention of RA [8, 9], the present systematic review of studies to elicit preferences for RA treatments updates and extends the previous review [6] by including studies of the preferences of individuals who do not have RA, and those of ‘at risk’ populations for RA prevention [17]. This inquiry will explore differences between preference studies for RA treatment and prevention, and across different populations (patients, general public, at risk groups). Differences in study design and results will be examined. These findings will be informative for the design of efficient trials and healthcare strategies, and for attribute selection in further quantitative preference studies relating to RA prevention.

Methods

This systematic review was conducted and reported in line with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Statement [18]. The protocol has been registered on Prospero (CRD42018099312).

Study selection criteria

Research articles published in English between January 1957 and November 2021, describing studies that used quantitative preference elicitation techniques (e.g. conjoint analysis, discrete choice experiment (DCE)) to investigate preferences for RA treatment or prevention in adults aged 18 years or older were included. The start date for the search marks the publication of the first successful randomised trial of a therapeutic intervention (glucocorticoids) for RA [19]. In line with the Durand et al. review [6], articles that assessed more than one treatment attribute were included. Where multiple publications described data from a single study, the earliest publication was included, and any subsequent article was used to supplement data extraction where necessary.

Review articles, conference proceedings, abstracts, commentaries, editorials, opinion pieces and letters, qualitative studies and articles using time-trade off methods for economic evaluations were excluded. Studies assessing healthcare professionals’ preferences were also excluded unless data for patient/public preferences could be extracted separately.

Search strategy

The following databases were searched on the 5th of November 2021 to identify potential articles for inclusion: MEDLINE, PsycINFO; EMBASE, Econlit publications; and CINAHL. Search terms were developed by the authors and received expert input from a librarian at the University of Birmingham. The MEDLINE search terms are provided in Additional Table S1 as an example, similar search terms were used when searching the other databases, only updated to the format of a particular database and restricting the search to that database only.

Article selection

A minimum of two reviewers independently screened the titles and abstracts identified by the search strategy for potential eligibility for inclusion. Reviewers discussed any disagreements and where necessary an additional reviewer (GS) screened the abstract in question and disagreements were resolved by consensus if possible or the article in question was put forward for full-text review. Full-text review was again conducted independently by a minimum of two reviewers (GS and MF) and where there was any uncertainty about the validity of the inclusion of a source, methodological experts were consulted (JV and RD) Reference lists of all articles included were checked to identify further eligible studies.

Assessment with the PREFS checklist

Included articles were reviewed independently by two research assistants (GM and NW) using the 5-item Purpose, Respondents, Explanation, Findings, Significance (PREFS) checklist [20]. The PREFS checklist was developed to access quality and validity across different types of treatment preference study. This checklist assesses whether (1) preference assessment is clearly defined and is the main objective(s) of the study, (2) there is the risk of a selection bias, (3) enough methodological detail is available to enable replication of the study, (4) there is a risk of bias arising from excluding data from the findings, and (5) key results and significance tests were reported. Scores for each item and an aggregate score (ranging from 0 to 5) were calculated for each included study. Where the reviewers differed in their assessment, the source was assessed by an additional reviewer (GS) and consensus reached through discussion amongst all reviewers.

Data extraction and analysis

Data extraction from included articles was conducted by a minimum of two independent reviewers (JC, GS, research assistant). Extracted characteristics included the full reference of the source, study objective, stated preference methodology, and a description of attributes and levels and order of relative importance (See Table 1 for an overview).

Table 1 Extracted information

The attributes in each study were further categorised according to whether they described a risk (e.g. ‘Risk of serious infection’), benefit (e.g. ‘Likelihood of remission’ or ‘Reduction in chance of developing RA’), treatment administration (e.g. ‘Route of administration’), or cost of the treatment (e.g. ‘Personal cost to you per month not covered by insurance’). All other attributes were categorised as ‘other’.

Results

Study selection results

Twenty-three unique studies were included from the 5407 screened records (see Fig. 1). Three of these studies were described in multiple publications. Only one paper for each was included in the systematic review, with the others referenced. No studies were identified through the references of the included studies.

Fig. 1

Study selection results

Table 2 summarizes the characteristics of included studies. None of the included studies predates 2004 and 20 of the 23 studies were published after 2012. The study objectives for the included studies can be found in Additional Table S2. Twenty studies were of preferences for RA treatment and three studies for RA prevention. Study participants were patients with established (n = 17) or newly diagnosed (n = 1) RA; members of the general population (n = 2) who were asked to imagine they had RA; first degree relatives (FDRs) of patients with RA (n = 2); and one study included both FDRs and RA patients. Some articles also reported data from patients with other conditions, and healthcare professionals but these were not extracted for the current review. Sample sizes varied between 85 and 2663 individuals for the RA treatment studies and between 30 and 288 individuals in the prevention studies. Studies were carried out in the USA (n = 9), Europe (n = 8), Canada (n = 4), Australia (1), and Argentina (n = 1). Studies included were DCEs (n = 15), conjoint analyses (n = 6), or Best-Worst Scaling (n = 2). A description of participant characteristics such as age and gender distribution and the (clinical) inclusion criteria for each study can be found in Additional Table S3.

Table 2 Overview included studies including PREFS assessment

Results from the transparency assessment with the PREFS checklist

Aggregate PREFS scores are included in Table 2. Eight studies scored 3 (out of 5), twelve (including all three studies of treatments to prevent RA) scored 4, and three scored 5. Most studies failed to give information about how respondents differed from non-respondents reducing the score to 4 or less.

Twenty sources provided either a sample task or a complete survey. Only the three studies of RA prevention, and two treatment studies (one with non-patient participants) included the background information provided to participants.

Attributes, attribute selection, and order of relative importance

There was wide variation in the number and type of attributes included, and number of attribute levels across studies. Table 3 provides an overview of the attribute selection process, whereas Table 4 provides the attributes included as well as the type of attribute and the absolute rank order of the relative importance for each study where this information is available. For two studies, the rank order of attribute importance was either not reported or could not be derived from the reported results and model [29, 41]. An overview of the attributes and attribute levels for all 23 included studies can be found in Additional Table S2.

Table 3 Method of attribute selection

Table 4 Order of relative importance

Attribute selection was informed by either literature review, clinical opinion, qualitative research or a combination thereof. Fourteen out of 20 studies of RA treatment preferences (12 of the patient studies and both general population studies) reported including at least one stakeholder in the form of RA patients in the attribute selection process. All three studies of preferences for RA prevention included a qualitative phase to which FDRs contributed.

The variability of attributes and levels made comparisons across studies and between different participant groups difficult. However, there were some notable differences. The most common number of attributes according to the mode was seven. Six patient studies of RA treatment included large numbers of attributes (between 8 and 16) often describing multiple specific side effects (e.g. [25, 26, 28]). In contrast, all three prevention studies included five or fewer attributes.

All but one study [39] included at least one benefit attribute. Benefit attributes for RA treatment studies focussed on efficacy in symptom reduction and remission, except two studies [21, 30], which instead included time till onset of treatment action. Those with general public participants included the percentage of people treated that would feel better in six months. RA prevention studies included reduction in risk of developing RA.

In ten of the studies of RA treatments, risk attributes related to specific conditions, such as risk of cancer or tuberculosis. The other RA treatment studies, including those with general public participants, and the three preventive treatment studies included risk attributes as side effects described in terms of their severity (e.g. ‘minor side effects’) or the proportion of people having to discontinue treatment due to adverse events, in some cases giving examples of the type of side effects these categories might entail, but not singling out one specific side effect. One study of RA treatments referred to psychological side effects and side-effects related to physical appearance in addition to mild and serious side effects [23, 24]. Presentation of side effects as risk of specific conditions versus categories of side effect severity did not appear to affect relative importance of risk attributes.

A benefit attribute was ranked higher than a risk attribute in both of the RA treatment studies with general public participants [42, 43]. However, for the studies with RA patients a benefit attribute was relatively more important than a risk attribute in only eight of the 16 studies that assessed a benefit attribute and for which a rank ordering for relative importance was available [23, 24, 27, 31,32,33,34, 36, 37, 40]. In addition, for one study [25, 26], the rank order differed for the two samples. Whereas a sample of African-American participants placed more relative importance on a risk attribute over benefits, the sample of white participants placed more relative importance on a benefit (likelihood of remission; see also Table 3). A benefit was ranked higher than risk attributes in two of the three prevention studies [44,45,46].

All but two studies [29, 40] included at least one treatment administration attribute. For these treatment attributes, only the prevention studies included information on how long medication would need to be taken (i.e. 1 year). Treatment attributes mainly included frequency and route of administration either as individual attributes or as a combination. In one study, a labelled experimental design was used, with the treatment profiles indicated as ‘oral’, ‘injection’, ‘infusion’ and an opt out [33].

Nine of the 18 RA treatment studies with patient participants also included cost as an attribute, whereas none of those with general public participants did, nor did the RA prevention studies. Two prevention studies [45, 46] reported excluding a cost attribute as it was ranked as the least important attribute in the qualitative research conducted to inform attribute selection [47]. Cost attribute ranges examined across studies varied widely, which was reflected in the relative importance across studies. Moderate to large ranges of cost levels (e.g. ranging from 0 to $1000 per month or from ‘easy’ to ‘hard to afford’) were important determinants of choice (ranked first or second) in five of the nine studies. Among those studies where cost was ranked lower, smaller ranges of cost attribute levels (e.g. 0 to $50 per month) were typical.

As shown in Table 3, a number of attributes were coded as other including: physician experience or recommendation, the availability of nurse support, additional burden associated with the treatment in the form of regular medical tests or having to take it together with another medicine, and degree of uncertainty around benefit and risk estimates. Attributes that characterise the degree of certainty around the benefits or risk of treatment were included in two out of three prevention studies [45, 46] and one out of two RA treatment studies with general public participants [43]. Three RA treatment studies with patient participants included attributes relating to how long a treatment has been in use [28, 30, 33]. There was variation across these studies in terms of the relative importance of this kind of attributes.

Discussion

The aim was to systematically review preference studies related to treatments for RA, including both patient and general public participants and treatments to prevent RA. This updates and extends a previous systematic review [6] by including more recently published studies and studies in non-patient populations.

The fact that preventive intervention for RA in at-risk populations is a relatively recent area of research focus, was reflected in the fact that only three preference studies for preventive treatment were identified, two of which were conducted by the same research group and all with relatively small sample sizes. The relative importance of types of attributes was variable across these three studies, suggesting that further evidence is needed in this area.

The quality of all included sources was assessed with the PREFS checklist, which rewards transparency. Transparency is desirable to allow interpretation of results and replication of studies. Eight of the 18 studies with patient participants were assigned a relatively low PREFS score (three out of five), indicating that the description of the study method and results section lacked detail. The most frequent contributor to a lower score was respondent sampling and not addressing similarity of respondents and non-respondents.

Most of the included sources used attributes typical of treatment preference studies, such as side effects, treatment efficacy, mode of administration and frequency of treatment administration. Treatment cost or co-pay was included in half of the studies with RA patients, mostly in countries without universal health care provision (e.g. USA) although there were exceptions where for example increased taxation was included as a form of co-pay (e.g. Italy [39]). Where cost was included, it was an important determinant of choice in five of the nine studies, typically where the cost ranges studied were higher.

The number and type of attributes included, and the absolute rank order of relative importance of types of attribute, varied across studies. Studies of preferences for RA treatment tended to include more attributes than studies looking at preferences for preventive treatment.

When comparing the relative ranking of benefits and risks for treatment studies and prevention studies, it was found that a benefit attribute was ranked higher than a risk attribute over the ranges tested for two out of three prevention studies and in both studies with the general public. In contrast, for the studies of RA treatments, a benefit attribute was relatively more important than a risk attribute in only half of the studies. Due to the smaller number of non-patient studies, and methodological heterogeneity across these studies, it is difficult to draw conclusions about differences in the relative preferences of patient and non-patient participants. It is possible that different levels of first-hand experience with a disease or personal experience of treatment side effects could influence preference results [48]. Direct comparisons between different samples with different levels of disease proximity are now needed, especially in the context of studies of preferences for preventive treatments. Where study participants do not have the disease in question, preferences could be especially likely to vary according to participants’ illness perceptions or beliefs about medication. Two studies identified in this review included a measure of patients’ beliefs about medication, but none of the studies of RA prevention did. Further research is needed to elucidate the role of such psychological constructs in preference heterogeneity [49].

About half of the studies of patients’ preferences for RA treatment identified in this review included specific side effects as separate risk attributes, such as the risk of (a specific) cancer or the risk of serious infection. Whereas the remaining studies used more general terms such as “serious side effect”, some would include examples to illustrate what might constitute such a side effect. Specificity of the risk description does not appear to impact on the rank ordering of attributes in terms of relative importance. However, where risks of multiple conditions are included as separate attributes there is potential for level overlap and decreased ability of participants to make an informed choice. Risk attributes in the studies identified were typically described in terms of their severity (e.g. ‘mild side effect’), but one source included further categories of side-effects, such as those affecting an individual’s appearance or mental health which had varying importance for preferences for different sub-groups of participants.

Five studies varied the degree of confidence around treatment efficacy and safety, or degree of approval of their healthcare professional [28, 30, 43, 45, 46]. This approach was more frequent, and more likely to have an important impact on preferences in studies with non-patient participants. In clinical settings, people would not usually be asked to consider a treatment for which there is insufficient evidence and there may be potential for a related attribute to dominate preferences. However, this is an important consideration for clinical trial design, where consideration and communication of risks and benefits in the context of limited evidence is essential.

The current review was comprehensive and methodologically rigorous. The study protocol benefited from the extensive input from a multidisciplinary team including clinical and methodological expertise and patient research partners. There are limitations to the ability to compare preference studies with different objectives, populations, formats, and attributes. Further work to explore the impact of differences in attribute presentation and wording is needed. Further, as noted in the previous review of the preference literature in RA [50], some studies were fully or partially industry-funded (e.g. [22, 33, 35, 36, 38], which may have introduced a bias towards the inclusion of, and emphasis on certain attributes (e.g. mode of administration) and the exclusion of others.

The studies identified in this review all took place between 2004 and 2021, with most of them taking place after 2012. Whilst this is a relatively narrow window of time, it should be noted that the availability of certain categories of drugs and of information about treatment effectiveness and safety varies over time, and limits the extent to which temporally separated studies can be compared. A final limitation of this study is that the search strategy was restricted to articles published in the English language only, which may have resulted in the exclusion of relevant articles published in other languages.

This review has highlighted a need for further studies of preferences of at-risk populations for treatments to prevent RA. The three studies in this context identified included very small samples of FDRs of patients with a confirmed diagnosis of RA or self-reported FDRs. Many public misperceptions exist around the nature and symptoms of RA [51, 52] and RA is often confused with osteoarthritis, raising questions around sample integrity when participants are self-reported FDRs. Further studies with FDRs recruited through patients of rheumatology clinics with a confirmed diagnosis are needed, though such recruitment is challenging and resource intensive [53]. As preference studies of this kind typically ask participants to imagine a scenario where they have been identified as being at high risk of developing RA, it is possible that the preferences of the general population are equivalent to those of at-risk groups and more readily available to study. Direct comparisons are needed to address this important issue. The elicitation of public preferences is also in line with publicly funded health system requirements to value healthcare interventions based on the preferences of the general population [54].

It is further important to note that most ongoing prevention trials focus on symptomatic at-risk groups (e.g. people with clinically suspect arthralgia [55]) and there is a need for future preference studies to quantify the preferences of this group, as none were identified in this review. It is likely that such studies could include benefit attributes relating to reduction in current symptoms (e.g. joint pain; fatigue) in addition to risk reduction benefits.

Conclusion

Most stated preference studies relating to RA focus on the treatment of established disease. These find that treatment attributes, such as efficacy, safety, route/mode of administration and treatment cost are important determinants of choice. There are few studies that examine preferences of at-risk individuals for treatments to prevent RA. Given the increasing research focus on RA prediction and prevention [56], there is a need for further preference studies in this context to inform future management of RA and the design of prevention trials. Further research is also needed to assess the impact of variations in attribute presentation, predictors of preference heterogeneity and variation between populations, in the context of both disease treatment and prevention.