photo_camera wanda dunn
Bowl of fruit on a table
Literature Review
Health Behavior Interventions Literature Review
Jamie Harris  •  July 24, 2020
View PDF

Edited by Jacy Reese Anthis and Kelly Anthis. Many thanks to Juliette Finetti for providing advice and feedback.

Abstract

There is an extensive research literature on the effectiveness of various interventions for changing health behaviors, such as dietary habits, physical activity, and smoking. Existing reviews and overviews tend to aggregate research on the effects of specific interventions on particular health behaviors. This review provides a largely qualitative, non-statistical summary of the evidence for the effectiveness of intervention types across health behaviors, by aggregating 706 research items (mostly systematic reviews and meta-analyses) based on the strength of evidence. This review makes a number of subjective judgment calls and uses novel methods of evaluation in order to quickly digest and summarize an extremely large evidence base. It focuses on applications to the farmed animal movement, especially to the behavioral change of reducing animal product consumption. In general, while the health behavior literature includes a very large number of studies, there is much inconsistency in wording, methodology, and subject matter, which makes it difficult to extract useful insights for behavior change advocates. However, some conclusions are warranted. Key findings include that almost all types of health behavior interventions targeted at individuals or small groups seem likely to have effect sizes conventionally interpreted as “small” or “very small,” that their effect sizes tend to be even smaller in the long term, and that interventions with educational and behavioral components outperform solely educational interventions.

Table of Contents

Abstract

Table of Contents

Introduction

Summary of strategic implications

Appendices and supplementary spreadsheets

Methodology

Search strategy

Explanation and discussion of the four qualitative analyses used in this literature review

“Overall judgement” and “Strength of evidence assessments”

“Size of effects or differences shown through direct tests”

“Size of differences shown through indirect comparisons”

Moderator analyses

Results and discussion

Strengths and weaknesses of the health behavior literature

Strengths of the health behavior literature

Weaknesses of the health behavior literature

Limitations

Potential Items for Further Study

Bibliography

Introduction

Health behaviors are “overt behavioral patterns, actions and habits that relate to health maintenance, to health restoration and to health improvement.”[1] They are often associated with lifestyle features that affect health and lifespan, such as diet and nutrition, physical activity (henceforth PA), smoking, alcohol consumption, sexual health and contraceptive use, adherence to medication, and vaccination, immunization, screening, and appointment attendance.[2] Occasionally the terms “health behavior” and “risk behavior” are used separately to refer to actions that improve or endanger health respectively, although in this review, the term “health behavior” is used to refer to both health and risk behaviors. The study of health behavior is a vast subject area, drawing not only on medical science but also on social sciences such as behavioral economics and psychology.

While we are generally interested in what the health behavior literature can tell us about changing behavior, our particular focus is on animal product consumption and other behaviors of interest to the farmed animal movement, such as participating in demonstrations against factory farming, though animal product consumption seems most similar to typical health behavior changes. We decided to write this literature review because, as an international and well-funded field, health behavior seemed likely to have a fuller evidence base, and perhaps more certain conclusions, than exist currently in the farmed animal movement. Of course, there are many differences between the farmed animal and health behavior contexts which mean that conclusions in one field will not automatically transfer across to the other. However, if some features, trends, or effects are consistent across several different health behaviors, then it seems more likely that these findings will transfer to the farmed animal context.

External findings from the health behavior field can therefore provide weak evidence for animal advocacy strategy. Although this review draws strategic implications from the health behavior literature, these implications are only valid insofar as we place weight on external evidence, and should always be interpreted in the context of other available evidence.[3]

Summary of strategic implications

Below are a number of strategic claims supported by the evidence in this review:

Appendices and supplementary spreadsheets

Two appendices provide additional detail and discussion:

Narrative summaries of findings by health behavior topic are available upon request, as is a document listing the factors that were considered by the author for assessing the relevance of each of the health behavior areas to the farmed animal movement. Each of these appendices and supplementary documents was less thoroughly edited than Sentience Institute’s usual standard, in order to reduce the time required to summarize the extensive health behavior literature.

Additional supplementary spreadsheets provide detail on research items that were reviewed and evaluated to inform the results in Table 1 below:

Methodology

Prior to the literature review, we expected that health behavior research would provide evidence to help us better understand:

In order to focus the review on those topics of most interest:

Search strategy

Because the health behavior literature is so vast, this literature review relies primarily on systematic reviews. The focus is on Cochrane reviews where possible, since they have especially strong methodology.[7] However, Cochrane reviews do not comprehensively cover the health behavior literature.[8] The search was therefore widened beyond research by the Cochrane Collaboration to consider systematic reviews in other journals. “High-level reviews,” “meta-reviews,” and systematic “reviews of reviews” (henceforth collectively referred to as overviews) are also included. Individual studies are very rarely included.

There are established best-practice methodologies for systematic reviews,[9] but these are time-consuming procedures and can cost “upwards of $100,000 each.”[10] A review of “rapid reviews” found that even this more stripped back methodology requires on average 3.2 months to complete for just a small subset of the evidence that this literature review seeks to cover.[11] Given the vast breadth of research being evaluated in this literature review and its uncertain transferability to the farmed animal movement, a more efficient method was needed for the health behavior topics considered here. Nevertheless, as discussed below, steps have been taken to avoid arbitrary or biased selection of evidence that might limit the robustness of the results.

Initially, broad Google searches were conducted using general search terms such as “health behavior” that identified several recent overviews[12] and the information contained in Appendix B: Theory Used in Health Behavior Intervention Design and Research.

Secondly, Cochrane reviews were searched via the Cochrane Library. Two Cochrane review topics, “Tobacco, Drugs & Alcohol” and “Public Health,” seemed directly relevant to health behavior, and so these were searched comprehensively, checking the title, abstract, and summary of findings for all reviews included in these topic categories. For each review, at least one reference to it was included in this present literature review or it was listed in the spreadsheet “Lists of included and excluded research” with a brief explanation of why it was excluded.

Many other Cochrane review topics and groups seemed likely to contain some reviews relevant to health behavior. The titles of all reviews in these topics were screened, and references were included to those providing relevant information, though in most cases, the reasons for excluding were not stated, as this seemed unnecessarily time-consuming given their relatively clear irrelevance. Additionally, to check that key reviews had not been missed, several terms were searched in the Cochrane Library and checked in the same manner. The topics, groups, and search terms that were checked in this manner included:

Following this, the search was widened beyond research by the Cochrane Collaboration, prioritizing more up-to-date evidence and prioritizing the most cited research. The Google and Google Scholar search criteria were limited to overviews published since 2014 and only the first three pages of results (on each of Google Scholar and Google) were checked; only the first two pages were checked for systematic reviews and meta-analyses. If research items were returned by one of these searches but excluded in the present literature review, the reason was noted in the spreadsheet “Lists of included and excluded research.” Less systematically, the results for each search term up to page 10 on both Google and Google Scholar were also skimmed for other results that may have been particularly relevant or useful, but exclusions were not noted. For each of the search terms focusing on systematic reviews, the same process was repeated with “AND (behavior OR behaviour OR intervention)” added to the search terms. For those marked with an asterisk, not all exclusions were noted, since the search or a variation of the wording returned very few potentially relevant results that had not already been cited or checked:

Less systematically, additional research items were included based on mentions in included items, follow-up searches for specific interventions, and follow-up searches for reviews that cover multiple behavior types.[13]

In total, 85 out of 166 (51%) of the Cochrane reviews we included and 397 out of 540 (74%) other research items were identified through less systematic methodologies.

Explanation and discussion of the four qualitative analyses used in this literature review

These research items are aggregated in four ways:

These methods are used in lieu of formal statistical models due to the complex and inconsistent nature of the literature, which makes something like a meta-meta-analysis inappropriate or, at best, cumbersome in that they would require a variety of subjective judgement calls.

“Overall judgement” and “Strength of evidence assessments”

This analysis is a judgement about whether reviews tended to find statistically significant evidence in favor of particular hypotheses (phrased as questions in column B on the “GRADE overview” tab of the “Strength of Evidence Assessments spreadsheet”) or not.[16]

The overall judgements on these questions are essentially a statement of the author of this literature review’s confidence that this sort of intervention is likely to have a meaningful effect in the farmed animal movement, rather than a categorical statement that the intervention will or will not have any effect whatsoever.

The “Strength of evidence” ratings are a subjective judgment of the author, including using the Grading of Recommendations, Assessment, Development and Evaluation (GRADE) tool.[17] The GRADE tool is used to clarify understanding of the strength of evidence without spending too long delving into each review. The GRADE scores given were based primarily on the criteria for evidence type (RCTs or observational studies), risks of bias, inconsistency of the results (i.e. unexplained heterogeneity), imprecision (usually, whether the CIs included the null hypothesis), and publication bias. The original reviewers’ GRADE ratings were used when provided, which was most common in Cochrane reviews. Particularly subjective judgments made in this review were marked with an asterisk, highly uncertain judgments (say, roughly less than 75% confident) were marked with an exclamation mark, and where the review did not provide sufficient information to make a confident judgement, but an answer was guessed, this was marked with a question mark.

A number of other factors influenced the “Strength of evidence” rating, including:

A well-designed systematic review and meta-analysis can still provide very weak evidence if the quality of the studies included in the review is poor. For this reason, the AMSTAR 2 ratings of reviews (see the “AMSTAR 2” and “AMSTAR 2 sub questions” tabs on the spreadsheet) were not particularly informative, and were thus excluded after an initial attempt to include them in this review. The most important elements of the AMSTAR 2 criteria, such as whether a review notes the risk of bias or of publication bias, are in the GRADE criteria anyway.

The “Strength of evidence” ratings have the following meanings, in relation to the “Overall judgement” column:

These ratings assume that evidence from the health behavior literature constitutes valid evidence for the farmed animal movement, i.e. that there are no issues of replicability between the health behavior literature and the same studies done in the farmed animal movement, which is an inaccurate simplification.

Health behaviors vary in their relevance to the farmed animal movement.[18] The author’s understanding of the relevance of particular health behaviors to the context of the farmed animal movement affects some of the judgement calls in this literature review.[19]

When evaluating long-term effects, the focus was on studies with follow-up at 12 months or greater. This distinction was used by a number of included reviews. Usually, if a review included information for multiple follow-up periods but not for follow-up periods of 12 months or greater, it was not considered to provide evidence on long-term effects. Sometimes small exceptions to this were made, such as in one review that provided evidence on follow-up at 10 months or more.[20]

“Size of effects or differences shown through direct tests”

The effect size that included meta-analyses suggest each intervention type has was also analyzed.

This analysis focused on the effect size estimates from meta-analyses using behavioral outcomes. Clinical or indirect outcomes were not included, although combined measures that featured behavioral outcomes prominently sometimes were. This decision was made because clinical outcome measures and indirect measures such as intention could bias the effect size estimates.

Sometimes the author had to make a subjective judgment call on which reported effect size would be best to include in the analysis; these were chosen based on their intuitive relevance to the farmed animal movement, such as choosing reduction of fat intake over increase in vegetable consumption since reduction may be more important than increasing in that context. Where a meta-analysis included separate analyses for separate age groups, the combined effect size was included where possible, and the effect for adults was included if this was not possible. Where a study reports both dichotomous and continuous outcomes, if both are similarly comparable to behaviors of interest in the farmed animal movement, the continuous outcomes were prioritized, since many in the farmed animal movement are interested in reductions in animal product consumption and not just whether consumption is entirely eliminated, unless the evidence was notably stronger for dichotomous outcomes.

When reporting on the effect sizes of different interventions and on the strength of evidence, the metrics provided by the reviewers were used. As a result, several different measurements of effect size were used, most commonly relative risk (RR), odds ratios (OR), mean difference (MD), standardized mean difference (SMD) / Cohen’s d, Hedges’ g, and Pearson’s r correlation coefficients.[21] Sometimes the reviewers also report what these effects mean in the original units (such as number of successful quit attempts per 1000 smokers, or the reduction in grams of pure alcohol consumed), but they do not always do so.

Guidelines exist for interpreting some of these different forms of outcome measures, most notably Jacob Cohen’s definitions of r = 0.1 or d = 0.2 as a “small effect size,” r = 0.3 or d = 0.5 as a “medium effect size,” and r = 0.5 or d = 0.8 as a “large effect size.” This implies that effect sizes under r = 0.1 or d = 0.2 are very small (sometimes referred to as “negligible”) and that effect sizes well above r = 0.5 or d = 0.8 are very large.[22] In this literature review, Hedges’ g is interpreted using the same rules as Cohen’s d, despite some differences between the measurements. Because relative risks and odds ratios are not directly comparable to Cohen’s d effect sizes, and there are not commonly used guidelines for interpreting them that the author is aware of, this literature review uses the following rough rule of thumb for interpreting them: 0.86 to 1.24 as “very small,” 0.85 to 0.76 or 1.25 to 1.49 as “small,” 1.50 to 1.99 or 0.75 to 0.51 as “moderate,” 2.00 to 2.99 or 0.5 or 0.34 as “large,” and 3.00 upwards or 0.33 downwards as “very large.”[23] When discussing differences in effectiveness, the same guides are used for interpretation, but the language is sometimes altered to “very slightly different,” “slightly different,” “moderately different,” “substantially different,” or “very substantially different.”

In the tab “Direct tests health behavior summaries,” a mean effect size is provided for each different effect size unit, per question, per health behavior, as is a comment on the range of possibilities indicated by the CIs. Here, the terms “positive” and “negative” are used as a shorthand for “in the hypothesized direction” and “in the opposite direction to the hypothesized direction.”[24] For SMD or similar outcome measures, negative SMDs were converted to positive SMDs, if the effect is in the hypothesized direction, to make them more comparable.[25] The same was not done the same for RRs and ORs, because they are harder to convert.


When choosing how to summarize the “Overall effect size judgement” in contexts in which there are multiple different units used for the effect sizes, considerations similar to those listed in the section above on “Strength of evidence assessments” were used to make subjective judgement calls.

In the “Direct tests overview” tab, the methodology is similar. Here, the mean effect sizes of each health behavior summary is reported, rather than the mean of each individual effect size. This avoids over-representing health behaviors for which there is more evidence and underrepresenting health behaviors for which there is less evidence. The main disadvantage of this decision is that health behaviors with better evidence on a particular intervention type are weighted equally to those that have only a single effect size.[26] This means that sometimes outlier effect sizes are overrepresented. Because most combined effect size estimates are “very small” or “small,” where an effect size estimate approaches “moderate” or higher, it has been highlighted in green. Negative effect sizes are highlighted in red.

There are other disadvantages and limitations of the methodology used in these effect size estimates from direct tests:

Although not technically direct tests, beta coefficients from meta-regression analyses have also been included in this section, rather than in the section on indirect comparisons. This is because they report a single measure (the beta coefficient) rather than two separate effect sizes. Since the author did not initially plan to include an analysis of beta coefficients, it is possible that several relevant results from included reviews were omitted.[27]

“Size of differences shown through indirect comparisons”

Some questions of interest are not well-represented through direct tests. For example, direct tests are not usually made to check the differences between outcomes at short-term and long-term follow-up. To access some of these questions of interest, the likely differences in effect sizes across particular variables were estimated by comparing between the reported effect sizes for different groups within the same meta-analyses.

The methodology used was similar to that for the direct comparisons, except that all differences are reported as percentages, which are then interpreted with the same rough guidelines used to interpret RR.[28] The width of reported possible CIs is typically much larger than in the effect size estimates from direct tests, as it involves comparing the extreme ends of the 95% CIs of two different meta-analytic results.

There are other disadvantages and difficulties of interpretation in these comparisons:

For the comparisons between effect sizes at long-term and short-term follow-up, the author usually tried to compare across the measurements closest to the 12-month boundary, which was the boundary used to represent “long-term” in the strength of evidence assessments and comments on statistical significance.[31] Sometimes exceptions were made, such as if the evidence was much stronger for a different follow-up period that also enabled comparison between short- and long-term follow-up.

In some cases, slightly stricter inclusion criteria were used than were used in the Strength of Evidence Assessments spreadsheet. For example, when evaluating the difference between face-to-face and non face-to-face modes of delivery, indirect comparisons between mixed modes of delivery and one mode of delivery were not included.

Moderator analyses

For the effects of including particular types of behavior change techniques (BCTs) in interventions, modifying the intensity of interventions, modifying the complexity of interventions, the use or lack of tailoring, and the effectiveness of interventions in groups of participants with different demographic characteristics, it seemed as important to consider how results varied by intervention as how they varied by health behavior. To consider this, the results from reviews were listed in tables that laid out the results.

The tables were then examined to see if reviews came to similar conclusions for particular intervention types. Qualitative “scores” were assigned to different types of review. For example, a qualitative review provides evidence rated half as strong as a meta-analysis (further explanation is provided at the top of each tab on the spreadsheet). These methods allow less scope for nuanced understanding of the implications of each review than do the other methods of analysis used in this literature review.

There are also various limitations in the original reviews in the methods used to note whether these factors did or did not have a moderating effect.[32]

For the analysis of results by inclusion or exclusion of certain BCTs, the other three forms of analysis used in this literature review (“Size of effects or differences shown through direct tests,” “Size of differences shown through indirect comparisons,” “Overall judgement” and “Strength of evidence assessments”) seemed unlikely to be helpful, so were not carried out. For intensity, complexity, and tailoring, these three types of analysis were used for considering results by health behavior (as done elsewhere), but not by intervention type.

Results and discussion

In total, 706 research items were reviewed. The findings are summarized in Table 1 below.

Table 1: Summary of findings. Green highlighting indicates positive results, red indicates negative results, and no highlighting indicates limited or mixed evidence or small effect size.

Issue

Question

Overall judgement

Strength of evidence

Size of effects or differences shown through direct tests

Size of differences shown through indirect comparisons

Education or information only

Does the evidence suggest that this intervention is likely to be effective at changing behavior in the farmed animal movement?

Yes

Moderate

Small effects

NA

Does the evidence suggest that where effects occur, they are likely to endure into the long term?

Yes

Very weak

Small / very small effects

Very small / small differences in favor of the short-term

Brief interventions (BIs)

Does the evidence suggest that this intervention is likely to be effective at changing behavior in the farmed animal movement?

Yes

Strong

Small effects

NA

Does the evidence suggest that where effects occur, they are likely to endure into the long term?

Yes

Very weak

Small effects

Moderate / large differences in favor of the short-term

Motivational interviewing (MI)

Does the evidence suggest that this intervention is likely to be effective at changing behavior in the farmed animal movement?

Yes

Moderate

Small / very small effects

NA

Does the evidence suggest that where effects occur, they are likely to endure into the long term?

Yes

Very weak

No information

Large differences in favor of the short-term

Does the evidence suggest that this intervention is likely to be more effective at changing behavior in the farmed animal movement than other comparable intervention types?

Yes

Very weak

Very small / small differences in favor of MI

No information

Counselling or therapy

Does the evidence suggest that this intervention is likely to be effective at changing behavior in the farmed animal movement?

Yes

Strong

Large / moderate effects

NA

Does the evidence suggest that where effects occur, they are likely to endure into the long term?

No

Very weak

Small effects

Moderate differences in favor of the short-term

Self-help, self-monitoring, and self-management

Does the evidence suggest that this intervention is likely to be effective at changing behavior in the farmed animal movement?

Yes

Moderate

Small effects

NA

Does the evidence suggest that where effects occur, they are likely to endure into the long term?

No

Very weak

No information

No information

Action planning, coping planning, problem solving, and implementation intentions:

Does the evidence suggest that this intervention is likely to be effective at changing behavior in the farmed animal movement?

Yes

Weak

Small / moderate effects

NA

Does the evidence suggest that where effects occur, they are likely to endure into the long term?

Yes

Very weak

No information

No information

Social norms

Does the evidence suggest that this intervention is likely to be effective at changing behavior in the farmed animal movement?

Yes

Moderate

Small effects

NA

Does the evidence suggest that where effects occur, they are likely to endure into the long term?

No information

No information

No information

Peer-led interventions and mentoring

Does the evidence suggest that this intervention is likely to be effective at changing behavior in the farmed animal movement?

Yes

Weak

Very small / small effects

NA

Does the evidence suggest that where effects occur, they are likely to endure into the long term?

Yes

Very weak

No information

No information

Reminders

Does the evidence suggest that this intervention is likely to be effective at changing behavior in the farmed animal movement?

Yes

Moderate

Very small effects

NA

Does the evidence suggest that where effects occur, they are likely to endure into the long term?

No

Very weak

No information

No information

Educational or behavioral interventions as additions to pharmacological interventions:

Does the evidence suggest that this intervention is likely to be effective at changing behavior in the farmed animal movement?

Yes

Weak

Unclear (very small?) effects

NA

Does the evidence suggest that where effects occur, they are likely to endure into the long term?

No information

No information

No information

Telephone

Does the evidence suggest that this intervention is likely to be effective at changing behavior in the farmed animal movement?

Yes

Strong

Small effects

NA

Does the evidence suggest that where effects occur, they are likely to endure into the long term?

No

Very weak

No useful information

No information

Does the evidence suggest that interventions using this mode of delivery are likely to be less effective at changing behavior in the farmed animal movement than face-to-face equivalents?

No

Very weak

Small differences in favor of face-to-face delivery

Text messaging

Does the evidence suggest that this intervention is likely to be effective at changing behavior in the farmed animal movement?

Yes

Strong

Small effects

NA

Does the evidence suggest that where effects occur, they are likely to endure into the long term?

No information

No information

No information

Does the evidence suggest that interventions using this mode of delivery are likely to be less effective at changing behavior in the farmed animal movement than face-to-face equivalents?

No information

No information

No information

Broader mobile phone interventions (mHealth)

Does the evidence suggest that this intervention is likely to be effective at changing behavior in the farmed animal movement?

Yes

Weak

No information

NA

Does the evidence suggest that where effects occur, they are likely to endure into the long term?

No information

No information

No information

Does the evidence suggest that interventions using this mode of delivery are likely to be less effective at changing behavior in the farmed animal movement than face-to-face equivalents?

No information

No information

No information

Online and computer-based interventions

Does the evidence suggest that this intervention is likely to be effective at changing behavior in the farmed animal movement?

Yes

Strong

Small / very small effects

NA

Does the evidence suggest that where effects occur, they are likely to endure into the long term?

No

Very weak

Very small effects / no effect

Moderate / large differences in favor of the short-term

Does the evidence suggest that interventions using this mode of delivery are likely to be less effective at changing behavior in the farmed animal movement than face-to-face equivalents?

Yes

Very weak

Very small differences in either direction / no difference

Moderate / large differences in favor of face-to-face delivery

Explicit consideration of print-based materials

Does the evidence suggest that this intervention is likely to be effective at changing behavior in the farmed animal movement?

Yes

Weak

Very small effects

NA

Does the evidence suggest that where effects occur, they are likely to endure into the long term?

Yes

Very weak

No information

No information

Does the evidence suggest that interventions using this mode of delivery are likely to be less effective at changing behavior in the farmed animal movement than face-to-face equivalents?

Yes

Weak

No information

No information

Does the evidence suggest that interventions using this mode of delivery are likely to be less effective at changing behavior in the farmed animal movement than other non face-to-face modes of delivery?

No

Very weak

Very small differences in either direction / no difference

No information

Broader consideration of non face-to-face modes of delivery

Does the evidence suggest that this intervention is likely to be effective at changing behavior in the farmed animal movement?

Yes

Strong

Small / very small effects

NA

Does the evidence suggest that where effects occur, they are likely to endure into the long term?

No

Very weak

Very small / no effect

Large / moderate differences in favor of the short-term

Does the evidence suggest that interventions using this mode of delivery are likely to be less effective at changing behavior in the farmed animal movement than face-to-face equivalents?

No

Very weak

No information

Moderate / small differences in favor of face-to-face delivery

Does the evidence suggest that interventions using this mode of delivery are likely to be less effective at changing behavior in the farmed animal movement than other non face-to-face modes of delivery?

NA

NA

NA

NA

All non face-to-face modes of delivery combined

Does the evidence suggest that this intervention is likely to be effective at changing behavior in the farmed animal movement?

Yes

Very strong

Small / very small effects

NA

Does the evidence suggest that where effects occur, they are likely to endure into the long term?

No

Very weak

Very small / no effect

Moderate / large differences in favor of the short-term

Does the evidence suggest that interventions using this mode of delivery are likely to be less effective at changing behavior in the farmed animal movement than face-to-face equivalents?

No

Very weak

Very small differences in either direction / no difference

Small differences in favor of face-to-face delivery

Group interventions

Does the evidence suggest that this intervention is likely to be effective at changing behavior in the farmed animal movement?

Yes

Moderate

Moderate effects

NA

Does the evidence suggest that where effects occur, they are likely to endure into the long term?

Yes

Very weak

No information

No information

Does the evidence suggest that interventions using group delivery are likely to be less effective at changing behavior in the farmed animal movement than individual equivalents?

No

Moderate

No difference / very small differences in favor of group delivery

Very small differences in favor of group delivery

School-based interventions

Does the evidence suggest that this intervention is likely to be effective at changing behavior in the farmed animal movement?

Yes

Weak

Small effects

NA

Does the evidence suggest that where effects occur, they are likely to endure into the long term?

Yes

Weak

Small / very small effects?

Very small differences in favor of the long-term

Does the evidence suggest that interventions in this setting are likely to be more effective at changing behavior in the farmed animal movement than other settings?

No

Very weak

No information

No information

Family-based interventions

Does the evidence suggest that this intervention is likely to be effective at changing behavior in the farmed animal movement?

Yes

Moderate

Small effects

NA

Does the evidence suggest that where effects occur, they are likely to endure into the long term?

Yes

Weak

Small effects

Small / moderate differences in favor of the short-term

Does the evidence suggest that focusing on parents is important for the success of home- or family-based interventions?

No

Very weak

No information

Large differences in favor of favor of interventions that involve both parents and children

Workplace-based interventions

Does the evidence suggest that this intervention is likely to be effective at changing behavior in the farmed animal movement?

Yes

Weak

Small effects

NA

Does the evidence suggest that where effects occur, they are likely to endure into the long term?

No

Very weak

No information

No information

Community-based interventions and population-level interventions

Does the evidence suggest that this intervention is likely to be effective at changing behavior in the farmed animal movement?

Yes

Very weak

Small effects

NA

Does the evidence suggest that where effects occur, they are likely to endure into the long term?

No

Very weak

No information

No information

Does the evidence suggest that interventions in this setting are likely to be more effective at changing behavior in the farmed animal movement than other settings?

No

Very weak

No information

Mixed

Other settings

Does the evidence suggest that this intervention is likely to be effective at changing behavior in the farmed animal movement?

Yes

Very weak

No information

NA

Does the evidence suggest that interventions in specific settings are likely to be more effective at changing behavior in the farmed animal movement than other settings?

No

Very weak

No information

No information

Intensity of intervention

Does the evidence suggest that more intense interventions are likely to be more effective at changing behavior in the farmed animal movement?

Yes

Very weak

Small differences in favor of more intensity

Small differences in favor of more intensity?

Does the evidence suggest that interventions with longer total duration are likely to be more effective at changing behavior in the farmed animal movement?

Very small / small differences in favor of longer duration

Mixed

Does the evidence suggest that interventions with a larger number of contacts are likely to be more effective at changing behavior in the farmed animal movement?

Small / moderate differences in favor of more contacts

Very small differences in favor of more contacts

Does the evidence suggest that interventions with longer contact time are likely to be more effective at changing behavior in the farmed animal movement?

Very large differences in favor of longer contact time

Small differences in favor of longer contact time

Does the evidence suggest that text or digital interventions with two-way communication are likely to be more effective at changing behavior than those with one-way communication?

No information

Very small / small differences in favor of one-way communication

Complexity of intervention

Does the evidence suggest that more complex interventions are likely to be more effective at changing behavior in the farmed animal movement?

Yes

Very weak

Small differences in favor of more complexity

Moderate / large differences in favor of more complexity

Does the evidence suggest that interventions with more components (BCTs or similar) are likely to be more effective at changing behavior in the farmed animal movement?

Small differences in favor of more components

Moderate / large differences in favor of more components

Does the evidence suggest that interventions with more modes of delivery are likely to be more effective at changing behavior in the farmed animal movement?

No information

No difference / very small differences in favor of more modes of delivery

Does the evidence suggest that interventions with behavioral components are likely to be more effective at changing behavior in the farmed animal movement than those only using education?

Small differences in favor of more behavioral components

Large / moderate differences in favor of more behavioral components

Tailoring

Does the evidence suggest that tailored interventions are likely to be more effective at changing behavior in the farmed animal movement than comparable non-tailored interventions?

Yes

Very weak

Very small / small differences in favor of tailoring

Moderate / large differences in favor of tailoring

Fear appeals

Does the evidence suggest that this intervention is likely to be effective at changing behavior in the farmed animal movement?

Yes

Very weak

Small / very small effects

NA

Does the evidence suggest that fear appeals are likely to be more effective at changing behavior in the farmed animal movement than comparable non-fear-based interventions?

Yes

Very weak

No information

No information

Framing

Does the evidence suggest that gain-framed messages are likely to be more effective at changing behavior in the farmed animal movement than loss-framed messages?

No

Very weak

Very small differences in favor of gain-framed messages

Large differences in favor of gain-framed messages?

Does the evidence suggest that positive attribute framed messages are likely to be more effective at changing behavior in the farmed animal movement than negative attribute framed messages?

No

Very weak

No information

No information

Narratives

Does the evidence suggest that testimonial messages are likely to be more effective at changing behavior in the farmed animal movement than non-testimonial messages?

No

Very weak

No information

No information

Does the evidence suggest that narrative messages are likely to be more effective at changing behavior in the farmed animal movement than non-narrative messages?

Yes

Very weak

Small differences in favor of narrative messages

No information

Cultural competency

Does the evidence suggest that this intervention is likely to be effective at changing behavior in the farmed animal movement?

Yes

Moderate

Small effects

NA

Does the evidence suggest that culturally competent interventions are likely to be more effective at changing behavior in the farmed animal movement than generic interventions?

No

Very weak

Very small differences in favor of interventions that are not culturally competent

No information

Variations across professionals

Does the evidence suggest that professionals with more specialized skillsets and expertise are likely to be more effective at encouraging or supporting behavior change than less specialized professionals?

Yes

Very weak

No information

Unclear

Does the evidence suggest that professionals with longer training times and greater public respect and credibility are likely to be more effective at encouraging or supporting behavior change than those with less respect and credibility?

No

Weak

No information

Unclear

Does the evidence suggest that interventions provided by health professionals in other contexts (such as oral health professionals or pharmacists) are likely to be effective?

Yes

Moderate

Moderate / large effects

No information

Other variations

Does the evidence suggest that interventions where the patient and deliverer are matched on demographic characteristics are likely to be more effective at changing behavior in the farmed animal movement than interventions without demographic matching?

Yes

Weak

No information

Small differences in favor of demographic matching

Pharmacology

Does the level of behavioral support improve the effectiveness of pharmacological treatments?

No

Weak

No information

Very small differences in favor of lower intensity behavioral support

Is motivation an important moderator of the effectiveness of pharmacological treatments?

Yes

Very weak

No information

No information

Do those who use this intervention to assist behavioral change rely on continued access to it in order to maintain their new behavior?

Yes

Very weak

No information

No information

Convincing alternatives

Does the evidence suggest that this intervention is likely to be effective at changing behavior in the farmed animal movement?

Yes

Weak

Large effects?

NA

Does the evidence suggest that e-cigarettes (an alternative to smoking) are similarly effective to other forms of NRT?

Yes

Very weak

No information

No information

Does the evidence suggest that programs that focus on sexual abstinence are less effective than those that encourage the use of acceptable alternative methods of sexual intercourse?

Yes

Weak

Small differences in favor of alternative methods

Moderate differences in favor of alternative methods

Direct financial incentives

Does the evidence suggest that this intervention is likely to be effective at changing behavior in the farmed animal movement?

Yes

Strong

Small / moderate effects

NA

Does the evidence suggest that where effects occur, they are likely to endure into the long term?

No

Weak

Moderate effects

Small differences in favor of the short-term

Do those who use this intervention to assist behavioral change tend to rely on continued access to it in order to maintain their new behavior?

Yes

Weak

Very small effects after withdrawal of the incentives

Moderate differences in favor of continued use of incentives

Does the evidence suggest that cash incentives are superior to other forms of incentive?

Yes

Very weak

No information

Small differences in favor of cash incentives

Does the evidence suggest that higher value incentives are likely to have a larger impact on behavioral outcomes of interest to the farmed animal movement than lower value incentives would?

Yes

Weak

Very small differences in favor of higher value incentives / no difference

Small differences in favor of higher value incentives

Does the evidence suggest that this intervention is likely to be effective at changing behavior in the farmed animal movement, even if the recipients of the intervention are receiving other types of intervention simultaneously?

No

Very weak

No effect / very small effects beyond other interventions

Moderate / small differences in favor of inclusion of this intervention

Taxes, subsidies, and prices

Does the evidence suggest that this intervention is likely to be effective at changing behavior in the farmed animal movement?

Yes

Strong

Moderate effects?

NA

Does the evidence suggest that where effects occur, they are likely to endure into the long term?

No information

No information

No information

Does the evidence suggest that subsidies for animal-free food products are likely to have a larger impact on the consumption of those products than taxes would on animal products?

Yes

Very weak

No information

Large differences in favor of subsidies

Packaging and labelling

Does the evidence suggest that this intervention is likely to be effective at changing behavior in the farmed animal movement?

Yes

Weak

Very small effects?

NA

Does the evidence suggest that where effects occur, they are likely to endure into the long term?

Yes

Very weak

No information

No information

Does the evidence suggest that pictorial or interpretive labels are likely to be more effective at changing behavior in the farmed animal movement than text-only labels?

Yes

Weak

No information

Large differences in favor of pictorial or interpretive labels

Does the evidence suggest that graphic labels are likely to be more effective at changing behavior in the farmed animal movement than non-graphic labels?

Yes

Weak

No information

No information

Nudges and environmental interventions

Does the evidence suggest that this intervention is likely to be effective at changing behavior in the farmed animal movement?

Yes

Moderate

Small effects

NA

Does the evidence suggest that where effects occur, they are likely to endure into the long term?

Yes

Very weak

No information

No information

Mass media

Does the evidence suggest that this intervention is likely to be effective at changing behavior in the farmed animal movement?

Yes

Weak

Very small / small effects

NA

Does the evidence suggest that where effects occur, they are likely to endure into the long term?

No information

No information

No information

Does the evidence suggest that more complex mass media interventions that use multiple intervention components are likely to be more effective than purely mass media interventions that utilize equivalent amounts of resources?

Yes

Very weak

No difference / very small differences in favor of complexity

No information

Does the evidence suggest that more intensive mass media interventions are likely to be more effective than less intensive mass media interventions?

Yes

Very weak

Small differences in favor of intensity

No information

Does the evidence suggest that mass media alone is likely to be less effective at changing behavior in the farmed animal movement than mass media combined with face-to-face engagement?

Yes

Very weak

Small differences in favor of combination with face-to-face

No information

Social marketing

Does the evidence suggest that this intervention is likely to be effective at changing behavior in the farmed animal movement?

Yes

Weak

Small / moderate effects?

NA

Does the evidence suggest that where effects occur, they are likely to endure into the long term?

Yes

Very weak

No information

No information

Month-long campaigns

Does the evidence suggest that this intervention is likely to be effective at changing behavior in the farmed animal movement?

Yes

Weak

No information

NA

Do those who use this intervention to assist behavioral change will maintain their new behavior after the end or withdrawal of the intervention?

Yes

Very weak

No information

No information

Advertising and advertising bans

Does the evidence suggest that the advertising of products related to health behavior increases consumption of them?

Yes

Weak

Small / very small effects

No information

Does the evidence suggest that bans of advertisements for undesirable products are likely to be effective at changing behavior in the farmed animal movement?

No

Very weak

No effect / very small effects

No information

Bans on the risk behavior

Are localized bans of risk behaviors effective at reducing those risk behaviors in those contexts?

Yes

Weak

Moderate / small effects

NA

Does the evidence suggest that where these localized effects occur, they are likely to endure into the long term?

Yes

Very weak

No information

No information

Are localized bans of risk behaviors effective at reducing total risk behaviors, beyond where the ban is operational?

Yes

Weak

No information

NA

Other legislation

Does the evidence suggest that these interventions are likely to be effective at changing behavior in the farmed animal movement?

Yes

Weak

Moderate effects

NA

Does the evidence suggest that where effects occur, they are likely to endure into the long term?

Yes

Very weak

No information

No information

Gradual or abrupt transition

Does the evidence suggest that gradual behavior change is likely to be more successful than abrupt behavior change in the farmed animal movement?

No

Weak

No information

No information

Combined average across all individual included results (as opposed to combining by health behavior)

Does the evidence suggest that results at long-term follow-up are smaller than results at short-term follow-up?

Small / moderate differences in favor of the short-term

Does the evidence suggest that interventions using this mode of delivery are likely to be less effective at changing behavior in the farmed animal movement than face-to-face equivalents?

Small differences in favor of face-to-face?

Strengths and weaknesses of the health behavior literature

The strengths and weaknesses of the health behavior literature affect the weight that should be placed on the findings of this literature review. Each of the following comments and generalizations is based on the author’s reading of the included evidence, primarily through systematic reviews and overviews. It is possible that individual studies contain much more information on some of these issues than the author is aware of and that such information simply has not been included in the identified research items.

Strengths of the health behavior literature

Weaknesses of the health behavior literature

Limitations

Potential Items for Further Study

Further research could be conducted to address any of the above limitations of this literature review. However, such research seems unlikely to be high-priority; this literature review was extremely time-consuming and had fewer strategic implications for the farmed animal movement than we had hoped it might.

More specific, higher-priority potential items for further study include:

Bibliography

See the Lists of Included and Excluded Research for a full list of references.


[1] David S. Gochman (ed.), Handbook of health behavior research, vol. 1 (New York: Plenum, 1997), 3. On 7, Gochman adds that “[h]ealth behavior is conceptually distinct from treatment and from physiological/biological/pharmacological responses to treatment. It is also conceptually distinct from health care and from the organization or structure of the health care delivery system.”

[2] Nedra B. Belloc and Lester Breslow, “Relationship of physical health status and health practices,” Preventive Medicine 1, no. 3 (1972), 409–421, for example, found that “common health practices, including hours of sleep, regularity of meals, physical activity, smoking and drinking” were associated with “physical health status,” as measured by “[a] physical health spectrum” that was developed from answers to questions about disability, chronic conditions, impairments, symptoms, and energy level.” This was “independent of age, sex, and economic status.”

David S. Gochman (ed.), Handbook of health behavior research, vol. 1 (New York: Plenum, 1997), 4, after listing several behaviors which can prevent ill-health, notes that, “[a] survey of physicians (Sobal, Valente, Muncie, Levine, & DeForge, 1985) found strong professional consensus about the preventive importance of these everyday behaviors, particularly about eliminating smoking and using protective equipment and clothing.” On page 5, Gochman adds that, “health protective behaviors” are also important.

Summarizing more recent evidence, Susan Michie and Caroline E. Wood, “Health behaviour change techniques,” Mark Conner and Paul Norman (eds.), Predicting and changing health behaviour: Research and practice with social cognition models (Maidenhead: Open University Press, 2015; first published 1995), 358 note that, “[p]reventable behaviours, such as smoking, physical activity, unhealthy eating habits, and excessive alcohol consumption have been identified as leading causes of morbidity and mortality in resource-rich countries.”

The division of categories in this review was chosen based on the divisions found most commonly in the literature.

[3] “[meta] Social movements vs. EAA randomized controlled trials (RCTs) vs. intuition/speculation/anecdotes vs. external findings” in “Summary of Evidence for Foundational Questions in Effective Animal Advocacy,” Sentience Institute, last updated June, 2018, https://www.sentienceinstitute.org/foundational-questions-summaries#[meta]-social-movements-vs.-eaa-randomized-controlled-trials-(rcts)-vs.-intuition/speculation/anecdotes-vs.-external-findings.

[4] Some of these intervention types also have experimental evidence for their effectiveness.

[5] For definitions of these terms, see Appendix A: Definitions and Discussion by Intervention Type.

[6] See, for example, Elisabeth Mendes, “An Application of the Transtheoretical Model to Becoming Vegan,” Social Work in Public Health 28, no. 2 (2013), 142-9.

L. Wolfenden, N. Nathan, C. M. Williams, “Computer-tailored interventions to facilitate health behavioural Change,” British Journal of Sports Medicine 49, no. 22 (November 2015), 1478-9 found very small significant effects overall and note that, “[t]ailored interventions based on assessments of participants prior to each intervention contact (dynamic tailoring) were more effective than interventions tailored based on a single assessment (static tailoring) at baseline (g=0.19 vs 0.14, p=0.01).”

However, three reviews provide evidence that suggests that even if tailoring is effective, repeated variations in tailored content by the stage of change has no effect on behavioral outcomes.

Mia Liza A. Lustria, Seth M. Noar, Juliann Cortese, Stephanie K. Van Stee, Robert L. Glueckauf, and Junga Lee, “A Meta-Analysis of Web-Delivered Tailored Health Behavior Change Interventions,” Journal of Health Communication 18, no. 9 (June 2013), 1039-69 found that moderator analysis “demonstrated no significant difference among studies that administered multiple assessments over the course of the intervention to create tailored messages (n = 10) compared with those that used a single tailoring assessment at baseline (n = 11).”

Kate Cahill, Tim Lancaster, and Natasha Green, “Stage‐based interventions for smoking cessation,” Cochrane Database of Systematic Reviews 11 (November 2010) note that, “[f]our trials, which directly compared the same intervention in stage‐based and standard versions, found no clear advantage for the staging component. Stage‐based versus standard self‐help materials (two trials) gave a relative risk (RR) of 0.93 (95% CI 0.62 to 1.39). Stage‐based versus standard counselling (two trials) gave a relative risk of 1.00 (95% CI 0.82 to 1.22).” Although there is insufficient information to rate the evidence by GRADE criteria, it seems likely to be either of moderate or low quality.

Jamie Hartmann‐Boyce, Tim Lancaster, and Lindsay F. Stead, “Print‐based self‐help interventions for smoking cessation,” Cochrane Database of Systematic Reviews 6 (June 2014; first published 2002) found in studies comparing tailored print-based self-help materials to non-tailored print-based self-help materials that “results favoured tailored interventions when the tailored interventions involved more mailings than the non‐tailored interventions” (RR 1.42, 95% CI 1.20 to 1.68, 9 studies), “but not when the two conditions were contact‐matched” (RR 1.07, 95% CI 0.89 to 1.30, 10 studies).” They rated the quality of the evidence as moderate for each finding.

[7] “About Cochrane Reviews,” The Cochrane Collaboration, accessed January 17, 2019 https://www.cochranelibrary.com/about/about-cochrane-reviews notes that, “[a] Cochrane Review is a systematic review of research in health care and health policy that is published in the Cochrane Database of Systematic Reviews.” These reviews “use explicit, systematic methods that are selected with a view aimed at minimizing bias, to produce more reliable findings.”

Katherine R. Jones, Nirmala Lekhak, and Napatsawan Kaewluang, “Using Mobile Phones and Short Message Service to Deliver Self-Management Interventions for Chronic Conditions: A Meta-Review,” Worldviews on Evidence-Based Nursing 11, no. 2 (April 2014), 83 notes that, “Cochrane systematic reviews are considered the ‘gold standard’ of systematic reviews, with rigorous requirements for their performance and reporting;” it found all 4 Cochrane reviews included to have the maximum AMSTAR (A MeaSurement Tool to Assess systematic Reviews) rating (see “What is AMSTAR,” AMSTAR, accessed January 17, 2019 https://amstar.ca/About_Amstar.php). This literature review therefore initially focused discussion on these results.

Holden Karnofsky, “Surveying the research on a topic,” last updated July 2016, https://blog.givewell.org/2012/09/06/surveying-the-research-on-a-topic/ of the Charity evaluator GiveWell also considers the Cochrane Collaboration to provide some of the strongest literature reviews.

[8] For example, Antonio José Grande, Tammy Hoffmann, and Paul Glasziou, “Searching for randomized controlled trials and systematic reviews on exercise. A descriptive study,” Sao Paulo Medical Journal 133, no. 2 (April 2015), found that, “[u]p until 2011, 9,354 RCTs about exercise were published in 1,250 journals and 1,262 SRs in 513 journals... The Cochrane Database of Systematic Reviews was the principal source for SRs, with 9.8% of the total.”

[9] See Julian P. T. Higgins and Sally Green (eds.) “Cochrane Handbook for Systematic Reviews of Interventions: Version 5.1.0” (March 2011), http://handbook-5-1.cochrane.org/.

[10] Holden Karnofsky, “Surveying the research on a topic” last updated July 2016, https://blog.givewell.org/2012/09/06/surveying-the-research-on-a-topic/.

[11] Ahmed M. Abou-Setta, Maya Jeyaraman, Abdelhamid Attia, Hesham G. Al-Inany, Mauricio Ferri, Mohammed T. Ansari, Chantelle M. Garritty, Kenneth Bond, and Susan L. Norris, “Methods for Developing Evidence Reviews in Short Periods of Time: A Scoping Review,” PLOS ONE 11, no. 12 (December 8, 2016), 7.

[12] These reviews were:

Denise de Ridder, Floor Kroese, Catherine Evers, Marieke Adriaanse, and Marleen Gillebaart, “Healthy diet: Health impact, prevalence, correlates, and interventions,” Psychology & Health 32 (April 2017), 907–941,

Robert West, “Tobacco smoking: Health impact, prevalence, correlates and interventions,” Psychology & Health 32 (August 2017), 1018–1036,

Emmanuel Kuntsche, Sandra Kuntsche, Johannes Thrul, and Gerhard Gmel, “Binge drinking: Health impact, prevalence, correlates, and interventions,” Psychology & Health 32 (May 2017), 976–1017,

Ryan E. Rhodes, Ian Janssen, Shannon S. D. Bredin, Darren E. R. Warburton, and Adrian Bauman, “Physical activity: Health impact, prevalence, correlates and interventions,” Psychology & Health 32 (May 2017), 942–975,

Elísio Costa, Anna Giardini, Magda Savin, Enrica Menditto, Elaine Lehane, Olga Laosa, Sergio Pecorelli, Alessandro Monaco, and Alessandra Marengoni, “Interventional tools to improve medication adherence: review of literature,” Patient Preference and Adherence 9 (September 2015), 1303-1314.

[13] This increased the risk of selection bias in reporting results but seemed worthwhile in order to seek clarification on topics of particular interest to the farmed animal movement or topics for which the searches so far had returned little evidence.

[14] Holger Schünemann, Jan Brożek, Gordon Guyatt, and Andrew Oxman (eds.), “GRADE Handbook,” last updated October 2013, https://gdt.gradepro.org/app/handbook/handbook.html.

[15] For example, a review might include a meta-analysis for face-to-face counseling interventions compared to control groups that received no intervention and a separate meta-analysis for counseling interventions delivered by telephone, also compared to control groups that received no intervention. Indirect comparison between the reported effect sizes in each of these two meta-analyses might suggest larger effects for one mode of delivery than the other.

[16] For example, one question is whether the evidence in the health behavior literature suggests that education or information only interventions are likely to be effective at changing behavior in the farmed animal movement. A large number of reviews reported statistically significant findings suggesting that such interventions do have effects on behavioral outcome, although several reviews found statistically insignificant evidence. The “overall judgement” is that yes, education or information only interventions are likely to be effective at changing behavior in the farmed animal movement.

[17] Holger Schünemann, Jan Brożek, Gordon Guyatt, and Andrew Oxman (eds.), “GRADE Handbook,” last updated October 2013, https://gdt.gradepro.org/app/handbook/handbook.html.

[18] Hence, for example, conclusions from research on interventions seeking to reduce levels of salt consumption seem more likely to also be accurate for interventions seeking to reduce levels of animal product consumption than do the conclusions from research on interventions seeking to encourage vaccination adherence.

 

Examples of moderating characteristics encountered in this research, of health behaviors and of study subjects, include:

[19] The “Strength of evidence” estimates in the “GRADE health behavior summaries” tab do not take into consideration how comparable the author expects the evidence from each health behavior to be to evaluations of consumer interventions in the farmed animal movement, but those in the “GRADE overview” tab do. In the “GRADE overview” tab, the evidence from some health behavior areas is weighted more heavily than the evidence from others. For these weightings, intuitions about the relevance of each of the health behavior areas to the farmed animal movement were used.

[20] A. Sadiq Sani, Charles Abraham, Sarah Denford, and Susan Ball, “School-based sexual health education interventions to prevent STI/HIV in sub-Saharan Africa: a systematic review and meta-analysis,” BMC Public Health 16, no. 1069 (October 2016).

[21] Mark Simmonds, “Synthesis and meta-analysis,” (November 2018), https://drive.google.com/file/d/121LQMSgbpJEvxEJHpUG4wq3KdDhJTEFd/view provides a clear introduction to understanding most of the main measures used in this literature review.

[22] Jacob Cohen, Statistical Power Analysis for the Behavioral Sciences (New Jersey: Lawrence Erlbaum Associates, 1988; first published 1969), 79-81.

[23] OR and RR are not the same, but to prevent extensive time being spent on trying to locate sufficient information to convert between these measurement types, the same rough rule of thumb was used, with some discretionary adjustment towards 1 for OR.

[24] For example, when asking whether the evidence suggests that gain-framed messages are likely to be more effective at changing behavior in the farmed animal movement than loss-framed messages, the evidence for reviews of multiple health behaviors is summarized as having “Very small negative to small positive” CIs. This means very small differences in favor of loss-framed messages to small differences in favor of gain-framed messages.

[25] That is, even if a review reported a reduction in alcohol consumption from an intervention by SMD -0.20, in the spreadsheet, this would have been recorded as SMD 0.20. Any negative numbers on the spreadsheet therefore represent changes in the opposite direction to that which was expected.

[26] For example, there is a large amount of evidence on the effect sizes for brief interventions to reduce alcohol consumption, but alcohol consumption BIs are not notably more comparable to plausible interventions in the farmed animal movement than BIs to reduce smoking. However, this does mean that 9 effect sizes for alcohol BIs have the same combined weight as the single effect size for sexual health BIs.

[27] That is, the author may have read a review some time in 2018, and read the relevant information relating to meta-regression, but not written this information down, because it was not relevant to the analyses he was planning to conduct. The author only decided to include an analysis of beta coefficients in March 2019.

[28] For example, a MD of 14.91g reduction in ethanol consumption at less than 12 months’ follow-up after an intervention compared to a MD of a 7.46g reduction in ethanol consumed at 12 months’ follow-up or longer is reported as a 50% difference in effect size in favor of short-term follow-up. This is then interpreted as a “large” effect size difference (on the border with a “moderate” effect size difference).

[29] For example, SMD 0.2 would be 200% the size of SMD 0.1, but SMD 0.3 would only be 150% the size of SMD 0.2, even though the gap between the effect sizes is the same in each of these comparisons in absolute terms (0.1 difference).

[30] For example, The gap between SMD 0.1 and SMD 0.2 is not too dissimilar from the gap between RR 1.12 and RR 1.25 (both a gap from the border of a “small” effect size to a more clearly “very small” effect size), yet the percentage difference is very different (200% and 112% respectively).

[31] For example, for Eleni Mantzari, Florian Vogt, Ian Shemilt, Yinghui Wei, Julian P. T. Higgins, Theresa M. Marteau, “Personal financial incentives for changing habitual health-related behaviors: A systematic review and meta-analysis,” Preventive Medicine 75 (2015), 75-85, where 6 months’, 6-12 months’, 12-18 months’, and 18+ months’ follow-up were all included, 6-12 and 12-18 months’ follow-up were compared, rather than 6 and 18+.

[32] See, for example, the discussion at the start of the section on “Strengths and weaknesses of the health behavior literature.”

[33] Some reviews include over one hundred studies on the same intervention type, whereas the largest meta-analysis of studies within the farmed animal movement that the author is aware of (“Leafleting,” Animal Charity Evaluators (November 2017), https://animalcharityevaluators.org/advocacy-interventions/interventions/leafleting/#report) contains only six studies.

[34] This literature review has sought to utilize tools such as AMSTAR 2 and GRADE, rather than to evaluate them in comparison to other tools and therefore cannot provide strong recommendations on the best evaluation tools. However, most of these could be used by researchers in the farmed animal movement; either as checklists to ensure the quality of their own research designs, or to evaluate the quality of the research of others. Some tools, such as the Cochrane Risk of Bias tool (Julian P. T. Higgins and Sally Green (eds.) “Chapter 8: Assessing risk of bias in included studies” in “Cochrane Handbook for Systematic Reviews of Interventions: Version 5.1.0” (March 2011), http://handbook-5-1.cochrane.org/) can be used with minimal adaptation. Although the full methods used in health behavior systematic reviews might only rarely be appropriate for the research of the farmed animal movement, reading such reviews has helped the author to reflect on the importance of being as systematic as practically possible (given resource constraints) in research in order to minimize selection bias. The author has tried to utilize some of these methods in conducting this literature review, for example (see the section on “search strategy” above).

[35] See the column for “Inconsistency of results” in the tab “GRADE individual reviews” on the spreadsheet “Strength of Evidence Assessments.”

[36] Many reviews draw attention to this limitation. This literature review includes comparisons between different follow-up periods where possible. See the column for “Question (abbreviated for clarity)” in the tab “GRADE individual reviews” on the spreadsheet for “Strength of Evidence Assessments;” note the much larger number of reviews helping to answer questions marked as “Effective?” than helping to answer questions marked as “Long-term?”

[37] For example, in the debate about the usefulness of fear appeals, proponents have used mostly observational evidence, or experimental evidence with indirect outcome measurements such as intention to smoke or self-efficacy, to argue that fear appeals are effective (see, for example, David Hammond, “Health warning messages on tobacco products: a review,” Tobacco Control 20 (2011), 327-37). Others have drawn attention to the limitations of such evidence and pointed to indirect evidence of negative effects (see, for example, Robert A. C. Ruiter, Loes T. E. Kessels, Gjalt‐Jorn Y. Peters, and Gerjo Kok, “Sixty years of fear appeal research: Current state of the evidence,” International Journal of Psychology 49, no. 2 (April 2014), 63-70 and Gerjo Kok, Gjalt-Jorn Ygram Peters, Loes T. E. Kessels, Gill A. ten Hoor, and Robert A. C. Ruiter, “Ignoring Theory and Misinterpreting Evidence: The False Belief in Fear Appeals,” Health Psychology Review 12, no. 2 (December 2017), 111-25).

[38] The author of this literature review did not count one domain considered to be “critical” by the authors of the AMSTAR 2 methodology as critical, partially because it did not seem particularly important, and partially so that he could meaningfully differentiate between reviews; otherwise nearly all evaluated reviews would have been rated as “low” or “critically low.” No reviews were rated as “high” quality by AMSTAR 2 criteria. See the tab “AMSTAR 2” on the spreadsheet for “Strength of Evidence Assessments.”

[39] For example, Denise de Ridder, Floor Kroese, Catherine Evers, Marieke Adriaanse, and Marleen Gillebaart, “Healthy diet: Health impact, prevalence, correlates, and interventions,” Psychology & Health 32 (April 2017), 23-4, referring to four qualitative reviews on nudge interventions, note that, “[a]ll reviews stress that the quality of studies included was suboptimal, and in some cases even weak... although nudging shows promise when considering health behaviour interventions, as a low-cost, effective way of increasing healthy choices, caution is needed due to the lack of population-based long-term effectiveness.” Barnabas Szaszi, Anna Palinkas, Bence Palfi, Aba Szollosi, and Balazs Aczel, “A Systematic Scoping Review of the Choice Architecture Movement: Toward Understanding When and Why Nudges Work,” Behavioral Decision Making 31, no. 3 (July 2018), 355-66 review 422 choice architecture interventions in 156 studies note that, “only 7% of the studies applied power analysis, 2% used guidelines aiming to improve the quality of reporting, no study in our database was preregistered, and the used intervention nomenclatures were non‐exhaustive and often have overlapping categories.”

[40] For example, a review might note that the majority of studies found no significant effects of the intervention, but if this was due to the individual studies being insufficiently powered, then the intervention may still be effective. Even with small or very small effect sizes, low intensity and low cost interventions may still be cost-effective. This problem is mitigated by using meta-analytic techniques.

[41] See, for example, Rory McGill, Elspeth Anwar, Lois Orton, Helen Bromley, Ffion Lloyd-Williams, Martin O’Flaherty, David Taylor-Robinson, Maria Guzman-Castillo, Duncan Gillespie, Patricia Moreira, Kirk Allen, Lirije Hyseni, Nicola Calder, Mark Petticrew, Martin White, Margaret Whitehead, and Simon Capewell, “Are interventions to promote healthy eating equally effective for all? Systematic review of socioeconomic inequalities in impact,” BMC Public Health 15, no. 457 (May 2015).

[42] See the section on “Usefulness of social cognition models” in Appendix B.

[43] For example, Dao Truong, “Social Marketing: A Systematic Review of Research 1998-2012,” Social Marketing Quarterly 20, no. 1 (January 2014), 15-34, though not limited exclusively to health behavior (about 75% of identified articles focused on health topics), notes that 1,879 (56.9% of those identified) research contributions to the topic of social marketing came from the US. Following this were the UK (11.5%), Australia (5.7%), and Canada (5.1%).

Although this literature review has not recorded or counted the geographical locations of included research items, the author would guess that over half of the primary studies included in this literature review (including those summarized by systematic reviews) were conducted in the U.S. Additionally, the systematic searches did not return a single review that directly compared results between North American and European contexts for particular interventions, although some specified that their review was limited to high-income countries or to low- and middle-income countries only. This problem may be partially due to language constraints. Many reviews only include studies published in English.

[44] For example, the evaluation of the findings from behavior change technique analyses in included reviews was not initially planned, so information on BCT analyses from reviews that were looked at before making this decision may have been omitted. The analysis of “Effectiveness of interventions varying by demographic characteristics” suffers from the same issue.

[45] If an overview contained reviews that had already been examined, this was noted in the tab on “Qualitative comments on overviews” in the spreadsheet “Strength of Evidence Assessments.” It is likely that there are many instances where cited reviews use some of the same studies as their evidence base and this has not been noted.

[46] For example, different forms of outcome measurement have hardly been considered, but it may well be that studies using self-reported and objectively measured outcomes give substantially different impressions of the effectiveness of particular interventions or modifications. Little attention has been paid to the countries in which studies were conducted; the study locations or characteristics have not been noted unless it seemed to have an especially important bearing on the results.

[47] Sometimes, this reflects decision-making by the author of this literature review, as with the comparison of “long term” (follow-up at 12 months or more) to “short term” (follow-up at less than 12 months). At other times, this reflects the decisions of the authors of included research items. For example, sometimes intensity is measured by texts being sent weekly or not; alternatively, one could reasonably use texts sent “at least once every five days” as the cutoff point to compare across.

[48] See the section on “Explanation and discussion of the four qualitative analyses used in this literature review.”

[49] See the section on “Strengths and weaknesses of the health behavior literature.

[50] See “Asking individuals to contribute to institutional change” in Jamie Harris, “Which institutional tactics can animal advocates use?” (April 27, 2020), https://www.sentienceinstitute.org/blog/institutional-tactics.

[51] For example, wild animals, the global poor, people of color, women, members of the LGBTQI community, future beings, and artificial sentience are all arguably excluded or insufficiently included within humanity’s moral circle.

[52] Though lower priority, other variations evaluated by health behavior research, where the conclusions are unclear, could also be evaluated in the contexts that social movements are interested in. For example, what effects do the use of gain-framed messaging or fear appeals have?

[53] A similar point was made by Filippo Bianchi, Claudia Dorsel, Emma Garnett, Paul Aveyard, and Susan A. Jebb, “Interventions targeting conscious determinants of human behaviour to reduce the demand for meat: a systematic review with qualitative comparative analysis,” International Journal of Behavioral Nutrition and Physical Activity 15, no. 102 (October 2018). They note that, “while providing information was not found to directly influence behaviour, future research should explore whether this approach might contribute towards reducing population-wide demand for meat in other ways. For example, providing information on the benefits of eating less meat might increase the public’s acceptability for more structural interventions to reduce meat consumption.”

[54] These could include more systematic inclusion of relevant reviews and studies, greater effort to dig down into the reasons for discrepancies between reviews on specific outcomes of interest, and better use of meta-analytic techniques.

[55] Susanne Stoll-Kleemann and Uta Johanna Schmidt, “Reducing meat consumption in developed and transition countries to counter climate change and biodiversity loss: a review of influence factors,” Regional Environmental Change 17, no. 5 (June 2017), 1261-77.

[56] Joeri Veul, “Interventions to reduce meat consumption in OECD countries: a systematic review to understand differences in success,” (master’s thesis, August 2018), https://theses.ubn.ru.nl/bitstream/handle/123456789/6391/Veul%2c_Joeri_1.pdf?sequence=1.

[57] Some of the included research items that had relevance for messaging considerations drew on this literature. Topics included comparison of loss-framing to gain-framing, help-self appeals compared to help-others appeals, moderators of effectiveness in mass media campaigns and in social marketing, and evaluations of the effectiveness and moderators of advertising and advertising bans. This literature may be more useful for improving messaging strategies and identifying the features of mass media campaigns that increase their effectiveness than the health behavior literature is.


Subscribe to our newsletter to receive updates on our research and activities. We average one to two emails per year.