Methodological Flaws, Conflicts of Interest, and Scientific Fallacies: Implications for the Evaluation of Antidepressants’ Efficacy and Harm

4
ByCrossFit June 28, 2019

In this 2017 narrative review, Michael Hengartner discusses the evidence assessing the effectiveness and harms of antidepressants. He finds the evidence of benefits insufficient and the harms sufficiently great to argue treatment should not be recommended for the majority of patients on an evidentiary basis.

Significant biases confound the perceived benefits of antidepressants in acute therapy. Industry-funded research consistently shows greater treatment efficacy than research funded and conducted entirely by individuals without conflicts of interest. This is at least partially due to publication bias, as industry-funded antidepressant trials with less positive results often either remain unpublished or are distorted to make the results seem positive. In sum, this creates a published literature base that demonstrates greater drug efficacy than a complete view of the literature would support.

Some consistent methodological choices further distort results. One key area is trial selection criteria, which generally exclude patients with major depression and comorbidities or suicidal ideation; such selective practices separate antidepressants in a trial setting from their real-world clinical use, potentially exaggerating their average benefits (by excluding the hardest-to-treat patients) and downplaying their risks (by excluding the patients most susceptible to increased suicide risk and other side effects).

Despite these biases, all of which would inflate the mean perceived benefit attributed to antidepressant treatment, no meta-analysis has shown an effect size for antidepressants that reaches clinical significance (Hengartner cites evidence that an improvement of fewer than 7 points on the HAMD scale would not be recognized as an improvement in depression symptoms). Some researchers have argued that when antidepressants are compared to active placebos (which intentionally introduce side effects to reduce patients’ opportunity to discover they are in the placebo group), the benefits disappear entirely.

Research testing the impact of antidepressants in long-term therapy is consistently distorted by the fact that long-term antidepressant use can cause durable neurochemical changes in the brain and dependence. Depression relapses in discontinuation trials, then, may often be discontinuation or withdrawal symptoms. Long-term observational studies (which provide the only data on the impact of antidepressants over many years) suggest outcomes for antidepressant users receiving continuous maintenance therapy are no better than those who never received antidepressants in the first place.

Finally, multiple meta-analyses have found antidepressants increase risk of suicide attempts, self-harm, and suicidal ideation (with a risk ratio of between 2.5 and 4.3). As noted above, this effect may in fact be understated, as patients at the greatest risk of suicide are generally excluded from antidepressant trials. Similarly, multiple observational studies have shown antidepressant use is associated with increased mortality, particularly in older patients.

Hengartner concludes:

My reading of the literature is that some patients may benefit from acute pharmacotherapy, but on average clinical benefits are debatable and should be weighed against adverse side effects. Continuation and maintenance therapy is not recommended due to an apparent lack of clear clinical benefits, coupled with a possibly increased vulnerability to chronic depression, increased suicide risk, and, in particular in older adults, higher all-cause mortality.

Comments on Methodological Flaws, Conflicts of Interest, and Scientific Fallacies: Implications for the Evaluation of Antidepressants’ Efficacy and Harm

4 Comments

Comment thread URL copied!
Back to 190629
RAPHAEL SIRTOLI
July 2nd, 2019 at 5:25 pm
Commented on: Methodological Flaws, Conflicts of Interest, and Scientific Fallacies: Implications for the Evaluation of Antidepressants’ Efficacy and Harm

Comment part 1/


Sorry, my comment was cut-off so it is re-posted here:

The publication bias by the pharmaceutical industry is massive. It can be very hard to unearth given the clever misuse of statistics they engage in. Here's an example from the antidepressant literature I like because they put their finger on different statistical measures used by them vs the US FDA


Newer-Generation Antidepressants and Suicide Risk in RCTs: A Re-Analysis of the US_FDA Database https://www.karger.com/Article/FullText/501215


For suicide events (attempts + death), the absolute risk increase was 0.077% or ~77 suicides per 100,000 antidepressant users, for a Number Needed to Harm of 1,303.

Comment URL copied!
RAPHAEL SIRTOLI
July 2nd, 2019 at 5:26 pm

Comment part 2/


The suicide attempt rate was increased in antidepressant arms relative to placebo (OR = 2.38, 95% CI = 1.63—3.61, p < 0.00001, BF = 180.1 [very strong evidence]).


The absolute risk increase was 0.413% or about 413 suicide attempts per 100,000 antidepressant users.

Although the absolute risk increase in suicide events is small, it must be weighed against the knowledge that the deterioration in quality of life that accompanies the increase in suicide events is significant.

Comment URL copied!
RAPHAEL SIRTOLI
July 2nd, 2019 at 4:27 pm
Commented on: Methodological Flaws, Conflicts of Interest, and Scientific Fallacies: Implications for the Evaluation of Antidepressants’ Efficacy and Harm

The publication of the pharmaceutical industry is massive. It can be very hard to unearth given the clever misuse of statistics they engage in. Here's an example from the antidepressant literature I like because they put their finger on different statistical measures used by them vs the US FDA


"Newer-Generation Antidepressants and Suicide Risk in RCTs: A Re-Analysis of the US_FDA Database" https://www.karger.com/Article/FullText/501215


For suicide events (attempts + death), the absolute risk increase was 0.077% or ~77 suicides per 100,000 antidepressant users, for a Number Needed to Harm of 1,303.


The suicide attempt rate was increased in antidepressant arms relative to placebo (OR = 2.38, 95% CI = 1.63—3.61, p < 0.00001, BF = 180.1 [very strong evidence]).


The absolute risk increase was 0.413% or about 413 suicide attempts per 100,000 antidepressant users


Although the absolute risk increases - which were previously hidden - were uncovered, they are 'minor'. Nevertheless, before suicide 'events' take place the decrease in quality of life can be significant. So the number should be analysed within that context too.


In fairness though, the the increase in events may stem from the initial increase in energy provided by the dopamine upregulation (whether via partial agonism or antagonism). This is similar to the natural transition into Spring, known to itself be antidepressant to many clinically depressed people.


So the data is hard to parse but what's sure is that many of the pharma giants behaving disgracefully !

Comment URL copied!
RAPHAEL SIRTOLI
July 2nd, 2019 at 5:25 pm

Sorry, my comment was cut-off so it is re-posted here:

The publication bias by the pharmaceutical industry is massive. It can be very hard to unearth given the clever misuse of statistics they engage in. Here's an example from the antidepressant literature I like because they put their finger on different statistical measures used by them vs the US FDA


Newer-Generation Antidepressants and Suicide Risk in RCTs: A Re-Analysis of the US_FDA Database https://www.karger.com/Article/FullText/501215


For suicide events (attempts + death), the absolute risk increase was 0.077% or ~77 suicides per 100,000 antidepressant users, for a Number Needed to Harm of 1,303.


The suicide attempt rate was increased in antidepressant arms relative to placebo (OR = 2.38, 95% CI = 1.63—3.61, p < 0.00001, BF = 180.1 [very strong evidence]).


The absolute risk increase was 0.413% or about 413 suicide attempts per 100,000 antidepressant users.

Although the absolute risk increase in suicide events is small, it must be weighed against the knowledge that the deterioration in quality of life that accompanies the increase in suicide events is significant.

Comment URL copied!