By Published: Jan. 18, 2017

When Matthew Keller found he could not duplicate his own 2012 study that tied inbreeding to the chances of developing schizophrenia in a more-powerful secondary study, he wanted to make sure the scientific record was clear


Science can be a very messy business, with many more hypotheses posited, studied, discounted and idly discarded than most people realize, according to Matthew Keller, an associate professor in behavioral, psychiatric and statistical genetics at the University of Colorado Boulder.

鈥淭here are plenty of false starts, some of which go on for years and years until someone shows them to be false,鈥 said Keller, whose lab researches genetic architecture of psychiatric disorders. 鈥淚t鈥檚 not unlikely that a lot of the science that鈥檚 published鈥攑erhaps in some domains, most of what is published鈥攊s wrong. That sounded startling to scientists a few years ago, but people are increasingly realizing that for certain sub-disciplines of science, it may be true.鈥

So when Keller found he could not duplicate his own 2012 study linking inbreeding to the likelihood of developing schizophrenia in a secondary study, he wanted to make sure that subsequent research would not go down the same faulty track.

The second study, 鈥淣o Reliable Association between Runs of Homozygosity and Schizophrenia in a Well Powered Replication Study,鈥 was published in the journal PLOS Genetics in October, which also published the initial study, 鈥.鈥

Keller

Matthew Keller

鈥淚 thought it was crucial that we not only publish it, but publish in the same journal that we published the original finding,鈥 Keller said. 鈥淚鈥檓 very grateful the journal did publish our second study. Most editors simply don鈥檛 want to publish null findings.鈥 (A null finding does not support the hypothesis.)

To be sure, many researchers aren鈥檛 too inclined to discount their own findings, either. Keller actually is not sure the positive results of his first study are not valid, but in regard to the second study, the disqualifying data speak for themselves.

I have to admit that I鈥檓 disappointed in that it didn鈥檛 replicate, but I take great pride in publishing this report."

鈥淚 have to admit that I鈥檓 disappointed in that it didn鈥檛 replicate, but I take great pride in publishing this report,鈥 he said. 鈥淎t first I thought we must have done something wrong鈥攎aybe miscoded something. And my poor graduate student (PhD candidate Emma Johnson, the lead author for the second study), I forced her to jump through so many hoops, but in the end the research was sound.鈥

That first study found a modest but nevertheless reliable association between inbreeding and schizophrenia鈥攍eading Keller to state that that the odds of developing schizophrenia increase by approximately 17 percent for every additional percent of the genome that shows evidence of inbreeding. Inbreeding is a well-known factor in predicting occurrences of diseases caused by abnormality in a single gene, which are referred to as monogenic disorders, but in more complex diseases the epidemiological studies require huge patient lists to create enough data to establish an association.

鈥淭he effects are tiny; to detect an association you need huge sample sizes,鈥 Keller explained. 鈥淥nce you get those sample sizes, you can see lots and lots of effects.鈥

To create those databases, researchers from around the globe have formed consortiums, so the 22,000-person database used in the original study included patients and control populations from a number of different countries. Combining them into a single database, researchers can then examine the degree of inbreeding in schizophrenic patients compared to the degree of inbreeding in the control group.

鈥淏oth studies used very large consortium data, but they all came from smaller studies鈥攆or instance a study in Denmark would take data from 1,000 patients with schizophrenia and a similar sized control group,鈥 he said.

The measure of inbreeding is essentially determined by how many chromosomes have identical alleles鈥攎eaning that individual received the same allele from both the mother and father. But rather than simply finding a ratio of duplicated pairs of alleles鈥攈omozygotes in the language of the discipline鈥攔esearchers look for long strings of homozygosity.

鈥淓veryone is inbred to a certain degree, but there is a large variation on how far back you have to go to before you start finding the same people in different branches of the tree,鈥 Keller said. 鈥淪ome people, you only have to go back a few generations, others much further back. The runs of homozygosity are a more sensitive measure of recent inbreeding.鈥

Homozygosity means that stretches of the genome are identical because they come from the exact same ancestor, and if recessive alleles exist in that run of homozygosity, their full negative effect will be revealed. In monogenic disorders that may easily be the path to disease mutations鈥揵ut in more complex disorders there could be thousands of combinations leading to a disorder.

Keller remains unsure why his results failed to replicate but suspects that the use of consortium data may be partly to blame. In essence, control group establishment varies widely in each study that contributed data, so that could have easily confounded the results.

鈥淲hen the research differs in how people are ascertaining cases and control, it鈥檚 very easy to get confounding results in this particular type of study,鈥 he said. For instance, if controls are ascertained disproportionately from highly educated and well-traveled people, their levels of inbreeding could be less dramatic than in cases drawn from the more general population, with a mix of people coming from populations of long-established farming communities, for example.

鈥淭his confounding could either be covering up an association in the second study, or it could have created the association in the first study,鈥 Keller said. The second study used a large population 鈥 more than 30,000 people 鈥 but Keller did not include the original 22,000 people from the first study.

鈥淚 still have my suspicions that the first finding was right, but my confidence has plummeted from 80 percent right after we published that study to maybe 25 percent now,鈥 he said.听 Still, publishing the null results not only gives subsequent researchers warning signs, but also a glimpse into those possible data glitches and the intrinsic difficulty in moving forward on this path.

鈥淭he main problem now is there is no additional data collected that can help us solve the riddle,鈥 he said. 鈥淭here鈥檚 no reason to do the same study on another sample of 30,000 people again, because we can鈥檛 rule out there are these confounding problems. We鈥檝e got to find a dataset that has collected relevant information, not just about the disorder, but about potential confounding variables, to make the study worth re-running.鈥