Tijdschrift voor Taalbeheersing - Volume 38, Issue 2, 2016

Abstract Research integrity in quantitative, empirical studies: problems and potential solutions In the social sciences, there is an important debate about how to do good empirical research and how to publish about it. As this journal, the Tijdschrift voor Taalbeheersing, also regularly publishes empirical studies, the present article aims to open the debate in the field of language and communication. After outlining the major prob Read More

Abstract Integrity in research: hunger for perfection and production Solutions for observed integrity problems in scientific practice often involve reorganizations of the publication system, but systemic solutions do not warrant changes in culture. Perfect form does not guarantee interesting content. Next to looking at the system, academics should also look at and reevaluate their own criteria for publishing a paper, or hiring Read More

Abstract Empirically sound conclusions: A guide for language researchers Recently, there has been (and still is) a lot of discussion about the replicability of scientific findings. Hornikx and Batenburg (2016) try to explain the non-replicability in science, and discuss the situation for language research. We make the point that empirically sound conclusions will contribute to the replicability of science. In this commentary, we dis Read More

Abstract Conduct matters: On rules for scientific integrity1 Discussions of scientific integrity of research in discourse studies (taalbeheersing) should not be limited to experimental research only, for rules for scientific conduct apply to all sorts of research: experimental and observational, quantitative and qualitative, empirical and theoretical. Nowadays, written codes are available that specify simple and clear principles of Read More

Abstract More messages, of course – but how many and what kind of messages? It is solid advice to employ more messages in one’s experiments when conducting research on message variables’ effects. The question is how many messages should be used? And what characteristics should these messages have? Compared to the insights and guidelines available for the selection mode and number of participants when aimin Read More

Abstract Sustainable Research To increase the effectiveness of communication research in terms of theoretical and practical yield, I propose a three-pronged approach: 1) Reduce the temptation to make less ethical decisions by changing publication policies; 2) Increase the power of the statistical tests, also by maximizing effect size; 3) Focus the research effort on the domain of sustainability.

Abstract Research quality: dichotomous versus meta-analytical thinking The success of statistical reform as a means of improving the quality of quantitative research requires that individual researchers change their interpretation of the results of statistical analyses. For instance, if researchers do not change their habits of dichotomously interpreting p-values, publishing studies regardless of statistical significance m Read More

Abstract False positives: No lack of integrity, but an excess of flexibility Hornikx and Batenburg discuss the important problem of false positives in the literature. One of the causes for false positives they give is a faulty incentive system that stimulates unethical behavior. In this reply I argue that false positives are mainly caused by human error, misunderstanding of statistics, and underpowered studies. I suggest a small adaptatio Read More

Abstract Scarcity is good, but selection must improve Hornikx and Batenburg (2016) demonstrate that publication pressure is an important reason why the social sciences face a problem with replicability. They argue that researchers might use questionable methods because the opportunities to publish are scarce. This paper, however, suggests that more room for publications will not lead to better research practices. Instead the Read More

Abstract How transparent can we be? In their contribution Hornikx and Batenburg (2016) raise a number of issues related to the transparency and integrity of quantitative research in particular. In this contribution two additional issues are raised that may hinder the accessibility and accountability of our research results. One is related to studies based on the use of confidential materials – especially in the context of q Read More

Abstract Research integrity in quantitative, empirical studies: the perspective of researchers in language and communication The article by Hornikx and Batenburg (2016) invited researchers in language and communication to reflect on problems and possible solutions related to research integrity in conducting and reporting quantitative, empirical research. The reactions from colleagues in the field underline the problems Read More