Reconsidering Counting Articles in Ranked Venues (CARV) as the Appropriate Evaluation Criteria for the Advancement of Democratic Discourse in the IS Field

Document Type

Article

Publication Date

2019

Publication Title

Communications of the Association for Information Systems

DOI

10.17705/1CAIS.04410

ISSN

1529-3181

Abstract

For a research field to advance, scholars must be able to openly exchange ideas. For this open exchange to exist, the contexts and methods that evaluate scholarly output must encourage this interchange. We argue that the current process for evaluating scholarly output, “counting articles in ranked venues” (CARV), creates pressures that result in a distorted discourse inhibiting the growth of the field. We review the current system of evaluating scholarly output and describe its virtues and shortcomings. Then, based on works by Habermas (1984) and Mingers and Walsham (2010), we suggest that the IS field should adopt an improved method of evaluation that enhances the openness of ideas. This method should be objective, reproducible, relatively easy to compute, and standardized. The new method should also produce easy-to-compute profiles of measures that assess a construct for scholarly output founded on a well-defined theory. It should also reduce the dependence on publishing in any particular journal. The scholarly capital model (SCM) represents one such method. We believe that wide adoption of the SCM would open the discourse and help the field to develop more rapidly.

Comments

Submission of an article to CAIS implies the authors' certification that the manuscript is not copyrighted and is not currently under review by any other journal or conference proceedings.

Copyright to all articles published by the Communications of the Association for Information Systems must be transferred by the authors to AIS prior to publication. Authors will be required to fill out and sign a form to this effect.

Electronic or print copies may be made for non-commercial personal or class-room use. In cases of classroom copies, copyright should be attributed to AIS on each copy.

Authors may include a copy of their article on their Web page as long as it is clearly noted that AIS owns the copyright and use for profit is not allowed. Such an author version must be identical to the final published version, and include a link to Communications of the Association for Information Systems.

Full Journal Policy

Link to Full Text

Share

COinS