Crowdsourcing Journal Rankings in Educational Technology and Distance Learning
PROCEEDINGS
Mark J. W. Lee, Charles Sturt University, Australia
EdMedia + Innovate Learning, in Victoria, Canada ISBN 978-1-939797-03-2 Publisher: Association for the Advancement of Computing in Education (AACE), Waynesville, NC
Abstract
Much emphasis has been and continues to be placed on measures of quality and prestige of scholarly publishing outlets. Educational technology and distance learning researchers worldwide are under perennial pressure to publish in journals that perform favorably according to these measures. This paper describes a work-in-progress project whose objective is to trial the use of a novel approach based on "crowdsourcing" as an alternative method for producing rankings of scholarly journals. The approach involves gathering and aggregating the collective opinions of a large number of individuals on the World Wide Web. The project seeks to provide "proof of concept" of the approach and to elicit participants' views and perceptions of the crowdsourced rankings in comparison to traditional journal rankings and quality measures.
Citation
Lee, M.J.W. (2013). Crowdsourcing Journal Rankings in Educational Technology and Distance Learning. In J. Herrington, A. Couros & V. Irvine (Eds.), Proceedings of EdMedia 2013--World Conference on Educational Media and Technology (pp. 2443-2448). Victoria, Canada: Association for the Advancement of Computing in Education (AACE). Retrieved March 28, 2024 from https://www.learntechlib.org/primary/p/112311/.
© 2013 Association for the Advancement of Computing in Education (AACE)
References
View References & Citations Map- All Our Ideas. (2012). About this project. Retrieved from http://www.allourideas.org/about Atkinson, R. (2011). Editorial: Dawn of a new ERA? Australasian Journal of Educational Technology, 27(3), iii–viii.
- Auranen, O., & Nieminen, M. (2010). University research funding and publication performance—an international comparison. Research Policy, 39(6), 822–834.
- Australian Research Council. (2011). Ranked journal list development. Retrieved August 1, 2011, from http://www.arc.gov.au/era/journal_list_dev.htm
- Bergstrom, C.T. (2007). Eigenfactor: Measuring the value and prestige of scholarly journals. College& Research Libraries News, 68(5), 314–316.
- Bollen, J., Rodriguez, M.A., & Van de Sompel, H. (2006). Journal status. Scientometrics, 69(3), 669-687.
- Brabham, D.C. (2008). Crowdsourcing as a model for problem solving: An introduction and cases. Convergence, 14(1), 75–90.
- Campbell, J.P., DeBlois, P.B., & Oblinger, D. (2007). Academic analytics: A new tool for a new era. EDUCAUSE Review, 42(4), 41–57.
- Doan, A., Ramakrishnan, R., & Halevy, A.Y. (2011). Crowdsourcing systems on the WorldWide Web. Communications of the ACM, 54(4), 86–96.
- Fearn, H. (2010, March 4). “Me” focus skews journal rankings. Times Higher Education. Retrieved from http://www.timeshighereducation.co.uk/story.asp?sectioncode=26 & Storycode=410640 & C=1
- Garfield, E. (1955). Citation indexes to science: A new dimension in documentation through association of ideas. Science, 122(3159), 108–111.
- Garfield, E. (1994). The Thomson Reuters impact factor. Current Contents, 25, 3–7.
- Garfield, E. (2005, September). The agony and the ecstasy—the history and the meaning of the journal impact factor. Paper presented at the Fifth International Congress on Peer Review in Biomedical Publication, Chicago, IL.
- Greengard, S. (2011). Following the crowd. Communications of the ACM, 54(2), 20–22.
- Goldstein, P.J. (2005). Academic analytics: The uses of management information and technology in higher education. Boulder, CO: ECAR.
- Hilton, J. (2006). The future for higher education: Sunrise or perfect storm? EDUCAUSE Review, 41(2), 58–71.
- Howe, J. (2006). The rise of crowdsourcing. Wired, 14(6). Retrieved from http://www.wired.com/wired/archive/14.06/crowds.html
- Howe, J. (2008). Crowdsourcing: Why the power of the crowd is driving the future of business. New York, NY: Crown Business.
- Kodrzycki, Y.K., & Yu, P.D. (2006). New approaches to ranking economics journals. The B.E. Journal of Economic Analysis& Policy, 5(1).
- Kusnetzky, D. (2010, February 16). What is “big data?” ZDNet. Retrieved from http://www.zdnet.com/blog/virtualization/what-is-big-data/1708 Lee, M.J.W., & McLoughlin, C. (Eds.). (2011). Web 2.0-based e-learning: Applying social informatics for tertiary teaching. Hershey, PA: IGI Global.
- Liebowitz S.J., & Palmer, J.P. (1984). Assessing the relative impacts of economics journals. Journal of Economic Literature, 22(1), 77–88.
- Long, P.D., & Siemens, G. (2011). Penetrating the fog: Analytics in learning and education. EDUCAUSE Review, 46(5), 31–40.
- O’Reilly, T. (2005). What is Web 2.0: Design patterns and business models for the next generation of software. Retrieved from http://www.oreillynet.com/pub/a/oreilly/tim/news/2005/09/30/what-is-web-20.html
- Palacios-Huerta, I. & Volij, O. (2004). The measurement of intellectual influence. Econometrica, 72(3), 963–977.
- Pontille, D., & Torny, D. (2010). The controversial policies of journal ratings: Evaluating social sciences and humanities. Research Evaluation, 19(5), 347–360.
- Rosen, J. (2006, June 27). The people formerly known as the audience. [Weblog post]. Retrieved from http://journalism.nyu.edu/pubzone/weblogs/pressthink/2006/06/27/ppl_frmr.html
- Rowbotham, J. (2011, March 2). Journal rankings a sword over universities. The Australian. Retrieved from http://www.theaustralian.com.au/highereducation/journal-rankings-a-sword-over-universities/story-e6frgcjx-1226014363796
- Salganik, M.J., & Levy, K.E.C. (2012). Wiki surveys: Open and quantifiable social data collection. Retrieved from http://arxiv.org/pdf/1202.0500 Serenko A., & Dohan M. (2011). Comparing the expert survey and citation impact journal ranking methods: Example from the field of artificial intelligence. Journal of Informetrics, 5(4), 629–648.
- Strauss, A.L., & Corbin, J. (2008). Basics of qualitative research: Grounded theory procedures and techniques (3rd ed.). Newbury Park, CA: Sage.
- Surowiecki, K. (2004). The wisdom of crowds: Why the many are smarter than the few and how collective wisdom shapes business, economies, societies and nations. New York, NY: Doubleday.
- Toffler, A. (1980). The third wave. New York, NY: Bantam Books.
- University of Washington. (2012). Eigenfactor.org: Ranking and mapping scientific knowledge. Retrieved from http://www.eigenfactor.org/ White, T. (2012). Hadoop: The definitive guide (3rd ed.). Sebastopol, CA: O’Reilly.
These references have been extracted automatically and may have some errors. Signed in users can suggest corrections to these mistakes.
Suggest Corrections to References