Skip to main content

Empirical research in CSCW — a review of the ACM/CSCW conferences from 1998 to 2004

Abstract

This paper reviews all the 169 full papers published in the ACM/CSCW conferences from 1998 to 2004. We classify the papers according to the type of empirical research they report. The classes are evaluation of groupware, description of work situations, hypothesis testing, bibliographic research, and papers with no empirical research. We show that the field is in constant change, that the proportions of papers in these different categories have been changing in these 6 years, and that for the evaluation papers, the results by Pinelle and Gutwin do not carry for the 1998–2004 period

References

  • [1]_ACM. TOC: Computer Supported Cooperative Work. http://portal.acm.org/toc.cfm?id=SERIES296, 2007.

  • [2]_P. Antunes, M. Borges, J. Pino, and L. Carriço. Analyzing groupware design by means of usability results.Proceedings of the Ninth International Conference on Computer Supported Cooperative Work in Design, 2005.

  • [3]_R. M. Araujo, F. M. Santoro, and M. Borges. The CSCW Lab for groupware evaluation. InGroupware: Design, Implementation and Use: 8th International Workshop, CRIWG 2002, number 2440 in Lecture Notes in Computer Science, pages 222–231. Springer, 2002.

  • [4]_R. M. Araujo, F. M. Santoro, and M.R.S. Borges. The CSCW Lab ontology for groupware evaluation. InProceedings of the 8th International Conference on Computer Supported Cooperative Work in Design, pages 148–153. IEEE Press, 2004.

  • [5]_R. Baeza-Yates and J. A. Pino. A first step to formally evaluate collaborative work. InGROUP ’97: Proceedings of the international ACM SIGGROUP conference on Supporting group work, pages 56–60, New York, NY, USA, 1997. ACM Press.

  • [6]_Andrew L. Cohen, Debra Cash, and Michael J. Muller. Designing to support adversarial collaboration. InCSCW ’00: Proceedings of the 2000 ACM conference on Computer supported cooperative work, pages 31–39, New York, NY, USA, 2000. ACM Press.

  • [7]_K. Eason and W. Olphert. Early evaluation of the organizational implications of CSCW systems. In P. Thomas, editor,CSCW Requirements and Evaluation, pages 75–89. Springer, 1996.

  • [8]_R. L. Glass, V. Ramesh, and I. Vessey. An analysis of research in computing disciplines.Commun. ACM, 47(6):89–94, 2004.

    Article  Google Scholar 

  • [9]_Rebecca E. Grinter and Leysia Palen. Instant messaging in teen life. InCSCW ’02: Proceedings of the 2002 ACM conference on Computer supported cooperative work, pages 21–30, New York, NY, USA, 2002. ACM Press.

  • [10]_J. Grudin. Groupware and social dynamics: eight challenges for developers.Commun. ACM, 37(1):92–105,1994.

    Article  Google Scholar 

  • [11] _E. G. Guba and Y. S. Lincon.Effective evaluation. Jossey-Bass, 1981.

  • [12]_Lena Mamykina and Catherine G. Wolf. Evolution of contact point: a case study of a help desk and its users. InCSCW ’00: Proceedings of the 2000 ACM conference on Computer supported cooperative work, pages 41–48, New York, NY, USA, 2000. ACM Press.

  • [13]_J.E. McGrath. Methodology matters: Doing research in the behavioral and social sciences. In RM. Baecker, J. Grudin, W.A.S. Buxton, and S. Greenberg, editors,Readings in Human-Computer Interaction: Toward the Year 2000, pages 152–169. Morgan Kaufman Publishers, 1995.

  • [14]_Dennis C. Neale, John M Carroll, and Mary Beth Rosson. Evaluating computer-supported cooperative work: models and frameworks. InCSCW ’04: Proceedings of the 2004 ACM conference on Computer supported cooperative work, pages 112–121, New York, NY, USA, 2004. ACM Press.

  • [15]_W. Orlikowski and J. Baroudi. Studying information technology in organizations: Research approaches and assumptions.Information Systems Research, 2(1):1–28, 1991.

    Article  Google Scholar 

  • [16]_D. Pinelle and C. Gutwin. A review of groupware evaluations. InProceedings of WET ICE 2000, pages 86–91. IEEE Computer Society, 2000.

  • [17]_D. Pinelle, C. Gutwin, and S. Greenberg. Task analysis for groupware usability evaluation: Modeling shared-workspace tasks with the mechanics of collaboration.ACM Transactions on Computer-Human Interaction (TOCHI), 10(4):281–311, 2003.

    Article  Google Scholar 

  • [18]_A. Pinsonnealult and K. L. Kraemer. The impact of technological support on groups: An assessment of the empirical research.Decision Support Systems, 5(2):197–216, 1989.

    Article  Google Scholar 

  • [19]_V. Ramesh, R.L. Glass, and I. Vessey. Research in computer science: An empirical study.Journal of Systems and Software, 70(1–2): 165–176, 2004.

    Article  Google Scholar 

  • [20]_M.P. Steves, E. Morse, C. Gutwin, and S. Greenberg. A comparison of usage evaluation and inspection methods for assessing groupware usability.Proceedings of the 2001 International ACM SIG-GROUP Conference on Supporting Group Work, pages 125–134, 2001.

  • [21]_L.A. Suchman.Plans and Situated Actions: The Problem of Human-Machine Communication. Cambridge University Press, 1987.

  • [22]_W. F. Tichy, P. Lukowicz, L. Prechelt, and E. A. Heinz. Experimental evaluation in computer science: A quantitative study.Journal of Systems and Software, 28(1):9–18, 1995.

    Article  Google Scholar 

  • [23]_Steve Whittaker, Quentin Jones, and Loren Terveen. Contact management: identifying contacts to support long-term communication. InCSCW ’02: Proceedings of the 2002 ACM conference on Computer supported cooperative work, pages 216–225, New York, NY, USA, 2002. ACM Press.

Download references

Author information

Affiliations

Authors

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and Permissions

About this article

Cite this article

Wainer, J., Barsottini, C. Empirical research in CSCW — a review of the ACM/CSCW conferences from 1998 to 2004. J Braz Comp Soc 13, 27–35 (2007). https://doi.org/10.1007/BF03192543

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF03192543

Keywords

  • groupware
  • CSCW
  • systematic review
  • empirical research
  • bibliographic review
  • evaluation