Skip to main content

Cooperative object manipulation in collaborative virtual environments

Abstract

Cooperative manipulation refers to the simultaneous manipulation of a virtual object by multiple users in an immersive virtual environment (VE). In this work, we present techniques for cooperative manipulation based on existing single-user techniques. We discuss methods of combining simultaneous user actions, based on the separation of degrees of freedom between two users, and the awareness tools used to provide the necessary knowledge of the partner activities during the cooperative interaction process. We also present a framework for supporting the development of cooperative manipulation techniques, which are based on rules for combining single user interaction techniques. Finally, we report an evaluation of cooperative manipulation scenarios, the results indicating that, in certain situations, cooperative manipulation is more efficient and usable than singleuser manipulation.

References

  1. C. Basdogan, C. Ho, M. A. Srinivasan, M. Slater. An Experimental Study on the Role of Touch in Shared Virtual Environments.ACM Transactions on Computer-Human Interaction, 7(4):443–460, 2000.

    Article  Google Scholar 

  2. R. Bolt. Put-that-there: Voice and Gesture at the Graphic Interface.Computer Graphics, 14(3): 262–270, 1980

    Article  MathSciNet  Google Scholar 

  3. D. Bowman, L.F. Hodges. An Evaluation of Techniques for Grabbing and Manipulating Remote Objects in Immersive Virtual Environments. InProceedings of 1997 Symposium on Interactive 3D Graphics (I3D). ACM Press, New York, p. 35–38, 1997.

    Chapter  Google Scholar 

  4. D. Bowman, L.F. Hodges. Formalizing the Design, Evaluation, and Application of Interaction Techniques for Immersive Virtual Environments.The Journal of Visual Languages and Computing, 10(1): 37–53, 1999.

    Article  Google Scholar 

  5. D. Bowman, D. Johnson, L.F. Hodges. Testbed Evaluation of Virtual Environment Interaction Techniques.Presence: Teleoperators and Virtual Environments, 10(1):75–95, 2001.

    Article  Google Scholar 

  6. D. Bowman, E. Kruijff, J. LaViola, I. Poupyrev. 3D User Interfaces: Theory and Practice. Addison-Wesley, Boston, 2004.

    Google Scholar 

  7. L.D. Cutler, B. Fröhlich, P. Hanrahan. Twohanded direct manipulation on the responsive workbench. InProceedings of the 1997 Symposium on Interactive 3D Graphics (I3D). ACM Press, New York, p. 107–114, 1997.

    Google Scholar 

  8. T. Duval, A. Lecuyer, S. Thomas. SkeweR: a 3D Interaction Technique for 2-User Collaborative Manipulation of Objects in Virtual Environments. InProceedings of the IEEE Symposium on 3D User Interfaces (3DUI 2006), IEEE Computer Society Press, Los Alamitos, p. 69–72, 2006.

    Chapter  Google Scholar 

  9. Y. Fabre, G. Pitel, D. Verna, D. Urbi et Orbi: Unusual Design and Implementation Choices for Distributed Virtual Environments. InProceedings of 6th International Conference on Virtual Systems and Multimedia (VSMM’2000), p. 714–724, 2000.

  10. E. Frécon, M. Stenius. DIVE: A Scalable Network Architecture for Distributed Virtual Environments.Distributed Systems Engineering Journal, 5(3):91–100, 1998.

    Article  Google Scholar 

  11. M. Goebel. Digital Storytelling — Creating Interactive Illusions with Avocado. InProceedings of International Conference on Artificial Reality and Telexistence (ICAT’99), Japan, p. 9–22, 1999.

  12. C. Greenhalgh, S. Benford. MASSIVE: A Virtual Reality System for Tele-conferencing.ACM Transactions on Computer Human Interfaces, 2(3):239–261, 1995.

    Article  Google Scholar 

  13. K. Hinckley, R. Pausch, D. Proffitt, N.F. Kassell. Two-handed virtual manipulation.ACM Trans. Computer Human Interaction, 5(3): 260–302, 1998.

    Article  Google Scholar 

  14. G. Kessler, D. Bowman, L.F. Hodges. The Simple Virtual Environment Library: an Extensible Framework for Building VE Applications.Presence: Teleoperators and Virtual Environments, 9(2): 187–208, 2000.

    Article  Google Scholar 

  15. A. Leganchuk, S. Zhai, W. Buxton. Manual and Cognitive Benefits of Two-Handed Input: An Experimental Study.ACM Transactions on Computer-Human Interaction, 5(4):326–359, 1998.

    Article  Google Scholar 

  16. M. Macedonia, M. Zyda, D. Pratt, P. Barham. Exploiting reality with multicast groups: A Network Architecture for Large-Scale Virtual Environments. InProceedings of IEEE Virtual Reality Annual International Symposium (VRAIS’95), IEEE Computer Society Press, Los Alamitos, CA, p.15–19, 1995.

    Google Scholar 

  17. D. Margery, B. Arnaldi, N. Plouzeau. A General Framework for Cooperative Manipulation in Vrirtual Enviroments. InProceedings of the IEEE Virtual Environments’ 99, IEEE Computer Society Press, Los Alamitos, CA, p. 169–178, 1999.

    Google Scholar 

  18. M. Mine. Virtual environment interaction techniques. UNC Chapel Hill CS Dept. Technical Report TR95-018m, 1995.

  19. M. Mine, F. Brooks, C. Sequin. Moving Objects in Space: Exploiting Proprioception in Virtual-Environment Interaction. InProceedings of the 1997 ACM Conference on Graphics (SIGGRAPH’97), p. 19–26, ACM Press, New York, 1997.

    Chapter  Google Scholar 

  20. J. Mulder. Remote Object Translation Methods for Immersive Virtual Environments. InProceedings of Virtual Environments Conference & 4th Eurographics Workshop (EGVE’98), p. 80–89, 1998.

  21. M. S. Pinho, D. Bowman, C.M.D.S. Freitas. Cooperative Object Manipulation in Immersive Virtual Environments: Framework and Techniques. InProceedings of ACM Virtual Reality Software and Technology (VRST 2002), ACM Press, New York, p. 171–178, 2002.

    Chapter  Google Scholar 

  22. I. Poupyrev, M. Billinghurst, S. Weghorst, T. Ichikawa. The Go-Go Interaction Technique: Non-linear Mapping for Direct Manipulation in VR. InProceedings of the ACM Symposium on User Interface Software and Technology (UIST’96), p. 79–80, 1996.

  23. R.A. Ruddle, J.C. Savage, D.M. Jones. Movement in Cluttered Virtual Environments.Presence: Teleoperators and Virtual Environments, 10(5): 511–524, 2001.

    Article  Google Scholar 

  24. R.A. Ruddle, J.C. Savage, D.M. Jones. Symmetric and Asymmetric Action Integration During Cooperative Object Manipulation in Virtual Environments.ACM Transactions on Computer-Human Interaction, 9(4):285–308, 2002.

    Article  Google Scholar 

  25. R.A. Ruddle, J.C. Savage, D.M. Jones. Levels of control during a collaborative carrying task.Presence: Teleoperators and Virtual Environments, 12(2):140–155, 2003.

    Article  Google Scholar 

  26. E.L. Sallnäs. Collaboration in Multimodal Virtual Worlds: Comparing Touch, Text, Voice and Video. In Social Life of Avatars. Schroeder, R.

  27. S. Smith, D. Duke. Virtual Environments as Hybrid Systems. InProceedings of the 17th Eurographics Annual Conference (Eurographics’99), Eurographics/Blackwell, Oxford, p. 169–178, 1999.

    Google Scholar 

  28. R. Stoakley, M. Conway, R. Pausch. Virtual reality on a WIM: interactive worlds in miniature. InProceedings of CHI’95, ACM Press, New York, p. 265–272, 1995.

    Google Scholar 

  29. J. Viega, M. Conway, G. Williams, R. Pausch. 3D Magic Lenses. InProceedings of ACM Symposium on User Interface Software and Technology (UIST’96), ACM Press, New York, p. 51–58, 1996.

    Google Scholar 

  30. J. Wainer, C. Barsottini. Empirical research in CSCW — a review of the ACM/CSCW conferences from 1998 to 2004.Journal of the Brazilian Computer Society, 13(3):27–36, September 2008.

    Article  Google Scholar 

  31. K. Watsen, M. Zyda. Bamboo — a Portable System for Dynamically Extensible, Real-time, Networked, Virtual Environments. InProceedings of IEEE Virtual Reality Annual International Symposium (VRAIS’98), p. 252–260, 1998.

  32. H.P. Wyss, R. Bach, M. Bues. iSith — Intersection-based Spatial Interaction for Two Hands. InProceedings of IEEE Symposium on 3D User Interfaces (3DUI 2006), IEEE Computer Society Press, Los Alamitos, p. 69–72, 2006

    Google Scholar 

  33. S. Zhai, P. Milgram. Quantifying Coordination and Its Application to Evaluating 6 DOF Input Devices. InProceedings of CHI’98, ACM Press, New York, p. 320–327, 1998.

    Google Scholar 

Download references

Author information

Affiliations

Authors

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and Permissions

About this article

Cite this article

Pinho, M.S., Bowman, D.A. & Freitas, C.M.D.S. Cooperative object manipulation in collaborative virtual environments. J Braz Comp Soc 14, 53–67 (2008). https://doi.org/10.1007/BF03192559

Download citation

  • Received:

  • Accepted:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF03192559

Keywords

  • Cooperative interaction
  • Collaborative interaction
  • Virtual environments
  • Interaction techniques
  • VR experiments