Skip to main content
SpringerLink
Log in

A 5 degrees of freedom multi-user pointing device for interactive whiteboards

  • Industrial and Commercial Application
  • Published:
Pattern Analysis and Applications Aims and scope Submit manuscript

Abstract

Interactive whiteboards are nowadays rather common equipments in classrooms as they provide large advantages in terms of expressive power. Despite the radical paradigm shift, their interaction model is firmly tied to the archetypal concept of strokes and gestures over a whiteboard. In this paper we introduce a novel pointing device that enables one to escape the surface-based interaction, by means of a robust and occlusion-resilient multi-camera 3D tracking. More precisely, we designed a frequency-based active pen. By means of a camera network such pen can be localized in a 3D frame featuring the same 5 degrees of freedom exposed by a real whiteboard marker. Our approach allows for using many pointers at the same time, by reliably assigning an unique and permanent identity to each one. By levering on these capabilities, interaction designers can conceive new and inventive interaction models. A few of them have been implemented within this study and are described in the experimental part of this work.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Albarelli A, Rodolà E, Bergamasco F, Torsello A (2011) A non-cooperative game for 3D object recognition in cluttered scenes. In: Proceedings—2011 international conference on 3D imaging, modeling, processing, visualization and transmission, 3DIMPVT, pp 252–259. doi:10.1109/3DIMPVT.2011.39

  2. Balsamo S, Marin A (2007) Queueing networks. In 7th international school on formal methods for the design of computer, communication, and software systems, pp 34–82. doi:10.1007/978-3-540-72522-0_2

  3. Balsamo S, Marin A (2011) Performance engineering with product-form models: efficient solutions and applications. In: Proceedings of the 2nd ACM/SPEC international conference on performance engineering (ICPE '11), pp 437–448. ACM, New York, NY, USA. doi:10.1145/1958746.1958812

  4. Bartoli Adrien, Lapresté Jean-Thierry (2008) Triangulation for points on lines. Image Vis Comput 26(2):315–324

    Article  MathSciNet  Google Scholar 

  5. Bartu Petr, Neulinger Anton, Jakoby Bernhard, Bauer Siegfried, Koeppe Robert (2013) Light curtain for 2d large-area object detection. Opt Express 21(10):12757–12766

    Article  Google Scholar 

  6. Bergamasco F, Albarelli A, Rodola E, Torsello A (2011) Rune-tag: a high accuracy fiducial marker with strong occlusion resilience. In: Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition, CVPR ’11, pp 113–120, Washington, DC. (IEEE Computer Society)

  7. Bergamasco Filippo, Albarelli Andrea, Torsello Andrea (2013) Pi-tag: a fast image-space marker design based on projective invariants. Mach Vis Appl 24(6):1295–1310

    Article  Google Scholar 

  8. Bosetti M, Pilolli P, Ruffoni M, Ronchetti M (2011) Interactive whiteboards based on the wiimote: Validation on the field. In: Interactive Collaborative Learning (ICL), 2011 14th International Conference on, pp 269–273

  9. Bradski G, Kaehler A (2008) Learning OpenCV: computer vision with the OpenCV Library. O’Reilly Media Inc, 1st edn

  10. Brandl P, Haller M, Hurnaus M, Lugmayr V, Oberngruber J, Oster C, Schafleitner C, Billinghurst M (2007) An adaptable rear-projection screen using digital pens and hand gestures. In: Artificial reality and telexistence, 17th International Conference on, pp 49–54

  11. Camplani M, Salgado L, Camplani R (2012) Low-cost efficient interactive whiteboard. In: Consumer electronics (ICCE), 2012 IEEE International Conference on, pp 686–687

  12. Chesi Graziano, Hung Yeungsam (2011) Fast multiple-view l2 triangulation with occlusion handling. Comput Vis Image Underst 115(2):211–223

    Article  Google Scholar 

  13. Dietz P, Leigh D (2001) Diamondtouch: a multi-user touch technology. In: Proceedings of the 14th annual ACM symposium on User interface software and technology, UIST ’01, ACM, New York, pp 219–226

  14. Elrod S, Bruce R, Gold R, Goldberg D, Halasz F, Janssen W, Lee D, McCall K, Pedersen E, Pier K, Tang J, Welch B (1992) Liveboard: a large interactive display supporting group meetings, presentations and remote collaboration. In: Proc. Conf. on Human Factors in Computing Systems (CHI). ACM Press, New York, pp 599–607

  15. Fiala Mark (2010) Designing highly reliable fiducial markers. Pattern Anal Mach Intell IEEE Trans 32(7):1317–1324

    Article  MathSciNet  Google Scholar 

  16. Hartley Richard I, Sturm Peter (1997) Triangulation. Comput Vis Image Underst 68(2):146–157

    Article  Google Scholar 

  17. Horn BKP (1987) Closed-form solution of absolute orientation using unit quaternions. J Opt Soc Am A 4(4):629–642

  18. Emil Kalman R (1960) A new approach to linear filtering and prediction problems. Trans ASME J Basic Eng 1(82 (Series D)):35–45

  19. Kim Sunkook, Choi Woong, Rim Woojin, Chun Youngtea, Shim Hongsik, Kwon Hyukjun, Kim Jongsoo, Kee Inseo, Kim Sungchul, Lee Sangyoon, Park Jongsun (2011) A highly sensitive capacitive touch sensor integrated on a thin-film-encapsulated active-matrix oled for ultrathin displays. Electron Devices IEEE Trans 58(10):3609–3615

    Article  Google Scholar 

  20. Lech M, Kostek B (2010) Gesture-based computer control system applied to the interactive whiteboard. In: Information Technology (ICIT), 2010 2nd International Conference on, pp 75–78

  21. Liang R-H, Su C-H, Weng C-T, Cheng K-Y, Chen B-Y, Yang D-N (2012) Gaussbrush: drawing with magnetic stylus. In: SIGGRAPH Asia 2012 Emerging Technologies, SA ’12, ACM, New York, pp 11:1–11:2

  22. Liang Tsung-Ho, Huang Yueh-Min, Tsai Chin-Chung (2012) An investigation of teaching and learning interaction factors for the use of the interactive whiteboard technology. Educ Technol Soc 15(4):356–367

    Google Scholar 

  23. Musa Eldar (2008) Laser-based light barrier. Appl Opt 47(19):3415–3422

    Article  Google Scholar 

  24. Otsu Nobuyuki (1979) A threshold selection method from gray-level histograms. Syst Man Cybern IEEE Trans 9(1):62–66

    Article  MathSciNet  Google Scholar 

  25. Ouellet J, Hebert P (2009) Precise ellipse estimation without contour point extraction. Mach. Vision Appl. p 21

  26. Pinhanez C (2001) Using a steerable projector and a camera to transform surfaces into interactive displays. In: CHI ’01 Extended Abstracts on Human Factors in Computing Systems, CHI EA ’01, ACM, New York, pp 369–370

  27. Shi Y, Yang Z, Hao Yang H, Liu S (2012) Study on the research hotspots of interactive whiteboards in education. In: Yu X, Lienhart R, Zha Z-J, Yan L, Satoh S (eds) ICIMCS, ACM, pp 209–212

  28. Slay Hannah, Siebrger Ingrid, Hodgkinson-Williams Cheryl (2008) Interactive whiteboards: real beauty or just lipstick? Comput Educ 51(3):1321–1341

    Article  Google Scholar 

  29. Smith Heather J, Higgins Steve, Wall Kate, Miller Jen (2005) Interactive whiteboards: boon or bandwagon? a critical review of the literature. J Comput Assist Learn 21(2):91–101

    Article  Google Scholar 

  30. So E, Zhang H, Guan YS (1999) Sensing contact with analog resistive technology. In: Systems, Man, and Cybernetics, 1999. IEEE SMC ’99 Conference Proceedings. 1999 IEEE International Conference on, vol 2, pp 806–811

  31. Stewenius H, Schaffalitzky F, Nister D (2005) How hard is 3-view triangulation really? In: Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV’05) vol 1, ICCV ’05, IEEE Computer Society, Washington, DC, pp 686–693

  32. Sung Kelvin (2011) Recent videogame console technologies. Computer 44(2):91–93

    Article  Google Scholar 

  33. Takeoka Y, Miyaki T, Rekimoto J (2010) Z-touch: an infrastructure for 3d gesture interaction in the proximity of tabletop surfaces. In: ACM International Conference on Interactive Tabletops and Surfaces, ITS ’10, ACM, New York, pp 91–94

  34. Tang JC, Minneman S (1991) Videowhiteboard: video shadows to support remote collaboration. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’91, ACM, New York, pp 315–322

  35. Tang JC, Minneman SL (1990) Videodraw: a video interface for collaborative drawing. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’90, ACM, New York, pp 313–320

  36. Torsello A, Rodola E, Albarelli A (2011) Multiview registration via graph diffusion of dual quaternions. In: Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on, pp 2441–2448

  37. Torsello A, Rodolà E, Albarelli A (2011) Sampling relevant points for surface registration. In: 2011 international conference on 3D imaging, modeling, processing, visualization and transmission (3DIMPVT), pp 290–295. Hangzhou, 16–19 May 2011. doi:10.1109/3DIMPVT.2011.43

  38. Walny Jagoda, Lee Bongshin, Johns Paul, Henry Riche Nathalie, Carpendale Sheelagh (2012) Understanding pen and touch interaction for data exploration on interactive whiteboards. IEEE Trans Vis Comput Graph 18(12):2779–2788

    Article  Google Scholar 

  39. Wang Z, Louey J (2008) Economical solution for an easy to use interactive whiteboard. In: Frontier of Computer Science and Technology, 2008. FCST ’08. Japan-China Joint Workshop on, pp 197–203

  40. Wilson AD (2005) Playanywhere: a compact interactive tabletop projection-vision system. In: Proceedings of the 18th annual ACM symposium on User interface software and technology, UIST ’05, ACM, New York, pp 83–92

  41. Zhang H, So E (2002) Hybrid resistive tactile sensing. Syst Man Cybern Part B: Cybern IEEE Trans 32(1):57–65

  42. Zhang S, He W, Yu Q, Zheng X (2012) Low-cost interactive whiteboard using the kinect. In: Image Analysis and Signal Processing (IASP), 2012 International Conference on, pp 1–5

Download references

Author information

Authors and Affiliations

  1. Dipartimento di Scienze Ambientali, Informatica e Statistica, Università Ca’ Foscari Venezia, Venice, Italy

    Andrea Albarelli, Luca Cosmo, Filippo Bergamasco, Flavio Sartoretto & Andrea Torsello

Authors
  1. Andrea Albarelli
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Luca Cosmo
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Filippo Bergamasco
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Flavio Sartoretto
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Andrea Torsello
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Andrea Albarelli.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Albarelli, A., Cosmo, L., Bergamasco, F. et al. A 5 degrees of freedom multi-user pointing device for interactive whiteboards. Pattern Anal Applic 19, 237–250 (2016). https://doi.org/10.1007/s10044-015-0457-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10044-015-0457-3

Keywords

Search

Navigation