Elsevier

Measurement

Volume 46, Issue 9, November 2013, Pages 3291-3307
Measurement

Review
State of the art and future developments of measurement applications on smartphones

https://doi.org/10.1016/j.measurement.2013.05.006Get rights and content

Abstract

The modern smartphones contain different sensor technologies, so they can be used as stand-alone measurement instruments on a wide range of application domains. The paper deals with a survey of measurement applications based on smartphones. In the first part, the evolution of mobile phone technologies, including the sensors and mobile networks developments, is presented. Then, in order to highlight the sensors and the communication capabilities, the architectural overview of the hardware and software technologies, which are available on latest series of smartphones, is reported and discussed. A review of measurements applications using the smart sensors and the communication interfaces available on smartphones, it is also presented. A classification of smartphone applications, which looks the smartphone as a handheld measurement instrument, is presented. In the last part, the integration of augmented reality to the measurement applications and new type of measurement systems, having a smartphone as processing support, is presented.

Introduction

In the everyday experience, it is necessary to make measurements. Anytime one interacts with the environment around, he/she is making measurements of physical quantities. For this reason, it is important that measurements are available as friendly as possible for specialized and non-specialized people. A measurement is available if the measurement system is accessible and easy to use. For the everyday experience, a usable measurement system has the following features: (i) non-invasive, (ii) user friendly, and (iii) portable. A modern smartphone allows measuring of different physical quantities directly from its embedded sensors, e.g. three-axis accelerometer, three-axis magnetometer, barometer, light sensor, and so on. Moreover, the smartphone can communicate with other apparatuses (e.g. wireless sensor nodes, data acquisition boards, etc.) through wireless interfaces, such as Bluetooth, Wi-Fi and Near Field Communication (NFC). Thanks to these technologies, the smartphone is candidate to be considered as a measurement system, too.

The statistical data available on [1] present the United States (US) smartphone users and penetration on the market. In 2010, the US smartphone users were 60.2 millions, the 26.0% of mobile phone users and the 19.4% of population. Last year, the number of smartphone users was 106.7 millions, the 44.0% of mobile phone users and the 33.8% of population. In 2015 the number of smartphone users is expected to be around 148.6 millions, the 58.0% compared to mobile phone users and the 45.6% of US population. The smartphones are becoming even more popular and their market is expanding continuously.

In time, sensing applications have been developed in order to operate at multiple scales, from personal sensing to global sensing [2]. In [3], the authors classify sensing applications on smartphone in participatory sensing, when the user is directly involved in the sensing action and opportunistic sensing, when the user is not involved in the sensing action. In this way, many smartphone applications have been developed to implement sensing systems [4], [5], [6] and different researchers have been focused their works on the development of systems that use the smartphone as a sensing device [7], [8].

In this paper, applications, where the smartphone is described from the point of view of measurements, are presented. Furthermore, a new classification of smartphone applications, which looks the smartphone as a handheld measurement instrument, is presented. In order to highlight the hardware and the software capabilities for using the smartphone in measurement applications, the smartphone technology is described. A new user interface for measurement application, based on mobile augmented reality, is described, too.

After the introduction, the paper is organized as follows. Section 2 offers a brief history of mobile phones, with the evolution of the hardware and mobile network. In Section 3, in order to highlight the hardware capabilities of smartphone as measurement instrument, an overview on the smartphone architecture is presented. Section 4 describes the sensors integrated in a modern smartphone, highlighting the hardware of the iPhone 5. In Section 5, different operating systems for smartphone are discussed. Section 6 describes the smartphone as a handheld measurement system. In Section 7, a survey of measurement applications using the sensors integrated on the smartphone is presented. Section 8 describes applications where the smartphone communicates with external equipment in order to measure physical quantities. The augmented reality on smartphone is presented on Section 9. Finally, Section 10 deals with the future developments of measurement applications on smartphones.

Section snippets

The evolution of mobile phones

In the last 20 years, mobile technologies had an exponential growth due to the development of new network capabilities, the integration of sensors on mobile phones and the introduction of more communication interfaces, as it is shown in Fig. 1.

The second generation networks (2G) are the first digital mobile networks at the global level. The Global System Mobile (GSM) network was released in 1991 and it is the first 2G network [9], [10], [11]. The Nokia 1011 is the first GSM Nokia mobile phone

Smartphone architecture

The definition of smartphone has changed in the time. The simplest mobile device on the market today, has been considered a smartphone 10 years ago [32]. Nowadays, a smartphone, in according to [32] has a multitasking operating system, a full desktop browser, Wi-Fi capability, 3G connection, a music player, a GPS or an Assisted GPS, a digital compass, video camera, TV out, Bluetooth, touch display, 3D video acceleration and Inertial Magnetic Sensors (IMS). The development of the smartphone

Smartphone sensors and communication interfaces

The smartphone interacts with the surrounding environment through the sensors and the communication interfaces. The smartphone sensors measure physical quantities and transmit them to the AP through to a Digital Interface. As it was mentioned before, usually, the smartphone includes smart sensors, composed by [40]: (i) the transducer (converts energy from one form into another), (ii) the signal conditioning (takes the output of the transducer and converts it into a form suitable for following

Operating systems for smartphone

The operating system (OS) represents the software core on smartphone. The smartphone OS can be classified on the basis of [55]: (i) supported mobile phone, (ii) development environment, (iii) software features, (iv) hardware support, (v) power management, and (vi) multimedia capabilities. The market shares of smartphone OSs are shown in Fig. 8. Today, Android is the most popular OS for mobile platforms. It has 56.1% of market share as it is presented in [56]. Android OS was announced by Open

Smartphone as a handheld measurement system

In order to describe the smartphone as a measurement system, there are two leading features that must be considered: the handheld and the sensing capabilities. A smartphone allows user to interact with the external world through its sensors and communication interfaces.

A smartPhone based measurement instrument (SPMI) can be defined as a mobile general-purpose measurement instrument. It is mobile because it can be carried or moved easily, it is general-purpose because it is able to sense

Person oriented applications

The modern smartphones include high-resolution video cameras, processors and Light-Emitting Diode flashes (LEDs). All these elements can be used for medical applications to implement a PhotoPlethysmoGraphy (PPG) system [62]. Such PPG systems are based on the processing of the skin image in order to monitor different physiological parameters [63]: (i) pulse rate, (ii) breathing rate, and (iii) blood oxygen saturation. In [7], a medical application for the heart rate monitoring by using a

Person oriented applications

In [70], a smartphone based portable Doppler flow meter system is presented. In the medical field, blood flow measurements are used in order to prevent cardiovascular diseases. The blood flow parameters are usually measured by using Doppler ultrasound. The architecture of the system for the smartphone is shown in Fig. 13, and it is composed of three main modules: (i) analog circuit, (ii) transducer, and (iii) smartphone. The analog circuit links the smartphone and the transducer. A timing

Augmented reality on smartphone

The augmented reality (AR) technology can be considered as the enrichment of human sensorial perception through the use of added information that is not perceived by the five senses [77], [78]. The idea of AR is to augment the visual field of the user. In [77], the authors give a definition of Mobile AR (MAR) system as a system, which: (i) overlaps a virtual object on an image of the real environment, (ii) runs in real time, and (iii) permits to the user to interact with virtual objects.

Future developments and conclusions

The increasing number of measurement applications on smartphones is due to their capabilities of (i) sensing more and more physical quantities, so that new measurements can be carried out as a fusion of different measured values from new embedded sensors on the smartphone, and (ii) offering wider wireless and wired connection possibilities and smart visual interfaces in order to receive measurements from different systems external to the smartphone.

The development of these capabilities depend

References (88)

  • M. Kesim et al.

    Augmented reality in education: current technologies and the potential for education

    Proceedings of Cyprus International Conference on Educational Research (CY-ICER-2012)

    (2012)
  • US Smartphone Users and Penetration, 2010–2015, August 2011....
  • N. Lane et al.

    A survey of mobile phone sensing

    IEEE Communications Magazine

    (2010)
  • W.Z. Khan et al.

    Mobile phone sensing systems: a survey

    IEEE Communications Surveys and Tutorials

    (2013)
  • Metal Detector Application....
  • Wind Speed Meter Application....
  • Android Application Partometer....
  • P. Pelegris, K. Banitsas, T. Orbach, K. Marias. A novel method to detect heart beat rate using a mobile phone, in:...
  • D.A. Johnson, M.M. Trivedi, “Driving style recognition using a smartphone as a sensor platform, in: Proceedins of the...
  • P. Chitrapu, B.Aghili, Evolution of GSM into the next generation wireless world, in: Proceedings of IEEE Systems,...
  • S. Akhtar, “Encyclopedia of multimedia technology and networking”, second ed., M. Pagani (Ed.), 2008, pp....
  • N.R. Prasad, “GSM evolution towards third generation UMTS/IMT2000”, in: Proceedins of IEEE International Conference on...
  • NOKIA 1011, 2G Mobile Phone....
  • D. Calin, D. Zeghlache, “Analysis of GSM HSCSD service with channel allocation constraints”, in: Proceedings of 9th...
  • NOKIA 8810, Mobile Phone....
  • Benefon Esc!, GPS Integreted Mobile Phone....
  • NOKIA 7110, Mobile Phone....
  • A. Furuskar et al.

    EDGE: enhanced data rates for GSM and TDMA/136 evolution

    Journal of IEEE Personal Communications

    (1999)
  • M. Rohs, Camera-based interaction and interaction with public displays, White paper Deutsche Telekom Laboratories, TU...
  • Ericsson T39, Bluetooth Capability Mobile Phone....
  • M.R. Bhalla et al.

    Generations of mobile wireless technology: a survey

    International Journal of Computer Applications

    (2010)
  • A. Samukic

    UMTS universal mobile telecommunication system: development of standard for the third generation

    IEEE Transactions on Vehicular Technology

    (1998)
  • Motorola A845, Mobile Phone....
  • TREO 700w, Smartphone....
  • T. Kato

    Next generation mobile network

    FUJITSU Science Technology Journal

    (2012)
  • Apple iPhone, Smartphone....
  • J. Govil, J. Govil, 4G: functionalities development and an analysis of mobile wireless grid, in: Proceedings of ICETET...
  • HTC EVO 4G, Smartphone....
  • Apple....
  • Samsung Galaxy S III, Smartphone....
  • Google, Nexus Specifications....
  • T. Janevski, 5G Mobile Phone Concept, in: Proceedings of IEEE Consumer Communications and Networking Conference, 10–13...
  • M. Firtman

    Programming the Mobile Web

    (2010)
  • N.D. Lane et al.

    A survey of mobile phone sensing

    IEEE Communications Magazine

    (2010)
  • T. Johnson, M.Ridell, B.Scrivner, “Application Processors & Ubiquitous Multimedia”, ECE 477/577 – Multimedia Systems,...
  • ARM Coretex-A Series, Processors....
  • Exynos 4 Quad, Apllications Processor....
  • Camera Interface, Interface....
  • T. Hoye, J. Kozak, “Touch screen: a pressing technology”, in: Proceedings of Tenth Annual Freshman Conference,...
  • SD Association, “SD Card Specification Simplified Version of: Part E1”, SD Card Association, October 2001....
  • R. Frank

    Understanding Smart Sensors, Artech House

    (2000)
  • C.C. Huang, J.A. Kuo, Photosensitive circuit for detecting an object having a switch unit respectively providing...
  • C.C. Huang, J.A. Kuo, Photo sensing method with a variation of received light calculated based on a difference between...
  • R.Narendran, A Study of CMOS Cameras, ELEC 663 Aburn University,...
  • Cited by (81)

    • Review on smartphone sensing technology for structural health monitoring

      2023, Measurement: Journal of the International Measurement Confederation
    • Mobile digital colorimetry for the determination of ammonia in aquaculture applications

      2021, Computers and Electronics in Agriculture
      Citation Excerpt :

      Nowadays, devices that incorporate digital cameras such as smartphones or tablets are very common, and about one out of three people have a device with such photographic capabilities (O’Dea, 2020). For this reason, it is convenient to develop software tools for these devices in order to turn them into measuring instruments (Daponte et al., 2013) for different kinds of physical variables. In this work, we propose a process with low cost and complexity to determine the concentration of ammonia in the water of aquacultural farms.

    • Smartphone-based molecular sensing for advanced characterization of asphalt concrete materials

      2020, Measurement: Journal of the International Measurement Confederation
    View all citing articles on Scopus
    View full text