A Study on Internet of Things Performance Evaluation

Wasswa Shafik, Mojtaba Matinkhah, Melika Asadi, Zahra Ahmadi, Zahra Hadiyan

Abstract


In recurrent years, Internet of Things (IoT) being a scheme of interrelated computing devices that are provided with unique identifiers and with the ability to transfer data over a network without requiring human-tocomputer or even human-to-human interaction, there are common example of IoTs that include Smart technologies like Nest Smart Home, Kisi Smart Lock, canary security
systems, mirrors, bags, watches, gloves, tracking systems among others, IoTs have emerged in the computing arenas. Due to this increased usage of IoTs in some aspects, its performance has not been focused on per the current studies. In this paper, we present a detailed comprehensive study on the main performance of IoTs. The main IoTs have been further examined and analyzed,
like a case, for example, IoT security, IoT congestion control, IoT flow control, IoT energy consumption efficiency in different aspects of the computing. The
summarized table of the IoT performance evaluation can be used by researchers in developing models that solve the presented current technological issues.


Keywords


Internet of Things; Energy Evaluation; Security Assessments; Wireless Computing; Control Measures

Full Text:

PDF

References


Shafik, Wasswa, S. Mojtaba Matinkhah, and Mohammad Ghasemzadeh. "Internet of Things-Based Energy Management, Challenges, and Solutions in Smart Cities." Journal of Communications Technology, Electronics and Computer Science 27 (2020): 1-11.

P. Solic, Z. Blazevic, M. Skiljo, L. Patrono, R. Colella, and {and} Joel J. P. C. Rodrigues, “Gen2 RFID as IoT Enabler: Characterization and Performance Improvement,†IEEE Wireless Communications, vol. 24, no. 3, pp. 33–39, Jun. 2017, doi: 10.1109/MWC.2017.1600431.

J. Zhang, R. S. Blum, and H. V. Poor, “Approaches to Secure Inference in the Internet of Things: Performance Bounds, Algorithms, and Effective Attacks on IoT Sensor Networks,†IEEE Signal Processing Magazine, vol. 35, no. 5, pp. 50–63, Sep. 2018, doi: 10.1109/MSP.2018.2842261.

J. A. Belloch, J. M. Badía, F. D. Igual, and M. Cobos, “Practical Considerations for Acoustic Source Localization in the IoT Era: Platforms, Energy Efficiency, and Performance,†IEEE Internet of Things Journal, vol. 6, no. 3, pp. 5068–5079, Jun. 2019, doi: 10.1109/JIOT.2019.2895742.

W. U. Rahman, Y.-S. Choi, and K. Chung, “Performance Evaluation of Video Streaming Application Over CoAP in IoT,†IEEE Access, vol. 7, pp. 39852–39861, 2019, doi: 10.1109/ACCESS.2019.2907157.

T. Yokotani, A. Shimuzu, Y. Sasaki, and H. Mukai, “Proposals for packet processing and performance evaluation of IoT devices,†in 2017 Japan-Africa Conference on Electronics, Communications and Computers (JAC-ECC), 2017, pp. 5–8, doi: 10.1109/JEC-ECC.2017.8305766.

N. Kaur and S. K. Sood, “A Game Theoretic Approach for an IoT-Based Automated Employee Performance Evaluation,†IEEE Systems Journal, vol. 11, no. 3, pp. 1385–1394, Sep. 2017, doi: 10.1109/JSYST.2015.2469102.

M. Z. Ali, J. Mišić, and V. B. Mišić, “Performance Evaluation of Heterogeneous IoT Nodes with Differentiated Qos in Ieee 802.11ah Raw Mechanism,†IEEE Transactions on Vehicular Technology, vol. 68, no. 4, pp. 3905–3918, Apr. 2019, doi: 10.1109/TVT.2019.2897127.

S.-S. Yoo, S.-H. Lee, S.-Y. Jung, and J.-H. Kim, “Performance evaluation of random-access response estimation scheme for IoT communications,†in 2017 IEEE International Conference on Communications (ICC), 2017, pp. 1–6, doi: 10.1109/ICC.2017.7996507.

M. P. R. S. Kiran, V. Subrahmanyam, and P. Rajalakshmi, “Novel Power Management Scheme and Effects of Constrained On-Node Storage on Performance of MAC Layer for Industrial IoT Networks,†IEEE Transactions on Industrial Informatics, vol. 14, no. 5, pp. 2146–2158, May 2018, doi: 10.1109/TII.2017.2766783.

H. G. Moussa and W. Zhuang, “RACH Performance Analysis for Large-Scale Cellular IoT Applications,†IEEE Internet of Things Journal, vol. 6, no. 2, pp. 3364–3372, Apr. 2019, doi: 10.1109/JIOT.2018.2883101.

A. Rauniyar, P. E. Engelstad, and O. N. Østerbø, “Performance Analysis of RF Energy Harvesting and Information Transmission Based on NOMA With Interfering Signal for IoT Relay Systems,†IEEE Sensors Journal, vol. 19, no. 17, pp. 7668–7682, Sep. 2019, doi: 10.1109/JSEN.2019.2914796.

B. Martinez, F. Adelantado, A. Bartoli, and X. Vilajosana, “Exploring the Performance Boundaries of NB-IoT,†IEEE Internet of Things Journal, vol. 6, no. 3, pp. 5702–5712, Jun. 2019, doi: 10.1109/JIOT.2019.2904799.

H.-Y. Jin, E.-S. Jung, and D. Lee, “High-performance IoT streaming data prediction system using Spark: a case study of air pollution,†Neural Comput & Applic, Dec. 2019, doi: 10.1007/s00521-019-04678-9.

C. Lachner and S. Dustdar, “A Performance Evaluation of Data Protection Mechanisms for Resource Constrained IoT Devices,†in 2019 IEEE International Conference on Fog Computing (ICFC), 2019, pp. 47–52.

H. Li, G. Chen, Y. Wang, Y. Gao, and W. Dong, “Accurate Performance Modeling of Uplink Transmission in NB-IoT,†in 2018 IEEE 24th International Conference on Parallel and Distributed Systems (ICPADS), 2018, pp. 910–917.

P. Andres-Maldonado, P. Ameigeiras, J. Prados-Garzon, J. Navarro-Ortiz, and J. M. Lopez-Soler, “An Analytical Performance Evaluation Framework for NB-IoT,†IEEE Internet Things J., vol. 6, no. 4, pp. 7232–7240, Aug. 2019.

V. Chinnalagi, R. Murugeswari, T. Priyadharshni, K. Rajalakshmi, and J. VijithaAnanthi, “Dynamic performance of smart sensor network using IoT,†in 2017 International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC), 2017, pp. 49–53.

E. Khorov et al., “Enabling the Internet of Things With Wi-Fi Halow—Performance Evaluation of the Restricted Access Window,†IEEE Access, vol. 7, pp. 127402–127415, 2019.

Y.-D. Kim, S.-H. Jung, D.-Y. Gu, H.-K. Kim, and C.-H. Song, “IoT Sensor Based Mobility Performance Test-Bed for Disaster Response Robots,†in 2017 6th IIAI International Congress on Advanced Applied Informatics (IIAI-AAI), 2017, pp. 990–991.

X. Li, L. Tan, and F. Li, “Optimal Cloud Resource Allocation With Cost Performance Tradeoff Based on Internet of Things,†IEEE Internet Things J., vol. 6, no. 4, pp. 6876–6886, Aug. 2019.

G. Chen, J. P. Coon, A. Mondal, B. Allen, and J. A. Chambers, “Performance Analysis for Multihop Full-Duplex IoT Networks Subject to Poisson Distributed Interferers,†IEEE Internet Things J., vol. 6, no. 2, pp. 3467–3479, Apr. 2019.

B. Ji, Y. Li, B. Zhou, C. Li, K. Song, and H. Wen, “Performance Analysis of UAV Relay Assisted IoT Communication Network Enhanced With Energy Harvesting,†IEEE Access, vol. 7, pp. 38738–38747, 2019.

W. Li, C. Zhu, V. C. M. Leung, L. T. Yang, and Y. Ma, “Performance Comparison of Cognitive Radio Sensor Networks for Industrial IoT With Different Deployment Patterns,†IEEE Syst. J., vol. 11, no. 3, pp. 1456–1466, Sep. 2017.

W. Rafique and M. Ali Shah, “Performance evaluation of IoT network infrastructure,†in 2016 22nd International Conference on Automation and Computing (ICAC), 2016, pp. 348–353.

J. de C. Silva, P. H. M. Pereira, L. L. de Souza, C. N. M. Marins, G. A. B. Marcondes, and J. J. P. C. Rodrigues, “Performance Evaluation of IoT Network Management Platforms,†in 2018 International Conference on Advances in Computing, Communications and Informatics (ICACCI), 2018, pp. 259–265.

S. El Kafhali, K. Salah, and S. Ben Alla, “Performance Evaluation of IoT-Fog-Cloud Deployment for Healthcare Services,†in 2018 4th International Conference on Cloud Computing Technologies and Applications (Cloudtech), 2018, pp. 1–6.

Z. Ali, S. Henna, A. Akhunzada, M. Raza, and S. W. Kim, “Performance Evaluation of LoRaWAN for Green Internet of Things,†IEEE Access, vol. 7, pp. 164102–164112, 2019.

A. A. Ismail, H. S. Hamza, and A. M. Kotb, “Performance Evaluation of Open Source IoT Platforms,†in 2018 IEEE Global Conference on Internet of Things (GCIoT), 2018, pp. 1–5.

S. Sreeraj and G. S. Kumar, “Performance of IoT protocols under constrained network, a Use Case based approach,†in 2018 International Conference on Communication, Computing and Internet of Things (IC3IoT), 2018, pp. 495–498.

R. Raymundo Belleza and E. Pignaton de Freitas, “Performance study of real-time operating systems for internet of things devices,†IET Softw., vol. 12, no. 3, pp. 176–182, 2018.

O. Novo, “Scalable Access Management in IoT Using Blockchain: A Performance Evaluation,†IEEE Internet Things J., vol. 6, no. 3, pp. 4694–4701, Jun. 2019.

T. Yokotani and Y. Sasaki, “Transfer protocols of tiny data blocks in IoT and their performance evaluation,†in 2016 IEEE 3rd World Forum on Internet of Things (WF-IoT), 2016, pp. 54–57.

D. Zucchetto and A. Zanella, “Uncoordinated Access Schemes for the IoT: Approaches, Regulations, and Performance,†IEEE Commun. Mag., vol. 55, no. 9, pp. 48–54, Sep. 2017.

Suárez-Albela M, Fernández-Caramés TM, Fraga-Lamas P, Castedo L. A Practical Performance Comparison of ECC and RSA for Resource-Constrained IoT Devices. In: 2018 Global Internet of Things Summit (GIoTS). 2018. p. 1–6.

Sun Y, Zhang L, Feng G, Yang B, Cao B, Imran MA. Blockchain-Enabled Wireless Internet of Things: Performance Analysis and Optimal Communication Node Deployment. IEEE Internet of Things Journal. 2019 Jun;6(3):5791–802.

Palma D. Enabling the Maritime Internet of Things: CoAP and 6LoWPAN Performance Over VHF Links. IEEE Internet of Things Journal. 2018 Dec;5(6):5205–12.

Liu S, Liu Y, Wu F, Fan W. Feature Data Selection for Improving the Performance of Entity Similarity Searches in the Internet of Things. IEEE Access. 2019;7:49938–44.

Badihi B, Ghavimi F, Jäntti R. On the System-level Performance Evaluation of Bluetooth 5 in IoT: Open Office Case Study. In: 2019 16th International Symposium on Wireless Communication Systems (ISWCS). 2019. p. 485–9.

Li X, Tan L, Li F. Optimal Cloud Resource Allocation With Cost Performance Tradeoff Based on Internet of Things. IEEE Internet of Things Journal. 2019 Aug;6(4):6876–86.

Li F, Zheng K, Long H, Guan D. Performance Analysis of Complementary GFDM in IoT Communications. In: 2019 IEEE 89th Vehicular Technology Conference (VTC2019-Spring). 2019. p. 1–5.

Kiran MPRS, Rajalakshmi P. Performance Analysis of CSMA/CA and PCA for Time Critical Industrial IoT Applications. IEEE Transactions on Industrial Informatics. 2018 May;14(5):2281–93.

Anajemba JH, Tang Y, Ansere JA, Iwendi C. Performance Analysis of D2D Energy Efficient IoT Networks with Relay-Assisted Underlaying Technique. In: IECON 2018 - 44th Annual Conference of the IEEE Industrial Electronics Society. 2018. p. 3864–9.

Lin W, Matsumoto T. Performance Analysis of Distortion-Acceptable Cooperative Communications in Wireless Sensor Networks for Internet of Things. IEEE Sensors Journal. 2019 Mar;19(5):1979–89.

Kim T, Jung BC. Performance Analysis of Grant-Free Multiple Access for Supporting Sporadic Traffic in Massive IoT Networks. IEEE Access. 2019;7:166648–56.

Leite JRE, Ursini EL, Martins PS. Performance Analysis of IoT Networks with Mobility Via Modeling and Simulation. In: 2018 International Symposium on Performance Evaluation of Computer and Telecommunication Systems (SPECTS). 2018. p. 1–13.

Banaie F, Misic J, Misic VB, Yaghmaee Moghaddam MH, Hosseini Seno SA. Performance Analysis of Multithreaded IoT Gateway. IEEE Internet of Things Journal. 2019 Apr;6(2):3143–55.

Ferrari P, Rinaldi S, Sisinni E, Colombo F, Ghelfi F, Maffei D, et al. Performance evaluation of full-cloud and edge-cloud architectures for Industrial IoT anomaly detection based on deep learning. In: 2019 II Workshop on Metrology for Industry 40 and IoT (MetroInd40 IoT). 2019. p. 420–5.

Da Cruz MAA, Marcondes GAB, Rodrigues JJPC, Lorenz P, Pinheiro PR. Performance Evaluation of IoT Middleware through Multicriteria Decision-Making. In: 2018 IEEE Global Communications Conference (GLOBECOM). 2018. p. 1–5.

Al-Hasnawi A, Mohammed I, Al-Gburi A. Performance Evaluation of the Policy Enforcement Fog Module for Protecting Privacy of IoT Data. In: 2018 IEEE International Conference on Electro/Information Technology (EIT). 2018. p. 0951–7.

Liu M, Yu FR, Teng Y, Leung VCM, Song M. Performance Optimization for Blockchain-Enabled Industrial Internet of Things (IIoT) Systems: A Deep Reinforcement Learning Approach. IEEE Transactions on Industrial Informatics. 2019 Jun;15(6):3559–70.

Akbar MS, Yu H, Cang S. Performance Optimization of the IEEE 802.15.4-Based Link Quality Protocols for WBASNs/IoTs in a Hospital Environment Using Fuzzy Logic. IEEE Sensors Journal. 2019 Jul;19(14):5865–77.

Raymundo Belleza R, Pignaton de Freitas E. Performance study of real-time operating systems for internet of things devices. IET Software. 2018;12(3):176–82.

Cluzel S, Dervin M, Radzik J, Cazalens S, Baudoin C, Dragomirescu D. PHYSICAL LAYER ABSTRACTION FOR PERFORMANCE EVALUATION OF LEO SA℡LITE SYSTEMS FOR IOT USING TIME-FREQUENCY ALOHA SCHEME. In: 2018 IEEE Global Conference on Signal and Information Processing (GlobalSIP). 2018. p. 1076–80.

Wang J, Qi H, Li K, Zhou X. PRSFC-IoT: A Performance and Resource Aware Orchestration System of Service Function Chaining for Internet of Things. IEEE Internet of Things Journal. 2018 Jun;5(3):1400–10.

Nhan Vo V, Tran D-D, So-In C, Tran H. Secrecy Performance Analysis for Fixed-Gain Energy Harvesting in an Internet of Things With Untrusted Relays. IEEE Access. 2018;6:48247–58.

Ali, M. Zulfiker, Jelena Mišić, and Vojislav B. Mišić. 2019. “Performance Evaluation of Heterogeneous IoT Nodes with Differentiated Qos in Ieee 802.11ah Raw Mechanism.†IEEE Transactions on Vehicular Technology 68 (4): 3905–18.

Yoo, Seung-Su, Sung-Hyung Lee, So-Yi Jung, and Jae-Hyun Kim. 2017. “Performance Evaluation of Random Access Response Estimation Scheme for IoT Communications.†In 2017 IEEE International Conference on Communications (ICC), 1–6. https://doi.org/10.1109/ICC.2017.7996507.

Kiran, M. P. R. S., V. Subrahmanyam, and P. Rajalakshmi. 2018. “Novel Power Management Scheme and Effects of Constrained On-Node Storage on Performance of MAC Layer for Industrial IoT Networks.†IEEE Transactions on Industrial Informatics 14 (5): 2146–58. https://doi.org/10.1109/TII.2017.2766783.

Moussa, Hesham G., and Weihua Zhuang. 2019. “RACH Performance Analysis for Large-Scale Cellular IoT Applications.†IEEE Internet of Things Journal 6 (2): 3364–72. https://doi.org/10.1109/JIOT.2018.2883101.

Rauniyar, Ashish, Paal E. Engelstad, and Olav N. Østerbø. 2019. “Performance Analysis of RF Energy Harvesting and Information Transmission Based on NOMA With Interfering Signal for IoT Relay Systems.†IEEE Sensors Journal 19 (17): 7668–82. https://doi.org/10.1109/JSEN.2019.2914796.48.

Solic, Petar, Zoran Blazevic, Maja Skiljo, Luigi Patrono, Riccardo Colella, and and Joel J. P. C. Rodrigues. 2017. “Gen2 RFID as IoT Enabler: Characterization and Performance Improvement.†IEEE Wireless Communications 24 (3): 33–39. https://doi.org/10.1109/MWC.2017.1600431..

Zhang, Jiangfan, Rick S. Blum, and H. Vincent Poor. 2018. “Approaches to Secure Inference in the Internet of Things: Performance Bounds, Algorithms, and Effective Attacks on IoT Sensor Networks.†IEEE Signal Processing Magazine 35 (5): 50–63. https://doi.org/10.1109/MSP.2018.2842261.

Belloch, Jose A., José M. Badía, Francisco D. Igual, and Maximo Cobos. 2019. “Practical Considerations for Acoustic Source Localization in the IoT Era: Platforms, Energy Efficiency, and Performance.†IEEE Internet of Things Journal 6 (3): 5068–79. https://doi.org/10.1109/JIOT.2019.2895742.

Rahman, Waqas Ur, Young-Seok Choi, and Kwangsue Chung. 2019. “Performance Evaluation of Video Streaming Application Over CoAP in IoT.†IEEE Access 7: 39852–61.

Yokotani, Tetsuya, Akihiro Shimuzu, Yuya Sasaki, and Hiroaki Mukai. 2017. “Proposals for Packet Processing and Performance Evaluation of IoT Devices.†In 2017 Japan-Africa Conference on Electronics, Communications and Computers (JAC-ECC), 5–8. Alexandria: IEEE. https://doi.org/10.1109/JEC-ECC.2017.8305766.

Jin, Ho-Yong, Eun-Sung Jung, and Duckki Lee. 2019. “High-Performance IoT Streaming Data Prediction System Using Spark: A Case Study of Air Pollution.†Neural Computing and Applications, December. https://doi.org/10.1007/s00521-019-04678-9.

Fathy Cidek Esmail, Mohamed, and Tarek Mekhail. 2019. “Investigations of the Instantaneous Performance of a Solar Chimney Power Plant Installed in Aswan Using IoT.†IET Renewable Power Generation 13 (12): 2261–66. https://doi.org/10.1049/iet-rpg.2018.5950.

Li, Jian, Yun Liu, Zhenjiang Zhang, Jian Ren, and Nan Zhao. 2017. “Towards Green IoT Networking: Performance Optimization of Network Coding Based Communication and Reliable Storage.†IEEE Access 5: 8780–91. https://doi.org/10.1109/ACCESS.2017.2706328.

Morabito, Roberto, Ivan Farris, Antonio Iera, and Tarik Taleb. 2017. “Evaluating Performance of Containerized IoT Services for Clustered Devices at the Network Edge.†IEEE Internet of Things Journal 4 (4): 1019–30. https://doi.org/10.1109/JIOT.2017.2714638.

Ismail, Leila, and Huned Materwala. 2018. “Energy-Aware VM Placement and Task Scheduling in Cloud-IoT Computing: Classification and Performance Evaluation.†IEEE Internet of Things Journal 5 (6): 5166–76. https://doi.org/10.1109/JIOT.2018.2865612.

Li, Songyuan, and Jiwei Huang. 2017. “GSPN-Based Reliability-Aware Performance Evaluation of IoT Services.†In 2017 IEEE International Conference on Services Computing (SCC), 483–86. https://doi.org/10.1109/SCC.2017.70.

Martinez, Borja, Ferran Adelantado, Andrea Bartoli, and Xavier Vilajosana. 2019. “Exploring the Performance Boundaries of NB-IoT.†IEEE Internet of Things Journal 6 (3): 5702–12. https://doi.org/10.1109/JIOT.2019.2904799.

Sobral, José V. V., Joel José P. C. Rodrigues, Ricardo A. L. Rabêlo, Kashif Saleem, and Sergei A. Kozlov. 2019. “Improving the Performance of LOADng Routing Protocol in Mobile IoT Scenarios.†IEEE Access 7: 107032–46. https://doi.org/10.1109/ACCESS.2019.2932718.

Ray, Partha Pratim, Nishant Thapa, and Dinesh Dash. 2019. “Implementation and Performance Analysis of Interoperable and Heterogeneous IoT-Edge Gateway for Pervasive Wellness Care.†IEEE Transactions on Consumer Electronics 65 (4): 464–73. https://doi.org/10.1109/TCE.2019.2939494.

A. H. Khaleel, G. A. Al-Suhai, and B. M. Hussan, “Application Tool based on C4. 5 Decision Tree for Diagnosing Diabetes Infection Symptoms,†J. Commun. Technol. Electron. Comput. Sci., vol. 22, pp. 7–15, 2019.

N. Alrajei, “Dependable Wireless Sensor Networks by Dynamic Redundant Deployment,†J. Commun. Technol. Electron. Comput. Sci., vol. 23, pp. 1–8, 2019.

S. Mostafavi and W. Shafik, “Fog Computing Architectures, Privacy and Security Solutions,†J. Commun. Technol. Electron. Comput. Sci., vol. 24, pp. 1–14, 2019.

Z. jun Tang, Y. Guo, and Q. Liu, “Research on an improved fusion RFID collision avoidance algorithm,†J. Commun. Technol. Electron. Comput. Sci., vol. 22, pp. 6–19, 2019.

D. Nimawat and N. Nagar, “Self-Tuning Fuzzy Pid Controllers Application on Industrial Hydraulic Actuator Using Unique System Identification Approach,†J. Commun. Technol. Electron. Comput. Sci., vol. 22, pp. 1–6, 2019.




DOI: http://dx.doi.org/10.22385/jctecs.v28i0.303