Choice of Application Layer Protocols for Next Generation Video Surveillance Using Internet of Video Things

Video surveillance has become ubiquitous due to the increasing security requirements in every sphere of life. The next generation video surveillance system (VSS) possesses great challenges in various applications, such as intelligent urban surveillance systems and smart cities. In these applications, we need to deal with the fast-growing number of surveillance nodes which introduce several constraints, e.g., high latency, high bandwidth, high energy consumption, and CPU and memory usage. To address these issues, the Internet of Video Things (IoVT), which is considered to be a part of the Internet of Things (IoT), can be a solution. The IoVT is composed of visual sensors (i.e., cameras) connected to the Internet. Unlike conventional systems, the VSS under an IoVT framework provides multiple layers (i.e., edge, fog, and cloud) of communication and decision making by capturing and analyzing rich contextual and behavioral information. Since an appropriate application layer protocol (ALP) can help in alleviating the challenges of future VSSs, the selection of ALPs is important for IoVT-based systems. Therefore, this paper presents a generic architecture of an IoVT-based VSS and a comparative analysis of several ALPs, such as MQTT, AMQP, HTTP, XMPP, CoAP, and DDS, with real-time experimentation. This analysis will assist the users to choose the appropriate ALPs in various surveillance applications and determine their suitability at different nodes of the IoVT framework.

Related papers:

title: A framework for visual fog computing
abstract: Visual data are rich, which have opened vast analytics opportunities and been widely used in many applications. However, the demanding requirements of computational resources and bandwidth have prevented the data from being useful in an economically efficient manner. A visual fog paradigm is needed for efficient processing of continuous video streams by collaboratively using things in the Internet of Video Things (IoVT), comprising edge devices, intermediate gateways, and servers on premise or in the cloud, as the computing platform. The challenges lying ahead include (1) Reusability-a reusable framework across multiple vertical applications, (2) Efficiency-the intelligence for online distributing and redistributing work-load for optimal system performance, and (3) Configurability-the user interface for (layperson) users to easily analyze the visual data as well as the corresponding metadata. This paper spells out the need of a framework for visual fog computing and suggest promising research directions towards instantiations of a visual fog computing framework.

title: Intelligent Video Systems and Analytics: A Survey
abstract: Recent technology and market trends have demanded the significant need for feasible solutions to video/camera systems and analytics. This paper provides a comprehensive account on theory and application of intelligent video systems and analytics. It highlights the video system architectures, tasks, and related analytic methods. It clearly demonstrates that the importance of the role that intelligent video systems and analytics play can be found in a variety of domains such as transportation and surveillance. Research directions are outlined with a focus on what is essential to achieve the goals of intelligent video systems and analytics.

title: Internet of video things in 2030: A world with many cameras
abstract: The Internet of Things (IoT) is the internetworking of a variety of devices, including sensors. Among all sensors, visual sensors (i.e. cameras) are special because they can provide rich and versatile information. The world already has more than one billion cameras on mobile phones. We define the internet-working of visual sensors as the Internet of Video Things. This article estimates the number of cameras the world will see in 2030 and the implications of a large number of cameras. Transmitting, storing, and analyzing the data from cameras could impose significant challenges to existing technological infrastructures. This paper surveys recent progress in relevant technologies and suggests directions for future research.

title: Real-time streaming challenges in Internet of Video Things (IoVT)
abstract: The limited capabilities of Internet of Things (IoT) devices make real-time video streaming a major challenge. Video encoding and transmission are computationally intensive processes. Applications; like urban surveillance and health care monitoring, require real-time high definition video streams. Current video encoders are not designed to meet these requirements, thus alternative architectures, algorithms and compression techniques are needed to meet these goals. In this paper, real-time video streaming challenges for IoT applications are presented.

title: Object-based on-line video summarization for internet of video things
abstract: In order to address the high transmission bandwidth requirement of an Internet-of-Video-Things (IoVT), an object-based on-line video summarization algorithm is proposed to summarize the captured video information at the sensor nodes before being transmitted to the server. It is composed of two stages: intra-view and inter-view stages. In the intra-view stage, human object detector is employed with the proposed human object descriptor. In the inter-view stage, an on-line clustering algorithm with a two-layer K-nearest-neighbor model is also proposed for object clustering. Experimental results show that significant improvement can be achieved when compared with state-of-the-art works.

title: A Survey of Communication Protocols for Internet of Things and Related Challenges of Fog and Cloud Computing Integration
abstract: The fast increment in the number of IoT (Internet of Things) devices is accelerating the research on new solutions to make cloud services scalable. In this context, the novel concept of fog computing as well as the combined fog-to-cloud computing paradigm is becoming essential to decentralize the cloud, while bringing the services closer to the end-system. This article surveys e application layer communication protocols to fulfill the IoT communication requirements, and their potential for implementation in fog- and cloud-based IoT systems. To this end, the article first briefly presents potential protocol candidates, including request-reply and publish-subscribe protocols. After that, the article surveys these protocols based on their main characteristics, as well as the main performance issues, including latency, energy consumption, and network throughput. These findings are thereafter used to place the protocols in each segment of the system (IoT, fog, cloud), and thus opens up the discussion on their choice, interoperability, and wider system integration. The survey is expected to be useful to system architects and protocol designers when choosing the communication protocols in an integrated IoT-to-fog-to-cloud system architecture.

title: Comparing application layer protocols for the Internet of Things via experimentation
abstract: In this paper we compare the performance of three application layer protocols, that are Constrained Application Protocol (CoAP), WebSocket and Message Queuing Telemetry Transport (MQTT), in an Internet of Things (IoT) scenario. The three protocols have been implemented on the same low cost and low complexity hardware platform, suitable for IoT applications. The performance, in terms of protocol efficiency, strictly related to the overhead, and average Round Trip Time (RTT), were experimentally evaluated. In the considered scenario an IoT device was transmitting data to a server and waiting for replies. IEEE 802.11.b/g/n air interface was used for the communication between the IoT device and an Access Point (AP), connected to the final server. Two different settings have been considered: a local area network (LAN) configuration, where the AP and the server were in the same LAN; and a more realistic IoT configuration, where the AP was connected to a remote server via the Internet. Furthermore, in the IoT configuration, two types of Internet connection are considered: a connection established through a home router and another via cellular network. Results show that CoAP achieves the highest protocol efficiency and the lowest average RTT, closely followed by WebSocket. The performance of MQTT protocol strongly depend on the Quality of Service (QoS) profile. Changing the environment, from a LAN network to a realistic IoT scenario, does not significantly impact the protocol efficiency, but has a considerable influence on the average RTT, which increases by a factor of 2 or 3, depending on the protocol. Finally, we give some insights on the impact of routing through a cellular network on the system performance.

title: Choice of effective messaging protocols for IoT systems: MQTT, CoAP, AMQP and HTTP
abstract: The standard and real-time communication technology is an unalloyed inevitability for the development of Internet of Things (IoT) applications. However, the selection of a standard and effective messaging protocol is a challenging and daunting task for any organisation because it depends on the nature of the IoT system and its messaging requirements. Copious messaging protocols have been developed and employed by various organisations based on their requirements in the last two decades. Though, none of them is able to support all messaging requirements of all types of IoT systems. Messaging protocol is an ongoing dilemma for the IoT industry; consequently, it is important to understand the pros and cons of the widely accepted and emerging messaging protocols for IoT systems to determine their best-fit scenarios. Therefore, this paper presents an evaluation of the four established messaging protocols MQTT, CoAP, AMQP and HTTP for IoT systems. Firstly, it presents the broad comparison among these messaging protocols to introduce their characteristics comparatively. Afterwards, it performs a further in-depth and relative analysis based on some interrelated criteria to gain insight into their strengths and limitations. Thus, based on this detailed evaluation, the user can decide their appropriate usage in various IoT systems according to their requirements and suitability.

title: Real-time wireless multisensory smart surveillance with 3D-HEVC streams for internet-of-things (IoT)
abstract: This paper presents the design of a novel, real-time, wireless, multisensory, smart surveillance system with 3D-HEVC features. The proposed high-level system architecture of the surveillance system is analyzed. The advantages of HEVC encoding are presented. Methods for synchronization between multiple streams are presented. Available wireless standards are presented and compared. A network-adaptive transmission protocol for a reliable, real-time, multisensory surveillance system is proposed. Adaptive packet frame grouping (APFG) and adaptive quantization are deployed to maximize the quality-of-experience (QoE). Measurements of the proposed protocol have been shown to provide superior results compared to existing transport protocols.

title: IoT-based surveillance system for ubiquitous healthcare
abstract: The last few years, significant advances which improve healthcare have been done in Internet of Things, in cloud computing, in video coding, and in mobile devices. This paper provides an overview of these advances. Also, we propose an IoT-based surveillance system for ubiquitous healthcare monitoring. The system consists of sensors, actuators, and cameras. Mesh topology was decided to be used as it provides important advantages. Moreover, the Constrained Application Protocol (CoAP) is used for the data compression and transferring, and the Scalable High-Efficiency Video Coding (SHVC) is used for the video compression and transferring. The SHVC can deliver the same video quality in half of the bit rate than the High-Efficiency Video Coding (HEVC). Furthermore, cloud services are provided, such as storage and real-time monitoring. Finally, we made a comparative analysis between our proposed system architecture and two other approaches. From this analysis, we can say that our system architecture has some benefits instead of other similar architectures. Also, we made an analysis of the bandwidth and the network throughput. The results are significant since the bandwidth required for the transmission of data and video is reduced.

title: Architecture for security monitoring in IoT environments
abstract: The focus of this paper is to propose an integration between Internet of Things (IoT) and Video Surveillance, with the aim to satisfy the requirements of the future needs of Video Surveillance, and to accomplish a better use. IoT is a new technology in the sector of telecommunications. It is a network that contains physical objects, items, and devices, which are embedded with sensors and software, thus enabling the objects, and allowing for their data exchange. Video Surveillance systems collect and exchange the data which has been recorded by sensors and cameras and send it through the network. This paper proposes an innovative topology paradigm which could offer a better use of IoT technology in Video Surveillance systems. Furthermore, the contribution of these technologies provided by Internet of Things features in dealing with the basic types of Video Surveillance technology with the aim to improve their use and to have a better transmission of video data through the network. Additionally, there is a comparison between our proposed topology and relevant proposed topologies focusing on the security issue.

title: An Efficient Algorithm for Media-based Surveillance System (EAMSuS) in IoT Smart City Framework
abstract: Internet of Things (IoT) is the new technological revolution that aspires to connect all the everyday physical objects to the Internet, making a huge global network of uniquely things which can share information amongst each other and complete scheduled tasks, bringing significant benefits to users and companies of a Smart City (SC). A Smart City represents a new future framework, which integrates multiple information and communication technology (ICT) and Internet of Things (IoT) solutions, so as to improve the quality life of its citizens. However, there are many security and privacy issues which must be taken into account before the official launching of this new technological concept. Many methods which focus on media security of wireless sensor networks have been proposed and can be adopted in the new expandable network of IoT. In this paper, we describe the upcoming IoT network architecture and its security challenges and analyze the most important researches on media security and privacy in wireless sensor networks (WSNs). Subsequently, we propose an Efficient Algorithm for Media-based Surveillance System (EAMSuS) in IoT network for Smart City Framework, which merges two algorithms introduced by other researchers for WSN packet routing and security, while it reclaims the new media compression standard, High Efficiency Video Coding (HEVC). Experimental analysis shows the efficacy of our proposed scheme in terms of users’ privacy, media security, and sensor node memory requirements. This scheme can be successfully integrated into the IoT network of the upcoming Smart City concept.

title: Integration of Cloud computing and Internet of Things: A survey
abstract: Cloud computing and Internet of Things (IoT) are two very different technologies that are both already part of our life. Their adoption and use are expected to be more and more pervasive, making them important components of the Future Internet. A novel paradigm where Cloud and IoT are merged together is foreseen as disruptive and as an enabler of a large number of application scenarios.In this paper, we focus our attention on the integration of Cloud and IoT, which is what we call the CloudIoT paradigm. Many works in literature have surveyed Cloud and IoT separately and, more precisely, their main properties, features, underlying technologies, and open issues. However, to the best of our knowledge, these works lack a detailed analysis of the new CloudIoT paradigm, which involves completely new applications, challenges, and research issues. To bridge this gap, in this paper we provide a literature survey on the integration of Cloud and IoT. Starting by analyzing the basics of both IoT and Cloud Computing, we discuss their complementarity, detailing what is currently driving to their integration. Thanks to the adoption of the CloudIoT paradigm a number of applications are gaining momentum: we provide an up-to-date picture of CloudIoT applications in literature, with a focus on their specific research challenges. These challenges are then analyzed in details to show where the main body of research is currently heading. We also discuss what is already available in terms of platforms-both proprietary and open source-and projects implementing the CloudIoT paradigm. Finally, we identify open issues and future directions in this field, which we expect to play a leading role in the landscape of the Future Internet. Vision and motivations for the integration of Cloud computing and Internet of Things (IoT).Applications stemming from the integration of Cloud computing and IoT.Hot research topics and challenges in the integrated scenario of Cloud computing and IoT.Open issues and future directions for research in this scenario.

title: Middleware for IoT-Cloud Integration Across Application Domains
abstract: This paper presents a middleware connecting the Internet of Things and the Cloud for better security. The implementation demonstrates the proof of concept of this approach. It is an example showing how to integrate embedded systems and cloud computing.

title: Integration of agent-based and Cloud Computing for the smart objects-oriented IoT
abstract: In the future Internet of Things (IoT), smart objects will be the fundamental building blocks for the creation of cyber-physical smart pervasive systems in a great variety of application domains ranging from health-care to transportation, from logistics to smart grid and cities. The implementation of a smart objects-oriented IoT is a complex challenge as distributed, autonomous, and heterogeneous IoT components at different levels of abstractions and granularity need to cooperate among themselves, with conventional networked IT infrastructures, and also with human users. In this paper, we propose the integration of two complementary mainstream paradigms for large-scale distributed computing: Agents and Cloud. Agent-based computing can support the development of decentralized, dynamic, cooperating and open IoT systems in terms of multi-agent systems. Cloud computing can enhance the IoT objects with high performance computing capabilities and huge storage resources. In particular, we introduce a cloud-assisted and agent-oriented IoT architecture that will be realized through ACOSO, an agent-oriented middleware for cooperating smart objects, and BodyCloud, a sensor-cloud infrastructure for large-scale sensor-based systems.

title: CloudThings: A common architecture for integrating the Internet of Things with Cloud Computing
abstract: The Internet of Things presents the user with a novel means of communicating with the Web world through ubiquitous object-enabled networks. Cloud Computing enables a convenient, on demand and scalable network access to a shared pool of configurable computing resources. This paper mainly focuses on a common approach to integrate the Internet of Things (IoT) and Cloud Computing under the name of CloudThings architecture. We review the state of the art for integrating Cloud Computing and the Internet of Things. We examine an IoT-enabled smart home scenario to analyze the IoT application requirements. We also propose the CloudThings architecture, a Cloud-based Internet of Things platform which accommodates CloudThings IaaS, PaaS, and SaaS for accelerating IoT application, development, and management. Moreover, we present our progress in developing the CloudThings architecture, followed by a conclusion.

title: Secure integration of IoT and Cloud Computing
abstract: Mobile Cloud Computing is a new technology which refers to an infrastructure where both data storage and data processing operate outside of the mobile device. Another recent technology is Internet of Things. Internet of Things is a new technology which is growing rapidly in the field of telecommunications. More specifically, IoT related with wireless telecommunications. The main goal of the interaction and cooperation between things and objects which sent through the wireless networks is to fulfill the objective set to them as a combined entity. In addition, there is a rapid development of both technologies, Cloud Computing and Internet of Things, regard the field of wireless communications. In this paper, we present a survey of IoT and Cloud Computing with a focus on the security issues of both technologies. Specifically, we combine the two aforementioned technologies (i.e Cloud Computing and IoT) in order to examine the common features, and in order to discover the benefits of their integration. Concluding, we present the contribution of Cloud Computing to the IoT technology. Thus, it shows how the Cloud Computing technology improves the function of the IoT. Finally, we survey the security challenges of the integration of IoT and Cloud Computing.

title: A survey of IoT cloud providers
abstract: Cloud Computing enables flexible resource provisions that has become hugely popular for many businesses to take advantage of responding quickly to new demands from customers. Many cloud providers follow recent trends in cloud application development, and offer federation capabilities at the platform level, thus creating Platform-as-a-Service solutions. There is a growing number of providers offering IoT-specific services, since cloud computing has the potential to satisfy IoT needs such as hiding data generation, processing and visualization tasks. While cloud provider offerings have been widely studied, IoT-specific features are still unexplored due to their recent appearance. In this paper we investigate such basic properties of IoT cloud providers by presenting a survey and a classification of them, which are the main contributions of this work. This work can be useful for application developers planning to exploit IoT capabilities of PaaS cloud providers. We also present the needs for an IoT device simulator based on the results of this survey, which can further ease IoT cloud system development in the future.

title: Recent advances delivered by Mobile Cloud Computing and Internet of Things for Big Data applications: a survey
abstract: The Internet of Things (IoT) is a new technology that is growing rapidly in the field of telecommunications and especially in the modern field of wireless telecommunications. The main goal of the interaction and cooperation between things and objects sent through the wireless networks is to fulfill the objective set to them as a combined entity. In addition, based on the technology of wireless networks, both the technologies of Mobile Cloud Computing (MCC) and IoT develop rapidly. In this paper, we combine the two aforementioned technologies (i.e., MCC and IoT) with the technology of the Big Data in order to examine the common features and tο discover which of the MCC and IoT benefits improve the use of the Big Data applications. Finally, we present the contribution of MCC and IoT individually to the technology of Big Data.

title: Efficient Large-scale Medical Data (eHealth Big Data) Analytics in Internet of Things
abstract: Recent technologies such as Big Data could be used in order to help the improvement of other fields except for the telecommunication field. Due to the Health field, the Big Data technology could contribute with the aim to help for the purpose of analysis and management of the huge amounts of health data. The main objective of this research proposal is an analytical study of the technologies IoT, Cloud Computing (CC) and large-scale data (Big Data) to resolve various issues facing the health sector in relation to these technologies. The purpose of the research proposal is the collection of medical (e-health) big data in real time. The collection will be performed by sensor devices and actuators, which will wear patients who suffer from various ailments. Then is following, the transfer of these data through a network to a cloud server. Additionally, these data will be processed in the cloud which makes its analysis so as to become meaningless. By the analysis of these data is done the data mining. Finally, to address the various problems in the health sector, the transfer of the analyzed health data will be held by the devices of the relevant persons. Also, in our study, we will deal with the security of medical data which constitute personal data and must be protected.

title: A Survey of Fog Computing: Concepts, Applications and Issues
abstract: Despite the increasing usage of cloud computing, there are still issues unsolved due to inherent problems of cloud computing such as unreliable latency, lack of mobility support and location-awareness. Fog computing can address those problems by providing elastic resources and services to end users at the edge of network, while cloud computing are more about providing resources distributed in the core network. This survey discusses the definition of fog computing and similar concepts, introduces representative application scenarios, and identifies various aspects of issues we may encounter when designing and implementing fog computing systems. It also highlights some opportunities and challenges, as direction of potential future work, in related techniques that need to be considered in the context of fog computing.

title: An overview of Fog computing and its security issues
abstract: Fog computing is a paradigm that extends Cloud computing and services to the edge of the network. Similar to Cloud, Fog provides data, compute, storage and application services to end users. In this article, we elaborate the motivation and advantages of Fog computing and analyse its applications in a series of real scenarios, such as Smart Grid, smart traffic lights in vehicular networks and software defined networks. We discuss the state of the art of Fog computing and similar work under the same umbrella. Distinguished from other reviewing work of Fog computing, this paper further discloses the security and privacy issues according to current Fog computing paradigm. As an example, we study a typical attack, man‐in‐the‐middle attack, for the discussion of system security in Fog computing. We investigate the stealthy features of this attack by examining its CPU and memory consumption on Fog device. In addition, we discuss the authentication and authorization techniques that can be used in Fog computing. An example of authentication techniques is introduced to address the security scenario where the connection between Fog and Cloud is fragile.

title: A decentralized platform for heterogeneous IoT networks management
abstract: A typical Internet of Things (IoT) platform adopts a Cloud-centric design, where virtually unlimited processing resources enable data analytics of unprecedented complexity. However, Cloud computing model is not suitable for many emerging IoT applications that require real-time interaction between sensing and actuator devices, predictable latency, location awareness and/or mobility support. Motivated by these challenges, we propose a new design of IoT platform which exploits benefits of decentralized Fog and Edge computing paradigms. In particular, we provide a background on the key design requirements for collaborative Cloud-Fog-Edge computing in IoT, emphasizing the challenges with regard to resource virtualization and communication interoperability between IoT devices belonging to different network domains. Further on, we present results of the work in progress on the prototype implementation and demonstrate its capabilities on the example of a smart solar panel grid.

title: Fog and IoT: An Overview of Research Opportunities
abstract: Fog is an emergent architecture for computing, storage, control, and networking that distributes these services closer to end users along the cloud-to-things continuum. It covers both mobile and wireline scenarios, traverses across hardware and software, resides on network edge but also over access networks and among end users, and includes both data plane and control plane. As an architecture, it supports a growing variety of applications, including those in the Internet of Things (IoT), fifth-generation (5G) wireless systems, and embedded artificial intelligence (AI). This survey paper summarizes the opportunities and challenges of fog, focusing primarily in the networking context of IoT.

title: Securing Fog Computing for Internet of Things Applications: Challenges and Solutions
abstract: Internet of Things (IoT) allows billions of physical objects to be connected to collect and exchange data for offering various applications, such as environmental monitoring, infrastructure management, and home automation. On the other hand, IoT has unsupported features (e.g., low latency, location awareness, and geographic distribution) that are critical for some IoT applications, including smart traffic lights, home energy management and augmented reality. To support these features, fog computing is integrated into IoT to extend computing, storage and networking resources to the network edge. Unfortunately, it is confronted with various security and privacy risks, which raise serious concerns towards users. In this survey, we review the architecture and features of fog computing and study critical roles of fog nodes, including real-time services, transient storage, data dissemination and decentralized computation. We also examine fog-assisted IoT applications based on different roles of fog nodes. Then, we present security and privacy threats towards IoT applications and discuss the security and privacy requirements in fog computing. Further, we demonstrate potential challenges to secure fog computing and review the state-of-the-art solutions used to address security and privacy issues in fog computing for IoT applications. Finally, by defining several open research issues, it is expected to draw more attention and efforts into this new architecture.

title: Edge Computing Framework for Cooperative Video Processing in Multimedia IoT Systems
abstract: Multimedia Internet-of-Things (IoT) systems have been widely used in surveillance, automatic behavior analysis and event recognition, which integrate image processing, computer vision, and networking capabilities. In conventional multimedia IoT systems, videos captured by surveillance cameras are required to be delivered to remote IoT servers for video analysis. However, the long-distance transmission of a large volume of video chunks may cause congestions and delays due to limited network bandwidth. Nowadays, mobile devices, e.g., smart phones and tablets, are resource-abundant in computation and communication capabilities. Thus, these devices have the potential to extract features from videos for the remote IoT servers. By sending back only a few video features to the remote servers, the bandwidth starvation of delivering original video chunks can be avoided. In this paper, we propose an edge computing framework to enable cooperative processing on resource-abundant mobile devices for delay-sensitive multimedia IoT tasks. We identify that the key challenges in the proposed edge computing framework are to optimally form mobile devices into video processing groups and to dispatch video chunks to proper video processing groups. Based on the derived optimal matching theorem, we put forward a cooperative video processing scheme formed by two efficient algorithms to tackle above challenges, which achieves suboptimal performance on the human detection accuracy. The proposed scheme has been evaluated under diverse parameter settings. Extensive simulation confirms the superiority of the proposed scheme over other two baseline schemes.

title: Fog Computing and Efficient Resource Management in the era of Internet-of-Video Things (IoVT)
abstract: Internet-of-Things (IoT) consists of interconnected devices with sensing, monitoring and processing functionalities that work in a cooperative way to offer services. Smart buildings, self-driving cars, house monitoring and management, city electricity and pollution monitoring are some examples where IoT systems have been already deployed. Amongst different kinds of devices in IoT, cameras have a key role, since they can capture rich and resourceful content. The number of embedded cameras is rising rapidly establishing the term Internet-of-Video Things (IoVT). However, since multiple IoT devices share the same gateway, the data that is produced from high definition cameras struggle the network and the available computational resources, resulting in Quality-of-Service degradation regarding visual content. In this work, we propose a methodology that tries to balance the content generation rate of cameras in an IoT environment. Specifically, the targeted use case is face recognition for video surveillance under local storage, network utilization and computational constraints while achieving the highest possible accuracy.

title: Lightweight Service Mashup Middleware With REST Style Architecture for IoT Applications
abstract: Internet of Things (IoT) can provide new value-added service by connecting the physical devices to virtual environments association with their context, and there is also a huge demand in ad hoc services by the end users for IoT applications. By extending mashup concept into IoT applications, we can achieve a novel and more lightweight services creation approach. This paper proposes a lightweight IoT service mashup middleware based on REST-style architecture for IoT applications, and design an uniform sensor devices access and dynamically protocol stack management framework, propose a distributed publish/subscribe based messages distribution service, and situational IoT services mashup approach, which can be integrated easily to create new composite and situational applications, and also apply the REST principles to define an extensible interface to build comprehensive and situational mashup applications. Based on proposed service mashup middleware, the end user can integrate applications and services in a more lightweight manner. We also illustrated the scenarios for RESTful Web service mashups representing for coal mine safety monitoring and control automation. In the experiments, the end-user evaluation has been conducted to evaluate the middleware, and also the performance has been measured and analyzed.

title: Situation-Aware Dynamic Service Coordination in an IoT Environment
abstract: The Internet of Things (IoT) infrastructure with numerous diverse physical devices are growing up rapidly, which need a dynamic services coordination approach that can integrate those heterogeneous physical devices into the context-aware IoT infrastructure. This paper proposes a situation-aware dynamic IoT services coordination approach. First, focusing on the definition of formal situation event pattern with event selection and consumption strategy, an automaton-based situational event detection algorithm is proposed. Second, the enhanced event-condition-action is used to coordinate the IoT services effectively, and also the collaboration process decomposing algorithm and the rule mismatch detection algorithms are proposed. Third, the typical scenarios of IoT services coordination for smart surgery process are also illustrated and the measurement and analysis of the platform’s performance are reported. Finally, the conclusions and future works are given.

title: Internet of Things: A survey related to various recent architectures and platforms available
abstract: IP-based Internet is the largest network in the world therefore; there are excessive steps towards connecting Wireless Sensor Networks (WSNs) to the Internet. It is popularly known as to IoT (Internet of Things). IETF has developed a suite of protocols and open standards for accessing applications and services for wireless resource constrained networks such as IoT. Development of application requires standardized architecture and platform for design and analysis of new ideas. This paper provides a brief awareness about recent IoT architectures and platforms. It is also discussed some of the gaps issues of the platforms related to usability of the user. This helps researcher to select a particular platform according to need.

title: Internet of Things (IoT): Research, Simulators, and Testbeds
abstract: The Internet of Things (IoT) vision is increasingly being realized to facilitate convenient and efficient human living. To conduct effective IoT research using the most appropriate tools and techniques, we discuss recent research trends in the IoT area along with current challenges faced by the IoT research community. Several existing and emerging IoT research areas such as lightweight energy-efficient protocol development, object cognition and intelligence, as well as the critical need for robust security and privacy mechanisms will continue to be significant fields of research for IoT. IoT research can be a challenging process spanning both virtual and physical domains through the use of simulators and testbeds to develop and validate the initial proof-of-concepts and subsequent prototypes. To support researchers in planning IoT research activities, we present a comparative analysis of existing simulation tools categorized based on the scope of coverage of the IoT architecture layers. We compare existing large-scale IoT testbeds that have been adopted by researchers for examining the physical IoT prototypes. Finally, we discuss several open challenges of current IoT simulators and testbeds that need to be addressed by the IoT research community to conduct large-scale, robust and effective IoT simulation, and prototype evaluations.

title: A Survey on Object Detection and Tracking Methods
abstract: The goal of object tracking is segmenting a region of interest from a video scene and keeping track of its motion, positioning and occlusion.The object detection and object classification are preceding steps for tracking an object in sequence of images. Object detection is performed to check existence of objects in video and to precisely locate that object. Then detected object can be classified in various categories such as humans, vehicles, birds, floating clouds, swaying tree and other moving objects. Object tracking is performed using monitoring objects’ spatial and temporal changes during a video sequence, including its presence, position, size, shape, etc.Object tracking is used in several applications such as video surveillance, robot vision, traffic monitoring, Video inpainting and Animation. This paper presents a brief survey of different object detection, object classification and object tracking algorithms available in the literature including analysis and comparative study of different techniques used for various stages of tracking.

title: Video arrays for real-time tracking of person, head, and face in an intelligent room
abstract: Real-time three-dimensional tracking of people is an important requirement for a growing number of applications. In this paper we describe two trackers; both of them use a network of video cameras for person tracking. These trackers are called a rectilinear video array tracker (R-VAT) and an omnidirectional video array tracker (O-VAT), indicating the two different ways of video capture. The specific objectives of this paper are twofold: (i) to present a systematic comparison of these two trackers using an extensive series of experiments conducted in an `intelligent' room; (ii) to develop a real-time system for tracking the head and face of a person, as an extension of the O-VAT approach. The comparative research indicates that O-VAT is more robust to the number of people, less complex and runs faster, needs manual camera calibration, and the integrated omnidirectional video network has better reconfigurability. The person head and face tracker study shows that such a system can serve as a most effective input stage for face recognition and facial expression analysis modules.

title: An automated form of video image analysis applied to classification of movement disorders
abstract: Video image analysis is able to provide quantitative data on postural and movement abnormalities and thus has an important application in neurological diagnosis and management. The conventional techniques require patients to be videotaped while wearing markers in a highly structured laboratory environment. This restricts the utility of video in routine clinical practise. We have begun development of intelligent software which aims to provide a more flexible system able to quantify human posture and movement directly from whole-body images without markers and in an unstructured environment. The steps involved are to extract complete human profiles from video frames, to fit skeletal frameworks to the profiles and derive joint angles and swing distances. By this means a given posture is reduced to a set of basic parameters that can provide input to a neural network classifier. To test the system's performance we videotaped patients with dopa-responsive Parkinsonism and age-matched normals during several gait cycles, to yield 61 patient and 49 normal postures. These postures were reduced to their basic parameters and fed to the neural network classifier in various combinations. The optimal parameter sets (consisting of both swing distances and joint angles) yielded successful classification of normals and patients with an accuracy above 90%. This result demonstrated the feasibility of the approach. The technique has the potential to guide clinicians on the relative sensitivity of specific postural/gait features in diagnosis. Future studies will aim to improve the robustness of the system in providing accurate parameter estimates from subjects wearing a range of clothing, and to further improve discrimination by incorporating more stages of the gait cycle into the analysis.

title: Event detection for intelligent car park video surveillance
abstract: Intelligent surveillance has become an important research issue due to the high cost and low efficiency of human supervisors, and machine intelligence is required to provide a solution for automated event detection. In this paper we describe a real-time system that has been used for detecting tailgating, an example of complex interactions and activities within a vehicle parking scenario, using an adaptive background learning algorithm and intelligence to overcome the problems of object masking, separation and occlusion. We also show how a generalized framework may be developed for the detection of other complex events.

title: Bio-Inspired Adaptive Hyperspectral Imaging for Real-Time Target Tracking
abstract: In this paper, we present an efficient and novel approach to embed hyperspectral imaging (HSI) capability in an intelligent panoramic scanning system for real-time target tracking and signature acquisition. The sensor platform we propose consists of a dual-panoramic peripheral vision component and a narrow field-of-view (FOV) HSI component. The panoramic HSI design optimizes the tradeoff of a wide FOV, a high-spatial/spectral resolution in real-time imaging, and bandwidth limitations. The dual-panoramic scanners with a hyperspectral fovea sensor platform improves some existing designs in literature in three aspects: 1) a panoramic view is provided instead of just a normal wide-angle view; 2) a dual scanning system is designed to obtain moving targets in a very effective and efficient manner; and 3) active control of the hyperspectral sensor is added to facilitate signature acquisition of targets of various locations that is required in real time for target tracking.

title: A novel brain-inspired neural cognitive approach to SARS thermal image analysis
abstract: Thermal imaging is used extensively in the detection of infrared spectrum. This principle has found great and effective use in the screening of potential SARS patients. This paper investigates the application of several novel brain-inspired softcomputing techniques in the study of the correlation of superficial thermal images against the true internal body temperature. Given some backgrounds that the existing infrared systems used at various boarder checkpoints have high false-negative rate, the novel fuzzy neural networks (FNNs) employed in the back-end of the system have a role as a thermal analysis tool with high degree of accuracy. To achieve the automation and improve the accuracy in the feature extraction process of the infrared images, some forms of image processing technique based on the novel FNNs are also proposed in this paper. Extensive experimentations are undertaken to examine such intelligent medical decision support tool. Benchmarking was carried out on the novel FNN architectures which include pseudo outer-product fuzzy neural network (POPFNN), evolving fuzzy neural network (EFuNN), fuzzy adaptive learning control network (Falcon), generic self-organizing fuzzy neural network (GenSoFNN), and fuzzy cerebellar model articulation controller (FCMAC), and their results are promising. The performance of the GenSoFNN network is the most appealing among others. In addition, the experiments are conducted on real-life data taken from the Emergency Department (A&E), Tan Tock Seng Hospital (the designated SARS center in Singapore) to confirm the validity of such design in the real time.

title: Reliable and energy-efficient transmission on the Internet-of-Video-Things
abstract: Due to the rapid development of smart homes, smart grid, and intelligent transportation, Internet-of-Video-Things (IoVT) have become increasingly important. IoVT is considered as a part of Internet-of-Things that can effectively deal with large volumes of data, such as image and video. In IoVT, reliable and energy-efficient transmission is extremely important. The reliability guarantees all data are properly transferred in the network, while the energy efficiency allows a large amount of data to be processed at low power consumption. In this paper, a hardware platform based on Raspberry Pi Zero (RPz) is proposed. RPZ is exploited due to its integrated H.264 hardware encoder/decoder. A source node is composed of a RPZ, a camera, and an Atmel RF, whereas a sink node excludes the camera. The input is a 640×480@30fps video, and the output is the 300-Kbps H.264 encoded bit stream. Based on various experiments, we concluded that data were properly transferred and the energy per bit was approximately 6.4 nJ/bit.

title: Web Performance Evaluation for Internet of Things Applications
abstract: An area of intensive research under the umbrella of the Internet of Things (IoT) has resulted in intensive proliferation of globally deployed sensor devices that provide a basis for the development of different use-case applications working with real-time data and demanding a rich user interface. Overcoming the lack of the standard HTML platform, HTML5 specifications WebSocket and Canvas graphics strongly supported the development of rich real-time applications. Such support has been offered by browser plug-ins such as Adobe Flash and Microsoft Silverlight for years. In order to provide a deep insight into IoT Web application performance, we implemented two test applications. In the first application, we measured latencies induced by different communication protocols and message encodings, as well as graphics rendering performance, while comparing the performance of different Web platform implementations. In the second application, we compared Web performance of IoT messaging protocols such as MQTT, AMQP, XMPP, and DDS by measuring the latency of sensor data message delivery and the message throughput rate. Our tests have shown that although Adobe Flash has the best performance at the moment, HTML5 platform is also very capable of running real-time IoT Web applications, whereas Microsoft Silverlight is noticeably behind both platforms. On the other hand, MQTT is the most appropriate messaging protocol for a wide set of IoT Web applications. However, IoT application developers should be aware of certain MQTT message broker implementation shortcomings that could prevent the usage of this protocol.

title: Internet of Things: Existing protocols and technological challenges in security
abstract: Internet of Things (IoT) is the future reflection of internet based smart objects which are interconnected to each other and capable of pre processing raw data and taking decisions on their own. Surge in the research and application of IoT based objects has triggered the development of new IoT specific protocols and at the same time it has created various security challenges. The colossal size of the IoT network and resource constraint nature of IoT nodes has made the design and implementation of security policies for IoT network a cumbersome task as compared to the traditional networking. This paper presents an effort to describe the IoT protocol stack and some of the most commonly used protocols and comparison of it from security aspect. Also the paper attempts to present various challenges related to security from aspect of protocols, network and device.

title: A Comparison of Lightweight Communication Protocols in Robotic Applications
abstract: Robot communication is an essential element in robot operation. There are several protocols that serve robot communication applications, but the protocols used are not optimized for mobile and battery-operated robots. To operate in such condition, an optimized protocol for such environment must be used. This paper will evaluate Constrained Application Protocol (CoAP) and MQ Telemetry Transport for Sensor Nodes (MQTT-SN) which are designed for such devices. Result from experiment shows that MQTT-SN performs 30% faster than CoAP when transmitting the same payload.

title: Internet of Things: A Survey on Enabling Technologies, Protocols, and Applications
abstract: This paper provides an overview of the Internet of Things (IoT) with emphasis on enabling technologies, protocols, and application issues. The IoT is enabled by the latest developments in RFID, smart sensors, communication technologies, and Internet protocols. The basic premise is to have smart sensors collaborate directly without human involvement to deliver a new class of applications. The current revolution in Internet, mobile, and machine-to-machine (M2M) technologies can be seen as the first phase of the IoT. In the coming years, the IoT is expected to bridge diverse technologies to enable new applications by connecting physical objects together in support of intelligent decision making. This paper starts by providing a horizontal overview of the IoT. Then, we give an overview of some technical details that pertain to the IoT enabling technologies, protocols, and applications. Compared to other survey papers in the field, our objective is to provide a more thorough summary of the most relevant protocols and application issues to enable researchers and application developers to get up to speed quickly on how the different protocols fit together to deliver desired functionalities without having to go through RFCs and the standards specifications. We also provide an overview of some of the key IoT challenges presented in the recent literature and provide a summary of related research work. Moreover, we explore the relation between the IoT and other emerging technologies including big data analytics and cloud and fog computing. We also present the need for better horizontal integration among IoT services. Finally, we present detailed service use-cases to illustrate how the different protocols presented in the paper fit together to deliver desired IoT services.

title: Data Distribution Service (DDS): A performance comparison of OpenSplice and RTI implementations
abstract: Data distributions systems with guaranteed Quality of Service (QoS) levels, such as the data-centric Data Distribution Service (DDS) standard specification, have gained more and more success in the last decade. These systems represent suitable solutions for effective and high-performance data communication for challenging application scenarios with real-time requirements, such as air traffic management, industrial automation, smart grids, and, more recently, financial applications. Notwithstanding the last decade has witnessed the diffusion and consolidation of some major implementations, only a very few, in some sense obsolete, performance analysis studies are available in the literature. To fill that gap and to facilitate future IT decision processes, we propose a thorough analysis of the DDS implementations proposed by the two main stakeholders in the DDS market, namely, PrismTech and Real-Time Innovations (RTI). The reported experimental results point out the pros and cons of both solutions in terms of data delivery performance, also by precisely evaluating bottlenecks and overhead, for instance in terms of CPU and memory resource usage.

title: A Simple Solution to Find the Distribution of TCP Window Sizes
abstract: The performance of Internet applications depends very much on the dynamics of TCP congestion window sizes. This paper presents a novel model of TCP congestion window sizes. In particular, we focus on the multiplicative-decrease phases of the TCP congestion window instead of additive-increase phases. With this focus, we derive a model and a novel solution for finding the distribution of TCP window sizes. Both simulations and experiments show that our proposed model and solution are accurate.

title: Identification of TCP congestion control algorithms with convolution neural networks
abstract: Currently, various high-speed congestion control algorithms such as CUBIC and Compound TCP are used in order to accommodate sufficient bandwidths over high delay-bandwidth networks. CUBIC and Compound TCP have been implemented as the default congestion control algorithms in Linux and Microsoft Windows OS, respectively. However, Compound TCP drastically decreases its throughput when traffic flows of CUBIC and Compound TCP share a bottleneck link. In order to resolve this problem, it is necessary to identify them at the bottleneck link and suppress the throughput of CUBIC flows. In this paper, we propose an identification method of congestion control algorithms with image recognition using convolution neural networks. Through simulation experiments, we show the effectiveness of the proposed identification method.

title: The Fog computing paradigm: Scenarios and security issues
abstract: Fog Computing is a paradigm that extends Cloud computing and services to the edge of the network. Similar to Cloud, Fog provides data, compute, storage, and application services to end-users. In this article, we elaborate the motivation and advantages of Fog computing, and analyse its applications in a series of real scenarios, such as Smart Grid, smart traffic lights in vehicular networks and software defined networks. We discuss the state-of-the-art of Fog computing and similar work under the same umbrella. Security and privacy issues are further disclosed according to current Fog computing paradigm. As an example, we study a typical attack, man-in-the-middle attack, for the discussion of security in Fog computing. We investigate the stealthy features of this attack by examining its CPU and memory consumption on Fog device.

title: Transfer protocols of tiny data blocks in IoT and their performance evaluation
abstract: HTTP has been widely applied for data transfer. However, in networks for IoT, this protocol causes a large overhead. To solve this problem, named based transfer protocols have been discussed. This paper compares the performance of HTTP with that of MQTT, a type of named based transfer protocol. Additionally, the paper proposes enhancements to MQTT for better performance.

title: Evaluating Critical Security Issues of the IoT World: Present and Future Challenges
abstract: Social Internet of Things (SIoT) is a new paradigm where Internet of Things (IoT) merges with social networks, allowing people and devices to interact, and facilitating information sharing. However, security and privacy issues are a great challenge for IoT but they are also enabling factors to create a “trust ecosystem.” In fact, the intrinsic vulnerabilities of IoT devices, with limited resources and heterogeneous technologies, together with the lack of specifically designed IoT standards, represent a fertile ground for the expansion of specific cyber threats. In this paper, we try to bring order on the IoT security panorama providing a taxonomic analysis from the perspective of the three main key layers of the IoT system model: 1) perception; 2) transportation; and 3) application levels. As a result of the analysis, we will highlight the most critical issues with the aim of guiding future research directions.

title: An approach for secure edge computing in the Internet of Things
abstract: In this paper, we discuss the singular characteristics of the Internet of Things (IoT) in regard to security issues and present a security architecture with special focus on Edge networks and Smart Things. The architecture is based on the assumption that data integrity, authentication, and service/device access control are the most important aspects that have to be guaranteed for safe operation of highly decentralized and heterogeneous IoT systems. The architecture is made concrete as an extension of the ContextNet middleware for IoT. This middleware has a cloud and a mobile component and advocates the use of smartphones — or devices that execute smartphone platforms — as the universal gateways between cloud-hosted IoT services and the Smart Things. In addition to general architecture, the other major contribution is a protocol for establishing a secure connection between the Smart Things and these mobile gateways.