Deep Learning Scene Recognition Method Based on Localization Enhancement

Indoor Scene Recognition Mechanism Based on Direction-Driven Convolutional Neural Networks

Indoor location-based services constitute an important part of our daily lives, providing position and direction information about people or objects in indoor spaces. These systems can be useful in security and monitoring applications that target specific areas such as rooms. Vision-based scene recognition is the task of accurately identifying a room category from a given image. Despite years of research in this field, scene recognition remains an open problem due to the different and complex places in the real world. Indoor environments are relatively complicated because of layout variability, object and decoration complexity, and multiscale and viewpoint changes. In this paper, we propose a room-level indoor localization system based on deep learning and built-in smartphone sensors combining visual information with smartphone magnetic heading. The user can be room-level localized while simply capturing an image with a smartphone. The presented indoor scene recognition system is based on direction-driven convolutional neural networks (CNNs) and therefore contains multiple CNNs, each tailored for a particular range of indoor orientations. We present particular weighted fusion strategies that improve system performance by properly combining the outputs from different CNN models. To meet users' needs and overcome smartphone limitations, we propose a hybrid computing strategy based on mobile computation offloading compatible with the proposed system architecture. The implementation of the scene recognition system is split between the user's smartphone and a server, which aids in meeting the computational requirements of CNNs. Several experimental analysis were conducted, including to assess performance and provide a stability analysis. The results obtained on a real dataset show the relevance of the proposed approach for localization, as well as the interest in model partitioning in hybrid mobile computation offloading. Our extensive evaluation demonstrates an increase in accuracy compared to traditional CNN scene recognition, indicating the effectiveness and robustness of our approach.

Mapping Large-Scale Mangroves along the Maritime Silk Road from 1990 to 2015 Using a Novel Deep Learning Model and Landsat Data

Mangroves are important ecosystems and their distribution and dynamics can provide an understanding of the processes of ecological change. Meanwhile, mangroves protection is also an important element of the Maritime Silk Road (MSR) Cooperation Project. Large amounts of accessible satellite remote sensing data can provide timely and accurate information on the dynamics of mangroves, offering significant advantages in space, time, and characterization. In view of the capability of deep learning in processing massive data in recent years, we developed a new deep learning model—Capsules-Unet, which introduces the capsule concept into U-net to extract mangroves with high accuracy by learning the spatial relationship between objects in images. This model can significantly reduce the number of network parameters to improve the efficiency of data processing. This study uses Landsat data combined with Capsules-Unet to map the dynamics of mangrove changes over the 25 years (1990–2015) along the MSR. The results show that there was a loss in the mangrove area of 1,356,686 ha (about 21.5%) between 1990 and 2015, with anthropic activities such as agriculture, aquaculture, tourism, urban development, and over-development appearing to be the likely drivers of this decline. This information contributes to the understanding of ecological conditions, variability characteristics, and influencing factors along the MSR.

Smartphone Sensor Based Indoor Positioning: Current Status, Opportunities, and Future Challenges

The last two decades have witnessed a rich variety of indoor positioning and localization research. Starting with Microsoft Research pioneering the fingerprint approach based RADAR, MIT’s Cricket, and then moving towards beacon-based localization are few among many others. In parallel, researchers looked into other appealing and promising technologies like radio frequency identification, ultra-wideband, infrared, and visible light-based systems. However, the proliferation of smartphones over the past few years revolutionized and reshaped indoor localization towards new horizons. The deployment of MEMS sensors in modern smartphones have initiated new opportunities and challenges for the industry and academia alike. Additionally, the demands and potential of location-based services compelled the researchers to look into more robust, accurate, smartphone deployable, and context-aware location sensing. This study presents a comprehensive review of the approaches that make use of data from one or more sensors to estimate the user’s indoor location. By analyzing the approaches leveraged on smartphone sensors, it discusses the associated challenges of such approaches and points out the areas that need considerable research to overcome their limitations.

An Improved Res-UNet Model for Tree Species Classification Using Airborne High-Resolution Images

Tree species classification is important for the management and sustainable development of forest resources. Traditional object-oriented tree species classification methods, such as support vector machines, require manual feature selection and generally low accuracy, whereas deep learning technology can automatically extract image features to achieve end-to-end classification. Therefore, a tree classification method based on deep learning is proposed in this study. This method combines the semantic segmentation network U-Net and the feature extraction network ResNet into an improved Res-UNet network, where the convolutional layer of the U-Net network is represented by the residual unit of ResNet, and linear interpolation is used instead of deconvolution in each upsampling layer. At the output of the network, conditional random fields are used for post-processing. This network model is used to perform classification experiments on airborne orthophotos of Nanning Gaofeng Forest Farm in Guangxi, China. The results are then compared with those of U-Net and ResNet networks. The proposed method exhibits higher classification accuracy with an overall classification accuracy of 87%. Thus, the proposed model can effectively implement forest tree species classification and provide new opportunities for tree species classification in southern China.

Deep feature-based automatic classification of mammograms

Breast cancer has the second highest frequency of death rate among women worldwide. Early-stage prevention becomes complex due to reasons unknown. However, some typical signatures like masses and micro-calcifications upon investigating mammograms can help diagnose women better. Manual diagnosis is a hard task the radiologists carry out frequently. For their assistance, many computer-aided diagnosis (CADx) approaches have been developed. To improve upon the state of the art, we proposed a deep ensemble transfer learning and neural network classifier for automatic feature extraction and classification. In computer-assisted mammography, deep learning-based architectures are generally not trained on mammogram images directly. Instead, the images are pre-processed beforehand, and then they are adopted to be given as input to the ensemble model proposed. The robust features extracted from the ensemble model are optimized into a feature vector which are further classified using the neural network (nntraintool). The network was trained and tested to separate out benign and malignant tumors, thus achieving an accuracy of 0.88 with an area under curve (AUC) of 0.88. The attained results show that the proposed methodology is a promising and robust CADx system for breast cancer classification. Graphical Abstract Flow diagram of the proposed approach. Figure depicts the deep ensemble extracting the robust features with the final classification using neural networks.