Clothes image caption generation with attribute detection and visual attention model

An attention-based recurrent learning model for short-term travel time prediction

With the advent of Big Data technology and the Internet of Things, Intelligent Transportation Systems (ITS) have become inevitable for future transportation networks. Travel time prediction (TTP) is an essential part of ITS and plays a pivotal role in congestion avoidance and route planning. The novel data sources such as smartphones and in-vehicle navigation applications allow traffic conditions in smart cities to be analyzed and forecast more reliably than ever. Such a massive amount of geospatial data provides a rich source of information for TTP. Gated Recurrent Unit (GRU) has been successfully applied to traffic prediction problems due to its ability to handle long-term traffic sequences. However, the existing GRU does not consider the relationship between various historical travel time positions in the sequences for traffic prediction. We propose an attention-based GRU model for short-term travel time prediction to cope with this problem enabling GRU to learn the relevant context in historical travel time sequences and update the weights of hidden states accordingly. We evaluated the proposed model using FCD data from Beijing. To demonstrate the generalization of our proposed model, we performed a robustness analysis by adding noise obeying Gaussian distribution. The experimental results on test data indicated that our proposed model performed better than the existing deep learning time-series models in terms of Root Mean Square Error (RMSE), Mean Absolute Error (MAE), Mean Absolute Percentage Error (MAPE), and Coefficient of Determination (R2).

A digital twin auxiliary approach based on adaptive sparse attention network for diesel engine fault diagnosis

Condition monitoring and fault diagnosis of diesel engines are of great significance for safety production and maintenance cost control. The digital twin method based on data-driven and physical model fusion has attracted more and more attention. However, the existing methods lack deeper integration and optimization facing complex physical systems. Most of the algorithms based on deep learning transform the data into the substitution of the physical model. The lack of interpretability of the deep learning diagnosis model limits its practical application. The attention mechanism is gradually developed to access interpretability. In this study, a digital twin auxiliary approach based on adaptive sparse attention network for diesel engine fault diagnosis is proposed with considering its signal characteristics of strong angle domain correlation and transient non-stationary, in which a new soft threshold filter is designed to draw more attention to multi decentralized local fault information dynamically in real time. Based on this attention mechanism, the distribution of fault information in the original signal can be better visualized to help explain the fault mechanism. The valve failure experiment on a diesel engine test rig is conducted, of which the results show that the proposed adaptive sparse attention mechanism model has better training efficiency and clearer interpretability on the premise of maintaining performance.