Increasing accuracy of pulse arrival time estimation in low frequency recordings

Objective.Wearable devices that measure vital signals using photoplethysmography are becoming more commonplace. To reduce battery consumption, computational complexity, memory footprint or transmission bandwidth, companies of commercial wearable technologies are often looking to minimize the sampling frequency of the measured vital signals. One such vital signal of interest is the pulse arrival time (PAT), which is an indicator of blood pressure. To leverage this non-invasive and non-intrusive measurement data for use in clinical decision making, the accuracy of obtained PAT-parameters needs to increase in lower sampling frequency recordings. The aim of this paper is to develop a new strategy to estimate PAT at sampling frequencies up to 25 Hertz.Approach.The method applies template matching to leverage the random nature of sampling time and expected change in the PAT.Main results.The algorithm was tested on a publicly available dataset from 22 healthy volunteers, under sitting, walking and running conditions. The method significantly reduces both the mean and the standard deviation of the error when going to lower sampling frequencies by an average of 16.6% and 20.2%, respectively. Looking only at the sitting position, this reduction is even larger, increasing to an average of 22.2% and 48.8%, respectively.Significance.This new method shows promise in allowing more accurate estimation of PAT even in lower frequency recordings.

Lightweight preprocessing and template matching facilitate streamlined ischemic myocardial scar classification

Purpose

Ischemic myocardial scarring (IMS) is a common outcome of coronary artery disease that potentially leads to lethal arrythmias and heart failure. Late-gadolinium-enhanced cardiac magnetic resonance (CMR) imaging scans have served as the diagnostic bedrock for IMS, with recent advancements in machine learning enabling enhanced scar classification. However, the trade-off for these improvements is intensive computational and time demands. As a solution, we propose a combination of lightweight preprocessing (LWP) and template matching (TM) to streamline IMS classification.

Approach

CMR images from 279 patients (151 IMS, 128 control) were classified for IMS presence using two convolutional neural networks (CNNs) and TM, both with and without LWP. Evaluation metrics included accuracy, sensitivity, specificity, F1-score, area under the receiver operating characteristic curve (AUROC), and processing time. External testing dataset analysis encompassed patient-level classifications (PLCs) and a CNN versus TM classification comparison (CVTCC).

Results

LWP enhanced the speed of both CNNs (4.9x) and TM (21.9x). Furthermore, in the absence of LWP, TM outpaced CNNs by over 10x, while with LWP, TM was more than 100x faster. Additionally, TM performed similarly to the CNNs in accuracy, sensitivity, specificity, F1-score, and AUROC, with PLCs demonstrating improvements across all five metrics. Moreover, the CVTCC revealed a substantial 90.9% agreement.

Conclusions

Our results highlight the effectiveness of LWP and TM in streamlining IMS classification. Anticipated enhancements to LWP's region of interest (ROI) isolation and TM's ROI targeting are expected to boost accuracy, positioning them as a potential alternative to CNNs for IMS classification, supporting the need for further research.

Accurate Localization of First and Second Heart Sounds via Template Matching in Forcecardiography Signals

Cardiac auscultation is an essential part of physical examination and plays a key role in the early diagnosis of many cardiovascular diseases. The analysis of phonocardiography (PCG) recordings is generally based on the recognition of the main heart sounds, i.e., S1 and S2, which is not a trivial task. This study proposes a method for an accurate recognition and localization of heart sounds in Forcecardiography (FCG) recordings. FCG is a novel technique able to measure subsonic vibrations and sounds via small force sensors placed onto a subject's thorax, allowing continuous cardio-respiratory monitoring. In this study, a template-matching technique based on normalized cross-correlation was used to automatically recognize heart sounds in FCG signals recorded from six healthy subjects at rest. Distinct templates were manually selected from each FCG recording and used to separately localize S1 and S2 sounds, as well as S1-S2 pairs. A simultaneously recorded electrocardiography (ECG) trace was used for performance evaluation. The results show that the template matching approach proved capable of separately classifying S1 and S2 sounds in more than 96% of all heartbeats. Linear regression, correlation, and Bland-Altman analyses showed that inter-beat intervals were estimated with high accuracy. Indeed, the estimation error was confined within 10 ms, with negligible impact on heart rate estimation. Heart rate variability (HRV) indices were also computed and turned out to be almost comparable with those obtained from ECG. The preliminary yet encouraging results of this study suggest that the template matching approach based on normalized cross-correlation allows very accurate heart sounds localization and inter-beat intervals estimation.

Transformer-Based Multiple-Object Tracking via Anchor-Based-Query and Template Matching

Multiple object tracking (MOT) plays an important role in intelligent video-processing tasks, which aims to detect and track all moving objects in a scene. Joint-detection-and-tracking (JDT) methods are thriving in MOT tasks, because they accomplish the detection and data association in a single stage. However, the slow training convergence and insufficient data association limit the performance of JDT methods. In this paper, the anchor-based query (ABQ) is proposed to improve the design of the JDT methods for faster training convergence. By augmenting the coordinates of the anchor boxes into the learnable queries of the decoder, the ABQ introduces explicit prior spatial knowledge into the queries to focus the query-to-feature learning of the JDT methods on the local region, which leads to faster training speed and better performance. Moreover, a new template matching (TM) module is designed for the JDT methods, which enables the JDT methods to associate the detection results and trajectories with historical features. Finally, a new transformer-based MOT method, ABQ-Track, is proposed. Extensive experiments verify the effectiveness of the two modules, and the ABQ-Track surpasses the performance of the baseline JDT methods, TransTrack. Specifically, the ABQ-Track only needs to train for 50 epochs to achieve convergence, while that for TransTrack is 150 epochs.

Flatfeet Severity-Level Detection Based on Alignment Measuring

Flat foot is a postural deformity in which the plantar part of the foot is either completely or partially contacted with the ground. In recent clinical practices, X-ray radiographs have been introduced to detect flat feet because they are more affordable to many clinics than using specialized devices. This research aims to develop an automated model that detects flat foot cases and their severity levels from lateral foot X-ray images by measuring three different foot angles: the Arch Angle, Meary's Angle, and the Calcaneal Inclination Angle. Since these angles are formed by connecting a set of points on the image, Template Matching is used to allocate a set of potential points for each angle, and then a classifier is used to select the points with the highest predicted likelihood to be the correct point. Inspired by literature, this research constructed and compared two models: a Convolutional Neural Network-based model and a Random Forest-based model. These models were trained on 8000 images and tested on 240 unseen cases. As a result, the highest overall accuracy rate was 93.13% achieved by the Random Forest model, with mean values for all foot types (normal foot, mild flat foot, and moderate flat foot) being: 93.38 precision, 92.56 recall, 96.46 specificity, 95.42 accuracy, and 92.90 F-Score. The main conclusions that were deduced from this research are: (1) Using transfer learning (VGG-16) as a feature-extractor-only, in addition to image augmentation, has greatly increased the overall accuracy rate. (2) Relying on three different foot angles shows more accurate estimations than measuring a single foot angle.

ECG-Free Heartbeat Detection in Seismocardiography and Gyrocardiography Signals Provides Acceptable Heart Rate Variability Indices in Healthy and Pathological Subjects

Cardio-mechanical monitoring techniques, such as Seismocardiography (SCG) and Gyrocardiography (GCG), have received an ever-growing interest in recent years as potential alternatives to Electrocardiography (ECG) for heart rate monitoring. Wearable SCG and GCG devices based on lightweight accelerometers and gyroscopes are particularly appealing for continuous, long-term monitoring of heart rate and its variability (HRV). Heartbeat detection in cardio-mechanical signals is usually performed with the support of a concurrent ECG lead, which, however, limits their applicability in standalone cardio-mechanical monitoring applications. The complex and variable morphology of SCG and GCG signals makes the ECG-free heartbeat detection task quite challenging; therefore, only a few methods have been proposed. Very recently, a template matching method based on normalized cross-correlation (NCC) has been demonstrated to provide very accurate detection of heartbeats and estimation of inter-beat intervals in SCG and GCG signals of pathological subjects. In this study, the accuracy of HRV indices obtained with this template matching method is evaluated by comparison with ECG. Tests were performed on two public datasets of SCG and GCG signals from healthy and pathological subjects. Linear regression, correlation, and Bland-Altman analyses were carried out to evaluate the agreement of 24 HRV indices obtained from SCG and GCG signals with those obtained from ECG signals, simultaneously acquired from the same subjects. The results of this study show that the NCC-based template matching method allowed estimating HRV indices from SCG and GCG signals of healthy subjects with acceptable accuracy. On healthy subjects, the relative errors on time-domain indices ranged from 0.25% to 15%, on frequency-domain indices ranged from 10% to 20%, and on non-linear indices were within 8%. The estimates obtained on signals from pathological subjects were affected by larger errors. Overall, GCG provided slightly better performances as compared to SCG, both on healthy and pathological subjects. These findings provide, for the first time, clear evidence that monitoring HRV via SCG and GCG sensors without concurrent ECG is feasible with the NCC-based template matching method for heartbeat detection.

Extensive Angular Sampling Enables the Sensitive Localization of Macromolecules in Electron Tomograms

Cryo-electron tomography provides 3D images of macromolecules in their cellular context. To detect macromolecules in tomograms, template matching (TM) is often used, which uses 3D models that are often reliable for substantial parts of the macromolecules. However, the extent of rotational searches in particle detection has not been investigated due to computational limitations. Here, we provide a GPU implementation of TM as part of the PyTOM software package, which drastically speeds up the orientational search and allows for sampling beyond the Crowther criterion within a feasible timeframe. We quantify the improvements in sensitivity and false-discovery rate for the examples of ribosome identification and detection. Sampling at the Crowther criterion, which was effectively impossible with CPU implementations due to the extensive computation times, allows for automated extraction with high sensitivity. Consequently, we also show that an extensive angular sample renders 3D TM sensitive to the local alignment of tilt series and damage induced by focused ion beam milling. With this new release of PyTOM, we focused on integration with other software packages that support more refined subtomogram-averaging workflows. The automated classification of ribosomes by TM with appropriate angular sampling on locally corrected tomograms has a sufficiently low false-discovery rate, allowing for it to be directly used for high-resolution averaging and adequate sensitivity to reveal polysome organization.

Vision-Based Jigsaw Puzzle Solving with a Robotic Arm

This study proposed two algorithms for reconstructing jigsaw puzzles by using a color compatibility feature. Two realistic application cases were examined: one involved using the original image, while the other did not. We also calculated the transformation matrix to obtain the real positions of each puzzle piece and transmitted the positional information to the robotic arm, which then put each puzzle piece in its correct position. The algorithms were tested on 35-piece and 70-piece puzzles, achieving an average success rate of 87.1%. Compared with the human visual system, the proposed methods demonstrated enhanced accuracy when handling more complex textural images.

Heartbeat Detection in Gyrocardiography Signals without Concurrent ECG Tracings

A heartbeat generates tiny mechanical vibrations, mainly due to the opening and closing of heart valves. These vibrations can be recorded by accelerometers and gyroscopes applied on a subject's chest. In particular, the local 3D linear accelerations and 3D angular velocities of the chest wall are referred to as seismocardiograms (SCG) and gyrocardiograms (GCG), respectively. These signals usually exhibit a low signal-to-noise ratio, as well as non-negligible amplitude and morphological changes due to changes in posture and the sensors' location, respiratory activity, as well as other sources of intra-subject and inter-subject variability. These factors make heartbeat detection a complex task; therefore, a reference electrocardiogram (ECG) lead is usually acquired in SCG and GCG studies to ensure correct localization of heartbeats. Recently, a template matching technique based on cross correlation has proven to be particularly effective in recognizing individual heartbeats in SCG signals. This study aims to verify the performance of this technique when applied on GCG signals. Tests were conducted on a public database consisting of SCG, GCG, and ECG signals recorded synchronously on 100 patients with valvular heart diseases. The results show that the template matching technique identified heartbeats in GCG signals with a sensitivity and positive predictive value (PPV) of 87% and 92%, respectively. Regression, correlation, and Bland-Altman analyses carried out on inter-beat intervals obtained from GCG and ECG (assumed as reference) reported a slope of 0.995, an intercept of 4.06 ms (R² > 0.99), a Pearson's correlation coefficient of 0.9993, and limits of agreement of about ±13 ms with a negligible bias. A comparison with the results of a previous study obtained on SCG signals from the same database revealed that GCG enabled effective cardiac monitoring in significantly more patients than SCG (95 vs. 77). This result suggests that GCG could ensure more robust and reliable cardiac monitoring in patients with heart diseases with respect to SCG.

Co-Design Dedicated System for Efficient Object Tracking Using Swarm Intelligence-Oriented Search Strategies

The template matching technique is one of the most applied methods to find patterns in images, in which a reduced-size image, called a target, is searched within another image that represents the overall environment. In this work, template matching is used via a co-design system. A hardware coprocessor is designed for the computationally demanding step of template matching, which is the calculation of the normalized cross-correlation coefficient. This computation allows invariance in the global brightness changes in the images, but it is computationally more expensive when using images of larger dimensions, or even sets of images. Furthermore, we investigate the performance of six different swarm intelligence techniques aiming to accelerate the target search process. To evaluate the proposed design, the processing time, the number of iterations, and the success rate were compared. The results show that it is possible to obtain approaches capable of processing video images at 30 frames per second with an acceptable average success rate for detecting the tracked target. The search strategies based on PSO, ABC, FFA, and CS are able to meet the processing time of 30 frame/s, yielding average accuracy rates above 80% for the pipelined co-design implementation. However, FWA, EHO, and BFOA could not achieve the required timing restriction, and they achieved an acceptance rate around 60%. Among all the investigated search strategies, the PSO provides the best performance, yielding an average processing time of 16.22 ms coupled with a 95% success rate.

Quantification of gallium cryo-FIB milling damage in biological lamellae

Cryogenic electron microscopy (cryo-EM) can reveal the molecular details of biological processes in their native, cellular environment at atomic resolution. However, few cells are sufficiently thin to permit imaging with cryo-EM. Thinning of frozen cells to <500 nm lamellae by focused-ion-beam (FIB) milling has enabled visualization of cellular structures with cryo-EM. FIB milling represents a significant advance over prior approaches because of its ease of use, scalability, and lack of large-scale sample distortions. However, the amount of damage it causes to a thinned cell section has not yet been determined. We recently described an approach for detecting and identifying single molecules in cryo-EM images of cells using 2D template matching (2DTM). 2DTM is sensitive to small differences between a molecular model (template) and the detected structure (target). Here, we use 2DTM to demonstrate that under the standard conditions used for machining lamellae of biological samples, FIB milling introduces a layer of variable damage that extends to a depth of 60 nm from each lamella surface. This layer of damage limits the recovery of information for in situ structural biology. We find that the mechanism of FIB milling damage is distinct from radiation damage during cryo-EM imaging. By accounting for both electron scattering and FIB milling damage, we estimate that FIB milling damage with current protocols will negate the potential improvements from lamella thinning beyond 90 nm.

Robust H-K Curvature Map Matching for Patient-to-CT Registration in Neurosurgical Navigation Systems

Image-to-patient registration is a coordinate system matching process between real patients and medical images to actively utilize medical images such as computed tomography (CT) during surgery. This paper mainly deals with a markerless method utilizing scan data of patients and 3D data from CT images. The 3D surface data of the patient are registered to CT data using computer-based optimization methods such as iterative closest point (ICP) algorithms. However, if a proper initial location is not set up, the conventional ICP algorithm has the disadvantages that it takes a long converging time and also suffers from the local minimum problem during the process. We propose an automatic and robust 3D data registration method that can accurately find a proper initial location for the ICP algorithm using curvature matching. The proposed method finds and extracts the matching area for 3D registration by converting 3D CT data and 3D scan data to 2D curvature images and by performing curvature matching between them. Curvature features have characteristics that are robust to translation, rotation, and even some deformation. The proposed image-to-patient registration is implemented with the precise 3D registration of the extracted partial 3D CT data and the patient's scan data using the ICP algorithm.

ECG-Free Heartbeat Detection in Seismocardiography Signals via Template Matching

Cardiac monitoring can be performed by means of an accelerometer attached to a subject's chest, which produces the Seismocardiography (SCG) signal. Detection of SCG heartbeats is commonly carried out by taking advantage of a simultaneous electrocardiogram (ECG). SCG-based long-term monitoring would certainly be less obtrusive and easier to implement without an ECG. Few studies have addressed this issue using a variety of complex approaches. This study proposes a novel approach to ECG-free heartbeat detection in SCG signals via template matching, based on normalized cross-correlation as heartbeats similarity measure. The algorithm was tested on the SCG signals acquired from 77 patients with valvular heart diseases, available from a public database. The performance of the proposed approach was assessed in terms of sensitivity and positive predictive value (PPV) of the heartbeat detection and accuracy of inter-beat intervals measurement. Sensitivity and PPV of 96% and 97%, respectively, were obtained by considering templates that included both systolic and diastolic complexes. Regression, correlation, and Bland-Altman analyses carried out on inter-beat intervals reported slope and intercept of 0.997 and 2.8 ms (R² > 0.999), as well as non-significant bias and limits of agreement of ±7.8 ms. The results are comparable or superior to those achieved by far more complex algorithms, also based on artificial intelligence. The low computational burden of the proposed approach makes it suitable for direct implementation in wearable devices.

Automated assessment of human engineered heart tissues using deep learning and template matching for segmentation and tracking

The high rate of drug withdrawal from the market due to cardiovascular toxicity or lack of efficacy, the economic burden, and extremely long time before a compound reaches the market, have increased the relevance of human in vitro models like human (patient-derived) pluripotent stem cell (hPSC)-derived engineered heart tissues (EHTs) for the evaluation of the efficacy and toxicity of compounds at the early phase in the drug development pipeline. Consequently, the EHT contractile properties are highly relevant parameters for the analysis of cardiotoxicity, disease phenotype, and longitudinal measurements of cardiac function over time. In this study, we developed and validated the software HAARTA (Highly Accurate, Automatic and Robust Tracking Algorithm), which automatically analyzes contractile properties of EHTs by segmenting and tracking brightfield videos, using deep learning and template matching with sub-pixel precision. We demonstrate the robustness, accuracy, and computational efficiency of the software by comparing it to the state-of-the-art method (MUSCLEMOTION), and by testing it with a data set of EHTs from three different hPSC lines. HAARTA will facilitate standardized analysis of contractile properties of EHTs, which will be beneficial for in vitro drug screening and longitudinal measurements of cardiac function.

Printing Defect Detection Based on Scale-Adaptive Template Matching and Image Alignment

Printing defects are extremely common in the manufacturing industry. Although some studies have been conducted to detect printing defects, the stability and practicality of the printing defect detection has received relatively little attention. Currently, printing defect detection is susceptible to external environmental interference such as illuminance and noise, which leads to poor detection rates and poor practicality. This research develops a printing defect detection method based on scale-adaptive template matching and image alignment. Firstly, the research introduces a convolutional neural network (CNN) to adaptively extract deep feature vectors from templates and target images at a low-resolution version. Then, a feature map cross-correlation (FMCC) matching metric is proposed to measure the similarity of the feature map between the templates and target images, and the matching position is achieved by a proposed location refinement method. Finally, the matching image and the template are both sent to the image alignment module, so as to detect printing defects. The experimental results show that the accuracy of the proposed method reaches 93.62%, which can quickly and accurately find the location of the defect. Simultaneously, it is also proven that our method achieves state-of-the-art defect detection performance with strong real-time detection and anti-interference capabilities.

Mushroom Detection and Three Dimensional Pose Estimation from Multi-View Point Clouds

Agricultural robotics is an up and coming field which deals with the development of robotic systems able to tackle a multitude of agricultural tasks efficiently. The case of interest, in this work, is mushroom collection in industrial mushroom farms. Developing such a robot, able to select and out-root a mushroom, requires delicate actions that can only be conducted if a well-performing perception module exists. Specifically, one should accurately detect the 3D pose of a mushroom in order to facilitate the smooth operation of the robotic system. In this work, we develop a vision module for 3D pose estimation of mushrooms from multi-view point clouds using multiple RealSense active-stereo cameras. The main challenge is the lack of annotation data, since 3D annotation is practically infeasible on a large scale. To address this, we developed a novel pipeline for mushroom instance segmentation and template matching, where a 3D model of a mushroom is the only data available. We evaluated, quantitatively, our approach over a synthetic dataset of mushroom scenes, and we, further, validated, qualitatively, the effectiveness of our method over a set of real data, collected by different vision settings.

Large Displacement Detection Using Improved Lucas-Kanade Optical Flow

Displacement is critical when it comes to the evaluation of civil structures. Large displacement can be dangerous. There are many methods that can be used to monitor structural displacements, but every method has its benefits and limitations. Lucas-Kanade (LK) optical flow is recognized as a superior computer vision displacement tracking method, but it only applies to small displacement monitoring. An upgraded LK optical flow method is developed in this study and used to detect large displacement motions. One motion controlled by a multiple purpose testing system (MTS) and a free-falling experiment were designed to verify the developed method. The results provided by the upgraded LK optical flow method showed 97 percent accuracy when compared with the movement of the MTS piston. In order to capture the free-falling large displacement, the pyramid and warp optical flow methods are included in the upgraded LK optical flow method and compared with the results of template matching. The warping algorithm with the second derivative Sobel operator provides accurate displacements with 96% average accuracy.

Cluster Analysis of Seismicity in the Eastern Gulf of Corinth Based on a Waveform Template Matching Catalog

The Corinth Rift, in Central Greece, is one of the most seismically active areas in Europe. In the eastern part of the Gulf of Corinth, which has been the site of numerous large and destructive earthquakes in both historic and modern times, a pronounced earthquake swarm occurred in 2020-2021 at the Perachora peninsula. Herein, we present an in-depth analysis of this sequence, employing a high-resolution relocated earthquake catalog, further enhanced by the application of a multi-channel template matching technique, producing additional detections of over 7600 events between January 2020 and June 2021. Single-station template matching enriches the original catalog thirty-fold, providing origin times and magnitudes for over 24,000 events. We explore the variable levels of spatial and temporal resolution in the catalogs of different completeness magnitudes and also of variable location uncertainties. We characterize the frequency-magnitude distributions using the Gutenberg-Richter scaling relation and discuss possible b-value temporal variations that appear during the swarm and their implications for the stress levels in the area. The evolution of the swarm is further analyzed through spatiotemporal clustering methods, while the temporal properties of multiplet families indicate that short-lived seismic bursts, associated with the swarm, dominate the catalogs. Multiplet families present clustering effects at all time scales, suggesting triggering by aseismic factors, such as fluid diffusion, rather than constant stress loading, in accordance with the spatiotemporal migration patterns of seismicity.

Flexible template matching for observational study design

Matching is a popular design for inferring causal effect with observational data. Unlike model-based approaches, it is a nonparametric method to group treated and control subjects with similar characteristics together, hence to re-create a randomization-like scenario. The application of matched design for real world data may be limited by: (1) the causal estimand of interest; (2) the sample size of different treatment arms. We propose a flexible design of matching, based on the idea of template matching, to overcome these challenges. It first identifies the template group which is representative of the target population, then match subjects from the original data to this template group and make inference. We provide theoretical justification on how it unbiasedly estimates the average treatment effect using matched pairs and the average treatment effect on the treated when the treatment group has a bigger sample size. We also propose using the triplet matching algorithm to improve matching quality and devise a practical strategy to select the template size. One major advantage of matched design is that it allows both randomization-based or model-based inference, with the former being more robust. For the commonly used binary outcome in medical research, we adopt a randomization inference framework of attributable effects in matched data, which allows heterogeneous effects and can incorporate sensitivity analysis for unmeasured confounding. We apply our design and analytical strategy to a trauma care evaluation study.

Towards Efficient and Accurate SARS-CoV-2 Genome Sequence Typing Based on Supervised Learning Approaches

Despite the active development of SARS-CoV-2 surveillance methods (e.g., Nextstrain, GISAID, Pangolin), the global emergence of various SARS-CoV-2 viral lineages that potentially cause antiviral and vaccine failure has driven the need for accurate and efficient SARS-CoV-2 genome sequence classifiers. This study presents an optimized method that accurately identifies the viral lineages of SARS-CoV-2 genome sequences using existing schemes. For Nextstrain and GISAID clades, a template matching-based method is proposed to quantify the differences between viral clades and to play an important role in classification evaluation. Furthermore, to improve the typing accuracy of SARS-CoV-2 genome sequences, an ensemble model that integrates a combination of machine learning-based methods (such as Random Forest and Catboost) with optimized weights is proposed for Nextstrain, Pangolin, and GISAID clades. Cross-validation is applied to optimize the parameters of the machine learning-based method and the weight settings of the ensemble model. To improve the efficiency of the model, in addition to the one-hot encoding method, we have proposed a nucleotide site mutation-based data structure that requires less computational resources and performs better in SARS-CoV-2 genome sequence typing. Based on an accumulated database of >1 million SARS-CoV-2 genome sequences, performance evaluations show that the proposed system has a typing accuracy of 99.879%, 97.732%, and 96.291% for Nextstrain, Pangolin, and GISAID clades, respectively. A single prediction only takes an average of <20 ms on a portable laptop. Overall, this study provides an efficient and accurate SARS-CoV-2 genome sequence typing system that benefits current and future surveillance of SARS-CoV-2 variants.

Shape-Texture Debiased Training for Robust Template Matching

Finding a template in a search image is an important task underlying many computer vision applications. This is typically solved by calculating a similarity map using features extracted from the separate images. Recent approaches perform template matching in a deep feature space, produced by a convolutional neural network (CNN), which is found to provide more tolerance to changes in appearance. Inspired by these findings, in this article we investigate whether enhancing the CNN's encoding of shape information can produce more distinguishable features that improve the performance of template matching. By comparing features from the same CNN trained using different shape-texture training methods, we determined a feature space which improves the performance of most template matching algorithms. When combining the proposed method with the Divisive Input Modulation (DIM) template matching algorithm, its performance is greatly improved, and the resulting method produces state-of-the-art results on a standard benchmark. To confirm these results, we create a new benchmark and show that the proposed method outperforms existing techniques on this new dataset.

Fusion-Based Versatile Video Coding Intra Prediction Algorithm with Template Matching and Linear Prediction

The new generation video coding standard Versatile Video Coding (VVC) has adopted many novel technologies to improve compression performance, and consequently, remarkable results have been achieved. In practical applications, less data, in terms of bitrate, would reduce the burden of the sensors and improve their performance. Hence, to further enhance the intra compression performance of VVC, we propose a fusion-based intra prediction algorithm in this paper. Specifically, to better predict areas with similar texture information, we propose a fusion-based adaptive template matching method, which directly takes the error between reference and objective templates into account. Furthermore, to better utilize the correlation between reference pixels and the pixels to be predicted, we propose a fusion-based linear prediction method, which can compensate for the deficiency of single linear prediction. We implemented our algorithm on top of the VVC Test Model (VTM) 9.1. When compared with the VVC, our proposed fusion-based algorithm saves a bitrate of 0.89%, 0.84%, and 0.90% on average for the Y, Cb, and Cr components, respectively. In addition, when compared with some other existing works, our algorithm showed superior performance in bitrate savings.

In Situ Measurement of the Strain Field at the Fatigue Crack Tip Based on Sub-Image Stitching and Matching DIC

Studying the in situ measurement and evolution of the strain field at the crack tip during fatigue crack growth (FCG) is of great significance for understanding the fracture characteristics of materials and predicting fatigue life. Herein, a new method is proposed for the in-situ measurement of the strain field at the fatigue crack tip based on microscopic digital image correlation (DIC). The method proposed solves the problem of the existing in situ strain field measurement method being unable to dynamically track the crack tip and take the crack tip image due to the limitation of the field of view of the microscopic camera. A macroscopic camera is used to capture the global crack images on one side of the compact tension (CT) specimen. Meanwhile, a microscopic camera is used to track and capture the crack propagation speckle image on the other side of the CT specimen. The proposed method was verified by experiments with Quenching and Partitioning 980 (Q&P980) steel, and the results showed that the method has high accuracy, with the average measurement error being less than 5% and the maximum error being less than 10%. A butterfly shape of the measured strain field and the strain concentration near the crack tip were observed. The success of this method will help to obtain better insight into and understanding of the fracture behavior of metal materials as well as precise prediction of the fatigue life of metal materials.

Detection of Oculomotor Dysmetria From Mobile Phone Video of the Horizontal Saccades Task Using Signal Processing and Machine Learning Approaches

Eye movement assessments have the potential to help in diagnosis and tracking of neurological disorders. Cerebellar ataxias cause profound and characteristic abnormalities in smooth pursuit, saccades, and fixation. Oculomotor dysmetria (i.e., hypermetric and hypometric saccades) is a common finding in individuals with cerebellar ataxia. In this study, we evaluated a scalable approach for detecting and quantifying oculomotor dysmetria. Eye movement data were extracted from iPhone video recordings of the horizontal saccade task (a standard clinical task in ataxia) and combined with signal processing and machine learning approaches to quantify saccade abnormalities. Entropy-based measures of eye movements during saccades were significantly different in 72 individuals with ataxia with dysmetria compared with 80 ataxia and Parkinson's participants without dysmetria. A template matching-based analysis demonstrated that saccadic eye movements in patients without dysmetria were more similar to the ideal template of saccades. A support vector machine was then used to train and test the ability of multiple signal processing features in combination to distinguish individuals with and without oculomotor dysmetria. The model achieved 78% accuracy (sensitivity= 80% and specificity= 76%). These results show that the combination of signal processing and machine learning approaches applied to iPhone video of saccades, allow for extraction of information pertaining to oculomotor dysmetria in ataxia. Overall, this inexpensive and scalable approach for capturing important oculomotor information may be a useful component of a screening tool for ataxia and could allow frequent at-home assessments of oculomotor function in natural history studies and clinical trials.

Template Matching and Matrix Profile for Signal Quality Assessment of Carotid and Femoral Laser Doppler Vibrometer Signals

Background: Laser-Doppler Vibrometry (LDV) is a laser-based technique that allows measuring the motion of moving targets with high spatial and temporal resolution. To demonstrate its use for the measurement of carotid-femoral pulse wave velocity, a prototype system was employed in a clinical feasibility study. Data were acquired for analysis without prior quality control. Real-time application, however, will require a real-time assessment of signal quality. In this study, we (1) use template matching and matrix profile for assessing the quality of these previously acquired signals; (2) analyze the nature and achievable quality of acquired signals at the carotid and femoral measuring site; (3) explore models for automated classification of signal quality. Methods: Laser-Doppler Vibrometry data were acquired in 100 subjects (50M/50F) and consisted of 4-5 sequences of 20-s recordings of skin displacement, differentiated two times to yield acceleration. Each recording consisted of data from 12 laser beams, yielding 410 carotid-femoral and 407 carotid-carotid recordings. Data quality was visually assessed on a 1-5 scale, and a subset of best quality data was used to construct an acceleration template for both measuring sites. The time-varying cross-correlation of the acceleration signals with the template was computed. A quality metric constructed on several features of this template matching was derived. Next, the matrix-profile technique was applied to identify recurring features in the measured time series and derived a similar quality metric. The statistical distribution of the metrics, and their correlates with basic clinical data were assessed. Finally, logistic-regression-based classifiers were developed and their ability to automatically classify LDV-signal quality was assessed. Results: Automated quality metrics correlated well with visual scores. Signal quality was negatively correlated with BMI for femoral recordings but not for carotid recordings. Logistic regression models based on both methods yielded an accuracy of minimally 80% for our carotid and femoral recording data, reaching 87% for the femoral data. Conclusion: Both template matching and matrix profile were found suitable methods for automated grading of LDV signal quality and were able to generate a quality metric that was on par with the signal quality assessment of the expert. The classifiers, developed with both quality metrics, showed their potential for future real-time implementation.

Facility profiling under competing risks using multivariate prognostic scores: Application to kidneytransplant centers

The performance of health care facilities (e.g. hospitals, transplant centers, etc.) is often evaluated through time-to-event outcomes. In this paper, we consider the case where, for each subject, the failure event is due to one of several mutually exclusive causes (competing risks). Since the distribution of patient characteristics may differ greatly by the center, some form of covariate adjustment is generally necessary in order for center-specific outcomes to be accurately compared (to each other or to an overall average). We propose a weighting method for comparing facility-specific cumulative incidence functions to an overall average. The method directly standardizes each facility's non-parametric cumulative incidence function through a weight function constructed from a multivariate prognostic score. We formally define the center effects and derive large-sample properties of the proposed estimator. We evaluate the finite sample performance of the estimator through simulation. The proposed method is applied to the end-stage renal disease setting to evaluate the center-specific pre-transplant mortality and transplant cumulative incidence functions from the Scientific Registry of Transplant Recipients.

Reliable Template Matching for Image Detection in Vision Sensor Systems

Template matching is a simple image detection algorithm that can easily detect different types of objects just by changing the template without tedious training procedures. Despite these advantages, template matching is not currently widely used. This is because traditional template matching is not very reliable for images that differ from the template. The reliability of template matching can be improved by using additional information (depths for the template) available from the vision sensor system. Methods of obtaining the depth of a template using stereo vision or a few (two or more) template images or a short template video via mono vision are well known in the vision literature and have been commercialized. In this strategy, this paper proposes a template matching vision sensor system that can easily detect various types of objects without prior training. To this end, by using the additional information provided by the vision sensor system, we study a method to increase the reliability of template matching, even when there is a difference in the 3D direction and size between the template and the image. Template images obtained through the vision sensor provide a depth template. Using this depth template, it is possible to predict the change of the image according to the difference in the 3D direction and the size of the object. Using the predicted changes in these images, the template is calibrated close to the given image, and then template matching is performed. For ease of use, the algorithm is proposed as a closed form solution that avoids tedious recursion or training processes. For wider application and more accurate results, the proposed method considers the 3D direction and size difference in the perspective projection model and the general 3D rotation model.

Intelligent Mining of Urban Ventilation Corridors Based on High-Precision Oblique Photographic Images

With the advancement of urbanization and the impact of industrial pollution, the issue of urban ventilation has attracted increasing attention. Research on urban ventilation corridors is a hotspot in the field of urban planning. Traditional studies on ventilation corridors mostly focus on qualitative or simulated research on urban climate issues such as the intensified urban heat island effect, serious environmental pollution, and insufficient climate adaptability. Based on the high-precision urban remote sensing image data obtained by aeromagnetic oblique photography, this paper calculates the frontal area density of the city with reference to the urban wind statistics. Based on the existing urban patterns, template matching technology was used to automatically excavate urban ventilation corridors, which provides scientific and reasonable algorithmic support for the rapid construction of potential urban ventilation corridor paths. It also provides technical methods and decision basis for low-carbon urban planning, ecological planning and microclimate optimization design. This method was proved to be effective through experiments in Deqing city, Zhejiang Province, China.

A Triggering Mechanism for Cyber-Attacks in Naval Sensors and Systems

In the maritime sector, the integration of radar systems, Automatic Identification System (AIS) and Electronic Chart Display and Information System (ECDIS) through digital technologies enables several benefits to maritime operations, but also make ships prone to cyberattacks. In this context, this work investigates the feasibility of an attacker using a radar system or AIS as open door to remotely send commands to a cyber threat hosted on a ship, even if the ship’s systems are air gapped—i.e., are not connected to other networks. The received commands are intended to trigger a cyber threat located in the ship. Although the literature covers several analyzes on cyber risks and vulnerabilities in naval systems, it lacks exploiting mechanisms capable of acknowledging attack commands received through radar and AIS. To this end, this work proposes a triggering mechanism that uses a template matching technique to detect specific patterns transmitted by the attacker to the ship’s radar or AIS. The results show the effectiveness of the proposed technique as a tool to acknowledge the received attack commands and activate a malicious code previously installed on the ship. In the case of attacks on a radar system, the accuracy achieved by the proposed method is 0.90. In the case of attacks on an AIS/ECDIS setup it presents an accuracy of 0.93. In both cases the proposed mechanism maintains the due safety against accidental attack activations.

Ground Speed Optical Estimator for Miniature UAV

In a conventional Unmanned aerial vehicles (UAV) navigational system Global Navigation Satellite System (GNSS) sensor is often a main source of data for trajectory generation. Even video tracking based systems need some GNSS data for proper work. The goal of this study is to develop an optics-based system to estimate the ground speed of the UAV in the case of the GNSS failure, jamming, or unavailability. The proposed approach uses a camera mounted on the fuselage belly of the UAV. We can obtain the ground speed of the airplane by using the digital cropping, the stabilization of the real time image, and template matching algorithms. By combining the ground speed vector components with measurements of airspeed and altitude, the wind velocity and drift are computed. The obtained data were used to improve efficiency of the video-tracking based on a navigational system. An algorithm allows this computation to be performed in real time on board of a UAV. The algorithm was tested in Software-in-the-loop and implemented on the UAV hardware. Its effectiveness has been demonstrated through the experimental test results. The presented work could be useful for upgrading the existing MUAV products (with embedded cameras) already delivered to the customers only by updating their software. It is especially significant in the case when any necessary hardware upgrades would be economically unjustified or even impossible to be carried out.

Research on track fastener positioning method based on local unidirectional template matching

Commonly used fastener positioning methods include pixel statistics (PS) method and template matching (TM) method. For the PS method, it is difficult to judge the image segmentation threshold due to the complex background of the track. For the TM method, the search in both directions of the global is easily affected by complex background, as a result, the locating accuracy of fasteners is low. To solve the above problems, this paper combines the PS method with the TM method and proposes a new fastener positioning method called local unidirectional template matching (LUTM). First, the rail positioning is achieved by the PS method based on the gray-scale vertical projection. Then, based on the prior knowledge, the image of the rail and the surrounding area of the rail is obtained which is referred to as the 1-shaped rail image; then, the 1-shaped rail image and the produced offline symmetrical fastener template is pre-processed. Finally, the symmetrical fastener template image is searched from top to bottom along the rail and the correlation is calculated to realize the fastener positioning. Experiments have proved that the method in this paper can effectively realize the accurate locating of the fastener for ballastless track and ballasted track at the same time.

Follower: A Novel Self-Deployable Action Recognition Framework

Deep learning technology has improved the performance of vision-based action recognition algorithms, but such methods require a large number of labeled training datasets, resulting in weak universality. To address this issue, this paper proposes a novel self-deployable ubiquitous action recognition framework that enables a self-motivated user to bootstrap and deploy action recognition services, called FOLLOWER. Our main idea is to build a "fingerprint" library of actions based on a small number of user-defined sample action data. Then, we use the matching method to complete action recognition. The key step is how to construct a suitable "fingerprint". Thus, a pose action normalized feature extraction method based on a three-dimensional pose sequence is designed. FOLLOWER is mainly composed of the guide process and follow the process. Guide process extracts pose action normalized feature and selects the inner class central feature to build a "fingerprint" library of actions. Follow process extracts the pose action normalized feature in the target video and uses the motion detection, action filtering, and adaptive weight offset template to identify the action in the video sequence. Finally, we collect an action video dataset with human pose annotation to research self-deployable action recognition and action recognition based on pose estimation. After experimenting on this dataset, the results show that FOLLOWER can effectively recognize the actions in the video sequence with recognition accuracy reaching 96.74%.

A Very High-Speed Validation Scheme Based on Template Matching for Segmented Character Expiration Codes on Beverage Cans

This paper expands upon a previous publication and is the natural continuation of an earlier study which presented an industrial validator of expiration codes printed on aluminium or tin cans, called MONICOD. MONICOD is distinguished by its high operating speed, running at 200 frames per second and validating up to 35 cans per second. This paper adds further detail to this description by describing the final stage of the MONICOD industrial validator: the process of effectively validating the characters. In this process we compare the acquired shapes, segmented during the prior stages, with expected character shapes. To do this, we use a template matching scheme (here called “morphologies”) based on bitwise operations. Two learning algorithms for building the valid morphology databases are also presented. The results of the study presented here show that in the acquisition of 9885 frames containing 465 cans to be validated, there was only one false positive (0.21% of the total). Another notable feature is that it is at least 20% faster in validation time with error rates similar to those of classifiers such as support vector machines (SVM), radial base functions (RBF), multi-layer perceptron with backpropagation (MLP) and k-nearest neighbours (KNN).

A PCB Alignment System Using RST Template Matching with CUDA on Embedded GPU Board

The fiducial-marks-based alignment process is one of the most critical steps in printed circuit board (PCB) manufacturing. In the alignment process, a machine vision technique is used to detect the fiducial marks and then adjust the position of the vision system in such a way that it is aligned with the PCB. The present study proposed an embedded PCB alignment system, in which a rotation, scale and translation (RST) template-matching algorithm was employed to locate the marks on the PCB surface. The coordinates and angles of the detected marks were then compared with the reference values which were set by users, and the difference between them was used to adjust the position of the vision system accordingly. To improve the positioning accuracy, the angle and location matching process was performed in refinement processes. To overcome the matching time, in the present study we accelerated the rotation matching by eliminating the weak features in the scanning process and converting the normalized cross correlation (NCC) formula to a sum of products. Moreover, the scanning time was reduced by implementing the entire RST process in parallel on threads of a graphics processing unit (GPU) by applying hash functions to find refined positions in the refinement matching process. The experimental results showed that the resulting matching time was around 32× faster than that achieved on a conventional central processing unit (CPU) for a test image size of 1280 × 960 pixels. Furthermore, the precision of the alignment process achieved a considerable result with a tolerance of 36.4μm.

Automatic Acoustic Target Detecting and Tracking on the Azimuth Recording Diagram with Image Processing Methods

Passive acoustic target detection has been a hot research topic for a few decades. Azimuth recording diagram is one of the most promising techniques to estimate the arrival direction of the interested signal by visualizing the sound wave information. However, this method is challenged by the random ambient noise, resulting in low reliability and short effective distance. This paper presents a real-time postprocessing framework for passive acoustic target detection modalities by using a sonar array, in which image processing methods are used to automate the target detecting and tracking on the azimuth recording diagram. The simulation results demonstrate that the proposed approach can provide a higher reliability compared with the conventional ones, and is suitable for the constraints of real-time tracking.

BLE Fingerprint Indoor Localization Algorithm Based on Eight-Neighborhood Template Matching

Aiming at the problem of indoor environment, signal non-line-of-sight propagation and other factors affect the accuracy of indoor locating, an algorithm of indoor fingerprint localization based on the eight-neighborhood template is proposed. Based on the analysis of the signal strength of adjacent reference points in the fingerprint database, the methods for the eight-neighborhood template matching and generation were studied. In this study, the indoor environment was divided into four quadrants for each access point and the expected values of the received signal strength indication (RSSI) difference between the center points and their eight-neighborhoods in different quadrants were chosen as the generation parameters. Then different templates were generated for different access points, and the unknown point was located by the Euclidean distance for the correlation of RSSI between each template and its coverage area in the fingerprint database. With the spatial correlation of fingerprint data taken into account, the influence of abnormal fingerprint on locating accuracy is reduced. The experimental results show that the locating error is 1.0 m, which is about 0.2 m less than both K-nearest neighbor (KNN) and weighted K-nearest neighbor (WKNN) algorithms.

A Study on the Gaze Range Calculation Method During an Actual Car Driving Using Eyeball Angle and Head Angle Information

Car operation requires advanced brain function. Currently, evaluation of the motor vehicle driving ability of people with higher brain dysfunction is medically unknown and there are few evaluation criteria. The increase in accidents by elderly drivers is a social problem in Japan, and a method to evaluate whether elderly people can drive a car is needed. Under these circumstances, a system to evaluate brain dysfunction and driving ability of elderly people is needed. Gaze estimation research is a rapidly developing field. In this paper, we propose the gaze calculation method by eye and head angles. We used the eye tracking device (TalkEyeLite) made by Takei Scientific Instruments Cooperation. For our image processing technique, we estimated the head angle using the template matching method. By using the eye tracking device and the head angle estimate, we built a system that can be used during actual on-road car operation. In order to evaluate our proposed method, we tested the system on Japanese drivers during on-road driving evaluations at a driving school. The subjects were one instructor of the car driving school and eight general drivers (three 40–50 years old and five people over 60 years old). We compared the gaze range of the eight general subjects and the instructor. As a result, we confirmed that one male in his 40s and one elderly driver had narrower gaze ranges.

Research on Method of Farmland Obstacle Boundary Extraction in UAV Remote Sensing Images

Aimed at the problem of obstacle detection in farmland, the research proposed to adopt the method of farmland information acquisition based on unmanned aerial vehicle landmark image, and improved the method of extracting obstacle boundary based on standard correlation coefficient template matching and assessed the influence of different image resolutions on the precision of obstacle extraction. Analyzing the RGB image of farmland acquired by unmanned aerial vehicle remote sensing technology, this research got the following results. Firstly, we applied a method automatically registering coordinates, and the average deviations on the X and Y direction were 4.6 cm and 12.0 cm respectively, while the average deviations manually by ArcGIS were 4.6 cm and 5.7 cm. Secondly, with an improvement on the step of the traditional correlation coefficient template matching, we reduced the time of template matching from 12.2 s to 4.6 s. The average deviation between edge length of obstacles calculated by corner points extracted by the algorithm and that by actual measurement was 4.0 cm. Lastly, by compressing the original image on a different ratio, when the pixel reached 735 × 2174 (the image resolution reached 6 cm), the obstacle boundary was extracted based on correlation coefficient template matching, the average deviations of boundary points I of six obstacles on the X and Y were respectively 0.87 and 0.95 cm, and the whole process of detection took about 3.1 s. To sum up, it can be concluded that the algorithm of automatically registered coordinates and of automatically extracted obstacle boundary, which were designed in this research, can be applied to the establishment of a basic information collection system for navigation in future study. The best image pixel of obstacle boundary detection proposed after integrating the detection precision and detection time can be the theoretical basis for deciding the unmanned aerial vehicle remote sensing image resolution.

Real-Time Object Tracking with Template Tracking and Foreground Detection Network

In this paper, we propose a fast and accurate deep network-based object tracking method, which combines feature representation, template tracking and foreground detection into a single framework for robust tracking. The proposed framework consists of a backbone network, which feeds into two parallel networks, TmpNet for template tracking and FgNet for foreground detection. The backbone network is a pre-trained modified VGG network, in which a few parameters need to be fine-tuned for adapting to the tracked object. FgNet is a fully convolutional network to distinguish the foreground from background in a pixel-to-pixel manner. The parameter in TmpNet is the learned channel-wise target template, which initializes in the first frame and performs fast template tracking in the test frames. To enable each component to work closely with each other, we use a multi-task loss to end-to-end train the proposed framework. In online tracking, we combine the score maps from TmpNet and FgNet to find the optimal tracking results. Experimental results on object tracking benchmarks demonstrate that our approach achieves favorable tracking accuracy against the state-of-the-art trackers while running at a real-time speed of 38 fps.

[Optimal template selecting combined with non-liner template matching for Doppler fetal heart rate extraction]

The ultrasound Doppler fetal heart rate measurement is the gold standard of fetal heart rate counting. However, the existing fetal heart rate extraction algorithms are not designed specifically to suppress the high maternal interference during the second stage of labor, and false detection occurrences are common during labor. With this background, a method combining time-frequency frame template library optimal selecting and non-linear template matching is proposed. The method contributes a template library, and the optimal template can be selected to match the signal frame. After the short-time Fourier transform of the signal, the difference between the signal and the template is optimized by leaky rectified linear unit (LReLU) function frame by frame. The heart rate was calculated from the peak of the matching curve and the heart rate was calculated. By comparing the proposed method with the autocorrelation method, the results show that the detection accuracy of the proposed method is improved by 20% on average, and the non-linear template matching of 23% samples is at least 50% higher than the autocorrelation method. This paper designs the algorithm by analyzing the characteristics of the interference and signal mixing. We hope that this paper will provide a new idea for fetal heart rate extraction which not only focuses on the original signal.

A collection of yeast cellular electron cryotomography data

BACKGROUND

Cells are powered by a large set of macromolecular complexes, which work together in a crowded environment. The in situ mechanisms of these complexes are unclear because their 3D distribution, organization, and interactions are largely unknown. Electron cryotomography (cryo-ET) can address these knowledge gaps because it produces cryotomograms-3D images that reveal biological structure at ∼4-nm resolution. Cryo-ET uses no fixation, dehydration, staining, or plastic embedment, so cellular features are visualized in a life-like, frozen-hydrated state. To study chromatin and mitotic machinery in situ, we subjected yeast cells to genetic and chemical perturbations, cryosectioned them, and then imaged the cells by cryo-ET.

FINDINGS

Here we share >1,000 cryo-ET raw datasets of cryosectioned budding yeast Saccharomyces cerevisiaecollected as part of previously published studies. These data will be valuable to cell biologists who are interested in the nanoscale organization of yeasts and of eukaryotic cells in general. All the unpublished tilt series and a subset of corresponding cryotomograms have been deposited in the EMPIAR resource for the community to use freely. To improve tilt series discoverability, we have uploaded metadata and preliminary notes to publicly accessible Google Sheets, EMPIAR, and GigaDB.

CONCLUSIONS

Cellular cryo-ET data can be mined to obtain new cell-biological, structural, and 3D statistical insights in situ. These data contain structures not visible in traditional electron-microscopy data. Template matching and subtomogram averaging of known macromolecular complexes can reveal their 3D distributions and low-resolution structures. Furthermore, these data can serve as testbeds for high-throughput image-analysis pipelines, as training sets for feature-recognition software, for feasibility analysis when planning new structural-cell-biology projects, and as practice data for students.

Markerless tumor tracking using fast-kV switching dual-energy fluoroscopy on a benchtop system

PURPOSE

To evaluate markerless tumor tracking (MTT) using fast-kV switching dual-energy (DE) fluoroscopy on a bench top system.

METHODS

Fast-kV switching DE fluoroscopy was implemented on a bench top which includes a turntable stand, flat panel detector, and x-ray tube. The customized generator firmware enables consecutive x-ray pulses that alternate between programmed high and low energies (e.g., 60 and 120 kVp) with a maximum frame rate of 15 Hz. In-house software was implemented to perform weighted DE subtraction of consecutive images to create an image sequence that removes bone and enhances soft tissues. The weighting factor was optimized based on gantry angle. To characterize this system, a phantom was used that simulates the chest anatomy and tumor motion in the lung. Five clinically relevant tumor sizes (5-25 mm diameter) were considered. The targets were programmed to move in the inferior-superior direction of the phantom, perpendicular to the x-ray beam, using a cos⁴ waveform to mimic respiratory motion. Target inserts were then tracked with MTT software using a template matching method. The optimal computed tomography (CT) slice thickness for template generation was also evaluated. Tracking success rate and accuracy were calculated in regions of the phantom where the target overlapped ribs vs spine, to compare the performance of single energy (SE) and DE imaging methods.

RESULTS

For the 5 mm target, a CT slice thickness of 0.75 mm resulted in the lowest tracking error. For the larger targets (≥10 mm) a CT slice thickness ≤2 mm resulted in comparable tracking errors for SE and DE images. Overall DE imaging improved MTT accuracy, relative to SE imaging, for all tumor targets in a rotational acquisition. Compared to SE, DE imaging increased tracking success rate of small target inserts (5 and 10 mm). For fast motion tracking, success rates improved from 23% to 64% and 74% to 90% for 5 and 10 mm targets inserts overlapping ribs, respectively. For slow moving targets success rates improved from 19% to 59% and 59% to 91% in 5 and 10 mm targets overlapping the ribs, respectively. Similar results were observed when the targets overlapped the spine. For larger targets (≥15 mm) tracking success rates were comparable using SE and DE imaging.

CONCLUSION

This work presents the first results of MTT using fast-kV switching DE fluoroscopy. Using DE imaging has improved the tracking accuracy of MTT, especially for small targets. The results of this study will guide the future implementation of fast-kV switching DE imaging using the on-board imager of a linear accelerator.

Untargeted and Targeted Fingerprinting of Extra Virgin Olive Oil Volatiles by Comprehensive Two-Dimensional Gas Chromatography with Mass Spectrometry: Challenges in Long-Term Studies

Comprehensive two-dimensional gas chromatography coupled with mass spectrometric detection (GC × GC-MS) offers an information-rich basis for effective chemical fingerprinting of food. However, GC × GC-MS yields 2D-peak patterns (i.e., sample 2D fingerprints) whose consistency may be affected by variables related to either the analytical platform or to the experimental parameters adopted for the analysis. This study focuses on the complex volatile fraction of extra-virgin olive oil and addresses 2D-peak patterns variations, including MS signal fluctuations, as they may occur in long-term studies where pedo-climatic, harvest year, or shelf life changes are studied. The 2D-pattern misalignments are forced by changing chromatographic settings and MS acquisition. All procedural steps, preceding pattern recognition by template matching, are analyzed and a rational workflow defined to accurately realign patterns and analytes metadata. Signal-to-noise ratio (SNR) detection threshold, reference spectra extraction, and similarity match factor threshold are critical to avoid false-negative matches. Distance thresholds and polynomial transform parameters are key for effective template matching. In targeted analysis (supervised workflow) with optimized parameters, method accuracy reaches 92.5% (i.e., % of true-positive matches) while for combined untargeted and targeted ( UT) fingerprinting (unsupervised workflow), accuracy reaches 97.9%. Response normalization also is examined, evidencing good performance of multiple internal standard normalization that effectively compensates for discriminations occurring during injection of highly volatile compounds. The resulting workflow is simple, effective, and time efficient.

An electronic travel guide for visually impaired - vehicle board recognition system through computer vision techniques

Purpose: In the context of assistive technology, mobility takes the meaning of "moving safely, gracefully, and comfortably".The aim of this article is to provide a system which will be a convenient means of navigation for the Visually Impaired people, in the public transport system.Method: A blind regular commuter who travels by public transport facility finds difficulty in identifying the vehicle that is nearing the stop. Hence, a real-time system that dynamically identifies the nearing vehicle and informs the commuters is necessary. This paper proposes such a system namely the "Vehicle Board Recognition System" (VBRS). Computer Vision techniques such as segmentation, object recognition, text detection and optical character recognition are utilized to build the system, which will detect, analyze, derive and communicate the information to the passengers.Results: Thanks to the rapid development in technology, there are several navigation systems both hand held and wearable, available to help visually impaired (VI) people move comfortably both indoor and outdoor. Many blind people are not comfortable in using these devices or they are not affordable for them. Thus the proposed system gives them the comfort of navigation.Conclusion: This system can be installed in the bus stop to assist the Visually Impaired, from externally rather than their hand held or wearable assistive devices.Implications for rehabilitationThis proposed system will help the visually impaired toensure secure navigationbe independent of the others develop self confidence.overcome the training, affordability of wearable/ handheld devices.

[Automated Detection of Radiopaque Markers in Chest and Abdomen Radiography]

We aimed to develop a computerized method for the detection of radiopaque markers, such as R and L in chest and abdomen radiography by using the generalized Hough transform and the template matching. To develop the computerized method, we used 200 chest and abdomen images in our institution as training cases. First, two template images for R and L markers were created with the same exposure condition as a chest X-ray. Following various image processing, such as edge detection, thinning and Hough transformed, a look-up table that consisted of distance and direction pairs was built for the generalized Hough transform. All training images were preprocessed with median filter, edge detection, binarization, thinning, back ground removal and labeling. For candidates of markers that were detected as true positive or false positive, their vote and cross-correlation were calculated with the generalized Hough transform. To evaluate this proposed method, a validation test was performed with another database that consisted of 800 chest and abdomen images by use of Mahalanobis distance based on vote and cross-correlation in statistics. The precision of detecting the radiopaque markers for 800 test images was 99.9%. In addition, this method worked out well for some specific images in which markers were overlapped with a human body.

Constraining Spatiotemporal Characteristics of Magma Migration at Piton De La Fournaise Volcano From Pre-eruptive Seismicity

Volcano-tectonic seismicity has been recorded for decades on various volcanoes and is linked with the magma transport and reservoir pressurization. Yet earthquakes often appear broadly distributed such that magma movement is difficult to infer from its analysis. We explore the seismicity that occurred before eruptions at Piton de la Fournaise in the last 5 years. Using template matching and relocation techniques, we produce a refined image of the summit seismicity, demonstrating that most earthquakes are located on a ring structure. However, only a portion of this structure is activated before each eruption, which provides an indication as to the direction of the future eruptive site. Furthermore, we show that the delay between the pre-eruptive swarm and the eruption onset is proportional to the distance of the eruptive fissures relative to the summit cone. This reveals that the beginning of the intrusion already bears information regarding the future eruption location.

A Vision-Based Approach to UAV Detection and Tracking in Cooperative Applications

This paper presents a visual-based approach that allows an Unmanned Aerial Vehicle (UAV) to detect and track a cooperative flying vehicle autonomously using a monocular camera. The algorithms are based on template matching and morphological filtering, thus being able to operate within a wide range of relative distances (i.e., from a few meters up to several tens of meters), while ensuring robustness against variations of illumination conditions, target scale and background. Furthermore, the image processing chain takes full advantage of navigation hints (i.e., relative positioning and own-ship attitude estimates) to improve the computational efficiency and optimize the trade-off between correct detections, false alarms and missed detections. Clearly, the required exchange of information is enabled by the cooperative nature of the formation through a reliable inter-vehicle data-link. Performance assessment is carried out by exploiting flight data collected during an ad hoc experimental campaign. The proposed approach is a key building block of cooperative architectures designed to improve UAV navigation performance either under nominal GNSS coverage or in GNSS-challenging environments.

Evaluation of Radiomics to Predict the Accuracy of Markerless Motion Tracking of Lung Tumors: A Preliminary Study

Template-based matching algorithms are currently being considered for markerless motion tracking of lung tumors. These algorithms use tumor templates derived from the planning CT scan, and track the motion of the tumor on single energy fluoroscopic images obtained at the time of treatment. In cases where bone may obstruct the view of the tumor, dual energy fluoroscopy may be used to enhance soft tissue contrast. The goal of this study is to predict which tumors will have a high degree of accuracy for markerless motion tracking based on radiomic features obtained from the planning CT scan, using peak-to-sidelobe ratio (PSR) as a surrogate of tracking accuracy. In this study, CT imaging data of 8 lung cancer patients were obtained and analyzed through the open source IBEX program to generate 2,287 radiomic features. Agglomerative hierarchical clustering was used to narrow down these features into 145 clusters comprised of the highest correlation to PSR. The features among the clusters with the least inter-correlation were then chosen to limit redundancy in the data. The results of this study demonstrated a number of radiomic features that are positively correlated to PSR. The features with the highest degree of correlation included complexity, orientation and range. This approach may be used to determine patients for whom markerless motion tracking would be beneficial.

A multi-emitter fitting algorithm for potential live cell super-resolution imaging over a wide range of molecular densities

Multi-emitter fitting algorithms have been developed to improve the temporal resolution of single-molecule switching nanoscopy, but the molecular density range they can analyse is narrow and the computation required is intensive, significantly limiting their practical application. Here, we propose a computationally fast method, wedged template matching (WTM), an algorithm that uses a template matching technique to localise molecules at any overlapping molecular density from sparse to ultrahigh density with subdiffraction resolution. WTM achieves the localization of overlapping molecules at densities up to 600 molecules μm^-2 with a high detection sensitivity and fast computational speed. WTM also shows localization precision comparable with that of DAOSTORM (an algorithm for high-density super-resolution microscopy), at densities up to 20 molecules μm^-2 , and better than DAOSTORM at higher molecular densities. The application of WTM to a high-density biological sample image demonstrated that it resolved protein dynamics from live cell images with subdiffraction resolution and a temporal resolution of several hundred milliseconds or less through a significant reduction in the number of camera images required for a high-density reconstruction. WTM algorithm is a computationally fast, multi-emitter fitting algorithm that can analyse over a wide range of molecular densities. The algorithm is available through the website. https://doi.org/10.17632/bf3z6xpn5j.1.

Human Identification by Cross-Correlation and Pattern Matching of Personalized Heartbeat: Influence of ECG Leads and Reference Database Size

Human identification (ID) is a biometric task, comparing single input sample to many stored templates to identify an individual in a reference database. This paper aims to present the perspectives of personalized heartbeat pattern for reliable ECG-based identification. The investigations are using a database with 460 pairs of 12-lead resting electrocardiograms (ECG) with 10-s durations recorded at time-instants T1 and T2 > T1 + 1 year. Intra-subject long-term ECG stability and inter-subject variability of personalized PQRST (500 ms) and QRS (100 ms) patterns is quantified via cross-correlation, amplitude ratio and pattern matching between T1 and T2 using 7 features × 12-leads. Single and multi-lead ID models are trained on the first 230 ECG pairs. Their validation on 10, 20, ... 230 reference subjects (RS) from the remaining 230 ECG pairs shows: (i) two best single-lead ID models using lead II for a small population RS = (10-140) with identification accuracy AccID = (89.4-67.2)% and aVF for a large population RS = (140-230) with AccID = (67.2-63.9)%; (ii) better performance of the 6-lead limb vs. the 6-lead chest ID model-(91.4-76.1)% vs. (90.9-70)% for RS = (10-230); (iii) best performance of the 12-lead ID model-(98.4-87.4)% for RS = (10-230). The tolerable reference database size, keeping AccID > 80%, is RS = 30 in the single-lead ID scenario (II); RS = 50 (6 chest leads); RS = 100 (6 limb leads), RS > 230-maximal population in this study (12-lead ECG).