1
|
Abstract
In real-life scenarios, Human Activity Recognition (HAR) from video data is prone to occlusion of one or more body parts of the human subjects involved. Although it is common sense that the recognition of the majority of activities strongly depends on the motion of some body parts, which when occluded compromise the performance of recognition approaches, this problem is often underestimated in contemporary research works. Currently, training and evaluation is based on datasets that have been shot under laboratory (ideal) conditions, i.e. without any kind of occlusion. In this work, we propose an approach for HAR in the presence of partial occlusion, in cases wherein up to two body parts are involved. We assume that human motion is modeled using a set of 3D skeletal joints and also that occluded body parts remain occluded during the whole duration of the activity. We solve this problem using regression, performed by a novel deep Convolutional Recurrent Neural Network (CRNN). Specifically, given a partially occluded skeleton, we attempt to reconstruct the missing information regarding the motion of its occluded part(s). We evaluate our approach using four publicly available human motion datasets. Our experimental results indicate a significant increase of performance, when compared to baseline approaches, wherein networks that have been trained using only nonoccluded or both occluded and nonoccluded samples are evaluated using occluded samples. To the best of our knowledge, this is the first research work that formulates and copes with the problem of HAR under occlusion as a regression task.
Collapse
Affiliation(s)
- Ioannis Vernikos
- Department of Informatics and Telecommunications, University of Thessaly, 3rd Km Old National Road Lamia-Athens, Lamia 35132, Greece
| | - Evaggelos Spyrou
- Department of Informatics and Telecommunications, University of Thessaly, 3rd Km Old National Road Lamia-Athens, Lamia 35132, Greece
| | - Ioannis-Aris Kostis
- Department of Informatics and Telecommunications, University of Thessaly, 3rd Km Old National Road Lamia-Athens, Lamia 35132, Greece
| | - Eirini Mathe
- Department of Informatics, Ionian University, 7 Tsirigoti Square, Corfu 49100, Greece
| | - Phivos Mylonas
- Department of Informatics and Computer Engineering, University of West Attica, Egaleo Park, Agiou Spyridonos Street, 12243 Egaleo, Athens, Greece
| |
Collapse
|
2
|
Vernikos I, Spyropoulos T, Spyrou E, Mylonas P. Human Activity Recognition in the Presence of Occlusion. Sensors 2023; 23:4899. [PMID: 37430811 DOI: 10.3390/s23104899] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/20/2023] [Revised: 04/28/2023] [Accepted: 05/16/2023] [Indexed: 07/12/2023]
Abstract
The presence of occlusion in human activity recognition (HAR) tasks hinders the performance of recognition algorithms, as it is responsible for the loss of crucial motion data. Although it is intuitive that it may occur in almost any real-life environment, it is often underestimated in most research works, which tend to rely on datasets that have been collected under ideal conditions, i.e., without any occlusion. In this work, we present an approach that aimed to deal with occlusion in an HAR task. We relied on previous work on HAR and artificially created occluded data samples, assuming that occlusion may prevent the recognition of one or two body parts. The HAR approach we used is based on a Convolutional Neural Network (CNN) that has been trained using 2D representations of 3D skeletal motion. We considered cases in which the network was trained with and without occluded samples and evaluated our approach in single-view, cross-view, and cross-subject cases and using two large scale human motion datasets. Our experimental results indicate that the proposed training strategy is able to provide a significant boost of performance in the presence of occlusion.
Collapse
Affiliation(s)
- Ioannis Vernikos
- Department of Informatics and Telecommunications, University of Thessaly, 35131 Lamia, Greece
| | | | - Evaggelos Spyrou
- Department of Informatics and Telecommunications, University of Thessaly, 35131 Lamia, Greece
| | - Phivos Mylonas
- Department of Informatics and Computer Engineering, University of West Attica, Egaleo Park, 12243 Athens, Greece
| |
Collapse
|
3
|
Koutrintzes D, Spyrou E, Mathe E, Mylonas P. A Multimodal Fusion Approach for Human Activity Recognition. Int J Neural Syst 2023; 33:2350002. [PMID: 36573880 DOI: 10.1142/s0129065723500028] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/29/2022]
Abstract
The problem of human activity recognition (HAR) has been increasingly attracting the efforts of the research community, having several applications. It consists of recognizing human motion and/or behavior within a given image or a video sequence, using as input raw sensor measurements. In this paper, a multimodal approach addressing the task of video-based HAR is proposed. It is based on 3D visual data that are collected using an RGB + depth camera, resulting to both raw video and 3D skeletal sequences. These data are transformed into six different 2D image representations; four of them are in the spectral domain, another is a pseudo-colored image. The aforementioned representations are based on skeletal data. The last representation is a "dynamic" image which is actually an artificially created image that summarizes RGB data of the whole video sequence, in a visually comprehensible way. In order to classify a given activity video, first, all the aforementioned 2D images are extracted and then six trained convolutional neural networks are used so as to extract visual features. The latter are fused so as to form a single feature vector and are fed into a support vector machine for classification into human activities. For evaluation purposes, a challenging motion activity recognition dataset is used, while single-view, cross-view and cross-subject experiments are performed. Moreover, the proposed approach is compared to three other state-of-the-art methods, demonstrating superior performance in most experiments.
Collapse
Affiliation(s)
- Dimitrios Koutrintzes
- Institute of Informatics and Telecommunications, National Center for Scientific Research - "Demokritos", Athens, Greece
| | - Evaggelos Spyrou
- Department of Informatics and Telecommunication, University of Thessaly, Lamia, Greece
| | - Eirini Mathe
- Department of Informatics, Ionian University, Corfu, Greece
| | - Phivos Mylonas
- Department of Informatics, Ionian University, Corfu, Greece
| |
Collapse
|
4
|
Didachos C, Kintos DP, Fousteris M, Mylonas P, Kanavos A. An Optimized Cloud Computing Method for Extracting Molecular Descriptors. Adv Exp Med Biol 2023; 1424:247-254. [PMID: 37486501 DOI: 10.1007/978-3-031-31982-2_28] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/25/2023]
Abstract
Extracting molecular descriptors from chemical compounds is an essential preprocessing phase for developing accurate classification models. Supervised machine learning algorithms offer the capability to detect "hidden" patterns that may exist in a large dataset of compounds, which are represented by their molecular descriptors. Assuming that molecules with similar structure tend to share similar physicochemical properties, large chemical libraries can be screened by applying similarity sourcing techniques in order to detect potential bioactive compounds against a molecular target. However, the process of generating these compound features is time-consuming. Our proposed methodology not only employs cloud computing to accelerate the process of extracting molecular descriptors but also introduces an optimized approach to utilize the computational resources in the most efficient way.
Collapse
Affiliation(s)
- Christos Didachos
- Computer Engineering and Informatics Department, University of Patras, Patras, Greece
| | | | | | - Phivos Mylonas
- Department of Informatics, Ionian University, Corfu, Greece
| | - Andreas Kanavos
- Department of Informatics, Ionian University, Corfu, Greece.
| |
Collapse
|
5
|
Drakopoulos G, Kafeza E, Mylonas P, Al Katheeri H. Higher Order Trust Ranking of LinkedIn Accounts with Iterative Matrix Methods. INT J ARTIF INTELL T 2022. [DOI: 10.1142/s0218213022600016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
Trust is a fundamental sociotechnological mainstay of the Web today. There is substantial evidence about this since netizens implicitly or explicitly agree to trust virtually every Web service they use ranging from Web-based mail to e-commerce portals. Moreover the methodological framework for trusting individual netizens, primarily their identity and communications, has considerably progressed. Nevertheless, the core of fact checking for human generated content is still far from being substantially automated as most proposed smart algorithms capture inadequately fundamental human traits. One such case is the evaluation of the profile trustworthiness of LinkedIn members based on publicly available attributes available from the platform itself. A trusted profile may indirectly indicate a more suitable candidate since its contents can be easily verified. In this article a first order graph search mechanism for discovering LinkedIn trusted profiles based on a random walker is extended to higher order ranking based on a combination of functional and connectivity patterns. Results are derived for the same benchmark dataset and the first- and higher-order approaches are compared in terms of accuracy.
Collapse
Affiliation(s)
- Georgios Drakopoulos
- Department of Informatics, Ionian University, Plateia Tsirigoti 7, Kerkyra 49100, Hellas, Greece
| | - Eleanna Kafeza
- College of Innovation and Technology, Zayed University, Dubai Academic City, E-L1-008, UAE
| | - Phivos Mylonas
- Department of Informatics, Ionian University, Plateia Tsirigoti 7, Kerkyra 49100, Hellas, Greece
| | - Haseena Al Katheeri
- College of Innovation and Technology, Zayed University, Abu Dhabi – Khalifa City, FF2-0-033, UAE
| |
Collapse
|
6
|
Mok Z, Mylonas P, Austin R, Proctor G, Pitts N, Thanou M. Calcium Phosphate Nanoparticles Tested on Hydroxyapatite Discs as Remineralising Agent. Dent Mater 2022. [DOI: 10.1016/j.dental.2021.12.078] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
7
|
Mylonas P, Moazzez R, Joiner A, Bartlett D. Superimposition of sequential scans to measure erosion on unpolished and curved human enamel. J Dent 2021; 117:103879. [PMID: 34762989 DOI: 10.1016/j.jdent.2021.103879] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2021] [Revised: 10/18/2021] [Accepted: 10/29/2021] [Indexed: 11/19/2022] Open
Abstract
OBJECTIVES To determine if superimposition of sequential scans can discriminate between different fluorides at step heights less than 5 μm on natural human enamel surfaces. MATERIALS AND METHODS Natural, unpolished, human enamel specimens (n = 60) were randomly assigned to one of three pre-treatment toothpaste slurries with a calcium silicate/fluoride, fluoride-only and a control. Baseline and post treatment scans, from a non-contacting profilometer with a 0.01 μm z-axis and <1 μm lateral scanning resolution were imported into superimposition software to define change in mean 3D step height and surface roughness following erosion in 0.3 % citric acid for 15 min. Statistical analysis conducted with two-way repeated measures ANOVA and post-hoc Tukey's multiple comparisons. RESULTS Confidence and resolution of superimposition and subtraction of repeated profiles from unpolished enamel revealed accuracy within 1-2 μm. The technique was able to discriminate between the fluorides demonstrating statistical differences in mean (SD) 3D step height (μm) of 1.96 (0.40) and 2.75 (0.49) (p=0.0024). There was a statistically significant increase in surface roughness for all groups after 15 min erosion compared to baseline. But no statistically significant difference between the interventions after 15 min erosion but there was compared to no fluoride (p=0.006). CONCLUSION Superimposition and subtraction of profiles could discriminate between fluoride interventions, which showed statistical differences in enamel loss differences less than 3 μm. CLINICAL SIGNIFICANCE This erosion model and data analysis workflow was able to distinguish differences between scans of 3 μm on unpolished enamel following the interaction with fluoride.
Collapse
Affiliation(s)
- P Mylonas
- School of Dentistry, College of Biomedical and Life Sciences, Cardiff University, Heath Park, Cardiff CF14 4XY, United Kingdom; Centre for Oral, Clinical &Translational Sciences, King's College London Faculty of Dentistry, Oral & Craniofacial Sciences, London, United Kingdom.
| | - R Moazzez
- Centre for Oral, Clinical &Translational Sciences, King's College London Faculty of Dentistry, Oral & Craniofacial Sciences, London, United Kingdom
| | - A Joiner
- Unilever Oral Care, Bebington, Wirral, United Kingdom
| | - D Bartlett
- Centre for Oral, Clinical &Translational Sciences, King's College London Faculty of Dentistry, Oral & Craniofacial Sciences, London, United Kingdom
| |
Collapse
|
8
|
Drakopoulos G, Kanavos A, Mylonas P, Sioutas S. Discovering sentiment potential in Twitter conversations with Hilbert–Huang spectrum. Evolving Systems 2021. [DOI: 10.1007/s12530-020-09348-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
9
|
Kounelis F, Kanavos A, Mylonas P. Improving the Run-Time of Space-Efficient n-Gram Data Structures Using Apache Spark. GeNeDis 2020 2021; 1338:165-173. [DOI: 10.1007/978-3-030-78775-2_19] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
10
|
Pikramenos G, Mathe E, Vali E, Vernikos I, Papadakis A, Spyrou E, Mylonas P. An adversarial semi-supervised approach for action recognition from pose information. Neural Comput Appl 2020. [DOI: 10.1007/s00521-020-05162-5] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
11
|
Drakopoulos G, Mylonas P, Sioutas S. An Architecture for Cooperative Mobile Health Applications. Advances in Experimental Medicine and Biology 2020; 1194:23-29. [DOI: 10.1007/978-3-030-32622-7_2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
12
|
Drakopoulos G, Stathopoulou F, Kanavos A, Paraskevas M, Tzimas G, Mylonas P, Iliadis L. A genetic algorithm for spatiosocial tensor clustering. Evolving Systems 2019. [DOI: 10.1007/s12530-019-09274-9] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
|
13
|
Mullan F, Mylonas P, Parkinson C, Bartlett D, Austin R. Precision of 655 nm Confocal Laser Profilometry for 3D surface texture characterisation of natural human enamel undergoing dietary acid mediated erosive wear. Dent Mater 2018; 34:531-537. [DOI: 10.1016/j.dental.2017.12.012] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2017] [Revised: 12/18/2017] [Accepted: 12/21/2017] [Indexed: 10/18/2022]
|
14
|
Drakopoulos G, Kanavos A, Mylonas P, Sioutas S. Defining and evaluating Twitter influence metrics: a higher-order approach in Neo4j. Soc Netw Anal Min 2017. [DOI: 10.1007/s13278-017-0467-9] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
|
15
|
Abstract
Aims To evaluate the quality of clinical record keeping and determine quality of denture cleanliness; record baseline denture cleanliness for 60 patients; introduce denture hygiene instruction (DHI); and then re-assess the patients for improvement and enhanced record keeping.Methods Analysis of patients' denture hygiene instruction record keeping (n = 60) was undertaken retrospectively. The Denture Cleanliness Index (DCI) was utilised to assess denture cleanliness (best score 0, worst score 4). Baseline DCI scores were taken and individual DHI was delivered. After one month, patients were reviewed and scored, with record keeping quality analysed.Results At baseline, 11.7% (n = 7) of patients had DCI scores of ≤2, improving to 93.8% (n = 45) after one month, demonstrating short-term improvement in denture cleanliness. Only 63% (n = 38) of patients had evidence of a record of DHI within their notes at baseline, improving to 100% at recall.Conclusions New patient information leaflet and clinical guidelines on denture hygiene have been written and implemented. The results of this study suggest that this may be a relatively straightforward method to achieve a short-term improvement in denture cleanliness. The implementation of a DCI score is helpful in allowing patients to improve denture hygiene and its wider use is supported.
Collapse
Affiliation(s)
- P Mylonas
- Dental Core Trainee in Restorative Dentistry. Birmingham Dental Hospital, St Chad's Queensway, Birmingham, B4 6NN
| | - D C Attrill
- Senior Lecturer and Honorary Consultant in Restorative Dentistry, School of Dentistry, College of Medical and Dental Sciences, University of Birmingham, St Chad's Queensway, Birmingham, B4 6NN
| | - A D Walmsley
- Professor and Honorary Consultant in Restorative Dentistry, School of Dentistry, College of Medical and Dental Sciences, University of Birmingham, St Chad's Queensway, Birmingham, B4 6NN
| |
Collapse
|
16
|
|
17
|
Mylonas P, Afzal Z, Attrill DC. A clinical audit of denture cleanliness in general dental practice undertaken in the West Midlands. Br Dent J 2014; 217:231-4. [DOI: 10.1038/sj.bdj.2014.757] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/20/2014] [Indexed: 02/07/2023]
|
18
|
Alexopoulos P, Pavlopoulos J, Mylonas P. A Semantic Framework for Harvesting Vague Enterprise Knowledge from Microposts. INT J ARTIF INTELL T 2014. [DOI: 10.1142/s0218213014400089] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
The advent and wide proliferation of Social Web in the recent years has promoted the concept of social interaction as an important influencing factor of the way enterprises and organizations conduct business. Among the fields influenced is that of Enterprise Knowledge Management, where the increase and maintenance of the employees' active participation in the organization's knowledge management activities is pursued through the adoption of social computing approaches. In this paper we consider a prominent and increasingly applied such approach, namely enterprise microblogging, and we propose a novel way to exploit its knowledge generation and sharing capabilities in order to effectively capture and formalize enterprise knowledge that is vague. Application and empirical evaluation of the framework indicates significant potential towards this goal.
Collapse
Affiliation(s)
- Panos Alexopoulos
- Intelligent Software Components S.A., Av. del Partenon, 16–18, 1–7, 28042, Madrid, Spain
| | - John Pavlopoulos
- Department of Informatics, Athens University of Economics and Business, 76 Patission Str., 10434, Athens, Greece
| | - Phivos Mylonas
- National Technical University of Athens, Image, Video and Multimedia Laboratory, 9 Iroon Polytechniou Str., 15773, Athens, Greece
| |
Collapse
|
19
|
Alexandrides T, Spiliotis J, Mylonas P, Melachrinou M, Kardamakis D, Spiliopoulou I, Panagopoulos C, Kalfarentzos F. Effects of growth hormone and insulin-like growth factor-I on radiation enteritis. a comparative study. Eur Surg Res 2000; 30:305-11. [PMID: 9731098 DOI: 10.1159/000008592] [Citation(s) in RCA: 14] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
Abstract
The effect of growth hormone (GH) and insulin-like growth factor-I (IGF-I) on intestinal mucosal integrity and bacterial translocation after abdominal radiation was studied in rats. Animals were divided into the following groups: I (control), II (radiation), III (radiation plus GH) and IV (radiation plus IGF-I). Radiation (1,100 cGy) was administered on the 1st day to groups II, III and IV. GH [0.25 mg/kg body weight (BW) s.c. once daily] was administered on days 1, 2 and 3 to group III, and IGF-I (0.1 mg/kg BW s.c. twice daily) was given on days 1, 2 and 3 to group IV. On day 4, animals were sacrificed. Cultures of the mesenteric lymph nodes (MLN) and blood cultures from aorta and portal vein were performed. The number of villi per centimeter (V/cm), the villus height (Vh), mitoses per crypt (M/C) and protein and DNA contents of the mucosa were evaluated in samples from the terminal ileum. Radiation increased the number of positive MLN cultures, while treatment with GH and IGF-I reduced them significantly. V/cm, Vh, M/C, protein and DNA contents were significantly increased in all irradiated animals treated with GH and IGF-I. In conclusion both GH and IGF-I are not only capable of improving the mucosal integrity but also to reduce the bacterial translocation that follows intestinal radiation. In small doses IGF-I could reproduce the effects of GH and in some parameters the effects were more pronounced, although not statistically significant. This suggests that the effects of GH on intestine could be mediated through the local and systemic generation of IGF-I.
Collapse
Affiliation(s)
- T Alexandrides
- Department of Internal Medicine, University of Patras, Greece
| | | | | | | | | | | | | | | |
Collapse
|
20
|
Mylonas P. You get what you pay for. Aust Vet J 1996; 74:164. [PMID: 8894030] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/02/2023]
|