A Learning-Based Framework for Error Compensation in 3D Printing

A Comprehensive Study on Self-Learning Methods and Implications to Autonomous Driving

As artificial intelligence (AI) has already seen numerous successful applications, the upcoming challenge lies in how to realize artificial general intelligence (AGI). Self-learning algorithms can autonomously acquire knowledge and adapt to new, demanding applications, recognized as one of the most effective techniques to overcome this challenge. Although many related studies have been conducted, there is still no comprehensive and systematic review available, nor well-founded recommendations for the application of autonomous intelligent systems, especially autonomous driving. As a result, this article comprehensively analyzes and classifies self-learning algorithms into three categories: broad self-learning, narrow self-learning, and limited self-learning. These categories are used to describe the popular usage, the most promising techniques, and the current status of hybridization with self-supervised learning. Then, the narrow self-learning is divided into three parts based on the self-learning realization path: sample self-learning, model self-learning, and self-learning architecture. For each method, this article discusses in detail its self-learning capacity, challenges, and applications to autonomous driving. Finally, the future research directions of self-learning algorithms are pointed out. It is expected that this study has the potential to eventually contribute to revolutionizing autonomous driving technology.

AI-driven 3D bioprinting for regenerative medicine: From bench to bedside

In recent decades, 3D bioprinting has garnered significant research attention due to its ability to manipulate biomaterials and cells to create complex structures precisely. However, due to technological and cost constraints, the clinical translation of 3D bioprinted products (BPPs) from bench to bedside has been hindered by challenges in terms of personalization of design and scaling up of production. Recently, the emerging applications of artificial intelligence (AI) technologies have significantly improved the performance of 3D bioprinting. However, the existing literature remains deficient in a methodological exploration of AI technologies' potential to overcome these challenges in advancing 3D bioprinting toward clinical application. This paper aims to present a systematic methodology for AI-driven 3D bioprinting, structured within the theoretical framework of Quality by Design (QbD). This paper commences by introducing the QbD theory into 3D bioprinting, followed by summarizing the technology roadmap of AI integration in 3D bioprinting, including multi-scale and multi-modal sensing, data-driven design, and in-line process control. This paper further describes specific AI applications in 3D bioprinting's key elements, including bioink formulation, model structure, printing process, and function regulation. Finally, the paper discusses current prospects and challenges associated with AI technologies to further advance the clinical translation of 3D bioprinting.

A Novel Local-Global Graph Convolutional Method for Point Cloud Semantic Segmentation

Although convolutional neural networks (CNNs) have shown good performance on grid data, they are limited in the semantic segmentation of irregular point clouds. This article proposes a novel and effective graph CNN framework, referred to as the local-global graph convolutional method (LGGCM), which can achieve short- and long-range dependencies on point clouds. The key to this framework is the design of local spatial attention convolution (LSA-Conv). The design includes two parts: generating a weighted adjacency matrix of the local graph composed of neighborhood points, and updating and aggregating the features of nodes to obtain the spatial geometric features of the local point cloud. In addition, a smooth module for central points is incorporated into the process of LSA-Conv to enhance the robustness of the convolution against noise interference by adjusting the position coordinates of the points adaptively. The learned robust LSA-Conv features are then fed into a global spatial attention module with the gated unit to extract long-range contextual information and dynamically adjust the weights of features from different stages. The proposed framework, consisting of both encoding and decoding branches, is an end-to-end trainable network for semantic segmentation of 3-D point clouds. The theoretical analysis of the approximation capabilities of LSA-Conv is discussed to determine whether the features of the point cloud can be accurately represented. Experimental results on challenging benchmarks of the 3-D point cloud demonstrate that the proposed framework achieves excellent performance.

3D printing in materials manufacturing industry: A realm of Industry 4.0

Additive manufacturing (AM), also known as 3D printing, is a new manufacturing trend showing promising progress over time in the era of Industry 4.0. So far, various research has been done for increasing the reliability and productivity of a 3D printing process. In this regard, reviewing the existing concepts and forwarding novel research directions are important. This paper reviews and summarizes the process flow, technologies, configurations, and monitoring of AM. It started with the general AM process flow, followed by the definitions and the working principles of various AM technologies and the possible AM configurations, such as traditional and robot-assisted AM. Then, defect detection, fault diagnosis, and open-loop and closed-loop control systems in AM are discussed. It is noted that introducing robots into the assisting mechanism of AM increases the reliability and productivity of the manufacturing process. Moreover, integrating machine learning and conventional control algorithms ensures a closed-loop control in AM, a promising control strategy. Lastly, the paper addresses the challenges and future trends.

A Survey of Image-Based Fault Monitoring in Additive Manufacturing: Recent Developments and Future Directions

Additive manufacturing (AM) has emerged as a transformative technology for various industries, enabling the production of complex and customized parts. However, ensuring the quality and reliability of AM parts remains a critical challenge. Thus, image-based fault monitoring has gained significant attention as an efficient approach for detecting and classifying faults in AM processes. This paper presents a comprehensive survey of image-based fault monitoring in AM, focusing on recent developments and future directions. Specifically, the proponents garnered relevant papers from 2019 to 2023, gathering a total of 53 papers. This paper discusses the essential techniques, methodologies, and algorithms employed in image-based fault monitoring. Furthermore, recent developments are explored such as the use of novel image acquisition techniques, algorithms, and methods. In this paper, insights into future directions are provided, such as the need for more robust image processing algorithms, efficient data acquisition and analysis methods, standardized benchmarks and datasets, and more research in fault monitoring. By addressing these challenges and pursuing future directions, image-based fault monitoring in AM can be enhanced, improving quality control, process optimization, and overall manufacturing reliability.

Structured Data Storage for Data-Driven Process Optimisation in Bioprinting

Bioprinting is a method to fabricate 3D models that mimic tissue. Future fields of application might be in pharmaceutical or medical context. As the number of applicants might vary between only one patient to manufacturing tissue for high-throughput drug screening, designing a process will necessitate a high degree of flexibility, robustness, as well as comprehensive monitoring. To enable quality by design process optimisation for future application, establishing systematic data storage routines suitable for automated analytical tools is highly desirable as a first step. This manuscript introduces a workflow for process design, documentation within an electronic lab notebook and monitoring to supervise the product quality over time or at different locations. Lab notes, analytical data and corresponding metadata are stored in a systematic hierarchy within the research data infrastructure Kadi4Mat, which allows for continuous, flexible data structuring and access management. To support the experimental and analytical workflow, additional features were implemented to enhance and build upon the functionality provided by Kadi4Mat, including browser-based file previews and a Python tool for the combined filtering and extraction of data. The structured research data management with Kadi4Mat enables retrospective data grouping and usage by process analytical technology tools connecting individual analysis software to machine-readable data exchange formats.

Multi-input convolutional network for ultrafast simulation of field evolvement

There is a compelling need for the regression capability of mapping the initial field and applied conditions to the evolved field, e.g., given current flow field and fluid properties predicting next-step flow field. Such a capability can provide a maximum to full substitute of a physics-based model, enabling fast simulation of various field evolvements. We propose a conceptually simple, lightweight, but powerful multi-input convolutional network (ConvNet), yNet, that merges multi-input signals by manipulating high-level encodings of field/image input. yNet can significantly reduce the model size compared with its ConvNet counterpart (e.g., to only one-tenth for main architecture of 38-layer depth) and is as much as six orders of magnitude faster than a physics-based model. yNet is applied for data-driven modeling of fluid dynamics, porosity evolution in sintering, stress field development, and grain growth. It consistently shows great extrapolative prediction beyond training datasets in terms of temporal ranges, spatial domains, and geometrical shapes.

•

A multi-input convolutional network is proposed to model evolution of physical fields

•

The lightweight model shows general effectiveness in four diverse applications

•

It also displays good extrapolative prediction beyond training datasets

•

Full-component selective laser sintering and large grain growth modeling are given

In physical sciences and engineering, the convolutional network (ConvNet) has been used increasingly to simulate the evolvement of physical fields, e.g., flow field evolvement. Physical field data are fed as images, and ConvNet treats the field evolvement as a field-to-field/image-to-image regression problem, i.e., building the mapping from the input flow field to the evolved flow field. The ConvNet, when trained, can be a cheap substitute for physics-based models, enabling fast simulation of field evolvement. However, a big challenge still lies in incorporating conditions that dictate field evolvement, e.g., fluid properties associated with fluid dynamics. We propose a light multi-input ConvNet as a general-purpose, multi-input, image-to-image regression tool. Its simplicity and usefulness are demonstrated by modeling various condition-dependent field evolvements and developments. Large- and extreme-scale simulations are also performed based on its computational superiority.

Traditional Artificial Neural Networks Versus Deep Learning in Optimization of Material Aspects of 3D Printing

3D printing of assistive devices requires optimization of material selection, raw materials formulas, and complex printing processes that have to balance a high number of variable but highly correlated variables. The performance of patient-specific 3D printed solutions is still limited by both the increasing number of available materials with different properties (including multi-material printing) and the large number of process features that need to be optimized. The main purpose of this study is to compare the optimization of 3D printing properties toward the maximum tensile force of an exoskeleton sample based on two different approaches: traditional artificial neural networks (ANNs) and a deep learning (DL) approach based on convolutional neural networks (CNNs). Compared with the results from the traditional ANN approach, optimization based on DL decreased the speed of the calculations by up to 1.5 times with the same print quality, improved the quality, decreased the MSE, and a set of printing parameters not previously determined by trial and error was also identified. The above-mentioned results show that DL is an effective tool with significant potential for wide application in the planning and optimization of material properties in the 3D printing process. Further research is needed to apply low-cost but more computationally efficient solutions to multi-tasking and multi-material additive manufacturing.

Deep Learning Plus Three-Dimensional Printing in the Management of Giant (>15 cm) Sporadic Renal Angiomyolipoma: An Initial Report

Objective

To evaluate the feasibility and effectivity of deep learning (DL) plus three-dimensional (3D) printing in the management of giant sporadic renal angiomyolipoma (RAML).

Methods

The medical records of patients with giant (>15 cm) RAML were retrospectively reviewed from January 2011 to December 2020. 3D visualized and printed kidney models were performed by DL algorithms and 3D printing technology, respectively. Patient demographics and intra- and postoperative outcomes were compared between those with 3D-assisted surgery (3D group) or routine ones (control group).

Results

Among 372 sporadic RAML patients, 31 with giant ones were eligible for analysis. The median age was 40.6 (18-70) years old, and the median tumor size was 18.2 (15-28) cm. Seventeen of 31 (54.8%) had a surgical kidney removal. Overall, 11 underwent 3D-assisted surgeries and 20 underwent routine ones. A significant higher success rate of partial nephrectomy (PN) was noted in the 3D group (72.7% vs. 30.0%). Patients in the 3D group presented a lower reduction in renal function but experienced a longer operation time, a greater estimated blood loss, and a higher postoperative morbidity. Subgroup analysis was conducted between patients undergoing PN with or without 3D assistance. Despite no significant difference, patients with 3D-assisted PN had a slightly larger tumor size and higher nephrectomy score, possibly contributing to a relatively higher rate of complications. However, 3D-assisted PN lead to a shorter warm ischemia time and a lower renal function loss without significant difference. Another subgroup analysis between patients under 3D-assisted PN or 3D-assisted RN showed no statistically significant difference. However, the nearness of tumor to the second branch of renal artery was relatively shorter in 3D-assisted PN subgroup than that in 3D-assisted RN subgroup, and the difference between them was close to significant.

Conclusions

3D visualized and printed kidney models appear to be additional tools to assist operational management and avoid a high rate of kidney removal for giant sporadic RAMLs.

3D Foot Reconstruction Based on Mobile Phone Photographing

Foot measurement is necessary for personalized customization. Nowadays, people usually obtain their foot size by using a ruler or foot scanner. However, there are some disadvantages to this, namely, large measurement error and variance when using rulers, and high price and poor convenience when using a foot scanner. To tackle these problems, we obtain foot parameters by 3D foot reconstruction based on mobile phone photography. Firstly, foot images are taken by a mobile phone. Secondly, the SFM (Structure-from-Motion) algorithm is used to acquire the corresponding parameters and then to calculate the camera position to construct the sparse model. Thirdly, the PMVS (Patch-based Multi View System) is adopted to build a dense model. Finally, the Meshlab is used to process and measure the foot model. The result shows that the experimental error of the 3D foot reconstruction method is around 1 mm, which is tolerable for applications such as shoe tree customization. The experiment proves that the method can construct the 3D foot model efficiently and easily. This technology has broad application prospects in the fields of shoe size recommendation, high-end customized shoes and medical correction.

Towards Machine Learning for Error Compensation in Additive Manufacturing

Additive Manufacturing (AM) of three-dimensional objects is now being progressively realised with its ad-hoc approach with minimal material wastage (lean manufacturing) being one of its benefit by default. It could also be considered as an evolutional paradigm in the manufacturing industry with its long list of application as of late. Artificial Intelligence is currently finding its usefulness in predictive modelling to provide intelligent, efficient, customisable, high-quality and sustainable-oriented production process. This paper presents a comprehensive survey on commonly used predictive models based on heuristic algorithms and discusses their applications toward making AM “smart”. This paper summarises AM’s current trend, future opportunity, gaps, and requirements together with recommendations for technology and research for inter-industry collaboration, educational training and technology transfer in the AI perspective in-line with the Industry 4.0 developmental process. Moreover, machine learning algorithms are presented for detecting product defects in the cyber-physical system of additive manufacturing. Based on reviews on various applications, printability with multi-indicators, reduction of design complexity threshold, acceleration of prefabrication, real-time control, enhancement of security and defect detection for customised designs are seen of as prospective opportunities for further research.