1
|
Habibunnisha N, Nedumaran D. FPGA-Based Point Processing for denoising of the show-through effect in Scanned Document Images. JOURNAL OF KING SAUD UNIVERSITY - COMPUTER AND INFORMATION SCIENCES 2022. [DOI: 10.1016/j.jksuci.2022.12.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
|
2
|
Tonazzini A, Salerno E, Abdel-Salam ZA, Harith MA, Marras L, Botto A, Campanella B, Legnaioli S, Pagnotta S, Poggialini F, Palleschi V. Analytical and mathematical methods for revealing hidden details in ancient manuscripts and paintings: A review. J Adv Res 2019; 17:31-42. [PMID: 31193359 PMCID: PMC6526198 DOI: 10.1016/j.jare.2019.01.003] [Citation(s) in RCA: 35] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2018] [Revised: 01/07/2019] [Accepted: 01/08/2019] [Indexed: 11/24/2022] Open
Abstract
In this work, a critical review of the current nondestructive probing and image analysis approaches is presented, to revealing otherwise invisible or hardly discernible details in manuscripts and paintings relevant to cultural heritage and archaeology. Multispectral imaging, X-ray fluorescence, Laser-Induced Breakdown Spectroscopy, Raman spectroscopy and Thermography are considered, as techniques for acquiring images and spectral image sets; statistical methods for the analysis of these images are then discussed, including blind separation and false colour techniques. Several case studies are presented, with particular attention dedicated to the approaches that appear most promising for future applications. Some of the techniques described herein are likely to replace, in the near future, classical digital photography in the study of ancient manuscripts and paintings.
Collapse
Affiliation(s)
- Anna Tonazzini
- National Research Council of Italy, Institute of Information Science and Technologies “Alessandro Faedo”, Via G. Moruzzi, 1, Pisa, Italy
| | - Emanuele Salerno
- National Research Council of Italy, Institute of Information Science and Technologies “Alessandro Faedo”, Via G. Moruzzi, 1, Pisa, Italy
| | | | | | - Luciano Marras
- Art Test Studio di Luciano Marras, via del Martello 14, 56121 Pisa, Italy
| | - Asia Botto
- National Research Council of Italy, Applied and Laser Spectroscopy Laboratory, Institute of Chemistry of Organometallic Compounds, Via G. Moruzzi, 1, Pisa, Italy
| | - Beatrice Campanella
- National Research Council of Italy, Applied and Laser Spectroscopy Laboratory, Institute of Chemistry of Organometallic Compounds, Via G. Moruzzi, 1, Pisa, Italy
| | - Stefano Legnaioli
- National Research Council of Italy, Applied and Laser Spectroscopy Laboratory, Institute of Chemistry of Organometallic Compounds, Via G. Moruzzi, 1, Pisa, Italy
| | - Stefano Pagnotta
- National Research Council of Italy, Applied and Laser Spectroscopy Laboratory, Institute of Chemistry of Organometallic Compounds, Via G. Moruzzi, 1, Pisa, Italy
| | - Francesco Poggialini
- National Research Council of Italy, Applied and Laser Spectroscopy Laboratory, Institute of Chemistry of Organometallic Compounds, Via G. Moruzzi, 1, Pisa, Italy
| | - Vincenzo Palleschi
- National Research Council of Italy, Applied and Laser Spectroscopy Laboratory, Institute of Chemistry of Organometallic Compounds, Via G. Moruzzi, 1, Pisa, Italy
| |
Collapse
|
3
|
|
4
|
Chen Y. Scanning double-sided documents without incurring show-through by learning to fuse two complementary images using multilayer perceptron. PLoS One 2017; 12:e0176969. [PMID: 28489900 PMCID: PMC5425205 DOI: 10.1371/journal.pone.0176969] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2016] [Accepted: 04/20/2017] [Indexed: 11/30/2022] Open
Abstract
This paper presents a novel method for scanning duplex-printed documents without incurring the unwanted show-through artifact. The proposed method achieves the goal of eliminating the leaked-out reverse-side content by fusing a white backed scan image with a black backed scan image of the document. The fusion is accomplished using a multilayer perceptron having learned a fusion mapping from manually corrected document images. The main novel contributions of this work include (1) being the first to propose to accomplish the goal of show through free scanning by fusing a white backed scan image with a black backed scan image of the document; (2) proposing a learning approach using a multilayer perceptron to learn the fusion mapping from manually corrected scan images; and (3) proposing to use the pixel value histogram of reverse-side-printed area as well as the pixel value histogram of duplex-printed area to quantitatively indicate show through severity to facilitate objective comparison of the methods in consideration. The experiment results show that the proposed method is remarkably more powerful in eliminating show through than the two state-of-the-art methods in comparison.
Collapse
Affiliation(s)
- Yuzhong Chen
- School of Material Science and Engineering, Shandong University, Jinan, China
| |
Collapse
|
5
|
Salerno E, Martinelli F, Tonazzini A. Nonlinear model identification and see-through cancelation from recto–verso data. INT J DOC ANAL RECOG 2012. [DOI: 10.1007/s10032-012-0183-y] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
6
|
Linear-quadratic blind source separating structure for removing show-through in scanned documents. INT J DOC ANAL RECOG 2010. [DOI: 10.1007/s10032-010-0131-7] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
|
7
|
Huang Y, Brown MS, Xu D. User-assisted ink-bleed reduction. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2010; 19:2646-2658. [PMID: 20421185 DOI: 10.1109/tip.2010.2048971] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/29/2023]
Abstract
This paper presents a novel user-assisted approach to reduce ink-bleed interference found in old manuscripts. The problem is addressed by first having the user provide simple examples of foreground ink, ink-bleed, and the manuscript's background. From this small amount of user-labeled data, likelihoods of each pixel being foreground, ink-bleed, or background are computed and used as the data costs of a dual-layer Markov random field (MRF) that simultaneously labels all pixels in both the front and back sides of the manuscript. This user-assisted approach produces better results than existing algorithms without the need for extensive parameter tuning or prior assumptions about the ink-bleed intensity characteristics. Our overall application framework is discussed along with details of the features used in the data costs, a comparison between K-nearest neighbor and support vector machine for likelihood estimation, the dual-layer MRF formulation with associated inter- and intra-layer costs, and a comparison of our approach against other ink-bleed reduction algorithms.
Collapse
Affiliation(s)
- Yi Huang
- School of Computer Engineering, Nanyang Technological University, Singapore.
| | | | | |
Collapse
|
8
|
Tonazzini A. Color space transformations for analysis and enhancement of ancient degraded manuscripts. PATTERN RECOGNITION AND IMAGE ANALYSIS 2010. [DOI: 10.1134/s105466181003017x] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|
9
|
Moghaddam RF, Cheriet M. A variational approach to degraded document enhancement. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 2010; 32:1347-1361. [PMID: 20558870 DOI: 10.1109/tpami.2009.141] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/29/2023]
Abstract
The goal of this paper is to correct bleed-through in degraded documents using a variational approach. The variational model is adapted using an estimated background according to the availability of the verso side of the document image. Furthermore, for the latter case, a more advanced model based on a global control, the flow field, is introduced. The solution of each resulting model is obtained using wavelet shrinkage or a time-stepping scheme, depending on the complexity and nonlinearity of the models. When both sides of the document are available, the proposed model uses the reverse diffusion process for the enhancement of double-sided document images. The results of experiments with real and synthesized samples are promising. The proposed model, which is robust with respect to noise and complex background, can also be applied to other fields of image processing.
Collapse
Affiliation(s)
- Reza Farrahi Moghaddam
- Synchromedia Laboratory for Multimedia Communication in Telepresence, Ecole de Technologie Supérieure, Montréal, QC, Canada.
| | | |
Collapse
|
10
|
Tonazzini A, Gerace I, Martinelli F. Multichannel blind separation and deconvolution of images for document analysis. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2010; 19:912-925. [PMID: 20028627 DOI: 10.1109/tip.2009.2038814] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/28/2023]
Abstract
In this paper, we apply Bayesian blind source separation (BSS) from noisy convolutive mixtures to jointly separate and restore source images degraded through unknown blur operators, and then linearly mixed. We found that this problem arises in several image processing applications, among which there are some interesting instances of degraded document analysis. In particular, the convolutive mixture model is proposed for describing multiple views of documents affected by the overlapping of two or more text patterns. We consider two different models, the interchannel model, where the data represent multispectral views of a single-sided document, and the intrachannel model, where the data are given by two sets of multispectral views of the recto and verso side of a document page. In both cases, the aim of the analysis is to recover clean maps of the main foreground text, but also the enhancement and extraction of other document features, such as faint or masked patterns. We adopt Bayesian estimation for all the unknowns and describe the typical local correlation within the individual source images through the use of suitable Gibbs priors, accounting also for well-behaved edges in the images. This a priori information is particularly suitable for the kind of objects depicted in the images treated, i.e., homogeneous texts in homogeneous background, and, as such, is capable to stabilize the ill-posed, inverse problem considered. The method is validated through numerical and real experiments that are representative of various real scenarios.
Collapse
Affiliation(s)
- Anna Tonazzini
- Istituto di Scienza e Tecnologie dell'Informazione, Consiglio Nazionale delle Ricerche, Pisa, Italy.
| | | | | |
Collapse
|
11
|
Wolf C. Document ink bleed-through removal with two hidden Markov random fields and a single observation field. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 2010; 32:431-447. [PMID: 20075470 DOI: 10.1109/tpami.2009.33] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/28/2023]
Abstract
We present a new method for blind document bleed-through removal based on separate Markov Random Field (MRF) regularization for the recto and for the verso side, where separate priors are derived from the full graph. The segmentation algorithm is based on Bayesian Maximum a Posteriori (MAP) estimation. The advantages of this separate approach are the adaptation of the prior to the contents creation process (e.g., superimposing two handwritten pages), and the improvement of the estimation of the recto pixels through an estimation of the verso pixels covered by recto pixels; moreover, the formulation as a binary labeling problem with two hidden labels per pixels naturally leads to an efficient optimization method based on the minimum cut/maximum flow in a graph. The proposed method is evaluated on scanned document images from the 18th century, showing an improvement of character recognition results compared to other restoration methods.
Collapse
|
12
|
|
13
|
Almeida MS, Almeida LB. Wavelet-based separation of nonlinear show-through and bleed-through image mixtures. Neurocomputing 2008. [DOI: 10.1016/j.neucom.2007.12.048] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
|
14
|
Hermite and Gabor transforms for noise reduction and handwriting classification in ancient manuscripts. INT J DOC ANAL RECOG 2007. [DOI: 10.1007/s10032-007-0039-z] [Citation(s) in RCA: 23] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
15
|
Caner G, Tekalp AM, Sharma G, Heinzelman W. Local image registration by adaptive filtering. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2006; 15:3053-65. [PMID: 17022269 DOI: 10.1109/tip.2006.877514] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/12/2023]
Abstract
We propose a new adaptive filtering framework for local image registration, which compensates for the effect of local distortions/displacements without explicitly estimating a distortion/displacement field. To this effect, we formulate local image registration as a two-dimensional (2-D) system identification problem with spatially varying system parameters. We utilize a 2-D adaptive filtering framework to identify the locally varying system parameters, where a new block adaptive filtering scheme is introduced. We discuss the conditions under which the adaptive filter coefficients conform to a local displacement vector at each pixel. Experimental results demonstrate that the proposed 2-D adaptive filtering framework is very successful in modeling and compensation of both local distortions, such as Stirmark attacks, and local motion, such as in the presence of a parallax field. In particular, we show that the proposed method can provide image registration to: a) enable reliable detection of watermarks following a Stirmark attack in nonblind detection scenarios, b) compensate for lens distortions, and c) align multiview images with nonparametric local motion.
Collapse
Affiliation(s)
- Gulcin Caner
- Electrical and Computer Engineering Department, University of Rochester, Rochester, NY 14627-0126, USA.
| | | | | | | |
Collapse
|
16
|
Salerno E, Tonazzini A, Bedini L. Digital image analysis to enhance underwritten text in the Archimedes palimpsest. INT J DOC ANAL RECOG 2006. [DOI: 10.1007/s10032-006-0028-7] [Citation(s) in RCA: 21] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
|
17
|
Tonazzini A, Salerno E, Bedini L. Fast correction of bleed-through distortion in grayscale documents by a blind source separation technique. INT J DOC ANAL RECOG 2006. [DOI: 10.1007/s10032-006-0015-z] [Citation(s) in RCA: 80] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
18
|
Dance C, Fan L. Color reconstruction in digital cameras: optimization for document images. INT J DOC ANAL RECOG 2005. [DOI: 10.1007/s10032-004-0130-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
19
|
|