Correlation-based receiver for optical camera communications

Developing a comprehensive model for underwater MIMO OCC system

Due to its spatial modulation feature and potential applications, optical camera communication (OCC) has gained significant attention in recent years for a range of applications including underwater. Nonetheless, due to the low frame rates of the camera, the OCC data rate is rather low, which is why multiple-input-multiple-output (MIMO) has been adopted to compensate. In MIMO systems, however, the signal from one light emitting diode (LED) may result in interference on the image sensor (i.e., the camera) resulting in inter-pixel interference (IPI). This paper presents a comprehensive model of the underwater OCC (UOCC) and experimentally verifies its performance under IPI by comparing signal to interference and noise ratio (SINR). The effect of distance between LEDs according to LED diameter D on signal to interference ratio (SIR) is presented and results indicate that coastal water has the SIR gain ∼2.5 dB for the link span of 1 to 6 m, and for harbor water channel length from 0.4 to 1.4 m the gain increased from ∼2 to ∼5 dB for d of 2D compared with d of 0.5D.

Deep learning for signal clock and exposure estimation in rolling shutter optical camera communication

In rolling shutter (RS)-based optical camera communication (OCC) links, selecting the appropriate camera's exposure time is critical, as it limits the reception bandwidth. In long exposures, the pixels accumulate over time the incoming irradiance of several consecutive symbols. As a result, a harmful intersymbol interference corrupts the received signal. Consequently, reducing the exposure time is required to increase the reception bandwidth at the cost of producing dark images with impracticable light conditions for human or machine-supervised applications. Alternatively, deep learning (DL) equalizers can be trained to mitigate the exposure-related ISI. These equalizers must be trained considering the transmitter clock and the camera's exposure, which can be exceptionally challenging if those parameters are unknown in advance (e.g., if the camera does not reveal its internal settings). In those cases, the receiver must estimate those parameters directly from the images, which are severely distorted by the exposure time. This work proposes a DL estimator for this purpose, which is trained using synthetic images generated for thousands of representative cases. This estimator enables the receiver operation under multiple possible configurations, regardless of the camera used. The results obtained during the validation, using more than 7000 real images, registered relative errors lower than 1% and 2% when estimating the transmitter clock and the exposure time, respectively. The obtained errors guarantee the optimal performance of the following equalization and decoding receiver stages, keeping bit error rates below the forward error correction limit. This estimator is a central component of any OCC receiver that operates over moderate exposure conditions. It decouples the reception routines from the cameras used, ultimately enabling cloud-based receiver architectures.

Survey on Optical Wireless Communications-Based Services Applied to the Tourism Industry: Potentials and Challenges

In this paper, we explore the potential applications of Optical Wireless Communications in the tourism industry, considering both indoor and outdoor scenarios and different transmission speeds. They range from high-speed atmospheric outdoor links (Free-Space Optics (FSO)) to indoor systems based on high-speed lighting networks (known under the trade name LiFi©) or low-speed services support the Internet of Things networks, using visible light (VLC) or IR emitters, with receivers based on either on classical photodiodes or in image sensors, known as Optical Camera Communications. The avant-garde applications of this technology have been studied focusing on three possible use scenarios: the traveler himself, in what we have called TAN (Tourist Area Network); the tourist facility, which includes not only the hotel but also leisure areas (theme parks, museums, natural protected areas) or services (restaurants, shopping areas, etc.); and the entire destination, which can be both the city or the territory where the tourist is received, within the paradigm of the Smart Tourist Destination (STD). In addition to the classic services based on radio frequency and wired broadband networks, these technologies will make it possible to meet the tourist's challenging needs, the establishment, and the destination. Besides, they cover the services imposed by the new marketing services related to location or context and feed the big data systems used to study tourist behavior.

Convolutional autoencoder for exposure effects equalization and noise mitigation in optical camera communication

In rolling shutter-based optical camera communication (OCC), the camera's exposure time limits the achievable reception bandwidth. In long-exposure settings, the image sensor pixels average the incident received power, producing inter-symbol interference (ISI), which is perceived in the images as a spatial mixture of the symbol bands. Hence, the shortest possible exposure configuration should be selected to alleviate ISI. However, in these conditions, the camera produces dark images with impracticable light conditions for human or machine-supervised applications. In this paper, a novel convolutional autoencoder-based equalizer is proposed to alleviate exposure-related ISI and noise. Furthermore, unlike other systems that use artificial neural networks for equalization and decoding, the training procedure is conducted offline using synthetic images for which no prior information about the deployment scenario is used. Hence the training can be performed for a wide range of cameras and signal-to-noise ratio (SNR) conditions, using a vast number of samples, improving the network fitting and the system decoding robustness. The results obtained in the experimental validation record the highest ISI mitigation potential for Manchester encoded on-off keying signals. The system can mitigate the ISI produced by exposure time windows that are up to seven times longer than the transmission symbol duration, with bit error rates (BER) lower than 10^-5 under optimal SNR conditions. Consequently, the reception bandwidth improves up to 14 times compared to non-equalized systems. In addition, under harsh SNRs conditions, the system achieves BERs below the forward error correction limit for 1dB and 5 dB while operating with exposure times that are 2 and 4 times greater than the symbol time, respectively.

Wireless Sensor Networks Using Sub-Pixel Optical Camera Communications: Advances in Experimental Channel Evaluation

Optical wireless communications in outdoor scenarios are challenged by uncontrollable atmospheric conditions that impair the channel quality. In this paper, different optical camera communications (OCC) equipment are experimentally studied in the laboratory and the field, and a sub-pixel architecture is raised as a potential solution for outdoor wireless sensor networks (WSN) applications, considering its achievable data throughput, the spatial division of sources, and the ability of cameras to overcome the attenuation caused by different atmospheric conditions such as rain, turbulence and the presence of aerosols. Sub-pixel OCC shows particularly adequate capabilities for some of the WSN applications presented, also in terms of cost-effectiveness and scalability. The novel topology of sub-pixel projection of multiple transmitters over the receiver using small optical devices is presented as a solution using OCC that re-uses camera equipment for communication purposes on top of video-monitoring.

Optical Camera Communication as an Enabling Technology for Microalgae Cultivation

Optical Camera Communication (OCC) systems have a potential application in microalgae production plants. In this work, a proof-of-concept prototype consisting of an artificial lighting photobioreactor is proposed. This reactor optimises the culture's photosynthetic efficiency while transmitting on-off keying signals to a rolling-shutter camera. Upon reception, both signal decoding and biomass concentration sensing are performed simultaneously using image processing techniques. Moreover, the communication channel's theoretical modelling, the data rate system's performance, and the plant distribution requirements and restrictions for a production-scale facility are detailed. A case study is conducted to classify three different node arrangements in a real facility, considering node visibility, channel capacity, and space exploitation. Finally, several experiments comprising radiance evaluation and Signal-to-Noise Ratio (SNR) computation are performed at different angles of view in both indoor and outdoor environments. It is observed that the Lambertian-like emission patterns are affected by increasing concentrations, reducing the effective emission angles. Furthermore, significant differences in the SNR, up to 20 dB, perceived along the illuminated surface (centre versus border), gradually reduce as light is affected by greater dispersion. The experimental analysis in terms of scattering and selective wavelength attenuation for green (Arthrospira platensis) and brown (Rhodosorus marinus) microalgae species determines that the selected strain must be considered in the development of this system.

Sandstorm effect on experimental optical camera communication

Sandstorms can severely affect the reliability of outdoor optical wireless communications (OWC) by diminishing large regions' visibility. In this work, the effect of a real sandstorm on optical camera communications (OCC) links is experimentally evaluated. Two link ranges are essayed using a cost-efficient telescope-based camera setup with commercial LEDs. Using on-off keying modulation, a data rate of 1035 and 630 bps with error probabilities of 9.14⋅10^-5 and 4.1⋅10^-3 for 100 m and 200 m, respectively, can be achieved. The signal-to-noise ratio of the links was optimized by tuning the analog amplifier's gain of the camera, increasing it by up to 9 dB. It is shown that scattering due to the sandstorm can even be beneficial for increasing the data rate in OCC (contrary to classical photodetector-based OWC links), thanks to an increment of 33% on the region of interest dimensions compared to the expected clear air link.

Spatial frequency-based angular behavior of a short-range flicker-free MIMO-OCC link

In this paper, we provide a solution based on spatial frequency f_sf to study the angular behavior of a flicker-free, short-range indoor multiple-input multiple-output (MIMO) optical camera communications (OCC) link. We focus on the experimental investigation of OCC's performance for the transmitters (Txs) [i.e., light-emitting diode (LED) based arrays] located at the same and different distances from the receiver (Rx) with the off-axis rotation angle θ. We have used two 8×8 distributed LED arrays and a commercial low-cost complementary metal-oxide-semiconductor (CMOS) Raspberry Pi camera with the rolling-shutter capturing mode as the Tx and Rx, respectively. The image and the respective communications link quality metrics are measured in terms of the peak signal-to-noise ratio (PSNR) and the rate of successfully received bits with respect to f_sf for different camera shutter speeds (SS). A CMOS image sensor noise characterization is carried in terms of the signal-to-noise ratio (SNR) and PSNR. The proposed study provides a 100% success rate in data reception at the optimum θ of 50° at lower captured values of f_sf, which is projected onto the image sensor in the form of pixels. Moreover, the effect of channel saturation over f_sf is studied with respect to θ and SS and we show that, for θ exceeding the optimum value along transmission range, the f_sf area of the Txs reduces to less than ∼50% of the captured Tx units at θ of 0°, where no data can be fully recovered.

Characterization and Performance of a Thermal Camera Communication System

This work presents a novel communications technology named Thermal Camera Communication (TCC), which is analogous to Optical Camera Communication (OCC). Thermographic cameras and Peltier cells are proposed as receiver and transmitter, respectively, changing completely their usual field of application. Furthermore, a comprehensive characterization of the Peltier-Thermal camera pair is carried out, presenting their bandwidth, achievable data rate under On-Off-Keying (OOK) modulation, noise characteristics, and energy efficiency. A comparison against the current state-of-the-art OCC technology is also provided, showing that TCC is a promising technology suitable for sensor networks. The thorough analysis of TCC performed in this work shows that commercial Peltier cells can be re-thought under a communications viewpoint in order to improve their performance. This novel communication technology can be applied in environments such as the access to public transportation or buildings due to the new health emergency situation. The use of thermographic cameras will become massive and dual measurement and communication purposes could be considered for applications such as sensor networks, using a yet unexploited wavelength range.

Experimentally Derived Feasibility of Optical Camera Communications under Turbulence and Fog Conditions

Optical camera communications (OCC) research field has grown recently, aided by ubiquitous digital cameras; however, atmospheric conditions can restrict their feasibility in outdoor scenarios. In this work, we studied an experimental OCC system under environmental phenomena emulated in a laboratory chamber. We found that the heat-induced turbulence does not affect our system significantly, while the attenuation caused by fog does decrease the signal quality. For this reason, a novel strategy is proposed, using the camera's built-in amplifier to overcome the optical power loss and to decrease the quantization noise induced by the analog-digital converter of the camera. The signal quality has been evaluated using the Pearson's correlation coefficient with respect to a reference template signal, along with the signal-to-noise ratio that has been empirically evaluated. The amplification mechanism introduced allows our system to receive the OCC signal under heavy fog by gradually increasing the camera gain up to 16 dB, for meteorological visibility values down to 10 m, with a correlation coefficient of 0.9 with respect to clear conditions.