Article Search
닫기

Original Article

Split Viewer

International Journal of Fuzzy Logic and Intelligent Systems 2014; 14(1): 8-16

Published online March 1, 2014

https://doi.org/10.5391/IJFIS.2014.14.1.8

© The Korean Institute of Intelligent Systems

Robust Video-Based Barcode Recognition via Online Sequential Filtering

Minyoung Kim

Department of Electronics & IT Media Engineering, Seoul National University of Science & Technology, Seoul, Korea

Correspondence to :
Minyoung Kim (mikim@seoultech.ac.kr)

Received: September 28, 2013; Revised: March 10, 2014; Accepted: March 11, 2014

We consider the visual barcode recognition problem in a noisy video data setup. Unlike most existing single-frame recognizers that require considerable user effort to acquire clean, motionless and blur-free barcode signals, we eliminate such extra human efforts by proposing a robust video-based barcode recognition algorithm. We deal with a sequence of noisy blurred barcode image frames by posing it as an online filtering problem. In the proposed dynamic recognition model, at each frame we infer the blur level of the frame as well as the digit class label. In contrast to a frame-by-frame based approach with heuristic majority voting scheme, the class labels and frame-wise noise levels are propagated along the frame sequences in our model, and hence we exploit all cues from noisy frames that are potentially useful for predicting the barcode label in a probabilistically reasonable sense. We also suggest a visual barcode tracking approach that efficiently localizes barcode areas in video frames. The effectiveness of the proposed approaches is demonstrated empirically on both synthetic and real data setup.

Keywords: Hidden Markov models,Online sequential filtering,Barcode recognition

This study was supported by Seoul National University of Science & Technology.

It is worth noting that the in-plane rotations were already dealt with in the previous experiments. However, the out-of-plane rotations, if significant changes, may not be properly handled by the proposed approach since we use a simple equal division to extract each digit code. So, we collect the videos with mild changes in out-of-plane pose changes.

No potential conflict of interest relevant to this article was reported.

Minyoung Kim received his BS and MS degrees both in Computer Science and Engineering from Seoul National University, South Korea. He earned a PhD degree in Computer Science from Rutgers University in 2008. From 2009 to 2010 he was a postdoctoral researcher at the Robotics Institute of Carnegie Mellon University. He is currently an Assistant Professor in the Department of Electronics and IT Media Engineering at Seoul National University of Science and Technology in Korea. His primary research interest is machine learning and computer vision. His research focus includes graphical models, motion estimation/tracking, discriminative models/learning, kernel methods, and dimensionality reduction.

Article

Original Article

International Journal of Fuzzy Logic and Intelligent Systems 2014; 14(1): 8-16

Published online March 1, 2014 https://doi.org/10.5391/IJFIS.2014.14.1.8

Copyright © The Korean Institute of Intelligent Systems.

Robust Video-Based Barcode Recognition via Online Sequential Filtering

Minyoung Kim

Department of Electronics & IT Media Engineering, Seoul National University of Science & Technology, Seoul, Korea

Correspondence to:Minyoung Kim (mikim@seoultech.ac.kr)

Received: September 28, 2013; Revised: March 10, 2014; Accepted: March 11, 2014

Abstract

We consider the visual barcode recognition problem in a noisy video data setup. Unlike most existing single-frame recognizers that require considerable user effort to acquire clean, motionless and blur-free barcode signals, we eliminate such extra human efforts by proposing a robust video-based barcode recognition algorithm. We deal with a sequence of noisy blurred barcode image frames by posing it as an online filtering problem. In the proposed dynamic recognition model, at each frame we infer the blur level of the frame as well as the digit class label. In contrast to a frame-by-frame based approach with heuristic majority voting scheme, the class labels and frame-wise noise levels are propagated along the frame sequences in our model, and hence we exploit all cues from noisy frames that are potentially useful for predicting the barcode label in a probabilistically reasonable sense. We also suggest a visual barcode tracking approach that efficiently localizes barcode areas in video frames. The effectiveness of the proposed approaches is demonstrated empirically on both synthetic and real data setup.

Keywords: Hidden Markov models,Online sequential filtering,Barcode recognition

Fig 1.

Figure 1.

(Top) Example EAN-13 barcode image that encodes 12-digit barcodes (a1..12) with the checksum digit c. (Bottom) Encoding scheme for each digit.

The International Journal of Fuzzy Logic and Intelligent Systems 2014; 14: 8-16https://doi.org/10.5391/IJFIS.2014.14.1.8

Fig 2.

Figure 2.

(Left) Endpoints (red) of the line that tightly covers the tracked barcode. (Middle) Unnormalized intensity values for digit 1 and 7 in the left part. (Right) Normalized signals to 1–30 duration and scaled to a range of 0–1.

The International Journal of Fuzzy Logic and Intelligent Systems 2014; 14: 8-16https://doi.org/10.5391/IJFIS.2014.14.1.8

Fig 3.

Figure 3.

Model of barcode signal sequence recognition.

The International Journal of Fuzzy Logic and Intelligent Systems 2014; 14: 8-16https://doi.org/10.5391/IJFIS.2014.14.1.8

Fig 4.

Figure 4.

Transition probabilities for hidden state variables.

The International Journal of Fuzzy Logic and Intelligent Systems 2014; 14: 8-16https://doi.org/10.5391/IJFIS.2014.14.1.8

Fig 5.

Figure 5.

(Top) Unblurred clean barcode image with the sequence of noisy video frames generated from it using Gaussian blur with different scales. (Bottom) Each of three panels depicts the sequences of normalized signal vectors, online class filtering, and state filtering results for three digits (the first, the third in the left part, and the sixth in the right) whose true digit classes are shown in the parentheses.

The International Journal of Fuzzy Logic and Intelligent Systems 2014; 14: 8-16https://doi.org/10.5391/IJFIS.2014.14.1.8

Fig 6.

Figure 6.

Sample frames from barcode videos.

The International Journal of Fuzzy Logic and Intelligent Systems 2014; 14: 8-16https://doi.org/10.5391/IJFIS.2014.14.1.8

Fig 7.

Figure 7.

Sample frames from additional barcode videos with severe illumination and pose changes.

The International Journal of Fuzzy Logic and Intelligent Systems 2014; 14: 8-16https://doi.org/10.5391/IJFIS.2014.14.1.8

Table 1 . Barcode recognition accuracy on real videos.

Video#Frame-by-frame (%)Proposed method (%)
125.0075.00
233.3375.00
30.0058.33
425.00100.00
591.67100.00
633.3358.33
725.0083.33
841.6766.67
958.3375.00
1033.3391.67
Average36.6778.33

Table 2 . Barcode recognition accuracy on real videos with severe illumination and pose variations..

Video#Frame-by-frame (%)Proposed method (%)
1133.3383.33
1241.6766.67
138.3350.00
1416.6791.67
1525.0066.67
1633.3358.33
1733.3375.00
Average27.3870.24