Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Jun 21;23(13):5790.
doi: 10.3390/s23135790.

Detection of Defective Lettuce Seedlings Grown in an Indoor Environment under Different Lighting Conditions Using Deep Learning Algorithms

Munirah Hayati Hamidon  1 , Tofael Ahamed  2
Affiliations

Detection of Defective Lettuce Seedlings Grown in an Indoor Environment under Different Lighting Conditions Using Deep Learning Algorithms

Munirah Hayati Hamidon et al. Sensors (Basel). .

Abstract

Sorting seedlings is laborious and requires attention to identify damage. Separating healthy seedlings from damaged or defective seedlings is a critical task in indoor farming systems. However, sorting seedlings manually can be challenging and time-consuming, particularly under complex lighting conditions. Different indoor lighting conditions can affect the visual appearance of the seedlings, making it difficult for human operators to accurately identify and sort the seedlings consistently. Therefore, the objective of this study was to develop a defective-lettuce-seedling-detection system under different indoor cultivation lighting systems using deep learning algorithms to automate the seedling sorting process. The seedling images were captured under different indoor lighting conditions, including white, blue, and red. The detection approach utilized and compared several deep learning algorithms, specifically CenterNet, YOLOv5, YOLOv7, and faster R-CNN to detect defective seedlings in indoor farming environments. The results demonstrated that the mean average precision (mAP) of YOLOv7 (97.2%) was the highest and could accurately detect defective lettuce seedlings compared to CenterNet (82.8%), YOLOv5 (96.5%), and faster R-CNN (88.6%). In terms of detection under different light variables, YOLOv7 also showed the highest detection rate under white and red/blue/white lighting. Overall, the detection of defective lettuce seedlings by YOLOv7 shows great potential for introducing automated seedling-sorting systems and classification under actual indoor farming conditions. Defective-seedling-detection can improve the efficiency of seedling-management operations in indoor farming.

Keywords: CenterNet; YOLO; deep learning; faster RCNN; indoor farming; lettuce; seedling detection.

PubMed Disclaimer

Conflict of interest statement

The authors declare no conflict of interest.

Figures

Figure 1
Figure 1
Seedling image acquisition process and development of the detection system.
Figure 2
Figure 2
Lettuce seedling growth system under different indoor lighting settings.
Figure 3
Figure 3
Example of captured images of lettuce seedlings under (a) white fluorescent; (b) red/blue LEDs; and (c) red/blue/white LEDs.
Figure 4
Figure 4
Different image augmentation methods: (a) original image; (b) 90° clockwise rotation; (c) 180° clockwise rotation; (d) horizontal flip; and (e) vertical flip.
Figure 5
Figure 5
Overall framework for the detection of defective lettuce seedlings using the CenterNet, YOLO, and faster R-CNN models.
Figure 6
Figure 6
The CenterNet prediction process in detecting defective seedlings based on triplet key points.
Figure 7
Figure 7
The YOLO prediction process in detecting defective seedlings based on bounding boxes.
Figure 8
Figure 8
The faster R-CNN prediction process in detecting defective seedlings based on the RPN and fast R-CNN detector.
Figure 9
Figure 9
Confusion matrices for detecting defective seedlings.
Figure 10
Figure 10
Training performance of datasets using the YOLOv5 algorithm.
Figure 11
Figure 11
Training performance of datasets using the YOLOv7 algorithm.
Figure 12
Figure 12
Test examples of the detection of defective lettuce seedlings under white light conditions from (a,b) original image; (c,d) CenterNet; (e,f) YOLOv5; (g,h) YOLOv7; (i,j) faster R-CNN; and (k) summary of the detection results. (The square mark in the figure refers to detected seedlings, and the circle mark indicates false and misdetected seedlings.)
Figure 12
Figure 12
Test examples of the detection of defective lettuce seedlings under white light conditions from (a,b) original image; (c,d) CenterNet; (e,f) YOLOv5; (g,h) YOLOv7; (i,j) faster R-CNN; and (k) summary of the detection results. (The square mark in the figure refers to detected seedlings, and the circle mark indicates false and misdetected seedlings.)
Figure 12
Figure 12
Test examples of the detection of defective lettuce seedlings under white light conditions from (a,b) original image; (c,d) CenterNet; (e,f) YOLOv5; (g,h) YOLOv7; (i,j) faster R-CNN; and (k) summary of the detection results. (The square mark in the figure refers to detected seedlings, and the circle mark indicates false and misdetected seedlings.)
Figure 13
Figure 13
Test examples of the detection of defective lettuce seedlings under red and blue light conditions from (a,b) original image; (c,d) CenterNet; (e,f) YOLOv5; (g,h) YOLOv7; (i,j) faster R-CNN; and (k) summary of the detection results. (The square mark in the figure refers to detected seedlings, and the circle mark indicates false and misdetected seedlings.)
Figure 13
Figure 13
Test examples of the detection of defective lettuce seedlings under red and blue light conditions from (a,b) original image; (c,d) CenterNet; (e,f) YOLOv5; (g,h) YOLOv7; (i,j) faster R-CNN; and (k) summary of the detection results. (The square mark in the figure refers to detected seedlings, and the circle mark indicates false and misdetected seedlings.)
Figure 13
Figure 13
Test examples of the detection of defective lettuce seedlings under red and blue light conditions from (a,b) original image; (c,d) CenterNet; (e,f) YOLOv5; (g,h) YOLOv7; (i,j) faster R-CNN; and (k) summary of the detection results. (The square mark in the figure refers to detected seedlings, and the circle mark indicates false and misdetected seedlings.)
Figure 14
Figure 14
Test examples of the detection of defective lettuce seedlings under red, blue, and white light conditions from (a,b) original image; (c,d) CenterNet; (e,f) YOLOv5; (g,h) YOLOv7; (i,j) faster R-CNN; and (k) summary of the detection results. (The square mark in the figure refers to detected seedlings, and the circle mark indicates false and misdetected seedlings.)
Figure 14
Figure 14
Test examples of the detection of defective lettuce seedlings under red, blue, and white light conditions from (a,b) original image; (c,d) CenterNet; (e,f) YOLOv5; (g,h) YOLOv7; (i,j) faster R-CNN; and (k) summary of the detection results. (The square mark in the figure refers to detected seedlings, and the circle mark indicates false and misdetected seedlings.)
Figure 14
Figure 14
Test examples of the detection of defective lettuce seedlings under red, blue, and white light conditions from (a,b) original image; (c,d) CenterNet; (e,f) YOLOv5; (g,h) YOLOv7; (i,j) faster R-CNN; and (k) summary of the detection results. (The square mark in the figure refers to detected seedlings, and the circle mark indicates false and misdetected seedlings.)
See this image and copyright information in PMC

References

    1. Kozai T., Niu G., Takagaki M. Plant Factory: An Indoor Vertical Farming System for Efficient Quality Food Production. Academic Press; Amsterdam, The Netherlands: 2019.
    1. Ahmed H.A., Yu-Xin T., Qi-Chang Y. Optimal control of environmental conditions affecting lettuce plant growth in a controlled environment with artificial lighting: A review. S. Afr. J. Bot. 2019;130:75–89. doi: 10.1016/j.sajb.2019.12.018. - DOI
    1. Kozai T., Kubota C., Chun C., Afreen F., Ohyama K. Transplant Production in the 21st Century. Springer; Dordrecht, The Netherlands: 2000. Necessity and Concept of the Closed Transplant Production System; pp. 3–19. - DOI
    1. Nagano S., Moriyuki S., Wakamori K., Mineno H., Fukuda H. Leaf-Movement-Based Growth Prediction Model Using Optical Flow Analysis and Machine Learning in Plant Factory. Front. Plant Sci. 2019:10. doi: 10.3389/fpls.2019.00227. - DOI - PMC - PubMed
    1. Li Z., Li Y., Yang Y., Guo R., Yang J., Yue J., Wang Y. A high-precision detection method of hydroponic lettuce seedlings status based on improved Faster RCNN. Comput. Electron. Agric. 2021;182:106054. doi: 10.1016/j.compag.2021.106054. - DOI

LinkOut - more resources