AI Model Benchmarking at the Edge for Quality Inspection in Manufacturing
Neural network based deep learning models increasingly demonstrates high accuracy in object detection and image classification in digital image processing. The manufacturing industry is adapting this advanced technology to assist in automated quality assurance. Successful in implementing prototypes and small-scale deployment to employ AI models for quality inspection has been achieved. AI-assisted quality inspection significantly improves inspection accuracy, operation throughput and efficiency. “A Framework for Large-Scale AI-Assisted Quality Inspection Implementation in Manufacturing Using Edge Computing” [1] was previously presented, in which details are discussed highlighting challenges in large-scale deployment of AI models for quality inspection operation and focused on IT architectural decisions to fulfill the OT requirement, including user experience in the quality inspection ecosystem.
This paper focuses on AI model benchmarking at the edge, with respect to the architecture presented in [1]. It discusses the technical challenges to meet specific inference performance requirement at the edge. Benchmarking study of various AI models on a set of edge hardware including Nvidia Jetson TX2 and IBM Power servers are performed and recommendations on AI model and edge hardware selection is presented.
Keyword: Quality Inspection, AI Models Benchmarking, Edge Computing