AI-DLCS: Artificial Intelligence for Data Labeling and Curation at Scale

The Department of Homeland Security (DHS) grapples with vast and diverse datasets collected daily, ranging from personal property scans to Stream of Commerce (SoC) data. To analyze and improve algorithms for detecting explosives and prohibited items, efficient curation and labeling are essential. However, DHS faces challenges, including data processing inefficiencies, dependency on human labeling, limited scalability, predictive analytics and threat detection obstacles, and inter-agency collaboration barriers.In response, Agile Data Decisions, Inc. (AgileDD) proposes an innovative solution called AI for Data Labeling and Curation at Scale (AI-DLCS). Leveraging their iQC human-in-the-loop AI platform and the CargoSeer AI platform, the project aims to address DHS's challenges. CargoSeer AI, developed by CargoSeer LTD, specializes in consignment inspection, utilizing a Large Foundation Model to automatically inspect scanned cargo for fraud. AgileDD plans to enhance these platforms with new algorithms for (1) labeling at scale from a known single image with few-shot learning, and (2) multi-class/multi-label image classification and object detection with weakly supervised learning.The technical objectives of the proposed Phase I research include developing a data ingestion and pre-processing pipeline for diverse image and document formats, establishing standardized metrics for auto-labeling, implementing large-scale auto-labeling with few-shot learning, conducting multi-label and multi-class auto-labeling on a large dataset, and demonstrating a proof-of-concept workflow on the ImageNet dataset. The goal is to enhance efficiency, reduce human dependency, and improve scalability for DHS in handling complex and extensive datasets crucial for security and defense decision-making. The proposed solution showcases promise in revolutionizing data handling processes for security applications.