RetailLens-AI
An autonomous retail operations agent that monitors live computer vision feeds, reasons across persistent memory, and executes safe determin
Built at AgentX Hackathon 2026
Team NEXORA: Yuvaraj Hiremath, Supritha T
Built with Next.js, Tailwind CSS, Next.js App Router API handlers, Zod, Python FastAPI
About the project
Problem
Traditional retail management systems and dashboards operate reactively—alerting staff only after inventory stockouts occur, shrink goes unnoticed at checkout, or expiring goods result in margin loss. Human staff cannot continuously monitor shelf density, catch unscanned items in real time, or anticipate dynamic replenishment without heavy manual intervention.
Solution
RetaiLens AI is an autonomous operations and checkout intelligence agent. It bridges physical store environments with digital inventory systems by continuously monitoring overhead vision feeds, detecting inventory anomalies, executing deterministic inventory mutations, and calculating dynamic, margin-safe discounts for approaching-expiry goods.
How It Works
Perceive & Reason: Ingests live shelf and checkout feeds via a high-performance Python FastAPI and OpenCV/YOLO-compatible computer vision pipeline, tracking real-time SKU occupancy, missing facings, and barcode scans.
ReAct Agentic Orchestration: Correlates visual observations against real-time POS and inventory data, executing deterministic tools bounded by strict store policies.
Human-in-the-Loop (HITL) Safety: Irreversible or high-stakes actions—such as dispatching large supplier purchase orders, overriding disputed checkout scans, or steep markdowns—automatically pause for 1-click authorized manager approval via server-enforced RBAC.
Persistent Cross-Session Memory: Stores depletion velocity patterns, supplier lead times, and checkout anomaly histories to proactively optimize restocking schedules.
Impact
Shrink Reduction: Blocks checkout mismatch leaks and unscanned merchandise in real time.
Minimized Stockouts & Waste: Automates timely supplier reorders and margin-safe expiry markdowns.
Zero Runaway Automation: Keeps store managers firmly in control with audit logging and idempotent tool executions.