WildDet3D

WildDet3D brings open-vocabulary 3D object detection to your iPhone — powered by AI research from the Allen Institute for AI (Ai2). Point your camera at any scene and instantly detect objects with full 3D bounding boxes rendered in augmented reality. Simply type what you're looking for — chairs, monitors, cups, or any object — and WildDet3D will find and measure them in 3D space. CAMERA MODE Leverage your iPhone's LiDAR sensor and ARKit to detect objects in real time. 3D bounding boxes are anchored to the real world, showing each object's label, confidence score, distance, dimensions, and volume. Supports meters, feet, and centimeters. UPLOAD MODE Run 3D detection on any photo from your library. No camera or LiDAR required — works on all iPhones. DETECTION MODES - Classes: Enter any object categories and detect all instances at once - 2D Box: Draw a box around a specific object to get its 3D bounding box ADVANCED FEATURES - RGB and RGBD depth-aligned detection for improved accuracy - Interactive 3D boxes — tap to inspect, compare, or delete - Multi-frame and multi-view capture for challenging scenes - Save annotated captures to your photo library REQUIREMENTS - iPhone with LiDAR sensor recommended for camera mode (iPhone 12 Pro and later) - Upload mode works on all iPhones - Internet connection required