AR Garden Studio is an immersive augmented reality application that allows users to design and cultivate virtual gardens in their real-world environment. Users can place various plants, decorative objects, and garden furniture on detected surfaces, manipulate them through gestures, navigate their garden using teleportation, and control the app through voice commands. The app includes AI-powered plane classification to recommend appropriate plant placements (e.g., ground plants vs. wall-mounted planters) and spatial audio for ambient nature sounds.
- Real-time Surface Detection: Automatic detection of horizontal and vertical planes
- AI-Powered Plane Classification: Smart recommendations based on surface type (floor, table, wall)
- Object Placement: Tap-to-place system with visual feedback
- 6 Plant Types: Rose, Sunflower, Tree, Cactus, Tulip and Bush
- Touch UI: Intuitive catalog, settings and action buttons
- Gesture Controls:
- Pinch to scale (0.3x to 0.5x)
- Two-finger twist to rotate
- Single-finger drag to reposition
- Voice Commands: Hands-free control with 12+ commands
- Object Selection: Tap objects to select with visual highlight
- Teleportation Locomotion: Instantly move viewpoint to explore large spaces
- Interactive Tutorial: 6-screen onboarding system for first-time users
- Accessibility Options:
- Adjustable text size (80% to 20%)
- Haptic feedback toggle
- Voice guidance option
- Error Handling: Graceful degradation with user-friendly messages
- Launch the App
- Grant camera, microphone and speech recognition permissions
- Complete the interactive tutorial (or skip)
- Scan your environment
- Move your device slowly around the room
- Blue transparent planes appear on detected surfaces
- Wait for "Surface detected!" message
- Place your first plant
- Tap the
+button (top left) - Select a plant from the catalog
- Tap on any blue surface to place
- Tap the
| Action | How To |
|---|---|
| Open Catalog | Top + button (top left) |
| Settings | Tap ⚙️ button (top right) |
| Help / Tutorial | Tap ? button (top right) |
| Delete Object | Select object, then tap 🗑️ button |
| Teleport Mode | Tap 📍 button, then tap destination |
| Voice Control | Tap 🎤 button to activate |
Select an object first by tapping it (yellow outline appears)
| Gesture | Action | Visual Feedback |
|---|---|---|
| Pinch (2 fingers) | Scale object | Orange banner |
| Twist (2 fingers) | Rotate object | Purple banner |
| Drag (1 finger) | Move object | Cyan banner |
To activate voice commands tap 🎤 button or say "Hey Garden"
| Command | Action |
|---|---|
| "place rose" | Select rose for placement |
| "place tree" | Select tree for placement |
| "place sunflower" | Select sunflower for placement |
| "delete" | Delete selected object |
| "make bigger" | Scale up selected object |
| "make smaller" | Scale down selected object |
| "rotate left" | Rotate selected object counter-clockwise |
| "show menu" | Open catalog |
| "teleport mode" | Activate teleportation |
Explore your AR garden from different viewpoints:
- Tap 📍 location button (bottom center)
- Button turns green - teleport mode active
- Tap anywhere on a detected surface
- Your viewpoint instantly moves to that location
- Objects remain in their world positions
Access settings by tapping the ⚙️ icon:
- Text Size: Adjust UI text from 80% to 200%
- Voice Guidance: Enable / disable voice feedback (future feature)
- Haptic Feedback: Toggle vibration on interactions
Following requirements are given:
- Device: iPhone or iPad with A12 Bionic chip or newer
- iOS Version: 16.0 or later
- ARKit Support: Device must support ARKit (iPhone 6s and newer)
- Xcode: 15.0 or later (for development)