Capture video from a USB camera using ESP-IDF.

This example demonstrates how to:

• Capture video from a USB camera using the USB Host UVC Driver.
  This repository uses components from version 1.0.4.
  https://components.espressif.com/components/espressif/usb_host_uvc
• Stream videos over WiFi using the built-in HTTP server.
• Supports plugging and unplugging USB cameras.

This example enumerates the attached camera descriptors, negotiates the selected resolution and FPS, and starts capturing video.

I based it on this official example.

• Changed Network connection by example_connect to WiFi connection by handler.

• Supported VideoStreaming format of UncompressedFormat.
  This will allow you to use Logitech C270n and Microsoft LifeCam.
  Conversion from UVC_FRAME_FORMAT_YUYV to JPEG used this.

• Changed from TCP transmission to HTTP transmission.
  I base it on this.

This example requires any ESP32-S2 or ESP32-S3 with external PSRAM and exposed USB connector attached to USB camera.
ESP module without external PSRAM will fail to initialize.
I used this board.

Note for ESP32S2
In earlier versions of the ESP32-S2 chip, USB transfers can cause SPI data contamination (esp32s2>=ECO1 and esp32s3 do not have this bug).
Software workaround is here.

USB cameras consume a lot of electricity.
If the power supplied to the USB port is insufficient, the camera will not operate and ESP32 resets.

USB connectors are available from AliExpress or eBay.
I used it by incorporating it into a Universal PCB.

We can buy this breakout on Ebay or AliExpress.

Here is a list of USB cameras that support UVC that work with FreeBSD.
From what I've researched, ESP-IDF has limited USB support.
For example, the Logitech C615 works with Linux, but not with ESP-IDF.
I tested with these cameras.

• Logitech C270n -> Success
• Logitech C615 -> Fail
• Logitech QuickCam Pro 9000 -> Success
• Microdia(Very old model) -> Success
• Microdia MSI Starcam Racer -> Success
• Microsoft LifeCam NX6000 -> Fail
• Microsoft LifeCam Cinema -> Success
• Microsoft LifeCam Studio -> Success
• Microsoft LifeCam HD3000 -> Success
• Microsoft LifeCam HD5000 -> Success
• Microsoft LifeCam HD6000 for Notebooks -> Success

It is very hard to find a camera that works with ESP-IDF.
On this document says that these cameras work with ESP-IDF.

• Logitech C980
• CANYON CNE-CWC2

This issue may be resolved when the USB Host UVC class driver provided by ESP-IDF is updated.
Detail is here.

ESP-IDF V5.0 or later.
ESP-IDF V4.4 release branch reached EOL in July 2024.

USB camera connects via USB connector.
The USB port on the ESP32 development board does not function as a USB-HOST.

+---------+  +-------------+  +----------+
|ESP BOARD|==|USB CONNECTOR|==|USB CAMERA|
+---------+  +-------------+  +----------+

ESP BOARD          USB CONNECTOR (type A)
                         +--+
5V        -------------> | || VCC
[GPIO19]  -------------> | || D-
[GPIO20]  -------------> | || D+
GND       -------------> | || GND
                         +--+

git clone https://github.com/nopnop2002/esp-idf-video-streaming
cd esp-idf-video-streaming
idf.py set-target {esp32s2/esp32s3}
idf.py menuconfig
idf.py flash monitor

Some cameras need to change frame size, frame rate and frame format.

• Build and flash firmware to esp32.

• Connect the USB camera at this timing.
  

• For available USB cameras, device information will be displayed and video streaming will begin.
  

• For unavailable USB cameras, you will see an error like this.
  

• Start your browser and enter the ESP32 IP address and port number in the address bar.
  You can use mDNS instead of ESP32 IP addresses.
  

• Streaming example : Some cameras have Auto Focus available.
  

• At 320x240, 30FPS is the maximum rate regardless of camera capabilities.
• At 640x480, 15FPS is the maximum rate regardless of camera capabilities.

You can use this repository.

https://github.com/nopnop2002/esp-idf-video-snapshot