Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Appearance settings
Open more actions menu

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
9 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

image_downloader_multiprocessing_python

Here we will use multiprocessing to download images in batch with python.

This saved me a lot of time while downloading images.

Installation

Clone the repository to your machine.

git clone https://github.com/nOOBIE-nOOBIE/image_downloader_multiprocessing_python

Install the requirements

pip install -r requirements.txt

Usage

python3 image_downloader.py <filename_with_urls_seperated_by_newline.txt> <num_of_process>

This will read all the urls in the text file and download them into a folder with name same as the filename. num_of_process is optional.(by default it uses 10 process)

Example

python3 image_downloader.py cats.txt

cat images downloading

cat image downloading

Benchmark

1183 images in 121.99 seconds with 10 process.

Images folder sample

cats

About

Downloading Images with multiprocessing using python requests and multiprocessing.

Topics

Resources

Stars

Watchers

Forks

Releases

Packages

Contributors

Languages

Morty Proxy This is a proxified and sanitized view of the page, visit original site.