Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Appearance settings

Dev-Mastermind/data-migration-script

Open more actions menu

Repository files navigation

PostgreSQL Table Migration to S3 in Chunks

Prerequisites

  1. Create a .env file in the project directory with the following variables:

DB_USERNAME=your_db_username DB_PASSWORD=your_db_password DB_HOST=your_db_host DB_PORT=your_db_port DB_NAME=your_db_name S3_BUCKET_NAME=your_s3_bucket_name TABLE_NAME=your_table_name

Configuration

  1. Set the chunk size in the main.py file if needed:

chunk_size = 10000 # Number of rows per chunk

  1. Install the dependencies:

    pip install -r requirements.txt

  2. Run the script: python main.py

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Morty Proxy This is a proxified and sanitized view of the page, visit original site.