SI: Implement put operations#67
Merged
Commits
Commits on Nov 15, 2022
Basic PUT operation. Currently this never executes because the server
Show description for 28c3a59committed
Jesse WhitehouseBump Spark CLI service protocol version being used.
Show description for 1b245b1committedJesse WhitehouseLog when attempting a staging operation
Show description for 1239defcommittedJesse Whitehouse
Commits on Nov 16, 2022
Fix failing unit tests since function signature for ExecuteResponse changed
Show description for b605ccecommittedJesse WhitehouseAdd e2e test for put.
Show description for 3ed84d8committedJesse WhitehouseBail on tests if staging_ingestion_user is not set
Show description for 57b8a34committedJesse WhitehouseBlack client.py
Show description for 7812278committedJesse Whitehouse
Commits on Nov 17, 2022
Add unit test that sanity checks _handle_staging_operation is called
Show description for 6b76439committedJesse WhitehouseFix imports so that this module can be run independently:
Show description for 3df7c89committedJesse WhitehouseImplement GET operation
Show description for 8f0a02ecommittedJesse Whitehouse
Commits on Nov 23, 2022
Refactor client.py into distinct methods for each ingestion command type
Show description for 55525cbcommittedJesse WhitehouseUpdate pypoetry so I can develop on Python 3.10
Show description for 157ac3dcommittedJesse WhitehouseApplied PR feedback around explicit response codes.
Show description for 0739ccccommittedJesse WhitehouseApplying PR feedback
Show description for d3a3651committedJesse WhitehousePR feedback
Show description for 72f917ecommittedJesse WhitehouseBlack client.py
Show description for fba64b7committedJesse WhitehouseRefactor e2e test to use a single teste for PUT, GET, and REMOVE
Show description for c27a3d6committedJesse WhitehouseMake REMOVE command work
Show description for 19ca706committedJesse WhitehouseThese methods don't need to know the `operation`
Show description for 0167bd9committedJesse WhitehouseRemove single quote that broke query
Show description for 85e4d7ccommittedJesse WhitehouseRemove unneeded argument
Show description for 713002dcommittedJesse WhitehouseExpect operation to succeed
Show description for fc06ef8committedJesse WhitehouseBlack PySQLStagingIngestionTestSuite only
Show description for cafa17dcommittedJesse WhitehouseTidy up comments in e2e test
Show description for a508a1ccommittedJesse WhitehouseBasic e2e test scaffolded in. Currently fails.
Show description for ce80df0committedJesse WhitehouseOnly allow ingestion commands when base_uploads_path is specified
Show description for 36885a4committedJesse WhitehouseRestrict local file operations to descendents of uploads_base_path
Show description for c0c09d4committedJesse Whitehouse
Commits on Dec 20, 2022
Remove per PR feedback
Show description for f612795committedJesse WhitehouseAdd check for null local_file per PR feedback
Show description for e609ef3committedJesse WhitehouseOpen output stream _after_ successful HTTP request
Show description for cdbe2d6committedJesse WhitehouseResolve relative paths before comparing row.localFile to uploads_base_path
Show description for 34a0362committedJesse WhitehouseAdd test that PUT fails if file exists in staging location and OVERWRITE not set
Show description for c8a64c7committedJesse WhitehouseAdd tests: operations fail to modify another user's staging location
Show description for d48d3f3committedJesse WhitehouseAdd test that ingestion command fails if local file is blank
Show description for e0037e0committedJesse WhitehouseAdd test that invalid staging path will fail at server
Show description for 3fa5d84committedJesse Whitehouse
Commits on Dec 22, 2022
Basic usage example (needs tweaking)
Show description for 4824b68committedJesse WhitehouseAdd samples of GET and REMOVE
Show description for 469f35fcommittedJesse Whitehouse
Commits on Dec 28, 2022
Refactor to allow uploads_base_path to be either a single string object
Show description for bdb948acommittedJesse Whitehouse
Commits on Dec 29, 2022
Refactor uploads_base_path to staging_allowed_local_path
Show description for 0261b7acommittedJesse Whitehouse
Commits on Dec 30, 2022
Fix mypy static type failures
Show description for 00d8a49committedJesse WhitehouseBlack src files
Show description for 7a602e6committedJesse Whitehouse