Introduce Backend Interface (DatabricksClient)#573
Merged
varun-edachali-dbx merged 149 commits intoMay 30, 2025
sea-migrationdatabricks/databricks-sql-python:sea-migrationfrom
backend-interfacedatabricks/databricks-sql-python:backend-interfaceCopy head branch name to clipboard
Merged
Introduce Backend Interface (DatabricksClient)#573varun-edachali-dbx merged 149 commits intosea-migrationdatabricks/databricks-sql-python:sea-migrationfrom backend-interfacedatabricks/databricks-sql-python:backend-interfaceCopy head branch name to clipboard
varun-edachali-dbx merged 149 commits into
sea-migrationdatabricks/databricks-sql-python:sea-migrationfrom
backend-interfacedatabricks/databricks-sql-python:backend-interfaceCopy head branch name to clipboard
Commits
Commits on May 28, 2025
move py.typed to correct places (#403)
Show description for 5f00532authored andcommittedUpgrade mypy (#406)
Show description for 59ed5ceauthored andcommittedDo not retry failing requests with status code 401 (#408)
Show description for c95951dauthored andcommitted[PECO-1715] Remove username/password (BasicAuth) auth option (#409)
Show description for 335d918authored andcommitted[PECO-1751] Refactor CloudFetch downloader: handle files sequentially (#405)
Show description for ee4f94cauthored andcommittedFix CloudFetch retry policy to be compatible with all `urllib3` versions we support (#412)
Show description for 1c8bb11authored andcommittedDisable SSL verification for CloudFetch links (#414)
Show description for 9de280eauthored andcommittedPrepare relese 3.3.0 (#415)
Show description for 04b626aauthored andcommittedFix pandas 2.2.2 support (#416)
Show description for 2a01173authored andcommitted[PECO-1801] Make OAuth as the default authenticator if no authentication setting is provided (#419)
Show description for b1faa09authored andcommitted[PECO-1857] Use SSL options with HTTPS connection pool (#425)
Show description for 270edcfauthored andcommittedPrepare release v3.4.0 (#430)
Show description for 8523fd3authored andcommitted[PECO-1926] Create a non pyarrow flow to handle small results for the column set (#440)
Show description for 763f070authored andcommitted[PECO-1961] On non-retryable error, ensure PySQL includes useful information in error (#447)
Show description for 1e0d9d5authored andcommittedReformatted all the files using black (#448)
Show description for 890cdd7authored andcommittedPrepare release v3.5.0 (#457)
Show description for 9bdee1dauthored andcommitted[PECO-2051] Add custom auth headers into cloud fetch request (#460)
Show description for cdd7a19authored andcommittedPrepare release 3.6.0 (#461)
Show description for fcc2da9authored andcommitted[ PECO - 1768 ] PySQL: adjust HTTP retry logic to align with Go and Nodejs drivers (#467)
Show description for d354309authored andcommitted[ PECO-2065 ] Create the async execution flow for the PySQL Connector (#463)
Show description for d63544eauthored andcommittedFix for check_types github action failing (#472)
Show description for 5bbf223authored andcommittedRemove upper caps on dependencies (#452)
Show description for 9c62b21authored andcommittedUpdated the doc to specify native parameters in PUT operation is not supported from >=3.x connector (#477)
Show description for 7bb7ca6authored andcommittedIncorrect rows in inline fetch result (#479)
Show description for 438a080authored andcommittedBumped up to version 3.7.0 (#482)
Show description for eb50411authored andcommittedPySQL Connector split into connector and sqlalchemy (#444)
Show description for 2a5b9c7authored andcommittedRemoved CI CD for python3.8 (#490)
Show description for d31aa59authored andcommittedAdded CI CD upto python 3.12 (#491)
Show description for 3e62c90authored andcommittedMerging changes from v3.7.1 release (#488)
Show description for f9a6b13authored andcommittedBumped up to version 4.0.0 (#493)
Show description for a941575authored andcommittedUpdated action's version (#455)
Show description for 032c276authored andcommittedSupport Python 3.13 and update deps (#510)
Show description for d36889dauthored andcommittedImprove debugging + fix PR review template (#514)
Show description for 22e5ce4authored andcommittedForward porting all changes into 4.x.x. uptil v3.7.3 (#529)
Show description for 7772403authored andcommittedUpdated the actions/cache version (#532)
Show description for 8b27150authored andcommittedUpdated the CODEOWNERS (#531)
Show description for 398db45authored andcommittedAdd version check for urllib3 in backoff calculation (#526)
Show description for c962b63authored andcommitted[ES-1372353] make user_agent_header part of public API (#530)
Show description for c246872authored andcommittedUpdates runner used to run DCO check to use databricks-protected-runner (#521)
Show description for 326f338authored andcommittedSupport multiple timestamp formats in non arrow flow (#533)
Show description for 37e73a9authored andcommittedprepare release for v4.0.1 (#534)
Show description for 3d7123cauthored andcommittedRelaxed bound for python-dateutil (#538)
Show description for 132e1b7authored andcommittedBumped up the version for 4.0.2 (#539)
Show description for 46090c0authored andcommittedAdded example for async execute query (#537)
Show description for 28249c0authored andcommittedAdded urllib3 version check (#547)
Show description for 5ab0a2cauthored andcommittedBump version to 4.0.3 (#549)
Show description for 6528cd1authored andcommittedCleanup fields as they might be deprecated/removed/change in the future (#553)
Show description for 8f7754bauthored andcommittedRefactor decimal conversion in PyArrow tables to use direct casting (#544)
Show description for f7d3865authored andcommitted[PECOBLR-361] convert column table to arrow if arrow present (#551)
Show description for 61cc398authored andcommitteddecouple session class from existing Connection
Show description for 554d011committedadd open property to Connection to ensure maintenance of existing API
Show description for 6f28297committedupdate unit tests to address ThriftBackend through session instead of through Connection
Show description for 983ec03committedchore: move session specific tests from test_client to test_session
Show description for 6f3b5b7committedformatting (black)
Show description for 29a2840committeduse connection open property instead of long chain through session
Show description for 0d28b69committedtrigger integration workflow
Show description for 8cb8cddcommittedfix: ensure open attribute of Connection never fails
Show description for 4495f9bcommittedintroduce databricksClient interface and thrift backend implementation
Show description for c744117committedchange names of ThriftBackend -> ThriftDatabricksClient in tests
Show description for ef5a06bcommittedfix: remove excess debug log
Show description for abbaaa5committedfix: replace thrift_backend with backend in result set param
Show description for 33765cbcommittedfix: replace module replacement with concrete mock instance in executemany test
Show description for 788d8c7committedformatting: black + re-organise backend into new dir
Show description for 4debbd3committedfix: sql.thrift_backend -> sql.backend.thrift_backend in tests and examples
Show description for 0e6e215committedUpdate CODEOWNERS (#562)
Show description for 925394cauthored andcommittedEnhance Cursor close handling and context manager exception management to prevent server side resource leaks (#554)
Show description for 4ad6c8dauthored andcommittedPECOBLR-86 improve logging on python driver (#556)
Show description for 51369c8authored andcommittedUpdate github actions run conditions (#569)
Show description for 9541464authored andcommittedremove un-necessary example change
Show description for cbdd3d7committed[empty commit] trigger integration tests
Show description for ca38e95committedfix: use backend in Cursor, not thrift_backend
Show description for b40c0fdcommittedfix: backend references in integration tests
Show description for 35ed462committedfix: thrift_backend -> backend in ResultSet reference in e2e test
Show description for 37f3af1committedintroduce normalised sessionId and CommandId for (near) complete backend abstraction
Show description for 09c5e2fcommittedfix: Any is not defined
Show description for 4ce6aabcommittedfix: get_session_id_hex() is not defined
Show description for 307f447committedcommand_handle -> command_id in ExecuteResponse
Show description for 802d8dccommittedfix: active op handle -> active command id in Cursor
Show description for 944d446committedfixed (most) tests by accounting for normalised Session interface
Show description for 6338083committedfix: convert command id to operationHandle in status_request
Show description for 3658a91committeddecouple session class from existing Connection
Show description for 8ef6ed6committedadd open property to Connection to ensure maintenance of existing API
Show description for 61300b2committedformatting (black)
Show description for 44e7d17committeduse connection open property instead of long chain through session
Show description for d2035eacommittedtrigger integration workflow
Show description for 8b4451bcommittedfix: ensure open attribute of Connection never fails
Show description for d21d2c3committedfix: de-complicate earlier connection open logic
Show description for 21068a3committedRevert "fix: de-complicate earlier connection open logic"
Show description for 476e763committed[empty commit] attempt to trigger ci e2e workflow
Show description for 1e1cf1ecommittedPECOBLR-86 improve logging on python driver (#556)
Show description for b408c2cauthored andcommittedRevert "Merge remote-tracking branch 'upstream/sea-migration' into decouple-session"
Show description for 73649f2committedReapply "Merge remote-tracking branch 'upstream/sea-migration' into decouple-session"
Show description for a61df99committedfix: separate session opening logic from instantiation
Show description for e1a2c0ecommittedchore: use get_handle() instead of private session attribute in client
Show description for 71ba9d5committedfix: remove accidentally removed assertions
Show description for 160ba9fcommittedgeneralise open session, fix session tests to consider positional args
Show description for 6b3436fcommittedformatting (black)
Show description for 30849dccommittedcorrect session logic after duplication during merge
Show description for 4d455bbcommittedargs -> kwargs in tests
Show description for 6fc0834committeddelegate protocol version to SessionId
Show description for d254e48committedids -> backend/types
Show description for 370627dcommittedupdate open session with normalised SessionId
Show description for ca1b57dcommittedMerging changes from v3.7.1 release (#488)
Show description for 6c120c0authored andcommittedSupport Python 3.13 and update deps (#510)
Show description for cdf6865authored andcommittedUpdated the actions/cache version (#532)
Show description for 12ce717authored andcommittedAdd version check for urllib3 in backoff calculation (#526)
Show description for 1215fd8authored andcommittedSupport multiple timestamp formats in non arrow flow (#533)
Show description for dd083f6authored andcommittedAdded example for async execute query (#537)
Show description for 8d30436authored andcommittedAdded urllib3 version check (#547)
Show description for 066aef9authored andcommitteddecouple session class from existing Connection
Show description for 1ed3514committedformatting (black)
Show description for ca80f94committeduse connection open property instead of long chain through session
Show description for 6027fb1committedtrigger integration workflow
Show description for 7a2f9b5committedfix: ensure open attribute of Connection never fails
Show description for 39294e9committedRevert "fix: de-complicate earlier connection open logic"
Show description for 709e910committed[empty commit] attempt to trigger ci e2e workflow
Show description for 1ad0acecommittedPECOBLR-86 improve logging on python driver (#556)
Show description for 913da63authored andcommittedRevert "Merge remote-tracking branch 'upstream/sea-migration' into decouple-session"
Show description for d8159e7committedReapply "Merge remote-tracking branch 'upstream/sea-migration' into decouple-session"
Show description for 0b91183committedfix: separate session opening logic from instantiation
Show description for ff78b5fcommittedEnhance Cursor close handling and context manager exception management to prevent server side resource leaks (#554)
Show description for c1d53d2authored andcommittedPECOBLR-86 improve logging on python driver (#556)
Show description for a5a8e51authored andcommittedNew Complex type test table + Github Action changes (#575)
Show description for f7be10cauthored andcommittedremove excess logs, assertions, instantiations
Show description for a888dd6committed- committed
formatting (black) + remove excess log (merge artifact)
Show description for 9b9735ecommittedfix typing
Show description for 0a8226ccommittedremove un-necessary check
Show description for 42263c4committedremove un-necessary replace call
Show description for ac984e4committedintroduce __str__ methods for CommandId and SessionId
Show description for 8da84e8committed
Commits on May 29, 2025
docstrings for DatabricksClient interface
Show description for eecc67dcommittedstronger typing of Cursor and ExecuteResponse
Show description for 9800636committedremove utility functions from backend interface, fix circular import
Show description for e07f56ccommittedrename info to properties
Show description for 73fb141committednewline for cleanliness
Show description for d838653committedfix circular import
Show description for 6654f06committedformatting (black)
Show description for 89425f9committedto_hex_id -> get_hex_id
Show description for 93e55e8committedbetter comment on protocol version getter
Show description for 7689d75committedformatting (black)
Show description for 1ec8c45committedmove guid to hex id to new utils module
Show description for bc5e716committedformatting (black)
Show description for 8b6ba56committedmove staging allowed local path to connection props
Show description for c0b989ccommitted
Commits on May 30, 2025
add strong return type for execute_command
Show description for ece7616committedskip auth, error handling in databricksclient interface
Show description for 765bbd7committedchore: docstring + line width
Show description for 54077f7committedget_id -> get_guid
Show description for 91357f4committedchore: docstring
Show description for 26c017dcommittedfix: to_hex_id -> to_hex_guid
Show description for 8f085d5committed