Enhance SEA HTTP Client #618
Merged
Merged
Enhance SEA HTTP Client #618
Commits
This pull request is big! We're only showing the most recent 250 commits
Commits on Jun 18, 2025
ensure command_id is not None
Show description for bf6d41ccommittedline breaks after multi-line pyfocs
Show description for 5afa733committedensure non null operationHandle for commandId creation
Show description for e3dfd36committeduse command_id methods instead of explicit guid_to_hex_id conversion
Show description for 63360b3committedremove un-necessary artifacts in test_session, add back assertion
Show description for 13ffb8dcommittedImplement SeaDatabricksClient (Complete Execution Spec) (#590)
Show description for a74d279authored- committed
remove unimplemented metadata methods test, un-necessary imports
Show description for f6d873dcommittedintroduce unit tests for metadata methods
Show description for 28675f5committed
Commits on Jun 19, 2025
add from __future__ import annotations to remove string literals around forward refs, remove some unused imports
Show description for d759050committed
Commits on Jun 20, 2025
remove verbosity in ResultSetFilter docstring
Show description for 3578659andauthoredremove un-necessary info in ResultSetFilter docstring
Show description for 8713023committedremove explicit type checking, string literals around forward annotations
Show description for 22dc252committedhouse SQL commands in constants
Show description for 390f592committed
Commits on Jun 23, 2025
convert complex types to string if not _use_arrow_native_complex_types
Show description for dd7dc6acommitted- committed
introduce unit tests for altered functionality
Show description for 2712d1ccommitted- committed
Revert "Merge branch 'fetch-json-inline' into ext-links-sea"
Show description for 48ad7b3committedreduce verbosity of ResultSetFilter docstring
Show description for a1f9b9ccommittedremove unused imports
Show description for 984e8eecommitted- committed
Revert "Merge branch 'fetch-json-inline' into ext-links-sea"
Show description for c313c2bcommittedRevert "reduce verbosity of ResultSetFilter docstring"
Show description for 3bc615ecommittedReapply "Merge branch 'fetch-json-inline' into ext-links-sea"
Show description for b6e1a10committedRevert "Merge branch 'fetch-json-inline' into ext-links-sea"
Show description for 2df3d39committedremove un-necessary filters changes
Show description for 5e75fb5committedremove un-necessary backend changes
Show description for 20822e4committedremove constants changes
Show description for 802d045committedremove changes in filters tests
Show description for f3f795acommittedremove unit test backend and JSON queue changes
Show description for f6c5950committedremove changes in sea result set testing
Show description for d210ccdcommittedRevert "remove changes in sea result set testing"
Show description for 22a953ecommittedRevert "remove unit test backend and JSON queue changes"
Show description for 3aed144committedRevert "remove changes in filters tests"
Show description for 0fe4da4committedRevert "remove constants changes"
Show description for 0e3c0a1committedRevert "remove un-necessary backend changes"
Show description for 93edb93committedRevert "remove un-necessary filters changes"
Show description for 871a44fcommittedremove unused imports
Show description for 0ce144dcommitted- committed
working version
Show description for 8c5cc77committedadopy _wait_until_command_done
Show description for 7f5c715committedintroduce metadata commands
Show description for 9ef5fadcommitteduse new backend structure
Show description for 44183dbcommittedconstrain backend diff
Show description for d59b351committedremove changes to filters
Show description for 1edc80acommittedmake _parse methods in models internal
Show description for f82658acommittedreduce changes in unit tests
Show description for 54eb0a4committed
Commits on Jun 24, 2025
run small queries with SEA during integration tests
Show description for 50cc1e2committedrun some tests for sea
Show description for 242307acommittedmove docstring of DatabricksClient within class
Show description for 1e21434committedmove ThriftResultSet import to top of file
Show description for cd4015bcommittedmake backend/utils __init__ file empty
Show description for ed8b610committeduse from __future__ import annotations to remove string literals around Cursor
Show description for 94d951ecommitteduse lazy logging
Show description for c20058ecommittedreplace getters with property tag
Show description for fe3acb1committed- committed
set active_command_id to None, not active_op_handle
Show description for 61dfc4dcommittedalign test_session with pytest instead of unittest
Show description for 64fb9b2committed
Commits on Jun 25, 2025
allow empty schema bytes for alignment with SEA
Show description for 8a138e8committedpass is_vl_op to Sea backend ExecuteResponse
Show description for 82f9d6bcommitted
Commits on Jun 26, 2025
remove catalog requirement in get_tables
Show description for 35f1ef0committedmove filters.py to SEA utils
Show description for a515d26committedensure SeaResultSet
Show description for 59b1330committed- committed
remove duplicate test, correct active_command_id attribute
Show description for 59b4825committed- committed
prevent circular imports
Show description for dd40bebcommittedremove unused imports
Show description for 14057accommittedremove cast, throw error if not SeaResultSet
Show description for a4d5bdbcommitted- committed
pass param as TSparkParameterValue
Show description for eb1a9b4committed- committed
remove failing test (temp)
Show description for a3ca7c7committedremove SeaResultSet type assertion
Show description for 2c22010committedchange errors to align with spec, instead of arbitrary ValueError
Show description for c09508ecommittedmake SEA backend methods return SeaResultSet
Show description for e9b1314committeduse spec-aligned Exceptions in SEA backend
Show description for 8ede414committedremove defensive row type check
Show description for 09a1b11committedSeaDatabricksClient: Add Metadata Commands (#593)
Show description for e380654andauthoredSEA volume operations fix: assign `manifest.is_volume_operation` to `is_staging_operation` in `ExecuteResponse` (#610)
Show description for 677a7b0authored- committed
- committed
raise ProgrammingError for invalid id
Show description for a026d31committedmake is_volume_operation strict bool
Show description for 4446a9ecommittedremove complex types code
Show description for 138359dcommittedRevert "remove complex types code"
Show description for b99d0c4committed
Commits on Jun 27, 2025
introduce type conversion for primitive types for JSON + INLINE
Show description for 21c389dcommitted- committed
remove SEA running on metadata queries (known failures
Show description for 9f0f969committedremove un-necessary docstrings
Show description for 04a1936committedpreliminary (robust) SEA HTTP Client
Show description for 11bc165committedprevent catching of MaxRetryError and HttpError in client
Show description for d389316committedformatting (black)
Show description for cc48cafcommittedfix type annotations
Show description for 6a1274fcommittedalign expected types with databricks sdk
Show description for 278b8cdcommittedlink rest api reference to validate types
Show description for 91b7f7fcommittedremove test_catalogs_returns_arrow_table test
Show description for 7a5ae13committedfix fetchall_arrow and fetchmany_arrow
Show description for f1776f3committedremove thrift aligned test_cancel_during_execute from SEA tests
Show description for 6143331committedIntroduce manual SEA test scripts for Exec Phase (#589)
Show description for 45585d4authored- committed
remove un-necessary changes in example scripts
Show description for 5eaded4committedremove un-necessary chagnes in example scripts
Show description for eeed9a1committed_convert_json_table -> _create_json_table
Show description for f233886committedremove accidentally removed test
Show description for 68ac437committedremove new unit tests (to be re-added based on new arch)
Show description for 7fd0845committedremove changes in sea_result_set functionality (to be re-added)
Show description for ea7ff73committedintroduce more integration tests
Show description for 563da71committedremove SEA tests in parameterized queries
Show description for a018273committedremove partial parameter fix changes
Show description for c0e98f4committedremove un-necessary timestamp tests
Show description for 7343035committedslightly stronger typing of _convert_json_types
Show description for ec500b6committedstronger typing of json utility func s
Show description for 0b3e91dcommittedstronger typing of fetch*_json
Show description for 7664e44committedremove unused helper methods in SqlType
Show description for db7b8e5committedline breaks after multi line pydocs, remove excess logs
Show description for f75f2b5committedline breaks after multi line pydocs, reduce diff of redundant changes
Show description for e2d4ef5committedreduce diff of redundant changes
Show description for 21e3078committedmandate ResultData in SeaResultSet constructor
Show description for bb015e6committed- committed
remove complex type conversion
Show description for b3273c7committedcorrect fetch*_arrow
Show description for 38c2b88committed- committed
Commits on Jun 30, 2025
pass test_retry_exponential_backoff
Show description for 4651cd6committedprevent parsing empty response data (get test_retry_abort_non_recoverable_error to pass)
Show description for d67eb7bcommittedmore defensive parsing, allow more method types in urllib3
Show description for 2caf38dcommittedallow Any values in session_conf, cast to String as done in Thrift backend
Show description for 3e55dddcommittedaccount for max_redirects in SEA backend
Show description for 4afff39committed
Commits on Jul 1, 2025
return empty JsonQueue if no data
Show description for 01d49cdcommitted
Commits on Jul 2, 2025
do not preload content?
Show description for 3d8aa7fcommittedComplete Fetch Phase (for `INLINE` disposition and `JSON_ARRAY` format) (#594)
Show description for 70c7dc8authored
Commits on Jul 3, 2025
- committed
recover old sea tests
Show description for fa2359dcommittedmove queue and result set into SEA specific dir
Show description for c07f709committedpass ssl_options into CloudFetchQueue
Show description for 9e4ef2ecommittedreduce diff
Show description for b00c06ccommittedremove redundant conversion.py
Show description for 10f55f0committedfix type issues
Show description for cd119e9committedValueError not ProgrammingError
Show description for d79638bcommittedreduce diff
Show description for f84578acommittedintroduce SEA cloudfetch e2e tests
Show description for c621c0ccommittedallow empty cloudfetch result
Show description for 7958cd9committedadd unit tests for CloudFetchQueue and SeaResultSet
Show description for e2d17ffcommittedskip pyarrow dependent tests
Show description for d348b35committed- committed
- committed
- committed
Commits on Jul 4, 2025
simplify download process: no pre-fetching
Show description for 4bd290ecommittedcorrect class name in logs
Show description for dfbbf79committed
Commits on Jul 7, 2025
- committed
Introduce `row_limit` param (#607)
Show description for 4f11ff0authored- committed
add sea tag on large queries
Show description for 51aa9becommittedalign with old impl
Show description for a5e9cdfcommittedalign next_n_rows with prev imple
Show description for be16634committedalign remaining_rows with prev impl
Show description for 6ec8656committedremove un-necessary Optional params
Show description for 7ea7b75committedremove un-necessary changes in thrift field if tests
Show description for 64be07bcommittedremove unused imports
Show description for 165644ccommitted- committed
simplify error handling
Show description for 461e762committed
Commits on Jul 8, 2025
stop mypy complaints
Show description for fd1e6cfcommittedrun large queries
Show description for abef941committedrun retry tests
Show description for 15378decommitted- committed
Commits on Jul 10, 2025
- committed
formatting (black)
Show description for 2c9368acommittedremove repetition from Session.__init__
Show description for 9b1b1f5committed
Commits on Jul 11, 2025
move link fetching immediately before table creation so link expiry is not an issue
Show description for fce324bcommitted- committed
fix merge artifacts
Show description for 3bd3aefcommittedcorrect patch paths
Show description for 6d4701fcommitted- committed
formatting (black)
Show description for b2d1579committedfix types
Show description for 077a71ccommittedfix param type in unit tests
Show description for 7985639committed
Commits on Jul 14, 2025
fix type issues
Show description for dc1cb6dcommitted- committed
correct param extraction
Show description for 0a0643bcommittedremove common constructor for databricks client abc
Show description for f7fd1d9committedmake SEA Http Client instance a private member
Show description for 510b0a3committedmake GetChunksResponse model more robust
Show description for dd2864bcommittedadd link to doc of GetChunk response model
Show description for c32b281committedpass result_data instead of "initial links" into SeaCloudFetchQueue
Show description for 0b1eba5committedmove download_manager init into parent CloudFetchQueue
Show description for 777f7c1committedraise ServerOperationError for no 0th chunk
Show description for 130b0d3committedunused iports
Show description for 1920375committed
Commits on Jul 15, 2025
- committed
explicitly close result queue
Show description for 922c448committed- committed
- committed
simplify HTTP client using requests.session
Show description for 25596e7committedexplicitly close response object
Show description for 2124fe0committedformatting (black)
Show description for 404aadfcommittedremove excess changes
Show description for 01c9b95committedreturn None in case of empty respose
Show description for 5a43686committedensure table is empty on no initial link s
Show description for 28c6bb1committed- committed
Commits on Jul 16, 2025
Complete Fetch Phase (`EXTERNAL_LINKS` disposition and `ARROW` format) (#598)
Show description for 1a0575aandauthoredSEA Session Configuration Fix: Explicitly convert values to `str` (#620)
Show description for c07beb1authored- committed
Revert "explicitly close response object"
Show description for 36daee6committedRevert "simplify HTTP client using requests.session"
Show description for b3fb5facommitted
Commits on Jul 17, 2025
pass error as 4th arg, not 3rd
Show description for 7143effcommittedadd warning for legacy behaviour
Show description for e3528a1committedsimplify error handling (attempt)
Show description for 112958dcommittedcleaner HTTP client using requests.sessions
Show description for b7a4677committedSEA: add support for `Hybrid` disposition (#631)
Show description for 640cc82authoredRevert "cleaner HTTP client using requests.sessions"
Show description for 3b8e1adcommittedclean up response (implicitly by using with)
Show description for c227739committed
Commits on Jul 19, 2025
improve docstrings, remove redundant comments and imports
Show description for a0aa023committedunit tests for imp methods
Show description for ef9283bcommittedSEA: Reduce network calls for synchronous commands (#633)
Show description for 8fbca9dauthored- committed
Commits on Jul 21, 2025
SEA: Decouple Link Fetching (#632)
Show description for 806e5f5authoredChunk download latency (#634)
Show description for b57c3f3authoredacquire lock before notif + formatting (black)
Show description for ef5836bcommitted
Commits on Jul 23, 2025
- committed
fix imports
Show description for 26f8947committedadd get_chunk_link s
Show description for 2d44596committedsimplify description extraction
Show description for 99e7435committedpass session_id_hex to ThriftResultSet
Show description for 54ec080committedrevert to main's extract description
Show description for f9f9f31committedvalidate row count for sync query tests as well
Show description for 51cef2bcommittedguid_hex -> hex_guid
Show description for 387102dcommittedreduce diff
Show description for d53d1eacommittedreduce diff
Show description for c7810aacommittedreduce diff
Show description for b3072bdcommittedset .value in compression
Show description for 8be5264committedreduce diff
Show description for 80692e3committed- committed
formatting (black)
Show description for 5a13925committedremove redundant test
Show description for 92ba484committedmove extra_params to the back
Show description for 2d451b6committed
Commits on Jul 24, 2025
Commits on Jul 25, 2025
is_direct_results -> has_more_rows
Show description for 0e87374committedRevert "is_direct_results -> has_more_rows"
Show description for 20c705fcommitted
Commits on Jul 28, 2025
- committed
stop passing session_id_hex
Show description for f277b07committedremove redundant comment
Show description for e58b6b5committedadd extra_params param
Show description for 9e086afcommittedpass extra_params into test_...unset...
Show description for 9cfa350committedremove excess session_id_he
Show description for 878a845committed
Commits on Jul 31, 2025
reduce changes in DatabricksRetryPolicy
Show description for 071ad4ecommittedreduce diff in DatabricksRetryPolicy
Show description for de339c0committedsimple comments on proxy setting
Show description for 2edff78committedlink docs for getproxies)(
Show description for 6c5b37fcommitted
Commits on Aug 4, 2025
- committed
rename proxy specific attrs with proxy prefix
Show description for dba08cdcommitted