Akshaya/mocking improvements #656
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
c31d415 to
fb0ca4d
Compare
There was a problem hiding this comment.
Pull Request Overview
This PR implements mocking improvements by standardizing error handling, adding model selection capabilities, and preparing for example call usage in LLM mocking. The changes introduce custom exception types to replace generic NotImplementedError exceptions and add support for configurable model parameters and example calls in the mocking framework.
- Standardized error handling with custom UiPath exception types for mocking scenarios
- Added model parameter configuration support for LLM mocking with temperature, top_p, top_k, etc.
- Introduced example call functionality to provide context for LLM-based mocking
Reviewed Changes
Copilot reviewed 12 out of 13 changed files in this pull request and generated 2 comments.
Show a summary per file
| File | Description |
|---|---|
| src/uipath/_cli/_evals/mocks/mocker.py | Defines new exception types for mocking error scenarios |
| src/uipath/_cli/_evals/mocks/mocks.py | Updates exception handling and adds example call support to mockable decorator |
| src/uipath/_cli/_evals/mocks/mockito_mocker.py | Implements proper error handling with new exception types |
| src/uipath/_cli/_evals/mocks/llm_mocker.py | Adds model parameter support and example call integration |
| src/uipath/_cli/_evals/_models/_evaluation_set.py | Adds ModelSettings for configurable LLM parameters |
| src/uipath/_services/llm_gateway_service.py | Adds top_k parameter support to chat completions |
| src/uipath/agent/models/agent.py | Introduces BaseResourceProperties with example calls |
| tests/cli/eval/mocks/test_mocks.py | Updates tests to use new exception types |
| samples/calculator/main.py | Demonstrates example call usage in mockable decorator |
| samples/calculator/evals/eval-sets/default.json | Shows model configuration in evaluation set |
Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.
fb0ca4d to
2dc9e0a
Compare
radu-mocanu
reviewed
Oct 8, 2025
radu-mocanu
reviewed
Oct 8, 2025
2dc9e0a to
47c0b3c
Compare
47c0b3c to
2b3f61e
Compare
radu-mocanu
approved these changes
Oct 9, 2025
2b3f61e to
da60163
Compare
1. Standardization of errors 1. `UiPathMockResponseGenerationError` to represent errors during generation of mocked response. 2. `UiPathNoMockFoundError` to represent that the method should not be mocked. 2. Model selection 3. Allow run examples in LLM Mocker. # Conflicts: # pyproject.toml
da60163 to
ff2c05d
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
UiPathMockResponseGenerationErrorto represent errors during generation of mocked response.UiPathNoMockFoundErrorto represent that the method should not be mocked.Development Package