Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Appearance settings

Conversation

nirinchev
Copy link
Collaborator

Proposed changes

This adds the ability to create a vector search index to the create-index tool. It is still WIP, but putting it here so that we can run accuracy tests.

Checklist

  • Integration tests for vector search indexes
  • Accuracy tests

Copy link
Contributor

github-actions bot commented Oct 7, 2025

📊 Accuracy Test Results

📈 Summary

Metric Value
Commit SHA d52d9957053cc2ae0f59eed7e2a57cb8fdf4763e
Run ID f099752f-8877-429b-8369-35603ceb8914
Status done
Total Prompts Evaluated 61
Models Tested 1
Average Accuracy 96.7%
Responses with 0% Accuracy 1
Responses with 75% Accuracy 4
Responses with 100% Accuracy 56

📊 Baseline Comparison

Metric Value
Baseline Commit f384834ee558a0a9c79c0105194b0f6dcdc12fe4
Baseline Run ID 0cb61b79-616f-4733-808f-b6bf54739dd6
Baseline Run Status done
Responses Improved 1
Responses Regressed 2

📎 Download Full HTML Report - Look for the accuracy-test-summary artifact for detailed results.

Report generated on: 10/7/2025, 12:29:08 PM

@coveralls
Copy link
Collaborator

coveralls commented Oct 8, 2025

Pull Request Test Coverage Report for Build 18482155309

Details

  • 116 of 119 (97.48%) changed or added relevant lines in 2 files are covered.
  • No unchanged relevant lines lost coverage.
  • Overall coverage increased (+0.2%) to 82.392%

Changes Missing Coverage Covered Lines Changed/Added Lines %
src/tools/tool.ts 9 10 90.0%
src/tools/mongodb/create/createIndex.ts 107 109 98.17%
Totals Coverage Status
Change from base Build 18478241913: 0.2%
Covered Lines: 5729
Relevant Lines: 6823

💛 - Coveralls

@nirinchev nirinchev force-pushed the ni/create-vector-index branch from 4113579 to 69aa6d0 Compare October 13, 2025 23:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

Morty Proxy This is a proxified and sanitized view of the page, visit original site.