Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Appearance settings

Conversation

Chadha93
Copy link
Collaborator

@Chadha93 Chadha93 commented Oct 13, 2025

ref: #1397 (comment)

tested OK:
image


Summary by cubic

Add sitemap fallback in /map for self-hosted setups when Fire Engine isn’t available, preventing empty results. If search finds nothing and sitemap=skip, we now try sitemap discovery and log the outcome.

  • Bug Fixes
    • Detect Fire Engine availability via FIRE_ENGINE_BETA_URL.
    • On empty search results with sitemap=skip, call crawler.tryGetSitemap with timeout/abort support.
    • Add debug logs for fallback start, success count, and failure.

Signed-off-by: Gaurav Chadha <gauravchadha1676@gmail.com>
Signed-off-by: Gaurav Chadha <gauravchadha1676@gmail.com>
@Chadha93 Chadha93 requested a review from micahstairs October 13, 2025 07:22
Copy link
Contributor

@cubic-dev-ai cubic-dev-ai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found across 1 file

@Chadha93
Copy link
Collaborator Author

This is just a workaround, not to display empty results, although a long-term permanent solution is to extend Fire-engine's capabilities.

@mogery
Copy link
Member

mogery commented Oct 13, 2025

Well, this is an issue on self-hosting only, no? Then a fix is to simply not use sitemap=skip, no?

@Chadha93
Copy link
Collaborator Author

Well, this is an issue on self-hosting only, no? Then a fix is to simply not use sitemap=skip, no?

Right only for self-host, I think, then I'll just update this thing in the docs, but won't we be adding support to sitemap=skip later?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

Morty Proxy This is a proxified and sanitized view of the page, visit original site.