Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly
Appearance settings
Discussion options

qmb874248n-code
Feb 8, 2026

Hi, I’m exploring Crawlee (Python + Playwright) for a personal automation project.

I’m particularly interested in:

  • Monitoring category or listing pages where product URLs are not known in advance
  • Detecting newly appearing items in near real time
  • Triggering a follow-up automation flow once a new item is detected

Before I go deeper, I wanted to ask:
Is Crawlee commonly used for this kind of real-time listing detection workflow, and are there any recommended patterns or examples for handling this cleanly?

Thanks in advance — the project looks very solid.
You must be logged in to vote

Replies: 1 comment

Comment options

janbuchar
Feb 9, 2026
Maintainer

Hello and thank you for your interest in Crawlee! On its own, Crawlee is better suited for batch-style jobs, where you start the crawler, it goes through a website and terminates. Then you can export the results, re-run the crawl and check for changes.

In other words, there is no built-in infrastructure for this in Crawlee, but you can totally build it on top of Crawlee.
You must be logged in to vote
0 replies
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
🙏
Q&A
Labels
t-tooling Issues with this label are in the ownership of the tooling team.
2 participants
@qmb874248n-code @janbuchar
Converted from issue

This discussion was converted from issue #1720 on February 09, 2026 14:40.

Morty Proxy This is a proxified and sanitized view of the page, visit original site.