Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Appearance settings

Massive performance regression in DomCrawler v6 #48950

Copy link
Copy link
Closed
@Bilge

Description

@Bilge
Issue body actions

Symfony version(s) affected

6.2.3

Description

The performance of the v6 DomCrawler component is somewhere in the region of 10x slower than that of v5, to do exactly the same work. I process in order of hundreds of thousands of pages per day so a 1000% slow-down is very obvious and also completely impractical (what should take 1 hour now takes 10). If I discovered DomCrawler today I would simply dismiss it as unfit for purpose, but since I've been using it for many years, I am aware simply downgrading to v5 will "fix" the issue.

How to reproduce

Compare v5 to v6 performance for high volume page parsing. In case you want to use exactly the same parser I do, see: https://github.com/Provider/Steam/blob/master/src/Scrape/AppDetailsParser.php

Possible Solution

No response

Additional Context

No response

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions

      Morty Proxy This is a proxified and sanitized view of the page, visit original site.