Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Appearance settings

Comments

Close side panel

Use a job pool for analysis tutorial#5489

Merged
ktf merged 3 commits intoAliceO2Group:devAliceO2Group/AliceO2:devfrom
ktf:feat-job-pool-analysisktf/AliceO2:feat-job-pool-analysisCopy head branch name to clipboard
Feb 18, 2021
Merged

Use a job pool for analysis tutorial#5489
ktf merged 3 commits intoAliceO2Group:devAliceO2Group/AliceO2:devfrom
ktf:feat-job-pool-analysisktf/AliceO2:feat-job-pool-analysisCopy head branch name to clipboard

Conversation

@ktf
Copy link
Member

@ktf ktf commented Feb 17, 2021

Defaults to 4 parallel jobs. Can be modified via:

cmake -DANALYSIS_JOB_POOL= ...

Defaults to 4 parallel jobs. Can be modified via:

cmake -DANALYSIS_JOB_POOL=<N> ...
@ktf ktf requested review from a team, iarsene and jgrosseo as code owners February 17, 2021 09:01
@ktf
Copy link
Member Author

ktf commented Feb 18, 2021

One job at the time is far from ideal, but at least seems to cure the issue.

@ktf ktf merged commit 2e2f5b7 into AliceO2Group:dev Feb 18, 2021
@ktf ktf deleted the feat-job-pool-analysis branch February 18, 2021 01:15
@davidrohr
Copy link
Collaborator

What is this needed for? It roughly quadrupples my O2 build time.
(This is realted to each of the analysis tutorial files whose build is serialized taking 20 - 40 seconds, which is kind of an issue by itsef (see https://alice.its.cern.ch/jira/browse/O2-2094))

@ktf
Copy link
Member Author

ktf commented Mar 5, 2021

To make sure we do not compile too many analysis jobs at the same time. It should apply to only 10 files, though. Is that really an issue?

@davidrohr
Copy link
Collaborator

Well, there are 32 files compiled with the job pool. When each takes ~30 seconds, you do the math.

@ktf
Copy link
Member Author

ktf commented Mar 6, 2021

I changed it to two in #5645. Let's see how that goes.

EmilGorm pushed a commit to EmilGorm/AliceO2 that referenced this pull request Nov 22, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

Morty Proxy This is a proxified and sanitized view of the page, visit original site.