Skip to content

Conversation

@ktf
Copy link
Member

@ktf ktf commented Jan 19, 2026

Breaks the build due to very heavy memory usage otherwise.

@github-actions
Copy link

github-actions bot commented Jan 19, 2026

O2 linter results: ❌ 2 errors, ⚠️ 0 warnings, 🔕 0 disabled

@github-actions github-actions bot changed the title Constrain PWGJE to only one compilation thread [Infrastructure,PWGJE] Constrain PWGJE to only one compilation thread Jan 19, 2026
@ktf
Copy link
Member Author

ktf commented Jan 19, 2026

@vkucera this is along the lines of what you were proposing, IIRC. Do you have better information on which compilation unit takes a lot of memory?

@vkucera
Copy link
Collaborator

vkucera commented Jan 19, 2026

@vkucera this is along the lines of what you were proposing, IIRC. Do you have better information on which compilation unit takes a lot of memory?

Hi @ktf , yes, I can provide a full list of targets and their memory consumption.
In PWGJE, these are the targets consuming more than 5 GiB on Linux (measured on 2 Dec):

Target Memory [GiB]
PWGJE/TableProducer/CMakeFiles/O2Physicsexe-analysis-je-jet-deriveddata-writer.dir/derivedDataWriter.cxx.o 9.1
PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-jet-substructure-ds-output.dir/jetSubstructureDsOutput.cxx.o 6.7
PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-jet-substructure-d0-output.dir/jetSubstructureD0Output.cxx.o 6.7
PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-jet-substructure-b0-output.dir/jetSubstructureB0Output.cxx.o 6.7
PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-jet-substructure-lc-output.dir/jetSubstructureLcOutput.cxx.o 6.6
PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-jet-substructure-dstar-output.dir/jetSubstructureDstarOutput.cxx.o 6.5
PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-jet-substructure-dielectron-output.dir/jetSubstructureDielectronOutput.cxx.o 6.5
PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-jet-substructure-dplus-output.dir/jetSubstructureDplusOutput.cxx.o 6.4
PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-jet-substructure-xictoxipipi-output.dir/jetSubstructureXicToXiPiPiOutput.cxx.o 6.3
PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-jet-substructure-bplus-output.dir/jetSubstructureBplusOutput.cxx.o 6.3
PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-jet-finder-bplus-qa.dir/jetFinderBplusQA.cxx.o 6.2
PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-jet-finder-dplus-qa.dir/jetFinderDplusQA.cxx.o 6.1
PWGJE/TableProducer/CMakeFiles/O2Physicsexe-analysis-je-subtractor-eventwiseconstituent.dir/eventwiseConstituentSubtractor.cxx.o 6.1
PWGJE/TableProducer/CMakeFiles/O2Physicsexe-analysis-je-jet-deriveddata-producer.dir/derivedDataProducer.cxx.o 6.1
PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-jet-finder-xictoxipipi-qa.dir/jetFinderXicToXiPiPiQA.cxx.o 5.9
PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-jet-finder-b0-qa.dir/jetFinderB0QA.cxx.o 5.9
PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-nuclei-in-jets.dir/nucleiInJets.cxx.o 5.8
PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-jet-finder-lc-qa.dir/jetFinderLcQA.cxx.o 5.8
PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-jet-finder-dstar-qa.dir/jetFinderDstarQA.cxx.o 5.8
PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-jet-finder-ds-qa.dir/jetFinderDsQA.cxx.o 5.8
PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-jet-finder-dielectron-qa.dir/jetFinderDielectronQA.cxx.o 5.8
PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-jet-taggerhf-qa.dir/jetTaggerHFQA.cxx.o 5.7
PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-jet-fragmentation.dir/jetFragmentation.cxx.o 5.7
PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-jet-finder-d0-qa.dir/jetFinderD0QA.cxx.o 5.7
PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-jet-v0qa.dir/v0QA.cxx.o 5.6
PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-jet-finder-full-qa.dir/jetFinderFullQA.cxx.o 5.5
PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-jet-finder-charged-qa.dir/jetFinderQA.cxx.o 5.5
PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-jet-spectra-charged.dir/jetSpectraCharged.cxx.o 5.4
PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-full-jet-spectra.dir/fullJetSpectra.cxx.o 5.4
PWGJE/TableProducer/CMakeFiles/O2Physicsexe-analysis-je-estimator-rho.dir/rhoEstimator.cxx.o 5.4
PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-jet-substructure-output.dir/jetSubstructureOutput.cxx.o 5.3
PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-bjet-tree-creator.dir/bjetTreeCreator.cxx.o 5.2
PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-recoil-jets.dir/recoilJets.cxx.o 5.1
PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-jet-substructure-dielectron.dir/jetSubstructureDielectron.cxx.o 5.1
PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-jet-hadron-recoil.dir/jetHadronRecoil.cxx.o 5.1
PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-phi-in-jets.dir/phiInJets.cxx.o 5.0
PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-jet-substructure-b0.dir/jetSubstructureB0.cxx.o 5.0

@ktf
Copy link
Member Author

ktf commented Jan 19, 2026

Thanks, could you please amend this PR to include only those?

@ktf
Copy link
Member Author

ktf commented Jan 19, 2026

Or maybe I simply do it, it should not take long.

Breaks the build due to very heavy memory usage otherwise.
@ktf ktf force-pushed the constrain-pwgje branch from fb28ec5 to c478bde Compare January 19, 2026 11:48
@vkucera
Copy link
Collaborator

vkucera commented Jan 19, 2026

Thanks @ktf , can you also add the other 3 table producers from the list?

PWGJE/TableProducer/CMakeFiles/O2Physicsexe-analysis-je-subtractor-eventwiseconstituent.dir/eventwiseConstituentSubtractor.cxx.o
PWGJE/TableProducer/CMakeFiles/O2Physicsexe-analysis-je-jet-deriveddata-producer.dir/derivedDataProducer.cxx.o
PWGJE/TableProducer/CMakeFiles/O2Physicsexe-analysis-je-estimator-rho.dir/rhoEstimator.cxx.o

@vkucera
Copy link
Collaborator

vkucera commented Jan 20, 2026

@ktf It would be useful to provide info on how the ANALYSIS_COMPILE_POOL, HIGH_MEMORY_COMPILE_POOL values can be configured.
Users with more powerful machines will probably want to enable more jobs per pool.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Development

Successfully merging this pull request may close these issues.

2 participants