Re: [Isis-fish-devel] last night's problem with isis-fish
Le 29/01/2014 10:33, Tina ODAKA a écrit :
2. or put more memory space for the simulation, and stop the java option to use disk.
For isis simulations, we are using a memory mapped file [1] to store results into memory (but with real backend storage on file system).
What you can do is, if isisfish can chose directory to use on caparmor, chose /home/trash/Users/5_days_max/lgasche We could try to modify configuration to point to that directory or simlink simulation directory to that directory. then, also use option not to use real backend storage on file system, then submit job with -q parallel8 -l select=1:ncpus=8 so that we can check how much memory in total it will use; We can't do that anymore with isis fish (this is not a configurable options).
Can you confirm that memory mapped file is counted into global jobs memory ? If so, since it's not real RAM memory, if there a way for caparmor to exclude memory mapped file from total count ? Is it a problem to use memory mapped file on caparmor ? Thanks in advance. -- Éric Chatellier - www.codelutin.com - 02.40.50.29.28
Le 29/01/2014 12:29, Eric Chatellier a écrit :
Le 29/01/2014 10:33, Tina ODAKA a écrit :
2. or put more memory space for the simulation, and stop the java option to use disk.
For isis simulations, we are using a memory mapped file [1] to store results into memory (but with real backend storage on file system).
What you can do is, if isisfish can chose directory to use on caparmor, chose /home/trash/Users/5_days_max/lgasche We could try to modify configuration to point to that directory or simlink simulation directory to that directory. then, also use option not to use real backend storage on file system, then submit job with -q parallel8 -l select=1:ncpus=8 so that we can check how much memory in total it will use; We can't do that anymore with isis fish (this is not a configurable options).
=> i do not understand why you say it can not do that, beggning of Jan, thats what loic did with his simulation.
Can you confirm that memory mapped file is counted into global jobs memory ?
if it is using ram, it is counted as memory, if you use disk, it is not counted as memory. it depends how your java code is programmed that which par is using memory. What i am asking you to test is to use max memory, and do not use disk. tina
If so, since it's not real RAM memory, if there a way for caparmor to exclude memory mapped file from total count ? Is it a problem to use memory mapped file on caparmor ?
Thanks in advance.
-- =================================================== Tina Odaka RIC - IDM - IMN - IFREMER Pôle de Calcul Intensif pour la Mer (PCIM) Tel: +33 (0)2 98 22 41 85 Fax: +33 (0)2 98 22 45 46 email: Tina.Odaka@ifremer.fr http://www.ifremer.fr/pcim ==================================================
participants (2)
-
Eric Chatellier -
Tina ODAKA