Welcome to the forums. Please post in English or French.

You are not logged in.

#51 2019-10-09 21:21:31

tianyikillua
Member
From: Paris
Registered: 2017-11-06
Posts: 69

Re: Code_Aster inside a Docker container available for everyone

ok, now the 14.4 version (sequential and parallel) is also available as a Docker image, see the github page.

quay.io/tianyikillua/code_aster

Some issues with petsc

Also case tests are to be re-run. If someone could report on github it would be useful.

The old 13.6 version is available as quay.io/tianyikillua/code_aster:v13

Last edited by tianyikillua (2019-10-10 17:16:57)

Offline

#52 2020-03-03 15:42:40

mvanwaveren
Member
Registered: 2019-03-26
Posts: 4

Re: Code_Aster inside a Docker container available for everyone

You mention:

14.4 version (sequential and parallel)

Is the parallel version an MPI or an OpenMP version?

Offline

#53 2020-03-07 11:36:59

tianyikillua
Member
From: Paris
Registered: 2017-11-06
Posts: 69

Re: Code_Aster inside a Docker container available for everyone

mpi + openmp

Offline

#54 2020-05-06 11:46:07

mf
Member
Registered: 2019-06-18
Posts: 204

Re: Code_Aster inside a Docker container available for everyone

Dear Tianyi,

first of all, thank you for this, this is really great stuff. I tried to compile the parallel version and did not succeed (I finally gave up, none of the online tutorials is 100% correct), so this is a way out for all users who are not software engineers to use the MPI version. Under Linux it seems to be VERY fast.

However, I have one question: can I use this docker on more than one node (nodes are connected via Infiniband)? Or are there modifications to the docker necessary? I cannot test this at the moment, thus my question. There is also something called 'docker swarm' could this be a possibility to run it on more than one node? As you have guessed, I am not a software engineer, so these might be dumb questions....

Thank you anyway,

Mario.

Offline

#55 2020-07-07 01:16:40

llionevans
Member
Registered: 2018-07-27
Posts: 6

Re: Code_Aster inside a Docker container available for everyone

mf wrote:

Dear Tianyi,

first of all, thank you for this, this is really great stuff. I tried to compile the parallel version and did not succeed (I finally gave up, none of the online tutorials is 100% correct), so this is a way out for all users who are not software engineers to use the MPI version. Under Linux it seems to be VERY fast.

However, I have one question: can I use this docker on more than one node (nodes are connected via Infiniband)? Or are there modifications to the docker necessary? I cannot test this at the moment, thus my question. There is also something called 'docker swarm' could this be a possibility to run it on more than one node? As you have guessed, I am not a software engineer, so these might be dumb questions....

Thank you anyway,

Mario.

One of the things we're looking at is using this with singularity instead of docker (but we're still having issues building the container). The reason for this is that singularity should be more appropriate for HPC vs docker.

Once we've been able to build the container we will test and report back on our results.

Offline

#56 2021-02-11 18:42:40

alealbanesi
Member
Registered: 2021-02-11
Posts: 11

Re: Code_Aster inside a Docker container available for everyone

Hi,

I'm trying to run cases in parallel, and I would like to ask for the correct configuration of "mpi_nbcpu" and "ncpus" variables for a multi-core CPU with one socket. I have an CPU with the I7-8700K, it has 6 cores with 2 threads per core (12 threads total) on one socket

I've successfully installed docker following tianyikillua instructions in GitHUB, all tests run Ok in parallel or sequential mode.

I've been doing some tests with some cases that need approximately 8 hours to compute on a single core using MUMPS. So far, the best configuration tested has "mpi_nbcpu = 3" and "ncpus = 2", and total computational time is 6 hours approximately with MUMPS.

Does anyone have other thoughts about this? Perhaps the limit is the single socket?

Thank you in advance,

Alejandro

Offline

#57 2021-02-11 20:12:06

mf
Member
Registered: 2019-06-18
Posts: 204

Re: Code_Aster inside a Docker container available for everyone

Hello,

you are right, this does not seem to be a huge gain. From my experience, your numbers are good for this CPU (mpi_nbcpu=3/ ncpus=2). Turning Hyperthreading off also helps (your tasks do not get interrupted so often by other tasks if HT=off). It also depends on the problem itself. I am not sure now, but I think I had a thermal only calculation once, where the benefit though MPI was also very low. From my experience with larger problems (5-6 M DOFs), doubling the number of cores makes it ~1.5 times faster (but uses more RAM overall). If the problem is too small in DOFs, the benefit will also be smaller. Other factors may be, but I don't  think it will help much, unless your problem is really big on more than one CPU:

-) MATR_DISTRIBUEE='OUI' in STAT_NON_LINE
-) DISTRIBUTION=_F(METHODE='SOUS_DOMAINE',
                             PARTITIONNEUR='METIS'),
    or similar in AFFE_MODELE.

Take care that your calculation does not run OUT_OF_CORE, it will be very slow then (insufficient RAM).

h ttps://www.code-aster.org/doc/default/en/man_u/u2/u2.08.06.pdf

Mario.

Last edited by mf (2021-02-11 20:17:51)

Offline

#58 2021-02-11 20:30:24

alealbanesi
Member
Registered: 2021-02-11
Posts: 11

Re: Code_Aster inside a Docker container available for everyone

Great Mario, thank you for your reply.

I will try those options in AFFE_MODELE, and see what happens.

Kind regards,

Alejandro

Offline

#59 2021-02-12 14:35:20

mf
Member
Registered: 2019-06-18
Posts: 204

Re: Code_Aster inside a Docker container available for everyone

Hello again,

something else just came to my mind: if your CPU is strongly affected by the Spectre and Meltdown mitigations and security is not an issue (perhaps you are behind a strong and up-to-date firewall) you may think about turning these mitigations OFF. It may also boost your performance a bit (depends on CPU though, some tasks are 10-50% slower with mitigations ON). This is especially easy under Linux, with Windows I do not know how to turn these off.

Mario.

Offline

#60 2021-02-25 21:06:08

alealbanesi
Member
Registered: 2021-02-11
Posts: 11

Re: Code_Aster inside a Docker container available for everyone

Thanks for the help Mario. Things are working ok now. I had a mechanical problem that needed 3 hours and 8 minutes for the solution when running on a single core of my CPU.

In parallel, things are much better:

* When using docker, and configuring (mpi_nbcpu=3/ ncpus=2), 57 minutes are needed for the solution.

* When using docker, configuring (mpi_nbcpu=3/ ncpus=2), and following your advice on (MATR_DISTRIBUEE='OUI' in STAT_NON_LINE) and (PARTITIONNEUR='METIS' in AFFE_MODELE.), 47 minutes are needed for the solution.

In my opinion, the scalability level in this parallel problem is great.  Of course, the "mpi_nbcpu" and "ncpus" parameters depend on the CPU type. Cheers,

Alejandro

Offline

#61 2021-04-09 14:25:39

abbas
Member
Registered: 2021-02-10
Posts: 14

Re: Code_Aster inside a Docker container available for everyone

tianyikillua wrote:

Could you please remove the left and right brackets?

docker run -ti --rm -e DISPLAY=192.168.44.176:0 -v %cd%:/home/aster/shared -w /home/aster/shared quay.io/tianyikillua/code_aster

Great work Tianyi!

I have the same problem when running astk. I am running ubuntu 20 and I'm using wired connection. I tried different IPs but cannot get the visual astk running. I get the error

application-specific initialization failed: couldn't connect to display "my ip address:0"
Error in startup script: invalid command name "wm"
    while executing
"wm withdraw ."

if I export the DISPLAY to an IP like praful's case (192.168.44.176), astk commands runs without error But no astk window is shown (see attached)


Attachments:
Screenshot from 2021-04-09 09-19-58.png, Size: 133.21 KiB, Downloads: 35

Offline

#62 2021-05-03 09:12:33

mf
Member
Registered: 2019-06-18
Posts: 204

Re: Code_Aster inside a Docker container available for everyone

Dear Tianyi!

I don't like to pose that question, but what are there any plans of updating your Docker with the upcoming stable 15.2 (?) version of Code Aster?  :-) What are the chances? :-)

Don't get me wrong, in the meantime I managed to compile and build 14.6 with MPI and PETSC, but I only now understand how difficult creating a Docker Container is in reality. So, I gave up on building a Docker in the meantime.

Mario.

Last edited by mf (2021-05-03 13:04:06)

Offline

#63 2021-05-06 21:16:23

AsterO'dactyle
Administrator
Registered: 2007-11-29
Posts: 375

Re: Code_Aster inside a Docker container available for everyone


Code_Asterの開発者

Offline

#64 2021-05-07 07:02:12

mf
Member
Registered: 2019-06-18
Posts: 204

Re: Code_Aster inside a Docker container available for everyone

Dear AsterO'dactyle,

I know about that, I participated a little bit (testing). It is still SalomeMeca, but I know that plans for a CA-MPI version in a singularity-containers are on the horizon. What I do not know is, how far they are. Though SM runs flawlessly in singularity,

Mario.

Offline