ANDES prep under miniconda3 and miniforge3 are almost same in consuming time on Mac with M3 #589

jinningwang · 2025-01-24T19:48:55Z

jinningwang
Jan 24, 2025
Maintainer

Summary

Environment	Command	Consumed Time (seconds)
Miniconda3	`andes prep -f`	9.6762
Miniconda3	`andes prep -q`	1.3919
Miniforge3	`andes prep -f`	9.4711
Miniforge3	`andes prep -q`	1.3979
Mambaforge3	`andes prep -f`	9.7406
Mambaforge3	`andes prep -1`	1.5191

Note:

Mambaforge installation failed ERROR: executing pre_install.sh failed, with both Mambaforge-MacOSX-arm64.sh and Mambaforge-24.9.2-0-MacOSX-arm64.sh. I successfully installed Mambaforge using Mambaforge-24.3.0-0-MacOSX-arm64.sh
sympy versions are the same while numpy versions are different

Hardware:

(base) jinningwang@jwangMBP work % system_profiler SPHardwareDataType
Hardware:

    Hardware Overview:

      Model Name: MacBook Pro
      Model Identifier: Mac15,6
      Model Number: Z1AV001HXLL/A
      Chip: Apple M3 Pro
      Total Number of Cores: 12 (6 performance and 6 efficiency)
      Memory: 36 GB

Miniconda3

(ams) jinningwang@jwangMBP work % andes

    _           _         | Version 1.9.3
   /_\  _ _  __| |___ ___ | Python 3.10.0 on Darwin, 01/24/2025 02:20:49 PM
  / _ \| ' \/ _` / -_|_-< | 
 /_/ \_\_||_\__,_\___/__/ | This program comes with ABSOLUTELY NO WARRANTY.

usage: andes [-h] [-v {1,10,20,30,40}] {run,plot,doc,misc,prepare,prep,selftest,st,demo} ...

positional arguments:
  {run,plot,doc,misc,prepare,prep,selftest,st,demo}
                        [run] run simulation routine; [plot] plot results; [doc] quick documentation; [misc] misc. functions; [prepare] prepare the numerical code; [selftest] run self test;

options:
  -h, --help            show this help message and exit
  -v {1,10,20,30,40}, --verbose {1,10,20,30,40}
                        Verbosity level in 10-DEBUG, 20-INFO, 30-WARNING, or 40-ERROR.
(ams) jinningwang@jwangMBP work % andes misc --version
Python  3.10.0
andes   1.9.3
numpy   1.23.5
kvxopt  1.3.2.1
sympy   1.13.3
scipy   1.14.1
pandas  2.2.2
numba   0.56.3
(ams) jinningwang@jwangMBP work % andes prep -f

    _           _         | Version 1.9.3
   /_\  _ _  __| |___ ___ | Python 3.10.0 on Darwin, 01/24/2025 02:21:27 PM
  / _ \| ' \/ _` / -_|_-< | 
 /_/ \_\_||_\__,_\___/__/ | This program comes with ABSOLUTELY NO WARRANTY.

> Loaded config from file "/Users/jinningwang/.andes/andes.rc"
Numerical code generation (full mode) started...
Generating code for 97 models on 12 processes.
Saved generated pycode to "/Users/jinningwang/.andes/pycode"
> Loaded generated Python code in "/Users/jinningwang/.andes/pycode".
Generated numerical code for 97 models in 9.6762 seconds.
(ams) jinningwang@jwangMBP work % andes prep -q

    _           _         | Version 1.9.3
   /_\  _ _  __| |___ ___ | Python 3.10.0 on Darwin, 01/24/2025 02:22:02 PM
  / _ \| ' \/ _` / -_|_-< | 
 /_/ \_\_||_\__,_\___/__/ | This program comes with ABSOLUTELY NO WARRANTY.

> Loaded config from file "/Users/jinningwang/.andes/andes.rc"
Numerical code generation (quick mode) started...
Generating code for 97 models on 12 processes.
Saved generated pycode to "/Users/jinningwang/.andes/pycode"
> Loaded generated Python code in "/Users/jinningwang/.andes/pycode".
Generated numerical code for 97 models in 1.3919 seconds.

Miniforge3

(mforge) jinningwang@jwangMBP work % andes

    _           _         | Version 1.9.3
   /_\  _ _  __| |___ ___ | Python 3.10.0 on Darwin, 01/24/2025 02:32:43 PM
  / _ \| ' \/ _` / -_|_-< | 
 /_/ \_\_||_\__,_\___/__/ | This program comes with ABSOLUTELY NO WARRANTY.

usage: andes [-h] [-v {1,10,20,30,40}] {run,plot,doc,misc,prepare,prep,selftest,st,demo} ...

positional arguments:
  {run,plot,doc,misc,prepare,prep,selftest,st,demo}
                        [run] run simulation routine; [plot] plot results; [doc] quick documentation; [misc] misc. functions; [prepare] prepare the numerical code; [selftest] run self test;

options:
  -h, --help            show this help message and exit
  -v {1,10,20,30,40}, --verbose {1,10,20,30,40}
                        Verbosity level in 10-DEBUG, 20-INFO, 30-WARNING, or 40-ERROR.
(mforge) jinningwang@jwangMBP work % andes misc --version
Python  3.10.0
andes   1.9.3
numpy   2.0.2
kvxopt  1.3.2.1
sympy   1.13.3
scipy   1.15.1
pandas  2.2.3
numba   0.60.0
(mforge) jinningwang@jwangMBP work % andes prep -f

    _           _         | Version 1.9.3
   /_\  _ _  __| |___ ___ | Python 3.10.0 on Darwin, 01/24/2025 02:32:54 PM
  / _ \| ' \/ _` / -_|_-< | 
 /_/ \_\_||_\__,_\___/__/ | This program comes with ABSOLUTELY NO WARRANTY.

> Loaded config from file "/Users/jinningwang/.andes/andes.rc"
Numerical code generation (full mode) started...
Generating code for 97 models on 12 processes.
Saved generated pycode to "/Users/jinningwang/.andes/pycode"
> Loaded generated Python code in "/Users/jinningwang/.andes/pycode".
Generated numerical code for 97 models in 9.4711 seconds.
(mforge) jinningwang@jwangMBP work % andes prep -q

    _           _         | Version 1.9.3
   /_\  _ _  __| |___ ___ | Python 3.10.0 on Darwin, 01/24/2025 02:33:25 PM
  / _ \| ' \/ _` / -_|_-< | 
 /_/ \_\_||_\__,_\___/__/ | This program comes with ABSOLUTELY NO WARRANTY.

> Loaded config from file "/Users/jinningwang/.andes/andes.rc"
Numerical code generation (quick mode) started...
Generating code for 97 models on 12 processes.
Saved generated pycode to "/Users/jinningwang/.andes/pycode"
> Loaded generated Python code in "/Users/jinningwang/.andes/pycode".
Generated numerical code for 97 models in 1.3979 seconds.

Mambaforge

(mbaforge) jinningwang@jwangMBP work % andes               

    _           _         | Version 1.9.3
   /_\  _ _  __| |___ ___ | Python 3.10.0 on Darwin, 01/24/2025 03:47:08 PM
  / _ \| ' \/ _` / -_|_-< | 
 /_/ \_\_||_\__,_\___/__/ | This program comes with ABSOLUTELY NO WARRANTY.

usage: andes [-h] [-v {1,10,20,30,40}] {run,plot,doc,misc,prepare,prep,selftest,st,demo} ...

positional arguments:
  {run,plot,doc,misc,prepare,prep,selftest,st,demo}
                        [run] run simulation routine; [plot] plot results; [doc] quick documentation; [misc] misc. functions; [prepare] prepare the numerical code;
                        [selftest] run self test;

options:
  -h, --help            show this help message and exit
  -v {1,10,20,30,40}, --verbose {1,10,20,30,40}
                        Verbosity level in 10-DEBUG, 20-INFO, 30-WARNING, or 40-ERROR.
(mbaforge) jinningwang@jwangMBP work % andes misc --version
Python  3.10.0
andes   1.9.3
numpy   2.0.2
kvxopt  1.3.2.1
sympy   1.13.3
scipy   1.15.1
pandas  2.2.3
numba   0.60.0
(mbaforge) jinningwang@jwangMBP work % andes prep -f

    _           _         | Version 1.9.3
   /_\  _ _  __| |___ ___ | Python 3.10.0 on Darwin, 01/24/2025 03:47:28 PM
  / _ \| ' \/ _` / -_|_-< | 
 /_/ \_\_||_\__,_\___/__/ | This program comes with ABSOLUTELY NO WARRANTY.

> Loaded config from file "/Users/jinningwang/.andes/andes.rc"
Numerical code generation (full mode) started...
Generating code for 97 models on 12 processes.
Saved generated pycode to "/Users/jinningwang/.andes/pycode"
> Loaded generated Python code in "/Users/jinningwang/.andes/pycode".
Generated numerical code for 97 models in 9.7406 seconds.
(mbaforge) jinningwang@jwangMBP work % andes prep -q

    _           _         | Version 1.9.3
   /_\  _ _  __| |___ ___ | Python 3.10.0 on Darwin, 01/24/2025 03:47:47 PM
  / _ \| ' \/ _` / -_|_-< | 
 /_/ \_\_||_\__,_\___/__/ | This program comes with ABSOLUTELY NO WARRANTY.

> Loaded config from file "/Users/jinningwang/.andes/andes.rc"
Numerical code generation (quick mode) started...
Generating code for 97 models on 12 processes.
Saved generated pycode to "/Users/jinningwang/.andes/pycode"
> Loaded generated Python code in "/Users/jinningwang/.andes/pycode".
Generated numerical code for 97 models in 1.5191 seconds.

cuihantao · 2025-01-24T20:23:41Z

cuihantao
Jan 24, 2025
Maintainer

Thanks, Jinning!

ERROR: executing pre_install.sh failed, with both Mambaforge-MacOSX-arm64.sh and Mambaforge-24.9.2-0-MacOSX-arm64.sh

What does this impact?

1 reply

jinningwang Jan 24, 2025
Maintainer Author

It results in the failed installation of Mambaforge. I tried two different installers, but both failed.

jinningwang · 2025-01-24T20:31:05Z

jinningwang
Jan 24, 2025
Maintainer Author

Also, I noticed the following statement by conda-forge:

With the release of Miniforge3-23.3.1-0, that incorporated the changes in conda-forge/miniforge#277, the packages and configuration of Mambaforge and Miniforge3 are now identical.

https://github.com/conda-forge/miniforge

0 replies

jinningwang · 2025-01-24T20:33:56Z

jinningwang
Jan 24, 2025
Maintainer Author

Oh, there might be permission issues with pre_install.sh, let me try one more time.

0 replies

jinningwang · 2025-01-24T20:50:50Z

jinningwang
Jan 24, 2025
Maintainer Author

Finally, I installed Mambaforge using Mambaforge-24.3.0-0-MacOSX-arm64.sh, and I've added the results using Mambaforge.

0 replies

jinningwang · 2025-01-24T20:53:03Z

jinningwang
Jan 24, 2025
Maintainer Author

With Mambaforge, for andes prep -q, the average consumed time of 6 tests is 1.4225 seconds.

(mbaforge) jinningwang@jwangMBP work % andes prep -q

    _           _         | Version 1.9.3
   /_\  _ _  __| |___ ___ | Python 3.10.0 on Darwin, 01/24/2025 03:47:47 PM
  / _ \| ' \/ _` / -_|_-< | 
 /_/ \_\_||_\__,_\___/__/ | This program comes with ABSOLUTELY NO WARRANTY.

> Loaded config from file "/Users/jinningwang/.andes/andes.rc"
Numerical code generation (quick mode) started...
Generating code for 97 models on 12 processes.
Saved generated pycode to "/Users/jinningwang/.andes/pycode"
> Loaded generated Python code in "/Users/jinningwang/.andes/pycode".
Generated numerical code for 97 models in 1.5191 seconds.
(mbaforge) jinningwang@jwangMBP work % andes prep -q

    _           _         | Version 1.9.3
   /_\  _ _  __| |___ ___ | Python 3.10.0 on Darwin, 01/24/2025 03:51:00 PM
  / _ \| ' \/ _` / -_|_-< | 
 /_/ \_\_||_\__,_\___/__/ | This program comes with ABSOLUTELY NO WARRANTY.

> Loaded config from file "/Users/jinningwang/.andes/andes.rc"
Numerical code generation (quick mode) started...
Generating code for 97 models on 12 processes.
Saved generated pycode to "/Users/jinningwang/.andes/pycode"
> Loaded generated Python code in "/Users/jinningwang/.andes/pycode".
Generated numerical code for 97 models in 1.3926 seconds.
(mbaforge) jinningwang@jwangMBP work % andes prep -q

    _           _         | Version 1.9.3
   /_\  _ _  __| |___ ___ | Python 3.10.0 on Darwin, 01/24/2025 03:51:03 PM
  / _ \| ' \/ _` / -_|_-< | 
 /_/ \_\_||_\__,_\___/__/ | This program comes with ABSOLUTELY NO WARRANTY.

> Loaded config from file "/Users/jinningwang/.andes/andes.rc"
Numerical code generation (quick mode) started...
Generating code for 97 models on 12 processes.
Saved generated pycode to "/Users/jinningwang/.andes/pycode"
> Loaded generated Python code in "/Users/jinningwang/.andes/pycode".
Generated numerical code for 97 models in 1.3844 seconds.
(mbaforge) jinningwang@jwangMBP work % andes prep -q

    _           _         | Version 1.9.3
   /_\  _ _  __| |___ ___ | Python 3.10.0 on Darwin, 01/24/2025 03:51:06 PM
  / _ \| ' \/ _` / -_|_-< | 
 /_/ \_\_||_\__,_\___/__/ | This program comes with ABSOLUTELY NO WARRANTY.

> Loaded config from file "/Users/jinningwang/.andes/andes.rc"
Numerical code generation (quick mode) started...
Generating code for 97 models on 12 processes.
Saved generated pycode to "/Users/jinningwang/.andes/pycode"
> Loaded generated Python code in "/Users/jinningwang/.andes/pycode".
Generated numerical code for 97 models in 1.4243 seconds.
(mbaforge) jinningwang@jwangMBP work % andes prep -q

    _           _         | Version 1.9.3
   /_\  _ _  __| |___ ___ | Python 3.10.0 on Darwin, 01/24/2025 03:51:09 PM
  / _ \| ' \/ _` / -_|_-< | 
 /_/ \_\_||_\__,_\___/__/ | This program comes with ABSOLUTELY NO WARRANTY.

> Loaded config from file "/Users/jinningwang/.andes/andes.rc"
Numerical code generation (quick mode) started...
Generating code for 97 models on 12 processes.
Saved generated pycode to "/Users/jinningwang/.andes/pycode"
> Loaded generated Python code in "/Users/jinningwang/.andes/pycode".
Generated numerical code for 97 models in 1.3903 seconds.
(mbaforge) jinningwang@jwangMBP work % andes prep -q

    _           _         | Version 1.9.3
   /_\  _ _  __| |___ ___ | Python 3.10.0 on Darwin, 01/24/2025 03:51:15 PM
  / _ \| ' \/ _` / -_|_-< | 
 /_/ \_\_||_\__,_\___/__/ | This program comes with ABSOLUTELY NO WARRANTY.

> Loaded config from file "/Users/jinningwang/.andes/andes.rc"
Numerical code generation (quick mode) started...
Generating code for 97 models on 12 processes.
Saved generated pycode to "/Users/jinningwang/.andes/pycode"
> Loaded generated Python code in "/Users/jinningwang/.andes/pycode".
Generated numerical code for 97 models in 1.4240 seconds.

0 replies

cuihantao · 2025-01-25T01:52:18Z

cuihantao
Jan 25, 2025
Maintainer

Jinning,

Looks good. Thank you! It means there is almost no difference in the new Miniforge.

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

ANDES prep under miniconda3 and miniforge3 are almost same in consuming time on Mac with M3 #589

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 6 comments 1 reply

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

ANDES prep under miniconda3 and miniforge3 are almost same in consuming time on Mac with M3 #589

jinningwang Jan 24, 2025 Maintainer

Summary

Miniconda3

Miniforge3

Mambaforge

Replies: 6 comments · 1 reply

cuihantao Jan 24, 2025 Maintainer

jinningwang Jan 24, 2025 Maintainer Author

jinningwang Jan 24, 2025 Maintainer Author

jinningwang Jan 24, 2025 Maintainer Author

jinningwang Jan 24, 2025 Maintainer Author

jinningwang Jan 24, 2025 Maintainer Author

cuihantao Jan 25, 2025 Maintainer

jinningwang
Jan 24, 2025
Maintainer

Replies: 6 comments 1 reply

cuihantao
Jan 24, 2025
Maintainer

jinningwang Jan 24, 2025
Maintainer Author

jinningwang
Jan 24, 2025
Maintainer Author

jinningwang
Jan 24, 2025
Maintainer Author

jinningwang
Jan 24, 2025
Maintainer Author

jinningwang
Jan 24, 2025
Maintainer Author

cuihantao
Jan 25, 2025
Maintainer