[INSTALL ISSUE]

[ssns233]

Describe the problem
A clear and concise description of the problem encountered.
Python Packages can not be installed ！Causing plenty of errors when testing.
When I tried to install them using pip install, I can not install pysap, mccd, and ngmix successfully.

To Reproduce
Steps to reproduce the behaviour:
Reinstall or install using script:"./install_shapepipe"
Screenshots
If applicable, add screenshots to help explain your problem.
Shots is provided as files uploaded below.

Desktop (please complete the following information):

OS: [e.g. iOS] Ubuntu
Browser [e.g. chrome, safari] Firefox
Version [e.g. 22] 20.04
Additional context Run in VMware16 pro.
Add any other context about the problem here

[sfarrens]

Hi @ssns233 thanks for reporting your issue. We will investigate and get back to you ASAP.

[sfarrens]

Hi @ssns233,

I have just run some tests using a Docker container running Ubuntu 20.04.5. As you can see from the screenshots below, I was not able to reproduce your issue.

Note that I used GCC v9.4.0 for the C/CXX compilers. Can you let me know which compilers you have used and what version of Conda you have installed?

...

[fabianhervaspeters]

Hello everyone, I think I have found a potential source of the error which could be of help. I saw sfarrens that you installed with Conda 4.12.0 but I recently installed it at it was the version 4.13.0
With the conda version 4.13.0 I got a very similar result to ssns233 :

I tried downgrading to conda 4.12.0 and things worked out better for the python packages but not for PSFEx and SExtractor:

Here is the full terminal output for the installation on conda 4.13.0 (GitHub does not accept rtf files, I found that by renaming the txt ro rtf you get the nice outlay (sorry there is probably a better manner)):
error_install_shapepipe.txt

For completeness, I had to give the installation script the $CONDA_PREFIX path by adding a --prefix /path/to/anaconda command line option as homebrew did not install it in a place that the installation script detected, but I would be surprised if this participated in the problem.

[sfarrens]

@fabianhervaspeters I can confirm for your particular case the issue is with Apple silicon (M1/M2). I am currently working on a fix for this for Sparse2D, which is used by PySAP, which is used by MCCD.

[sfarrens]

Hi @ssns233, I have run several tests and I can only reproduce your error on Ubuntu if the environment variables CC and CXX are not set.

I would propose that you rerun the install_shapepipe after setting these variables. For example, on my Ubuntu Docker image I ran the following:

export CC=gcc
export CXX=g++
./install_shapepipe

For completeness, I include below the exact setup I ran inside my Ubuntu container.

apt update
apt install -y gcc-9 g++-9 cmake git wget
wget https://repo.continuum.io/miniconda/Miniconda3-latest-Linux-x86_64.sh
bash Miniconda3-latest-Linux-x86_64.sh
bash
cd home
wget https://github.com/CosmoStat/shapepipe/archive/refs/tags/v1.0.1.tar.gz
tar -xzf v1.0.1.tar.gz
cd shapepipe-1.0.1
export CC=gcc
export CXX=g++
./install_shapepipe 

I will keep this issue open until I have resolved the Apple Silicon problem, but I don't believe there should be any problems installing ShapePipe on Ubuntu.

[ssns233]

Thanks for your responding and I tried what you proposed but it seems it did not work. It seems to be a problem with the pip. I tried some time and it can past the testing script processing the config.ini now.
For the first time I run ./install_shapepipe, it would get stuck at running "Installing pip dependences.../" and I had to use ctrl+C to interrupt it.
Then if I run ./install_shapepipe a second time, the issue I propose initially occurred, some packages failed to install.
After activating shapepipe environment I tried pip install and it worked for the last three packages treecorr, sqlitedict, sip_tpv, and for sf_tools I copied the package from anaconda3 and it get solved. But for mccd, ngmix and pysap, it seems that just running pip install will get stuck at "Building wheel for python-pysap.../". I finally cloned the tar.gz of each from Github and built them in the shapepipe environment and ensured packages can be found in .conda/envs/shapepipe/lib/python3.9/site_packages.
Then I run ./install_shapepipe and no errors appeared in the packages check list. But I still did not find a way to deal with the "Building wheels for python-pysap" and "Installing pip dependences" where it get stuck. I already have wheel installed, and pip also run normally, the problem still occurs. Conda version is 4.13.0, gcc 9 and g++ 9.