Numpy and other modules not recognized

[mooseknuckleking]

Not recognizing numpy?

Loading program...

...System modules loaded...
╭─────────────────────────────── Traceback (most recent call last) ────────────────────────────────╮
│ /Users/trevor/MetalDiffusion/dream.py:42 in │
│ │
│ 39 print("\n...[bold]System[/bold] modules loaded...") │
│ 40 │
│ 41 ### Math modules │
│ ❱ 42 import numpy as np │
│ 43 │
│ 44 ### Import Stable Diffusion modules │
│ 45 from stableDiffusionTensorFlow.stableDiffusion import StableDiffusion │
│ │
│ ╭─────────────────────────────────────────── locals ───────────────────────────────────────────╮ │
│ │ argparse = <module 'argparse' from │ │
│ │ '/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/argparse.py'> │ │
│ │ box = <module 'rich.box' from │ │
│ │ '/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages… │ │
│ │ gc = <module 'gc' (built-in)> │ │
│ │ install = <function install at 0x10a8b27a0> │ │
│ │ os = <module 'os' (frozen)> │ │
│ │ Panel = <class 'rich.panel.Panel'> │ │
│ │ print = <function print at 0x10a5d0360> │ │
│ │ random = <module 'random' from │ │
│ │ '/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/random.py'> │ │
│ │ Text = <class 'rich.text.Text'> │ │
│ │ time = <module 'time' (built-in)> │ │
│ ╰──────────────────────────────────────────────────────────────────────────────────────────────╯ │
╰──────────────────────────────────────────────────────────────────────────────────────────────────╯
ModuleNotFoundError: No module named 'numpy'
(venv) (base) trevor@Shreks-MBP MetalDiffusion % pip3 install numpy
Requirement already satisfied: numpy in /Users/trevor/venv/lib/python3.11/site-packages (1.23.5)

[soten355]

Strange! Sounds like numpy wasn't installed properly...but then you tried to reinstall it and it was. Have you tried reinstalling MetalDiffusion enitrely?

[raffetazarius]

I'm also running into this! See #11
Did you manage to resolve it @mooseknuckleking ?

I feel like the Virtual Python Environment "venv" that we're running MetalDiffusion inside (if following your instructions @soten355 ) should not be looking in:

1. the MacOS System-level Python installation folder ("/Library/Frameworks/Python.framework/Versions/...."), since following your instructions https://github.com/soten355/MetalDiffusion/wiki/Installation

Creating a virtual environment for Python using:
python -m venv venv

and activating
source venv/bin/activate

and installing dependencies
pip install -r requirements.txt --no-cache-dir

actually seems to install:

(a) scripts into a "bin" folder inside the "venv" directory:

/Users//MetalDiffusion/venv/bin

and the dependency "site-packages" into a "lib" folder inside the "venv" directory:

/Users//MetalDiffusion/venv/lib/python3.9/site-packages

2. Anywhere else on the user's drive, as in my case on Help! ModuleNotFoundError: No module named 'rich' when attempting to run dream.py #11

│ │ argparse = <module 'argparse' from │ │
│ │ '/Library/Developer/CommandLineTools/Library/Frameworks/Pyth… │ │
│ │ box = <module 'rich.box' from │ │
│ │ '/Users/username/Library/Python/3.9/lib/python/site-pac… │ │
│ │ gc = <module 'gc' (built-in)> │ │
│ │ install = <function install at 0x10b5e2ca0> │ │
│ │ os = <module 'os' from │ │
│ │ '/Library/Developer/CommandLineTools/Library/Frameworks/Pyth… │ │
│ │ Panel = <class 'rich.panel.Panel'> │ │
│ │ print = <function print at 0x10af85af0> │ │
│ │ random = <module 'random' from │ │
│ │ '/Library/Developer/CommandLineTools/Library/Frameworks/Pyth… │ │
│ │ Text = <class 'rich.text.Text'> │ │
│ │ time = <module 'time' (built-in)> │ │

it's trying to find the modules in the Xcode CommandLineTools folder!

/Library/Developer/CommandLineTools/Library/Frameworks/....

and

/Users/username/Library/Python/3.9/lib/python/....

---

@soten355 - I think you've missed a step in your installation instructions - somehow the venv environment we're using for MetalDiffusion needs to be configured to look in the correct location for modules/frameworks/etc. It seems like dream.py is looking in unpredictable locations based on how the user has their MacOS Python installation(??) configured (which shouldn't matter if you're directing us to run MetalDiffusion within a Python venv inside the MetalDiffusion folder, right?).

Where/how can we SET the configuration paths for MetalDiffusion correctly?

[soten355]

@raffetazarius
This is so strange! The reason I designed the installation around virtual environments is to avoid just this.

When using a virtual environment, it will install the library dependencies into the /venv/lib/python3.9/site-packages. This keeps the virtual environment independent of the global environment.

Are you running MetalDiffusion in the virtual environment? For example:

source venv/bin/activate
python dream.py

[raffetazarius]

@raffetazarius This is so strange! The reason I designed the installation around virtual environments is to avoid just this.

When using a virtual environment, it will install the library dependencies into the /venv/lib/python3.9/site-packages. This keeps the virtual environment independent of the global environment.

Are you running MetalDiffusion in the virtual environment? For example:

source venv/bin/activate
python dream.py

Yes, I was running it in the virtual environment.

It seems that my system was looking in non-venv locations for Python though. I did a big cleanup of all the Python versions I had installed on my machine though, but I also decided to remove MetalDiffusion and just focus on getting A1111 up and running on my rig. I'll update this thread if I decide to test out MetalDiffusion again.

Do you leverage tensorflow-metal in MetalDiffusion? https://developer.apple.com/metal/tensorflow-plugin/

[soten355]

Hmmm, you might be missing a step during installation or did something extra on accident. When running a code in a virtual environment, it will only reference the libraries in the environment; it's kind of a basic Python method.

---

Yes, MetalDiffusion utiliizes TensforFlow as a render framework. To use it, go to Advanced Settings and select TensorFlow as the render framework. Couple notes:

It will use the GPU

It will not use Diffusers models, but it WILL use safetenors and ckpt's

It does not currently support SDXL or LoRA's (either XL or not)

---

If you have any other questions regarding TensorFlow, please open a new issue. For now, let's keep this convo strictly about library dependencies in a virtual environment.