about extract features from my dataset

[galaxysan]

Hi, I want to ask how can i use this code to extract features from my own video datasets. Your input of your code is .npy. However, how can i get my .npy file from my dataset? I do not find any data process code in this repo.

Thanks

[SJYbetter]

hello, this is very common because they didn't push all code to this repo, you need to preprocess the video you want to implement by yourself. This link maybe help for you. https://scikit-image.org/docs/dev/user_guide/video.html
You should transfer the video to images by using ffmpeg then transfer the images to .npy.

[galaxysan]

Thx. I saw the PyAV’s API can help me transfer the images to .npy. the input of the i3d is rgb features and flow features, I think I should have two files that one is rgb feature and the other is flow feature about each video right? so this output of PyAV’s API is just a type transfer of images right? how can I get two feature files?Look forward to your reply. thanks

[ed-fish]

Hi check out this issue on the Tensorflow Repo which has a notebook for the optical flow preprocessing in Python. google-deepmind/kinetics-i3d#87