Error in training of part segmentation

[rabbiahassan]

Hello !
Thanks for the interesting work.
When I put the part segmentation model on training,it just stucks here and doesn't proceed further,it doesn't show any error either.
Please tell me what should I do?
Thanks for your time.

[hrzhou2]

You should check first if the gpu was working. Of course it takes a few time to process one epoch.

[rabbiahassan]

GPU is working absolutely fine,It stucks there for more than a day and din't move further an inch.

[hrzhou2]

It looks still fine for me here.

I think you can check if the code is working as expected within one epoch, by specifying a record interval. For example, set --interval 1 in training. This is expected to give some outputs very quickly.

[rabbiahassan]

Thanks a lot for your reply.
Even for one epoch it shows the same behaviour i.e. it gets stuck there.

[hrzhou2]

Some possible reasons that have came out of my mind:

1. Check first if the dataset is correct. And you could use python ShapeNetPart.py to see if it is working fine.
2. Check the gpu usage. It should be occupied (not continuously due to data loading).
3. Can you debug further to see it stops in which step. Since it happens within an epoch (only a few lines).

[rabbiahassan]

Thanks for reply,I will check all of these things.

[UestcJay]

Thanks for reply,I will check all of these things.

hi, the same error occurs, did you solve it?