Files in 3DCodeBench/images do not match the corresponding glb and py files

[llada60]

Hi, I found a possible data alignment issue in the benchmark section.

In the 3DCodeBench folder, some files under images do not appear to correspond to the associated .glb and .py files. The image content and the generated 3D model or Python script seem to describe different objects.

Could you please verify the file mappings and naming conventions in this part of the dataset?

Thanks.

[gaoypeng]

Hi, thanks for the reminder. Can you share some concrete examples? Is this folder https://huggingface.co/datasets/YipengGao/3DCode/tree/main/3DCodeBench wrong?

[llada60]

Thanks for the reply. Yes, the issue I found is in that folder for the benchmark.

For example, for Bird_seed0, I found its image input in the official model logs at: 3DCodeBench_ModelLogs/inputs/Bird_seed0/images

Here is the input image associated with Bird_seed0:

I then rendered the provided GT code in Blender: 3DCodeBench/Bird_seed0/Bird_seed0.py

Here is the rendering result of the GT code:

However, the input image and the rendered result from the provided GT code do not match at all. It appears that the input image and GT code may be incorrectly paired. The same issue also appears in other samples, including Beetle_seed0, Fish_seed0, Flyingbird_seed0 and ColumnarBaseCactus_seed0.

Could you please check whether there is an issue with the sample mapping or directory structure?

[gaoypeng]

Hi, thanks for pointing out the bird case. This is not a mismatch but the existed error during data curation. I spent more than 10 hours on the bird to reproduce the performance of the ones in Inifigen but I failed and gave up. Similar cases would also exist on other categories. If you could make a better one, please don't hesitate to contribute to the 3DCodeBench. I would appreciate it so much!