how to evaluate pi0-fast-ft-primitive-10task-deltachunk ckpt

[hemin0806]

Hello, I am trying to evaluate the following checkpoint : https://huggingface.co/VLABench/pi0-fast-ft-primitive-10task-deltachunk
I cloned the openpi repo inside a directory "VLABench", and placed the downloaded checkpoint under: VLABench/openpi/checkpoints/pi0-fast-ft-primitive-10task-deltachunk/

Then I tried to run the policy server using: ```
bash serve_policy.sh pi0_ft_vlabench_primitive_aligned checkpoints/pi0-fast-ft-primitive-10task-deltachunk/

However, I get the following runtime error:
ValueError: PyTrees have different structure:
- at keypath '':
  expected <class 'dict'> with 6 children,
  got <class 'dict'> with 1 child,
  so the numbers of children do not match,
  with the symmetric difference of key sets:
  {'action_time_mlp_in', 'action_time_mlp_out',
   'action_in_proj', 'state_proj', 'action_out_proj'}.

Could you let me know whether the current config is actually compatible with the checkpoint, or if something else is causing the issue? Also, what would be the correct way to resolve this problem?

[nansun5410]

Hello, I am trying to evaluate the following checkpoint : https://huggingface.co/VLABench/pi0-fast-ft-primitive-10task-deltachunk I cloned the openpi repo inside a directory "VLABench", and placed the downloaded checkpoint under: VLABench/openpi/checkpoints/pi0-fast-ft-primitive-10task-deltachunk/

Then I tried to run the policy server using: ``` bash serve_policy.sh pi0_ft_vlabench_primitive_aligned checkpoints/pi0-fast-ft-primitive-10task-deltachunk/

However, I get the following runtime error:
ValueError: PyTrees have different structure:
- at keypath '':
  expected <class 'dict'> with 6 children,
  got <class 'dict'> with 1 child,
  so the numbers of children do not match,
  with the symmetric difference of key sets:
  {'action_time_mlp_in', 'action_time_mlp_out',
   'action_in_proj', 'state_proj', 'action_out_proj'}.

Could you let me know whether the current config is actually compatible with the checkpoint, or if something else is causing the issue? Also, what would be the correct way to resolve this problem?

Hello, I am trying to evaluate the following checkpoint : https://huggingface.co/VLABench/pi0-fast-ft-primitive-10task-deltachunk I cloned the openpi repo inside a directory "VLABench", and placed the downloaded checkpoint under: VLABench/openpi/checkpoints/pi0-fast-ft-primitive-10task-deltachunk/

Then I tried to run the policy server using: ``` bash serve_policy.sh pi0_ft_vlabench_primitive_aligned checkpoints/pi0-fast-ft-primitive-10task-deltachunk/

However, I get the following runtime error:
ValueError: PyTrees have different structure:
- at keypath '':
  expected <class 'dict'> with 6 children,
  got <class 'dict'> with 1 child,
  so the numbers of children do not match,
  with the symmetric difference of key sets:
  {'action_time_mlp_in', 'action_time_mlp_out',
   'action_in_proj', 'state_proj', 'action_out_proj'}.

Could you let me know whether the current config is actually compatible with the checkpoint, or if something else is causing the issue? Also, what would be the correct way to resolve this problem?

use this: --policy.config pifast_ft_vlabench_primitive_aligned