Arm backend: Match arg ranks for min/max ops

[YufengShi-dudu]

• Int32 clamp is decomposed into min/max, but input_tensor and min_arg/max_arg can end up with different ranks (e.g. (1,) vs ()) after subsequent passes. This violates the TOSA requirements for TOSA.MINIMUM and TOSA.MAXIMUM in the node visitors.
• Fix this by matching the input ranks in MatchArgRanksPass

Change-Id: I47a3bb73832ddc35553cd3e5b65085155eb9ca48

cc @freddan80 @per @zingo @oscarandersson8218 @digantdesai

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/16181

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 46 New Failures

As of commit b28d0a6 with merge base c398ff4 ():

NEW FAILURES - The following jobs have failed:

• Build Presets / apple (profiling) / build (gh)
• Build Presets / apple (pybind) / build (gh)
  RuntimeError: Command bash /Users/runner/work/_temp/exec_script failed with exit code 1
• Build Presets / zephyr (zephyr) / build (gh)
  RuntimeError: Command docker exec -t 58f896f07953ebbd8c70f115902f43a3fc3b48f86065497fc04d1b00b60fd988 /exec failed with exit code 1
• pull / android / build-llm-demo / linux-job (gh)
  RuntimeError: Command docker exec -t 81bea9da7dfb3b570381f3b6e0f345d211ab181f23f02512d03554334ba3c7f3 /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu... / linux-job (gh)
  RuntimeError: Command docker exec -t 2dd70aa01c4110ada547737db74ec20ffeeb456704be4098d01b3a3f81d6eaa3 /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu-22.04-... / linux-job (gh)
  RuntimeError: Command docker exec -t 53d337fe114b13b2fb16be035219ab7a0a43d15bab56d0ff3c880523be676947 /exec failed with exit code 1
• pull / test-lora-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 63a61f218ddcf2dba11f282d014b0f7458a2178fe15dd70d05bb7a4253782a22 /exec failed with exit code 127
• pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job (gh)
  RuntimeError: Command docker exec -t c8d3908978b60720bc15f57ff85ce0f925d4c7eda46b04080a0a0a09a63c2085 /exec failed with exit code 1
• pull / test-quantized-aot-lib-linux / linux-job (gh)
  AttributeError: module 'urllib' has no attribute 'URLopener'
• pull / test-vulkan-models-linux / linux-job (gh)
  AttributeError: module 'urllib' has no attribute 'URLopener'
• pull / unittest / linux / linux-job (gh)
  backends/xnnpack/test/recipes/test_xnnpack_recipes.py::TestXnnpackRecipes::test_all_models_with_recipes
• pull / unittest / macos / macos-job (gh)
  backends/xnnpack/test/recipes/test_xnnpack_recipes.py::TestXnnpackRecipes::test_all_models_with_recipes
• pull / unittest / windows / windows-job (gh)
  export/tests/test_target_recipes.py::TestTargetRecipes::test_mv2_model
• pull / unittest-arm-backend-with-no-fvp (test_pytest_models) / linux-job (gh)
  RuntimeError: Command docker exec -t 88386859c1e253ad775dd878a1a13d19e6ae8ff3442bce3f9d81a4c60f4c046d /exec failed with exit code 1
• pull / unittest-arm-backend-with-no-fvp (test_pytest_ops) / linux-job (gh)
  RuntimeError: Command docker exec -t e1117f5dc48e40b2cb5ba0037bad67c62a6f0711921ab594f5ae71886a1d1e80 /exec failed with exit code 1
• pull / unittest-editable / linux / linux-job (gh)
  examples/models/test/test_export.py::ExportTest::test_mv2_export_to_executorch
• pull / unittest-editable / windows / windows-job (gh)
  examples/models/test/test_export.py::ExportTest::test_mv2_export_to_executorch
• pull / unittest-nxp-neutron / linux-job (gh)
  AttributeError: module 'urllib' has no attribute 'URLopener'
• trunk / test-arm-backend (test_model_smollm2-135M) / linux-job (gh)
  RuntimeError: Command docker exec -t bc144c28318ff980e00a0d74ccd039270ef5532dba18853da5a826f15288d5cc /exec failed with exit code 1
• trunk / test-arm-backend (test_models_ethos-u55) / linux-job (gh)
  RuntimeError: Command docker exec -t bbc6ce336b085f9adcf2778991145aed392cdca7e1a3dc2edba8c1430b1cdc6d /exec failed with exit code 1
• trunk / test-arm-backend (test_models_ethos-u85) / linux-job (gh)
  RuntimeError: Command docker exec -t cc07f886a2da9ae639b18f89377560144809afe7dc2486b65d44e7a7c4a00e91 /exec failed with exit code 1
• trunk / test-arm-backend (test_models_tosa) / linux-job (gh)
  RuntimeError: Command docker exec -t ddf8da996cbf861ef79624e658ae6280d36667c467bd104d5a2c9bcbc9e35157 /exec failed with exit code 1
• trunk / test-arm-backend (test_pytest_ops_ethosu_fvp) / linux-job (gh)
  RuntimeError: Command docker exec -t f277b78fd3e1416fcb8ada4490ba274c9614a19ea9e110dea41b53a441a9b6b1 /exec failed with exit code 1
• trunk / test-arm-backend (test_run_ethosu_fvp) / linux-job (gh)
  RuntimeError: Command docker exec -t b40be491e8c5694664b968e6eb7638416613b7c21dec81c8ef5745420a8ad07b /exec failed with exit code 1
• trunk / test-arm-backend-vkml (test_pytest_ops_vkml) / linux-job (gh)
  RuntimeError: Command docker exec -t 5118243d6ac090b10c0cfe3bae425035bf2152811f4109e4bac26f9765129b43 /exec failed with exit code 1
• trunk / test-arm-cortex-m-size-test (zephyr-preset) / linux-job (gh)
  RuntimeError: Command docker exec -t fd71d0e2c58fae596684980eea6c7f6145546655bfddef5d9b3cd6035696d004 /exec failed with exit code 2
• trunk / test-arm-ootb-linux / linux-job (gh)
  RuntimeError: Command docker exec -t f6342b89ec393df36f4a97af78aa7b34bef2df75a7a9368fca73ea41f8fdc1d7 /exec failed with exit code 1
• trunk / test-coreml-delegate / macos-job (gh)
  RuntimeError: Command bash /Users/runner/work/_temp/exec_script failed with exit code 1
• trunk / test-huggingface-transformers-macos (smollm2-135m|coreml_fp32_gpu|--quantize) / macos-job (gh)
  RuntimeError: Command bash /Users/runner/work/_temp/exec_script failed with exit code 1
• trunk / test-llama-runner-linux (fp32, xnnpack+custom, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11... / linux-job (gh)
  RuntimeError: Command docker exec -t 50c8ddc067677bd7c56809141eb3bf2ce6f52ce69a59db2e43ffa5ed354295ab /exec failed with exit code 1
• trunk / test-mcu-cortex-m-backend / linux-job (gh)
  RuntimeError: Command docker exec -t 3649878be8f1d93cb0d0c90e96f959ff766b7b7cdfff6332d9e12a966800a772 /exec failed with exit code 1
• trunk / test-models-linux-aarch64 (add_mul, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 445c3f86b112cb10ddf3a86c0f4609dcb072e3ed5bfba30e99c2875d691315c1 /exec failed with exit code 1
• trunk / test-models-linux-aarch64 (add, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 0cc8eaf81d4bc9e989252fa27d0397be9c989702749ba48b01b8c8110d723fde /exec failed with exit code 1
• trunk / test-models-linux-aarch64 (emformer_transcribe, portable, linux.arm64.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 3630b208a231e594f6c2596e08dddc3e06e1f628577df12c84c406edaf5bf2cb /exec failed with exit code 1
• trunk / test-models-linux-aarch64 (emformer_transcribe, xnnpack-quantization-delegation, linux.arm64.2xla... / linux-job (gh)
  RuntimeError: Command docker exec -t 4528285073d1edffc630cf3501a5d08303b3fc700eab50ee6bbb1121254e50db /exec failed with exit code 1
• trunk / test-models-linux-aarch64 (ic3, portable, linux.arm64.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 6063bd21c3d27bfbf74f5d20560eb335192b4eb712180b7290472775c1269aab /exec failed with exit code 1
• trunk / test-models-linux-aarch64 (ic3, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t fcf73af448c09a6a97fd7c987c1410d515bb7294d8e817f0ed8d4cf3b603583c /exec failed with exit code 1
• trunk / test-models-linux-aarch64 (ic4, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 744caff4f519a2e235ac1ce8cad8fe414990acc7296326b7555ce209deaf1340 /exec failed with exit code 1
• trunk / test-models-linux-aarch64 (linear, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t a446073f7e65ccd17e0d0af6fb1a284a5492bb6cb1e99e211c8b2bf25d8cd363 /exec failed with exit code 1
• trunk / test-models-linux-aarch64 (phi_4_mini, portable, linux.arm64.m7g.4xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 0564149e99f98555702f9bc4c3f17684468716c38ee125055fd76327c9d51bca /exec failed with exit code 1
• trunk / test-models-macos-cpu (ic4, xnnpack-quantization-delegation) / macos-job (gh)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
• trunk / test-models-macos-cpu (llama2, xnnpack-quantization-delegation) / macos-job (gh)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
• trunk / test-models-macos-cpu (w2l, xnnpack-quantization-delegation) / macos-job (gh)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
• trunk / unittest-release / linux / linux-job (gh)
  extension/llm/tokenizers/test/test_hf_tokenizer.py::TestHfTokenizer::test_phi_4_mini
• trunk / unittest-release / macos / macos-job (gh)
  examples/models/test/test_export.py::ExportTest::test_mv2_export_to_executorch
• trunk / unittest-release / windows / windows-job (gh)
  examples/models/test/test_export.py::ExportTest::test_mv2_export_to_executorch

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[ArmRyan]

int32 clamp already does a full op to handle the rank difference. If this is not working properly you should add a test that triggers this error or if it is a replacement, you should remove the full op

[YufengShi-dudu]

int32 clamp already does a full op to handle the rank difference. If this is not working properly you should add a test that triggers this error or if it is a replacement, you should remove the full op

Hey Ryan, thanks for your comment. I realize DecomposeInt32ClampPass does match the input ranks of aten.clamp.default. However, some passes between DecomposeInt32ClampPass and MatchArgRanksPass cause the input ranks to become unmatched. We can rematch them in MatchArgRanksPass.

This issue was found by some internal model tests and cannot be easily reproduced with an op test, but we have verified the fix against those internal models.

Thank you!