Arm backend: Report CPU time per inference for Ethos-U on Linux - #22596
Arm backend: Report CPU time per inference for Ethos-U on Linux#22596vacu9708 wants to merge 1 commit into
Conversation
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/22596
Note: Links to docs will display an error until the docs builds have been completed.
|
|
The following ciflow label(s) have been added but CI has not been triggered yet because the workflows are awaiting approval:
Once a maintainer approves the workflows (scroll to the bottom of the PR page), the corresponding CI jobs will be triggered automatically. Please ping one of the reviewers if you do not have access to approve and run workflows. |
This PR needs a
|
**Motivation** The Cortex-M runtime reports the CPU time spent in `EthosUBackend::execute()` per inference while the Linux runtime does not. **Change** Add a Linux branch to `arm_perf_monitor.cpp` to measure the CPU time per inference Signed-off-by: Youngsik Yang <vacu9708@gmail.com>
e5574af to
503aa16
Compare
Summary
EthosUBackend::execute()calls theEthosUBackend_execute_begin()/EthosUBackend_execute_end()hooks around each delegated inference.EthosUBackend::execute()per inference.I added a Linux branch to
arm_perf_monitor.cppto measure the CPU time saved by a Linux runtime change (#22599)Draft
This is a draft because I'm not sure an Arm-specific measurement belongs in the portable executor_runner, though
ET_ENABLE_VGF_INPUT_DUMPis a precedent.Would this be mergeable if I only added the Linux branch to
arm_perf_monitor.cppand left out the calls in the portable executor_runner?