Several ubuntu_performance_lkp failures on noble due to "not a valid job file"

Seen this on metal:ivysaur.amd64 for noble:linux-lowlatency 6.8.0-40.40.1 sru=2024.07.08

Investigation shows this commit in lkp-test can be the cause:

commit f185cf7a819d356cce0ee4600cce539603b500c9 (HEAD)
Author: Yujie Liu <email address hidden>
Date: Mon Jul 31 16:32:59 2023 +0800

    bin/program-options: support numbers program params

    there are some params such as "nr_1Mfiles" and "nr_1Gfiles" which were
    not supported before.

    == before fix ==

    > puts job.path_params
    1HDD

    == after fix ==

    > puts job.path_params
    1HDD-5-10000

    Signed-off-by: Yujie Liu <email address hidden>
    Signed-off-by: Philip Li <email address hidden>

The cassandra-cs-localhost-1SSD-300s-ext4-3.yaml will become cassandra-cs-localhost-1SSD-300s-ext4-3-1.yaml with this command. We just need to update the test case name accordingly.

cassandra-cs-localhost-1SSD-300s-ext4-3.yaml
=> cassandra-cs-localhost-1SSD-300s-ext4-3-1.yaml

hackbench-100-socket-process-100%.yaml
hackbench-8-socket-process-800%.yaml
hackbench-perf-socket-process-1600%.yaml

hackbench tests failed to split:
Running 'lkp split jobs/hackbench-8.yaml || true'
 /home/ubuntu/autotest/client/tmp/ubuntu_performance_lkp/src/lkp-tests/lib/job.rb:204:in `read': No such file or directory @ rb_sysopen - jobs/hackbench-8.yaml (Errno::ENOENT)
     from /home/ubuntu/autotest/client/tmp/ubuntu_performance_lkp/src/lkp-tests/lib/job.rb:204:in `load'
     from /home/ubuntu/autotest/client/tmp/ubuntu_performance_lkp/src/lkp-tests/sbin/split-job:104:in `block in

     from /home/ubuntu/autotest/client/tmp/ubuntu_performance_lkp/src/lkp-tests/sbin/split-job:100:in `each'
     from /home/ubuntu/autotest/client/tmp/ubuntu_performance_lkp/src/lkp-tests/sbin/split-job:100:in `

Because these yaml files (hackbench-100.yaml, hackbench-8.yaml, hackbench-perf.yaml) have been removed in the following commit:
commit 56c25bab9a2fff9004cf95b55f53fcd198a266f2 (refs/bisect/bad)
Author: Philip Li <email address hidden>
Date: Thu Mar 30 21:42:24 2023 +0800

    jobs: remove less useful hackbench yaml

    User need consider to maintain a set of yamls for own usage. The remained jobs/hackbench.yaml
    is a good reference.

We will need to remove these test cases as well. If we still want to use hackbench tests, we will have to split from jobs/hackbench-cgroup2.yaml jobs/hackbench-cpuset.yaml jobs/hackbench.yaml

schbench-100%.yaml
This has been changed since:
commit 91e7e86a5d7ada92ce9975189033656500c589b3
Author: Swapnil Sapkal <email address hidden>
Date: Thu Aug 18 10:45:00 2022 +0000

    Added iteration and additional params for schbench

    Added iteration and additional params for schbench

    Signed-off-by: Swapnil Sapkal <email address hidden>

 jobs/schbench.yaml | 11 +++++++++++
 tests/schbench | 11 ++++++++---
 tests/schbench.yaml | 1 +
 3 files changed, 20 insertions(+), 3 deletions(-)

It's now split into the following 4 if we have head set to 7381899cd266d:
schbench-3x-12.5%-300s-128.yaml
schbench-3x-12.5%-300s-512.yaml
schbench-3x-100%-300s-16.yaml
schbench-3x-100%-300s-128.yaml

And if we have it set to the latest tip (87dab9158daf1) in lkp-test:
schbench-3x-10%-300s-128.yaml
jobs/schbench.yaml => ./schbench-3x-2-300s-100%.yaml

We will have to decide which one to use.

unixbench-30%-300s-context1.yaml
unixbench-30%-300s-dhry2reg.yaml
unixbench-30%-300s-execl.yaml
unixbench-30%-300s-pipe.yaml
unixbench-30%-300s-syscall.yaml
unixbench-30%-300s-whetstone-double.yaml

commit 6fcf2a29b0988e8d0530b775b9c590db89950944
Author: Philip Li <email address hidden>
Date: Sun Apr 2 12:36:22 2023 +0800

    jobs/unixbench.yaml: adjust load to 100%

    Signed-off-by: Philip Li <email address hidden>

=> unixbench-100%-300s-context1.yaml
=> unixbench-100%-300s-dhry2reg.yaml
=> unixbench-100%-300s-execl.yaml
=> unixbench-100%-300s-pipe.yaml
=> unixbench-100%-300s-syscall.yaml
=> unixbench-100%-300s-whetstone-double.yaml