Use the Python from the compatibility layer for installing ReFrame in test script

[bedroge]

Hopefully this fixes the test step issue on RISC-V (which failed because of a missing library, I suppose in the build container or on the build host). Also changed the CI and made it use our test script for running the ReFrame test suite.

[bedroge]

Let's give it a try...

bot: build repo:eessi.io-2025.06-compat arch:riscv64/generic

edit: cancelled that run, as the RISC-V CI is also failing, maybe it has the same issue.

[riscv-eessi-io-bot]

New job on instance eessi-bot-riscv for CPU micro-architecture riscv64-generic for repository eessi.io-2025.06-compat in job dir /home/eessibot/shared/jobs/2025.06/pr_222/232729

date	job status	comment
Jun 17 13:36:23 UTC 2025	submitted	job id 232729 awaits release by job manager
Jun 17 13:37:21 UTC 2025	released	job awaits launch by Slurm scheduler
Jun 17 13:38:24 UTC 2025	running	job 232729 is running
Jun 17 13:42:32 UTC 2025	finished	🤷 UNKNOWN (click triangle for detailed information) Job results file _bot_job232729.result does not exist in job directory, or parsing it failed. No artefacts were found/reported.
Jun 17 13:42:32 UTC 2025	test result	🤷 UNKNOWN (click triangle for detailed information) Job test file _bot_job232729.test does not exist in job directory, or parsing it failed.

[bedroge]

The pip install reframe-hpc fails due to:

      Error: Please make sure the libxml2 and libxslt development packages are installed.

I suppose this is happening because it has to build lxml from source for RISC-V (and not for the other architectures).

[bedroge]

The lxml error can be solved by running this inside the compat layer environment (which has these packages installed), but then the next issue pops up for maturin:

Collecting rpds-py>=0.7.1 (from jsonschema->reframe-hpc)
  Downloading rpds_py-0.25.1.tar.gz (27 kB)
  Installing build dependencies ... error
  error: subprocess-exited-with-error
  
  × pip subprocess to install build dependencies did not run successfully.
  │ exit code: 1
  ╰─> [43 lines of output]
      Collecting maturin<2.0,>=1.2
        Downloading maturin-1.8.7.tar.gz (205 kB)
        Installing build dependencies: started
        Installing build dependencies: finished with status 'done'
        Getting requirements to build wheel: started
        Getting requirements to build wheel: finished with status 'error'
        error: subprocess-exited-with-error
      
        × Getting requirements to build wheel did not run successfully.
        │ exit code: 1
        ╰─> [22 lines of output]
            Traceback (most recent call last):
              File "/tmp/eessi.bFeVH0gbGo/lib/python3.13/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 389, in <module>
                main()
                ~~~~^^
              File "/tmp/eessi.bFeVH0gbGo/lib/python3.13/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 373, in main
                json_out["return_val"] = hook(**hook_input["kwargs"])
                                         ~~~~^^^^^^^^^^^^^^^^^^^^^^^^
              File "/tmp/eessi.bFeVH0gbGo/lib/python3.13/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 143, in get_requires_for_build_wheel
                return hook(config_settings)
              File "/tmp/pip-install-7ufz7wyw/maturin_b4b9d514f23f4383bd93975bf377ac56/maturin/bootstrap.py", line 29, in get_requires_for_build_wheel
                reqs = _orig_get_requires_for_build_wheel()
              File "/tmp/pip-build-env-pr3ib6vi/overlay/lib/python3.13/site-packages/setuptools/build_meta.py", line 331, in get_requires_for_build_wheel
                return self._get_build_requires(config_settings, requirements=[])
                       ~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
              File "/tmp/pip-build-env-pr3ib6vi/overlay/lib/python3.13/site-packages/setuptools/build_meta.py", line 301, in _get_build_requires
                self.run_setup()
                ~~~~~~~~~~~~~~^^
              File "/tmp/pip-build-env-pr3ib6vi/overlay/lib/python3.13/site-packages/setuptools/build_meta.py", line 317, in run_setup
                exec(code, locals())
                ~~~~^^^^^^^^^^^^^^^^
              File "<string>", line 52, in <module>
            ModuleNotFoundError: No module named 'puccinialin'
            [end of output]
      
        note: This error originates from a subprocess, and is likely not a problem with pip.
      error: subprocess-exited-with-error
      
      × Getting requirements to build wheel did not run successfully.
      │ exit code: 1
      ╰─> See above for output.
      
      note: This error originates from a subprocess, and is likely not a problem with pip.
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× pip subprocess to install build dependencies did not run successfully.
│ exit code: 1
╰─> See above for output.

Giving up for now...