The helper function runner.run_benchmarks does not offer a way to run the benchmarks with an external set of framework configurations.

I want to run dpbench in batch mode with a set of framework configs that change the sycl_device attribute. However, as the runner.run_benchmarks only reads configs from the default location, I cannot submit multiple jobs where each job has a different sycl_device.