Fix and improve for local deployment

[tollsimy]

This PR aims to fix and improve containers for local deployments by:

• remove obsolete Dockerfiles (move to ./kci docker)
• merging all compose files in one (pipeline + lava-callback + pipeline-kcidb)
• refactoring compose files and removing obsolete entries
• add missing config path argument to services
• updating relative docs

This PR is tightly related to recent fixes and improvements I am proposing in kernelci/kernelci-deploy.

[nuclearcat]

How to reproduce bug this patch (rename timeout) is fixing?

[tollsimy]

Rename timeout patch fixes:

cycle detected at path: services.timeout
cycle detected at path: services.timeout

Environment:

docker --version
Docker version 28.0.2, build 0442a73
docker-compose --version
Docker Compose version v2.30.2

[tollsimy]

What about something like this? I removed obsolete Dockerfiles. I will open another PR in deployment to add missing container builds.

[nuclearcat]

I will need to check if renaming will cause any issues with existing deployment scripts, it might take a bit of time, but likely will do this week.

[tollsimy]

Edit: apparently the cycle detected at path is a docker-compose bug related to yaml anchors. Does not happen if using the new docker compose command. Time to remove depreated docker-compose from local deployment scripts.
I will change and push new changes.

[nuclearcat]

Probably this PR causes breakage at staging script

ERROR: Version mismatch: file ./docker-compose.yaml specifies version 1 but extension file ./docker-compose-kcidb.yaml uses version 3.0

[tollsimy]

You're right @nuclearcat , since this PR merges pipeline-lava-callback, pipeline-kcidb and all other pipeline services in one compose file in 03042de, staging.kernelci.org in kernelci-deploy should be modified to execute only one compose.
Moreover, the version mismatch is due to the fact the the old (and deprecated) docker-compose is used.
Upgrading to the new docker compose plugin should remove that error (since "version" property is also deprecated).

Not sure but maybe upgrading to the new docker compose could also fix issue reported kernelci/kernelci-api#598 and #1045.

[nuclearcat]

https://github.com/kernelci/kernelci-core/actions/runs/14589446598/job/40921114087

2025-04-22 07:43:10,999 - INFO - Checking PR 1102: `Fix and improve for local deployment` by tollsimy
2025-04-22 07:43:10,999 - INFO - Processing PR 1102
error: callback-requirements.txt: No such file or directory
error: patch failed: docker-compose.yaml:106
error: docker-compose.yaml: patch does not apply
error: patch failed: docker-compose.yaml:155
error: docker-compose.yaml: patch does not apply
2025-04-22 07:43:11,294 - ERROR - Failed to apply patch for PR 1102

[nuclearcat]

I think you need to rebase your patch

[tollsimy]

Done, this should work, thanks @nuclearcat !