chore: upgrade package/docker dependencies (#879)

* chore: minimize dockerfiles net8.0

* pr-fix: still use sdk for building dockerfile

* pr-fix: automatic topic subscription

* pr-fix: remove databricks projet

* pr-fix: upgrade nuget packages

* pr-fix: simplify secret rerieval in worker projects

* pr-fix: use chiseled base docker images

* pr-fix: use chiseled base docker images

* pr-fix: use chiseled base docker images

* pr-enh: use 'slim' az func base images

* pr-sug: use same docker image type for base/build