bug: High memory consumption when using ApiExports and Bindings

[SimonTheLeg]

During the loadtest we observed a high-spike in memory consumption: Starting from ~22GiB for 10000 empty workspaces it spiked to ~95GiB after applying Exports and Bindings.

test protocol was: test which creates 10000 workspaces and afterwards creates 500 ApiExports and 9500 ApiBindings. Lastly it creates objects of the particular type in the 9500 consumer workspaces.

/kind bug