Abl 10 fill db for perftests tool - (#921)

[ghost]

• feat: added inital excel calc-sheet and loadtest json configs added projects for snapshot-tool and unit-tests

• chore: modified testdata excel, added json pool configs

• chore: fixed excel and json files

• test: added Models and test DeserializeFromJson

• test: added tests for DeserializeFromExcel, VerifyJsonPoolConfig

• feat: added own solution for snapshot-creator-v2

• fix: test-data path and check formatting oof backbone.sln

• fix: solution path

• fix: WHITESPACE

• chore: added dev readme

• feat: Generate JSON configs from Excel Calculation (PerformanceTestData)

• fix: error IDE0042: Variable declaration can be deconstructed

• fix: error IDE0007: use 'var' instead of explicit type

• feat: Generate Relationships Excel (RelationshipsAndMessagePoolConfigs..xlsx)

• feat: Distribute Messages on Relationships

• feat: Distribute Messages on Relationships

• feat: Distribute Messages on Relationships (RelationshipsAndMessagePoolConfigs..xlsx)

• feat: added VerifyAndFixNumberOfSentMessages, and included PR Review remarks

• fix: heavy loadtest data corrected according to confluence Performance Test Data.xls

• fix: PR review refactorings

• fix: VerifyNumberOfSentMessages

• test: added tests for test, light, heavy load

• refactor: added PoolConfigurationJsonGeneratorCommand

• refactor: added verify-json, generate-relationships commands

• fix: formatting import order

• feat: add command generate-all (pool-config with relationships-and-messages)

• refactor: updated to only generate a single json pool config incl. relationships and messages

• fix: error IMPORTS: Fix imports ordering

• feat: added inital excel calc-sheet and loadtest json configs added projects for snapshot-tool and unit-tests

• chore: modified testdata excel, added json pool configs

• chore: fixed excel and json files

• test: added Models and test DeserializeFromJson

• test: added tests for DeserializeFromExcel, VerifyJsonPoolConfig

• feat: added own solution for snapshot-creator-v2

• fix: test-data path and check formatting oof backbone.sln

• fix: solution path

• fix: WHITESPACE

• chore: added dev readme

• feat: Generate JSON configs from Excel Calculation (PerformanceTestData)

• fix: error IDE0042: Variable declaration can be deconstructed

• fix: error IDE0007: use 'var' instead of explicit type

• feat: Generate Relationships Excel (RelationshipsAndMessagePoolConfigs..xlsx)

• feat: Distribute Messages on Relationships

• feat: Distribute Messages on Relationships

• feat: Distribute Messages on Relationships (RelationshipsAndMessagePoolConfigs..xlsx)

• feat: added VerifyAndFixNumberOfSentMessages, and included PR Review remarks

• fix: heavy loadtest data corrected according to confluence Performance Test Data.xls

• fix: PR review refactorings

• fix: VerifyNumberOfSentMessages

• test: added tests for test, light, heavy load

• refactor: added PoolConfigurationJsonGeneratorCommand

• refactor: added verify-json, generate-relationships commands

• fix: formatting import order

• feat: add command generate-all (pool-config with relationships-and-messages)

• refactor: updated to only generate a single json pool config incl. relationships and messages

• fix: error IMPORTS: Fix imports ordering

• fix: use Directory.Build.props (FakeItEasy, FluentAssertions, GitHubActionsTestLogger)
  ref-link: Abl 10 fill db for perftests tool - intermediate  #921 (comment)

• feat: add CreateIdentities and some refactorings (mostly rename)

• feat: added AddDevices command

• feat: added CreateRelationshipTemplates command

• feat: added CreateRelationships command

• feat: added CreateChallenges command

• refactor: replaced ICommands with MediatR.NET moved command used classes in Shared namespace

• chore: some renamings and clean-up

• feat: added CreateMessages command some required refactorings, too.

• fix: an IDE0270 issue

• feat: added CreateDatawalletModifications command added an output helper

• feat: added create snapshot csv output helper

• refac: simplified sub-handler

• feat: use existing impl. of PreGenerateDatawalletModifications

• feat: added debugmode for pool-config generator command added excel writer

• fix: some adjustments

• fix: added IdentityData to solve signature error on adding new device note: Overcome Signature Issue when creating a sdk client from existing identity and onboard new devices

• refactor: create snapshot handler (part I)

• chore: added database cleanup scripts

• feat: added clean-db backup and restore script

• refactor: create snapshot handler (part II)

• refactor: create snapshot handler (part III) added a kind of lookup & replace in RelationshipAndMessagesGenerator

• refactor: create snapshot handler (part IV) added a kind of lookup & replace in RelationshipAndMessagesGenerator

• fix: relationship validation

• refactor: some code cleanup

• fix: unit tests

• refactor: create snapshot handler's challenge command added more expressive consumer api-error message

• refactor: create snapshot handler's message command added more expressive consumer api-error message

• feat: upgraded to net9.0

• fix: fixed Create Message Handler

• feat: added DatawalletModifications command harmonized error details messages

• chore: usage of common .csproj properties from Directory.Build.props and some fixes due to nullable context enable.

• test: real snapshot result for test performance-load added

• test: added light, heavy pool-config and linux drop/restore clean-db script
  a tiny adjsutment was required in performancetest excel. rule: configured relationship-templates >= configured relationships on connector side, otherwise no relationships can be created in db.

• test: added light, heavy pool-config and linux drop/restore clean-db script
  a tiny adjustment was required in PerformanceTest Excel file. rule: configured relationship-templates >= configured relationships on connector side, otherwise no relationships can be created in db.

• fix: ordered relationship id lists

• fix: usage RelationshipIdBag.NumberOfSentMessages

• feat: added logging

• chore: some minor fix in already created device

• fix: set Modules.Messages.Application.MaxNumberOfUnreceivedMessagesFromOneSender to high level to overcome BadRequest in SnapshotCreator-V2 on sent message

• fix: set upper range of MaxNumberOfUnreceivedMessagesFromOneSender

• refactor: added a degree of concurrency

• refactor: added a throttle of concurrency

• refactor: concurrency

• refactor: concurrency further improved - part I

• refactor: tweaked concurrency based on processor-count - part II

• refactor: tweaked concurrency based on processor-count - part III

• refactor: each handler can individually set maxDegreeOfParallelism in heavy load things are getting really slow due to Consumer-API response times. current values are values seen to fit when all is running without debugger attached on localhost.

• chore: added completed LIGHT Testrun

• chore: revmoved individual maxDegreeOfParallelism

• chore: aligned config files organized unittest folders

• test: CreateIdentities

• test: CreateDevices

• test: DeviceFactory

• refactor: minor code adjustments

• fix: removed wrong code segment in CreateDevice some other minor fixes

• test: DeviceFactoryTests

• test: IdentityFactory

• fix: fixed wrong return value

• refactor: prep CreateChallenges for tests

• test: added CreateChallengesTests

• test: added ChallengeFactoryTests

• refactor: adjusted CreateDatawalletModifications to support unit tests

• refactor: adjusted CreateRelationshipTemplates to support unit tests

• refactor: adjusted CreateRelationships to support unit tests

• refactor: adjusted CreateMessages to support unit tests

• fix: added missing identity.IdentityData

• test: added CreateDatawalletModificationsTests

• test: added DatawalletModificationFactoryTests

• test: added CreateRelationshipTemplates unit tests

• test: added RelationshipTemplateFactory unit tests

• test: added CreateRelationships unit tests

• test: added RelationshipFactory unit tests

• test: add CreateMessages unit tests

• test: added MessageFactory unit tests adjusted all tests to a common test setup

• fix: upgraded Microsoft.NET.Test.Sdk package version

• test: added MaxDegreeOfParallelism

• test: added CreateSnapshot unit tests

• test: completed PoolConfigurationExcelReader unit tests

• test: add PoolConfigurationJsonValidator unit tests

• test: added VerifyConfig unit test

• test: added PoolConfigurationJsonWriter unit tests

• test: added RelationshipAndMessagesGenerator unit tests

• test: added GenerateConfig unit tests - part I/II fixed failed test

• test: added GenerateConfig unit tests part II/II

• fix: cleanup after CreateSnapshotTests run

• test: some unit tests

• feat: added restore clean-db option (draft)

• refactor: added restore clean-db option

• feat: added a clearOnly and a snapshot backupDB cli command switch

• fix: unit test argument

---

Readiness checklist

• I added/updated unit tests.
• I added/updated integration tests.
• I ensured that the PR title is good enough for the changelog.
• I labeled the PR.

[ghost]

@tnotheis In your interest, we should get that PR approved before I leave the project.

[tnotheis]

I will try to review it. But since it's so big, I don't think I will make it in time.
We can do it without you as well though, I think.