Spark upgrade version 3.5.5 and 4.1.0

[aganisatria]

Upgraded spark 3.5.5 and 4.2.0-preview4

[aganisatria]

Hi sir @marc0der, this PR is ready for review. Could you please take a look and also help approve the workflows?
Thank you!

[marc0der]

@aganisatria This PR should be additive to what's already in the database, but it looks like you are re-inserting items that are already there. Please make the versions added mutually exclusive to those of the previous migration.

[aganisatria]

Noted, will do sir @marc0der

[aganisatria]

Done sir @marc0der.
Since this is my first PR, just let me know if there is required step that i need to do.

[marc0der]

Looking good. Just some minor improvements to make it better.

[aganisatria]

Done updated sir @marc0der, looking forward to this update to help maintain EMR 7.10.0 ☺️

[aganisatria]

Hi sir @marc0der, apologize to disturb your time.
bump for this please thank you so much

[chloe41427]

Thanks for the contribution @aganisatria! One request before we merge: please drop the 4.2.0-preview4 entry. Preview releases tend to have unreliable archive URLs that break shortly after the stable release ships. We prefer to keep migrations to stable releases only.

Once that's removed, this looks good to go! 🙂

[marc0der]

@aganisatria scalafmt failed

[aganisatria]

done sir @marc0der, fixed.

[chloe41427]

Looks good — build passes, scalafmt is fixed. Thanks for iterating on this! 🎉