adding utf8 encoding to documents data

[MohKamal]

Encode JSON data as UTF-8 before sending requests to properly support non-ASCII characters.

[poissoncorp]

Hi @MohKamal, thanks for the contribution. Could you check code format? Try using black on the modified file.

Also, could you provide a simple test that verifies correct behavior?

I've seen this one in the codebase, is it passing after the change?

ravendb-python-client/ravendb/tests/jvm_migrated_tests/client_tests/documents_tests/commands_tests/test_put_document_command.py

Lines 30 to 47 in 6354207

	@unittest.skip("todo: Not passing on CI/CD")
	def test_can_put_document_using_command_with_surrogate_pairs(self):
	name_with_emojis = "Gracjan \ud83d\ude21\ud83d\ude21\ud83e\udd2c\ud83d\ude00😡😡🤬😀"
	user = User(name=name_with_emojis, age=31)
	node = Utils.entity_to_dict(user, self.store.conventions.json_default_method)
	command = PutDocumentCommand("users/2", None, node)
	self.store.get_request_executor().execute_command(command)
	result = command.result
	self.assertEqual("users/2", result.key)
	self.assertIsNotNone(result.change_vector)
	with self.store.open_session() as session:
	loaded_user = session.load("users/2", User)
	self.assertEqual(loaded_user.name, name_with_emojis)

[poissoncorp]

@MohKamal To proceed to merge, please address my previous comment - once the test (verifying expected behavior) is created and passing (and the skip is removed from test_can_put_document_using_command_with_surrogate_pairs just for a check), we'll be able to approve merge the proposed change.

[MohKamal]

@MohKamal To proceed to merge, please address my previous comment - once the test (verifying expected behavior) is created and passing (and the skip is removed from test_can_put_document_using_command_with_surrogate_pairs just for a check), we'll be able to approve merge the proposed change.

Hi @poissoncorp, Thank you for your feedback, I will do it, I was busy a little bit.

[poissoncorp]

@MohKamal could you amend after black?

[MohKamal]

@MohKamal could you amend after black?

Yes, done, sorry forgot applying black before pushing!

[poissoncorp]

To proceed, please fix failing tests. Many thanks 🙏

[MohKamal]

To proceed, please fix failing tests. Many thanks 🙏

I see that the emojis are correctly saved and retrieved, do i change the test string from "\ud83d\ude21\ud83d\ude21\ud83e\udd2c\ud83d\ude00" to "😡😡🤬😀" ?

[poissoncorp]

To proceed, please fix failing tests. Many thanks 🙏

I see that the emojis are correctly saved and retrieved, do i change the test string from "\ud83d\ude21\ud83d\ude21\ud83e\udd2c\ud83d\ude00" to "😡😡🤬😀" ?

@MohKamal, any idea why those aren't passing? If that's not something critical, we can safely remove that.

[MohKamal]

To proceed, please fix failing tests. Many thanks 🙏

I see that the emojis are correctly saved and retrieved, do i change the test string from "\ud83d\ude21\ud83d\ude21\ud83e\udd2c\ud83d\ude00" to "😡😡🤬😀" ?

@MohKamal, any idea why those aren't passing? If that's not something critical, we can safely remove that.

i can escape them ""\ud83d\ude21\ud83d\ude21\ud83e\udd2c\ud83d\ude00"

[poissoncorp]

I've researched on this myself. Remove the Pythonic \u signs and leave just emojis

Like this:

"\ud83d\ude21\ud83d\ude21\ud83e\udd2c\ud83d\ude00" to "😡😡🤬😀"

I'll run tests, and merge if passing 👍