Skip to content

Allow unicode_set_filter in IcuNormalizationCharFilter #994

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
burakfahri opened this issue Apr 14, 2025 · 3 comments
Open

Allow unicode_set_filter in IcuNormalizationCharFilter #994

burakfahri opened this issue Apr 14, 2025 · 3 comments
Labels
Area: Specification Related to the API spec used to generate client code Category: Bug Something isn't working

Comments

@burakfahri
Copy link

burakfahri commented Apr 14, 2025

Java API client version

8.16.1

Java version

21

Elasticsearch Version

8.13.4

Problem description

In IcuNormatlizationChatFilter class, there is no field called unicode_set_filter. We use it to control which letters are normalized(documentation: https://www.elastic.co/guide/en/elasticsearch/plugins/current/analysis-icu-normalization-charfilter.html). The exception that we get is like the following:

Caused by: co.elastic.clients.json.JsonpMappingException: Error deserializing 
co.elastic.clients.elasticsearch._types.analysis.IcuNormalizationCharFilter: Unknown field 'unicode_set_filter' (JSON path: template.settings.analysis.char_filter.custom_icu_normalizer.unicode_set_filter) (in object at line no=1910, column no=38, offset=57197)
		at co.elastic.clients.json.ObjectDeserializer.parseUnknownField(ObjectDeserializer.java:291)
		at co.elastic.clients.json.ObjectDeserializer.deserializeInner(ObjectDeserializer.java:212)
		at co.elastic.clients.json.ObjectDeserializer.deserialize(ObjectDeserializer.java:166)
		at co.elastic.clients.json.ObjectDeserializer.deserialize(ObjectDeserializer.java:157)
		at co.elastic.clients.json.JsonpDeserializer.deserialize(JsonpDeserializer.java:77)
		at co.elastic.clients.json.ObjectBuilderDeserializer.deserialize(ObjectBuilderDeserializer.java:79)
		at co.elastic.clients.json.DelegatingDeserializer$SameType.deserialize(DelegatingDeserializer.java:43)
		at co.elastic.clients.json.ObjectDeserializer$FieldObjectDeserializer.deserialize(ObjectDeserializer.java:78)
		at co.elastic.clients.json.ObjectDeserializer.deserializeInner(ObjectDeserializer.java:231)
		at co.elastic.clients.json.ObjectDeserializer.deserialize(ObjectDeserializer.java:166)
		at co.elastic.clients.json.ObjectDeserializer.deserialize(ObjectDeserializer.java:157)
		at co.elastic.clients.json.BuildFunctionDeserializer.deserialize(BuildFunctionDeserializer.java:53)
		at co.elastic.clients.json.DelegatingDeserializer$SameType.deserialize(DelegatingDeserializer.java:48)
		at co.elastic.clients.json.UnionDeserializer$SingleMemberHandler.deserialize(UnionDeserializer.java:74)
		at co.elastic.clients.json.UnionDeserializer.deserialize(UnionDeserializer.java:287)
		at co.elastic.clients.json.UnionDeserializer.deserialize(UnionDeserializer.java:258)
		at co.elastic.clients.json.DelegatingDeserializer$SameType.deserialize(DelegatingDeserializer.java:43)
		at co.elastic.clients.json.JsonpDeserializerBase$StringMapDeserializer.deserialize(JsonpDeserializerBase.java:349)
		at co.elastic.clients.json.JsonpDeserializerBase$StringMapDeserializer.deserialize(JsonpDeserializerBase.java:333)
		at co.elastic.clients.json.JsonpDeserializer.deserialize(JsonpDeserializer.java:77)
		at co.elastic.clients.json.ObjectDeserializer$FieldObjectDeserializer.deserialize(ObjectDeserializer.java:78)
		at co.elastic.clients.json.ObjectDeserializer.deserializeInner(ObjectDeserializer.java:214)
		at co.elastic.clients.json.ObjectDeserializer.deserialize(ObjectDeserializer.java:166)
		at co.elastic.clients.json.ObjectDeserializer.deserialize(ObjectDeserializer.java:157)
		at co.elastic.clients.json.JsonpDeserializer.deserialize(JsonpDeserializer.java:77)
		at co.elastic.clients.json.ObjectBuilderDeserializer.deserialize(ObjectBuilderDeserializer.java:79)
		at co.elastic.clients.json.DelegatingDeserializer$SameType.deserialize(DelegatingDeserializer.java:43)
		at co.elastic.clients.json.ObjectDeserializer$FieldObjectDeserializer.deserialize(ObjectDeserializer.java:78)
		at co.elastic.clients.json.ObjectDeserializer.deserializeInner(ObjectDeserializer.java:214)
		at co.elastic.clients.json.ObjectDeserializer.deserialize(ObjectDeserializer.java:166)
		at co.elastic.clients.json.ObjectDeserializer.deserialize(ObjectDeserializer.java:157)
		at co.elastic.clients.json.JsonpDeserializer.deserialize(JsonpDeserializer.java:77)
		at co.elastic.clients.json.ObjectBuilderDeserializer.deserialize(ObjectBuilderDeserializer.java:79)
		at co.elastic.clients.json.DelegatingDeserializer$SameType.deserialize(DelegatingDeserializer.java:43)
		at co.elastic.clients.json.ObjectDeserializer$FieldObjectDeserializer.deserialize(ObjectDeserializer.java:78)
		at co.elastic.clients.json.ObjectDeserializer.deserializeInner(ObjectDeserializer.java:214)
		at co.elastic.clients.json.ObjectDeserializer.deserialize(ObjectDeserializer.java:166)
		at co.elastic.clients.json.ObjectDeserializer.deserialize(ObjectDeserializer.java:157)
		at co.elastic.clients.json.JsonpDeserializer.deserialize(JsonpDeserializer.java:77)
		at co.elastic.clients.json.ObjectBuilderDeserializer.deserialize(ObjectBuilderDeserializer.java:79)
		at co.elastic.clients.json.DelegatingDeserializer$SameType.deserialize(DelegatingDeserializer.java:43)
		at co.elastic.clients.json.ObjectDeserializer$FieldObjectDeserializer.deserialize(ObjectDeserializer.java:78)
		at co.elastic.clients.json.ObjectDeserializer.deserializeInner(ObjectDeserializer.java:214)
		at co.elastic.clients.json.ObjectDeserializer.deserialize(ObjectDeserializer.java:166)
		at co.elastic.clients.util.WithJsonObjectBuilderBase.withJson(WithJsonObjectBuilderBase.java:54)
		at com.meltwater.es.ESClientImpl$putTemplate$1.invoke$lambda$0(ESClientImpl.kt:362)
		at co.elastic.clients.elasticsearch.indices.ElasticsearchIndicesAsyncClient.putIndexTemplate(ElasticsearchIndicesAsyncClient.java:1615)
@burakfahri
Copy link
Author

I have a PR to fix the problem: elastic/elasticsearch-specification#4275

@l-trotta l-trotta added Area: Specification Related to the API spec used to generate client code Category: Bug Something isn't working labels Apr 15, 2025
@l-trotta
Copy link
Contributor

hey @burakfahri thanks for the report and fix! someone will take care of this in the specification repo, then we'll regenerate the java client to fix the issue

@burakfahri
Copy link
Author

Hello @l-trotta, let me know if I can do anything more about it please

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Area: Specification Related to the API spec used to generate client code Category: Bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants