Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

4lang issues #30

Open
GKingA opened this issue Apr 30, 2021 · 3 comments
Open

4lang issues #30

GKingA opened this issue Apr 30, 2021 · 3 comments

Comments

@GKingA
Copy link
Collaborator

GKingA commented Apr 30, 2021

There are some cases, where half of the sentence is left out right after a conjunction.
For example:

Meine Mutter hat mir erzählt, dass mein Vater einen Wahlkreiskandidaten nicht gewählt hat, weil der gegen die Homo-Ehe ist ☺

@HugoMuellerVogg @spdde Hat Rente nichts mit sozialer Gerechtigkeit zu tun?

Sometimes only the first word is kept from the sentence:

Verloren wäre die Zeit, in der wir nicht als Menschen gelebt, Erfahrungen gemacht, gelernt,geschaffen, genossen und gelitten hätten.

Twitter specific issue:

@JoeHellBack @ThomasMichael71 @alexa_jung60 @Tschonka @dasstimmvieh @Mohrenpost Och, antifeministisch bin ich auch :)

becomes

(u_1 / ATSYMBOLJoeHellBack)

and

#Lesetipp: Rede von Prof. Dr. Friedhelm Hengsbach SJ: »@Umfairteilen jetzt!« #Sozialwort #Vermögenssteuer #Kapitalismus (via @wiuge)

becomes

(u_1 / HASHTAGLesetipp) (u_1 / HASHTAGSozialwort)

@recski
Copy link
Owner

recski commented May 11, 2021

fixed in 87080ea

@Eszti
Copy link
Collaborator

Eszti commented Aug 13, 2021

Can this issue be closed?

@recski
Copy link
Owner

recski commented Aug 16, 2021

yes, I think so, the 4lang issues mentioned here were fixed and the twitter-specific things are taken care of in the preprocessing, I think. But @GKingA can verify - and she may have run into new German-specific issues recently.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants