I block all of Russia and China plus a couple others. Not worth the hassle.
-
WANTED: Happy members who like to discuss audio and other topics related to our interest. Desire to learn and share knowledge of science required. There are many reviews of audio hardware and expert members to help answer your questions. Click here to have your audio equipment measured for free!
Help with Chinese Language
- Thread starter amirm
- Start date
Can I assume you're using the StopForumSpam DB and DNSBL DB?
Presently42
Active Member
I reported one of these a while back, so I'm sad to see this spam is more than just a one-off. Anyway, the characters are simplified, strongly implying the origin of the spam being mainland China: traditional characters are used in Taiwan and Hong Kong (Japan uses a third set). All three posts have the number sequence 993398773, as well as 大学 (dàxué), meaning university.
Source: studied Standard Chinese for a few years. It's been a while, admittedly; and I no longer claim to be conversant in the language, sadly.
Edit: Noting, that Standard Chinese generally doesn't have spacing between words, can your spam filter pick up, that 大学 must occur together, rather than separately? That being said, if having a language other than English being used in posts and titles, I suppose the difference isn't terribly important.
Source: studied Standard Chinese for a few years. It's been a while, admittedly; and I no longer claim to be conversant in the language, sadly.
Edit: Noting, that Standard Chinese generally doesn't have spacing between words, can your spam filter pick up, that 大学 must occur together, rather than separately? That being said, if having a language other than English being used in posts and titles, I suppose the difference isn't terribly important.
So the answer is, as always, just to use more bit depth?
OP
- Thread Starter
- #26
Yes to both.
OP
- Thread Starter
- #27
That's the unknow. I am using wild cards on either side of the spam word so hopefully it does. I did trap him once this week so I am hoping it works.
OP
- Thread Starter
- #28
Thanks. I added all of this. Let's see what happens.
OP
- Thread Starter
- #29
He was there when we first started. Kept it up for a while but then disappeared. Then he came back a year or two later, and left again. Now he is back and has been around for a month or so. I have upped the various countermeasures making his life more difficult so he may disappear again.
OP
- Thread Starter
- #31
Google Lens says:
He was visiting "People's Daily" in 2016.
And hacking your site, of course.
sam_adams
Addicted to Fun and Learning
- Joined
- Dec 24, 2019
- Messages
- 997
- Likes
- 2,416
Person, woman, man, camera, TV.
- Joined
- Jul 21, 2019
- Messages
- 2,363
- Likes
- 3,546
Would it be practical to have posts from new users initially go into a moderation queue? That would at least force spammers / spies to produce legitimate audio content before they could post their curiously coded messages <-(product of an overactive imagination)
OP
- Thread Starter
- #35
I hadn't figure out how but the link above seems to indicate how to do it. So I will look at that.
OP
- Thread Starter
- #36
Yes. The problem is that we will be punishing the good guys in the process. I am doing everything in my power to not do that. It is not very welcoming to moderate new users this way.
Hello,
If the following line is given in XenForo's "Spam Phrases", it will be a "wildcard" match for Chinese ideographs.
Han is one of the Unicode categories indicating ideographic characters used in Chinese, Japanese, Korean, and Vietnamese.
This means that
I don't think there will be nearly as many problems with the text in this forum
www.php.net
If the following line is given in XenForo's "Spam Phrases", it will be a "wildcard" match for Chinese ideographs.
/\p{Han}/uHan is one of the Unicode categories indicating ideographic characters used in Chinese, Japanese, Korean, and Vietnamese.
This means that
\p{Han} would match characters from multiple languages.I don't think there will be nearly as many problems with the text in this forum
PHP: Unicode character properties - Manual
www.php.net
Last edited:
It's not really strange to block non-English character sets. It's an English-writing forum after all.
Very elegant solution. Welcome to ASR.Hello,
If the following line is given in XenForo's "Spam Phrases", it will be a "wildcard" match for Chinese ideographs.
/\p{Han}/u
Han is one of the Unicode categories indicating ideographic characters used in Chinese, Japanese, Korean, and Vietnamese.
This means that\p{Han}would match characters from multiple languages.
I don't think there will be nearly as many problems with the text in this forum
PHP: Unicode character properties - Manual
Perhaps it is better to filter the problematic phrases related to the spam first and see how well that works alone. I've noticed that in regular conversation here, members more than once have posted excerpts from other sites, usually in Chinese- and provided a translation in the case of a new product being launched from a Chinese brand when the news has not made it to western audiences yet. I remember another case- someone was having problems reading a Chinese or Japanese manual or guide for a product and I provided a transcription and translation. While not extremely common on an english-speaking forum, there may be valid cases to use those characters that don't include spam.
- Joined
- Oct 21, 2020
- Messages
- 548
- Likes
- 985
At the risk of going off-thread, I can heartily recommend this book "The Chinese Typewriter: A history". It's an incredible look at the difficulty of language and the development of a machine for communication. You'll discover among other things that 'predictive typing' has been around since ~ 1952. Just amazing. And, for those of you in the Los Angeles area, there's one of the very few remaining typewriters on display in the Huntington Gardens.
I refer to this as an insight into the difficulties of 'defining' language/words when you're dealing with ideographics and homophones. Trickier when there's a need to stop spam for instance. Again, a wonderful albeit a somewhat heavy duty, read.
(This illustrates the complexity also: https://blog.tutorabcchinese.com/expats/why-there-is-no-chinese-alphabet)
I refer to this as an insight into the difficulties of 'defining' language/words when you're dealing with ideographics and homophones. Trickier when there's a need to stop spam for instance. Again, a wonderful albeit a somewhat heavy duty, read.
(This illustrates the complexity also: https://blog.tutorabcchinese.com/expats/why-there-is-no-chinese-alphabet)