Error on pasting in different language

What character set is used on your databases and tables? Is it UTF-8 anywhere?

No issue with these characters on my local installation (UTF-8 everywhere, utf-8 mysql tables and collation).

my problem with:

"Lukšič"

PDOException: SQLSTATE[HY000]: General error: 1366 Incorrect string value: '\xC4\x8D' for column 'title' at row 1: UPDATE {node} SET vid=:db_update_placeholder_0, type=:db_update_placeholder_1, language=:db_update_placeholder_2, title=:db_update_placeholder_3, uid=:db_update_placeholder_4, status=:db_update_placeholder_5, created=:db_update_placeholder_6, changed=:db_update_placeholder_7, comment=:db_update_placeholder_8, promote=:db_update_placeholder_9, sticky=:db_update_placeholder_10, tnid=:db_update_placeholder_11, translate=:db_update_placeholder_12 WHERE (nid = :db_condition_placeholder_0) ; Array ( [:db_update_placeholder_0] => 1162 [:db_update_placeholder_1] => profile [:db_update_placeholder_2] => und [:db_update_placeholder_3] => Lukšič [:db_update_placeholder_4] => 1 [:db_update_placeholder_5] => 1 [:db_update_placeholder_6] => 1307544979 [:db_update_placeholder_7] => 1309524543 [:db_update_placeholder_8] => 0 [:db_update_placeholder_9] => 0 [:db_update_placeholder_10] => 0 [:db_update_placeholder_11] => 0 [:db_update_placeholder_12] => 0 [:db_condition_placeholder_0] => 1162 ) in drupal_write_record() (line 6859 of /xxx/includes/common.inc).

I tried Lukšič on my local install and it worked fine, so this must be an encoding/collation issue locally.

Please post the collation for the database (and table, and column since they can be different on MySQL) to this issue, without that this is going to be very hard to fix.

sorry - i did a research and it was some migration related stuff (on field level - so it was a little bit tricky to find out ...)

I got the message when I tried to paste 𐤈.
(U+10908 PHOENICIAN LETTER TET)

It appears to happen only with MySQL :

- D7, MySQL: getting error message
- D6, MySQL: no error, but character silently removed
- D7, SQLite: no error, character saved and displayed correctly

From MySQL documentation ( http://dev.mysql.com/doc/refman/5.5/en/charset-unicode-utf8mb4.html ), MySQL only uses up to 3 bytes per character when using utf8 encoding. As your character contains 4 bytes, it can't work correctly with MySQL default utf8 encoding.

The solution is to use MySQL 5.5.3 or later and the utf8mb4 encoding which supports 4 bytes characters.

Why don't we catch this exeption?
Can we change drupal_validate_utf8?

drupal_validate_utf8() is used in a lot of places throughout the code, the bug described here only happens when trying to save content to a MySQL DB that is not using utf8mb4 encoding.

However it could be useful to open a separate issue about content validation.

Opened related issue at #1314214: MySQL driver does not support full UTF-8 (emojis, asian symbols, mathematical symbols).

Postponing until #1314214: MySQL driver does not support full UTF-8 (emojis, asian symbols, mathematical symbols) is fixed.

How does this differ from #1314214: MySQL driver does not support full UTF-8 (emojis, asian symbols, mathematical symbols)? Close as duplicate? if this issue is about showing a proper error message, then this should not be postponed but be done now and deprecated when the other issue gets in.

Postponed issue fixed in D8.

Let's close this as a duplicate of #1314214: MySQL driver does not support full UTF-8 (emojis, asian symbols, mathematical symbols), as I don't see what this issue adds to that other one.