Unicode Support

All string functions have been updated to support Unicode. The functions assume that the string contains valid UTF-8 encoded code points. There are no explicit checks for valid UTF-8, and the functions may return incorrect results on invalid UTF-8. Invalid UTF-8 data can be corrected with from_utf8().

Additionally, the functions operate on Unicode code points and not user visible characters (or grapheme clusters). Some languages combine multiple code points into a single user-perceived character, the basic unit of a writing system for a language, but the functions will treat each code point as a separate unit.

Regular Expression Functions

All Regular Expression Functions have been rewritten to improve performance. The new versions are often twice as fast and in some cases can be many orders of magnitude faster (due to removal of quadratic behavior). This change introduced some minor incompatibilities that are explained in the documentation for the functions.

General Changes

• Add support for partitioned right outer joins, which allows for larger tables to be joined on the inner side.
• Add support for full outer joins.
• Support returning booleans as numbers in JDBC driver
• Fix contains() to return NULL if the value was not found, but a NULL was.
• Fix nested ROW rendering in DESCRIBE.
• Add array_join().
• Optimize map subscript operator.
• Add from_utf8() and to_utf8() functions.
• Add task_writer_count session property to set task.writer-count.
• Add cast from ARRAY<F> to ARRAY<T>.
• Extend implicit coercions to ARRAY element types.
• Implement implicit coercions in VALUES expressions.
• Fix potential deadlock in scheduler.

Hive Changes

• Collect more metrics from PrestoS3FileSystem.
• Retry when seeking in PrestoS3FileSystem.
• Ignore InvalidRange error in PrestoS3FileSystem.
• Implement rename and delete in PrestoS3FileSystem.
• Fix assertion failure when running SHOW TABLES FROM schema.
• Fix S3 socket leak when reading ORC files.