diff --git a/common/pom.xml b/common/pom.xml index 58c2467024..43733499b4 100644 --- a/common/pom.xml +++ b/common/pom.xml @@ -26,7 +26,7 @@ under the License. org.apache.datafusion comet-parent-spark${spark.version.short}_${scala.binary.version} - 0.14.0-SNAPSHOT + 0.14.0 ../pom.xml diff --git a/dev/diffs/3.4.3.diff b/dev/diffs/3.4.3.diff index 5713cacea5..21d77f874d 100644 --- a/dev/diffs/3.4.3.diff +++ b/dev/diffs/3.4.3.diff @@ -7,7 +7,7 @@ index d3544881af1..9c16099090c 100644 2.5.1 2.0.8 + 3.4 -+ 0.14.0-SNAPSHOT ++ 0.14.0 -| | binary | boolean | byte | date | decimal | double | float | integer | long | short | string | timestamp | -|---|---|---|---|---|---|---|---|---|---|---|---|---| -| binary | - | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | C | N/A | -| boolean | N/A | - | C | N/A | C | C | C | C | C | C | C | C | -| byte | C | C | - | N/A | C | C | C | C | C | C | C | C | -| date | N/A | C | C | - | C | C | C | C | C | C | C | C | -| decimal | N/A | C | C | N/A | - | C | C | C | C | C | C | C | -| double | N/A | C | C | N/A | I | - | C | C | C | C | C | C | -| float | N/A | C | C | N/A | I | C | - | C | C | C | C | C | -| integer | C | C | C | N/A | C | C | C | - | C | C | C | C | -| long | C | C | C | N/A | C | C | C | C | - | C | C | C | -| short | C | C | C | N/A | C | C | C | C | C | - | C | C | -| string | C | C | C | C | I | C | C | C | C | C | - | I | -| timestamp | N/A | U | U | C | U | U | U | U | C | U | C | - | + +| | binary | boolean | byte | date | decimal | double | float | integer | long | short | string | timestamp | +| --------- | ------ | ------- | ---- | ---- | ------- | ------ | ----- | ------- | ---- | ----- | ------ | --------- | +| binary | - | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | C | N/A | +| boolean | N/A | - | C | N/A | C | C | C | C | C | C | C | C | +| byte | C | C | - | N/A | C | C | C | C | C | C | C | C | +| date | N/A | C | C | - | C | C | C | C | C | C | C | C | +| decimal | N/A | C | C | N/A | - | C | C | C | C | C | C | C | +| double | N/A | C | C | N/A | I | - | C | C | C | C | C | C | +| float | N/A | C | C | N/A | I | C | - | C | C | C | C | C | +| integer | C | C | C | N/A | C | C | C | - | C | C | C | C | +| long | C | C | C | N/A | C | C | C | C | - | C | C | C | +| short | C | C | C | N/A | C | C | C | C | C | - | C | C | +| string | C | C | C | C | I | C | C | C | C | C | - | I | +| timestamp | N/A | U | U | C | U | U | U | U | C | U | C | - | **Notes:** + - **decimal -> string**: There can be formatting differences in some case due to Spark using scientific notation where Comet does not - **double -> decimal**: There can be rounding differences - **double -> string**: There can be differences in precision. For example, the input "1.4E-45" will produce 1.0E-45 instead of 1.4E-45 @@ -180,31 +182,33 @@ Cast operations in Comet fall into three levels of support: - **float -> string**: There can be differences in precision. For example, the input "1.4E-45" will produce 1.0E-45 instead of 1.4E-45 - **string -> date**: Only supports years between 262143 BC and 262142 AD - **string -> decimal**: Does not support fullwidth unicode digits (e.g \\uFF10) -or strings containing null bytes (e.g \\u0000) + or strings containing null bytes (e.g \\u0000) - **string -> timestamp**: Not all valid formats are supported - - + + ### Try Mode -| | binary | boolean | byte | date | decimal | double | float | integer | long | short | string | timestamp | -|---|---|---|---|---|---|---|---|---|---|---|---|---| -| binary | - | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | C | N/A | -| boolean | N/A | - | C | N/A | C | C | C | C | C | C | C | U | -| byte | U | C | - | N/A | C | C | C | C | C | C | C | C | -| date | N/A | U | U | - | U | U | U | U | U | U | C | C | -| decimal | N/A | C | C | N/A | - | C | C | C | C | C | C | C | -| double | N/A | C | C | N/A | I | - | C | C | C | C | C | C | -| float | N/A | C | C | N/A | I | C | - | C | C | C | C | C | -| integer | U | C | C | N/A | C | C | C | - | C | C | C | C | -| long | U | C | C | N/A | C | C | C | C | - | C | C | C | -| short | U | C | C | N/A | C | C | C | C | C | - | C | C | -| string | C | C | C | C | I | C | C | C | C | C | - | I | -| timestamp | N/A | U | U | C | U | U | U | U | C | U | C | - | + +| | binary | boolean | byte | date | decimal | double | float | integer | long | short | string | timestamp | +| --------- | ------ | ------- | ---- | ---- | ------- | ------ | ----- | ------- | ---- | ----- | ------ | --------- | +| binary | - | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | C | N/A | +| boolean | N/A | - | C | N/A | C | C | C | C | C | C | C | U | +| byte | U | C | - | N/A | C | C | C | C | C | C | C | C | +| date | N/A | U | U | - | U | U | U | U | U | U | C | C | +| decimal | N/A | C | C | N/A | - | C | C | C | C | C | C | C | +| double | N/A | C | C | N/A | I | - | C | C | C | C | C | C | +| float | N/A | C | C | N/A | I | C | - | C | C | C | C | C | +| integer | U | C | C | N/A | C | C | C | - | C | C | C | C | +| long | U | C | C | N/A | C | C | C | C | - | C | C | C | +| short | U | C | C | N/A | C | C | C | C | C | - | C | C | +| string | C | C | C | C | I | C | C | C | C | C | - | I | +| timestamp | N/A | U | U | C | U | U | U | U | C | U | C | - | **Notes:** + - **decimal -> string**: There can be formatting differences in some case due to Spark using scientific notation where Comet does not - **double -> decimal**: There can be rounding differences - **double -> string**: There can be differences in precision. For example, the input "1.4E-45" will produce 1.0E-45 instead of 1.4E-45 @@ -212,31 +216,33 @@ or strings containing null bytes (e.g \\u0000) - **float -> string**: There can be differences in precision. For example, the input "1.4E-45" will produce 1.0E-45 instead of 1.4E-45 - **string -> date**: Only supports years between 262143 BC and 262142 AD - **string -> decimal**: Does not support fullwidth unicode digits (e.g \\uFF10) -or strings containing null bytes (e.g \\u0000) + or strings containing null bytes (e.g \\u0000) - **string -> timestamp**: Not all valid formats are supported - - + + ### ANSI Mode -| | binary | boolean | byte | date | decimal | double | float | integer | long | short | string | timestamp | -|---|---|---|---|---|---|---|---|---|---|---|---|---| -| binary | - | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | C | N/A | -| boolean | N/A | - | C | N/A | C | C | C | C | C | C | C | U | -| byte | U | C | - | N/A | C | C | C | C | C | C | C | C | -| date | N/A | U | U | - | U | U | U | U | U | U | C | C | -| decimal | N/A | C | C | N/A | - | C | C | C | C | C | C | C | -| double | N/A | C | C | N/A | I | - | C | C | C | C | C | C | -| float | N/A | C | C | N/A | I | C | - | C | C | C | C | C | -| integer | U | C | C | N/A | C | C | C | - | C | C | C | C | -| long | U | C | C | N/A | C | C | C | C | - | C | C | C | -| short | U | C | C | N/A | C | C | C | C | C | - | C | C | -| string | C | C | C | C | I | C | C | C | C | C | - | I | -| timestamp | N/A | U | U | C | U | U | U | U | C | U | C | - | + +| | binary | boolean | byte | date | decimal | double | float | integer | long | short | string | timestamp | +| --------- | ------ | ------- | ---- | ---- | ------- | ------ | ----- | ------- | ---- | ----- | ------ | --------- | +| binary | - | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | C | N/A | +| boolean | N/A | - | C | N/A | C | C | C | C | C | C | C | U | +| byte | U | C | - | N/A | C | C | C | C | C | C | C | C | +| date | N/A | U | U | - | U | U | U | U | U | U | C | C | +| decimal | N/A | C | C | N/A | - | C | C | C | C | C | C | C | +| double | N/A | C | C | N/A | I | - | C | C | C | C | C | C | +| float | N/A | C | C | N/A | I | C | - | C | C | C | C | C | +| integer | U | C | C | N/A | C | C | C | - | C | C | C | C | +| long | U | C | C | N/A | C | C | C | C | - | C | C | C | +| short | U | C | C | N/A | C | C | C | C | C | - | C | C | +| string | C | C | C | C | I | C | C | C | C | C | - | I | +| timestamp | N/A | U | U | C | U | U | U | U | C | U | C | - | **Notes:** + - **decimal -> string**: There can be formatting differences in some case due to Spark using scientific notation where Comet does not - **double -> decimal**: There can be rounding differences - **double -> string**: There can be differences in precision. For example, the input "1.4E-45" will produce 1.0E-45 instead of 1.4E-45 @@ -244,9 +250,9 @@ or strings containing null bytes (e.g \\u0000) - **float -> string**: There can be differences in precision. For example, the input "1.4E-45" will produce 1.0E-45 instead of 1.4E-45 - **string -> date**: Only supports years between 262143 BC and 262142 AD - **string -> decimal**: Does not support fullwidth unicode digits (e.g \\uFF10) -or strings containing null bytes (e.g \\u0000) + or strings containing null bytes (e.g \\u0000) - **string -> timestamp**: ANSI mode not supported - - + + See the [tracking issue](https://github.com/apache/datafusion-comet/issues/286) for more details. diff --git a/fuzz-testing/pom.xml b/fuzz-testing/pom.xml index 110fa2ed96..fe64e65e1a 100644 --- a/fuzz-testing/pom.xml +++ b/fuzz-testing/pom.xml @@ -25,7 +25,7 @@ under the License. org.apache.datafusion comet-parent-spark${spark.version.short}_${scala.binary.version} - 0.14.0-SNAPSHOT + 0.14.0 ../pom.xml diff --git a/pom.xml b/pom.xml index 4bd0c9dc23..cb3bbcb97e 100644 --- a/pom.xml +++ b/pom.xml @@ -30,7 +30,7 @@ under the License. org.apache.datafusion comet-parent-spark${spark.version.short}_${scala.binary.version} - 0.14.0-SNAPSHOT + 0.14.0 pom Comet Project Parent POM diff --git a/spark-integration/pom.xml b/spark-integration/pom.xml index ad232b6914..fd75eea702 100644 --- a/spark-integration/pom.xml +++ b/spark-integration/pom.xml @@ -26,7 +26,7 @@ under the License. org.apache.datafusion comet-parent-spark${spark.version.short}_${scala.binary.version} - 0.14.0-SNAPSHOT + 0.14.0 ../pom.xml diff --git a/spark/pom.xml b/spark/pom.xml index 1b207288c9..7b49573366 100644 --- a/spark/pom.xml +++ b/spark/pom.xml @@ -26,7 +26,7 @@ under the License. org.apache.datafusion comet-parent-spark${spark.version.short}_${scala.binary.version} - 0.14.0-SNAPSHOT + 0.14.0 ../pom.xml