Progress Checklist
Data Types
| Functions | Supported ✅ ? |
|---|---|
| ArrayType | ⬜️ |
| BinaryType | ⬜️ |
| BooleanType | ⬜️ |
| ByteType | ⬜️ |
| DataType | ⬜️ |
| DateType | ✅ |
| DecimalType | ⬜️ |
| DoubleType | ✅ |
| FloatType | ✅ |
| IntegerType | ✅ |
| LongType | ✅ |
| MapType | ⬜️ |
| NullType | ⬜️ |
| ShortType | ✅ |
| StringType | ✅️ |
| StructField | ⬜️ |
| StructType | ⬜️ |
| TimestampType | ✅️ |
DataFrame APIs
Functions
| Functions | Accelerated ✅ ? |
|---|---|
| abs | ✅ |
| acos | ✅️ |
| acosh | ✅️ |
| add_months | ⬜️ |
| approxCountDistinct | ✅ |
| asin | ✅️ |
| asinh | ✅️ |
| atan | ✅️ |
| atanh | ✅️ |
| atan2 | ⬜️ |
| avg | ✅ |
| ceil | ⬜️ |
| conv | ⬜️ |
| corr | ✅ |
| cos | ⬜️ |
| cosh | ✅️ |
| count | ✅ |
| countDistinct | ✅ |
| cume_dist | ⬜️ |
| current_date | ⬜️ |
| current_timestamp | ⬜️ |
| date_add | ⬜️ |
| date_format | ⬜️ |
| date_sub | ⬜️ |
| date_trunc | ⬜️ |
| datediff | ⬜️ |
| dayofmonth | ⬜️ |
| dayofweek | ⬜️ |
| dayofyear | ⬜️ |
| days | ⬜️ |
| exp | ✅️ |
| explode | ⬜️ |
| explode_outer | ⬜️ |
| expm1 | ⬜️ |
| expr | ✅ |
| factorial | ⬜️ |
| isnan | ✅ |
| isnull | ✅️ |
| levenshtein | ⬜️ |
| log | ✅️ |
| log10 | ✅️ |
| log1p | ✅️ |
| log2 | ✅️ |
| max | ✅ |
| mean | ✅️ |
| min | ✅ |
| minute | ⬜️ |
| month | ⬜️ |
| months | ⬜️ |
| months_between | ⬜️ |
| next_day | ⬜️ |
| nth_value | ⬜️ |
| percent_rank | ⬜️ |
| percentile_approx | ⬜️ |
| pow | ✅️ |
| quarter | ⬜️ |
| radians | ⬜️ |
| rank | ⬜️ |
| second | ⬜️ |
| shiftLeft | ⬜️ |
| shiftRight | ⬜️ |
| shiftRightUnsigned | ⬜️ |
| signum | ⬜️ |
| sin | ✅️ |
| sinh | ✅️ |
| size | ⬜️ |
| skewness | ⬜️ |
| slice | ⬜️ |
| sort_array | ⬜️ |
| soundex | ⬜️ |
| split | ⬜️ |
| sqrt | ✅️ |
| stddev | ✅️ |
| stddev_pop(col) | ⬜️ |
| stddev_samp(col) | ⬜️ |
| struct | ⬜️ |
| substring | ✅ |
| substring_index | ⬜️ |
| sum) | ✅ |
| sumDistinct | ⬜️ |
| tan | ✅ |
| tanh | ✅ |
| timestamp_seconds | ⬜️ |
| toDegrees | ⬜️ |
| toRadians | ⬜️ |
| upper | ⬜️ |
| var_pop | ⬜️ |
| var_samp | ⬜️ |
| variance | ⬜️ |
| weekofyear | ⬜️ |
| when | ✅ |
| window | ⬜️ |
| year | ⬜️ |
| years | ⬜️ |
Grouping
| Functions | Supported ✅? |
|---|---|
| GroupedData.avg | ✅ |
| GroupedData.count | ✅ |
| GroupedData.max | ✅️ |
| GroupedData.mean | ✅️ |
| GroupedData.min | ✅️ |
| GroupedData.pivot | ⬜️ |
| GroupedData.sum | ✅ |