Available SQL Functions in Glue

Using the step: "Derived Column" where I can use SQL functions to derive new columns I found SUBSTRING works but CHARINDEX it doesn't. And as usual with AWS documentation, there's no place or indication which functions are available in this particular kind of glue node.

主題

分析資料庫

標籤

分析 AWS Glue 提取轉換與載入資料

語言

English

blanchma

已提問 1 年前檢視次數 343 次

1 個回答

最新
最多得票
最多評論

已接受的答案

Are you using DynamicFrames?

You can convert it to DataFrame and then use SparkSQL functions.

https://spark.apache.org/docs/latest/api/sql/index.html

acmanjon

已回答 1 年前

專家

Sedat Salman

已審閱 1 年前

blanchma
1 年前
The goal is to use "Derived Column" and not dabble with the script itself.
blanchma
1 年前
Actually that list is correct. Thanks, @acmanjon
Gonzalo Herreros 專家
1 年前
Yes, that node allows using SparkSQL functions based on the Glue version you are using (3.3.0 for Glue 4 and 3.1.1 for Glue 3)

Available SQL Functions in Glue

相關內容