Available SQL Functions in Glue

Using the step: "Derived Column" where I can use SQL functions to derive new columns I found SUBSTRING works but CHARINDEX it doesn't. And as usual with AWS documentation, there's no place or indication which functions are available in this particular kind of glue node.

主题

分析数据库

标签

分析 AWS Glue 提取变换和加载数据

语言

English

blanchma

已提问 1 年前341 查看次数

1 回答

最新
投票最多
评论最多

已接受的回答

Are you using DynamicFrames?

You can convert it to DataFrame and then use SparkSQL functions.

https://spark.apache.org/docs/latest/api/sql/index.html

acmanjon

已回答 1 年前

专家

Sedat Salman

已审核 1 年前

blanchma
1 年前
The goal is to use "Derived Column" and not dabble with the script itself.
blanchma
1 年前
Actually that list is correct. Thanks, @acmanjon
Gonzalo Herreros 专家
1 年前
Yes, that node allows using SparkSQL functions based on the Glue version you are using (3.3.0 for Glue 4 and 3.1.1 for Glue 3)

Available SQL Functions in Glue

相关内容