问题标签 [snowflake-task]

Please share your experiences wrt orchestrating jobs run through various tools and programmatic interfaces to load data to Snowflake-

1. python scripts in Ec2 instances. currently scheduled using crontab.
2. tasks in snowflake
3. Alteryx workflows

Are there any tools with sophisticated UI to create job workflows with dependencies? The workflow can have - python script followed by a task Alteryx workflow followed by a python script and then a task

If any job fails then it should send emails to the team.

• Thanks

We have a table with 533 columns with a lot of LOB columns that have to be moved to snowflake. Since our source transformation system having an issue to manage 533 columns in one job. We have split ted the columns into 2 jobs. The first job will insert 283 columns and the second job needs to update the remaining column.

We are using one copy command and upsert command respectively for these two jobs.

copy command

Upsert command

I would like to know if we have any other option ?

例如：

来源：S3

预定更新：2次/天

目标：雪花桌

流媒体 ：否

在第 0 天，我在 Snowflake DB 中创建并加载了一个客户表。S3 文件每天更新​​ 2 次，它们也需要反映在雪花表中。

我想提出一个解决方案，以便在没有流式传输或消息传递技术的情况下每天处理 2 次以下 3 个案例

1. 插入 - 新记录
2. 更新 - 现有记录
3. 删除 - 现有记录

我尝试连接雪花（SSO 身份验证）并从表中获取数据。但是，当我运行代码时，我可以在弹出的浏览器窗口中使用我的凭据登录并连接雪花，之后没有响应（程序既不终止也不提供结果）。不确定，在哪里做错了，请帮忙。

'''

帮助中下载 SnowSQL CLI 的 CLI Client(snowSQL) 选项在哪里—>在 Snowflake WebUI 中下载？附上屏幕截图

屏幕截图帮助 —> 下载

有人可以解释一下为什么它只返回两条记录而不是三条记录吗？当我对分隔符进行硬编码以及使用内置 SQL 函数时，我想要相同的结果。

我想使用雪花任务调度程序来克隆一个或所有具有动态克隆数据库名称的数据库，如下所示，是否可以在不创建存储过程的情况下做到这一点。由于我的帐户下有多个数据库，我希望克隆所有数据库在一项任务中

创建数据库 xx_date 克隆 xx

感谢您的回复

谢谢，

根据官方文档，它描述了好像我们可以从一个任务中插入多个表。这听起来不准确，因为

• 一旦消耗，流的偏移量就会被重置
• 一个任务可以只执行一条 SQL 语句

我在这里错过了什么吗？我希望能够通过任务插入从流中读取的 2 个表中。

我们可以向表上的用户授予直接选择或插入访问权限（不创建角色）吗？

[ {“腿”：[{“点”：[{“纬度”：29.76524，“经度”：-95.35406}，{“纬度”：30.74438，“经度”：-101.71203}，{“纬度”：30.74421， “经度”：-101.71247 }，{“纬度”：30.74404，“经度”：-101.71289 }，{“纬度”：30.74366，“经度”：-101.71374 }，{“纬度”：30.74346，“经度”：- 101.71415 }，{“纬度”：30.74303，“经度”：-101.71495 }，{“纬度”：30.74274，“经度”：-101.71543 }，{“纬度”：30.74234，“经度”：-101.71606 }，{“纬度：31.82985，“经度”：-102.34753 }，{“纬度”：31.8302，“经度”：-102.34597 }，{“纬度”：31.83029，“经度”：-102.34557 }，{“纬度”：31.83038，“经度”：-102.34526 }，{“纬度”：31.83051，“经度”：-102.3448 }，{“纬度”：31.83081，“经度”：- 102.344 }，{“纬度”：31.83099，“经度”：-102.34356 }，{“纬度”：31.83113，“经度”：-102.34328 }，{“纬度”：31.83145，“经度”：-102.34271 }，{“纬度”：31.83174，“经度”：-102.34226 }，{“纬度”：31.83207，“经度”：-102.34181 }，{“纬度”：31.83267，“经度”：-102.34109 }，{“纬度”：31.83317， “经度”：-102.34053 }，{“纬度”：31.83359，“经度”：-102.34007 }，{“纬度”：31.8339，“经度：-102.33971 }，{“纬度”：31.83499，“经度”：-102.33852 }，{“纬度”：31.83547，“经度”：-102.338 }，{“纬度”：31.83553，“经度”：-102.33793 }，{“纬度”：31.83685，“经度”：-102.33648 }，{“纬度”：31.83764，“经度”：-102.3356 }，{“纬度”：31.83838，“经度”：-102.33479 }，{“纬度” ": 31.84575, "经度": -102.32666 }, { "纬度": 31.84603, "经度": -102.32636 }, { "纬度": 31.84679, "经度": -102.32551 }, { "纬度": 31.84878, "经度“：-102.32333 }，{“纬度”：31.85095，“经度”：-102.32094 }，{“纬度”：31.85131，“经度：-102.32054 }，{“纬度”：31.85134，“经度”：-102.32044 }，{“纬度”：31.85259，“经度”：-102.31886 }，{“纬度”：31.85273，“经度”：-102.31859 }，{“纬度”：31.85462，“经度”：-102.3165 }，{“纬度”：31.85467，“经度”：-102.31644 }，{“纬度”：31.85489，“经度”：-102.3162 }，{“纬度” ": 31.85505, "经度": -102.3164 }, { "纬度": 31.8552, "经度": -102.3166 }, { "纬度": 31.85533, "经度": -102.31677 }, { "纬度": 31.85506, "经度“：-102.31706 }，{“纬度”：31.85655，“经度”：-102.32234 }，{“纬度”：31.85851，“经度”：-102.32294 } ]，“摘要”：{ “到达时间”：“2020-06-04T01:22:22-05:00”，“出发时间”：“2020-06-03T17:28:11-05: 00”，“lengthInMeters”：863989，“trafficDelayInSeconds”：528，“travelTimeInSeconds”：28451 } }]，“sections”：[{“endPointIndex”：5797，“sectionType”：“TRAVEL_MODE”，“startPointIndex”：0， "travelMode": "car" } ], "summary": { "arrivalTime": "2020-06-04T01:22:22-05:00", "departureTime": "2020-06-03T17:28:11- 05:00”，“lengthInMeters”：863989，“trafficDelayInSeconds”：528，“travelTimeInSeconds”：28451 } } ]22-05:00", "departureTime": "2020-06-03T17:28:11-05:00", "lengthInMeters": 863989, "trafficDelayInSeconds": 528, "travelTimeInSeconds": 28451 } } ], "sections “：[{“endPointIndex”：5797，“sectionType”：“TRAVEL_MODE”，“startPointIndex”：0，“travelMode”：“car”}]，“summary”：{“arrivalTime”：“2020-06-04T01： 22:22-05:00", "departureTime": "2020-06-03T17:28:11-05:00", "lengthInMeters": 863989, "trafficDelayInSeconds": 528, "travelTimeInSeconds": 28451 } } ]22-05:00", "departureTime": "2020-06-03T17:28:11-05:00", "lengthInMeters": 863989, "trafficDelayInSeconds": 528, "travelTimeInSeconds": 28451 } } ], "sections “：[{“endPointIndex”：5797，“sectionType”：“TRAVEL_MODE”，“startPointIndex”：0，“travelMode”：“car”}]，“summary”：{“arrivalTime”：“2020-06-04T01： 22:22-05:00", "departureTime": "2020-06-03T17:28:11-05:00", "lengthInMeters": 863989, "trafficDelayInSeconds": 528, "travelTimeInSeconds": 28451 } } ]28451 } } ]，“sections”：[{“endPointIndex”：5797，“sectionType”：“TRAVEL_MODE”，“startPointIndex”：0，“travelMode”：“car”}]，“summary”：{“arrivalTime”： “2020-06-04T01:22:22-05:00”、“departureTime”：“2020-06-03T17:28:11-05:00”、“lengthInMeters”：863989、“trafficDelayInSeconds”：528、“travelTimeInSeconds ": 28451 } } ]28451 } } ]，“sections”：[{“endPointIndex”：5797，“sectionType”：“TRAVEL_MODE”，“startPointIndex”：0，“travelMode”：“car”}]，“summary”：{“arrivalTime”： “2020-06-04T01:22:22-05:00”、“departureTime”：“2020-06-03T17:28:11-05:00”、“lengthInMeters”：863989、“trafficDelayInSeconds”：528、“travelTimeInSeconds ": 28451 } } ]trafficDelayInSeconds”：528，“travelTimeInSeconds”：28451 } } ]trafficDelayInSeconds”：528，“travelTimeInSeconds”：28451 } } ]