1

MRE:

  • 从 Fusion 创建数据集

  • 在代码工作簿中创建了一个转换

    def unnamed(src):
        src.createOrReplaceTempView('view_src')
        df = spark.sql(f"""SELECT * FROM view_src""")
        return df
    

在此处输入图像描述

Traceback (most recent call last):
  File "unnamed", line 1, in <module>
  File "unnamed", line 3, in unnamed
  File "/opt/conda/lib/python3.7/site-packages/pyspark/sql/session.py", line 649, in sql
    return DataFrame(self._jsparkSession.sql(sqlQuery), self._wrapped)
  File "/opt/conda/lib/python3.7/site-packages/py4j/java_gateway.py", line 1305, in __call__
    answer, self.gateway_client, self.target_id, self.name)
  File "/opt/conda/lib/python3.7/site-packages/pyspark/sql/utils.py", line 128, in deco
    return f(*a, **kw)
  File "/opt/conda/lib/python3.7/site-packages/py4j/protocol.py", line 328, in get_return_value
    format(target_id, ".", name), value)
py4j.protocol.Py4JJavaError: An error occurred while calling o651.sql.
: com.palantir.foundry.spark.api.errors.DatasetPathNotFoundException: view_src
...

如何从临时视图中将此表作为数据框取回?

我也试过了createOrReplaceGlobalTempView
在代码存储库中,给定的代码片段可以正常工作。

4

0 回答 0