databricks - 将数据加载到 Synapse 时出现 Databricks 错误：java.lang.IllegalArgumentException：列号不匹配

Question

Exception encountered in Azure Synapse Analytics connector code

Databricks 到 Synapse 数据加载错误：

Caused by: java.lang.IllegalArgumentException: Column number mismatch

Answer 1

Databricks 使用 spark 驱动程序连接到 synapse，它检查 azure synapse 表（如果是现有表）和 spark datafarme 之间的列数、名称、列顺序。如果不匹配，则会抛出错误。

 com.databricks.spark.sqldw.SqlDWConnectorException: Exception encountered in Azure Synapse Analytics connector code ..........
    Caused by: java.lang.IllegalArgumentException: Column number mismatch