我无法从熊猫数据框创建表。
hdfs = ibis.impala.hdfs_connect(host=host_name,
port = n_port,
protocol = "https",
auth_mechanism='GSSAPI',
verify = False
)
con = ibis.impala.connect(
host = impala_host,
port = imapla_port,
auth_mechanism = "GSSAPI",
kerberos_service_name="impala",
use_ssl = True,
hdfs_client=hdfs,
database=schema
)
df = pd.DataFrame({'foo': [1, 2, 3, 4], 'bar': ['a', 'b', 'c', 'd']})
con.create_table('pandas_table',df)
日志似乎是:
..../pandas_5cefdfabb2ae4c6d870a533bf234b689/0.csv has an invalid Parquet version number: 4,d\n\n
宜必思尝试将 csv 插入镶木地板是否正常?不应该是拼花桌吗?我看到的唯一解决方案是创建一个文本表并使用选择插入它。