我很好奇哪些选项最适合我的用例,并认为如果我分享我的结果可能对其他人有帮助:
简而言之,选择最快速的地方(对我来说!)。还值得注意的是,使用所有选项都会返回重复项,但except 除外。
Option 0: SELECT {c2} FROM {t2} WHERE {c2} not in (SELECT {c1} FROM {t1});
Entries returned: 1098, Unique entries returned: 357
Average: 1.8680 seconds
Entries returned: 0, Unique entries returned: 0
Average: 0.6664 seconds
Option 1: SELECT {c2} FROM {t2} EXCEPT SELECT {c1} FROM {t1};
Entries returned: 357, Unique entries returned: 357
Average: 3.9455 seconds
Entries returned: 0, Unique entries returned: 0
Average: 3.3074 seconds
Option 2: SELECT {t2}.{c2} FROM {t2} LEFT OUTER JOIN {t1} ON {t1}.{c1} = {t2}.{c2} WHERE {t1}.{c1} IS null;
Entries returned: 1098, Unique entries returned: 357
Average: 2.3330 seconds
Entries returned: 0, Unique entries returned: 0
Average: 1.1982 seconds
Option 3: SELECT {c2} FROM {t2} WHERE NOT EXISTS (SELECT 1 FROM {t1} WHERE {c1} = {t2}.{c2});
Entries returned: 1098, Unique entries returned: 357
Average: 2.6945 seconds
Entries returned: 0, Unique entries returned: 0
Average: 0.9737 seconds
这是我用来运行数字的代码:
import sqlite3
import timeit
# Database path here
database = "database.db"
# Your table and column names here
t1, c1 = 'Table_1', 'name'
t2, c2 = 'Table_2', 'temp_name'
# Reverse the test
dbs = [{'t1': t1, 'c1':c1, 't2': t2, 'c2': c2},
{'t1': t2, 'c1':c2, 't2': t1, 'c2': c1}]
commands = ["SELECT {c2} FROM {t2} WHERE {c2} not in (SELECT {c1} FROM {t1});",
"SELECT {c2} FROM {t2} EXCEPT SELECT {c1} FROM {t1};",
"SELECT {c2} FROM {t2} LEFT OUTER JOIN {t1} ON {t1}.{c1} = {t2}.{c2} WHERE {t2}.{c2} IS null;",
"SELECT {c2} FROM {t2} WHERE NOT EXISTS (SELECT 1 FROM {t1} WHERE {c1} = {t2}.{c2});",]
for i, c in enumerate(commands):
print("Option {}: {}".format(i, c))
for db in dbs:
co = c.format(**db)
foo = sqlite3.connect(database).execute(co).fetchall()
# Sanity check that entries have been found and how many
print("\tEntries returned: {}, Unique entries returned: {}".format(len(foo), len({a[0] for a in foo})))
# Reconnect to the database each time - I can't remember if there's any caching
t = timeit.repeat(lambda: sqlite3.connect(database).execute(co).fetchall(), repeat=5, number=1)
print('\tAverage: {:.4f} seconds'.format(statistics.mean(t)))