2

我正在考虑尝试 BigQuery 和 GithubArchive,但我不确定如何编写一个查询,让我可以在代码或项目中搜索一个术语,并按提交次数降序排列结果。

感谢您的任何提示

4

2 回答 2

1

加载到 BigQuery 的 GithubArchive 数据没有源代码副本,因此无法在代码中搜索词。但是,如果您想在存储库描述中搜索一个术语,然后按提交次数选择顶级存储库,这里是一个示例如何执行此操作(此示例中的术语是“SQL”):

select count(*) c, repository_url, repository_description
from [githubarchive:github.timeline]
where type = 'PushEvent' and repository_description contains 'SQL'
group by 2, 3
order by c desc
limit 10

这导致

14925   https://github.com/danberindei/infinispan   Infinispan is an open source data grid platform and highly scalable NoSQL cloud data store.  
9377    https://github.com/postgres/postgres    Mirror of the official PostgreSQL GIT repository. Note that this is just a *mirror* - we don't work with pull requests on github. To contribute, please see http://wiki.postgresql.org/wiki/Submitting_a_Patch   
4876    https://github.com/galderz/infinispan   Infinispan is an open source data grid platform and highly scalable NoSQL cloud data store.  
4747    https://github.com/triAGENS/ArangoDB    ArangoDB is a multi-purpose, open-source database with flexible data models for documents, graphs, and key-values. Build high performance applications using a convenient SQL-like query language or JavaScript/Ruby extensions. Use ACID transaction if you require them. Scale horizontally and vertically with a few mouse clicks.    
3590    https://github.com/webnotes/erpnext Open Source, web-based ERP based on Python, Javascript and MySQL.    
3489    https://github.com/anistor/infinispan   Infinispan is an open source data grid platform and highly scalable NoSQL cloud data store.  
3263    https://github.com/youtube/vitess   vitess provides servers and tools which facilitate scaling of MySQL databases for large scale web services.  
3071    https://github.com/infinispan/infinispan    Infinispan is an open source data grid platform and highly scalable NoSQL cloud data store.  
2631    https://github.com/theory/sqitch    Simple SQL change management     
2358    https://github.com/zzzeek/sqlalchemy    Mirror of SQLAlchemy
于 2015-11-28T01:41:40.840 回答
1
SELECT COUNT(1) c, repository_url, repository_description
FROM [githubarchive:github.timeline]
WHERE type = 'PushEvent' 
AND REGEXP_MATCH(repository_description, r'(?i)SQL')
GROUP BY 2, 3
ORDER BY c DESC
LIMIT 10

BigQuery 支持正则表达式,因此您可以极大地改进/缩小搜索结果,灵活地使用搜索模式与搜索词

以下参考资料可以进一步帮助您:

BigQuery 正则表达式函数
re2 语法

于 2015-11-28T17:57:39.797 回答