我正在尝试从他们的安全浏览 API 下载 Google 的网络钓鱼和恶意软件列表。我想使用新的 V3 API。
我设法获得了构成列表的重定向 URL。这是我得到的回复:
n:1710
i:googpub-phish-shavar
u:safebrowsing-cache.google。com/safebrowsing/rd/ChRnb29ncHViLXBoaXNoLXNoYXZhcjgBQAJKDAgBEOeYARjqmAEgAUoMCAEQu5gBGOWYASABSgwIARDplwEYuZgBIAFKDAgBENmXARjnlwEgAUoMCAEQxpcBGNeXASABSgwIARDDlwEYxJcBIAFKDAgBELCXARjBlwEgAUoMCAEQgpcBGK6XASABSgwIARD-lgEYgJcBIAFKDAgBEOGWARj8lgEgAUoMCAEQ2pYBGN-WASABSgwIARDQlgEY2JYBIAFKDAgBEMKWARjOlgEgAUoMCAEQvZYBGMCWASABSgwIARC6lgEYu5YBIAFKDAgBELWWARi4lgEgAUoMCAEQsJYBGLOWASABSgwIARCmlgEYrpYBIAFKDAgBEJ6WARihlgEgAUoMCAEQm5YBGJyWASABSgwIARCWlgEYmZYBIAFKDAgBEJOWARiUlgEgAUoMCAEQjZYBGJGWASABSgwIARD-lQEYi5YBIAFKDAgBEPeVARj7lQEgAUoMCAEQ9JUBGPSVASABSgwIARDolQEY8JUBIAFKDAgBEOSVARjmlQEgAUoMCAEQ4JUBGOKVASABSgwIARDYlQEY3JUBIAFKDAgBENGVARjVlQEgAUoMCAEQzZUBGM-VASABSgwIARDIlQEYyZUBIAFKDAgBEMCVARjGlQEgAUoMCAEQvpUBGL6VASABSgwIARC7lQEYvJUBIAFKDAgBELiVARi4lQEgAUoMCAEQs5UBGLaVASABSgwIARCwlQEYsZUBIAFKDAgBEK6VARiulQEgAUoMCAEQqpUBGKyVASABSgwIARCmlQEYqJUBIAFKDAgBEKKVARiilQEgAUoMCAEQnZUBGJ2VASABSgwIARCWlQEYl5UBIAFKDAgBEJSVARiUlQEgAUoMCAEQj5UBGJCVASABSgwIARCNlQEYjZUBIAFKDAgBEIWVARiIlQEgAUoMCAEQgZUBGIOVASABSgwiARD7lAEY_5QBIAFKDAgBEPWUARj4lAEgAUoMCAEQ8JQBGPCUASAB
u:safebrowsing-cache.google.com/safebrowsing/rd/ChRnb29ncHViLXBoaXNoLXNoYXZhcjgBQAJKEAgAEIydExicqRMgASoC0QU
u:safebrowsing-cache.google.com/safebrowsing/rd/ChRnb29ncHViLXBoaXNoLXNoYXZhcjgBQAJKEAgAEMCOExiLnRMgASoC0gg
u:safebrowsing-cache.google.com/safebrowsing/rd/ChRnb29ncHViLXBoaXNoLXNoYXZhcjgBQAJKEAgAEKP-Ehi_jhMgASoC_A4
u:safebrowsing -cache.google.com/safebrowsing/rd/ChRnb29ncHViLXBoaXNoLXNoYXZhcjgBQAJKFAgAENjsEhii_hIgASoGsALLBeMF
u:safebrowsing-cache.google.com/safebrowsing/rd/ChRnb29ncHViLXBoaXNoLXNoYXZhcjgBQAJKIAgAEObcEhjfjX7BIgASoGsALLBeMF
我的问题是:
1. 如何将列表保存到数据库中?块文件中的每一行是否仅被散列或者我需要使用协议缓冲区对其进行反序列化?
2. 我如何检查给定的 URL 是否错误?我需要散列吗?
3. 我如何需要我有哪些块?