web-scraping - OpenRefine/google 精炼可以用于登录后的页面吗？

Question

如果没有，是否有类似的替代方案可以？

我查看了文档，但看不到有关此主题的任何内容，尽管它必须是一个常见的要求。

需要明确的是，我的意思是基于 Web 的登录表单，而不是基本的 HTTP 身份验证。

Answer 1

YES it can be installed behind a proxy for example, a more secure method, since basic auth password is in the clear = bad, is to install a real web server up-front, use its authentication layer and, say, mod_proxy to tunnel OpenRefine thru.

Here is the simplest example:

<VirtualHost __YOUR_IP__:80>

ProxyPass        / http://127.0.0.1:3333/
ProxyPassReverse / http://127.0.0.1:3333/

<Location />
 AuthType Digest
 AuthName "My Own Hosted Refine"
 AuthUserFile /path/to/my/password.htpasswd
 Require valid-user
</Location>

</VirtualHost>

The ALTERNATIVE, just use an Amazon EC2 instance (or a Cloud hosting provider that offers security groups by IP) that can only be accessed by your IP address - http://docs.aws.amazon.com/gettingstarted/latest/wah-linux/getting-started-application-server.html

Answer 2

@Thad 方法是正确的。我还将以此指向 Tony Hisrt OpenRefine Docker Containers。

我不知道这两者是否相关，但我刚刚在OpenRefine Mailing List上回答了一个非常相似的问题。