3

我正在尝试使用 akka 演员从 scala 应用程序中运行 PhantomJS：

val process = Process("phantomjs --ignore-ssl-errors=yes " + myrenderscript.js + args ...)
val result = process.run(processLogger, true).exitValue() match {
  case ExitCode.SUCCESS => Left(Success)
  case ExitCode.TIMEOUT => Right(TimeoutError)
  case ExitCode.OPEN_FAILED => Right(NetworkError)
  case _ => Right(UnknownError)        
}

myrenderscript.js 看起来像这样：

var version = "1.1";

var TIMEOUT = 30000,
EXIT_SUCCESS = 0,
EXIT_TIMEOUT = 2,
EXIT_OPEN_FAILED = 3;


if (phantom.args.length < 2) {
    console.log("Usage: phantomjs render.js parentUrl output [width height]");
    phantom.exit(1);
}
var url = phantom.args[0];
var output = phantom.args[1];

var width = parseInt(phantom.args[2] || 1024);
var height = parseInt(phantom.args[3] || 1024);
var clipwidth = parseInt(phantom.args[4] || 1024);
var clipheight = parseInt(phantom.args[5] || 1024);
var zoom = parseFloat(phantom.args[6] || 1.0);
var phantom_version = phantom.version.major + "." + phantom.version.minor + "." +    phantom.version.patch;
var userAgentString = "PhantomJS/" + phantom_version + " screenshot-webservice/" + version;

renderUrlToFile(url, output, width, height, clipwidth, clipheight, zoom, userAgentString, function (url, file) {
    console.log("Rendered '" + url + "' at size (" + width + "," + height + ") into '" + output + "'");
    phantom.exit(EXIT_SUCCESS);
    phantom = null;
});

setTimeout(function () {
    console.error("Timeout reached (" + TIMEOUT + "ms): " + url);
    phantom.exit(EXIT_TIMEOUT);
}, TIMEOUT);


function renderUrlToFile(url, file, width, height, clipwidth, clipheight, zoom,    userAgentString, callback) {
    console.log("renderUrlToFile start: " + url)
    var page = new WebPage();
    page.viewportSize = { width: width, height: height };
    page.clipRect = { top: 0, left: 0, width: clipwidth, height: clipheight};
    page.settings.userAgent = userAgentString;
    page.zoomFactor = zoom;
    page.open(url, function (status) {
        console.log("renderUrlToFile open page: " + url)
        if (status !== "success") {
            console.log("Unable to render '" + url + "' (" + status + ")");
            page.release();
            page.close();
            page = null;
            phantom.exit(EXIT_OPEN_FAILED);
        } else {
            console.log("renderUrlToFile open page success and pre-render: " + url)
            page.render(file);
            console.log("renderUrlToFile open page post-render: " + url)
            page.release();
            page.close();
            page = null;
            callback(url, file);
        }
    });
}

在创建进程之前和完成运行之后，正在创建大约 4 个新线程。

每次调用创建进程的方法时，都会创建并启动新线程。该过程完成后，线程回到监视状态。最终我的应用程序需要超过 500 个线程（我正在捕获一个大型网站和内部链接）

如何让 scala 清理运行 phantomjs 时创建的线程？

编辑：

我已更改 scala 代码以执行以下操作：

val process = Process("phantomjs --ignore-ssl-errors=yes " + myrenderscript.js + args ...).run(processLogger, connectInput)
val result = process.exitValue() match {
  case ExitCode.SUCCESS => Left(Success)
  case ExitCode.TIMEOUT => Right(TimeoutError)
  case ExitCode.OPEN_FAILED => Right(NetworkError)
  case _ => Right(UnknownError)        
}
process.destroy()

然而，线程仍然存在......

4

1 回答 1

3

我想通了为什么它没有清​​理线程，但我不完全理解它。因此，如果有人在这里发布真正的答案，我会投票赞成该答案。

问题是我将connectInput 值设置为true。当我将其设置为 false 时，线程会按预期销毁。我不确定为什么。

当设置为 true 时，线程转储显示其中一个线程正在阻塞其他线程：

Thread-3@2830 daemon, prio=5, in group 'main', status: 'RUNNING'
 blocks Thread-63@4131
 blocks Thread-60@4127
 blocks Thread-57@4125
 blocks Thread-54@4121
 blocks Thread-51@4103
 blocks Thread-48@4092
 blocks Thread-45@4072
 blocks Thread-42@4061
 blocks Thread-39@4054
 blocks Thread-36@4048
 blocks Thread-33@4038
 blocks Thread-30@4036
 blocks Thread-27@4008
 blocks Thread-24@3996
 blocks Thread-21@3975
 blocks Thread-18@3952
 blocks Thread-15@3939
 blocks Thread-12@3905
 blocks Thread-9@3885
 blocks Thread-6@3850
  at java.io.FileInputStream.readBytes(FileInputStream.java:-1)
  at java.io.FileInputStream.read(FileInputStream.java:220)
  at java.io.BufferedInputStream.read1(BufferedInputStream.java:256)
  at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
  at java.io.FilterInputStream.read(FilterInputStream.java:116)
  at java.io.FilterInputStream.read(FilterInputStream.java:90)
  at scala.sys.process.BasicIO$.loop$1(BasicIO.scala:225)
  at scala.sys.process.BasicIO$.transferFullyImpl(BasicIO.scala:233)
  at scala.sys.process.BasicIO$.transferFully(BasicIO.scala:214)
  at scala.sys.process.BasicIO$.connectToIn(BasicIO.scala:183)
  at scala.sys.process.BasicIO$$anonfun$input$1.apply(BasicIO.scala:190)
  at scala.sys.process.BasicIO$$anonfun$input$1.apply(BasicIO.scala:189)
  at scala.sys.process.ProcessBuilderImpl$Simple$$anonfun$2.apply$mcV$sp(ProcessBuilderImpl.scala:72)
  at scala.sys.process.ProcessImpl$Spawn$$anon$1.run(ProcessImpl.scala:22)

我最初以为是进程记录器，但事实并非如此。

谁可以给我解释一下这个？

于 2013-04-04T17:26:27.950 回答