我有一个使用 Play Framework 2.2.0-scala 构建的示例,该示例使用 WebSocket 将数据流式传输到客户端。我遇到的问题是,无论出于何种原因,父 Actor 的一个孩子没有正确关闭。所有日志都表明它正在停止并且已经关闭,但我发现它实际上并没有通过向其发布数据而关闭。这是一些代码,首先是我的控制器操作:
def scores(teamIds: String) = WebSocket.async[JsValue] { request =>
val teamIdsArr:Array[String] = teamIds.split(",").distinct.map { el =>
s"nfl-streaming-scores-${el}"
}
val scoresStream = Akka.system.actorOf(Props(new ScoresStream(teamIdsArr)))
ScoresStream.join(scoresStream)
}
因此,每次客户端连接时,它们都会加入ScoresStream
,返回 WebSocket.async 所需的相应 Iteratee,Enumerator。实际的 ScoresStream 对象如下所示:
object ScoresStream {
implicit val timeout = Timeout(5 seconds)
def join(scoresStream:ActorRef):scala.concurrent.Future[(Iteratee[JsValue,_],Enumerator[JsValue])] = {
(scoresStream ? BeginStreaming).map {
case Connected(enumerator) =>
val iteratee = Iteratee.foreach[JsValue] { _ =>
Logger.info("Ignore iteratee input.")
}.map { _ =>
Logger.info("Client quitting - killing Actor.")
scoresStream ! UnsubscribeAll
scoresStream ! PoisonPill
}
(iteratee,enumerator)
}
ScoresStream
这里的想法是在客户端断开连接时杀死主要 Actor 。我通过使用scoresStream ! PoisonPill
.
ScoresStream
依次创建Pub
和Sub
实例,它们是连接到 Redis 以发布/写入消息的包装器,这是 Actor 代码:
class ScoresStream(teamIds: Array[String]) extends Actor with CreatePubSub with akka.actor.ActorLogging {
val (scoresEnumerator, scoresChannel) = Concurrent.broadcast[JsValue]
case class Message(kind: String, user: String, message: String)
implicit val messageReads = Json.reads[Message]
implicit val messageWrites = Json.writes[Message]
val sub = context.child("sub") match {
case None => createSub(scoresChannel)
case Some(c) => c
}
val pub = context.child("pub") match {
case None => createPub(teamIds)
case Some(c) => c
}
def receive = {
case BeginStreaming => {
log.info("hitting join...")
sub ! RegisterCallback
sub ! SubscribeChannel(teamIds)
sender ! Connected(scoresEnumerator)
}
case UnsubscribeAll => {
sub ! UnsubscribeChannel(teamIds)
}
}
}
trait CreatePubSub { self:Actor =>
def createSub(pChannel: Concurrent.Channel[JsValue]) = context.actorOf(Props(new Sub(pChannel)), "sub")
def createPub(teamIds: Array[String]) = context.actorOf(Props(new Pub(teamIds)), "pub")
}
最后,这是实际的 Sub Actor 代码:(Pub
在这里似乎不相关,因为它正在正常关闭):
class Sub(pChannel: Concurrent.Channel[JsValue]) extends Actor with CreatePublisherSubscriber with ActorLogging {
val s = context.child("subscriber") match {
case None => createSubscriber
case Some(c) => c
}
def callback(pubsub: PubSubMessage) = pubsub match {
case E(exception) => println("Fatal error caused consumer dead. Please init new consumer reconnecting to master or connect to backup")
case S(channel, no) => println("subscribed to " + channel + " and count = " + no)
case U(channel, no) => println("unsubscribed from " + channel + " and count = " + no)
case M(channel, msg) =>
msg match {
// exit will unsubscribe from all channels and stop subscription service
case "exit" =>
println("unsubscribe all ..")
pChannel.end
r.unsubscribe
// message "+x" will subscribe to channel x
case x if x startsWith "+" =>
val s: Seq[Char] = x
s match {
case Seq('+', rest @ _*) => r.subscribe(rest.toString){ m => }
}
// message "-x" will unsubscribe from channel x
case x if x startsWith "-" =>
val s: Seq[Char] = x
s match {
case Seq('-', rest @ _*) => r.unsubscribe(rest.toString)
pChannel.end
}
case x =>
try {
log.info("Just got a message: " + x)
pChannel.push(Json.parse(x))
}
catch {
case ex: com.fasterxml.jackson.core.JsonParseException => {
log.info("Malformed JSON sent.")
}
}
}
}
def receive = {
case RegisterCallback => {
log.info("Creating a subscriber and registering callback")
s ! Register(callback)
}
case SubscribeChannel(teamIds) => {
teamIds.foreach { x => log.info("subscribing to channel " + x + " ") }
//sub ! Subscribe(Array("scores-5","scores-6"))
s ! Subscribe(teamIds)
}
case UnsubscribeChannel(teamIds) => {
teamIds.foreach { x => log.info("unsubscribing from channel " + x + " ") }
s ! Unsubscribe(teamIds)
}
case true => println("Subscriber successfully received message.")
case false => println("Something went wrong.")
}
}
trait CreatePublisherSubscriber { self:Actor =>
def r = new RedisClient("localhost", 6379)
def createSubscriber = context.actorOf(Props(new Subscriber(r)), "subscriber")
def createPublisher = context.actorOf(Props(new Publisher(r)), "publisher")
}
现在,当客户端连接时,启动消息看起来很健康:
[DEBUG] [10/20/2013 00:35:53.618] [application-akka.actor.default-dispatcher-12] [akka://application/user] now supervising Actor[akka://application/user/$c#-54456921]
[DEBUG] [10/20/2013 00:35:53.619] [application-akka.actor.default-dispatcher-12] [akka://application/user/$c] started (com.example.stream.models.ScoresStream@131a9310)
[DEBUG] [10/20/2013 00:35:53.620] [application-akka.actor.default-dispatcher-12] [akka://application/user/$c] now supervising Actor[akka://application/user/$c/sub#1376180991]
[DEBUG] [10/20/2013 00:35:53.621] [application-akka.actor.default-dispatcher-17] [akka://application/user/$c/pub/publisher] started (com.redis.Publisher@3b34c0a6)
[DEBUG] [10/20/2013 00:35:53.622] [application-akka.actor.default-dispatcher-17] [akka://application/user/$c/sub/subscriber] started (com.redis.Subscriber@453f0a8)
Subscriber successfully received message.
Subscriber successfully received message.
[DEBUG] [10/20/2013 00:35:53.699] [application-akka.actor.default-dispatcher-19] [akka://application/user/$c/sub] started (com.example.stream.models.Sub@6165ab39)
[DEBUG] [10/20/2013 00:35:53.699] [application-akka.actor.default-dispatcher-19] [akka://application/user/$c/sub] now supervising Actor[akka://application/user/$c/sub/subscriber#-1562348862]
subscribed to nfl-streaming-scores-5 and count = 1
[DEBUG] [10/20/2013 00:35:53.699] [application-akka.actor.default-dispatcher-12] [akka://application/user/$c] now supervising Actor[akka://application/user/$c/pub#-707418539]
[INFO] [10/20/2013 00:35:53.700] [application-akka.actor.default-dispatcher-12] [akka://application/user/$c] hitting join...
[INFO] [10/20/2013 00:35:53.700] [application-akka.actor.default-dispatcher-23] [akka://application/user/$c/sub] Creating a subscriber and registering callback
[INFO] [10/20/2013 00:35:53.700] [application-akka.actor.default-dispatcher-23] [akka://application/user/$c/sub] subscribing to channel nfl-streaming-scores-5
[DEBUG] [10/20/2013 00:35:53.700] [application-akka.actor.default-dispatcher-18] [akka://application/user/$c/pub] started (com.example.stream.models.Pub@48007a17)
[DEBUG] [10/20/2013 00:35:53.703] [application-akka.actor.default-dispatcher-18] [akka://application/user/$c/pub] now supervising Actor[akka://application/user/$c/pub/publisher#1509054514]
断开连接看起来很健康:
[info] application - Client quitting - killing Actor.
unsubscribed from nfl-streaming-scores-5 and count = 0
[DEBUG] [10/20/2013 00:37:51.696] [application-akka.actor.default-dispatcher-17] [akka://application/user/$c] received AutoReceiveMessage Envelope(PoisonPill,Actor[akka://application/deadLetters])
[INFO] [10/20/2013 00:37:51.696] [application-akka.actor.default-dispatcher-25] [akka://application/user/$c/sub] unsubscribing from channel nfl-streaming-scores-5
[DEBUG] [10/20/2013 00:37:51.696] [application-akka.actor.default-dispatcher-17] [akka://application/user/$c] stopping
[DEBUG] [10/20/2013 00:37:51.697] [application-akka.actor.default-dispatcher-25] [akka://application/user/$c/sub] stopping
[DEBUG] [10/20/2013 00:37:51.697] [application-akka.actor.default-dispatcher-25] [akka://application/user/$c/pub/publisher] stopped
[DEBUG] [10/20/2013 00:37:51.697] [application-akka.actor.default-dispatcher-17] [akka://application/user/$c/sub/subscriber] stopped
[DEBUG] [10/20/2013 00:37:51.697] [application-akka.actor.default-dispatcher-17] [akka://application/user/$c/sub] stopped
[INFO] [10/20/2013 00:37:51.697] [application-akka.actor.default-dispatcher-17] [akka://application/user/$c/sub] Message [java.lang.Boolean] from Actor[akka://application/user/$c/sub/subscriber#-1562348862] to Actor[akka://application/user/$c/sub#1376180991] was not delivered. [2] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[DEBUG] [10/20/2013 00:37:51.699] [application-akka.actor.default-dispatcher-26] [akka://application/user/$c/pub] stopping
[DEBUG] [10/20/2013 00:37:51.699] [application-akka.actor.default-dispatcher-26] [akka://application/user/$c/pub] stopped
[DEBUG] [10/20/2013 00:37:51.699] [application-akka.actor.default-dispatcher-17] [akka://application/user/$c] stopped
问题来了,在客户端断开连接后,我将发送一条消息,表明当前关闭的 Actor 已订阅:
redis-cli publish "nfl-streaming-scores-5" "{\"test\":\"message\"}"
在这里它出现了,当它不应该出现的时候,这个 Actor 在技术上应该已经死了。之前在场的其他 Actor 也会收到该消息,标记为 $a/$b 的 Actor。我可以确认没有其他客户端连接。
[INFO] [10/20/2013 00:38:33.097] [Thread-7] [akka://application/user/$c/sub] Just got a message: {"test":"message"}
还有一个奇怪的指标是地址名称永远不会被重复使用。当我断开/连接时,我不断看到类似以下名称的趋势:
akka://application/user/$c
akka://application/user/$d
akka://application/user/$e
永远不会看到旧的引用被重用。
我在这里的假设是与 Redis 的连接没有被完全关闭。它没有解释为什么日志说 Actor 已经停止但仍然存在,但我肯定看到netstat
即使在所有 Actor 可能都死了之后,在运行后也建立了与 redis 的连接。当我完全停止应用程序运行时,这些连接就会清除。就好像取消订阅默默地失败了,这使 Actor 和连接保持活动状态,这由于多种原因而非常糟糕,因为最终系统将耗尽文件描述符和/或内存泄漏。这里有什么明显的地方我做错了吗?