4

编辑:升级到 OpenCV 2.4.2 和 FFMPEG 0.11.1 似乎已经解决了所有的错误和连接问题,但它仍然没有解决帧速率下降的问题。

我在 Ubuntu 12.04 中使用默认的 OpenCV 包,我相信它是 2.3.1。我正在连接流式传输 MJPEG 的 Foscam FI8910W。我已经看到人们说最好的方法是使用 opencv+libjpeg+curl,因为它比 gstreamer 解决方案更快。但是,我偶尔(50% 的时间)可以在构建时从 OpenCV 连接到摄像头并获取视频流。该流以大约 30 fps 的速度开始大约 1 秒,然后减慢到 5-10 fps。我正在进行的项目将需要 6 台摄像机,最好以 15-30 fps 的速度运行(越快越好)。

以下是我的问题:

  1. 这是 2.4.2 中修复的问题,我应该升级吗?
  2. 如果没有,有什么想法为什么我会短暂爆发然后变慢?
  3. 最好的解决方案仍然是使用 curl+libjpeg 吗?
  4. 我看到很多人说已经发布了解决方案,但很少有实际链接到带有解决方案的帖子。根据http://opencv-users.1802565.n2.nabble.com/IP-camera-solution-td7345005.html在一个地方引用所有实际解决方案(包括 curl 和 gstreamer)将非常方便。

这是我的代码:

  VideoCapture cap;
  cap.open("http://10.10.1.10/videostream.asf?user=test&pwd=1234&resolution=32");
  Mat frame;
  cap >> frame;
  wr.open("test.avi", CV_FOURCC('P','I','M','1'), 29.92, frame.size(), true);
  if(!wr.isOpened())
  {
    cout << "Video writer open failed" << endl;
    return(-1);
  }
  Mat dst = Mat::zeros(frame.rows + HEADER_HEIGHT, frame.cols, CV_8UC3);
  Mat roi(dst, Rect(0, HEADER_HEIGHT-1, frame.cols, frame.rows));
  Mat head(dst, Rect(0,0,frame.cols, HEADER_HEIGHT));
  Mat zhead = Mat::zeros(head.rows, head.cols, CV_8UC3);
  namedWindow("test", 1);
  time_t tnow;
  tm *tS;
  double t1 = (double)getTickCount();
  double t2;
  for(int i = 0; i>-1 ; i++) // infinite loop
  {
    cap >> frame;
    if(!frame.data)
      break;
    tnow = time(0);
    tS = localtime(&tnow);
    frame.copyTo(roi);
    std::ostringstream L1, L2;
    L1 << tS->tm_year+1900 << " " << coutPrep << tS->tm_mon+1 << " ";
    L1 << coutPrep << tS->tm_mday << " ";
    L1 << coutPrep << tS->tm_hour;
    L1 << ":" << coutPrep << tS->tm_min << ":" << coutPrep << tS->tm_sec;
    actValueStr = L1.str();
    zhead.copyTo(head);
    putText(dst, actValueStr, Point(0,HEADER_HEIGHT/2), fontFace, fontScale, Scalar(0,255,0), fontThickness, 8);
    L2 << "Frame: " << i;
    t2 = (double)getTickCount();
    L2 << "  " << (t2 - t1)/getTickFrequency()*1000. << " ms";
    t1 = (double)getTickCount();
    actValueStr = L2.str();
    putText(dst, actValueStr, Point(0,HEADER_HEIGHT), fontFace, fontScale, Scalar(0,255,0), fontThickness, 8);
    imshow("test", dst);
    wr << dst; // write frame to file
    cout << "Frame: " << i << endl;
    if(waitKey(30) >= 0)
      break;
  }

以下是正确运行时列出的错误:

Opening 10.10.1.10
Using network protocols without global network initialization. Please use avformat_network_init(), this will become mandatory later.
Using network protocols without global network initialization. Please use avformat_network_init(), this will become mandatory later.
[asf @ 0x701de0] max_analyze_duration reached
[asf @ 0x701de0] Estimating duration from bitrate, this may be inaccurate
[asf @ 0x701de0] ignoring invalid packet_obj_size (21084 656 21720 21740)
[asf @ 0x701de0] freeing incomplete packet size 21720, new 21696
[asf @ 0x701de0] ff asf bad header 0  at:1029744
[asf @ 0x701de0] ff asf skip 678 (unknown stream)
[asf @ 0x701de0] ff asf bad header 45  at:1030589
[asf @ 0x701de0] packet_obj_size invalid
[asf @ 0x701de0] ff asf bad header 29  at:1049378
[asf @ 0x701de0] packet_obj_size invalid
[asf @ 0x701de0] freeing incomplete packet size 21820, new 21684
[asf @ 0x701de0] freeing incomplete packet size 21684, new 21836
Using network protocols without global network initialization. Please use avformat_network_init(), this will become mandatory later.
Using network protocols without global network initialization. Please use avformat_network_init(), this will become mandatory later.
[asf @ 0x701de0] Estimating duration from bitrate, this may be inaccurate
Successfully opened network camera
[swscaler @ 0x8cf400] No accelerated colorspace conversion found from yuv422p to bgr24.
Output #0, avi, to 'test.avi':
Stream #0.0: Video: mpeg1video (hq), yuv420p, 640x480, q=2-31, 19660 kb/s, 90k tbn, 29.97 tbc
[swscaler @ 0x9d25c0] No accelerated colorspace conversion found from yuv422p to bgr24.
Frame: 0
[swscaler @ 0xa89f20] No accelerated colorspace conversion found from yuv422p to bgr24.
Frame: 1
[swscaler @ 0x7f7840] No accelerated colorspace conversion found from yuv422p to bgr24.
Frame: 2
[swscaler @ 0xb9e6c0] No accelerated colorspace conversion found from yuv422p to bgr24.
Frame: 3

Estimating duration from bitrate有时它在第一个语句之后挂起

4

2 回答 2

0

您是否尝试过删除写入磁盘的代码?当磁盘缓冲区填满时,我看到 USB 相机的性能问题非常相似。一开始帧率很高,然后急剧下降。

如果这是问题所在,另一种选择是将压缩编解码器更改为压缩更显着的东西。

于 2014-07-15T20:59:13.627 回答
0

快速初始 FPS 变为慢速 FPS 表明相机正在增加曝光时间以补偿光线不足的主体。相机正在分析前几帧,然后相应地调整曝光时间。

似乎实际的 FPS 是两件事的结合:

  1. 硬件限制(定义最大 FPS)
  2. 所需曝光时间(定义最低 FPS)

硬件可能具有传输 X FPS 所需的带宽,但光线不足的条件下可能需要曝光时间,从而减慢实际 FPS。例如,如果每帧需要曝光 0.1 秒,则禁食 FPS 为 10。

为了测试这一点,请在相机指向光线不足的对象时测量 FPS,并将其与相机指向光线良好的对象时的 FPS 进行比较。一定要夸大照明条件,并给相机几秒钟的时间来检测所需的曝光。

于 2016-09-23T17:40:48.960 回答