PDF(1443 KB)
基于视频帧间局部相关信息的光流估计网络
徐煦, 马鹏飞, 司建军, 高国军
PDF(1443 KB)
PDF(1443 KB)
基于视频帧间局部相关信息的光流估计网络
Optical flow estimation via fusing sequence image intensity correlation information
为解决光流估计网络在目标边缘分割、运动速度和运动方向不准确的问题,提出基于视频帧间局部相关信息的光流估计网络。运用特征编码器从图像中提取出编码特征,通过上下文网络获取图像的上下文特征。采用下采样处理减小特征尺寸提高计算效率。根据连续两帧光流图像位移较小的特性,提出一种分区计算视觉相似度的方法,构建更为精细的4D相关体。采用残差滤波器和相似卷积块的方法,分别针对相关体和光流信息进行操作,更有效地保留局部微小位移信息。研究结果表明:采用基于视频帧间局部相关信息的光流估计网络进行计算,端点误差分别实现了8.0%和5.7%的优化,显著提升了光流估计的准确性,对复杂场景下光流信息提取更准确。研究结果可为自动驾驶、智能安防等领域提供参考。
To address the challenges associated with inaccurate target edge segmentation, motion speed, and motion direction, this paper introduces an optical flow estimation network that leverages local correlation information between video frames. Initially, the network employs a feature encoder to extract encoding features from the image and capture contextual information through a context network. Subsequently, the feature size is reduced through downsampling to enhance computational efficiency. Given the minute displacement of the optical flow image across consecutive frames, a partition-based visual similarity computation method is proposed to construct a more refined 4D correlation volume. Residual filters and similar convolution blocks are utilized for processing the correlation volume and optical flow information, respectively, ensuring the preservation of local small displacement details. The research results show that the optical flow estimation network based on the local correlation information between video frames has achieved optimizations of 8.0% and 5.7% respectively in the optical flow estimation evaluation metric (endpoint error, EPE). This significantly improves the accuracy of optical flow estimation and effectively alleviates the problem of inaccurate optical flow information extraction in complex scenarios. The research conclusions provide references for fields such as autonomous driving and intelligent security.
计算机视觉 / 光流估计 / 深度学习 / 区域匹配 / 迭代更新
computer vision / optical flow estimation / deep learning / regional matching / iterative update
TP391.4
| 1 |
焦红虹,周浩,方淇.基于光流场的时间分段网络行为识别[J].云南大学学报(自然科学版),2019,41(1):36-45.
|
| 2 |
杨华,王姣,张维君 等.基于光流估计的轻量级视频插帧算法[J].沈阳航空航天大学学报,2022,39(6):57-64.
|
| 3 |
李志慧,胡永利,赵永华,等.基于车载的运动行人区域估计方法[J].吉林大学学报(工学版),2018,48(3):694-703.
|
| 4 |
|
| 5 |
|
| 6 |
|
| 7 |
|
| 8 |
|
| 9 |
ILG E,
|
| 10 |
|
| 11 |
|
| 12 |
|
| 13 |
|
| 14 |
|
| 15 |
|
| 16 |
|
| 17 |
张水发,张文生,丁欢,等.融合光流速度与背景建模的目标检测方法[J].中国图象图形学报,2011,16(2):236-243.
|
| 18 |
许广富,曾继超,刘锡祥.融合光流法和特征匹配的视觉里程计[J].激光与光电子学进展,2020,57(20):270-278.
|
| 19 |
安峰,戴军,韩振,等.引入注意力机制的自监督光流计算[J].图学学报,2022,43(5):841-848.
|
| 20 |
|
/
| 〈 |
|
〉 |