Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Filters








2,810 Hits in 6.0 sec

Visual JND: A Perceptual Measurement in Video Coding

Di Yuan, Tiesong Zhao, Yiwen Xu, Hong Xue, Liqun Lin
2019 IEEE Access  
Next, we introduce the applications of JND models in the perceptual quality evaluation and video compression coding, especially in applying machine-learning techniques to JND prediction.  ...  INDEX TERMS Just noticeable difference (JND), human visual system (HVS), machine learning, perceptual measurement, video coding.  ...  In psychology, the concept of just noticeable difference (JND) was presented. JND determines how accurate human sense are.  ... 
doi:10.1109/access.2019.2901342 fatcat:y3o67i3h75cq5nd3gaa7orsynq

Deep Local and Global Spatiotemporal Feature Aggregation for Blind Video Quality Assessment [article]

Wei Zhou, Zhibo Chen
2020 arXiv   pre-print
Then, the feature aggregation is conducted by the regression model to predict the perceptual video quality.  ...  In recent years, deep learning has achieved promising success for multimedia quality assessment, especially for image quality assessment (IQA).  ...  [8] , the algorithm for video quality assessment via analysis of spatial and spatiotemporal slices (ViS3) [3] , the just noticeable difference-based video quality (JVQ) index [9] , etc.  ... 
arXiv:2009.03411v1 fatcat:3qxvr5izm5cdzl6qgcnbg727iq

A Survey on Perceptually Optimized Video Coding [article]

Yun Zhang, Linwei Zhu, Gangyi Jiang, Sam Kwong, C.-C.Jay Kuo
2022 arXiv   pre-print
Secondly, recent advances on visual factors, computational perceptual models and quality assessment models are presented.  ...  However, the data amount of videos increases exponentially, which requires high efficiency video compression for storage and network transmission.  ...  [46] proposed learning-based Just-Noticeable-Quantization-Distortion (JNQD) models, LR-JNQD and CNN-JNQD, for perceptual video coding, which were able to adjust JND levels according to quantization  ... 
arXiv:2112.12284v2 fatcat:epphkkngbbdpreaxqkekssufli

2020 Index IEEE Transactions on Broadcasting Vol. 66

2020 IEEE transactions on broadcasting  
Zhang, L., Wu, Y., and Li, W., Using NOMA for Enabling Broadcast/Unicast Convergence in 5G Networks; TBC June 2020 503-514  ...  ., and Zhao, W., Future 5G mmWave TV Service With Fast List Decoding of Polar Codes; TBC June 2020 525-533 Hou, J., Wang, W., Zhang, Y., and Liu, X Iradier, E., Montalban, J., Fanari, L., Angueira, P.,  ...  ., +, TBC June 2020 579-588 Visual databases Just Noticeable Difference Level Prediction for Perceptual Image Compression.  ... 
doi:10.1109/tbc.2021.3055975 fatcat:4tbvfkcodrgxbput2p7rpem2na

A Framework to Map VMAF with the Probability of Just Noticeable Difference between Video Encoding Recipes [article]

Jingwen Zhu, Suiyi Ling, Yoann Baveye, Patrick Le Callet
2022 arXiv   pre-print
Just Noticeable Difference (JND) model developed based on Human Vision System (HVS) through subjective studies is valuable for many multimedia use cases.  ...  Nevertheless, recent state-of-the-art deep learning based JND prediction model relies on large-scale JND ground truth that is expensive and time consuming to collect.  ...  Specifically, large-scale JND datasets are necessary for deep learning-based method for SUR prediction [8] - [10] . (2) these SUR/JND models are not codec agnostic.  ... 
arXiv:2205.07565v2 fatcat:tabc6ccgvnbylm6vabq2q56vbm

Perceptual Video Coding for Machines via Satisfied Machine Ratio Modeling [article]

Qi Zhang, Shanshe Wang, Xinfeng Zhang, Chuanmin Jia, Zhao Wang, Siwei Ma, Wen Gao
2024 arXiv   pre-print
We then propose an SMR prediction model based on the correlation between deep feature differences and SMR.  ...  To overcome these limitations, this paper introduces Satisfied Machine Ratio (SMR), a metric that statistically evaluates the perceptual quality of compressed images and videos for machines by aggregating  ...  ACKNOWLEDGMENTS This work was supported in part by the National Natural Science Foundation of China under grant 62072008 and U20A20184, and the High Performance Computing Platform of Peking University,  ... 
arXiv:2211.06797v3 fatcat:cxwvppubfvfozmjkhu6oknen54

DVC-P: Deep Video Compression with Perceptual Optimizations [article]

Saiping Zhang, Marta Mrak, Luis Herranz, Marc Górriz, Shuai Wan, Fuzheng Yang
2021 arXiv   pre-print
Recent years have witnessed the significant development of learning-based video compression methods, which aim at optimizing objective or perceptual quality and bit rates.  ...  Our proposed DVC-P is based on Deep Video Compression (DVC) network, but improves it with perceptual optimizations.  ...  [7] presented an adversarial learned video compression model based on a 3D autoencoder, which tends to eliminate blurred results under extreme video compression.  ... 
arXiv:2109.10849v2 fatcat:yybw353jm5cxhet3kgjczuxddy

The Unreasonable Effectiveness of Deep Features as a Perceptual Metric

Richard Zhang, Phillip Isola, Alexei A. Efros, Eli Shechtman, Oliver Wang
2018 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition  
Acknowledgements This research was supported, in part, by grants from Berkeley Deep Drive, NSF IIS-1633310, and hardware donations by NVIDIA.  ...  We thank members of the Berkeley AI Research Lab and Adobe Research for helpful discussions. We thank Alan Bovik for his insightful comments.  ...  We also collect judgments on a different perceptual test, just noticeable differences (JND). • We show that deep features, trained on supervised, self-supervised, and unsupervised objectives alike, Table  ... 
doi:10.1109/cvpr.2018.00068 dblp:conf/cvpr/ZhangIESW18 fatcat:chyjzhkx7zgynfa2trjtzqfwam

Group Perceptual Quality Optimization for Multi-Channel Image Encoding Systems based on Adaptive Hyper Networks

Nan Chen, Xiaoyu Ma, Yong Chen, Dingguo Yu
2021 IEEE Access  
The GQO framework employs adaptive hyper network to predict the relationships between encoding parameters, transmitting resources, and perceptual qualities, i.e., just taking the pristine image as input  ...  Images and short videos that produced by social networks surge in recent years. Image/Video encoders, such as JPEG and H.264, are indispensably involved to reduce the transmitting bandwidth.  ...  and perceptual quality for each image channel by compressing the source into different versions using various encoding parameters and calculating the IQA prediction score for each of the distorted version  ... 
doi:10.1109/access.2021.3068483 fatcat:d3jzcefg6zcklnwv5zh6qk5e3m

A Perceptual Quality Metric for Video Frame Interpolation [article]

Qiqi Hou, Abhijay Ghildyal, Feng Liu
2022 arXiv   pre-print
Some recent deep learning-based perceptual quality metrics are shown more consistent with human judgments, but their performance on videos is compromised since they do not consider temporal information  ...  In this paper, we present a dedicated perceptual quality metric for measuring video frame interpolation results.  ...  It is a relatively small dataset and hence not suitable for training deep learning models.  ... 
arXiv:2210.01879v1 fatcat:ovt3ypo5gzderg3sxuz5jncx7m

Texture Segmentation Based Video Compression Using Convolutional Neural Networks

Chichen Fu, Di Chen, Edward Delp, Zoe Liu, Fengqing Zhu
2018 IS&T International Symposium on Electronic Imaging Science and Technology  
There has been a growing interest in using different approaches to improve the coding efficiency of modern video codec in recent years as demand for web-based video consumption increases.  ...  In this paper, we propose a model-based approach that uses texture analysis/synthesis to reconstruct blocks in texture regions of a video to achieve potential coding gains using the AV1 codec developed  ...  As a result, deep learning techniques can be developed to perform texture segmentation and classification for the proposed model-based video coding.  ... 
doi:10.2352/issn.2470-1173.2018.2.vipc-155 fatcat:4wo6mehm5fblbegff2xsvqvgxi

Deep Learning-Based Video Coding: A Review and A Case Study [article]

Dong Liu, Yue Li, Jianping Lin, Houqiang Li, Feng Wu
2019 arXiv   pre-print
For deep schemes, pixel probability modeling and auto-encoder are the two approaches, that can be viewed as predictive coding scheme and transform coding scheme, respectively.  ...  However, deep learning-based video coding remains in its infancy.  ...  Ma, Haichuan Ma, Rui Song, Yefei Wang, Ning Yan, Kun Yang, Qingyu Zhang, Zhenxin Zhang, and Haitao Yang.  ... 
arXiv:1904.12462v1 fatcat:cgcmwylwnvd67abpl6wders5hy

ProxIQA: A Proxy Approach to Perceptual Optimization of Learned Image Compression [article]

Li-Heng Chen, Christos G. Bampis, Zhi Li, Andrey Norkin, Alan C. Bovik
2020 arXiv   pre-print
By building on top of an existing deep image compression model, we are able to demonstrate a bitrate reduction of as much as 31% over MSE optimization, given a specified perceptual quality (VMAF) level  ...  Here, we describe a different "proximal" approach to optimize image analysis networks against quantitative perceptual models.  ...  ACKNOWLEDGMENT The authors thank Johannes Ballé for providing the training images.  ... 
arXiv:1910.08845v2 fatcat:mgg2mruvpbfr3pjxoqdwtqnnne

The Unreasonable Effectiveness of Deep Features as a Perceptual Metric [article]

Richard Zhang, Phillip Isola, Alexei A. Efros, Eli Shechtman, Oliver Wang
2018 arXiv   pre-print
We systematically evaluate deep features across different architectures and tasks and compare them with classic metrics.  ...  Recently, the deep learning community has found that features of the VGG network trained on ImageNet classification has been remarkably useful as a training loss for image synthesis.  ...  Acknowledgements This research was supported, in part, by grants from Berkeley Deep Drive, NSF IIS-1633310, and hardware donations by NVIDIA.  ... 
arXiv:1801.03924v2 fatcat:v3rqyohjazb7hjcf4qrrueslmq

JND-Based Perceptual Optimization For Learned Image Compression [article]

Feng Ding, Jian Jin, Lili Meng, Weisi Lin
2023 arXiv   pre-print
However, few of them take the Just Noticeable Difference (JND) characteristic of the Human Visual System (HVS) into account and optimize learned image compression towards perceptual quality.  ...  To address this issue, a JND-based perceptual quality loss is proposed.  ...  Recently, several learningbased JND models [9, 10, 11, 12, 13] further improved the accuracy of JND prediction, which provided new techniques and perspectives of perceptual image/video compression.  ... 
arXiv:2302.13092v2 fatcat:3iaxjeklbnhb5i7elogjgwesju
« Previous Showing results 1 — 15 out of 2,810 results