QUALITY EVALUATION OF LONG DURATION AUDIOVISUAL CONTENT
MetadataVis full innførsel
Subjective quality assessment of multi-modal services depends on a number of external factors that affect the final judgment, e.g. user expectations, user fatigue, room environment or methodology used in the evaluation process. In order to obtain as accurate as possible measurement of the perceived quality, an experimenter should carefully consider all factors contributing to the overall experience. Particulary important is to choose the right measurement method for the purpose of a specific task. In spite of the fact that a number of standardized test procedures for the quality assessment exist it is not always possible to find the one which suits a certain research purpose. In such case, the development of new assessment techniques is usually necessary, which then needs to be followed by appropriate testing and validation procedures. The lack of an appropriate methodology for instantaneous measurement of user’s audio-visual quality expectations/preferences over extended periods of time, as well as the scarce attention devoted to the topic of temporal development of Quality of Experience, were the main driving factors for this work. This dissertation, composed of five papers, helps to understand the underlying attributes of perceived quality and user cognitive processes used in evaluation of long duration audiovisual content. The work described here is twofold: firstly, a novel methodology for continuous quality evaluation is proposed, and secondly, using the method, the effect of the time dimension on user’s behavioral reaction to the experienced quality is investigated. The momentary-based approach described in this work reflects instantaneous measures of users’ quality judgements. Such measures allow capturing time varying changes of system characteristics and help to contribute to the holistic vision of quality of experience. The results obtained from several experiments described in this work reveal the importance of content duration in the process of quality assessment and its impact on user’s quality requirements. The knowledge gained from those studies can be directly applied to the quality assurance models of multimedia content providers and may serve as a valuable source of information for objective quality metrics development.
Består avPaper A: Borowiak, Adam Dominik; Reiter, Ulrich; Svensson, U. Peter. Quality Evaluation of Long Duration Audiovisual Content. I: 2012 IEEE Consumer Communications and Networking Conference (CCNC). IEEE conference proceedings 2012 http://dx.doi.org/10.1109/CCNC.2012.6181113 (c) 2012 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works.
Paper B: Borowiak, Adam Dominik; Reiter, Ulrich. Quality Evaluation of Long Duration AV Content — An Extended Analysis Using a Novel Assessment Methodology. Multimedia tools and applications 2014 ;Volum 74.(2) s. 367-380, The final publication is available at Springer via http://dx.doi.org/10.1007/s11042-014-1920-7
Paper C: Borowiak, Adam Dominik; Reiter, Ulrich; Svensson, U. Peter. Audio quality requirements and comparison of multimodal vs. unimodal perception of impairments for long duration content. Journal of Signal Processing Systems 2014 ;Volum 74.(1) s. 79-89, The final publication is available at Springer via http://dx.doi.org/10.1007/s11265-013-0777-8
Paper D: Borowiak, Adam Dominik; Reiter, Ulrich. Long Duration Audiovisual Content:Impact of Content Type and Impairment Appearance on User Quality Expectations Over Time. I: Fifth International Workshop on Quality of Multimedia Experience (QoMEX 2013). IEEE conference proceedings http://dx.doi.org/10.1109/QoMEX.2013.6603237 (c) 2013 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works.
Paper E: Borowiak, Adam Dominik; Reiter, Ulrich; Svensson, U. Peter. Momentary Quality of Experience: Users’ Audio Quality Preferences Measured Under Different Presentation Conditions. Journal of The Audio Engineering Society 2014 ;Volum 62.(4) s. 235-243 - Is not included due to copyright