Crowd workers proven useful : a comparative study of subjective video quality assessment

Lade...
Vorschaubild
Dateien
Saupe_0-371921.pdf
Saupe_0-371921.pdfGröße: 159.54 KBDownloads: 236
Datum
2016
Herausgeber:innen
Kontakt
ISSN der Zeitschrift
Electronic ISSN
ISBN
Bibliografische Daten
Verlag
Schriftenreihe
Auflagebezeichnung
DOI (zitierfähiger Link)
ArXiv-ID
Internationale Patentnummer
Angaben zur Forschungsförderung
Projekt
Open Access-Veröffentlichung
Open Access Green
Core Facility der Universität Konstanz
Gesperrt bis
Titel in einer weiteren Sprache
Forschungsvorhaben
Organisationseinheiten
Zeitschriftenheft
Publikationstyp
Beitrag zu einem Konferenzband
Publikationsstatus
Published
Erschienen in
QoMEX 2016 : 8th International Conference on Quality of Multimedia Experience. 2016
Zusammenfassung

We carried out crowdsourced video quality as- sessments using paired comparisons and converting the results to differential mean opinion scores (DMOS). A previous lab- based study had provided corresponding MOS-values for absolute category ratings. Using a simple linear transformation to fit the crowdsourcing-based DMOS values to the lab-based MOS values, we compared the results in terms of correlation coefficients and visually checked the relationship on scatter plots. The comparison result is surprisingly good with correlation coefficients more than 0.96, although (1) the original video sequences had to be cropped and downscaled in the crowdsourcing-based experiments, (2) the control of the experimental setup for the crowdsourcing case was much less and (3) it was widely believed that data from crowdsourcing workers are less reliable. Our result suggests crowdsourcing workers can actually be used to collect reliable VQA data in some applications.

Zusammenfassung in einer weiteren Sprache
Fachgebiet (DDC)
004 Informatik
Schlagwörter
Konferenz
QoMEX 2016 : 8th International Conference on Quality of Multimedia Experience, 6. Juni 2016 - 8. Juni 2016, Lisbon, Portugal
Rezension
undefined / . - undefined, undefined
Zitieren
ISO 690SAUPE, Dietmar, Franz HAHN, Vlad HOSU, Igor ZINGMAN, Masud RANA, Shujun LI, 2016. Crowd workers proven useful : a comparative study of subjective video quality assessment. QoMEX 2016 : 8th International Conference on Quality of Multimedia Experience. Lisbon, Portugal, 6. Juni 2016 - 8. Juni 2016. In: QoMEX 2016 : 8th International Conference on Quality of Multimedia Experience. 2016
BibTex
@inproceedings{Saupe2016Crowd-35942,
  year={2016},
  title={Crowd workers proven useful : a comparative study of subjective video quality assessment},
  booktitle={QoMEX 2016 : 8th International Conference on Quality of Multimedia Experience},
  author={Saupe, Dietmar and Hahn, Franz and Hosu, Vlad and Zingman, Igor and Rana, Masud and Li, Shujun}
}
RDF
<rdf:RDF
    xmlns:dcterms="http://purl.org/dc/terms/"
    xmlns:dc="http://purl.org/dc/elements/1.1/"
    xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
    xmlns:bibo="http://purl.org/ontology/bibo/"
    xmlns:dspace="http://digital-repositories.org/ontologies/dspace/0.1.0#"
    xmlns:foaf="http://xmlns.com/foaf/0.1/"
    xmlns:void="http://rdfs.org/ns/void#"
    xmlns:xsd="http://www.w3.org/2001/XMLSchema#" > 
  <rdf:Description rdf:about="https://kops.uni-konstanz.de/server/rdf/resource/123456789/35942">
    <dc:creator>Hosu, Vlad</dc:creator>
    <dc:creator>Rana, Masud</dc:creator>
    <dcterms:rights rdf:resource="https://rightsstatements.org/page/InC/1.0/"/>
    <dc:contributor>Hosu, Vlad</dc:contributor>
    <dc:contributor>Rana, Masud</dc:contributor>
    <dspace:isPartOfCollection rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/36"/>
    <dcterms:issued>2016</dcterms:issued>
    <dc:creator>Li, Shujun</dc:creator>
    <dc:contributor>Saupe, Dietmar</dc:contributor>
    <dspace:hasBitstream rdf:resource="https://kops.uni-konstanz.de/bitstream/123456789/35942/3/Saupe_0-371921.pdf"/>
    <bibo:uri rdf:resource="https://kops.uni-konstanz.de/handle/123456789/35942"/>
    <dc:creator>Hahn, Franz</dc:creator>
    <foaf:homepage rdf:resource="http://localhost:8080/"/>
    <dc:language>eng</dc:language>
    <dc:contributor>Li, Shujun</dc:contributor>
    <dcterms:title>Crowd workers proven useful : a comparative study of subjective video quality assessment</dcterms:title>
    <dc:contributor>Hahn, Franz</dc:contributor>
    <void:sparqlEndpoint rdf:resource="http://localhost/fuseki/dspace/sparql"/>
    <dc:creator>Zingman, Igor</dc:creator>
    <dcterms:abstract xml:lang="eng">We   carried   out   crowdsourced   video   quality   as- sessments  using  paired  comparisons  and  converting  the  results to  differential  mean  opinion  scores  (DMOS).  A  previous  lab- based study had provided corresponding MOS-values for absolute category  ratings.  Using  a  simple  linear  transformation  to  fit  the crowdsourcing-based DMOS values to the lab-based MOS values, we  compared  the  results  in  terms  of  correlation  coefficients  and visually checked the relationship on scatter plots. The comparison result is surprisingly good with correlation coefficients more than 0.96, although (1) the original video sequences had to be cropped and downscaled in the crowdsourcing-based experiments, (2) the control  of  the  experimental  setup  for  the  crowdsourcing  case was  much  less  and  (3)  it  was  widely  believed  that  data  from crowdsourcing  workers  are  less  reliable.  Our  result  suggests crowdsourcing  workers  can  actually  be  used  to  collect  reliable VQA  data  in  some  applications.</dcterms:abstract>
    <dc:creator>Saupe, Dietmar</dc:creator>
    <dcterms:hasPart rdf:resource="https://kops.uni-konstanz.de/bitstream/123456789/35942/3/Saupe_0-371921.pdf"/>
    <dc:contributor>Zingman, Igor</dc:contributor>
    <dcterms:isPartOf rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/36"/>
    <dc:date rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2016-11-16T16:29:04Z</dc:date>
    <dc:rights>terms-of-use</dc:rights>
    <dcterms:available rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2016-11-16T16:29:04Z</dcterms:available>
  </rdf:Description>
</rdf:RDF>
Interner Vermerk
xmlui.Submission.submit.DescribeStep.inputForms.label.kops_note_fromSubmitter
Kontakt
URL der Originalveröffentl.
Prüfdatum der URL
Prüfungsdatum der Dissertation
Finanzierungsart
Kommentar zur Publikation
Allianzlizenz
Corresponding Authors der Uni Konstanz vorhanden
Internationale Co-Autor:innen
Universitätsbibliographie
Ja
Begutachtet
Diese Publikation teilen