The application of factorial surveys in general population samples : the effects of respondent age and education on response times and response consistency

Lade...
Vorschaubild
Dateien
Zu diesem Dokument gibt es keine Dateien.
Datum
2011
Autor:innen
Sauer, Carsten
Liebig, Stefan
Herausgeber:innen
Kontakt
ISSN der Zeitschrift
Electronic ISSN
ISBN
Bibliografische Daten
Verlag
Schriftenreihe
Auflagebezeichnung
ArXiv-ID
Internationale Patentnummer
Angaben zur Forschungsförderung
Projekt
Open Access-Veröffentlichung
Sammlungen
Core Facility der Universität Konstanz
Gesperrt bis
Titel in einer weiteren Sprache
Forschungsvorhaben
Organisationseinheiten
Zeitschriftenheft
Publikationstyp
Zeitschriftenartikel
Publikationsstatus
Published
Erschienen in
Survey Research Methods. 2011, 5(3), pp. 89-102. Available under: doi: 10.18148/srm/2011.v5i3.4625
Zusammenfassung

Over the last decade, there has been a marked increase in the number of studies on attitude and decision research which use the factorial survey (FS) design. The FS integrates experimental set-ups into a survey: respondents react to hypothetical descriptions (vignettes) while the values of each attribute (dimension) of these descriptions systematically vary in order to estimate their impact on respondent judgments. As the vignettes are based on a number of dimensions and as respondents evaluate several vignettes, FSs are demanding in terms of individual cognitive and information-processing abilities. So far, there is little empirical knowledge of whether and to what extent this complexity is feasible in general population samples with heterogeneous respondents. Using data from a study on the fairness of earnings (with a mixed mode sample consisting a computer assisted personal interview [CAPI], computer assisted self interview [CASI], and paper and pencil [PAPI] mode), the complexity of FSs is analyzed in terms of: 1) design dimensions, such as the number of vignette dimensions (five, eight, or 12) and the number of vignettes for single respondents (10, 20, or 30), which were varied in a 3x3 experimental design; and 2) respondent characteristics that are associated with cognitive abilities (age and education). Two different indicators for cognitive load as well as learning and fatigue effects are analyzed: 1) latency time and 2) response consistency. The results show that raw reaction times but not latency times are longer for older respondents, suggesting that the cognitive effort needed for the evaluation of vignettes is not particularly high. Consistency measures reveal that respondents with a lower educational level show greater inconsistency in their evaluations when the number of vignettes is high. The number of dimensions has an effect on consistency only when respondents have to rate a large number of vignettes. In short, the results demonstrate that FSs are applicable in general population samples but should be used with a limited number of vignettes and dimensions per respondent.

Zusammenfassung in einer weiteren Sprache
Fachgebiet (DDC)
300 Sozialwissenschaften, Soziologie
Schlagwörter
Konferenz
Rezension
undefined / . - undefined, undefined
Zitieren
ISO 690SAUER, Carsten, Katrin AUSPURG, Thomas HINZ, Stefan LIEBIG, 2011. The application of factorial surveys in general population samples : the effects of respondent age and education on response times and response consistency. In: Survey Research Methods. 2011, 5(3), pp. 89-102. Available under: doi: 10.18148/srm/2011.v5i3.4625
BibTex
@article{Sauer2011appli-17787,
  year={2011},
  doi={10.18148/srm/2011.v5i3.4625},
  title={The application of factorial surveys in general population samples : the effects of respondent age and education on response times and response consistency},
  number={3},
  volume={5},
  journal={Survey Research Methods},
  pages={89--102},
  author={Sauer, Carsten and Auspurg, Katrin and Hinz, Thomas and Liebig, Stefan}
}
RDF
<rdf:RDF
    xmlns:dcterms="http://purl.org/dc/terms/"
    xmlns:dc="http://purl.org/dc/elements/1.1/"
    xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
    xmlns:bibo="http://purl.org/ontology/bibo/"
    xmlns:dspace="http://digital-repositories.org/ontologies/dspace/0.1.0#"
    xmlns:foaf="http://xmlns.com/foaf/0.1/"
    xmlns:void="http://rdfs.org/ns/void#"
    xmlns:xsd="http://www.w3.org/2001/XMLSchema#" > 
  <rdf:Description rdf:about="https://kops.uni-konstanz.de/server/rdf/resource/123456789/17787">
    <dcterms:issued>2011</dcterms:issued>
    <dc:language>eng</dc:language>
    <dc:contributor>Liebig, Stefan</dc:contributor>
    <dc:rights>terms-of-use</dc:rights>
    <dc:contributor>Sauer, Carsten</dc:contributor>
    <dc:creator>Liebig, Stefan</dc:creator>
    <dcterms:abstract xml:lang="eng">Over the last decade, there has been a marked increase in the number of studies on attitude and decision research which use the factorial survey (FS) design. The FS integrates experimental set-ups into a survey: respondents react to hypothetical descriptions (vignettes) while the values of each attribute (dimension) of these descriptions systematically vary in order to estimate their impact on respondent judgments. As the vignettes are based on a number of dimensions and as respondents evaluate several vignettes, FSs are demanding in terms of individual cognitive and information-processing abilities. So far, there is little empirical knowledge of whether and to what extent this complexity is feasible in general population samples with heterogeneous respondents. Using data from a study on the fairness of earnings (with a mixed mode sample consisting a computer assisted personal interview [CAPI], computer assisted self interview [CASI], and paper and pencil [PAPI] mode), the complexity of FSs is analyzed in terms of: 1) design dimensions, such as the number of vignette dimensions (five, eight, or 12) and the number of vignettes for single respondents (10, 20, or 30), which were varied in a 3x3 experimental design; and 2) respondent characteristics that are associated with cognitive abilities (age and education). Two different indicators for cognitive load as well as learning and fatigue effects are analyzed: 1) latency time and 2) response consistency. The results show that raw reaction times but not latency times are longer for older respondents, suggesting that the cognitive effort needed for the evaluation of vignettes is not particularly high. Consistency measures reveal that respondents with a lower educational level show greater inconsistency in their evaluations when the number of vignettes is high. The number of dimensions has an effect on consistency only when respondents have to rate a large number of vignettes. In short, the results demonstrate that FSs are applicable in general population samples but should be used with a limited number of vignettes and dimensions per respondent.</dcterms:abstract>
    <dcterms:available rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2012-02-03T08:47:11Z</dcterms:available>
    <dcterms:bibliographicCitation>Publ. in: Survey Research Methods; 5 (2011), 3. - S. 89-102</dcterms:bibliographicCitation>
    <dc:contributor>Hinz, Thomas</dc:contributor>
    <dcterms:rights rdf:resource="https://rightsstatements.org/page/InC/1.0/"/>
    <dspace:isPartOfCollection rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/34"/>
    <dcterms:title>The application of factorial surveys in general population samples : the effects of respondent age and education on response times and response consistency</dcterms:title>
    <foaf:homepage rdf:resource="http://localhost:8080/"/>
    <dc:contributor>Auspurg, Katrin</dc:contributor>
    <bibo:uri rdf:resource="http://kops.uni-konstanz.de/handle/123456789/17787"/>
    <dcterms:isPartOf rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/34"/>
    <dc:date rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2012-02-03T08:47:11Z</dc:date>
    <dc:creator>Sauer, Carsten</dc:creator>
    <dc:creator>Hinz, Thomas</dc:creator>
    <dc:creator>Auspurg, Katrin</dc:creator>
    <void:sparqlEndpoint rdf:resource="http://localhost/fuseki/dspace/sparql"/>
  </rdf:Description>
</rdf:RDF>
Interner Vermerk
xmlui.Submission.submit.DescribeStep.inputForms.label.kops_note_fromSubmitter
Kontakt
URL der Originalveröffentl.
Prüfdatum der URL
Prüfungsdatum der Dissertation
Finanzierungsart
Kommentar zur Publikation
Allianzlizenz
Corresponding Authors der Uni Konstanz vorhanden
Internationale Co-Autor:innen
Universitätsbibliographie
Ja
Begutachtet
Diese Publikation teilen