Survey Questionnaire Design and Attitude Measurement
- 格式:doc
- 大小:181.00 KB
- 文档页数:44
实用英语写作_中南大学中国大学mooc课后章节答案期末考试题库2023年1.Subjects like “Hello”, “Enquiry” or “Latest info” are appropriate in emailwriting.参考答案:错误2.The introduction part of a survey report part provides_____.参考答案:context to understand the background of the survey._information onhow the survey results are intended to be used._the reasons for which the survey has been conducted.3.We shouldn’t use all capitals in writing an email.参考答案:正确4.While gathering information, you ought to jot down full bibliographicalinformation, for an article without bibliographical information is uselesssince you cannot cite its source.参考答案:正确5.What are the principles for developing a good survey questionnaire?参考答案:Include instructions with your survey questionnaire._Order questions and present them in an organized layout._Test the surveyquestionnaire._Clearly state your intentions with the survey.6.Writing a literature review lets you gain and demonstrate skills ininformation seeking and critical appraisal.参考答案:正确7. A good summary is supposed to possess the following characteristics.参考答案:objectivity._cohesion._brevity.8.What are the benefits of taking notes in lectures?参考答案:creating a condensed record for study._engaging yourmind._keeping you alert._emphasizing and organizing information.9.The difference between a block format and an indented format is that in ablock format, every component is left-aligned while in an indented format, every component has an indentation.参考答案:错误10.All acronyms are abbreviations, but not all abbreviations are acronyms.参考答案:正确11.In English, N/A stands for not applicable.参考答案:正确12.Which information should not be included in the Education section of a CV?参考答案:Your academic skills13.In the given situation, which one of the instructions is correct?Havingpressed the blue button, you have to enter the code, and then press the red button.参考答案:Press the blue button, then enter the code. Finally, press the red button14.In the given situation, which one of the instructions is correct?The water hasto be boiled before you add the sugar.参考答案:Boil the water first, then add the sugar15.What do you have to prepare before writing a personal statement?参考答案:application questions16.In the given situation, which one of the instructions is correct?The left handlehas to be turned to the right, and then the right handle has to be turned to the left.Turn the left handle to the right, then turn the right handle to the left17.Acronyms are made from the first letter (or letters) of a string of words butare pronounced as if they were words themselves.参考答案:正确18.Which is the best description in a personal statement?参考答案:In the first project I managed, I made an effort to incorporate all my colleagues as equal members of a team, soliciting their feedback and deferring to their expertise as needed.19.What are the advantages of the outlining note-taking method?参考答案:It outlines contents as well as relationships._It’s a well-organizedsystem if done right._It’s easy to review by turning main points._Itreduces the work of editing.20.In the method section, you need to explain _____.参考答案:what questions are asked._who and how many are surveyed._how the survey is conducted._how the data are collected.21.The background study of a research proposal includesprevious studies andcurrent information surrounding theissue.正确22.It is acceptable to leave the subject field blank in email communication.参考答案:错误。
调查问卷与分析英语作文Survey Questionnaire and Analysis。
1. Do you enjoy taking surveys? Why or why not?Yeah, I don't mind them. It's kind of fun to give my opinion on stuff.2. What do you think is the most important aspect of a survey?It's gotta be the questions, they need to be clear and easy to understand.3. Have you ever lied on a survey? Why?Maybe once or twice, just to mess with the results.4. How do you feel about the length of surveys?If it's too long, I'm out. I don't have time for that.5. Do you think surveys are an accurate way to gather information?I guess it depends on the survey and who's taking it. People can be pretty unreliable.6. What's the most annoying question you've come across in a survey?Oh man, anything too personal. Like, why do you need to know my income?Analysis:The responses from the survey questionnaire reveal a variety of attitudes and opinions towards surveys. Some participants enjoy taking surveys as it allows them to give their opinion on different topics. However, others find surveys to be time-consuming and may not always provide accurate information. The importance of clear andunderstandable questions is emphasized, as well as the annoyance of personal or intrusive questions. Additionally, some participants admit to lying on surveys, either for fun or to influence the results. Overall, the survey responses highlight the diverse perspectives on the use and effectiveness of surveys as a data-gathering tool.。
Questionnaire Design and TestingTian XiuhuaService Survey Center of NBSAugust, 2008Beijing, ChinaAbstract:Questionnaire design aims to make respondents have a clear and comprehensive statement of questions and answer them or provide data, and also to make information obtained facilitate the data processing. Questionnaire design is an important step of survey and plays a central role in data collection process. It has a major impact on data quality. Though there are some principles in design theory, there is still a big challenge for well-designed questionnaire of enterprise survey in China. The NBS has implemented and finished the questionnaire design for enterprise and self-employed household in service industry on the basis of international corporation project, and won international specialists’ consent. This paper summarizes some principles and methods firstly, then introduces the enterprise survey questionnaire design combining the actual state of China. Enterprise and self-employed household questionnaire design are separated by different Methods of Data Collection. This paper expounds how to deal with some problems in questionnaire design process, including following aspects: code design, how to reflect the change of sample enterprises though enterprise questionnaire, and the improvement of self-employed household questionnaire from indicator to question.This paper also introduces the method and process of questionnaire testing in practice, explains the importance of choosing proper respondents and the demand of organizer’s ability. Finally, the questionnaires are amended according to the test result and suggestion from relevant experts.Keywords: questionnaire design testQuestionnaire (or survey form, statistics form) is composed of a series of questions which are specially designed to get information about some subject from respondents. Questionnaire plays an important role in the process of data collection, so the design of it can affect the data quality and the authority of statistics organization.1. Principles and methods of design1.1 PrinciplesThere was a violent argument about the questionnaire design theory. In 1980, British scholar (Marketing Research) Labaw wrote an " Advanced Questionnaire Design" ,in this book, she argued that the greatest weakness of questionnaire design was lack of theory and proposed her own systematic theory, set off a crazy discussion on this theme. After she wrote an article for revision, she constructed a framework thatincorporated her theoretical principles and the subsequent work of Jenkins and Dillman; Sudman, Bradburn and Schwarz; Harkness; Fowler; Belson; and others. This framework does not constitute a theory of questionnaire design, but provides a conceptual model of the questionnaire design process, including questionnaire design principles, these principles are:1.1.1 Questionnaire must fit the methods of data collection.. There are differences in telephone interview, Face-to-face interview, mailed questionnaire, and online survey, such as the telephone survey questionnaire will not be able to design graphics, mailed questionnaire survey will be considerate that, the respondents can not ask for “What is the exact meaning of this?” when they don’t understand the question,and so on.1.1.2 The questionnaire structure must be regular and reasonable. The general structure of the questionnaire is composed of title, the questions and themes, such several parts. First, the format must be normative; second, interval between various parts must be appropriate, the layout must be clear and easy to fill.1.1.3 Questionnaire should be as short and simple as possible. No matter what kind of survey approach, most people are still willing to complete some short questionnaires, and the questions which are unrelated to the problem must not be included.1.1.4 The questions generally should be ordered from easy to difficult. Start with a brief introduction, so the respondents will understand the purpose and know how to complete.1.1.5 The principle of choosing closed or open-ended questions. Generally, if we want the subjective information of respondents or when the scope of the question couldn’t be well defined, the open-ended questions will be suitable; if the question is able to clearly described and the options are easy to define, then select the closed questions.1.2 Methodology1.2.1 The basic methods. There are three kinds of questionnaires, the qualitative indicators questionnaire, quantitative indicators questionnaire and the combinative indicators questionnaire. For either type of questionnaire, the design process should be guided by the principles of the design. Such as the qualitative indicators questionnaire, use the closed or open-ended questions according to the survey theme. Open-ended question doesn’t provided options to the respondents. The closed questions list a number of possible answers for respondents to choose, there are various kinds of closed questions, the most common questions are the two choices question, a number of options question and multiple-choice question, sorting question and grade assess question, and so on. In practice, closed question is used widely. Of course, whether the words of the questions are simple, applicable and concrete should be considered carefully. Finally should also consider the questionnaire format, including the questions sequence, location of notes and layout design. For the quantitative indicators questionnaire design, we must first consider the scientificnature of the indicators, and then also have to consider their feasibility, if the indicator is very scientific, but in practice can not collect data, it is not valuable. Third, the design should facilitate filling in the form. Fourth, the layout should be simple and clear. The combination questionnaire design, consider all the above factors.1.2.2 Questionnaire design steps. The steps are: first, make the objective of the survey clear, learn the needs of data users; second, define the survey content, list the problem need to be solved or indicators need to be collected data, write the filling in instruction and indicators explanation; third, ask for suggestions from users and external consulting experts, discuss the amendment of the questionnaire; forth, test the questionnaire in small-scale; fifth, revise the questionnaire according to test results.2. Questionnaire design2.1 Design for enterpriseAn enterprise is an economic organization engaged in production and operation for profits. An enterprise legal person means an enterprise which has registered with various administrative departments for industry and commerce, has obtained the Business License of Enterprise Legal Person and is qualified as a legal person in accordance with the Regulations of the People’s Republic of China For Controlling th e Registration of Enterprises as Legal Person, and the Regulations of the People’s Republic of China on Administration of Registration of Companies, etc. Enterprise survey questionnaire is designed for the enterprise legal person.There are nine parts for the enterprise questionnaire. The first part is composed of some basic attributes indicators, including enterprise name, code of enterprise legal person, legal representative person, contact information, time to start business, principal operating activities, type of controlled holding, enterprise’s duration of operation during the reporting period, reasons for not in full operation during the reporting period and so on. The second part is the major economic indicators, including some indicators from the balance sheet, profit and distribution, and other subjects of accounting and human resources indicators, mainly to meet the needs of national accounts, taking into account the needs of other users. The third part is the change of enterprise, including whether the enterprise is consolidated, whether the enterprise is merged, whether the legal person code of the enterprise changed, whether the name of the enterprise changed. The forth part is the data of the business establishments affiliated with the enterprise, including two questions, one is whether the enterprise has business establishments under the categories of different industries or operating in different regions; the other is what the number of the establishments is. The fifth part is the data of the member enterprises of the corporate administrative institution, list two questions, one is whether the enterprise is a administrative institution, the other is what the number of member enterprises is. The sixth part is the recommendations, let respondents evaluate the following aspects: from format, indicators sequence, whether the data is easy to captured, whether theindicator explanation is clear, attitude of the interviewers and the training work of the statistic organization and so on, improve the survey according to these evaluation. The seventh part is the information of filling person, including the time used to fill in this form and the contact information. The eighth part is the detailed data of the establishments, this part is the expansion of part four. If the enterprise contains establishments (answered in part four), then fill this part with the activity, industrial code, the number of employees hired at the end of the period, income of each establishment and so on. The ninth part is the detailed information of the member enterprises of corporate administrative institution, is the expansion of part five. If the enterprise is the administrative institution ( answered in part five), then fill in this part with the activity, industrial code, income and so on of each member enterprise.2.2 Design for self-employed householdSelf-employed household is a business unit except the farmer which is based on the self-employed work, all the means of production belong to the work self, the outcome is personal possession.Self-employed usually don’t have the basis of accounting, no accounts to be investigated, plus the uneven cultural level of the individual owners, so we should choose the interview method, supplemented by actual observations, to ensure reliable data sources. The questionnaire should be designed in this premise.We designed the questionnaire similar to the enterprise at the first, but more simple in the content. The first part is the basic data of self-employed, including the name of the owner, contact telephone, principal operating activities and so on. Second part is the major economic indicators, including the number of the employee, business floor space, fixed assets, operating expenses and its components, operating income and so on. The objective is to be able to calculate the added value to meet the basic needs of accounting. Part three and part four are same as the enterprise, recommendations and information of the people filling form.After investigation, we changed the major economic indicator into operating questions, designed 13 issues in the second part, through the processing of these issues, we can get the needed indicators.2.3 The main difference between the designed questionnaire and the existing survey questionnaire2.3.1 Designed questionnaire adds the National Bureau of Statistics logo on the upper left corner, to enable enterprises clearly know this is a national survey, and should actively cooperate with it.2.3.2 Designed questionnaire adds the part of recommendations, to learn the evaluation about the questionnaire and the training work of the statistical system from the respondents, provide the basis for improvement.2.3.3 Designed questionnaire adds the question of “Time used to fill in the form”, to learn the burden of enterprises and the difficulty of the interviewers.2.3.4 Designed questionnaire adds the change information of enterprise, it can provide help for BR maintenance and data evaluation.2.3.5 Designed questionnaire adds the list table of business establishments affiliated with the enterprise, to try to let the enterprise headquarters fill the establishments table.2.3.6 Designed questionnaire adds the list table of the member enterprises of the corporate administrative institution, to accumulate experience and provide the basis for the accounting.3. Disposal of difficulty issues in questionnaire design3.1 Questionnaire code designThe code can facilitate the computer processing, make the questionnaire identification and management be easy, the code may be meaningless, and also can has a certain sense. With the China's actual situation analysis, taking into account the characteristics of China's administrative divisions, that each of the cities, counties have administrative division code, the city code contains two figures, so we decide that the enterprise questionnaire code has five figures, the former two is the city code, because there will not be more than 99 cities in a province; the last three figures will be from 001 to 999, it is the sequence number of the enterprise in each city, the number of the local enterprise samples will not be more than 999 in a city. So it is easy and convenient for whether the Survey Office in province or the Survey Office in city to code the questionnaire.The questionnaire code of the self-employed household contains 15 figures, the former 12 ones is the village administrative code, and the last 3 figures is the sequence number of the self-employed household in each village. Generally, each village contains not more than 999 self-employed households. This code is not only easy to use, but also accords with the habit of statisticians, because the administrative zoning code is frequently used in the statistics.3.2 Enterprise questionnaire how to reflect the change of samplesBecause of the establishment time of BR and the time of the survey is not synchronized, some sample enterprises changed when they were visited, such as merger and separation, and so on. If we can learn the change information, it can be useful for the data estimation and BR maintenance. For instance, we design some questions, such as whether the enterprise is merged, if merged, should fill the merge time, the name of enterprise before merging, the Legal Person Code, the name and Legal Person Code of the enterprise be merged. The questions about separation information can be designed similar to the merge.But we should not only consider how to set questions or indicators for collectinginformation, but also should consider how to get better results, we must concerned about the psychological reflection of the respondents when they receive the questionnaire, they may be sick of the complex indicators or too much questions, this will affect the quality of data, also be said to be unsuccessful design of the questionnaire.In addition, because the different educational level of filling person and many enterprises do not have full-time statisticians, so the accountant often works on the statistics as a sideline. So they need to refer to information or consult relevant personnel when they are asked to fill the change information in the form, especially the separation information of enterprise, the separate enterprise name and the legal person code is necessary, but the separate enterprise may not be local one, so they cannot get the information of the separate enterprise. Even if the accountant can fill the form, it will cost great deal of energy and time, moreover, the accounting workload is already big enough.It is difficult to let enterprise to do so much work just for this information, and this may affect the result of the survey. This is a conclusion from a large number of investigations. So we keep searching for better means which can learn the basic information and does not increase the workload, and also be easy to achieve. That is, let the enterprise only answer the optional question without other information, if need to know the detailed change information, the Survey Office of NBS in the prefecture or county level can contact the enterprise to check according to the simple information provide by the questions.3.3 The improvement from indicators to questions on self-employed household questionnaireWe choose the interview way to visit the self-employed ones, because one is they do not have accounts, and the other is they do not want to reveal their rich, and the third is they do not understand the indicators we need. Therefore, even the interviewer visit, also need to ask carefully and adopt some survey skills. Through investigation, we find that the best interview way is colloquium, talk about their current operations and difficulties firstly, and then ask about the number of employees, and ask their equipment and housing expenditure, finally, ask the most sensitive indicators of income. The interviewer should judge whether the income conforms to the actual target according to the expenditures, if it can not meet the actual information, check it on-site.If the questionnaire adopts the form of indicators, interviewers first need to record the relevant data at the colloquium, then calculate according to these data to get the needed indicators. If the questionnaire designed to be composed of the interview records, it will facilitate the interviewers, and reduce the workload, and also avoid the calculation error. For this reason the indicators on this questionnaire will be replaced by the questions.4. Testing of the questionnaire4.1 Content and used methods of the testingWe want to test the following aspects: the questionnaire for both enterprise and self-employed household, filling instruction and indicator explanation, interviewer manual, letters about explanting the survey targets, expecting the respondents’cooperation, the survey organization and implementation.We tested 18 enterprises and 25 self-employed households from 4 neighbourhood committees and 1 village committees in Shenyang of Liaoning province, 23 enterprises and 25 self-employed households from 4 neighbourhood committees and 1 village committees in Linyi of Shandong province, respectively. All the enterprises in Shenyang filled the form by accountants, 15 enterprises in Linyi filled the form by the accountants or the statisticians, other 8 ones were visited by the interviewer. All the self-employed households were visited by interviewers who come form the sub-district office or the neighbourhood committees.First, the Survey Office in Shenyang and Linyi selected the enterprises and villages need to be tested, hired the interviewers, and contacted the samples beforehand; second, the Survey Office of Shandong and Liaoning provinces distributed the document of lunching the test, and printed questionnaires, relevant letters and interviewer manual and so on, and sent these materials to the relevant units; third, the Survey Office in Shenyang and Linyi decided that the test would be held in June and August, before the test, they trained the participants together, the participants contains filling form person from enterprises, interviewers and the relevant personnel from county level survey office, provincial survey office and the National Bureau of Statistics. The delegation of Statistics Canada took part in the entire process of the test in Shenyang. During the training time, explained the enterprise questionnaire and the fill instruction to the staff of enterprises, introduced the self-employed household questionnaire and interviewer manual to the interviewers, the interviewer manual included the instruction about the definition of indicators, checking methods, where need to correct data, how to get the cooperation of the respondents. Each kind of the questionnaires cost two hours of training time.The fourth step, after training, the staff from enterprises was given one day and half time to go back their enterprise to fill the questionnaire, the interviewers were asked to visit 5 self-employed units, some interviewers in Linyi completed part interview for some enterprises. If the staff from enterprises and interviewers met difficulties on the test spot, they can contact the Survey Office of Shenyang and Linyi for help. Finally, convened the colloquia, listen to the evaluation and improvement suggestion on the questionnaire, training work, interviewer manual and used methods from the participants.The Statistics Canada delegation thought the participants were well prepared and had a serious attitude in particular. And organization for the meeting was very successful, lively, high efficiency. The evaluation of the test is:(1) The test of questionnaire was very successful, it had tested the content of the questionnaire, the relevant materials and survey methods which needed to be improved;(2) We can benefit from the questionnaire test on two main aspects: one is the formatof the questionnaire, the other is the content of the manual, particularly for suggestions of manual content improvement, it is necessary to give a more clear definition of indicators, should give the examples of processing and presentation in the instruction.4.2 Organization of the testingSuccessful test survey activities are inextricably linked to the well-planned arrangement, meticulous organization and the high level participants.(1) Well-planned arrangement. The National Bureau of Statistics is responsible for designing the questionnaire, preparing all related materials, and proposing the specific requirement at the same time. The Survey Office in Shandong and Liaoning is responsible for the arrangement and informing the selected cities by document, the city Survey Office is responsible for selecting the sample enterprises and villages, and contacts them in advance, explain the survey target and the work to be done to them, and ask for their cooperation.(2) Meticulous organization. The participants contains relevant people from the National Bureau of Statistics, Survey Office of NBS in provincial , city and county level, Sub-district Office, Village Committee or Neighbourhood Committee and sample enterprises, also includes the Statistics Canada delegation in Shenyang. We should arrange the duty of every level staff well. The staff filling form is mostly accountant in Shenyang, but in Linyi, it also contains some statisticians from enterprises and some interviewers, this is determined by the actual situation. The hired interviewers for self-employed household are from Village Committee or Neighbourhood Committee, a good organization of them is the key to the test.(3) High level participants. The quality of the participants also can affect the test result, especially the designer and the people filling form from enterprises and the interviewers. The designer not only should be good at the design knowledge, but also understand the accounting methods and accounting systems well, particularly the "new enterprise accounting standards", implemented since January 1, 2007 within the listed company framework, they should know the difference between the old and new versions, they also are required to learn the characteristics of industry and the actual situation. The staff from enterprises and the interviewers not only should have a serious attitude, but also have certain knowledge, ability level and work experience. Linyi involved 31 enterprise staff and interviewers, of which 90 percent graduated from secondary school or higher, 74 percent had statistics work experience.5. Improve of the questionnaireAll the above questionnaires are completed in strict accordance with the design steps, tested in small-scale, and also test the relevant survey materials and organizational processes. Due to the careful design, a lot of investigation and the application of some experience, the questionnaires and materials were approbated by the test participants, but still need to be improved and perfected.We revised the following parts according to the record of the forum took place in Shenyang and Linyi:(1) Delete the inappropriate or unrelated indicators and questions.(2) Determine the explanation for some indicators and the filling instruction.(3) Improve the interviewer manual, give detailed examples for reference.(4) Prepare survey certificate and relevant stuff for interviewers.The revised questionnaires were used in partial provinces.Questionnaire design is an art, the test is the means to improve questionnaire. To design high-quality questionnaire, first, pay more attention to the design; second, we should seriously listen to and study the needs of users and research the feasibility and effectiveness; third, we must take appropriate forms of test organization, request that there must be some experts in the field of survey and accounting among the participants in the test; fourth, choose appropriate respondents; fifth, we must seriously study the rationality and universality of the test results.References1. Philip Gendall, (1998) A Framework for Questionnaire Design: Labaw Revisited.2. Statistics Canada, (2001) China Survey Skills Manual.3. Statistics Canada, (2007) Questionnaire Design Workshop.。
提升问卷调查满意度的方法To improve the satisfaction of a survey, it is essential to first consider the design of the questionnaire itself. A well-structured and organized questionnaire can significantly impact the respondents' willingness to participate and provide accurate responses. Providing clear instructions and ensuring the questions are concise and to the point can also enhance the overall experience for the participants. When designing the survey, it is crucial to consider the target audience and tailor the questions to their preferences and understanding. By making the questionnaire relevant and engaging, respondents are more likely to complete it with genuine feedback.为了提高问卷调查的满意度,首先必须考虑问卷设计本身。
一个结构合理、有条理的问卷可以明显影响受访者参与的意愿和提供准确的回答。
提供清晰的说明并确保问题简洁明了也可以提高参与者的整体体验。
在设计调查问卷时,关键是要考虑目标受众,并根据他们的偏好和理解进行问题的定制。
通过使问卷有关连性和吸引力,受访者更有可能提供真实的反馈。
Introduction:Welcome to our creative survey! We are excited to learn more about your opinions, experiences, and ideas on various topics. This questionnaire is designed to be engaging and thought-provoking, allowing you to share your unique perspectives. Please take your time to answer each question thoughtfully. Your responses will help us better understand our audience and improve our services. Thank you for participating!---Section 1: Personal Information1. What is your age range?- Under 18- 18-24- 25-34- 35-44- 45-54- 55-64- 65 and above2. What is your gender identity?- Male- Female- Non-binary- Prefer not to say3. What is your highest level of education?- High School- Some College- Bachelor's Degree- Master's Degree- Doctorate- OtherSection 2: Creative Preferences4. Which of the following creative fields interests you the most? - Literature- Visual Arts- Performing Arts- Music- Film/Television- Gaming- Other (please specify)5. How often do you engage in creative activities?- Daily- Weekly- Monthly- Rarely- Never6. What is your favorite type of creative content to consume?- Books- Movies/TV Shows- Music- Art Exhibitions- Theater Performances- Video Games- Blogs/Online Articles- Other (please specify)Section 3: Creative Process7. When it comes to creating, do you prefer to work alone or in a group? - Alone- In a group- Both, depending on the project8. What is your go-to source of inspiration for creative ideas?- Personal experiences- Nature- Other people's work- Historical events- Science and technology- Fantasy and imagination- Other (please specify)9. How do you overcome creative blocks?- Take a break and return later- Collaborate with others- Research and learn new techniques- Talk to friends or mentors- Practice regularly- Other (please specify)Section 4: Creative Challenges10. What do you think is the biggest challenge in the creative industry today?- Funding and financial constraints- The rapid pace of technological advancements- The pressure to produce content that appeals to a wide audience- The need for diversity and representation- The difficulty of maintaining a work-life balance- Other (please specify)11. How do you stay updated with the latest trends and developments in your creative field?- Online courses and tutorials- Industry conferences and workshops- Social media and online communities- Networking with other creatives- Other (please specify)Section 5: Future Outlook12. In the next five years, what do you envision for the creative industry?- Increased digitalization and online presence- Greater emphasis on sustainability and environmental awareness- More opportunities for emerging creatives- The rise of new creative formats and mediums- Other (please specify)13. What advice would you give to someone just starting out in the creative industry?- Focus on your unique voice and style- Be persistent and patient- Network and build relationships- Learn from failures and mistakes- Stay informed about industry trends- Other (please specify)---Conclusion:Thank。
Questionnaire Design for Surveys and Laboratory Experiments:Social And Cognitive PerspectivesCommunication 239, Political Science 324R, Psychology 224Jon A. KrosnickDepartments of Communication, Political Science, and PsychologyStanford University434 McClatchy Hall, 725-3031, Krosnick@Spring, 2005Building 50, Room 52HTuesdays, 3:15 – 6:05 pm_______________________________________________________________________This course will provide an introduction to general theories of the cognitive aspects of question-answering in surveys. The focus will be on the cognitive processes in which respondents engage when answering questions and on the social interactions among researchers, interviewers, and respondents. The course will provide an overview of issues that one should consider when designing a survey questionnaire or when interpreting the results of a survey.A great deal of research has been conducted during the last 50 years exploring the effects of different measurement strategies on the findings of survey research, and this work reveals a great deal about the cognitive processes in which survey respondents engage during interviews. We will review the major findings of this work and discuss their implications for understanding cognitive aspects of question-answering. The primary goal of the discussions will be to identify issues to be considered when writing survey questions to measure specified constructs. Taken together, this literature makes many useful recommendations regarding how to avoid sources of bias in measurement and how to maximize accuracy.Most of our discussions will focus on the measurement of subjective psychological phenomena, such as attitudes, beliefs, assessments of importance, and assessments of satisfaction. There will be some secondary discussion of the measurement of objective phenomena, primarily past behavior.Course requirements are: (1) reading all required reading assignments prior to class meetings when they will be discussed, (2) participating energetically and creatively in class discussion, and (3) a final sit-down exam asking you to critique a questionnaire that I will give you.Topics to be Covered1. General Introduction2. Open versus Closed Questions3. Closed Questions: Ratings versus Rankings4. Closed Questions: Number of Scale Points/Magnitude Scaling5. Closed Questions: Verbal vs. Numeric Scale Point Labels6. Closed Questions: Response Order Effects7. Attitudes and Non-attitudes8. Acquiescence and Other Response Biases9. Question Wording/Question Balance10. Question Order11. Attitude Recall Questions12. Asking Why?Readings to be ReviewedNote: Readings marked with "*" are required. Readings marked with "+" are optional but recommended. All other readings are fully optional.General Readings on Questionnaire DesignBradburn, N. M. (1983). Response effects. Pp. 289-328 in P. H. Rossi, J. D. Wright, &A. B. Anderson (Eds.), Handbook of survey research. New York: AcademicPress.Bradburn, N. M., & Sudman, S. Improving interview method and questionnaire design.San Francisco: Jossey-Bass.Cantril, H. (1944). Gauging public opinion. Princeton, N.J.: Princeton University Press. +Converse, J. M., & Presser, S. (1986). Survey questions: Handcrafting the standardized questionnaire. Beverly Hills, CA: Sage.Kahn, R. L., & Cannell, C. F. (1957). The dynamics of interviewing (Chapters 5 and 6, "The formulation of questions" and "The design of questionnaires"). New York:Wiley.Oppenheim, A. N. (1966). Questionnaire design and attitude measurement. New York: Basic Books.Payne, S. L. (1951). The art of asking questions. Princeton, N.J.: Princeton University Press.Sheatsley, P. B. (1983). Questionnaire construction and item writing. Pp. 195-230 in P.H. Rossi, J. D. Wright, & A. B. Anderson (Eds.), Handbook of survey research.New York: Academic Press.Smith, T. W. (1987). The art of asking questions, 1936-1985. Public Opinion Quarterly, 51, S95-S108.Sudman, S., & Bradburn, N. M. (1974). Response effects in surveys. Chicago: Aldine. Sudman, S., & Bradburn, N. M. (1983). Asking questions. San Francisco: Jossey-Bass. +Turner, C. F., & Martin, E. (1984). Surveying subjective phenomena (vol. 1 and 2).New York: Russell Sage Foundation.Warwick, D. P., & Lininger, C. A. (1975). The sample survey: Theory and practice.(Chapter 6, "Questionnaire design."). New York: McGraw-Hill.1. Introduction to Issues of Question DesignAndrews, F. M. (1984). Construct validity and error components of survey measures: A structural modeling approach. Public Opinion Quarterly, 48, 409-442.*Hippler, H., & Schwarz, N. (1987). Response effects in surveys. In H. Hippler, N.Schwarz, & S. Sudman (Eds.), Social information processing and surveymethodology. New York: Springer-Verlag.Kalton, G., & Schuman, H. (1982). The effect of the question on survey responses: A review. The Journal of the Royal Statistical Society, 145, 42-73.*Krosnick, J. A. (1991). Response strategies for coping with the cognitive demands of attitude measures in surveys. Applied Cognitive Psychology, 5, 213-236.Schuman, H. (1982). Artifacts are in the mind of the beholder. The American Sociologist, 17, 21-28.Schuman, H. (1986). Ordinary questions, survey questions, and policy questions. Public Opinion Quarterly, 50, 432-442.Schuman, H., & Kalton, G. (1985). Survey methods. In G. Lindzey and E. Aronson (Eds.), Handbook of social psychology (vol. 1). New York: Random House. Schuman, H., & Presser, S. (1977). Question wording as an independent variable in survey analysis. Sociological Methods and Research, 6, 27-46.*Tourangeau, R. (1987). Attitude measurement: A cognitive perspective. In H. Hippler, N. Schwarz, & S. Sudman (Eds.), Social information processing and surveymethodology. New York: Springer-Verlag.2. Open vs. Closed QuestionsBelson, W. A., & Duncan, J. A. (1962). A comparison of the checklist and the open response questioning systems. Applied Statistics, 11, 120-132.*Converse, J. M. (1984). Strong arguments and weak evidence: The open/closed questioning controversy of the 1940s. Public Opinion Quarterly, 48, 267-282. Ehrlich, H. J., & Rinehart, J. W. (1965). A brief report on the methodology of stereotype research. Social Forces, 43, 564-575.Elig, T. W., & Frieze, I. H. (1979). Measuring causal attributions for success and failure.Journal of Personality and Social Psychology, 37, 621-634.Geer, J. G. (1988). What do open-ended questions measure? Public Opinion Quarterly, 52, 365-371.Hurd, A. W. (1932). Comparisons of short answer and multiple choice tests covering identical subject content. Journal of Educational Psychology, 26, 28-30.Jenkins, J. G. (1935). Psychology in Business and Industry. New York: Wiley, p. 348-351.Lazarsfeld, P. E. (1944). The controversy over detailed interviews - an offer for negotiation. Public Opinion Quarterly, 8, 38-60.Lindzey, G. E., & Guest, L. (1951). To repeat - check lists can be dangerous. Public Opinion Quarterly, 15, 355-358.Link, H. C. (1943). An experiment in depth interviewing. Public Opinion Quarterly, 7, 267-279.Magill, W. H. (1934). The influence of the form of the item on the validity of achievement tests. Journal of Educational Psychology, 25, 21-28.Malmud, R. S. (1925). The controlled vs. the free completion. American Journal of Psychology, 36, 401-411.Mason, R., Boersma, L., & Faulkenberry, G. D. (1988). The use of open and closed questions to identify holders of crystallized attitudes: The case of adoption oferosion-control practices among farmers. Rural Sociology, 53, 96-109.Metzner, H., & Mann, F. (1952). A limited comparison of two methods of data collection: The fixed alternative questionnaire and the open-ended interview.American Sociological Review, 17, 486-491.Remmers, H. H., Marschat, L. E., Brown, A., & Chapman, I. (1923). An experimental study of the relative difficulty of true-false, multiple-choice, and incomplete-sentence types of examination questions. Journal of Educational Psychology, 14,367-372.Roslow, S., & Blankenship, A. B. (1939). Phrasing the question in consumer research: Experimental studies on the form of question. Journal of Applied Psychology, 23, 612-622.Roslow, S., Wulfeck, W. H., & Corby, P. G. (1940). Consumer and opinion research: Experimental studies on the form of the question. Journal of Applied Psychology, 24, 334-346.Rugg, D., & Cantril, H. (1944). The wording of questions. In H. Cantril (Ed.), Gauging public opinion. Princeton: Princeton University Press, p. 37-38, 49.Schuman, H., Ludwig, J., & Krosnick, J.A. (1986). The perceived threat of nuclear war, salience, and open questions. Public Opinion Quarterly, 50, 519-536.*Schuman, H., & Presser, S. (1981). Questions and answers in attitude surveys. New York: Academic Press. Chapter 3, "Open versus closed questions."Schuman, H., & Scott, J. (1987). Problems in the use of survey questions to measure public opinion. Science, 236, 957-959.Skott, H. E. (1943). Attitude research in the Department of Agriculture. Public Opinion Quarterly, 7, 280-292.3. Closed Questions: Ratings vs. Rankings*Alwin, D. F., & Krosnick, J. A. (1985). The measurement of values in surveys: A comparison of ratings and rankings. Public Opinion Quarterly, 49, 535-552. Elig, T. W., & Frieze, I. H. (1979). Measuring causal attributions for success and failure.Journal of Personality and Social Psychology, 37, 621-634.Feather, N. T. (1973). The measurement of values: Effects of different assessment procedures. Australian Journal of Psychology, 25, 221-231.Guilford, J. P. (1954). Psychometric methods. New York: McGraw-Hill.*Herzog, A. R., & Bachman, J. G. (1981). Effects of questionnaire length on response quality. Public Opinion Quarterly, 45, 549-559.*Krosnick, J. A., & Alwin, D. F. (1987). A test of the form-resistant correlation hypothesis: Ratings, rankings, and the measurement of values. Public OpinionQuarterly, 52, 526-538.McIntyre, S. H., & Ryans, A. B. (1977). Time and accuracy measures for alternative multidimensional scaling data collection methods: Some additional results.Journal of Marketing Research, 14, 607-610.Moore, M. (1975). Rating versus ranking in the Rokeach value survey: An Israeli comparison. European Journal of Social Psychology, 5, 405-408.Munson, J. M., & McIntyre, S. H. (1979). Developing practical procedures for the measurement of personal values in cross-cultural marketing. Journal ofMarketing Research, 16, 48-52.Rankin, W. L., & Grube, J. W. (1980). A comparison of ranking and rating procedures for value system measurement. European Journal of Social Psychology, 10, 233-246.Reynolds, T. J., & Jolly, J. P. (1980). Measuring personal values: An evaluation of alternative methods. Journal of Marketing Research, 17, 531-536.Schulz, U., & May, T. (1989). The recording of social orientations with ranking and pair comparison procedures. European Journal of Social Psychology, 19, 41-59.4. Closed Questions: Number of Scale PointsAndrews, F. M. (1984). Construct validity and error components of survey measures: A structural modeling approach. Public Opinion Quarterly, 48, 409-442.Bass, B. M., Cascio, W. F., & O'Connor, E. J. (1974). Magnitude estimations of expressions of frequency and amount. Journal of Applied Psychology, 59, 313-320.Bendig, A. W. (1953). The reliability of self-ratings as a function of amount of verbal anchoring and of the number of categories on the scale. Journal of AppliedPsychology, 37, 38-41.Bendig, A. W. (1954). Transmitted information and the length of rating scales. Journal of Experimental Psychology, 47, 303-308.Bendig, A. W., & Hughes, J. B. (1953). Effect of amount of verbal anchoring and number of rating-scale categories upon transmitted information. Journal ofExperimental Psychology, 46, 87-90.Birkett, N. J. (1986). Selecting the number of response categories for a Likert-type scale.Proceedings of the American Statistical Association 1987 Annual Meetings,Section on Survey Research Methods.Bishop, G. F. (1987). Experiments with the middle response alternative in survey questions. Public Opinion Quarterly, 51, 220-232.Champney, H., & Marshall, H. (1939). Optimal refinement of the rating scale. Journal of Applied Psychology, 23, 323-331.Cox, E. P. (1980). The optimal number of response alternatives for a scale: A review.Journal of Marketing Research, 17, 407-422.Eagly, A. H., & Steffen, V. J. (1988). A note on assessing stereotypes. Personality and Social Psychology Bulletin, 14, 676-680.Finn, R. H. (1972). Effects of some variations in rating scale characteristics on the means and reliabilities of ratings. Educational and Psychological Measurement,32, 255-265.Garner, W. R. (1960). Rating scales, discriminability, and information transmission.Psychological Review, 67, 343-352.Ghiselli, E. E. (1939). All or none versus graded response questionnaires. Journal of Applied Psychology, 23, 405-413.Green, P. E., & Rao, V. R. (1970). Rating scales and information recovery - how many scales and response categories to use? Journal of Marketing, 34, 33-39.Kalton, G., Roberts, J., & Holt, D. (1980). The effects of offering a middle response option with opinion questions. Statistician, 29, 65-78.Komorita, S. S., & Graham, W. K. (1965). Number of scale points and the reliability of scales. Educational and Psychological Measurement, 25, 897-995.Lehmann, D. R., & Hulbert, J. (1972). Are three-point scales always good enough?Journal of Marketing Research, 9, 444-446.Lipset, S. M., & Schneider, W. (1983). The confidence gap. New York: The Free Press, p. 89-96.Lissitz, R. W., & Green, S. B. (1975). Effect of the number of scale points on reliability:A monte carlo approach. Journal of Applied Psychology, 60, 10-13+Lodge, M. (1981). Magnitude scaling: Quantitative measurement of opinions. Beverly Hills: Sage.Lodge, M., & Tursky, B. (1979). Comparisons between category and magnitude scaling of political opinion employing SRC/CPS items. American Political ScienceReview, 73, 50-66.Lodge, M., & Tursky, B. (1981) The social-psychophysical scaling of political opinion.In B. Wegener (Ed.), Social attitudes and psychophysical measurement. Hillsdale, N.J.: Erlbaum.Lodge, M., Cross, D., Tursky, B., & Tannenhaus, J. (1975). The psychophysical scaling and validation of a political support scale. American Journal of Political Science, 19, 611-649.Lodge, M., Cross, D., Tursky, B., Foley, M. A., & Foley, H. (1976). The calibration and cross-model validation of ratio scales of political opinion in survey research.Social Science Research, 5, 325-347.Lodge, M., Cross, D., Tursky, B., Tannenhaus, J., & Reeder, R. (1976). The psychophysical scaling of political support in the 'real world'. PoliticalMethodology, 2, 159-182.Matell, M. S., & Jacoby, J. (1971). Is there an optimal number of alternatives for Likert scale items? Study I: Reliability and validity. Educational and PsychologicalMeasurement, 31, 657-674.Matell, M. S., & Jacoby, J. (1972). Is there an optimal number of alternatives for Likert-scale items? Effects of testing time and scale properties. Journal of AppliedPsychology, 56, 506-509.McGuire, W. J. (1981). The probabilogical model of cognitive structure and attitude change. In R. E. Petty, T. M. Ostrom, and T. C. Brock (Eds.), Cognitiveresponses in persuasion. Hillsdale, NJ: Erlbaum.Peterson, B. L. (1985). Confidence: Categories and confusion. GSS Technical Report No. 50, National Opinion Research Center, University of Chicago.Ramsay, J. O. (1973). The effect of number of categories in rating scales on precision of estimation of scale values. Psychometrika, 38, 513-532.Rosenstone, S. J., Hansen, J. M., & Kinder, D. R. (1986). Measuring change in personal economic well-being. Public Opinion Quarterly, 50, 176-192.*Schuman, H., & Presser, S. (1981). Questions and answers in attitude surveys. New York: Academic Press. Chapters 6, "Measuring a middle position."Smith, T. W., & Peterson, B. L. (1985). The impact of number of response categories on inter-item associations: Experimental and simulated results. Paper presented atthe American Sociological Association annual meetings, Washington, D.C. Stember, H., & Hyman, H. (1949-1950). How interviewer effects operate through question form. International Journal of Opinion and Attitude Research, 3, 493-512.Symonds, P. M. (1924). On the loss of reliability in rating due to coarseness of the scale.Journal of Experimental Psychology, 456-461.Warr, P., Barter, J., & Brownridge, G. (1983). On the independence of positive and negative affect. Journal of Personality and Social Psychology, 44, 644-651. Watson, D. (1988). The vicissitudes of mood measurement: Effects of varying descriptors, time frames, and response formats on measures of positive andnegative affect. Journal of Personality and Social Psychology, 55, 128-141.*Wedell, D. H., & Parducci, A. (1988). The category effect in social judgment: Experimental ratings of happiness. Journal of personality and Social Psychology,55, 341-356.Welch, R. E. (1972). The use of magnitude estimation in attitude scaling: Constructing a measure of political dissatisfaction. Social Science Quarterly, 76-87.5. Closed Questions: Verbal vs. Numerical Scale Point LabelsAlbaum, G., & Murphy, B. D. (1988). Extreme response on a Likert scale.Psychological Reports, 63, 501-502.Andrews, F. M. (1984). Construct validity and error components of survey measures: A structural modeling approach. Public Opinion Quarterly, 48, 409-442.Bass, B. M., Cascio, W. F., & O'Connor, E. J. (1974). Magnitude estimations of expressions of frequency and amount. Journal of Applied Psychology, 59, 313-320.Bendig, A. W. (1953). The reliability of self-ratings as a function of amount of verbal anchoring and of the number of categories on the scale. Journal of AppliedPsychology, 37, 38-41.Bendig, A. W., & Hughes, J. B. (1953). Effect of amount of verbal anchoring and number of rating-scale categories upon transmitted information. Journal ofExperimental Psychology, 46, 87-90.*Bradburn, N. M., & Miles, C. (1979). Vague qualifiers. Public Opinion Quarterly, 43, 92-101.Bryant, G. D., & Norman, G. R. (19??). Expressions of probability: Words and numbers.New England Journal of Medicine, 302, 411.Budescu, D. V., & Wallsten, T. S. (1985). Consistency in interpretation of probabilistic phrases. Organizational Behavior and Human Decision Making, 36, 391-405. Chase, C. I. (1969). Often is where you find it. American Psychologist, 24, 1043.Cliff, N. (1959). Adverbs as multipliers. Psychological Review, 66, 27-44.Cohen, J. Dearnley, E. J., & Hansel, C. E. M. (1958). A quantitative study of meaning.British Journal of Educational Psychology, 28, 141-148.Eagly, A. H., & Steffen, V. J. (1988). A note on assessing stereotypes. Personality and Social Psychology Bulletin, 14, 676-680.Finn, R. H. (1972). Effects of some variations in rating scale characteristics on the means and reliabilities of ratings. Educational and Psychological Measurement,32, 255-265.Goocher, B. E. (1965). Effects of attitude and experience on the selection of frequency adverbs. Journal of Verbal Learning and Verbal Behavior, 4, 193-195.Hakel, M. D. (1968). How often is often? American Psychologist, 23, 533-534. Koltko, M. E. (1989). How vagueness can ruin a survey: Comment on Pope, Tabachnick, & Keith-Spiegel. American Psychologist, 44, 845-846.Lichtenstein, S., & Newman, J. R. (1967). Empirical scaling of common verbal phrases associated with numerical probabilities. Bulletin of the Psychonomic Society, 9,563-564.Madden, J. M., & Bourdon, R. D. (1964). Effects of variations in scale format on judgment. Journal of Applied Psychology, 48, 147-151.Miller, P. V. (1984). Alternative question forms for attitude scale questions in telephone surveys. Public Opinion Quarterly, 48, 766-778.Moore, P. G. (1977). The manager's struggles with uncertainty. Journal of the Royal Statistical Association, 140, 129-165.Murphy, K. R., & Constans, J. I. (1987). Behavioral anchors as a source of bias in ratings. Journal of Applied Psychology, 72, 573-577.Ostrom, T. M., & Upshaw, H. S. (1968). Psychological perspective and attitude change.In A. G. Greenwald, T. C. Brock, and T. M. Ostrom (Eds.), PsychologicalFoundations of Attitudes. New York: Academic Press.Parducci, A. (1968). Often is often. American Psychologist, 23, 828.Pepper, S., & Prytulak, L. S. (1974). Sometimes frequently means seldom: Context effects in the interpretation of quantitative expressions. Journal of Research inPersonality, 8, 95-101.Peters, D. L., & McCormick, E. J. (1966). Comparative reliability of numerically anchored versus job-task anchored rating scales. Journal of Applied Psychology,50, 92-96.Pope, K. S., Tabachnick, B. G., & Keith-Spiegel, P. (1989). Reply to Koltko. American Psychologist, 44, 846-847.Reyna, V. F. (1981). The language of possibility and probability: Effects of negation on meaning. Memory and Cognition, 9, 642-650..Roslow, S., Wulfeck, W. H., & Corby, P. G. (1940). Consumer and opinion research: Experimental studies on the form of the question. Journal of Applied Psychology, 24, 334-346.Schwarz, N., & Scheuring, B. (1988). Judgments of relationship satisfaction: Inter- and intraindividual comparisons as a function of questionnaire structure. EuropeanJournal of Social Psychology, 18, 485-496.Simpson, R. H. (1944). The specific meanings of certain terms indicating different degrees of frequency. Quarterly Journal of Speech, 30, 328-330.Stone, D. R., & Johnson, R. T. (1959). A study of words indicating frequency. Journal of Educational Psychology, 50, 224-227.Teigen, K. H. (1988). When are low-probability events judged to be 'probable?' Effects of outcome-set characteristics on verbal probability estimates. Acta Psychologica, 68, 157-174.*Wallsten, T. S., Budescu, D. V., Rapoport, A., Zwick, R., & Forsyth, B. (1986).Measuring the vague meanings of probability terms. Journal of ExperimentalPsychology: General, 115, 348-365.Warr, P., Barter, J., & Brownridge, G. (1983). On the independence of positive and negative affect. Journal of Personality and Social Psychology, 44, 644-651.Watson, D. (1988). The vicissitudes of mood measurement: Effects of varying descriptors, time frames, and response formats on measures of positive andnegative affect. Journal of Personality and Social Psychology, 55, 128-141.Wedell, D. H., & Parducci, A. (1988). The category effect in social judgment: Experimental ratings of happiness. Journal of personality and Social Psychology, 55, 341-356.Weisberg, H. F., & Miller, A. H. (1980). Evaluation of the feeling thermometers: A report to the National Election Study Board based on data from the 1979 pilotstudy. Unpublished manuscript, Center for Political Studies, Institute for SocialResearch, University of Michigan.Zaller, J. (1988). Vague questions get vague answers: An experimental attempt to reduce response instability. Unpublished manuscript, University of California atLos Angeles.6. Closed Questions: Acquiescence and Other Response BiasesBachman, J. G., & O'Malley, P. M. (1984). Black-white differences in self-esteem: Are they affected by response styles? American Journal of Sociology, 90, 624-639. Bachman, J. G., & O'Malley, P. M. (1984). Yea-saying, nay-saying, and going to extremes: Black-white differences in response styles. Public Opinion Quarterly,48, 491-509.Bass, B. M. (1955). Authoritarianism or acquiescence? Journal of Abnormal and Social Psychology, 51, 616-623.Bentler, P. M., Jackson, D. N., & Messick, S. (1971). Identification of content and style:A two-dimensional interpretation of acquiescence. Psychological Bulletin, 76,186-204.Bentler, P. M., Jackson, D. N., & Messick, S. (1972). A rose by any other name.Psychological Bulletin, 77, 109-113.Bishop, G. F., Oldendick, R. W., & Tuchfarber, A. J. (1982). Effects of presenting one versus two sides of an issue in survey questions. Public Opinion Quarterly, 46,69-85.Bishop, G. F., Oldendick, R. W., & Tuchfarber, A. J. (1982). Effects of presenting one versus two sides of an issue in survey questions. Public Opinion Quarterly, 46,69-85.Blankenship, A. B. (1940). The influence of the question form upon the response in a public opinion poll. Psychological Record, 3, 345-422.Block, J. (1965). The challenge of response sets. New York: Appleton-Century-Crofts. Block, J. (1971). On further conjectures regarding acquiescence. Psychological Bulletin, 76, 205-210.Campbell, A., Converse, P. E., & Rogers, W. (1976). The quality of American life: Perceptions, evaluations, and satisfaction. New York: Russell Sage Foundation.Chapter 4.Campbell, A., Converse, P. E., Miller, W. E., & Stokes, D. E. (1960). The American Voter. New York: Wiley. Chapter 18.Clancy, K. J., & Wachsler, R. A. (1971). Positional effects in shared-cost surveys.Public Opinion Quarterly, 35, 258-265.Couch, A., & Keniston, K. (1960). Yeasayers and naysayers: Agreeing response set as a personality variable. Journal of Abnormal and Social Psychology, 60, 151-174.Couch, A., & Keniston, K. (1961). Agreeing response set and social desirability.Journal of Abnormal and Social Psychology, 62, 175-179.Crandall, J. E. (1965). Some relationship among sex, anxiety, and conservatism of judgment. Journal of Personality, 33, 99-107.Cronbach, L. J. (1941). An experimental comparison of the multiple true-false and multiple multiple-choice tests. Journal of Educational Psychology, 32, 533-543.Cronbach, L. J. (1942). Studies of acquiescence as a factor in the true-false test. Journal of Educational Psychology, 33, 401-415.Cronbach, L. J. (1946). Response sets and test validity. Educational and Psychological Measurement, 6, 475-494.Cronbach, L. J. (1950). Further evidence on response sets and test design. Educational and Psychological Measurement, 10, 3-31.Foster, R. J. (1961). Acquiescent response set as a measure of acquiescence. Journal of Abnormal and Social Psychology, 63, 155-160.Gage, N. L., & Chatterjee, B. B. (1960). The psychological meaning of acquiescence set: Further evidence. Journal of Abnormal and Social Psychology, 60, 280-283. Goldsmith, R. E., Stith, M. T., & White, J. D. (1987). The Rokeach value survey and social desirability. Journal of Social Psychology, 127, 553-554.Goldsmith, R. E., White, J. D., & Stith, M. T. (1987). Yeasaying and the Rokeach value survey: Interactions with age and race. Journal of Social Behavior andPersonality, 2, 251-258.Hamilton, D. L. (1968). Personality attributes associated with extreme response style.Psychological Bulletin, 69, 192-203.Hedges, B. M. (1979). Question wording effects: Presenting one or both sides of the case. Statistician, 28, 83-99.。