Lesson Two - Sociological Research

Sociologists examine the world, see a problem or interesting pattern, and set out to study it. They use research methods to design a study—perhaps a positivist, quantitative method for conducting research and obtaining data, or perhaps an ethnographic study utilizing an interpretive framework. Planning the research design is a key step in any sociological study. When entering a particular social environment, a researcher must be careful. There are times to remain anonymous and times to be overt. There are times to conduct interviews and times to simply observe. Some participants need to be thoroughly informed; others should not know they are being observed. A researcher would not stroll into a crime-ridden neighbourhood at midnight, calling out, “Any gang members around?” And if a researcher walked into a coffee shop and told the employees they would be observed as part of a study on work efficiency, the self-conscious, intimidated baristas might not behave naturally.

In the 1920s, leaders of a Chicago factory called Hawthorne Works commissioned a study to determine whether or not changing certain aspects of working conditions could increase or decrease worker productivity. Sociologists were surprised when the productivity of a test group increased when the lighting of their workspace was improved. They were even more surprised when productivity improved when the lighting of the workspace was dimmed. In fact almost every change of independent variable—lighting, breaks, work hours—resulted in an improvement of productivity. But when the study was over, productivity dropped again.

Why did this happen? In 1953, Henry A. Landsberger analyzed the study results to answer this question. He realized that employees’ productivity increased because sociologists were paying attention to them. The sociologists’ presence influenced the study results. Worker behaviours were altered not by the lighting but by the study itself. From this, sociologists learned the importance of carefully planning their roles as part of their research design (Franke and Kaul 1978). Landsberger called the workers’ response the Hawthorne effect—people changing their behaviour because they know they are being watched as part of a study.

The Hawthorne effect is unavoidable in some research. In many cases, sociologists have to make the purpose of the study known for ethical reasons. Subjects must be aware that they are being observed, and a certain amount of artificiality may result (Sonnenfeld 1985). Making sociologists’ presence invisible is not always realistic for other reasons. That option is not available to a researcher studying prison behaviours, early education, or the Ku Klux Klan. Researchers cannot just stroll into prisons, kindergarten classrooms, or Ku Klux Klan meetings and unobtrusively observe behaviours. In situations like these, other methods are needed. All studies shape the research design, while research design simultaneously shapes the study. Researchers choose methods that best suit their study topic and that fit with their overall goal for the research.

In planning a study’s design, sociologists generally choose from four widely used methods of social investigation: survey, experiment, field research, and textual or secondary data analysis (or use of existing sources). Every research method comes with plusses and minuses, and the topic of study strongly influences which method or methods are put to use.

Surveys

As a research method, a survey collects data from subjects who respond to a series of questions about behaviours and opinions, often in the form of a questionnaire. The survey is one of the most widely used positivist research methods. The standard survey format allows individuals a level of anonymity in which they can express personal ideas.

Questionnaires are a common research method; the Statistics Canada Census is a well-known example. (Photo courtesy of Khosrow Ebrahimpour/Flickr)

At some point or another, everyone responds to some type of survey. The Statistics Canada census is an excellent example of a large-scale survey intended to gather sociological data. Customers also fill out questionnaires at stores or promotional events, responding to questions such as “How did you hear about the event?” and “Were the staff helpful?” You’ve probably picked up the phone and heard a caller ask you to participate in a political poll or similar type of survey: “Do you eat hot dogs? If yes, how many per month?” Not all surveys would be considered sociological research. Marketing polls help companies refine marketing goals and strategies; they are generally not conducted as part of a scientific study, meaning they are not designed to test a hypothesis or to contribute knowledge to the field of sociology. The results are not published in a refereed scholarly journal, where design, methodology, results, and analyses are vetted.

Often, polls on TV do not reflect a general population, but are merely answers from a specific show’s audience. Polls conducted by programs such as American Idol or Canadian Idol represent the opinions of fans but are not particularly scientific. A good contrast to these are the BBM Ratings, which determine the popularity of radio and television programming in Canada through scientific market research. Sociologists conduct surveys under controlled conditions for specific purposes. Surveys gather different types of information from people. While surveys are not great at capturing the ways people really behave in social situations, they are a great method for discovering how people feel and think—or at least how they say they feel and think. Surveys can track attitudes and opinions, political preferences, reported individual behaviours (such as sleeping, driving, or texting habits), or factual information such as employment status, income, and education levels. A survey targets a specific population, people who are the focus of a study, such as university athletes, international students, or teenagers living with type 1 (juvenile-onset) diabetes.

Most researchers choose to survey a small sector of the population, or a sample: that is, a manageable number of subjects who represent a larger population. The success of a study depends on how well a population is represented by the sample. In a random sample, every person in a population has the same chance of being chosen for the study. According to the laws of probability, random samples represent the population as a whole. For instance, an Ipsos Reid poll, if conducted as a nationwide random sampling, should be able to provide an accurate estimate of public opinion whether it contacts 2,000 or 10,000 people. However the validity of surveys can be threatened when part of the population is inadvertently excluded from the sample (e.g., telephone surveys that rely on land lines exclude people that use only cell phones) or when there is a low response rate. After selecting subjects, the researcher develops a specific plan to ask questions and record responses.

It is important to inform subjects of the nature and purpose of the study upfront. If they agree to participate, researchers thank subjects and offer them a chance to see the results of the study if they are interested. The researcher presents the subjects with an instrument (a means of gathering the information). A common instrument is a structured questionnaire, in which subjects answer a series of set questions. For some topics, the researcher might ask yes-or-no or multiple-choice questions, allowing subjects to choose possible responses to each question.

This kind of quantitative data—research collected in numerical form that can be counted—is easy to tabulate. Just count up the number of “yes” and “no” answers or tabulate the scales of “strongly agree,” “agree,” disagree,” etc. responses and chart them into percentages. This is also their chief drawback however: their artificiality. In real life, there are rarely any unambiguously yes-or-no answers. Questionnaires can also ask more complex questions with more complex answers—beyond “yes,” “no,” “agree,” “strongly agree,” or an option next to a checkbox. In those cases, the answers are subjective, varying from person to person. How do you plan to use your university education? Why do you follow Justin Bieber around the country and attend every concert? Those types of questions require short essay responses, and participants willing to take the time to write those answers will convey personal information about religious beliefs, political views, and morals.

Some topics that reflect internal thought are impossible to observe directly and are difficult to discuss honestly in a public forum. People are more likely to share honest answers if they can respond to questions anonymously. This type of information is qualitative data—results that are subjective and often based on what is seen in a natural setting. Qualitative information is harder to organize and tabulate. The researcher will end up with a wide range of responses, some of which may be surprising. The benefit of written opinions, though, is the wealth of material that they provide.

An interview is a one-on-one conversation between the researcher and the subject, and is a way of conducting surveys on a topic. Interviews are similar to the short answer questions on surveys in that the researcher asks subjects a series of questions. However, participants are free to respond as they wish, without being limited by predetermined choices. In the back-and-forth conversation of an interview, a researcher can ask for clarification, spend more time on a subtopic, or ask additional questions. In an interview, a subject will ideally feel free to open up and answer questions that are often complex. There are no right or wrong answers. The subject might not even know how to answer the questions honestly. Questions such as “How did society’s view of alcohol consumption influence your decision whether or not to take your first sip of alcohol?” or “Did you feel that the divorce of your parents would put a social stigma on your family?” involve so many factors that the answers are difficult to categorize. A researcher needs to avoid steering or prompting the subject to respond in a specific way; otherwise, the results will prove to be unreliable. And, obviously, a sociological interview is not an interrogation. The researcher will benefit from gaining a subject’s trust, from empathizing or commiserating with a subject, and from listening without judgment.

Experiments

You’ve probably tested personal social theories. “If I study at night and review in the morning, I’ll improve my retention skills.” Or, “If I stop drinking soda, I’ll feel better.” Cause and effect. If this, then that. When you test the theory, your results either prove or disprove your hypothesis. One way researchers test social theories is by conducting an experiment, meaning they investigate relationships to test a hypothesis—a scientific approach. There are two main types of experiments: lab-based experiments and natural or field experiments.

In a lab setting, the research can be controlled so that perhaps more data can be recorded in a certain amount of time. In a natural or field-based experiment, the generation of data cannot be controlled but the information might be considered more accurate since it was collected without interference or intervention by the researcher. As a research method, either type of sociological experiment is useful for testing if-then statements: if a particular thing happens, then another particular thing will result.

To set up a lab-based experiment, sociologists create artificial situations that allow them to manipulate variables. Classically, the sociologist selects a set of people with similar characteristics, such as age, class, race, or education. Those people are divided into two groups. One is the experimental group and the other is the control group. The experimental group is exposed to the independent variable(s) and the control group is not. This is similar to pharmaceutical drug trials in which the experimental group is given the test drug and the control group is given a placebo or sugar pill. To test the benefits of tutoring, for example, the sociologist might expose the experimental group of students to tutoring while the control group does not receive tutoring. Then both groups would be tested for differences in performance to see if tutoring had an effect on the experimental group of students. As you can imagine, in a case like this, the researcher would not want to jeopardize the accomplishments of either group of students, so the setting would be somewhat artificial. The test would not be for a grade reflected on their permanent record, for example.

The Stanford Prison Experiment is perhaps one of the most famous sociological experiments ever conducted. In 1971, 24 healthy, middle-class male university students were selected to take part in a simulated jail environment to examine the effects of social setting and social roles on individual psychology and behaviour. They were randomly divided into 12 guards and 12 prisoners. The prisoner subjects were arrested at home and transported blindfolded to the simulated prison in the basement of the psychology building on the campus of Stanford University. Within a day of arriving the prisoners and the guards began to display signs of trauma and sadism respectively. After some prisoners revolted by blockading themselves in their cells, the guards resorted to using increasingly humiliating and degrading tactics to control the prisoners through psychological manipulation. The experiment had to be abandoned after only six days because the abuse had grown out of hand (Haney, Banks, and Zimbardo 1973). While the insights into the social dynamics of authoritarianism it generated were fascinating, the Stanford Prison Experiment also serves as an example of the ethical issues that emerge when experimenting on human subjects.

Field Research

Sociological researchers travel across countries and cultures to interact with and observe subjects in their natural environments. (Photo courtesy of Patrick/flickr)

The work of sociology rarely happens in limited, confined spaces. Sociologists seldom study subjects in their own offices or laboratories. Rather, sociologists go out into the world. They meet subjects where they live, work, and play. Field research refers to gathering primary data from a natural environment without doing a lab experiment or a survey. It is a research method suited to an interpretive approach rather than to positivist approaches. To conduct field research, the sociologist must be willing to step into new environments and observe, participate, or experience those worlds. In fieldwork, the sociologists, rather than the subjects, are the ones out of their element. The researcher interacts with or observes a person or people, gathering data along the way. The key point in field research is that it takes place in the subject’s natural environment, whether it’s a coffee shop or tribal village, a homeless shelter or a care home, a hospital, airport, mall, or beach resort.

While field research often begins in a specific setting, the study’s purpose is to observe specific behaviours in that setting. Fieldwork is optimal for observing how people behave. It is less useful, however, for developing causal explanations of why they behave that way. From the small size of the groups studied in fieldwork, it is difficult to make predictions or generalizations to a larger population. Similarly, there are difficulties in gaining an objective distance from research subjects. It is difficult to know whether another researcher would see the same things or record the same data. We will look at three types of field research: participant observation, ethnography, and the case study.

Participant Observation

In 2000, a comic writer named Rodney Rothman wanted an insider’s view of white-collar work. He slipped into the sterile, high-rise offices of a New York “dot com” agency. Every day for two weeks, he pretended to work there. His main purpose was simply to see if anyone would notice him or challenge his presence. No one did. The receptionist greeted him. The employees smiled and said good morning. Rothman was accepted as part of the team. He even went so far as to claim a desk, inform the receptionist of his whereabouts, and attend a meeting. He published an article about his experience in The New Yorker called “My Fake Job” (2000). Later, he was discredited for allegedly fabricating some details of the story and The New Yorker issued an apology. However, Rothman’s entertaining article still offered fascinating descriptions of the inside workings of a “dot com” company and exemplified the lengths to which a sociologist will go to uncover material.

Is she a working waitress or a sociologist conducting a study using participant observation? (Photo courtesy of Zoetnet/flickr)

Rothman had conducted a form of study called participant observation, in which researchers join people and participate in a group’s routine activities for the purpose of observing them within that context. This method lets researchers study a naturally occurring social activity without imposing artificial or intrusive research devices, like fixed questionnaire questions, onto the situation. A researcher might go to great lengths to get a firsthand look into a trend, institution, or behaviour. Researchers temporarily put themselves into “native” roles and record their observations. A researcher might work as a waitress in a diner, or live as a homeless person for several weeks, or ride along with police officers as they patrol their regular beat. Often, these researchers try to blend in seamlessly with the population they study, and they may not disclose their true identity or purpose if they feel it would compromise the results of their research.

At the beginning of a field study, researchers might have a question: “What really goes on in the kitchen of the most popular diner on campus?” or “What is it like to be homeless?” Participant observation is a useful method if the researcher wants to explore a certain environment from the inside. Field researchers simply want to observe and learn. In such a setting, the researcher will be alert and open minded to whatever happens, recording all observations accurately. Soon, as patterns emerge, questions will become more specific, observations will lead to hypotheses, and hypotheses will guide the researcher in shaping data into results. In a study of small-town America conducted by sociological researchers John S. Lynd and Helen Merrell Lynd, the team altered their purpose as they gathered data. They initially planned to focus their study on the role of religion in American towns. As they gathered observations, they realized that the effect of industrialization and urbanization was the more relevant topic of this social group. The Lynds did not change their methods, but they revised their purpose. This shaped the structure of Middletown: A Study in Modern American Culture, their published results (Lynd and Lynd 1959).

A classroom in Muncie, Indiana, in 1917, five years before John and Helen Lynd began researching this “typical” American community. (Photo courtesy of Don O’Brien/flickr)

The Lynds were upfront about their mission. The townspeople of Muncie, Indiana, knew why the researchers were in their midst. But some sociologists prefer not to alert people to their presence. The main advantage of covert participant observation is that it allows the researcher access to authentic, natural behaviours of a group’s members. The challenge, however, is gaining access to a setting without disrupting the pattern of others’ behaviour. Becoming an inside member of a group, organization, or subculture takes time and effort. Researchers must pretend to be something they are not. The process could involve role playing, making contacts, networking, or applying for a job. Once inside a group, some researchers spend months or even years pretending to be one of the people they are observing. However, as observers, they cannot get too involved. They must keep their purpose in mind and apply the sociological perspective. That way, they illuminate social patterns that are often unrecognized. Because information gathered during participant observation is mostly qualitative, rather than quantitative, the end results are often descriptive or interpretive. The researcher might present findings in an article or book, describing what he or she witnessed and experienced.

Field research happens in real locations. What type of environment do work spaces foster? What would a sociologist discover after blending in? (Photo courtesy of drewzhrodague/flickr)

This type of research is what journalist Barbara Ehrenreich conducted for her book Nickel and Dimed. One day over lunch with her editor, as the story goes, Ehrenreich mentioned an idea. How can people exist on minimum-wage work? How do low-income workers get by? she wondered. Someone should do a study. To her surprise, her editor responded, Why don’t you do it? That is how Ehrenreich found herself joining the ranks of the low-wage service sector. For several months, she left her comfortable home and lived and worked among people who lacked, for the most part, higher education and marketable job skills. Undercover, she applied for and worked minimum wage jobs as a waitress, a cleaning woman, a nursing home aide, and a retail chain employee. During her participant observation, she used only her income from those jobs to pay for food, clothing, transportation, and shelter. She discovered the obvious: that it’s almost impossible to get by on minimum wage work. She also experienced and observed attitudes many middle- and upper-class people never think about. She witnessed firsthand the treatment of service work employees. She saw the extreme measures people take to make ends meet and to survive. She described fellow employees who held two or three jobs, worked seven days a week, lived in cars, could not pay to treat chronic health conditions, got randomly fired, submitted to drug tests, and moved in and out of homeless shelters. She brought aspects of that life to light, describing difficult working conditions and the poor treatment that low-wage workers suffer.

Ethnography

Ethnography is the extended observation of the social perspective and cultural values of an entire social setting. Researchers seek to immerse themselves in the life of a bounded group, by living and working among them. Often ethnography involves participant observation, but the focus is the systematic observation of an entire community.

The heart of an ethnographic study focuses on how subjects view their own social standing and how they understand themselves in relation to a community. An ethnographic study might observe, for example, a small Newfoundland fishing town, an Inuit community, a village in Thailand, a Buddhist monastery, a private boarding school, or Disney World. These places all have borders. People live, work, study, or vacation within those borders. People are there for a certain reason and therefore behave in certain ways and respect certain cultural norms. An ethnographer would commit to spending a determined amount of time studying every aspect of the chosen place, taking in as much as possible, and keeping careful notes on his or her observations.

A sociologist studying a tribe in the Amazon might learn the language, watch the way villagers go about their daily lives, ask individuals about the meaning of different aspects of activity, study the group’s cosmology and then write a paper about it. To observe a spiritual retreat centre, an ethnographer might sign up for a retreat and attend as a guest for an extended stay, observe and record how people experience spirituality in this setting, and collate the material into results.