Monday, December 18, 2006

Of Samples and Bias

When I was in university, one of my favorite areas of study was experimental psychology (physiological being my favorite by a head). One of the things you learned pretty early on about psychological experiments and all surveys, from which a lot of behavioral data is gleaned, is that there is always bias and issues with just how well the data you collect reflects real behavior.

One of the things all foreign people tend to do is reach conclusions about Japan based on our anecdotal experience. We don't do this because we want to offer a skewed viewpoint of life here. We do it because that is what we have access to and it makes a huge impression on us. There is very little you can do about this issue except to seek out other sources of information (which will in turn include their own biases and erroneous conclusions) and, most importantly, be open-minded and flexible in your opinion.

Early on, many foreigners tend to form their viewpoints based on their experiences as English teachers. While conversation school teachers tend to meet a fair variety of people, they are still going to get a pretty narrow view of people in Japan. For one thing, the people you meet in schools usually want to have contact with foreigners and have an interest in expressing themselves in English. You don't meet the average person who has no interest or an active distaste for foreigners very often. Additionally, you tend to meet people who are affluent enough to afford attending such schools and who will tell you things which portray Japanese culture in a favorable light because they want you to like them.

Those who moved on from schools to working in Japanese offices and have direct exposure to the corporate environment have a somewhat broader perspective but it's still far from putting us in a position to understand the culture as well as we might. The types of companies that will employ foreigners tend to need foreign employees for their language skills or they tend to be in the tech industry. There are certain kinds of businesses that we don't get an intimate knowledge of. However, I think you really get a good feel for corporate culture from working in an office and can see beyond the stereotypes of Japanese businesspeople that western news sources offer.

Finally, there are those who marry Japanese people and they probably are in the best position to get a full perspective on the culture. However, even foreigners with Japanese spouses will be treated differently than Japanese people treat each other (and possibly shielded from certain behaviors. Also, some foreigners with Japanese spouses start to form a bias to help them integrate with Japanese culture better. That is, some people will start saying that there is little or not prejudice against foreigners in Japan or start to assert that foreigners deserve poor treatment on the occasions when they experience it because they don't try to fit in hard enough.

In my particular case, I have had the chance to speak to copious numbers of people for short periods of time. In my former job, I spoke to a minimum of 700 different people each year in short conversations. This allowed me to ask a lot of people the same questions. In essence, I have functioned as a one-person surveyor on a limited number of points and my sample size is easily over 10,000. This is a far greater sample than you see in most surveys. Unfortunately, my sample is still pretty skewed as 99% of the people I spoke as a part of my job were male company employees (or college students) and probably 70% were 25 or younger.

In my work outside of that company (at a conversation and as a private teacher), I've had many chances for in-depth conversations with a relatively small sampling of people who are predominately female and over 30. Their responses to questions are vastly different from those that I used to get when I was interviewing young men.

One way in which I attempt to find a little balance for my experiences with other perspectives is to read the surveys on What Japan Thinks. These surveys are also, of course, from limited sample sizes. In fact, most of the time, the samples are insignificant for a population the size of Japan's and the fact that all surveys are done voluntarily further degrades the validity of any survey (in any country, by any method, and on any topic). Only a certain personality type will take the time to answer survey questions. However, at least these samples represent people who are responding in Japanese and are done by a method other than a face-to-face encounter so reading them broadens the range of my perspective a bit more. They're also very interesting as anecdotal information. I often discuss them with my students to see if they concur.

I think it's pretty important to allow your theories about Japan and its people and culture to be open to modification as time goes by. It's also important not to take anything you read on the Internet at face value no matter how knowledgeable the source appears to be. Even after a lot of time and conversations with a lot of people, there are still things I get wrong or don't know.

2 comments:

wewood said...

You're right in that we know about "the Japanese" or "the English" or "the Russians" by the people we meet--and that is, by the nature of the human condition, a limited sample. The trap, I think, is what you point out: That these people represent the whole when there is no whole to represent. Or, in a country of 130 million people, the whole is too large and too diverse to represent. So we can never generalize, never stereotype. What, after all, do you say when a Japanese friend asks you, "Why do Americans hate black people?" (A) Not all Americans hate black people. (B) Even those who hate black people hate for different reasons.

What is interesting, I think, is to try to tease out the commonalities among the Japanese (English, Russians, etc.) with the sure knowledge that these do not apply to every individual, and even when they do apply broadly--like a sense of group identify in the case of the Japanese--they have different strengths in different individuals.

I also think that the better you know the language, the better you can understand the culture, the common assumptions, and the subtlties that make many Japanese different from many Americans.

Shari said...

Thank you for the very well-written and insightful comment, wewood. Your points are well-taken.

One thing that I try hard not to do is say things like "all" or "most" though sometimes I slip up. ;-)

I think the "group identity" concept is relatively misunderstood by many non-Japanese people. I could be wrong about it but my sense of it is that it's not that everyone is the same but that most people gear their actions toward a harmonious environment. It's not their characters that are the same but rather that they react toward a common goal which often subverts their own wishes in favor of not making trouble. Most people in Japan are raised with this notion though it is slowly diminishing.