Journal of Socio-Informatics Vol. 7, No. 1 Nov. 2014

Validity of TV, Video, Video Game Viewing/Usage Diary:Comparison with the Data Measured by a Viewing State
Measurement Device
Keywords:
Media use measurement, Viewing diary, Validity, TV, Video, Videogame

Rei KUDO, Value Management Institute, Inc.
Shinichi HORIKAWA, NHK Broadcasting Culture Research Institute
Akira SAKAMOTO, Ochanomizu University

Abstract
The aim of this study was to examine the validity of data entered in participating subjects’ TV,
video, and video game viewing/usage diaries.
The participating subjects were eight families with third and fourth graders in the Tokyo
Metropolitan Area. The amount of TV viewing (total and by TV channel), viewing of videorecorded TV programs, and playing of video games by third and fourth grade children wererecorded in the viewing/usage diary and at the same time measured by a viewing statemeasurement device. The correlation coefficient between the data obtained from the diary andthat from the measurement device was equal to or higher than the coefficient obtained in apreceding study, confirming the validity of the data entered in the viewing/usage diary.

1&:B$;'LQGG

Validity of TV, Video, Video Game Viewing/Usage Diary: Comparison with the Data Measured by a Viewing State Measurement Device

KUDO et al

To this end, a self-reporting questionnaire or a

1. Introduction

viewing diary has been often used as a method
In our modern information society, visual

for measuring the amount of media use. In a

media such as televisions, videos, DVDs, Blu-ray

viewing diary, the subject records the type ofdiscs, and video games are part of our daily lives.

media used, the names of viewed programs, andAlong with the increase of the role of visual media

the start and end times of media use. Therefore,in our daily living, there has been increaseda viewing diary has an advantage over a self-social and academic interest in such topics as thereportingphysiological and psychological effects of suchquestionnaire simply asks the participants how

media on its users and the relationship between

much time they spend using a certain type ofuser personality traits as motivational factors formedia or watching a certain type of content per

media use and the amount of media use. Due today, a viewing diary allows more detailed andthis interest, there have been many psychologicalaccurate measurements of the duration ofor sociological studies examining the amount ofviewing and the type of content viewed duringvisual media use by type or content as an

the study period. Moreover, the viewing diary

independentaalso has the advantage of the ability to measuredependent (objective) variable (e.g., Dill, 2012;

the use of multiple types of media simultaneously

Bryant & Oliver, 2008). In particular, a large(such as watching television while playing

number of studies have been conducted tohandheld games like Nintendo DS). If theexamine the relationships between children’s

participants are young children, their parents

visual media use and their physiological andusually record the diary for them. When thispsychological development, because children are

occurs, however, the accuracy of measured andbelieved to be more easily influenced by thoserecorded amounts of media use may be

media (Singer & Singer, 2012).

compromised.

(explanatory)

variableorquestionnaire

in

that,

while

a

Scientific research showing the relationshipAnderson et al. (1985) examined the accuracy

between media use and various psychologicalof TV viewing diaries for 5-year-old children

factors,andwritten by their parents. They studied thepersonality traits, has been a topic of great social

includingbehavioral

trendscorrelation between TV viewing time recorded ininterest. Therefore, if visual media exposure is tothe viewing diary in increments of 15 minutes

be used as an independent or a dependent

and TV viewing time calculated based on a video

variable, the actual amount of media use by study

recorded in a room where a participating childparticipants must be measured as accurately as

watched TV. The obtained correlation was. 84.

possible.

Anderson et al. (1985) used a video-recorded

The method, which most accurately measures

TV room as an objective index in the study. Note,the amount of the participants’ visual media use,

however, there is always some risk of unsuccessful

requires a device that automatically records therecording due to device failures or inappropriate

amount of time they spend in watching or

operation. Also, because of the diversity of visual

listening to media. However, it is generally

media used by children, it is necessary todifficult to applying this method to a large scale.

examine the validity of a viewing diary not only2&:B$;'LQGG

Journal of Socio-Informatics Vol. 7, No. 1 Nov. 2014

for the amount of TV viewing but also for thefrom among the families satisfying theseamount of DVD- or HDD-recorded TV programs,

conditions in order to eliminate bias due to theand the amount of video games played. In thismother’s work. These eight families were asked

study, therefore, the amount of media use wasto record their viewing habits via a machine andrecorded in a TV, video, and video game viewing/

maintain a diary of their visual media viewing/

usage diary, and at the same time measured by ausage. The mother of each participating family

device originally designed to obtain viewing rates

recorded in the diary her child’s amount of visualfor television stations. This device, connected to a

media use.

standard TV, is capable of recording the amount

2.2 Study periodof regular, BS, and CS TV programs viewed, theamount of DVD- and HDD-recorded TV programs

The study was conducted in two parts. The

viewed, and the amount of video games played.

first study was conducted from January 20 to 22,

Then the validity of data recorded in the viewing/

2012, and the second study was conducted fromusage diary was examined by calculating the

February 10 to 12, 2012. The study period was set

correlation between the data entered in the diaryfrom Friday to Sunday because lifestyle patterns

and the data obtained by the viewing state

differ by the day of the week. Moreover, themeasurement device.

study period was three days because this was the
maximum length of time the viewing state

2. Methodmeasuring device could record.
Each study was conducted with four families.

2.1 Participants

The participants of the first study were a female

This study was conducted in association withthird grader, a male third grader, a female fourthVideo Research Ltd., a company that measuresgrader, and a male fourth grader. The participants

TV program viewing rates by collecting data fromof the second study were a male third grader, aviewing state measurement devices installed inmale fourth grader, and two female fourth

the residences of participating families.

graders.

The process of selecting the participating
families began with a preliminary investigation of

2.3 Measurement of the amount of media use

TV viewing, conducted online, among families

The viewing/usage diary(1) Mothers of theworking with Video Research Ltd. Based on theparticipating children recorded in a viewing/

results of this preliminary investigation, families

usage diary the time their children started andwith third and fourth graders in primary school

ended watching TV, video-recorded TV programs

were selected. These families lived in Tokyo(VHS tapes, DVDs, or HDDs (including Blu-ray

Metropolitan Area and did not have any family

discs)) or playing video games. The amount ofmembers employed in mass communications orvisual media use was recorded in units of 15

research companies. Eight families were selected

minutes. When a participating child watched a(1) The viewing/usage diaries used in this research were used in the NHK research project, “Better Broadcasting
for Children.” Originally, they were used to record media use for a one-week period.

3&:B$;'LQGG

Validity of TV, Video, Video Game Viewing/Usage Diary: Comparison with the Data Measured by a Viewing State Measurement Device

KUDO et al

TV program, his/her mother recorded therecorded content was used to identify the channel

channel by selecting from NHK General TV

and the name of each program viewed, if the(NHK-G), NHK Educational TV (NHK-E),

participating child was identified as the viewer.

Nippon Television Network (NTV), TV Asahi,Then, the amount of time spent watching

Tokyo Broadcasting System Television (TBS),according to the viewing state measurement

TV Tokyo, Fuji Television Network (Fuji TV), or

device was translated into a value for each

Other. The mother recorded the channel number,

15-minute time frame. Finally, the number ofchannel name, program name, and/or game title;

times and the duration of the use of visual media

if “Other” was selected; a TV program recorded

were analyzed in the same manner as the data

in VHS, DVD, or HDD (including Blu-ray disc)obtained from the viewing/usage diary.

format was watched; or a video game was played.

2.4 Procedure

Figure 1 shows the sample of the viewing/usage

A researcher from Video Research Ltd. visited

diary used in this study.
The format used is similar to that of Anderson

each participating family before the study,

et al. (1985); this format lists the units of time

installed a viewing state measurement device andrecorded next to the TV channel number and thea hard disc recorder, and showed the family how

program name. However, Anderson et al. (1985)

to use them. At the same time, the researcher

did not record the amount of media use othergave each family a viewing/usage diary andthan TV.

showed how to enter information in the diary.

Then, the type of media used, how many times

The explanatory note includes the following: if

each channel was watched (every time a channel

the names of the programs, the titles of thewas watched within a 15-minute time frame, itgames or the time intervals of the media use

was counted as one time point), and how many

were unclear for the mothers, the participating

minutes each channel was viewed were measured

children need to confirm them; it is necessary tofrom 6 am to midnight (12 am) during the threerecord of all the types of media being used in

day study period, were recorded. Obtained datacases where multiple types of media were used

was used in analysis. For example, Figure 1

simultaneously; if there were any questions onshows that NTV programs were watched at two

the manner of recording, a researcher wastime points for 30 minutes in total.

consulted with; and other such similar things.

Viewing state measurement device A viewing

The notion of recording media use in 15-min timestate measurement device and a hard discintervals was explained using the following

recorder were connected to the TV that was mostconcrete example. “If your child was in contact

often used in the residence of each participatingwith media 6:35 AM onward, please draw afamily. The device was capable of identifying thevertical line starting from 6:30 AM.” Additionally,

viewer when the TV was turned on and controlled

the researcher asked each family to fill in theby its remote control. Identification of the viewer

diary only if participating children watching TV

was then collected as data via the Internet. After

connected to the viewing state measurement

the viewer was identified, the hard disc recorderdevice. Each family was told that the objective ofstarted to record what was shown on TV. The

the study was to examine how TV was used.
4&:B$;'LQGG

Figure 1 The sample of the TV, video, video game viewing/usage diary

Journal of Socio-Informatics Vol. 7, No. 1 Nov. 20145&:B$;'LQGG

Validity of TV, Video, Video Game Viewing/Usage Diary: Comparison with the Data Measured by a Viewing State Measurement Device

KUDO et al

After the study was complete, the researcher

video games. For all participating children, avisited each participating family to remove thelonger duration of media use was recorded in theviewing state measurement device and hard discviewing/usage diary than by the viewing state

recorder. At the same time, the researcher

measurement device (Table 2). The smallest

collected the diary after confirming it contained

difference was 24 minutes, and the largest

no missing information or mistakes. In thosedifference was 245 minutes. Mean of thecases where the times when media use began ordifference was 146.88 minutes (SD = 69.92) for

finished were unclear, the researcher checked

total duralion of media use, 30.75 minutes (SD =with the family and made necessary revisions.

117.71) for TV viewing.

3. Results

3.3 Correlations between the viewing/usage
diary

data

and

the

viewingstatemeasurement device data for the amount

3.1 Frequency of media use according to theof media use

viewing/usage diary and the viewing statemeasurement device

For each 15-minute time frame, the correlation

Table 1 shows how many times eachbetween the data recorded in the viewing/usage

participating child used media during the study

diary and the measurement by the viewing state

period. The difference between the diary datameasurement device was examined for theand device measurement data was then obtained

amount of media use. The correlation coefficientfor the total number of times of media use, whichon each channel and media type was calculated

included viewing of TV programs regardless ofusing 1728 data items (8 samples × 3 days × 72

the channel, viewing of video-recorded TV

time points).

programs, and playing of video games. For half oftheparticipantstheviewing/usage

Table 3 shows the result of Pearson’s product-

diary

moment correlation analysis. The correlations

recorded a higher frequency of media use, whileobtained for the amount of TV viewing by channel

the viewing state measurement device recorded

were significant, ranging from .49 to .82. Thea higher frequency of media use for the other halfcorrelation for the total amount of TV viewingof the participants (Table 1).

was .79, also significant. The correlation was .73
for viewing video-recorded TV programs and .59

3.2 Total duration of media use according tofor playing video games. There was also a positivethe viewing/usage diary and the viewing

and significant correlation of .75 for the total

state measurement device

amount of TV viewing, viewing of video-recorded

Table 2 shows how long each participating

TV programs, and playing of video games

child used the media during the study period.

combined.

The difference between the diary data and device

Finally, the correlations between the datameasurement data was then obtained for the total

entered in the diary and measurement data

duration of media use, which included viewing ofobtained by the device were obtained for the total

TV programs regardless of the channel, viewing

amount of use of each type of visual media toof video-recorded TV programs, and playing ofcompare with Anderson et al (1985) (Table 4).
6&:B$;'LQGG

&:B$;'LQGG

Table 1Frequency of media use by each participating child (measured in time points)

7

Journal of Socio-Informatics Vol. 7, No. 1 Nov. 2014

1) “Diary” means the measured amount of visual media use recorded in the TV, video, video game viewing/usage diary, and “device” means theamount of visual media use measured by the viewing state measurement device. “Difference” is the value obtained by subtracting the amount ofvisual media use measured by the viewing state measurement device from the amount of visual media use recorded in the diary.
2) “All channels” means the total number of times that NHK-G, NHK-E, NTV, TV Asahi, TBS, TV Tokyo, Fuji TV, or Other channel was watched.
3) “Total time points” is obtained by adding “All channels,” the number of times video-recorded TV programs were watched, and the number of times
video games were played.

81) ”Diary” means the measured amount of visual media use recorded in the TV, video, video game viewing/usage diary, and “device” means theamount of visual media use measured by the viewing state measurement device. “Difference” is the value obtained by subtracting the amount ofvisual media use measured by the viewing state measurement device from the amount of visual media use recorded in the diary.
2) “All channels” means the total minutes spent on NHK-G, NHK-E, NTV, TV Asahi, TBS, TV Tokyo, Fuji TV, or Other channel was watched.
3) “Total” is obtained by adding “All channels,” the minutes spent on video-recorded TV programs were watched, and on video games were played.

Validity of TV, Video, Video Game Viewing/Usage Diary: Comparison with the Data Measured by a Viewing State Measurement Device&:B$;'LQGG

Table 2 Total duration of media use by each participating child (measured in minutes)

KUDO et al

Journal of Socio-Informatics Vol. 7, No. 1 Nov. 2014

Table 3 Correlations between the data recorded in the TV, video, video game viewing/usage
diary and the measurement by the viewing state measurement device (for each
15-minute time frame)

1) ”All channels” means the total number of times that NHK-G, NHK-E, NTV, TV Asahi, TBS, TV Tokyo, Fuji
TV, or Other channel was watched.
2) ”Total” is obtained by adding “All channels,” the number of times video-recorded TV programs werewatched, and the number of times video games were played. All coefficients are significant (p < .01).

Table 4 Correlations between the data recorded in the TV, video, video game viewing/usage
diary and the measurement by the viewing state measurement device (for total amountof each type of media use)

1) “All channels” means the total minutes spent on NHK-G, NHK-E, NTV, TV Asahi, TBS, TV Tokyo, Fuji TV,
or Other channel was watched.
2) “Total” is obtained by adding “All channels,” the minutes spent on video-recorded TV programs werewatched, and on video games were played. ＊p < .05, ＊＊p < .01, ＊＊＊p < .001.

The obtained correlations were positive andtime, that this system is supposed to have thesignificant, being equal to or higher than .80 for

reliability to some extent. However, the accuracy

all TV channels, video-recorded TV programs,of this system was not examined in this study.

and video games, except for the amount of TBS

Therefore, it is necessary to consider the

programs watched. The correlation was .92 for

influence of the viewer identification error on thethe overall TV viewing and .99 for the total

results of this study.

amount of TV viewing, video-recorded TV

The frequency of media use was recorded asprograms, and video games combined.

higher in the viewing/usage diary for someparticipants while it was measured as higher by
the viewing state measurement device for other

4. Discussion

participants. Meanwhile, the amount of media
At the beginning, note that the measuring

use was always recorded as higher in thedevice’s identification accuracy of the viewer. In

viewing/usage diary. This means that thethis study, the viewer was identified by pushingmothers of the participating children recorded in

the button of the device’s remote control. This

the diary a larger amount of media use thanidentification system has been used to measure

actually occurred. One of the possible reasons is

the individual TV viewing rate for such a long

that, while the viewing/usage diary was entered
9&:B$;'LQGG

Validity of TV, Video, Video Game Viewing/Usage Diary: Comparison with the Data Measured by a Viewing State Measurement Device

for each 15-minute time frame, the viewing state

KUDO et al

participants.

measurement device recorded the amount ofFor data on the participants’ video gamemedia use every minute. Even if a participatingplaying, it was noticed that the diaries contained

child used the media for only a part of themore data than the devices had recorded. This

15-minute time frame, the amount of media use

was supposed to have occurred not only because

would be recorded as “15 minutes” in the diary.

of the units recorded in the diaries that wereThis would likely to result in recording of a larger

mentioned above but also because of theamount of media use than actually occurred. The

limitations of the measuring device. The

result of this study indicated that the total amountmeasuring device could only measure theof TV viewing was recorded as longer in thevideogame device it was associated with, whereas

viewing/usage

the diaries could measure handheld game playing

diary

by

approximately

10

minutes per day on average. This must be kept intime.

mind when analyzing the amount of media use

There is a growing trend of recording TV

recorded in the viewing/usage diary. Shortening

programs on an HDD and watching them at a

the time interval to 10 min would improve themore convenient time instead of watching TV

precision of measurements in the viewing/usage

programs in real time (Hirata & Shigyo, 2013),

diary.

and young children are starting to adopt the

The correlations between the data entered insame trends (Anraku, 2013). Also, as in the casethe viewing/usage diary and the data recordedof TV programs, there has been a strong interestby the viewing state measurement device werein the effect of videogame play on children’s.79 for the frequency of overall media use and .92

development, and many studies have been

for the total amount of media use. The correlation

conducted on this subject as well (Anderson, Dill

for the total amount of media use was equal to or& Gentile, 2012). In the future, the social andhigher than the correlation obtained by Anderson

academic interests to empirically examine theet al. (1985). Therefore, the accuracy of theeffects of standard TV-based visual media,

viewing/usage diary was confirmed to be equalincluding TV programs, VHS-, DVD, or HDD-

to or higher than the accuracy found by Anderson

recorded TV programs, and video games, on

et al. (1985). For the amount of viewing of video-

children’s development will continue to grow.

recorded TV programs and the amount of video

The findings of this study propose an effective

game play, there was a positive correlation of .80

methodology for measuring the amount of media

or higher between the data entered in theuse and therefore have an important significance.

viewing/usage diary and the data obtained by theviewing state measurement device. Again, theReferences

validity of the viewing/usage diary was confirmed

Anderson, C. A., Gentile, D. A., & Dill, K. E. (2012):

with a certain degree of confidence. However,“Prosocial, Antisocial, and Other Effects ofnote that compared with Anderson’s research,

Recreational Video Games”, In D. G. Singer, & J.

there is a higher possibility that the calculation of

L. Singer (Eds), Handbook of Children and thethe correlation coefficient in this research wasMedia, 2nd Edition, (pp. 249-272). Thousand

influenced by extreme dates because of fewer

Oaks, CA: Sage.

10&:B$;'LQGG



Journal of Socio-Informatics Vol. 7, No. 1 Nov. 2014
Anderson, D. R., Field, D. E., Collins, P. A., Lorch, E.

‘Kasutamaizu shicho’ to ‘Tsunagari shicho’:P., & Nathan, J. G. (1985): “Estimates of young‘Terebi 60-nen Chosa’ kara (1) (Prevailingchildren’s time with television: A methodological‘Customized Viewing’ and ‘Connected Viewing’ :comparison of parent reports with time-lapse

From a Survey Made on the 60th Anniversary ofvideo home observation”, Child Development,

TV Broadcasting)”, The NHK Monthly Report on

Vol.56, 1345-1357.

Broadcast Research, Vol.745, 18-45.

Anraku, Y. (2013): “Yoji no terebi shicho to rokuga

Singer, D. G., & Singer, J. L. (Eds.) (2012): “Handbook

bangumi/DVD no riyo jyokyo: 2013-nen 6-gatsu

of children and the media (2nd ed.)”. Thousand‘Yoji Shichoritsu Chosa’ kara (How Young

Oaks, CA: Sage.

Children Are Watching TV and DVDs : From the

Acknowledgements

June 2013 Rating Survey on Young Children’s TV
Viewing)”,

The

NHK

Monthly

ReportThis study was part of the NHK research project,on“Better Broadcasting for Children.” We would like to

Broadcast Research, Vol.749, 44-57.
Bryant, J., & Oliver, M. B. (Eds.) (2008): “Media

take this opportunity to express our gratitude toeffects: Advances in theory and research (3rdVideo Research Ltd. for their full cooperation withed.)”. New York, NY: Routledge.

data collection.

Dill, K. E. (Ed.) (2012): “The Oxford Handbook ofThis paper is a modified and translated version of aMedia Psychology”. New York, NY: Oxford

part of the Ph.D. thesis of the first author

University Press.

(Ochanomizu University).

Hirata,A.,&

Shigyo,A.

(2013):“Hirogaru

11&:B$;'LQGG

