Thursday, November 19, 2009

Assignment 5: Revised Survey and Comments

Personal Computer Use

This is a short survey about computer use. The purpose of the survey is to investigate how and why you use your computer(s), how much you use them in a typical day, and what knowledge you have about computers. Please answer the following questions to the best of your ability.

1. What is your gender? (circle one) Male Female

2. Age(years)_________

3. What is the highest level of education you have attained?

a. Less than high school
b. High School
c. Some University
d. University Degree

4. Do you own a computer?

a. Yes (Skip to question #9)
b. No (Proceed to question#5)

5. Do you intend on purchasing a computer?

a. Yes (Skip to question # 7)
b. No (Proceed to question #6)

6. Which of the following statements best describes your reason for not purchasing a computer

a. I cannot afford a computer
b. I have no interest in owning/using a computer
c. What is a computer?
d. Other(please explain)______________________
END OF SURVEY

7. Do you know what kind of computer you are going to buy (laptop/desktop, Apple, Sony etc.)?
a. Yes (Proceed to question # 8)
b. No END OF SURVEY

8. What kind of computer are you thinking of buying?
Laptop/Desktop/Unsure________________
Brand of computer (Apple, Dell, Sony etc.)__________
END OF SURVEY

9. How many computers do you, or anyone in your household, own? Please indicate type (desktop/laptop) and brand (Apple, Dell, Sony etc.)

For example:
I own 2 computers.
1 desktop(s). Brand(s) Apple
1 laptop(s). Brand(s) Sony

I own ________computers.
_____ desktop(s). Brand(s)____________
_____ laptop(s). Brand(s) _____________

10. How often do you use your computer in an average week? Please round down to the nearest hour (i.e. if you use the computer for 2 and a half hours/week then you would select a).

a. 0 - 2 hours
b. 3 - 5 hours
c. 6 - 8 hours
d. + 8 hours. Please estimate how many hours_________

Please read the following statements and rate them on a scale from 1 to 7, with 1 meaning “strongly disagree”, 4 meaning “neither agree nor disagree” and 7 meaning “strongly agree”

11. “I am able to fix my computer when it is not working”

1............2...........3...........4...........5...........6...........7
Strongly Disagree________Strongly Agree

12. “I feel confident in my ability to install software on my computer, and use the internet to find relevant upgrades and plug-ins when needed”

1............2...........3...........4...........5...........6...........7
Strongly Disagree________Strongly Agree

13. “The only thing I know about my computer is how to turn it on”

1............2...........3...........4...........5...........6...........7

Strongly Disagree________Strongly Agree

14. Which of the following do you use your computer for? (select all that apply)

a. E-mail
b. Work
c. School
d. Surfing the internet (reading news, watching sports highlights etc.)
e. Gaming
f. Financing (taxes, budget spreadsheets etc.)
g. Watching movies/tv shows
h. Research (pricing cars, vacation spots etc.)
i. Other(please explain)______________

15. Using the options from question 14, which is the MAIN use of your computer_____________________?

16. Please explain in one or two sentences how your life would be affected if computers were not available for personal use.
__________________________________
__________________________________

__________________________________
__________________________________
__________________________________

Thank-you for your time!


Peer Feedback
Based on the feedback I received from four individuals, I made a number of modifications to my survey. I decided to include a brief description of the purpose of the survey. I also decided to add some demographic questions to the beginning of the survey.
'
It was suggested by a couple of people that the instructions ought to stand out a little more. After answering whether they own a computer, respondents are instructed to proceed to question #5 if they answer no, and skip to question #9 if they answer yes. A few of my respondents did not notice these instructions and continued on to the next question regardless of their response. I decided to put the relevant instructions beside their response, and bold it, so that the survey would be easier to follow.
'
I included an open ended option for question #6, as it was noted that someone may have a reason for not purchasing a computer that was not stated on the survey.
'
Question #7 and #8 were changed to be more specific in terms of “kind” of computer. I included some examples so that respondents will know what I am looking for in a response.
'
Questions # 6-8 of the original survey were combined into question #9. It makes more sense, and I was told would be easier to follow, if these questions were all grouped into one. This question was also changed so that it asked the respondent how many computers were in the household rather than simply asking how many computers they own. This was done because one of my respondents asked about his wife’s computer, and whether this should be included. I thought it would be more straightforward to include all computers in the household to avoid confusion of this nature.
'
Question #10, which asked respondents how many hours/week they tyically use thier computer, was changed slightly. The categories in this question were altered so that they would be mutually exclusive (the first draft had 2 hours as an option in a and b). An additional option was also included for respondents who use their computer less than 1 hour/week. An open ended response was included so that people who answered +8 hours could estimate how many hours they use the computer in a week.
'
The question regarding computer use was altered to include more options. My respondents had suggested that e-mail, financing, watching movies/tv shows, and research were some additional options. Also, it was suggested that school and work be separated, rather than including it as one option.
.
The last question was altered slightly. The original version of the survey asked how a person’s life would be altered if computers had never been invented. One of my respondents suggested this may be too broad. Therefore I changed it by asking how their lives would be different if computers were not available for personal use.

Assignment 5: Original Survey

1. Do you own a computer?
a. Yes
b. No
If Yes, skip to question #6
If No, answer question #2

2. Do you intent on purchasing a computer?
a. Yes
b. No
If Yes, skip to question # 4
If No, answer question #3

3. Which of the following statements best describes your reason for not purchasing a computer
a. I cannot afford a computer
b. I have no interest in owning/using a computer
c. What is a computer?
END OF SURVEY

4. Do you know what kind of computer you are going to buy?
a. Yes
b. No
If No, END OF SURVEY
If Yes, answer question # 5.

5. What kind of computer are you thinking of buying?____________________
END OF SURVEY

6. How many computers do you own?______________________

7. Do you own a laptop(s)? Y/N How many ?_________Mac or PC_______

8. Do you own a desktop(s)Y/N How many ?_________Mac or PC_______

9. How often do you use your computer in an average week?
a. 1-2 hours
b. 2-6 hours
c. 4-8 hours
d. + 8 hours




Please read the following statements and rate them on a scale from 1 to 7, with 1 meaning “strongly disagree”, 4 meaning “neither agree nor disagree” and 7 meaning “strongly agree”

10. “I am able to fix my computer when it is not working”

1............2...........3...........4...........5...........6...........7
Strongly Disagree________Strongly Agree

11. “I feel confident in my ability to install software on my computer, and use the internet to find relevant upgrades and plug-ins when needed”

1............2...........3...........4...........5...........6...........7
Strongly Disagree________Strongly Agree

12. “The only thing I know about my computer is how to turn it on”
1............2...........3...........4...........5...........6...........7 Strongly Disagree________Strongly Agree

13. Which of the following do you use your computer for? (select all that apply)
a. Work/school
b. Surfing the internet
c. Gaming
d. Other______________

14. Using the options from question 10, which is the MAIN use of your computer_____________________?

15. Please explain in one or two sentences how your life would be affected if computers had not been invented yet.

Thursday, October 15, 2009

assignment 3

The Employee Assistance Program (EAP), established in 1989, is a program that is available for staff, and their family, at the University of Saskatchewan. Its purpose is to provide short-term counseling and other services to help alleviate stress and issues which may be detrimental to their work. There are one-on-one, group and online services available regarding family, health, nutrition, legal and financial issues. This program has a lot to offer the staff of the University, as well as the university as a whole. The university, who provides the funding for this program, will become a productive environment in which staff have somewhere to turn when facing issues that are impacting their ability to work effectively and efficiently.

Focusing the Evaluation

The focus of the current evaluation is to explore the effectiveness of these services. It will examine participants’ experiences and feelings about the program in order to determine whether they found the program accessible and useful.

The EAP has a mission statement that highlights a number of goals it hopes to achieve. It can be found on their website at www.usask.ca/eap/mission. Basically, the program sets out to provide support for employee problems, provide information and training to enhance functioning, and increase campus productivity by offering these services to employees.

Anyone who is looking into participating in this program would find this evaluation useful. Employees can review previous experiences in the program and determine if the EAP is something they might benefit from. Administrators of the EAP would also find this evaluation useful, as it will highlight the strengths and weaknesses of the program, and provide insight into ways in which the program might be improved.

The evaluation will seek to answer two main questions:
1. Are the available services an effective means of alleviating employee stress and other issues that are affecting their well-being?
2. Can these services be improved, and can additional services be provided?

Individual indicators will vary, depending on what aspect of the program the person had participated in. For example, participants who participate in nutritional counseling will develop a better understanding of nutrition. Questions that they answer before and after counseling will be an indicator of this acquired knowledge. Other indicators regarding the general effectiveness of individual programs will be self-reported levels of satisfaction with the program, and suggestions for future modifications. These questions will be addressed by utilizing a number of different research methods.



Collecting the Information
Method
Data will be collected differently, depending on the type of program a person has participated in. Some of the services are offered in group settings (smoking cessation), while others occur on a one-on-one basis (counseling). There are also a variety of different self-help tools available online (the Health and Wellness Companion).

Those who have participated in a group program will be asked to participate in focus groups. When they first contact the EAP, they will be asked if they would be willing to participate in a study. Each person who is willing to participate will be a part of two focus groups; one before they participate in the program and one when they are finished with the program. The groups will remain the same as the program in which they were a part of. They most likely would have developed a degree of rapport with each other, which may aide people in opening up regarding their experiences.

The first focus group will be used to get an idea of what issues the participants are currently having, and what they hope to achieve by participating. The second focus group will explore whether participating in the program had a positive impact on the issues that brought them to EAP. They will be asked to discuss their experiences, and suggest any ways n which the program might be improved.

Those who have participated in any type of one-on-one services, such as financial counseling, nutritional counseling, caregiving support services etc., will be asked to participate in an interview. The nature of the interviews will be very similar to the focus groups. There will be an interview before they participate regarding their expectations, and an interview after that will explore their experiences and suggestions for improvement.

Finally, anyone who participates in an online service will be asked to complete an online survey regarding their experience. All participants of the online services will be asked if they would be interested in participating in a study. If they agree, they will be directed to the online survey immediately after they complete the program session. They will be asked various questions regarding their happiness with the content, organization and the program in general. There will also be an open-ended question at the end of each survey that will ask participants what they liked and disliked about the program, as well as anything they would have liked to see included.

Using the Information
The data will be analyzed using a combination of quantitative and qualitative analyses. Quantitative analyses will be used to compare data that was collected both pre-and post-participation in the program. These analyses will determine whether there were any significant improvements based on participation. For example, as mentioned previously, an indicator of effectiveness of nutritional counseling would be acquired knowledge about nutrition. Participants will complete a survey about nutrition, and the pre- and post-participation results will be analyzed to see if there was a significant change. If knowledge regarding nutrition has significantly improved, then it can be concluded that the participants had learned something from the counseling they had received.

Reported levels of satisfaction will be analyzed, using basic descriptive analyses, to determine whether participants were happy with the program. However, a qualitative approach will be used for analyzing participants’ thoughts and feelings regarding strengths and weaknesses of the programs, as well as suggestions for changes. Qualitative statistical software will be used to identify common themes in participants’ responses in order to determine which areas of the program were best received, and which could use some adjustments.

Once this evaluation is completed, it will be posted on the EAP website (www.usask.ca/eap). Anyone who is interested in learning more about the program, thinking about participating, or thinks that a family member might participate, would benefit from reading this evaluation. It will provide an abundant amount of information specific to anyone who is wondering about the effectiveness of this program. By reading about others experiences, people will be able to make a more informed choice about becoming involved with the EAP themselves.

Sunday, September 20, 2009

Assignment 2

Introduction

This program is intended to help children who have been diagnosed with a severe or profound disability. A teacher will develop a plan, containing goals and objectives that are based on individual student need. There are a number of requirements that the in-home visits must include. The students may participate in an in-home or center-based program or use a combination of the two.

An evaluation of this program should answer a number of questions: 1. Did the in-home visits meet the necessary requirements? 2. Did the students meet the set goals and objectives set by their teacher? 3. Were there any advantages for students who participated in either the in-home or center-based program?

Question One: Did the In-Home Visits Meet the Necessary Requirements?

These questions can be answered with the use of the Stake-Countenance model. This would be the most straightforward and effective means of studying the program. There are a number of standards that the program description has outlined. The descriptive nature of this model would be an adequate means of determining whether the program is successful in maintaining these standards. Descriptive data can be collected from the division folders/special education forms. This would tell us if the in-home visits were adhering to the outlined requirements. The parent/guardian could also be interviewed about the in-home visits. This would provide additional descriptive information about the nature of these visits.

Question Two: Did Students Meet the Set Goals and Objectives?

The Stake-Countenance model is also generally used to examine whether a program in question was able to create the outcomes it had intended. This program intends to help children with disabilities reach various goals after spending productive learning time with their teachers. This evaluation would focus on whether these intentions were successful. The teachers can complete surveys at the beginning of the program regarding the goals and objectives they had developed for the students. Another survey can be administered at the end of the program that would investigate whether they were met. This would give us valuable insight into the effectiveness of the program.

Question Three: Advantages For Students Who Participated in Either In-Home or Center-Based Program?

Finally, this evaluation would investigate whether there is any relationship between the variables. The current program has one significant variable; whether students participated from home or in a center. It would be interesting to analyze whether students’ were more successful in fulfilling their goals when they were primarily studying at home, when compared to students were studying in a center, or vice-versa. If there were significant differences, this might suggest that one method may be more favorable than the other for future programs.

Friday, September 11, 2009

Assignment 1

The model that was used in the evaluation “Report on a program evaluation of a telephone assisted parenting support service for families living in isolated rural areas” (Cann, Rogers & Worley, 2003) most closely resembles Robert Tyler’s model of objectives and outcomes. The objectives of this program were to influence various factors (i.e. reduce depression, increase parental satisfaction). The researchers measured these factors pre- and post-project and evaluated the outcomes (changes in levels of depression and parental satisfaction). There results were definitely in the predicted direction, with parents showing significantly reduced levels of depression, anxiety, stress and inter-parent conflict. There were also significant improvement in parents’ reports of their children’s behavior, parenting styles as well as parent satisfaction and efficacy. From this the authors concluded that this program had influenced both the parents and the children’s behavior, and the overall well being of the parents.

This model was a very simple means of measuring the changes in these factors, before and after participating in the program. However, do the results mean that the program directly influenced both behavior and feelings of the parents? Not necessarily. It only tells us that self-reported levels of these variables changed after participation. This doesn’t necessarily tell us anything about the effectiveness of the program, only that the changes occurred. For example, parents reported lower levels of stress, anxiety and depression after participation. It’s hard to say which part of the program, if any, led to these changes.

If the researcher had employed a CIPP model, more attention would have been given to the actual process of the program, thereby providing us with more feedback about potential direct relationships between participating in the program and the variables measured. A qualitative approach provides richer data, and would be a more reliable means of determining whether participation in the program had a direct impact on the variables. Interviews could have been conducted during the course of the program, which could have easily been done during the weekly conversations participants had with counselors. The researchers could have evaluated how feelings and behaviors evolved over the course of the program, rather than merely measuring changes from point A to point B.

As noted by the authors, future research ought to consider using a control group. This would increase the confidence that participation in the program led to changes in the variables measured. In addition to a control group, additional experimental groups could also be looked at, and various components (i.e. the addition of more or less self-help materials, amount or type of contact with counselors) could be manipulated, which would allow one to evaluate which parts of the program are effective, and which are expendable.

There are some strengths in the simplicity of the evaluation design. It was a straight forward approach that easily showed the reader that a large number of variables significantly changed after participating in this program. They also conducted a satisfaction survey, which revealed that the participating families were very satisfied with the content and results of the program. It is a very good starting point, and the researchers provided a number of limitations and directions for future research that can be used to further evaluate this program.

Here is a link to the online article:

http://auseinet.flinders.edu.au/journal/vol2iss3/index.php