Validity Data Analysis

Compute content validity ratio for test items.Purpose

  • Interpret a validity coefficient, calculate the coefficient of determination, and conduct a test of significance for a validity coefficient.
  • Examine the convergent and discriminant evidence of validity.

In this assignment, you will compute and interpret the validity evidence. In Part 1, you will calculate the content validity ratios. In Part 2, you will compute a validity coefficient using Jamovi. In Part 3, you will conduct a correlation analysis in Jamovi to obtain the convergent and discriminant evidence of test validity.

Please submit your work on Blackboard.

You can either:

  1. Type in your work and answers in MS Word version of the workbook, save and submit.

or

  1. Print out the workbook, write down your work and answers, and scan the completed workbook, and submit.

Background

You are working as a talent management intern for the multi-state grocery chain. You are developing a 10-item customer orientation measure to select grocery store cashiers.

How to Complete

Part 1: Content Validity Ratio (20 points)

In Part 1, you will compute the content validity ratio to summarize the subject matter experts’ judgment on each test item on the customer orientation scale.

You have asked 14 SMEs (grocery store managers, experienced cashers) to rate each item if it is “essential,” “useful,” or “not necessary” for promptness as a cashier.

 

Item Not necessary Useful Essential
1 1 3 10
2 6 6 2
3 0 0 14
4 0 2 12
5 0 5 9
6 5 0 11
7 2 2 10
8 4 5 5
9 0 4 10
10 7 6 1
  1. What is the content validity ratio for each item (Item 1–Item 10)?
  2. What minimum value of content validity ratio is expected in this case? (Hint: Check Lawshe’s table on the slide presentation!) Based on the content validity ratio of 10 items, would you suggest any items to be revised or removed?

Part 2: Validity Coefficients (20 points)

There are step-by-step instructions as well as a video on “How to get validity coefficient in Jamovi” in the slide presentation.

In Part 2, you are examining the validity evidence based on the relationship to external variables. You decided to use a concurrent design. You asked 100 current cashiers to complete the new customer orientation scale and obtained their most recent job performance score from the personnel file.

Open Jamovi data file “PSY590_jobperformance_FA20.omv”.

Label in Jamovi
customer Employee’s score on the new customer orientation scale. A higher score indicates that a person is more customer-oriented.
jobperf Employee’s most recent job performance score. The score was obtained from the employee’s supervisor rating. A higher rating indicates better performance on the job.
team Employee’s score on the team-orientation scale. A higher score indicates that a person is more team-oriented.
service Employee’s score on the service competency scale. A higher score indicates that a person is more competent in providing customer services.
  1. What is a criterion in this case?

Run a correlation analysis and answer Questions 4 through 9.

  1. What is the validity coefficient of the customer orientation score predicting job performance for cashiers?
  2. Does the customer orientation score predict cashiers’ job performance? Support your answer with a correlation/validity coefficient (r) and its p-value.
  3. How much variance in job performance is explained by the customer orientation scores? Report the coefficient of determination and its interpretation.

Part 3: Discriminant and Convergent Validity (20 points)

In Part 3, you will continue examining the validity evidence based on the relationship to external variables. In addition to the customer orientation scale, you asked the 100 cashiers to complete two additional scales: Team-orientation scale and service competency scale.

Both customer orientation and team-orientation scales are used for selecting cashiers. While both are deemed critical for cashiers to perform their job successfully, these two scales measure different characteristics.

The service competency scale is a commercially available selection measure for customer service jobs. This scale measures the job applicants’ characteristics that are similar to the new customer orientation scale.

Please use the same data file from Part 2 (Jamovi data file “PSY590_jobperformance_FA20.omv”).

Run a correlation analysis and answer Questions 7 and 8.

  1. Is there evidence of convergent validity for the customer orientation scale? Please support your answer with an appropriate correlation coefficient (r) and its p-value.
  2. Is there evidence of discriminant validity for the customer orientation scale? Please support your answer with an appropriate correlation coefficient (r) and its p-value.

 

Order a unique copy of this paper
(550 words)

Approximate price: $22

Basic features
  • Free title page and bibliography
  • Unlimited revisions
  • Plagiarism-free guarantee
  • Money-back guarantee
  • 24/7 support
On-demand options
  • Writer’s samples
  • Part-by-part delivery
  • Overnight delivery
  • Copies of used sources
  • Expert Proofreading
Paper format
  • 275 words per page
  • 12 pt Arial/Times New Roman
  • Double line spacing
  • Any citation style (APA, MLA, Chicago/Turabian, Harvard)

Our guarantees

We value our customers and so we ensure that what we do is 100% original..
At Custom Writing, we believe in exemplary services that are fully geared toward customer satisfaction. That is why we don’t shy away from giving you the following guarantees;

Money-back guarantee

Trusting us with your work is the best decision you have made, our pleasure lies in seeing you satisfied at 100%. If in the rear chance it happens that you are not satisfied, then know that we will equally not be satisfied. But worry not, our 30 days- Money back guarantee is all you need and that is what we promise you..

Read more

Zero-plagiarism guarantee

We utilize profoundly equipped and gifted writers who produce unique papers liberated from any form of plagiarism. To guarantee this, we run all papers finished by our scholars through a Plagiarism checker to ensure uniqueness and originality. In any case, on the off chance that you have vulnerabilities about the originality or falsification of any paper we have finished and conveyed to you, please get in touch with us straight away. We will quickly investigate, and if the paper is seen as counterfeited, we will take suitable actions including but not limited to, revising the paper for free and in extreme cases we will activate the money back guarantee.

Read more

Free-revision policy

We have an obligation deliver great and specially composed assignments. Our revision strategy endeavors to ensure total client satisfaction, comfort, and a genuine feelings of serenity. We make minor updates and corrections to the underlying request as part of our continuous assistance. However, revisions should just incorporate changes and alterations that were not effectively met, in the underlying request and that are inside the rules as per the current request structure..

Read more

Privacy policy

Our client's Data is an Integral part of our business but clearly, we are not in the business of offering our clients' very own data to others. We realize that you care how your online data is utilized and shared, we equally value your trust that we will do so cautiously and sensibly. We Promise to ensure the security of your own data during transmission by utilizing encryption conventions and programming. Likewise assist us with securing your information by not sharing your passwords and usernames.

Read more

Fair-cooperation guarantee

In submitting a request with us, you consent to the services we give. We will strive to take the necessary steps to convey a far reaching paper according to your prerequisites. Equally we depend on your cooperation to guarantee that we convey on this order.

Read more

Calculate the price of your order

550 words
We'll send you the first draft for approval by September 11, 2018 at 10:52 AM
Total price:
$26
The price is based on these factors:
Academic level
Number of pages
Urgency