词条 | Situational judgement test |
释义 |
Unlike most psychological tests SJTs are not acquired 'off-the-shelf', but are in fact designed as a bespoke tool, tailor-made to suit the individual role requirements.[1] This is because SJTs are not a type of test with respect to their content, but are a method of designing tests. Developing a Situational Judgement TestDeveloping a situational judgement test begins with conducting a job analysis that includes collecting critical incidents. These critical incidents are used to develop different situations where the judgement of the prospective new hire would need to make a decision. Once these situations are developed, subject matter experts (excellent employees) are asked to suggest effective and less effective solutions to the situation. Then a different group of subject matter experts rate these responses from best to worst and the test is scored with the highest ranked options giving the respondent the higher score (or lower if the test is reverse scored).[5] ValidityThe validity of the test corresponds to the types of questions that are being asked. Knowledge instruction questions correlate more highly with general mental ability while behavioral tendency questions correlate more highly with personality.[4] Key results from a study show that knowledge about interpersonal behavior measured with situational judgement tests was valid for internships (7 years later) as well as job performance (9 years later). Also, students' knowledge of interpersonal behavior showed progressive validity over cognitive factors for predicting academic and post academic success. This study was also the first study to show evidence of the predictive long-term power of interpersonal skill assessed though situational judgement tests.[6] There are many problems within scoring SJTs. "Attempts to address this issue include expert-novice differences, where an item is scored in the direction favoring the experts after the average ratings of experts and novices on each item are compared; expert judgement, where a team of experts decides the best answer to each question; target scoring, where the test author determines the correct answer; and consensual scoring, where a score is allocated to each option according to the percentage of people choosing that option."[7] HistoryThe situational judgement test has been around for over fifty years. The first two that were documented were the How supervise and the Cardall Practical Judgement Test. In 1958 the Supervisory Practice Test came about by Bruce and Learner.[8] The Supervisory Practice Test was to point out whether or not supervisors could handle certain situations on the job. This test is said to effectively identify who could and could not be a supervisor.[8] The situational judgement test did not really take off and become a great use in the employment field until the early 1990s.[8] Situational Judgement Tests then went on to be used in World War II by psychologists in the US military.[3] "In the 1950s and 60s, their use was extended to predict, as well as assess, managerial success."[9] Today, SJTs are used in many organizations, are promoted by various consulting firms, and are researched by many. However, their use has been criticized in admissions screening due to bias against lower income individuals[10] and male applicants.[11] Tests to Measure Individual Adaptability in Applied SettingsA Thesis Submitted to George Mason University in 2010 by Adam M. Grim created a study to measure individual adaptability in applied settings. An Adaptability Situational Judgement Test (ASJT) was designed to provide a practical and valid selection and assessment instrument that had incremental validity beyond the Big Five personality traits and cognitive ability in predicting supervisor ratings of adaptability.[12] "The research contributes to the selection and adaptive performance literatures by demonstrating that it is possible to use a situational judgement test to measure individual adaptability in both military and non-military applied settings."[12] ASJT had similar relationships with all variables of interest in both samples, thus providing support for the generalizability of the measure to both military and business settings. Practical implications and recommendations for future refinements of ASJT are discussed.[12] With this ASJT did not have differential validity and provides a selection instrument that would not cause adverse impact or be subject to legal challenge because of predictive bias.[12] For this study there were both business and military setting scenarios which subjects would read and indicate how likely they were to do the list of behaviors related to that scenario.[12] Multiple-choice ExamplesConsist of either taking the test on paper or written out examples online. The online version offers a few advantages such as, faster results. It is often the case that Situational Judgement Test have multiple correct answers even though an answer might be more preferred by the hiring organization.[4] You are the leader of a manufacturing team that works with heavy machinery. One of your productions operators tells you that one machine in the work area is suddenly malfunctioning and may endanger the welfare of your work team. Rank order the following possible courses of action to effectively address this problem. from most desirable to least desirable. 1. Call a meeting of your team members to discuss the problem. 2. Report the problem to the Director of Safety 3. shut off the machine immediately. 4. Individually ask other production operators about problems with their machines. 5.evacuate your team from the production facility.[4] Other typical examples can be found here.[13] Video-based ExamplesConsists of videos that contain different scenarios that the employee may face. Scenarios for this section can be found on youtube.com. Scenarios are in many different styles such as:
* The correct answer could be given. * The individual could be ask to give the most reasonable answer. * The individual is asked to explain what they were to do if they were in that situation. Advantages over other measures
Company UseCompanies using SJTs report the following anecdotal evidence supporting the use of SJT. Note: these reports are not supported by peer reviewed research.
Pre-Hiring UseSJTs are a popular tool that employers use during the hiring process to weed out potential hires. Some professions that almost always require SJT exams are administrative, management, firefighters, customer service, nursing, call centers, and police officers. It's important to note that each profession may have its own situational judgement test specific to that particular field. However, generally, most SJTs include various question types and do not have a time limit.[20] One of the most popular question types on SJTs are scenarios. Scenarios are job-related, realistic, hypothetical situations. As the scenarios presented on SJTs always ask for a resolution for a given conflict, candidates will be asked to choose a preferred method of action out of several possible options. The conflict/scenario may involve supervisor-subordinate relationships, stress and disagreement between work colleagues, etc. The situations described may vary according to the role one is applying for. If scenarios are presented, candidates can expect to encounter 25–50 questions.[20] Other SJT test question types are multiple-choice, most-least or best/worst answer tables (where more than one option must be chosen on a certain scale), ranking and rating, or short video scenes (simulates the situation being asked about).[20] Criticisms
See also
Notes1. ^1 2 3 4 5 6 7 8 {{cite web|title=Situational Judgement Tests: Are they just measures of cognitive ability?|publisher=Human Assets|url=http://humanassets.co.uk/RS22SituationalJudgementTests|accessdate=August 5, 2011|deadurl=yes|archiveurl=https://web.archive.org/web/20091125090047/http://humanassets.co.uk/RS22SituationalJudgementTests|archivedate=November 25, 2009|df=}} {{DEFAULTSORT:Situational Judgement Test}}2. ^{{cite journal|last=Lievens|first=Filip|author2=Helga Peeters |author3=Eveline Schollaert |title=Situational judgement tests: a review of recent research|journal=Personnel Review|year=2008|volume=37|issue=4|pages=426–441|doi=10.1108/00483480810877598|citeseerx=10.1.1.529.7610}} 3. ^1 {{cite web|last=McDaniel|first=Michael A.|author2=Whetzel, Deborah L.|title=Situational Judgement Tests. An IPMAAC Workshop|publisher=IPMA-HR Assessment Council|url=http://www.ipmaac.org/conf/05/mcdaniel.pdf|accessdate=August 7, 2007|deadurl=yes|archiveurl=https://web.archive.org/web/20071010181057/http://www.ipmaac.org/conf/05/mcdaniel.pdf|archivedate=October 10, 2007|df=}} 4. ^1 2 3 4 {{cite book|last=Muchinsky|first=Paul|title=Psychology Applied to Work|year=2012|publisher=Hypergraphic Press|location=Summerfield, NC|isbn=978-0-578-07692-8|pages=110–11}} 5. ^{{cite journal|last=Lievens|first=Filip|journal=Personnel Review|year=2008|volume=37|issue=4|pages=426–441|doi=10.1108/00483480810877598|title=Situational judgement tests: A review of recent research|last2=Peeters|first2=Helga|last3=Schollaert|first3=Eveline|citeseerx=10.1.1.529.7610}} 6. ^{{cite journal|last=Lievens|first=Filip|author2=Paul R. Sackett |title=The Validity of Interpersonal Skills Assessment Via Situational Judgement Tests for Predicting Academic Success and Job Performance|journal=Applied Psychology|date=1 March 2012|volume=97|issue=2|pages=460–468|doi=10.1037/a0025741|pmid=21967295}} 7. ^http://eprints.usq.edu.au/787/1/Strahan_Fogarty_Machin_APS_Conference_proceedings.pdf 8. ^1 2 {{cite journal|last=Swander|first=Carl|title=Video-based Situational Judgement Test Characteristics: Multidimensionality at the Item Level and Impact of Situational Variables|date=3 May 2001|pages=3–5}} 9. ^{{Cite book | url=http://eprints.usq.edu.au/787/ | title=Predicting performance on a situational judgement test: The role of communication skills, listening skills, and expertise| pages=323–327| isbn=9780909881276| date=September 2005}} 10. ^1 {{Cite journal|last=Jerant|first=Anthony|last2=Fancher|first2=Tonya|last3=Fenton|first3=Joshua J.|last4=Fiscella|first4=Kevin|last5=Sousa|first5=Francis|last6=Franks|first6=Peter|last7=Henderson|first7=Mark|date=December 2015|title=How Medical School Applicant Race, Ethnicity, and Socioeconomic Status Relate to Multiple Mini-Interview-Based Admissions Outcomes: Findings From One Medical School|journal=Academic Medicine|volume=90|issue=12|pages=1667–1674|doi=10.1097/ACM.0000000000000766|issn=1938-808X|pmid=26017355}} 11. ^1 {{Cite journal|last=Ross|first=Marshall|last2=Walker|first2=Ian|last3=Cooke|first3=Lara|last4=Raman|first4=Maitreyi|last5=Ravani|first5=Pietro|last6=Coderre|first6=Sylvain|last7=McLaughlin|first7=Kevin|date=June 2017|title=Are Female Applicants Rated Higher Than Males on the Multiple Mini-Interview? Findings From the University of Calgary|journal=Academic Medicine|volume=92|issue=6|pages=841–846|doi=10.1097/ACM.0000000000001466|issn=1938-808X|pmid=28557950}} 12. ^1 2 3 4 {{cite web|last=Grim |first=Adam |title=Use of Situational Judgement Test to Measure Individual Adaptability in Applied Settings |url=http://u2.gmu.edu:8080/dspace/bitstream/1920/5793/1/Grim,%20Adam%3B%20G00468763,%20Master%27s%20thesis,%20April%202010.pdf |accessdate=March 1, 2012}} 13. ^{{cite web|title=Example Situational Judgement Test Items|url=http://www.markparkinson.co.uk/psychometric_links.htm}} 14. ^{{cite journal | last1 = Hoare | first1 = S. | last2 = Day | first2 = A. | last3 = Smith | first3 = M. | year = 1998 | title = The development and evaluation of situations inventories | url = | journal = Selection & Development Review | volume = 14 | issue = 6| pages = 3–8}} 15. ^1 2 3 4 {{cite web|title=Technical Information|publisher=Harcourt Assessment|url=http://www.harcourt-uk.com/hapage.aspx?name=hrtechnicalinformation|accessdate=August 7, 2007}} 16. ^Motowildo, S.J., Hanson, M.A., & Crafts, J.L. (1997). Low fidelity simulations. In D.L. Whetzel & G.R. Wheaton (Eds.), Applied Measurement in industrial Psychology. Palo Alto, CA: Davies-Black. 17. ^McDaniel, Michael. & Nguyen, Nhung "Situational Judgement Tests: A Review of Practice and Constructs Assessed", Blackwell Publishers LTD, Oxford, March/June 2001. Retrieved on 17 October 2012. 18. ^{{cite web|last=Rahman|first=Mahibur|title=Tackling situational judgement tests|publisher=BMJ Publishing Group Ltd|url=http://careerfocus.bmj.com/cgi/content/full/334/7602/gp189|accessdate=August 7, 2007|deadurl=yes|archiveurl=https://web.archive.org/web/20070809120205/http://careerfocus.bmj.com/cgi/content/full/334/7602/gp189|archivedate=August 9, 2007|df=}} 19. ^1 {{cite web|title=What Is The SJT |publisher=Medical Schools Council |url=http://www.isfp.org.uk/SJT/WhatIsTheSJT/Pages/WhatIsTheSJT.aspx/default.aspx |accessdate=October 16, 2012}} 20. ^1 2 {{cite web|title=Situational Judgement Test (SJT) Preparation|url=https://www.jobtestprep.com/sjt|website=JobTestPrep|accessdate=6 December 2016}} 21. ^{{cite journal | last1 = Chan | first1 = D. | last2 = Schmitt | first2 = N. | year = 2005 | title = An agenda for future research on applicants' reactions to selection procedures: A construct-orientated approach | url = | journal = International Journal of Selection and Assessment | volume = 12 | issue = 1–2| pages = 9–23 | doi=10.1111/j.0965-075x.2004.00260.x}} 22. ^{{cite journal | last1 = Ployhart | first1 = R.E. | last2 = Harold | first2 = C.M. | year = 2004 | title = The applicant attribution-reaction theory (AART): An integrative approach of applicant attributional processing | url = | journal = International Journal of Selection & Assessment | volume = 12 | issue = 1–2| pages = 84–98 | doi=10.1111/j.0965-075x.2004.00266.x}} 23. ^{{cite journal | last1 = Schmit | first1 = M.J. | last2 = Ryan | first2 = A.M. | year = 1992 | title = Test-taking dispositions: A missing link? | url = | journal = Journal of Applied Psychology | volume = 77 | issue = 5| pages = 629–637 | doi=10.1037/0021-9010.77.5.629}} 24. ^{{cite journal | last1 = McDaniel | first1 = M.A. | last2 = Morgeson | first2 = F.P. | last3 = Finnegan | first3 = E.B. | last4 = Campion | first4 = M.A. | last5 = Braverman | first5 = E.P. | year = 2001 | title = Use of situational judgement tests to predict job performance: A clarification of the literature | url = | journal = Journal of Applied Psychology | volume = 86 | issue = 730–740| pages = 730–40 |doi=10.1037/0021-9010.86.4.730 | pmid=11519656}} 25. ^{{cite journal | last1 = McDaniel | first1 = M.A. | last2 = Morgeson | first2 = F.P. | last3 = Finnegan | first3 = E.B. | last4 = Campion | first4 = M.A. | last5 = Braverman | first5 = E.P. | year = 2001 | title = Use of situational judgement tests to predict job performance: A clarification of the literature | url = | journal = Journal of Applied Psychology | volume = 86 | issue = 4| pages = 730–740 | doi=10.1037/0021-9010.86.4.730| pmid = 11519656}} 26. ^McDaniel, M.A. & Whetzel, D.L. (2007). Situational Judgement Tests. In D.L. Whetzel & G.R. Wheaton (Eds). Applied measurement: Industrial psychology in human resources management. Erlbaum. 235-258. 27. ^{{cite web | url=https://rwftraining.com/caspertestprep/casper-test-introduction/ | title=CASPer™ Test Introduction}} 2 : Psychometrics|Personality tests |
随便看 |
开放百科全书收录14589846条英语、德语、日语等多语种百科知识,基本涵盖了大多数领域的百科知识,是一部内容自由、开放的电子版国际百科全书。