查看完整版本: Major Findings From The Annual Rocket-Hire Online Screening

moon 2006-11-1 11:00 AM

Major Findings From The Annual Rocket-Hire Online Screening

Article and research by Charles Handler and Mark C. Healy H.^7O U%| wNA

q:r R?w,SI^)^"P
Io3}y/x} For the last three years, Rocket-Hire has surveyed ERE readers who use Web-based screening and assessment products as part of their hiring process. The information we have been able to gather from this research has been a valuable part of our efforts to track important trends in the use of screening and assessment tools. -O4IgZ+p B|'Oc
K cT^?j^9@.{
[b]Thus[/b], earlier this year, we again asked people professionals to tell us about their use and opinions of these tools. This brief report highlights the major findings of our fourth annual survey. w$\^ @,A
)do.F1_y?0vV
Please visit the ERE article archives to view the results of the previous three years' surveys. The full version of our survey results will be available in mid-November; contact us at [email]info@rocket-hire.com[/email] and we will be sure to email you a copy. (p kXVg$`4Y*{ n6n
k;K0I;A3l|$d&d
The information below provides an overview of the data we used to achieve our objectives, which included the following three goals: H.G)B`fA
yA$zE)T(_T+o}WJ-E@
[i]Understand the general rate of usage of Web-based screening and assessment c#?/@ S |&[#D
Get information on usage rates for various types of tools jX+e3RO(I&P
Determine whether these hiring tools are perceived as effective for the organization
#SoOGuIx m Who Responded?M ue)Ba;d d/oC
This year, 136 people professionals completed the survey, representing an increase of 51% over last year. This increase is indicative of the fact that screening and assessment is continuing to gain momentum as a best practice among hiring professionals.[/i]Z9i4NF |j
[Q2RZ z
As we have seen in past surveys, respondents were evenly representative of recruiters, HR executives, and hiring managers, and represented a wide variety of organizations and hiring situations. Thirty-four percent hired more than 500 employees in a given year, but a majority of respondents (66%) made 500 or fewer hires per year. 9a$aC0rOn5lE7[~

pW/M,J^ \/Z:ahNd [b]ATS Usage[/b]
vE&Kv@%h As with previous surveys, a majority of respondents use an applicant tracking system. Specifically, 72% already use one, with 8% in the process of installing applicant-tracking technology. As can be seen in the tables below, companies of all sizes are taking advantage of applicant tracking technology, and high rates of adoption indicate that use is fairly mainstream. KVG%j\H
'BRr lmz#l+U't S
Table 1 Size of Company  % using or intending to use ATS  
VG2I.E+]7lNh W-|-` [u]1-50  56%  
1d"L!a[t I;[] 51-500  71%  
hZ_.Rm 501-2,500  82%  (o&@)U Uo%|)j
2,501-5,000  85%  
LC;M7t{}/|9\ More than 5,000  100%  [/u]+tz:nw1VWo G

.WJn-H"H0BG"yAL This is important because the use of screening and assessment tools is often the next step in the creation of a technology-based hiring process. Thus, the higher the adoption rate for ATS, the greater the usage of screening and assessment tools will be.

moon 2006-11-1 11:01 AM

[b]Screening Tools[/b]
U"c(i$arO Strictly an administrative process, an applicant tracking system alone does not usually mean any in-depth evaluation of candidates. However, the following data on use of prescreening and assessment tools does underscore the growing importance of judging job applicants using systematic tools. For purposes of this survey, screening tools are defined as:@%s7cd#t;ND p

7GR;l1dlq(Qf Tools that gather information about, or ask candidates to respond to questions about, their experience, skills, and qualifications in order to identify if they meet minimum job requirements. These tools are typically used early on in the staffing process.
K(J d&e2Tg0o` Sixty-two percent of respondents indicated that they use at least one online screening tool to sort job candidates early in the hiring process. The table below captures the usage rates of each of the most common forms of screening.]fj N7p5}6|4E9M.f_

ucv1}w U$DW7R0c(S Table 2 Type of Prescreen  % using as a primary automated prescreen  T+f/ZFGJ5i,`g
[u]Resume-scanning systems  15%  
Y:Bx3l?-KJR Biodata or personality questionnaires  10%  P7_;OM,{6P
Basic qualifications  58%  :ooct;Q jH0C
Assessment of "fit" with company  14%  3T e;PUafi*J
Other tools  3%  [/u]3Pu:h^|}

3K9?ejzu \z6[ As can be seen above, qualifications screening was the most common form of automated prescreen in use. Over the last several years, usage rates for each of these tools are quite consistent. Part of this trend seems to be the relative simplicity with which basic job (or stated "minimum") qualifications (such as education or years of experience) may be collected and evaluated. As can be seen in Table 3, the extent of the deployment of prescreening technology varied quite a bit as well, with some companies using these tools for all jobs while some using it for one or two alone.,G hZ:W*x {6Z?

!~o~ bg&S O@ Table 3 Extent of Prescreening  %  %^-ey0tu)E6^6X
All jobs within a business unit, but not all business units  25%  7?oO sgo
All domestic jobs  27%  
wbW#lo#YQ!y All worldwide jobs  19%  +vw(Bjm+?7[
Specific local jobs only  18%  jF"`#G9N$[n w
Not sure  11%  
"ACj js$]1j 5uN_+}Qn4K
[b]Assessment Tools[/b]RU S`.EG%l9q

3i.OBg Do#G8t In contrast to screening tools, online assessment tools were defined as:&lAZ8]$U.T'YV

i F,]+tTe [b]Scientifically[/b] based screening tools that look more deeply into a candidate's abilities, interests, and skills. These tools include personality measures, cognitive tests (i.e., verbal and quantitative skills), situational judgment tests, job simulations, etc. These tools are typically used for a more in-depth evaluation later on in the staffing process.+{oY3iv

T8gi%O8f%T"T The overall usage rate of in-depth candidate assessment tools by organizations has grown when compared to the last few years. Although our current sample of people professionals represents a largely different group of individuals compared to last year, the substantial increase in the adoption of most types of tools is difficult to put aside. This trend alone is quite significant as it shows the growing increase in the popularity of these tools.

moon 2006-11-1 11:03 AM

[b]Table 4 Type of Assessment  2006  2005  2003-04  2002  [/b]w ddigr;S$B
+]wAx8sA T,jF
[i]Personality measures  65%  34%  30%  21%  
_:bY4d9{Z X Assessment of "fit" with company  53%  35%  27%  29%  
MI2TN0a0q0b5o Cognitive ability  42%  46%  27%  26%  2[;QuCr
Biodata  16%  15%  10%  14%  @L#X"H*b9V)Qw6x
Skills/Knowledge  66%  53%  40%  12%  
`0W2jM/Dx$\| Background investigations  65%  54%  30%  31%  ?'b(Of,w
Simulations  21%  18%  14%  10%  
"MW3eL ?1g Online interviews  7%  15%  4%  19%  [/i]
^1M GdFT 3RW WQf8OY&D
In line with previous surveys, checks of criminal background, specific skills and knowledge certifications, and personality inventories are becoming routine. However, this year's results signify a substantial jump in the level of adoption of these instruments. Online interviews and simulations continue to be less often used. But how extensive are deployments of assessment tools across organizations?Qu(| WG@`

a$U,PSV0E;pn [b]Table 5 Variation in Deployment  %  [/b]
3c&G8P2}D+^ [u]All jobs within a business unit, but not all business units  24%  %s pf;ytP _
All domestic jobs  28%  
WoP,G0P All worldwide jobs  8%   OZ7b;K-~7r[+Q
Specific local jobs only  27%  
~[B&a*C Not sure  13%  [/u]{D!d.i:k4O

CxJ6EG4|3lO As with prescreening, the variation in the deployment of tests and assessments is wide, with a total of 36% of users indicating that assessment is utilized in the placement of individuals into either all domestic (28%) or global jobs (8%). For another angle on the extent of assessment implementation, we asked respondents to indicate the level of jobs for which assessment is used for evaluating candidates.3P0Vx8nSR |Yk
O dSD _-F
[b]Table 6 Use Across an Organization  %  [/b]$s GRO/j/}i
[u]Entry level/hourly  43%  
+~)u`$`:S Lower-level management/professional  55%  
U3\YC8MF"m-M Middle-level management/professional  53%  
'BQb8u,dL7Y Higher-level management (director)  41%  
H![;A8A#H] Executive/Vice President  26%  [/u]5T$c;TX9lho)x |2w
S Ga dQ7OI4a
Table 6 suggests that this aspect of online assessment has evolved. 2006 appears to be the first year that our data show a general pattern of use across all levels of an organization. But unlike job level, rates of use for different types of job settings appear to vary quite a bit. Table 7 displays these broad differences.
7~| j-A.v:U a2O K'R$H:y"D$|oj_B
[b]Table 7 Rates of Use for Different Types of Job Settings  %  [/b]p"esya.@
[u]Customer service  41%  
LTy5S1FN7Oq;t&C Manufacturing/Labor  12%  |.LA`(ihJ
Skilled trades  24%  
"YH$\ E!FpT'r} Account management  32%  9t/YN9w`h"M
Call centers  30%  
k$WM.{~HE-f6]t Managerial/Supervisory  53%  [m7x*ze+?)d
Administrative  41%   X?7A G\#C(E|wf
Information technology  38%  G F2|jZ
Retail  12%  
I/L d GPv7gn Consulting/Advising  16%  *c ]y$U0J:^K_
Sales  41%  
0QV'? X8I{{E Professional  45%  0K K-b#T.E%\roW:g
Other  22%  [/u]+w/} Q`4g[Bu$Cq.v
c R%v|J+Z`8o
As we noted last year, Web-based managerial, sales, IT, administrative, and customer-service assessments are common, in part, because so many different instruments and recruiting programs have been developed specifically for these sorts of jobs. Moreover, non-online, validated assessments of key skills and competencies required for success in these roles have been used for decades. h2G?uMx(^[-e F0\
gfNZ |^
[b]Effectiveness of Screening and Assessment Tools[/b]
)R,OS2cf!b(Yw` A key goal of this series of studies has been to document the feelings people professionals have about the effectiveness of online recruiting and hiring systems. This year, 37% of prescreen users and 63% of assessment users felt their tools added value to their organization. The rest were evenly divided between either not having an opinion or feeling that Web-based hiring tools did not add value. C\e,tv4?
#w}:k$r;c[ ?
Understanding how these users have formed their opinions is of even greater interest. Apparently, these opinions have been formed through general impressions as opposed to actual evaluation, as only a minority of companies in our survey actually evaluated the use of hiring technology. Specifically, only 31% of users of prescreening tools and 30% of assessment users collected metrics to judge the quality of their interventions. Moreover, users of metrics tend to distinguish themselves from the majority. Tables 8 and 9 reveal this contrast:3\}1ik7n9y
"TM\5hL6fg2c
[b]Table 8 Are Prescreening Tools Effective?  Organizations collecting metrics  Organizations that do not collect metrics  [/b]+N*Y~%A7u
[u]Yes  59%  24%  
#A8g(O_yDM2m No  19%  31%   [F lw7j FI c]
Not sure  22%  31%  +Q8N6tcUs7I4ia
Did not answer  0%  14%  ,_aM/qC3k'yB3x
Table 9 Does assessment have a positive impact on your organization?  Organizations collecting metrics  Organizations that do not collect metrics  
I Y^P};p1q+a#@ Yes  89%  50%  
8l VW.G9f:txMB,dA No  7%  27%  
(xuq{Try4Cwc Not sure  4%  23% [/u]
7V!WK0_N.A
wGh y8cq[`#a Clearly, collecting metrics helps to answer the question of effectiveness and also appears to lead to impressions of success in the use of Web-based hiring systems. A variety of different metrics and measures are in use. Our respondents mentioned comparisons of assessment scores versus tenure and turnover; validation studies; diversity indicators; standard HR metrics (e.g., time-to-fill, cost-per-hire); and impressions and opinions of managers and job candidates.(U:Dc3eKRy
1L"^Bq\'{ xw$nc
[b]The Future of Online Screening and Assessment[/b]
1`FN-w"U M Of those companies not currently using screening or assessment instruments, 62% feel they will implement one or more in the future. For them, Table 10 summarizes the sorts of tools under consideration.
mDJ1N:tr u8g$Y,f C0tTm
[b]Table 10 Type of Screening/Assessment  % considering use [/b]
S*b e%J Z5M9X [u]Resume-scanning tools  24%  
k_8O]"]s$MO-U Qualifications — experience, education, etc.  48%  'pE l"\r
Personality measures  25%  *NH6P-?&h }
Assessment of "fit" with company  25%  
.A$@K7U)lV0Pa n2o Cognitive ability  21%  
u~0p6l c6Q Biodata  5%  
"Cb4GT ~0e9rNG Skills/knowledge assessment  32%  
:T']*OE*G,V Background investigations  22%  
NP_ lP Simulations  8%  
bI-yfR#q6B ~-v Online interviews  11%  
(g|*i3py3v Don't know  11%  [/u]
z&y3^{"A(a7WwA !}Z.{9|9NvZ
Consistent with experienced users, qualifications screening, assessment of cultural fit, skill/knowledge assessments, and personality inventories dominate the interest of organizations seeking to implement web-based hiring tools. But with such an optimistic outlook ahead, what is keeping organizations from adopting online screening and assessment tools?

moon 2006-11-1 11:04 AM

[b]Obstacles to the Use of Online Screening[/b]
"O"I)E$r.a/_ ` W)a Of those seeking to enter the world of online hiring, what is single biggest obstacle to the adoption of prescreening and assessment in their organization?
/M0lu_A/_
E9W!D/@f1` [b]Table 11 Single-biggest obstacle to the adoption of online screening and assessment?  %  [/b]4PN'q1hS3v~4uE:L
[u]No obstacles right now  22%  
.C.L-Rl@ Lack of knowledge in organization  17%  2M1o#P)_`$^$z]g
Too costly / lack of budget resources  16%  
5]?#dgL Skepticism about the ability of screening to provide results  13%  
;y t-Vp[)a9CXX Decision-makers do not believe it is worth the cost  10%  
}| g!Fc.D6ctv J HR not interested in innovation, reluctance to change  6%  PQ?n5h
Hesitation due to legal issues  6%  v A`#^3a&E v;V
Technology is still too new  4%  
+N,_ I~R} W Tools will negatively impact the candidate experience  3%  &BJ/sq L%D/P~8\BI
Hesitation due to security issues  3%  [/u]/K?/O+Q.u*Gc2A4E

b&_P1r$n`'A| The data in Table 11 are both encouraging and discouraging at the same time. It is very encouraging that the largest percentage of respondents indicated there are no obstacles at this time. This is a first and clearly shows an increasingly positive climate for the use of screening and assessment tools.
u$F LFKVES6| up)`2~,a/u
At the same time, it's the same-old song and dance. Data suggest that typical concerns center around value of spending money and time on more advanced assessment, candidate reactions to hiring tools, and lack of knowledge regarding the positive implications of assessment tools. eTW)f0tDq

Fr;F/h$\G Thus, in terms of skepticism about benefits and a lack of budget, companies continue to be penny-rich and dollar-poor when it comes to dedicating monetary and human resources to their recruitment and hiring processes. Cost of entry is low, and the value of the better assessment tools has been established through hundreds of studies.5e3N/TK f+h1K_p
?tPY]xZtB
Survey respondents also tended to mention candidate distortion of qualifications as the biggest threat to the success of their online hiring tools. But inflation of job skills has always been with us. Overall, most companies have few or no substantive reasons to limit their use of online recruitment and hiring techniques.g%t&U9X8B b

\7g/Y f.a'X7Ch(\ [b]Summary[/b] U-E\Hj.F+~*n
We offer the following as key findings that help clarify today's trends in online hiring:
"_|7A+~q+uk+n'v 7z!xq] r_x0r,E#u1`
[b]Most [/b]medium-sized and large organizations have adopted or will adopt an applicant tracking system, but the use of an applicant tracking system does not relate to perceptions of hiring effectiveness.%CXVgYN#Me i
vv,[*l$P A.B8m?
[b]Some[/b] hiring tools, like qualifications screening, skills testing/certification and personality tests, are becoming standard features of a strategic hiring process. The use of some methods (e.g., online interviewing) is rare. 8{(x6oO,Ed4Bf |

#Y$M c1U:a&n [b]Few[/b] companies formally assess their prescreening tools or use metrics of any kind as a decision making aid. Those who do tend to be aware of the effectiveness of their hiring systems and perceive greater value in them.
2[h p4@/n6g.|M6@
.LvF!s0B^ [b]People[/b] professionals report a lack of understanding, weak budgets, or a general lack of support for online tools as their primary obstacles to adoption or greater use of modern prescreening and assessment technology.^M HG&d"TG:b/q
7P%MJ:U_/k
[b]Overall[/b], the results of this fourth version of our survey are the most encouraging yet. They clearly show a growing interest in these tools. Valid, Web-based approaches to recruiting, screening, and placing job candidates are fast becoming the norm at leading edge, people-focused organizations.
)n9k*j#Yw dp 'n_Iy'd4z
This trend is encouraging and, in our experience, not surprising. We feel these numbers will continue to grow as more organizations understand the value in properly evaluating the impact of screening and assessment tools.
Z(f2L/}GP c &c'\d#k~L#b
Unfortunately, a major takeaway for us is that there is still a very widespread failure to adopt the business intelligence mindset required to evaluate the effectiveness of screening and assessment tools. We found a lack of understanding of the value these tools can return as well as budgeting issues the primary obstacles.
5w;X~h_6X9H2@3L
UT;a)^.Hv0B As long as this deficiency exists, it is not surprising that skepticism about the value of these tools remains strong. We will continue to champion the use of evaluation to "close the loop" and help ensure an increase in the understanding of how properly implemented screening and assessment tools can impact the bottom line.
^YUJOG-r;~ !oF2c9`)w&_^&]n
(See next month's Journal of Corporate Recruiting Leadership for expanded coverage of findings from the 4th Annual Rocket-Hire Online Usage Survey.)
z%T7Pc%q1z%kN
&r6RAv!J&[]z Mark C. Healy also contributed to this article. Mark is a consultant, teacher, and business writer based in Oakland, California. He assists companies with the development of their human capital strategy and designs hiring, leadership development, and training programs. Mark teaches Industrial/Organizational Psychology at De Anza College in Cupertino, California.
页: [1]
查看完整版本: Major Findings From The Annual Rocket-Hire Online Screening