Performance-based tests have substantial impact on the role of the psychometrician. They require skills in analyzing qualitative data, facilitating group discussions, pragmatics, and correlating variables. But, let me start by defining psychometrics and describing what psychometricians do.Read More
Since the dawn of the Pinterest era, DIY has become ubiquitous with crafters building home decor on weekends.
Unfortunately, most certification managers don’t exactly associate the term with the same level of enthusiasm. And that is because they are often building new exams out of necessity, not love.
Creating a performance-based certification platform in-house involves several moving parts, such as exam design, platform programming, latency testing and more.
SMBs that can only devote one to three team members are the most likely to experience setbacks due to trial and error. Budgetary constraints, unfamiliar technical specifications and poor contractor communication are often additional cause for frustration.
Most of the certification managers we meet at conferences wish they could hire someone to manage and execute PBC for them. However, they assume that doing so would be out of budget.
They are surprised when we tell them that often isn’t true. Their jaw drops even more when they learn they may actually be overspending on contractors who don’t fully deliver!Read More
Learn how to design performance-based exam questions and get your team and SMEs ready.
Transitioning from multiple choice question (MCQ) to performance-based certification (PBC) isn’t easy, but it’s worth it.
Tech leaders who have already made the switch — Google, SUSE and Chef — are enjoying benefits like trustworthy channel-partner relationships, greater brand recognition and increased sales opportunities.
If you’re not a huge company, with an unlimited budget, one of your biggest challenges will be navigating the exam design process with minimal errors. Obviously, no small or medium-sized business wants to waste time, energy and resources on designing a mediocre certification exam.
The good news? Learning how to design performance-based exam questions is relatively straightforward. That’s because the process of creating PBC questions is surprisingly similar to that of MCQ.
However, there are some key differences certification managers should familiarize themselves with before getting started. In this article, we’ll outline what those things are and why they matter.
We’ll also discuss why mentally preparing subject matter experts (SMEs) early-on is vital to growing a successful certification program. Let’s get started:
Great test design for performance-based exams depends on a shared understanding of competence.
Competence is doing meaningful work to standard under normal conditions. Agreeing on what is normal is where the hang up is. Normal assumes agreement on the uniformity and diversity of both work tasks and the workplace environment. People with the same job title may or may not do the same tasks even in the same company. They certainly do not share the same workplace environment if they work in different locations or for different bosses.
Rob Foshay, Ph.D. et.al, in their research on emerging best practices in the private sector discusses the rising interest in performance-based tests to measure competence. Part of that interest is fueled by the evidence that performance-based tests have higher fidelity (they more fully reflect the workplace environment) and; therefore, can demonstrate greater external integrity (passing correlates with something important to the organization). For example, is there a correlation between the number of people who pass the test and those who do well on the job, stay in the job longer, or have fewer cost overruns or missed deadlines?Read More
What a waste of time…
If you’ve ever uttered the phrase after attending an employee training program, you’re not alone. Despite U.S. companies continually spending more money on training, 75 percent of respondents surveyed by McKinsey & Co. indicated such efforts did not improve employee performance.
The primary culprit? Marathon learning sessions that overload team members with information that is never revisited.
“Decades of research on knowledge retention has proven that fire-hose training events deliver astonishingly bad results,” says Forbes contributor Stephen J. Meyer. “The human brain simply wasn’t designed to learn this way.”
Obviously, software and platform certification managers aren’t designing typical employee training programs. However, they are responsible for educating team members on how these certifications fit into “the bigger picture.”
If you’re in the process of transitioning to performance-based certification (PBC), it’s imperative that you approach team member training with the same level of care as the exam development process. Your program’s ultimate success will directly correlate with how much key stakeholders understand its value.
Organizational leadership, team members and channel partners alike should feel comfortable articulating why PBC enhances the capabilities of platform users, how it works from a technological standpoint and how the exam benefits everyone involved.
You’ve analyzed the data.
You’ve done your homework.
And you’re ready to transition from multiple-choice question exams to performance-based certification (PBC).
There is just one problem — you still have to convince “the boss” that adopting the new program format is the right move for everyone.Read More
How knowledgeable are you when it comes to MCQ exams?
Would you win a round at trivia night, answering the following?
True or false:
- The longest answer on an exam is usually the correct one.
- Exam answers hardly ever repeat consecutively.
- The answers “none of the above” and “all of the above” are correct responses on multiple choice question exams 52% of the time.
If you answered “true” for all of the above, pat yourself on the back and congratulate yourself for being a big nerd! Regardless of your score, read on to learn why performance-based assessment excels where MCQ fails.Read More
Expensive. Complicated. Time-consuming.
These are some common misconceptions held by software and platform companies considering Performance-Based Assessment (PBA).
What has motivated companies like Google, Elastic and Chef to make the switch in recent years, despite these misconceptions?
Instead of presenting candidates with only multiple-choice questions — that don’t accurately measure true ability — these organizations can now test users and channel-partners in real world environments that emulate actual project scenarios.Read More
Google recently announced plans to offer certification scholarships in support of its efforts to train and empower Africans to develop world class apps on Android, web, and cloud technologies. They’ll be training and certifying a generation of developers just as a global rollout of 5G networks is about to get underway. As you can imagine, this will undeniably spur a much-needed economic transformation in the region.
Interestingly enough, this announcement is also a milestone for the team here at TrueAbility. Because unbeknownst to many, TrueAbility is the performance-based delivery platform that’s powering two of the three certification programs announced by Google, namely the Android and Mobile Web Specialist certifications. So, Google’s announcement impacts us in three very important ways:Read More
Her toes were in the sand.
A piña colada was in her hand.
And Lauren wasn’t worried about a thing.
This was the vacation she had needed — a complete break from tech troubleshooting, exam proctoring and certification grading.
Everything was going great until a blaring car alarm began to overpower the sound of the ocean waves. The noise became louder until Lauren opened her eyes and realized it was her cell phone.
She reached for the phone, looked at the clock and rolled her eyes as she read the time: It was 2 a.m. Her husband woke up and gave her that familiar look that said, “Is this seriously happening again? Please quit, and find a new job, so I can get some sleep.”
Lauren managed the certification program for a growing SaaS provider that had recently launched its first performance-based certification program. This was the third time this week she had awoken to a call from a test-taker halfway around the world.Read More