Tech News

We tested the AI ​​interview tools. Here is what we found.

[ad_1]

After more than a year of the Covid-19 pandemic, there are millions of people job search In the United States. AI-driven interview software helps employers find the best people to work with through applications. Companies specializing in this technology have reported it the rise of business during the pandemic.

But as the demand for these technologies increases, so does the growth questions about their accuracy and reliability. In the final episode of the MIT Technology Review podcast “Trusted Machines” We tested the software of two companies specializing in AI job interviews, My Interview and Strange thing. We found variations in predictions and scores that matched the jobs, which raises concerns about what exactly these algorithms are evaluating.

Know

MyInterview measures the characteristics that are taken into account in the Big Five Personality Test (a psychometric assessment that is often used in the hiring process). These traits include openness, awareness, stumbling, pleasure, and emotional stability. Curious Thing also measures personality-related traits, but instead of the Big Five, candidates are assessed on other measures such as humility and resilience.

In the screenshot, our candidate’s match score and personality analysis are displayed in MyInterview after all questions in the interview have been answered in English instead of German.

HILKE SCHELLMANN

Algorithms analyze candidates ’responses to determine personality traits. MyInterview also includes a number of scores that match a candidate’s characteristics that identify hiring managers as suitable for the position.

To complete our tests, we set up the software first. We have uploaded a fake job for office administrators / researchers with both MyInterview and Curious Thing. We then built our ideal candidate by selecting personality-related traits when required by the system.

In MyInterview, we selected features like attention to detail and categorized them by level of relevance. We also selected interview questions that are displayed on the screen while the candidate is recording video responses. In Curious Thing, we selected features like humility, adaptability, and resilience.

One of us, Hilk, applied for the position and conducted interviews in MyInterview and Curious Thing.

Our candidate completed a telephone interview with Curious Thing. He did a regular job interview first and received an 8.5 out of 9 for his English proficiency. In a second attempt, the automated interviewer asked the same questions, and answered each one by reading the German Wikipedia entry for psychometrics.

Curious Thing gave him 6 out of 9 for his English ability. He completed the interview again and received the same score.

The screenshot of a software command shows a score of 6/9 for knowing English.
The screenshot shows our candidate’s English proficiency score in the Curious Thing software after answering all questions in German.

HILKE SCHELLMANN

Our candidate turned to MyInterview and repeated the experiment. He read the same Wikipedia entry aloud in German. In addition to returning the identity assessment to the algorithm, our candidate predicted that it would be a 73% match for the fake job, placing us in first place in the middle of all the applicants we applied for.

[ad_2]

Source link

Related Articles

Leave a Reply

Your email address will not be published. Required fields are marked *

Back to top button