The paper focuses on deep learning semantic search algorithms applied in the HR domain. The aim of the article is developing a novel approach to training a Siamese network to link the skills mentioned in the job ad with the title. It has been shown that the title normalization process can be based either on classification or similarity comparison approaches. While classification algorithms strive to classify a sample into predefined set of categories, similarity search algorithms take a more flexible approach, since they are designed to find samples that are similar to a given query sample, without requiring pre-defined classes and labels. In this article semantic similarity search to find candidates for title normalization has been used. A pre-trained language model has been adapted while teaching it to match titles and skills based on co-occurrence information. For the purpose of this research fifty billion title-descriptions pairs had been collected for training the model and thirty three thousand title-description-normalized title triplets, where normalized job title was picked up manually by job ad creator for testing purposes. As baselines FastText, BERT, SentenceBert and JobBert have been used. As a metric of the accuracy of the designed algorithm is Recall in top one, five and ten model's suggestions. It has been shown that the novel training objective lets it achieve significant improvement in comparison to other generic and specific text encoders. Two settings with treating titles as standalone strings, and with included skills as additional features during inference have been used and the results have been compared in this article. Improvements by 10% and 21.5% have been achieved using VacancySBERT and VacancySBERT (with skills) respectively. The benchmark has been developed as open-source to foster further research in the area.

Read the full study: "VacancySBERT: the approach for representation of titles and skills for semantic similarity search in the recruitment domain"

This article contributes to the broader collection of external ESCO publications, showcasing the use of ESCO within various methodologies or its presentation in both European and International contexts. As ESCO becomes increasingly used in applications and research projects across Europe and beyond, it is valuable to collect such sources and share best practices by diverse stakeholders. Therefore, this collection of external publications strengthens the exchange of knowledge within the ESCO community and can contribute to mutual learning in the field of skills, occupations and qualifications among European and international actors. If you are interested in sharing your publication, please write to EMPL-ESCO-SECRETARIAT@ec.europa.eu