Experimenting Embeddings with Graph Neural Networks for Knowledge Graphs using RDF Reification

When:
31/03/2024 – 01/04/2024 all-day
2024-03-31T01:00:00+01:00
2024-04-01T02:00:00+02:00

Offre en lien avec l’Action/le Réseau : – — –/– — –

Laboratoire/Entreprise : Université de Nantes
Durée : 5 à 6 mois
Contact : Patricia.Serrano-Alvarado@univ-nantes.fr
Date limite de publication : 2024-03-31

Contexte :
The context of this work is the CLARA project [CLARABench]1. In this internship, we are interested in analyzing knowledge graphs using deep learning methods. Since their introduction, deep learning models have been at the center of attention. The latest examples are the Large Language Models (LLMs) and in particular the transformer model [Transformer] used by ChatGPT. These models are built for tasks such as chatbots, conversational AIs, or sentiment analysis of texts. However, deep learning models have proven to be very efficient for other tasks, like the Convolutional Neural Networks (CNNs) for image recognition. This efficiency has also been proven for analyzing knowledge graphs with Graph Neural Networks (GNN) [SurveyGNN]. GNN models are particularly efficient for tasks such as link prediction, entity classification, or k-nearest neighbours.
Knowledge graphs represent statements as triples (head, relation, tail). Each triple is a fact stating a relation between two entities. Statements about statements, also called statement-level annotations, are increasingly used. They allow specifying that a statement is true under a particular context. Context can concern temporal aspects, provenance, trust values, scores, weights, etc. RDF reification allows expressing statement-based annotations in a generic way. We believe that current GNN models are not suited for processing annotations. GNN models do not support RDF reification because it may introduce noise that would reduce the quality of the results.

Sujet :
The goal of this internship is to show the limits of existing GNN models in the presence of RDF reification and to propose a new model that efficiently integrates RDF annotations.

You will participate in research work alongside a PhD student in the following tasks:
● Defining and running an experimental protocol. You will conceptualize and run an experimental protocol to put into light the impact of reification on GNN models. This will require the understanding of (a) several models (e.g., R-GCN [RGCN], HypE [HypE], RDF2vec [RDF2vec]), (b) the different reification approaches and their impact on GNN models (standard reification [Standard], n-ary relations [N-ary],

RDF-star [RDF-star]), and (c) how the impact of RDF reification on the GNN models can be measured. The obtained results will be the baseline for the next task.
● Creating a new GNN model. You will help in contributing a GNN model that better integrates RDF reification. The model will be inspired by the message-passing algorithm used in GNNs such as R-GCN and it should be able to adapt to RDF reification. The result of this approach should be compared to the baseline previously obtained.

Profil du candidat :

Knowledge of Machine Learning and Deep Learning.

Good programming skills, in particular in Python.

Formation et compétences requises :
Master or Engineer Student.

Adresse d’emploi :
Université de Nantes

Document attaché : 202312141033_2023-2024 Stage Master 2.pdf