Representation Learning for Geographic Spatio-Temporal Generalisation

When:
12/12/2022 – 13/12/2022 all-day
2022-12-12T01:00:00+01:00
2022-12-13T01:00:00+01:00

Offre en lien avec l’Action/le Réseau : – — –/– — –

Laboratoire/Entreprise : ICube, University of Strasbourg
Durée : 6 mois
Contact : lampert@unistra.fr
Date limite de publication : 2022-12-12

Contexte :
Time-series are becoming prevalent in many fields, particularly when monitoring environmental changes of the Earth’s surface in the long term (climate change, urbanisation, etc), medium term (annual crop cycle, etc) or short term (earthquakes, floods, etc). With the current and future satellite constellations satellite image time-series (SITS) expand remote sensing’s impact.

Sujet :
Detailed subject: https://seafile.unistra.fr/f/7b4b402e34124fb396b7/?dl=1

The project’s goal is to develop domain invariant representations using deep learning for SITS analysis. Such methods will enable geographic generalisation, which consists of reusing information from the analysis of one geographic area to analyse others by using, or not, the same sensors, as proposed in [5]. Current approaches work for single images because they generally originate from the computer vision community.

The internship will start the evaluation of the state-of-the-art and to implement and extend approaches already developed in ICube [5,6].
Current work on domain adaptation (DA) for time-series uses either weak supervision [1] or attention-based mechanisms [2,3] for classification or focus on the related problem of time- series forecasting [4]. However, none of these approaches tackle the problem of learning DIRs that can be applied to several geographical locations simultaneously.

The work has two benefits: on the one hand, to reduce the burden of ground truth collection when sensors of different characteristics are used; and on the other to exploit the information contained in each data modality to learn representations that are more robust and general, i.e. to detect crops, land cover evolution, etc in different countries that exhibit different characteristics.

Your contributions will be part of the global work of the SDC researchers and will be validated through the partnership with CNES and potential collaboration with Tour du Valat. SDC’s aim is to propose and implement new generic methods and tools to exploit large sets of reference data from one domain/modality (sufficient to train an accurate detector) to train a multi- modal/domain detector that can be applied to imagery taken from another sensor for which there exists no reference data.

As such, the work tackles key problems in many machine learning & computer vision applications.

Profil du candidat :
• Experience with the Python (numpy, keras, tensorflow, etc.)
• Interest/experience in deep learning
• Knowledge of machine learning workflows and techniques (e.g. best practices around
training data management, understand basics of numerical optimisation)
• Familiarity with Linux environments
• Have excellent communication skills and a strong team player
• Good knowledge of English (French is not mandatory)

Formation et compétences requises :
2nd year of a Master’s in Computer Science degree or similar

Adresse d’emploi :
ICube UMR 7357 – Laboratoire des sciences de l’ingénieur, de l’informatique et de l’imagerie
300 bd Sébastien Brant – CS 10413 – F-67412 Illkirch Cedex