Post-doctoral research visit f - m postdoctoral position reinforcement learning for collaborative annotation h/f

A propos d'Inria

Inria est l'institut national de recherche dédié aux sciences et technologies du numérique. Il emploie 2600 personnes. Ses 215 équipes-projets agiles, en général communes avec des partenaires académiques, impliquent plus de 3900 scientifiques pour relever les défis du numérique, souvent à l'interface d'autres disciplines. L'institut fait appel à de nombreux talents dans plus d'une quarantaine de métiers différents. 900 personnels d'appui à la recherche et à l'innovation contribuent à faire émerger et grandir des projets scientifiques ou entrepreneuriaux qui impactent le monde. Inria travaille avec de nombreuses entreprises et a accompagné la création de plus de 200 start-up. L'institut s'eorce ainsi de répondre aux enjeux de la transformation numérique de la science, de la société et de l'économie. Post-Doctoral Research Visit F/M Postdoctoral position Reinforcement Learning for Collaborative Annotation
Le descriptif de l'offre ci-dessous est en Anglais
Type de contrat : CDD

Niveau de diplôme exigé : Thèse ou équivalent

Fonction : Post-Doctorant

A propos du centre ou de la direction fonctionnelle
The Inria University of Lille centre, created in 2008, employs 360 people including 305 scientists in 15 research teams. Recognised for its strong involvement in the socio-economic development of the Hauts-De-France region, theInria University of Lille centre pursues a close relationship with large companies and SMEs. By promoting synergies between researchers and industrialists, Inria participates in the transfer of skills and expertise in digital technologies and provides access to the best European and international research for the benefit of innovation and companies, particularly in the region.For more than 10 years, theInria University of Lille centre has been located at the heart of Lille's university and scientific ecosystem, as well as at the heart of Frenchtech, with a technology showroom based on Avenue de Bretagne in Lille, on the EuraTechnologies site of economic excellence dedicated to information and communication technologies (ICT).
Contexte et atouts du poste

This postdoctoral position is part of the national PEPR (Programme et Equipement Prioritaire de Recherche) PlantAgroEco project, coordinated by Alexis Joly. The PEPR involves several teams from various institutes (Inria ZENITH, CIRAD AMAP, CIRAD PHIM, CIRAD PBVMT,INRAE ePhytia,INRAE IGEPP, INRAE LISAH, IRD EGCE, IRD IEES, Univ. Paris Saclay, TelaBotanica).This is a postdoctoral position in Machine Learning, more specifically in Reinforcement Learning. We are seeking a highly motivated and skilled postdoctoral fellow to join the project, dedicated to advancing the field of Machine Learning, with a specific focus on Reinforcement Learning. The position is initially funded for 15-month, but it can be easily extended.

The candidate will bebased at Inria Lille - Nord Europe under the expert guidance of Odalric-Ambrym Maillard.

About Us: The PEPR PlantAgroEco project brings together multidisciplinary teams from esteemed institutes, including Inria ZENITH, CIRAD AMAP, CIRAD PHIM, and more. Our mission is to address intriguing theoretical challenges in the application of agroecological practices in agriculture through cutting-edge Machine Learning techniques.

Collaborative Environment: You will collaborate closely with a team of dedicated Engineers responsible for the actual implementations. Hence, your primary focus will be on the creation of sound algorithms and methods, ensuring their theoretical integrity and applicability to real-world scenarios.

Odalric-Ambrym Maillard is a researcher at Inria. He has worked for over a decade on advancing the theoretical foundations of reinforcement learning,using a combination of tools from statistics, optimization and control, in order to build more efficient algorithms able to better estimate uncertainty, exploit structures, or adapt to some non-stationary context.
He was the PI of the ANR-JCJC project BADASS (BAnDits Against non-Stationarity and Structure) until Oct. 2021. He is also leading the Inria Action Exploratoire SR4SG (Sequential Recommendation for Sustainable Gardening) and the Inria-Japan associate team RELIANT (Reliable multi-armed bandits),
and is involved in a series of other projects, from more applied to more theoretical ones all related to the grand-challenge of reinforcement learning that is to make it applicable in real-life situations.
See \texttt{http://odalricambrymmaillard.neowordpress.fr} for further details.

Scool (Sequential COntinual and Online Learning) is an Inria team-project. It was created on November 1st, 2020 as the follow-up of the team SequeL. In a nutshell, the research topic of Scool is the study of the sequential decision making problem under uncertainty. Most of our activities are related to either bandit problems, or reinforcement learning problems. Through collaborations, we are working on their application in various fields, mainly: health, agriculture and ecology, sustainable development. See our \href{https://team.inria.fr/scool/projects/}{Projects page} for more information.

Mission confiée

Your Mission: As a key member of our team, you will embark on an enriching journey to tackle complex theoretical challenges, applying your expertise to a real open-science application. This role offers a unique opportunity for a young researcher to make valuable and visible contributions in an ambitious project.

The project is organized around three high-level tasks and research questions:
- User Annotation-Expertise Profiling: Your expertise will be instrumental in estimating and tracking user annotation profiles, adapting contextual bandit strategies to provide tailored support, and leveraging change-point detection techniques. These innovations will have wide-ranging applications beyond the scope of PlantNet, contributing to top-tier conferences and journals related to recommender systems.
- Rapid Annotation Assistance: You will devise efficient techniques for rapid annotation, customizing approaches based on users' estimated expertise. This task involves pioneering sample-efficient hypothesis testing and personalizing assistance for optimal outcomes. Your work will provide generic-purpose approaches applicable to diverse domains.
- Complementary Expert Query Strategies: You will pioneer adaptive query strategies for a diverse pool of experts, ensuring reliable collective labeling and adaptive stopping mechanisms. This research will not only benefit PlantNet but also have implications for other applications.

These tasks can be explored in various ways and lead to other challenges but should be considered the backbone of the project. The research, though focused on the PlantNet example, should be considered from a broader perspective, and be beneficial to recommender systems at large.

Principales activités

Making reinforcement learning techniques applicable to real-life applications (such as the recommendation of agroecological practices in agriculture) requires overcoming several scientific bottlenecks. Within the scope of the PEPR PlantAgroEco project, this 18m postdoc will focus on providing novel reinforcement learning strategies in order to improve the collaborative annotation process of the \href{https://plantnet.org}{PlantNet} data acquisition platform, both from a theoretical and applied perspective. This project makes appear appealing challenges around contextual multi-armed bandits relevant to collaborative decision making and recommendation at large, with a unique opportunity to interact with a real data platform used by millions. Solving the different challenges in a sound and effective way requires special attention from both mathematical and computational standpoints.

Compétences

- PhD in machine learning or statistics, with a focus on multi-armed bandits or recommender systems.
- Proficiency in English.
- Strong coding abilities, coupled with analytical and statistical expertise.
- Proven background in areas such as probability, Markov chains, and concentration of measure.
- Adeptness with contextual bandits, active sampling, and recommender systems.
- Ability to work collaboratively within a dynamic scientific environment.

Avantages

- Subsidized meals
- Partial reimbursement of public transport costs
- Leave: 7 weeks of annual leave + 10 extra days off due to RTT (statutory reduction in working hours) + possibility of exceptional leave (sick children, moving home, etc.)
- Possibility of teleworking and flexible organization of working hours
- Professional equipment available (videoconferencing, loan of computer equipment, etc.)
- Social, cultural and sports events and activities
- Access to vocational training
- Social security coverage

Rémunération
Gross monthly salary (before taxes) : 2 788€