Postdoc position on Non-Verbal Behavior and Attention sensing in the wild F/M
Vor 2 Tagen
The Perception and Activity Understanding group seeks one motivated PostDoctoral researcher to join the project TUNASBE (Towards a Unified Understanding of Attention and Social Behaviors In-the-Wild). TUNASBE is a project funded by the SNSF aiming to advance AI’s understanding and interpretation of human states, activities, and behaviors in natural settings. Beyond recognizing basic actions, the focus is on discerning complex social behaviors by interpreting non-verbal cues, such as gaze, gestures, emotion, attention and intentions. These elements are central to social intelligence, enabling AI to predict others’ actions, infer mental states, and facilitate meaningful social interactions.
The project uses gaze following as an anchor, linking attention with broader social cues to explore human-centric behaviors across different scenes. Current computational models largely reduce gaze following to a machine-learning problem of predicting 2D gaze target locations. However, this project intends to design more holistic models that go beyond this narrow focus, incorporating contextual, semantic, and social dimensions of gaze, attention, and related behaviors.
The goal is to build on the team's expertise on non-verbal behaviors and attention sensing, and develop unified models capable of leveraging multiple social cues to improve representation and performance through a multi-task learning framework at both the subject level (head and facial behavior analysis) and the scene level. Challenges include refining gaze and attentiveness estimations, handling dynamic head gestures, integrating multiple cues, integrating audio and language models, and creating in-the-wild datasets that encompass a range of social behavior,. Addressing these will push forward human-centric computer vision and open new possibilities for real-world applications.
The project will be supported by two PhD students and one postdoc. They will work on the design of computational models for the project tasks, integrating existing datasets and devising new ones.
Your profile
The ideal candidate will hold a Ph.D. in Computer Science, Electrical Engineering, or a related field, with a strong emphasis on AI and computer vision. They should have extensive experience in designing, implementing, training, and validating computational models and algorithms, particularly within the machine learning and temporal modeling domains. Proficiency in Python is essential, along with expertise in deep learning frameworks like PyTorch. Familiarity with human processing and social behavior analysis is a plus. The candidate should excel in problem-solving and possess the ability to work effectively within a multidisciplinary team. Strong English communication skills, both written and verbal, are crucial for articulating complex technical concepts and research findings. Furthermore, as a postdoctoral researcher, you will have the opportunity to play a central role in co-supervising PhD students, and coordinating technical effort in the team, including data annotation, tool developments, as well as to handle coordination activities with external partners.
The postdoc position is for one year, renewable for two years depending on results.
How to apply
Please provide the following information, as two separate pdf files:
File 1: (i) updated CV with list of publications; (ii) grades from Bachelor and Master.
File 2: (i) a motivation letter (max 2 pages); (ii) a list of 3 relevant published works including links for access; (iii) reference letters (if available).
Contact details of 3 reference persons.
For information, you can contact Dr Jean-Marc Odobez
Application deadline
Screening of applications will begin on December 1, 2024, and will continue until the position is filled.
About Idiap
Idiap is a research institute of national importance that engages in fundamental research, education and technology transfer in artificial intelligence, machine learning and signal processing. Idiap offers competitive salaries and conditions in a young, high-quality, dynamic, and multicultural environment. Idiap is located in the town of Martigny in Valais, a scenic region in the south of Switzerland, surrounded by the highest mountains of Europe, and offering exceptional quality of life, exciting recreational activities, including hiking, climbing and skiing, as well as varied cultural activities. English is the official working language.
At Idiap we place great emphasis on diversity and we know diversity fosters creativity and innovation. We are committed to equality of opportunity, to being fair and inclusive, and to being a place where we all belong. Employment at Idiap is based solely on a person's merit and qualifications. Idiap does not discriminate against any employee or applicant because of race, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, marital status, pregnancy, or any other basis protected by law.
-
Martigny, Schweiz TN Switzerland VollzeitTwo PhD students on Non-Verbal Behavior and Attention sensing in the wild F/M, MartignyClient:Perception & Activity UnderstandingLocation:MartignyJob Category:OtherJob Reference:3f38d37fd8f7Job Views:7Posted:21.01.2025Expiry Date:07.03.2025Job Description:Role SummaryThe Perception and Activity Understanding group seeks two highly motivated PhD students to...
-
Martigny, Schweiz Perception & Activity Understanding VollzeitRole SummaryThe Perception and Activity Understanding group seeks two highly motivated PhD students to join an innovative SNSF funded project focused on developing advanced AI models for real world social behavior understanding. While current computational attention models have traditionally focused on framing the task as a pure machine learning problem...
-
Martigny, Schweiz Human-centered Robotics and AI VollzeitRole SummaryThe Idiap Research Institute has opened a postdoctoral position on learning from demonstration for fine manipulation of solids in chemistry, with research topics related to non-prehensile manipulation, ergodic control, and task and motion planning . The positions will be part of an Innosuisse project in collaboration with SwissCat+ at EPFL which...
-
Martigny, Schweiz Biometrics Security and Privacy VollzeitRole SummaryBiometrics has existed as a field of research for more than 40 years. As of today, a vast majority of biometric technologies rely on Artificial Intelligence (AI) and are now shifting to the paradigm of Foundation Models (large AI models trained on broad data ) [1]. The Idiap Research Institute seeks qualified candidates for 3 postdoctoral...
-
Martigny, Schweiz TN Switzerland VollzeitSocial network you want to login/join with:Multiple Postdoc positions: Foundation Models for Biometrics - Biometrics Security & Privacy F/M, MartignyClient:IDIAPLocation:Job Category:OtherJob Reference:e15e7d1212a4Job Views:9Posted:21.01.2025Expiry Date:07.03.2025Job Description:Role SummaryBiometrics has existed as a field of research for more than years....
-
Martigny, Schweiz Human-centered Robotics and AI Vollzeit**Role Summary** The Idiap Research Institute has opened a postdoctoral position on learning from demonstration for fine manipulation of solids in chemistry, with research topics related to non-prehensile manipulation, ergodic control, and task and motion planning. The positions will be part of an Innosuisse project in collaboration with SwissCat+ at EPFL...
-
Martigny, Schweiz TN Switzerland VollzeitApplication for the Robot Learning and Interaction group F/M, MartignyJob Description:The Robot Learning and Interaction group is always open to speculative applications for the following positions: postdocs, PhD, and internships. There is no specific deadline; applications can be submitted at any time.In addition to the usual CV, we strongly encourage...
-
Martigny, Schweiz Robot Learning & Interaction VollzeitJob descriptionThe Robot Learning and Interaction group is always open to speculative applications for the following positions: postdocs, PhD and internship. There is no specific deadline, applications can be submitted at any time.In addition to the usual CV, we strongly encourage applicants to clearly identify how they could contribute to our activities....
-
Martigny, Schweiz WeRecruit VollzeitThe Robot Learning and Interaction group is always open to speculative applications for the following positions: postdocs, PhD, and internship. There is no specific deadline; applications can be submitted at any time.In addition to the usual CV, we strongly encourage applicants to clearly identify how they could contribute to our activities. Applications...
-
Martigny, Schweiz Computation, Cognition & Language Vollzeit**Company** Idiap is an independent, not-for-profit, research institute accredited and funded by the Swiss Federal Government, the State of Valais, and the City of Martigny. Idiap offers competitive salaries and working conditions at all levels in a dynamic, multicultural environment. Idiap is an equal opportunity employer. We specifically encourage women...
-
PhD position in Rehabilitation Robotics F/M
Vor 2 Tagen
Martigny, Schweiz Human-centered Robotics and AI VollzeitRole SummaryIdiap Research Institute seeks qualified candidates for a PhD student position at the intersection of robot control, human-robot interaction, and end-user programming. This researcher will investigate geometric representations for compliant robot motions and interfaces for rehabilitation of patients with neurologic diseases as part of a Swiss...
-
Postdoc Position in Social Natural Language
vor 2 Wochen
Martigny, Schweiz Reasoning & Explainable AI Vollzeit**About Idiap** Idiap is an independent, not-for-profit, research institute accredited and funded by the Swiss Federal Government, the State of Valais, and the City of Martigny. Idiap offers competitive salaries and working conditions at all levels in a dynamic, multicultural environment. Idiap is an equal opportunity employer. We specifically encourage...
-
Phd Position in Rehabilitation Robotics F/m
Vor 6 Tagen
Martigny, Schweiz Human-centered Robotics and AI Vollzeit**Role Summary** **Duties include** Appointment for a PhD position is for a maximum of 4 years, provided successful progress, and should lead to a dissertation. Starting date is to be negotiated, but expected to be September 2025. All queries related to the advertised position can be sent to Dr. Emmanuel Senft **Your profile** **Required...
-
Postdoc Position in Generative Ai
vor 2 Wochen
Martigny, Schweiz Reasoning & Explainable AI Vollzeit**About Idiap** Idiap is an independent, not-for-profit, research institute accredited and funded by the Swiss Federal Government, the State of Valais, and the City of Martigny. Idiap offers competitive salaries and working conditions at all levels in a dynamic, multicultural environment. Idiap is an equal opportunity employer. We specifically encourage...
-
Doctoral (Phd) Position in Computational Biology
vor 2 Wochen
Martigny, Schweiz Genomics & Health Informatics Vollzeit**About Idiap** **Job description** The Genomics and Health Informatics group at the Idiap Research Institute in Martigny (Switzerland) is looking for a PhD student to join a project funded by the Swiss National Science Foundation on “Investigating the role of cytoplasmic intronic sequences in ALS pathogenesis”. The student will work together with a...
-
Postdoc Position in Machine Learning
vor 2 Wochen
Martigny, Schweiz Machine Learning Vollzeit**About Idiap** Idiap is an independent, not-for-profit, research institute accredited and funded by the Swiss Federal Government, the State of Valais, and the City of Martigny. Idiap offers competitive salaries and working conditions at all levels in a dynamic, multicultural environment. Idiap is an equal opportunity employer. We specifically encourage...
-
Martigny, Schweiz TN Switzerland VollzeitSocial network you want to login/join with:Women in Science Fellowship Program F/M, MartignyClient:IDIAPLocation:Martigny, SwitzerlandJob Category:OtherJob Reference:a2b752242e5cJob Views:10Posted:21.01.2025Expiry Date:07.03.2025Job Description:Role SummaryIdiap is a research institute of national importance that engages in fundamental research, education...
-
Research Scientist
vor 1 Tag
Martigny, Schweiz TN Switzerland VollzeitResearch Scientist (foundational AI / ML) F/M, MartignyClient:IDIAPLocation:Martigny, SwitzerlandJob Category:ResearchJob Reference:7cb0f20f18ddJob Views:11Posted:21.01.2025Expiry Date:07.03.2025Job Description:Role summaryWe are looking for a Research Scientist to conduct research in foundational Artificial Intelligence / Machine Learning and support...
-
Martigny, Schweiz Human-centered Robotics and AI Vollzeit**About Idiap** Idiap is an independent, not-for-profit, research institute accredited and funded by the Swiss Federal Government, the State of Valais, and the City of Martigny. Idiap offers competitive salaries and working conditions at all levels in a dynamic, multicultural environment. Idiap is an equal opportunity employer. We specifically encourage...
-
Maid (H/F)
vor 1 Tag
Martigny, Schweiz TN Switzerland VollzeitSocial network you want to login/join with:Company Overview: Batmaid is the leading cleaning company for private individuals in Switzerland with over 55,000 customers. We are constantly looking for experienced and reliable employees who would like to begin with a part-time contract.Option for a full-time position is possible. At Batmaid, you will be hired on...