Project acronym ARCA
Project Analysis and Representation of Complex Activities in Videos
Researcher (PI) Juergen Gall
Host Institution (HI) RHEINISCHE FRIEDRICH-WILHELMS-UNIVERSITAT BONN
Country Germany
Call Details Starting Grant (StG), PE6, ERC-2015-STG
Summary The goal of the project is to automatically analyse human activities observed in videos. Any solution to this problem will allow the development of novel applications. It could be used to create short videos that summarize daily activities to support patients suffering from Alzheimer's disease. It could also be used for education, e.g., by providing a video analysis for a trainee in the hospital that shows if the tasks have been correctly executed.
The analysis of complex activities in videos, however, is very challenging since activities vary in temporal duration between minutes and hours, involve interactions with several objects that change their appearance and shape, e.g., food during cooking, and are composed of many sub-activities, which can happen at the same time or in various orders.
While the majority of recent works in action recognition focuses on developing better feature encoding techniques for classifying sub-activities in short video clips of a few seconds, this project moves forward and aims to develop a higher level representation of complex activities to overcome the limitations of current approaches. This includes the handling of large time variations and the ability to recognize and locate complex activities in videos. To this end, we aim to develop a unified model that provides detailed information about the activities and sub-activities in terms of time and spatial location, as well as involved pose motion, objects and their transformations.
Another aspect of the project is to learn a representation from videos that is not tied to a specific source of videos or limited to a specific application. Instead we aim to learn a representation that is invariant to a perspective change, e.g., from a third-person perspective to an egocentric perspective, and can be applied to various modalities like videos or depth data without the need of collecting massive training data for all modalities. In other words, we aim to learn the essence of activities.
Summary
The goal of the project is to automatically analyse human activities observed in videos. Any solution to this problem will allow the development of novel applications. It could be used to create short videos that summarize daily activities to support patients suffering from Alzheimer's disease. It could also be used for education, e.g., by providing a video analysis for a trainee in the hospital that shows if the tasks have been correctly executed.
The analysis of complex activities in videos, however, is very challenging since activities vary in temporal duration between minutes and hours, involve interactions with several objects that change their appearance and shape, e.g., food during cooking, and are composed of many sub-activities, which can happen at the same time or in various orders.
While the majority of recent works in action recognition focuses on developing better feature encoding techniques for classifying sub-activities in short video clips of a few seconds, this project moves forward and aims to develop a higher level representation of complex activities to overcome the limitations of current approaches. This includes the handling of large time variations and the ability to recognize and locate complex activities in videos. To this end, we aim to develop a unified model that provides detailed information about the activities and sub-activities in terms of time and spatial location, as well as involved pose motion, objects and their transformations.
Another aspect of the project is to learn a representation from videos that is not tied to a specific source of videos or limited to a specific application. Instead we aim to learn a representation that is invariant to a perspective change, e.g., from a third-person perspective to an egocentric perspective, and can be applied to various modalities like videos or depth data without the need of collecting massive training data for all modalities. In other words, we aim to learn the essence of activities.
Max ERC Funding
1 499 875 €
Duration
Start date: 2016-06-01, End date: 2021-05-31
Project acronym GrInflaGal
Project Gravity, Inflation, and Galaxies: Fundamental Physics with Large-Scale Structure
Researcher (PI) Fabian Schmidt
Host Institution (HI) MAX-PLANCK-GESELLSCHAFT ZUR FORDERUNG DER WISSENSCHAFTEN EV
Country Germany
Call Details Starting Grant (StG), PE9, ERC-2015-STG
Summary Over the past two decades, a data-driven revolution has occurred in our understanding of the origin and evolution of our Universe and the structure within it. During this period, cosmology has evolved from a speculative branch of theoretical physics into precision science at the intersection of gravity, particle- and astrophysics. Despite all we have learned, we still do not understand why the Universe accelerates, and how the structure in the Universe originated. Recent breakthrough research, with leading contributions by the PI of this proposal, has shown that we can make progress on these questions using observations of the large-scale structure and its tracers, galaxies. This opens up a fascinating, new interdisciplinary research field: probing Gravity and Inflation with Galaxies. The goal of the proposed research is to first, probe our theory of gravity, General Relativity, on cosmological scales. Second, it aims to shed light on the origin of the initial seed fluctuations out of which all structure in the Universe formed, by constraining the physics and energy scale of inflation. While seemingly unrelated, the main challenge in both research directions consists in understanding the nonlinear physics of structure formation, which is dominated by gravity on scales larger than a few Mpc. By making progress in this understanding, we can unlock a rich trove of information on fundamental physics from large-scale structure. The research goals will be pursued on all three fronts of analytical theory, numerical simulations, and confrontation with data. With space missions, such as Planck and Euclid, as well as ground-based surveys delivering data sets of unprecedented size and quality at this very moment, the proposed research is especially timely. It will make key contributions towards maximizing the science output of these experiments, deepen our understanding of the laws of physics, and uncover our cosmological origins.
Summary
Over the past two decades, a data-driven revolution has occurred in our understanding of the origin and evolution of our Universe and the structure within it. During this period, cosmology has evolved from a speculative branch of theoretical physics into precision science at the intersection of gravity, particle- and astrophysics. Despite all we have learned, we still do not understand why the Universe accelerates, and how the structure in the Universe originated. Recent breakthrough research, with leading contributions by the PI of this proposal, has shown that we can make progress on these questions using observations of the large-scale structure and its tracers, galaxies. This opens up a fascinating, new interdisciplinary research field: probing Gravity and Inflation with Galaxies. The goal of the proposed research is to first, probe our theory of gravity, General Relativity, on cosmological scales. Second, it aims to shed light on the origin of the initial seed fluctuations out of which all structure in the Universe formed, by constraining the physics and energy scale of inflation. While seemingly unrelated, the main challenge in both research directions consists in understanding the nonlinear physics of structure formation, which is dominated by gravity on scales larger than a few Mpc. By making progress in this understanding, we can unlock a rich trove of information on fundamental physics from large-scale structure. The research goals will be pursued on all three fronts of analytical theory, numerical simulations, and confrontation with data. With space missions, such as Planck and Euclid, as well as ground-based surveys delivering data sets of unprecedented size and quality at this very moment, the proposed research is especially timely. It will make key contributions towards maximizing the science output of these experiments, deepen our understanding of the laws of physics, and uncover our cosmological origins.
Max ERC Funding
1 330 625 €
Duration
Start date: 2016-09-01, End date: 2022-08-31
Project acronym INTEGHER
Project Integration of herpesvirus into telomeres: From the mechanism of genome integration and mobilization to therapeutic intervention
Researcher (PI) Benedikt Kaufer
Host Institution (HI) FREIE UNIVERSITAET BERLIN
Country Germany
Call Details Starting Grant (StG), LS6, ERC-2015-STG
Summary Herpesviruses cause serious diseases in humans and animals. After initial lytic infection, herpesviruses establish a quiescent (latent) infection, which allows their persistence in the host for life. We and others recently identified a novel mechanism that allows maintenance of the genome of certain herpesviruses during latency, by integrating their complete genetic material into host telomeres. One of these viruses is human herpesvirus 6 (HHV-6) which is associated with seizures, encephalitis, and graft rejection in transplant patients. Sporadic reactivation of the integrated virus ensures continued evolution of the virus as it spreads to a new cadre of susceptible individuals. There are critical gaps in our knowledge regarding the fate of herpesvirus genomes during integration and reactivation as well as of viral and cellular factors involved in these processes.
INTEGHER will make use of novel technologies to close these gaps and to devise new therapeutic approaches. Specifically, we will 1) determine the fate of the HHV-6 genome during latency by developing a novel reporter system that allows live-cell imaging of the virus genome in living cells and elucidate epigenetic changes of the HHV-6 genome during integration and reactivation; 2) identify viral and cellular factors that drive virus genome integration and reactivation, using recombinant viruses, drugs and CRISPR/Cas9 genome engineering 3) employ genome-editing tools to eliminate the virus genome integrated in host chromosomes in vitro and in an in vivo model. The proposal utilizes state-of-the-art technologies and pioneers new approaches, particularly with regard to visualization and excision of virus genomes in latently infected cells that are also present in (bone marrow) transplants. Altogether, these studies will define the mechanism of herpesvirus integration and reactivation and will provide new tools for therapeutic excision of virus genomes from living cells.
Summary
Herpesviruses cause serious diseases in humans and animals. After initial lytic infection, herpesviruses establish a quiescent (latent) infection, which allows their persistence in the host for life. We and others recently identified a novel mechanism that allows maintenance of the genome of certain herpesviruses during latency, by integrating their complete genetic material into host telomeres. One of these viruses is human herpesvirus 6 (HHV-6) which is associated with seizures, encephalitis, and graft rejection in transplant patients. Sporadic reactivation of the integrated virus ensures continued evolution of the virus as it spreads to a new cadre of susceptible individuals. There are critical gaps in our knowledge regarding the fate of herpesvirus genomes during integration and reactivation as well as of viral and cellular factors involved in these processes.
INTEGHER will make use of novel technologies to close these gaps and to devise new therapeutic approaches. Specifically, we will 1) determine the fate of the HHV-6 genome during latency by developing a novel reporter system that allows live-cell imaging of the virus genome in living cells and elucidate epigenetic changes of the HHV-6 genome during integration and reactivation; 2) identify viral and cellular factors that drive virus genome integration and reactivation, using recombinant viruses, drugs and CRISPR/Cas9 genome engineering 3) employ genome-editing tools to eliminate the virus genome integrated in host chromosomes in vitro and in an in vivo model. The proposal utilizes state-of-the-art technologies and pioneers new approaches, particularly with regard to visualization and excision of virus genomes in latently infected cells that are also present in (bone marrow) transplants. Altogether, these studies will define the mechanism of herpesvirus integration and reactivation and will provide new tools for therapeutic excision of virus genomes from living cells.
Max ERC Funding
1 810 747 €
Duration
Start date: 2016-04-01, End date: 2022-03-31
Project acronym nextDART
Project Next-generation Detection of Antigen Responsive T-cells
Researcher (PI) Sine Reker Hadrup
Host Institution (HI) DANMARKS TEKNISKE UNIVERSITET
Country Denmark
Call Details Starting Grant (StG), LS6, ERC-2015-STG
Summary Our current ability to map T-cell reactivity to certain molecular patterns poorly matches the huge diversity of T-cell recognition in humans. Our immune system holds approximately 107 different T-cell populations patrolling our body to fight intruding pathogens. Current state-of-the-art T-cell detection enables the detection of 45 different T-cell specificities in a given sample. Therefore comprehensive analysis of T-cell recognition against intruding pathogens, auto-immune attacked tissues or cancer is virtually impossible.
To gain insight into immune recognition and allow careful target selection for disease intervention, also on a personalized basis, we need technologies that allow detection of vast numbers of different T-cell specificities with high sensitivity in small biological samples.
I propose here a new technology based on multimerised peptide-major histocompatibility complex I (MHC I) reagents that allow detection of >1000 different T-cell specificities with high sensitivity in small biological samples. I will use this new technology to gain insight into the T-cell recognition of cancer cells and specifically assess the impact of mutation-derived neo-epitopes on T cell-mediated cancer cell recognition.
A major advantage of this new technology relates to the ability of coupling the antigen specificity to the T-cell receptor sequence. This will enable us to retrieve information about T-cell receptor sequences coupled with their molecular recognition pattern, and develop a predictor of binding between T-cell receptors and specific epitopes. It will ultimately enable us to predict immune recognition based on T-cell receptor sequences, and has the potential to truly transform our understanding of T cell immunology.
Advances in our understanding of T cell immunology are leading to massive advances in the treatment of cancer. The technologies I propose to develop and validate will greatly aid this process and have application for all immune related diseases.
Summary
Our current ability to map T-cell reactivity to certain molecular patterns poorly matches the huge diversity of T-cell recognition in humans. Our immune system holds approximately 107 different T-cell populations patrolling our body to fight intruding pathogens. Current state-of-the-art T-cell detection enables the detection of 45 different T-cell specificities in a given sample. Therefore comprehensive analysis of T-cell recognition against intruding pathogens, auto-immune attacked tissues or cancer is virtually impossible.
To gain insight into immune recognition and allow careful target selection for disease intervention, also on a personalized basis, we need technologies that allow detection of vast numbers of different T-cell specificities with high sensitivity in small biological samples.
I propose here a new technology based on multimerised peptide-major histocompatibility complex I (MHC I) reagents that allow detection of >1000 different T-cell specificities with high sensitivity in small biological samples. I will use this new technology to gain insight into the T-cell recognition of cancer cells and specifically assess the impact of mutation-derived neo-epitopes on T cell-mediated cancer cell recognition.
A major advantage of this new technology relates to the ability of coupling the antigen specificity to the T-cell receptor sequence. This will enable us to retrieve information about T-cell receptor sequences coupled with their molecular recognition pattern, and develop a predictor of binding between T-cell receptors and specific epitopes. It will ultimately enable us to predict immune recognition based on T-cell receptor sequences, and has the potential to truly transform our understanding of T cell immunology.
Advances in our understanding of T cell immunology are leading to massive advances in the treatment of cancer. The technologies I propose to develop and validate will greatly aid this process and have application for all immune related diseases.
Max ERC Funding
1 499 070 €
Duration
Start date: 2016-06-01, End date: 2021-05-31
Project acronym RadFeedback
Project The radiative interstellar medium
Researcher (PI) Stefanie Walch-Gassner
Host Institution (HI) UNIVERSITAET ZU KOELN
Country Germany
Call Details Starting Grant (StG), PE9, ERC-2015-STG
Summary The pressure, radiation, and ionization from the warm (UV emitting) and hot (X-ray emitting) gas has a significant impact on the cold, star-forming interstellar medium. We propose to carry out a comprehensive 3D study of the turbulent, multi-phase ISM in different environments that includes, for the first time, a proper treatment of UV and X-ray emission from stellar (primary) sources and extended (secondary) sources like cooling shock fronts and evaporating clouds. We do this by means of massively parallel, high-resolution 3D simulations that capture the complex interplay of gravity, magnetic fields, feedback from massive stars (ionizing radiation, radiation pressure, stellar winds, supernovae), heating and cooling including X-rays and cosmic rays, and chemistry. We are developing a novel, original and highly efficient method to accurately treat the transfer of radiation from multiple point and extended sources in the 3D simulations. Radiation and chemistry will be coupled to achieve self-consistent heating, cooling, and ionization rates. Moreover, accurate synthetic observations covering the large dynamic range from X-rays down to radio emission will be generated to set the results in the proper observational context. This will enable us to address the key science questions: How efficient is stellar feedback in different environments and which feedback process is dominant? What is the precise role of UV radiation and X-rays, also from secondary sources? Are the observations following the key dynamical players? How do we best interpret ISM observations from ALMA, SKA, or ATHENA? How do we assist in designing future observations? With the resources requested here we will perform the most self-consistent theoretical study of the multi-phase ISM so far, thus building up a leading group for ISM research in Europe. To stimulate worldwide scientific activities and interactions we will make all data available to the community through an open-access web interface.
Summary
The pressure, radiation, and ionization from the warm (UV emitting) and hot (X-ray emitting) gas has a significant impact on the cold, star-forming interstellar medium. We propose to carry out a comprehensive 3D study of the turbulent, multi-phase ISM in different environments that includes, for the first time, a proper treatment of UV and X-ray emission from stellar (primary) sources and extended (secondary) sources like cooling shock fronts and evaporating clouds. We do this by means of massively parallel, high-resolution 3D simulations that capture the complex interplay of gravity, magnetic fields, feedback from massive stars (ionizing radiation, radiation pressure, stellar winds, supernovae), heating and cooling including X-rays and cosmic rays, and chemistry. We are developing a novel, original and highly efficient method to accurately treat the transfer of radiation from multiple point and extended sources in the 3D simulations. Radiation and chemistry will be coupled to achieve self-consistent heating, cooling, and ionization rates. Moreover, accurate synthetic observations covering the large dynamic range from X-rays down to radio emission will be generated to set the results in the proper observational context. This will enable us to address the key science questions: How efficient is stellar feedback in different environments and which feedback process is dominant? What is the precise role of UV radiation and X-rays, also from secondary sources? Are the observations following the key dynamical players? How do we best interpret ISM observations from ALMA, SKA, or ATHENA? How do we assist in designing future observations? With the resources requested here we will perform the most self-consistent theoretical study of the multi-phase ISM so far, thus building up a leading group for ISM research in Europe. To stimulate worldwide scientific activities and interactions we will make all data available to the community through an open-access web interface.
Max ERC Funding
1 488 048 €
Duration
Start date: 2016-09-01, End date: 2021-08-31
Project acronym ResolutioNet
Project Resolving the Tussle in the Internet: Mapping, Architecture, and Policy Making
Researcher (PI) Georgios Smaragdakis
Host Institution (HI) TECHNISCHE UNIVERSITAT BERLIN
Country Germany
Call Details Starting Grant (StG), PE7, ERC-2015-STG
Summary The Internet has revolutionalized the way people and corporations communicate, publish, access, and search for information. As our globally-connected digital civilization increasingly relies on its smooth operation any disruption has a direct negative impact on both the economy and society. However, the Internet was not designed to serve its current role nor was foreseen to be a public good. On the contrary, it was designed to be fully decentralized and thus administrated by the owners of independent networks. Today, the various Internet players have diverse and often conflicting objectives. Indeed, the tussle between Internet players or between them and governments hit the news and the negative externalities affect the life of potentially billions of Internet users worldwide and harm innovation in the Internet.
We propose a research agenda to resolve the tussle in the Internet. First, we propose the use of sophisticated techniques to collect and analyze massive network data to unveil the complex interactions among the various Internet players that lead to disputes and to identify the conditions under which conditions a resolution is possible. Second, we utilize additional degrees of freedom to resolve the tussle in the Internet by enabling coordination of the various Internet players. To this end, we introduce expressiveness of all the involved parties in existing and emerging protocols and enable agile deployment of third-party services and applications inside operational networks. Third, we contribute to the Internet policy making debate by providing an unbiased view of the state and health of the Internet as well as providing recommendations on how to resolve the Internet tussle. This is an interdisciplinary effort to foster a dialogue for Internet's future and sustainability in light of its ever-increasing growth and competitiveness.
Summary
The Internet has revolutionalized the way people and corporations communicate, publish, access, and search for information. As our globally-connected digital civilization increasingly relies on its smooth operation any disruption has a direct negative impact on both the economy and society. However, the Internet was not designed to serve its current role nor was foreseen to be a public good. On the contrary, it was designed to be fully decentralized and thus administrated by the owners of independent networks. Today, the various Internet players have diverse and often conflicting objectives. Indeed, the tussle between Internet players or between them and governments hit the news and the negative externalities affect the life of potentially billions of Internet users worldwide and harm innovation in the Internet.
We propose a research agenda to resolve the tussle in the Internet. First, we propose the use of sophisticated techniques to collect and analyze massive network data to unveil the complex interactions among the various Internet players that lead to disputes and to identify the conditions under which conditions a resolution is possible. Second, we utilize additional degrees of freedom to resolve the tussle in the Internet by enabling coordination of the various Internet players. To this end, we introduce expressiveness of all the involved parties in existing and emerging protocols and enable agile deployment of third-party services and applications inside operational networks. Third, we contribute to the Internet policy making debate by providing an unbiased view of the state and health of the Internet as well as providing recommendations on how to resolve the Internet tussle. This is an interdisciplinary effort to foster a dialogue for Internet's future and sustainability in light of its ever-increasing growth and competitiveness.
Max ERC Funding
1 499 875 €
Duration
Start date: 2017-02-01, End date: 2022-01-31
Project acronym USECFrontiers
Project Frontiers of Usable Security – Principles and Methods for Administrator and Developer Usable Security Research
Researcher (PI) Matthew Smith
Host Institution (HI) RHEINISCHE FRIEDRICH-WILHELMS-UNIVERSITAT BONN
Country Germany
Call Details Starting Grant (StG), PE6, ERC-2015-STG
Summary Usability problems are a major cause of many of today’s IT-security incidents. Security systems are often too complicated, time-consuming, and error prone. For more than a decade researchers in the domain of usable security (USEC) have attempted to combat these problems by conducting interdisciplinary research focusing on the root causes of the problems and on the creation of usable security mechanisms. While major improvements have been made, to date USEC research has focused almost entirely on the non-expert end-user. However, many of the most catastrophic security incidents were not caused by end-users, but by developers or administrators. Heartbleed and Shellshock were both caused by single developers yet had global consequences. The recent Sony hack compromised an entire multi-national IT-infrastructure and misappropriated over 100 TB of data, unnoticed. Fundamentally, every software vulnerability and misconfigured system is caused by developers or administrators making mistakes, but very little research has been done into the underlying causalities and possible mitigation strategies.
I aim to extend the frontiers of usable security by conducting foundational research into USEC methods for developers and administrators. To this end I will research and systemize the hitherto unexamined human factors in a carefully selected set of problems currently faced by developers and administrators, specifically: authentication, secure messaging, systems configuration, intrusion detection, and public key infrastructures. From this pioneering research I will extract and develop principles, methods, and best practices for conducting usability studies and research with these actors and establish a foundation for this emerging research field. In addition to these foundational methodological results, I expect to make fundamental advancements in the above application research domains by including the human factors in these currently purely technical research areas.
Summary
Usability problems are a major cause of many of today’s IT-security incidents. Security systems are often too complicated, time-consuming, and error prone. For more than a decade researchers in the domain of usable security (USEC) have attempted to combat these problems by conducting interdisciplinary research focusing on the root causes of the problems and on the creation of usable security mechanisms. While major improvements have been made, to date USEC research has focused almost entirely on the non-expert end-user. However, many of the most catastrophic security incidents were not caused by end-users, but by developers or administrators. Heartbleed and Shellshock were both caused by single developers yet had global consequences. The recent Sony hack compromised an entire multi-national IT-infrastructure and misappropriated over 100 TB of data, unnoticed. Fundamentally, every software vulnerability and misconfigured system is caused by developers or administrators making mistakes, but very little research has been done into the underlying causalities and possible mitigation strategies.
I aim to extend the frontiers of usable security by conducting foundational research into USEC methods for developers and administrators. To this end I will research and systemize the hitherto unexamined human factors in a carefully selected set of problems currently faced by developers and administrators, specifically: authentication, secure messaging, systems configuration, intrusion detection, and public key infrastructures. From this pioneering research I will extract and develop principles, methods, and best practices for conducting usability studies and research with these actors and establish a foundation for this emerging research field. In addition to these foundational methodological results, I expect to make fundamental advancements in the above application research domains by including the human factors in these currently purely technical research areas.
Max ERC Funding
1 498 976 €
Duration
Start date: 2016-08-01, End date: 2022-01-31
