Project acronym 3D Reloaded
Project 3D Reloaded: Novel Algorithms for 3D Shape Inference and Analysis
Researcher (PI) Daniel Cremers
Host Institution (HI) TECHNISCHE UNIVERSITAET MUENCHEN
Country Germany
Call Details Consolidator Grant (CoG), PE6, ERC-2014-CoG
Summary Despite their amazing success, we believe that computer vision algorithms have only scratched the surface of what can be done in terms of modeling and understanding our world from images. We believe that novel image analysis techniques will be a major enabler and driving force behind next-generation technologies, enhancing everyday life and opening up radically new possibilities. And we believe that the key to achieving this is to develop algorithms for reconstructing and analyzing the 3D structure of our world.
In this project, we will focus on three lines of research:
A) We will develop algorithms for 3D reconstruction from standard color cameras and from RGB-D cameras. In particular, we will promote real-time-capable direct and dense methods. In contrast to the classical two-stage approach of sparse feature-point based motion estimation and subsequent dense reconstruction, these methods optimally exploit all color information to jointly estimate dense geometry and camera motion.
B) We will develop algorithms for 3D shape analysis, including rigid and non-rigid matching, decomposition and interpretation of 3D shapes. We will focus on algorithms which are optimal or near-optimal. One of the major computational challenges lies in generalizing existing 2D shape analysis techniques to shapes in 3D and 4D (temporal evolutions of 3D shape).
C) We will develop shape priors for 3D reconstruction. These can be learned from sample shapes or acquired during the reconstruction process. For example, when reconstructing a larger office algorithms may exploit the geometric self-similarity of the scene, storing a model of a chair and its multiple instances only once rather than multiple times.
Advancing the state of the art in geometric reconstruction and geometric analysis will have a profound impact well beyond computer vision. We strongly believe that we have the necessary competence to pursue this project. Preliminary results have been well received by the community.
Summary
Despite their amazing success, we believe that computer vision algorithms have only scratched the surface of what can be done in terms of modeling and understanding our world from images. We believe that novel image analysis techniques will be a major enabler and driving force behind next-generation technologies, enhancing everyday life and opening up radically new possibilities. And we believe that the key to achieving this is to develop algorithms for reconstructing and analyzing the 3D structure of our world.
In this project, we will focus on three lines of research:
A) We will develop algorithms for 3D reconstruction from standard color cameras and from RGB-D cameras. In particular, we will promote real-time-capable direct and dense methods. In contrast to the classical two-stage approach of sparse feature-point based motion estimation and subsequent dense reconstruction, these methods optimally exploit all color information to jointly estimate dense geometry and camera motion.
B) We will develop algorithms for 3D shape analysis, including rigid and non-rigid matching, decomposition and interpretation of 3D shapes. We will focus on algorithms which are optimal or near-optimal. One of the major computational challenges lies in generalizing existing 2D shape analysis techniques to shapes in 3D and 4D (temporal evolutions of 3D shape).
C) We will develop shape priors for 3D reconstruction. These can be learned from sample shapes or acquired during the reconstruction process. For example, when reconstructing a larger office algorithms may exploit the geometric self-similarity of the scene, storing a model of a chair and its multiple instances only once rather than multiple times.
Advancing the state of the art in geometric reconstruction and geometric analysis will have a profound impact well beyond computer vision. We strongly believe that we have the necessary competence to pursue this project. Preliminary results have been well received by the community.
Max ERC Funding
2 000 000 €
Duration
Start date: 2015-09-01, End date: 2020-08-31
Project acronym 3D-FIREFLUC
Project Taming the particle transport in magnetized plasmas via perturbative fields
Researcher (PI) Eleonora VIEZZER
Host Institution (HI) UNIVERSIDAD DE SEVILLA
Country Spain
Call Details Starting Grant (StG), PE2, ERC-2018-STG
Summary Wave-particle interactions are ubiquitous in nature and play a fundamental role in astrophysical and fusion plasmas. In solar plasmas, magnetohydrodynamic (MHD) fluctuations are thought to be responsible for the heating of the solar corona and the generation of the solar wind. In magnetically confined fusion (MCF) devices, enhanced particle transport induced by MHD fluctuations can deteriorate the plasma confinement, and also endanger the device integrity. MCF devices are an ideal testbed to verify current models and develop mitigation / protection techniques.
The proposed project paves the way for providing active control techniques to tame the MHD induced particle transport in a fusion plasma. A solid understanding of the interaction between energetic particles and MHD instabilities in the presence of electric fields and plasma currents is required to develop such techniques. I will pursue this goal through innovative diagnosis techniques with unprecedented spatio-temporal resolution. Combined with state-of-the-art hybrid MHD codes, a deep insight into the underlying physics mechanism will be gained. The outcome of this research project will have a major impact for next-step MCF devices as I will provide ground-breaking control techniques for mitigating MHD induced particle transport in magnetized plasmas.
The project consists of 3 research lines which follow a bottom-up approach:
(1) Cutting-edge instrumentation, aiming at the new generation of energetic particle and edge current diagnostics.
(2) Unravel the dynamics of energetic particles, electric fields, edge currents and MHD fluctuations.
(3) From lab to space weather: The developed models will revolutionize our understanding of the observed particle acceleration and transport in the solar corona.
Based on this approach, the project represents a gateway between the fusion, astrophysics and space communities opening new avenues for a common basic understanding.
Summary
Wave-particle interactions are ubiquitous in nature and play a fundamental role in astrophysical and fusion plasmas. In solar plasmas, magnetohydrodynamic (MHD) fluctuations are thought to be responsible for the heating of the solar corona and the generation of the solar wind. In magnetically confined fusion (MCF) devices, enhanced particle transport induced by MHD fluctuations can deteriorate the plasma confinement, and also endanger the device integrity. MCF devices are an ideal testbed to verify current models and develop mitigation / protection techniques.
The proposed project paves the way for providing active control techniques to tame the MHD induced particle transport in a fusion plasma. A solid understanding of the interaction between energetic particles and MHD instabilities in the presence of electric fields and plasma currents is required to develop such techniques. I will pursue this goal through innovative diagnosis techniques with unprecedented spatio-temporal resolution. Combined with state-of-the-art hybrid MHD codes, a deep insight into the underlying physics mechanism will be gained. The outcome of this research project will have a major impact for next-step MCF devices as I will provide ground-breaking control techniques for mitigating MHD induced particle transport in magnetized plasmas.
The project consists of 3 research lines which follow a bottom-up approach:
(1) Cutting-edge instrumentation, aiming at the new generation of energetic particle and edge current diagnostics.
(2) Unravel the dynamics of energetic particles, electric fields, edge currents and MHD fluctuations.
(3) From lab to space weather: The developed models will revolutionize our understanding of the observed particle acceleration and transport in the solar corona.
Based on this approach, the project represents a gateway between the fusion, astrophysics and space communities opening new avenues for a common basic understanding.
Max ERC Funding
1 512 250 €
Duration
Start date: 2019-05-01, End date: 2024-04-30
Project acronym 3D-QUEST
Project 3D-Quantum Integrated Optical Simulation
Researcher (PI) Fabio Sciarrino
Host Institution (HI) UNIVERSITA DEGLI STUDI DI ROMA LA SAPIENZA
Country Italy
Call Details Starting Grant (StG), PE2, ERC-2012-StG_20111012
Summary "Quantum information was born from the merging of classical information and quantum physics. Its main objective consists of understanding the quantum nature of information and learning how to process it by using physical systems which operate by following quantum mechanics laws. Quantum simulation is a fundamental instrument to investigate phenomena of quantum systems dynamics, such as quantum transport, particle localizations and energy transfer, quantum-to-classical transition, and even quantum improved computation, all tasks that are hard to simulate with classical approaches. Within this framework integrated photonic circuits have a strong potential to realize quantum information processing by optical systems.
The aim of 3D-QUEST is to develop and implement quantum simulation by exploiting 3-dimensional integrated photonic circuits. 3D-QUEST is structured to demonstrate the potential of linear optics to implement a computational power beyond the one of a classical computer. Such ""hard-to-simulate"" scenario is disclosed when multiphoton-multimode platforms are realized. The 3D-QUEST research program will focus on three tasks of growing difficulty.
A-1. To simulate bosonic-fermionic dynamics with integrated optical systems acting on 2 photon entangled states.
A-2. To pave the way towards hard-to-simulate, scalable quantum linear optical circuits by investigating m-port interferometers acting on n-photon states with n>2.
A-3. To exploit 3-dimensional integrated structures for the observation of new quantum optical phenomena and for the quantum simulation of more complex scenarios.
3D-QUEST will exploit the potential of the femtosecond laser writing integrated waveguides. This technique will be adopted to realize 3-dimensional capabilities and high flexibility, bringing in this way the optical quantum simulation in to new regime."
Summary
"Quantum information was born from the merging of classical information and quantum physics. Its main objective consists of understanding the quantum nature of information and learning how to process it by using physical systems which operate by following quantum mechanics laws. Quantum simulation is a fundamental instrument to investigate phenomena of quantum systems dynamics, such as quantum transport, particle localizations and energy transfer, quantum-to-classical transition, and even quantum improved computation, all tasks that are hard to simulate with classical approaches. Within this framework integrated photonic circuits have a strong potential to realize quantum information processing by optical systems.
The aim of 3D-QUEST is to develop and implement quantum simulation by exploiting 3-dimensional integrated photonic circuits. 3D-QUEST is structured to demonstrate the potential of linear optics to implement a computational power beyond the one of a classical computer. Such ""hard-to-simulate"" scenario is disclosed when multiphoton-multimode platforms are realized. The 3D-QUEST research program will focus on three tasks of growing difficulty.
A-1. To simulate bosonic-fermionic dynamics with integrated optical systems acting on 2 photon entangled states.
A-2. To pave the way towards hard-to-simulate, scalable quantum linear optical circuits by investigating m-port interferometers acting on n-photon states with n>2.
A-3. To exploit 3-dimensional integrated structures for the observation of new quantum optical phenomena and for the quantum simulation of more complex scenarios.
3D-QUEST will exploit the potential of the femtosecond laser writing integrated waveguides. This technique will be adopted to realize 3-dimensional capabilities and high flexibility, bringing in this way the optical quantum simulation in to new regime."
Max ERC Funding
1 474 800 €
Duration
Start date: 2012-08-01, End date: 2017-07-31
Project acronym 3DPBio
Project Computational Models of Motion for Fabrication-aware Design of Bioinspired Systems
Researcher (PI) Stelian Coros
Host Institution (HI) EIDGENOESSISCHE TECHNISCHE HOCHSCHULE ZUERICH
Country Switzerland
Call Details Consolidator Grant (CoG), PE6, ERC-2019-COG
Summary "Bridging the fields of Computer Animation and Computational Fabrication, this proposal will establish the foundations for algorithmic design of physical structures that can generate lifelike movements. Driven by embedded actuators, these types of structures will enable an abundance of possibilities for a wide array of real-world technologies: animatronic characters whose organic motions will enhance their ability to awe, entertain and educate; soft robotic creatures that are both skilled and safe to be around; patient-specific prosthetics and wearable devices that match the soft touch of the human body, etc. Recent advances in additive manufacturing (AM) technologies are particularly exciting in this context, as they allow us to create designs of unparalleled geometric complexity using a constantly expanding range of materials. And if past developments are an indication, within the next decade we will be able to fabricate physical structures that approach, at least at the macro scale, the functional sophistication of their biological counterparts. However, while this unprecedented capability enables fascinating opportunities, it also leads to an explosion in the dimensionality of the space that must be explored during the design process. As AM technologies keep evolving, the gap between ""what we can produce"" and ""what we can design"" is therefore rapidly growing.
To effectively leverage the extraordinary design possibilities enabled by AM, 3DPBio will develop the computational and mathematical foundations required to study a fundamental scientific question: how are physical deformations, mechanical movements and overall functional capabilities governed by geometric shape features, material compositions and the design of compliant actuation systems? By enabling computers to reason about this question, our work will establish new ways to algorithmically create digital designs that can be turned into mechanical lifeforms at the push of a button."
Summary
"Bridging the fields of Computer Animation and Computational Fabrication, this proposal will establish the foundations for algorithmic design of physical structures that can generate lifelike movements. Driven by embedded actuators, these types of structures will enable an abundance of possibilities for a wide array of real-world technologies: animatronic characters whose organic motions will enhance their ability to awe, entertain and educate; soft robotic creatures that are both skilled and safe to be around; patient-specific prosthetics and wearable devices that match the soft touch of the human body, etc. Recent advances in additive manufacturing (AM) technologies are particularly exciting in this context, as they allow us to create designs of unparalleled geometric complexity using a constantly expanding range of materials. And if past developments are an indication, within the next decade we will be able to fabricate physical structures that approach, at least at the macro scale, the functional sophistication of their biological counterparts. However, while this unprecedented capability enables fascinating opportunities, it also leads to an explosion in the dimensionality of the space that must be explored during the design process. As AM technologies keep evolving, the gap between ""what we can produce"" and ""what we can design"" is therefore rapidly growing.
To effectively leverage the extraordinary design possibilities enabled by AM, 3DPBio will develop the computational and mathematical foundations required to study a fundamental scientific question: how are physical deformations, mechanical movements and overall functional capabilities governed by geometric shape features, material compositions and the design of compliant actuation systems? By enabling computers to reason about this question, our work will establish new ways to algorithmically create digital designs that can be turned into mechanical lifeforms at the push of a button."
Max ERC Funding
2 000 000 €
Duration
Start date: 2020-02-01, End date: 2025-01-31
Project acronym 3DSPIN
Project 3-Dimensional Maps of the Spinning Nucleon
Researcher (PI) Alessandro Bacchetta
Host Institution (HI) UNIVERSITA DEGLI STUDI DI PAVIA
Country Italy
Call Details Consolidator Grant (CoG), PE2, ERC-2014-CoG
Summary How does the inside of the proton look like? What generates its spin?
3DSPIN will deliver essential information to answer these questions at the frontier of subnuclear physics.
At present, we have detailed maps of the distribution of quarks and gluons in the nucleon in 1D (as a function of their momentum in a single direction). We also know that quark spins account for only about 1/3 of the spin of the nucleon.
3DSPIN will lead the way into a new stage of nucleon mapping, explore the distribution of quarks in full 3D momentum space and obtain unprecedented information on orbital angular momentum.
Goals
1. extract from experimental data the 3D distribution of quarks (in momentum space), as described by Transverse-Momentum Distributions (TMDs);
2. obtain from TMDs information on quark Orbital Angular Momentum (OAM).
Methodology
3DSPIN will implement state-of-the-art fitting procedures to analyze relevant experimental data and extract quark TMDs, similarly to global fits of standard parton distribution functions. Information about quark angular momentum will be obtained through assumptions based on theoretical considerations. The next five years represent an ideal time window to accomplish our goals, thanks to the wealth of expected data from deep-inelastic scattering experiments (COMPASS, Jefferson Lab), hadronic colliders (Fermilab, BNL, LHC), and electron-positron colliders (BELLE, BABAR). The PI has a strong reputation in this field. The group will operate in partnership with the Italian National Institute of Nuclear Physics and in close interaction with leading experts and experimental collaborations worldwide.
Impact
Mapping the 3D structure of chemical compounds has revolutionized chemistry. Similarly, mapping the 3D structure of the nucleon will have a deep impact on our understanding of the fundamental constituents of matter. We will open new perspectives on the dynamics of quarks and gluons and sharpen our view of high-energy processes involving nucleons.
Summary
How does the inside of the proton look like? What generates its spin?
3DSPIN will deliver essential information to answer these questions at the frontier of subnuclear physics.
At present, we have detailed maps of the distribution of quarks and gluons in the nucleon in 1D (as a function of their momentum in a single direction). We also know that quark spins account for only about 1/3 of the spin of the nucleon.
3DSPIN will lead the way into a new stage of nucleon mapping, explore the distribution of quarks in full 3D momentum space and obtain unprecedented information on orbital angular momentum.
Goals
1. extract from experimental data the 3D distribution of quarks (in momentum space), as described by Transverse-Momentum Distributions (TMDs);
2. obtain from TMDs information on quark Orbital Angular Momentum (OAM).
Methodology
3DSPIN will implement state-of-the-art fitting procedures to analyze relevant experimental data and extract quark TMDs, similarly to global fits of standard parton distribution functions. Information about quark angular momentum will be obtained through assumptions based on theoretical considerations. The next five years represent an ideal time window to accomplish our goals, thanks to the wealth of expected data from deep-inelastic scattering experiments (COMPASS, Jefferson Lab), hadronic colliders (Fermilab, BNL, LHC), and electron-positron colliders (BELLE, BABAR). The PI has a strong reputation in this field. The group will operate in partnership with the Italian National Institute of Nuclear Physics and in close interaction with leading experts and experimental collaborations worldwide.
Impact
Mapping the 3D structure of chemical compounds has revolutionized chemistry. Similarly, mapping the 3D structure of the nucleon will have a deep impact on our understanding of the fundamental constituents of matter. We will open new perspectives on the dynamics of quarks and gluons and sharpen our view of high-energy processes involving nucleons.
Max ERC Funding
1 509 000 €
Duration
Start date: 2015-07-01, End date: 2020-12-31
Project acronym 3FLEX
Project Three-Component Fermi Gas Lattice Experiment
Researcher (PI) Selim Jochim
Host Institution (HI) RUPRECHT-KARLS-UNIVERSITAET HEIDELBERG
Country Germany
Call Details Starting Grant (StG), PE2, ERC-2011-StG_20101014
Summary Understanding the many-body physics of strongly correlated systems has always been a major challenge for theoretical and experimental physics. The recent advances in the field of ultracold quantum gases have opened a completely new way to study such strongly correlated systems. It is now feasible to use ultracold gases as quantum simulators for such diverse systems such as the Hubbard model or the BCS-BEC crossover. The objective of this project is to study a three-component Fermi gas in an optical lattice, a system with rich many-body physics. With our experiments we aim to contribute to the understanding of exotic phases which are discussed in the context of QCD and condensed matter physics.
Summary
Understanding the many-body physics of strongly correlated systems has always been a major challenge for theoretical and experimental physics. The recent advances in the field of ultracold quantum gases have opened a completely new way to study such strongly correlated systems. It is now feasible to use ultracold gases as quantum simulators for such diverse systems such as the Hubbard model or the BCS-BEC crossover. The objective of this project is to study a three-component Fermi gas in an optical lattice, a system with rich many-body physics. With our experiments we aim to contribute to the understanding of exotic phases which are discussed in the context of QCD and condensed matter physics.
Max ERC Funding
1 469 040 €
Duration
Start date: 2011-08-01, End date: 2016-07-31
Project acronym 4D IMAGING
Project Towards 4D Imaging of Fundamental Processes on the Atomic and Sub-Atomic Scale
Researcher (PI) Ferenc Krausz
Host Institution (HI) LUDWIG-MAXIMILIANS-UNIVERSITAET MUENCHEN
Country Germany
Call Details Advanced Grant (AdG), PE2, ERC-2009-AdG
Summary State-of-the-art microscopy and diffraction imaging provides insight into the atomic and sub-atomic structure of matter. They permit determination of the positions of atoms in a crystal lattice or in a molecule as well as the distribution of electrons inside atoms. State-of-the-art time-resolved spectroscopy with femtosecond and attosecond resolution provides access to dynamic changes in the atomic and electronic structure of matter. Our proposal aims at combining these two frontier techniques of XXI century science to make a long-standing dream of scientist come true: the direct observation of atoms and electrons in their natural state: in motion. Shifts in the atoms positions by tens to hundreds of picometers can make chemical bonds break apart or newly form, changing the structure and/or chemical composition of matter. Electronic motion on similar scales may result in the emission of light, or the initiation of processes that lead to a change in physical or chemical properties, or biological function. These motions happen within femtoseconds and attoseconds, respectively. To make them observable, we need a 4-dimensional (4D) imaging technique capable of recording freeze-frame snapshots of microscopic systems with picometer spatial resolution and femtosecond to attosecond exposure time. The motion can then be visualized by slow-motion replay of the freeze-frame shots. The goal of this project is to develop a 4D imaging technique that will ultimately offer picometer resolution is space and attosecond resolution in time.
Summary
State-of-the-art microscopy and diffraction imaging provides insight into the atomic and sub-atomic structure of matter. They permit determination of the positions of atoms in a crystal lattice or in a molecule as well as the distribution of electrons inside atoms. State-of-the-art time-resolved spectroscopy with femtosecond and attosecond resolution provides access to dynamic changes in the atomic and electronic structure of matter. Our proposal aims at combining these two frontier techniques of XXI century science to make a long-standing dream of scientist come true: the direct observation of atoms and electrons in their natural state: in motion. Shifts in the atoms positions by tens to hundreds of picometers can make chemical bonds break apart or newly form, changing the structure and/or chemical composition of matter. Electronic motion on similar scales may result in the emission of light, or the initiation of processes that lead to a change in physical or chemical properties, or biological function. These motions happen within femtoseconds and attoseconds, respectively. To make them observable, we need a 4-dimensional (4D) imaging technique capable of recording freeze-frame snapshots of microscopic systems with picometer spatial resolution and femtosecond to attosecond exposure time. The motion can then be visualized by slow-motion replay of the freeze-frame shots. The goal of this project is to develop a 4D imaging technique that will ultimately offer picometer resolution is space and attosecond resolution in time.
Max ERC Funding
2 500 000 €
Duration
Start date: 2010-03-01, End date: 2015-02-28
Project acronym 4DPHOTON
Project Beyond Light Imaging: High-Rate Single-Photon Detection in Four Dimensions
Researcher (PI) Massimiliano FIORINI
Host Institution (HI) ISTITUTO NAZIONALE DI FISICA NUCLEARE
Country Italy
Call Details Consolidator Grant (CoG), PE2, ERC-2018-COG
Summary Goal of the 4DPHOTON project is the development and construction of a photon imaging detector with unprecedented performance. The proposed device will be capable of detecting fluxes of single-photons up to one billion photons per second, over areas of several square centimetres, and will measure - for each photon - position and time simultaneously with resolutions better than ten microns and few tens of picoseconds, respectively. These figures of merit will open many important applications allowing significant advances in particle physics, life sciences or other emerging fields where excellent timing and position resolutions are simultaneously required.
Our goal will be achieved thanks to the use of an application-specific integrated circuit in 65 nm complementary metal-oxide-semiconductor (CMOS) technology, that will deliver a timing resolution of few tens of picoseconds at the pixel level, over few hundred thousand individually-active pixel channels, allowing very high rates of photons to be detected, and the corresponding information digitized and transferred to a processing unit.
As a result of the 4DPHOTON project we will remove the constraints that many light imaging applications have due to the lack of precise single-photon information on four dimensions (4D): the three spatial coordinates and time simultaneously. In particular, we will prove the performance of this detector in the field of particle physics, performing the reconstruction of Cherenkov photon rings with a timing resolution of ten picoseconds. With its excellent granularity, timing resolution, rate capability and compactness, this detector will represent a new paradigm for the realisation of future Ring Imaging Cherenkov detectors, capable of achieving high efficiency particle identification in environments with very high particle multiplicities, exploiting time-association of the photon hits.
Summary
Goal of the 4DPHOTON project is the development and construction of a photon imaging detector with unprecedented performance. The proposed device will be capable of detecting fluxes of single-photons up to one billion photons per second, over areas of several square centimetres, and will measure - for each photon - position and time simultaneously with resolutions better than ten microns and few tens of picoseconds, respectively. These figures of merit will open many important applications allowing significant advances in particle physics, life sciences or other emerging fields where excellent timing and position resolutions are simultaneously required.
Our goal will be achieved thanks to the use of an application-specific integrated circuit in 65 nm complementary metal-oxide-semiconductor (CMOS) technology, that will deliver a timing resolution of few tens of picoseconds at the pixel level, over few hundred thousand individually-active pixel channels, allowing very high rates of photons to be detected, and the corresponding information digitized and transferred to a processing unit.
As a result of the 4DPHOTON project we will remove the constraints that many light imaging applications have due to the lack of precise single-photon information on four dimensions (4D): the three spatial coordinates and time simultaneously. In particular, we will prove the performance of this detector in the field of particle physics, performing the reconstruction of Cherenkov photon rings with a timing resolution of ten picoseconds. With its excellent granularity, timing resolution, rate capability and compactness, this detector will represent a new paradigm for the realisation of future Ring Imaging Cherenkov detectors, capable of achieving high efficiency particle identification in environments with very high particle multiplicities, exploiting time-association of the photon hits.
Max ERC Funding
1 975 000 €
Duration
Start date: 2019-12-01, End date: 2024-11-30
Project acronym 4DRepLy
Project Closing the 4D Real World Reconstruction Loop
Researcher (PI) Christian THEOBALT
Host Institution (HI) MAX-PLANCK-GESELLSCHAFT ZUR FORDERUNG DER WISSENSCHAFTEN EV
Country Germany
Call Details Consolidator Grant (CoG), PE6, ERC-2017-COG
Summary 4D reconstruction, the camera-based dense dynamic scene reconstruction, is a grand challenge in computer graphics and computer vision. Despite great progress, 4D capturing the complex, diverse real world outside a studio is still far from feasible. 4DRepLy builds a new generation of high-fidelity 4D reconstruction (4DRecon) methods. They will be the first to efficiently capture all types of deformable objects (humans and other types) in crowded real world scenes with a single color or depth camera. They capture space-time coherent deforming geometry, motion, high-frequency reflectance and illumination at unprecedented detail, and will be the first to handle difficult occlusions, topology changes and large groups of interacting objects. They automatically adapt to new scene types, yet deliver models with meaningful, interpretable parameters. This requires far reaching contributions: First, we develop groundbreaking new plasticity-enhanced model-based 4D reconstruction methods that automatically adapt to new scenes. Second, we develop radically new machine learning-based dense 4D reconstruction methods. Third, these model- and learning-based methods are combined in two revolutionary new classes of 4DRecon methods: 1) advanced fusion-based methods and 2) methods with deep architectural integration. Both, 1) and 2), are automatically designed in the 4D Real World Reconstruction Loop, a revolutionary new design paradigm in which 4DRecon methods refine and adapt themselves while continuously processing unlabeled real world input. This overcomes the previously unbreakable scalability barrier to real world scene diversity, complexity and generality. This paradigm shift opens up a new research direction in graphics and vision and has far reaching relevance across many scientific fields. It enables new applications of profound social pervasion and significant economic impact, e.g., for visual media and virtual/augmented reality, and for future autonomous and robotic systems.
Summary
4D reconstruction, the camera-based dense dynamic scene reconstruction, is a grand challenge in computer graphics and computer vision. Despite great progress, 4D capturing the complex, diverse real world outside a studio is still far from feasible. 4DRepLy builds a new generation of high-fidelity 4D reconstruction (4DRecon) methods. They will be the first to efficiently capture all types of deformable objects (humans and other types) in crowded real world scenes with a single color or depth camera. They capture space-time coherent deforming geometry, motion, high-frequency reflectance and illumination at unprecedented detail, and will be the first to handle difficult occlusions, topology changes and large groups of interacting objects. They automatically adapt to new scene types, yet deliver models with meaningful, interpretable parameters. This requires far reaching contributions: First, we develop groundbreaking new plasticity-enhanced model-based 4D reconstruction methods that automatically adapt to new scenes. Second, we develop radically new machine learning-based dense 4D reconstruction methods. Third, these model- and learning-based methods are combined in two revolutionary new classes of 4DRecon methods: 1) advanced fusion-based methods and 2) methods with deep architectural integration. Both, 1) and 2), are automatically designed in the 4D Real World Reconstruction Loop, a revolutionary new design paradigm in which 4DRecon methods refine and adapt themselves while continuously processing unlabeled real world input. This overcomes the previously unbreakable scalability barrier to real world scene diversity, complexity and generality. This paradigm shift opens up a new research direction in graphics and vision and has far reaching relevance across many scientific fields. It enables new applications of profound social pervasion and significant economic impact, e.g., for visual media and virtual/augmented reality, and for future autonomous and robotic systems.
Max ERC Funding
1 977 000 €
Duration
Start date: 2018-09-01, End date: 2023-08-31
Project acronym 4TH-NU-AVENUE
Project Search for a fourth neutrino with a PBq anti-neutrino source
Researcher (PI) Thierry Michel Rene Lasserre
Host Institution (HI) COMMISSARIAT A L ENERGIE ATOMIQUE ET AUX ENERGIES ALTERNATIVES
Country France
Call Details Starting Grant (StG), PE2, ERC-2012-StG_20111012
Summary Several observed anomalies in neutrino oscillation data can be explained by a hypothetical fourth neutrino separated from the three standard neutrinos by a squared mass difference of a few eV2. This hypothesis can be tested with a PBq (ten kilocurie scale) 144Ce antineutrino beta-source deployed at the center of a large low background liquid scintillator detector, such like Borexino, KamLAND, and SNO+. In particular, the compact size of such a source could yield an energy-dependent oscillating pattern in event spatial distribution that would unambiguously determine neutrino mass differences and mixing angles.
The proposed program aims to perform the necessary research and developments to produce and deploy an intense antineutrino source in a large liquid scintillator detector. Our program will address the definition of the production process of the neutrino source as well as its experimental characterization, the detailed physics simulation of both signal and backgrounds, the complete design and the realization of the thick shielding, the preparation of the interfaces with the antineutrino detector, including the safety and security aspects.
Summary
Several observed anomalies in neutrino oscillation data can be explained by a hypothetical fourth neutrino separated from the three standard neutrinos by a squared mass difference of a few eV2. This hypothesis can be tested with a PBq (ten kilocurie scale) 144Ce antineutrino beta-source deployed at the center of a large low background liquid scintillator detector, such like Borexino, KamLAND, and SNO+. In particular, the compact size of such a source could yield an energy-dependent oscillating pattern in event spatial distribution that would unambiguously determine neutrino mass differences and mixing angles.
The proposed program aims to perform the necessary research and developments to produce and deploy an intense antineutrino source in a large liquid scintillator detector. Our program will address the definition of the production process of the neutrino source as well as its experimental characterization, the detailed physics simulation of both signal and backgrounds, the complete design and the realization of the thick shielding, the preparation of the interfaces with the antineutrino detector, including the safety and security aspects.
Max ERC Funding
1 500 000 €
Duration
Start date: 2012-10-01, End date: 2018-09-30