These are the associated projects that are related to the research questions studied within our ONE MUNICH Forum Project “Next Generation Human-Centered Robotics”:
- AI.D – Artificial Intelligence for Neuro Deficits
- Interactive Learning of Explainable, Situation-Adapted Decision Models
- PerforM – Personalities for Machinery in Personal Pervasive Smart Spaces
- Remaining Useful Lifetime for New and Used Technical Systems under Non-Stationary Conditions
- The Curious Robot: An Unsupervised Human-in-the-Loop Action-Learning Approach
- 6G-life Digital Transformation and Sovereignty of Future Communication Network
AI.D – Artificial Intelligence for Neuro Deficits
Limb loss, spinal cord injury (SCI), stroke, neuromusculoskeletal disorders (NMD), multiple sclerosis (MS), and cerebral palsy (CP), whose combined prevalence is approximately 3.8%, are all conditions that affect individuals ability to use their limbs without assistance. Prostheses, exoskeletons, and robotic assistive systems are promising means for chronic patients to regain their autonomy. In this context, there is a strong need for designing systems that recognize human intent and mimic the intended behavior as close as possible to the natural limb, in order to maximize the therapeutic effect and patient benefit.
Associated ONE MUNICH PIs Prof. Dr.
Simon Jacob(TUM)
Prof. Dr.
Sami Haddadin(TUM)
Simon Jacob
Sami Haddadin
The project AI.D aims to restore lost function of neurologically and neuromuscularly impaired patients through a new generation of human-model-informed and learning-enabled neuro machines, designed and controlled according to the principles of human neuromechanics and motor control, using a Brain/Body-Machine Interface (BMI). The mission of this translational research project is to develop novel methods and technologies that substantially improve the state of the art and provide support to such patients in the following three central phases:
- Receiving assistance and mobilization care
- Regaining mobility and independence
- Reinclusion into society
In order to achieve this ambitious goal the strategic approach will be based on three pillars:
- Brain-Machine Interface: Human model-informed causal signal processing
- Human-informed AI: Intelligent control and learning algorithms
- Clinical studies: From technology to clinical validation
Based on our pioneering work in robotics, neural control, neuromechanics modeling and physics-informed machine learning, the innovative special feature of AI.D project is the development of a new generation of AI-enhanced human-model-informed neuro machines, designed and controlled according to the principles of the human body, to restore autonomy and mobility to the physically challenged – amputees, paralyzed, and stroke patients.
Interactive Learning of Explainable, Situation-Adapted Decision Models
The focus of this project investigates a novel approach through which the space of possible models explaining a certain decision can be explored interactively by a user until a model is found that satisfies the needs of the user in terms of the trade-off between accuracy and model complexity. The project defines and explores a refinement relation that defines a lattice as an explanation space from which explanations can be selected.
For more details, visit the project webpage.
Associated ONE MUNICH PIs Prof. Dr.
Eyke Hüllermeier(LMU)
Eyke Hüllermeier
Limitations of Deep Neural Networks
The success of Deep Learning in many different practical application fields, ranging from image classification, protein folding prediction to natural language processing, lead to the (ongoing) development of a rich mathematical theory. Although great strides have been made to deepen our understanding of the field, many questions remain open at the moment. One of the most important but also most fundamental issues concerns the capabilities and limitations of Deep Learning. Simply put, which problems can we reasonably expect Deep Learning to solve and where can we, with great certainty, predict failures of Deep Learning methods. An often neglected aspect of this discussion are the restrictions imposed by the hardware the systems are running on. Deep Learning methods can not exceed the fundamental barriers of its computation platforms. Because of this it is crucial to link the capabilities of Deep Learning to (actual or theoretical) computation devices. The aim of this project is to characterize the possibilities and boundaries of Deep Learning inflicted by computational limits.
Associated ONE MUNICH PIs Prof. Dr.
Gitta Kutyniok(LMU)Prof. Dr.
Holger Boche(TUM)
Gitta Kutyniok
Holger Boche
PerforM – Personalities for Machinery in Personal Pervasive Smart Spaces
Condition-based maintenance and predictive maintenance are increasingly applied in the industry due to their ability of ensuring an optimum utilization of the monitored system. These maintenance strategies allow for diagnosing and predicting the health states of the system under stationary operating conditions. However, technical systems mostly operate under non-stationary conditions, e.g. a wind turbine affected by different loads and speeds due to stochastic wind excitation. Non-stationary conditions lead to changed sensor data and thereby mask alterations caused by either faults or degradation of the system. Therefore, condition monitoring methods need to be extended and adapted for systems operating under non-stationary conditions.
Associated ONE MUNICH PIs Prof. Dr.
Andreas Butz(LMU)
Andreas Butz
The proposed project aims to develop methods for remaining useful lifetime prediction for systems operated under non-stationary conditions. Therefore, classical data-driven and model-based approaches from engineering are combined with approaches from the field of artificial intelligence. By a hybrid combination of clustering and classification with knowledge-based approaches, operating conditions are categorized and failure modes are identified. Based on uncertainty quantification and analyzed relationships between the operating conditions, the sensor data und the degradation evolution, suitable features for enabling the prediction of the remaining useful lifetime are developed and evaluated. Embedding non-stationary future operating conditions is realized by the use of different machine learning methods such as learning on data streams. These methods enable incremental learning and adaption to changes like variation of operating conditions. Moreover, hybrid methods are developed to allow a prediction of the remaining useful lifetime for used systems that are retrofitted with suitable sensors but lack sensor data of their past operation.For validation of the methods for remaining useful lifetime predictions, three application examples are chosen which have been selected from various thematic fields. To generate data for the first example, a suitable ball bearing test rig needs to be developed and constructed. The test rig should allow varying operating conditions regarding speed and bearing load. Run-to-failure data is acquired by different sensors such as acceleration sensors, temperature sensors, and strain gauges. For the second example, a laboratory experiment based on piezoelectric transducers is also implemented, whose failure is characterized by cracks and should be monitored. The third example is based on simulated data of a turbofan engine whose degradation under six conditions has been detected by various sensors.
For more details, visit the project webpage.
Remaining Useful Lifetime for New and Used Technical Systems under Non-Stationary Conditions
Condition-based maintenance and predictive maintenance are increasingly applied in the industry due to their ability of ensuring an optimum utilization of the monitored system. These maintenance strategies allow for diagnosing and predicting the health states of the system under stationary operating conditions. However, technical systems mostly operate under non-stationary conditions, e.g. a wind turbine affected by different loads and speeds due to stochastic wind excitation. Non-stationary conditions lead to changed sensor data and thereby mask alterations caused by either faults or degradation of the system. Therefore, condition monitoring methods need to be extended and adapted for systems operating under non-stationary conditions.
Associated ONE MUNICH PIs Prof. Dr.
Eyke Hüllermeier(LMU)
Eyke Hüllermeier
The proposed project aims to develop methods for remaining useful lifetime prediction for systems operated under non-stationary conditions. Therefore, classical data-driven and model-based approaches from engineering are combined with approaches from the field of artificial intelligence. By a hybrid combination of clustering and classification with knowledge-based approaches, operating conditions are categorized and failure modes are identified. Based on uncertainty quantification and analyzed relationships between the operating conditions, the sensor data und the degradation evolution, suitable features for enabling the prediction of the remaining useful lifetime are developed and evaluated. Embedding non-stationary future operating conditions is realized by the use of different machine learning methods such as learning on data streams. These methods enable incremental learning and adaption to changes like variation of operating conditions. Moreover, hybrid methods are developed to allow a prediction of the remaining useful lifetime for used systems that are retrofitted with suitable sensors but lack sensor data of their past operation.For validation of the methods for remaining useful lifetime predictions, three application examples are chosen which have been selected from various thematic fields. To generate data for the first example, a suitable ball bearing test rig needs to be developed and constructed. The test rig should allow varying operating conditions regarding speed and bearing load. Run-to-failure data is acquired by different sensors such as acceleration sensors, temperature sensors, and strain gauges. For the second example, a laboratory experiment based on piezoelectric transducers is also implemented, whose failure is characterized by cracks and should be monitored. The third example is based on simulated data of a turbofan engine whose degradation under six conditions has been detected by various sensors.
The Curious Robot: An Unsupervised Human-in-the-Loop Action-Learning Approach
Domestic robots can bring the next step in human-computer collaboration, envisioned to allow many shared tasks such as cooking and cleaning. However, understanding the many ways humans perform actions is an unsolved problem. We propose a curiosity-driven robot that will learn user behavior based on videos. We use human pose estimation in combination with dimensionality reduction to understand the pose space. Using unsupervised clustering, we will find new unknown actions. As soon as a new action cluster emerges, the robot will ask for a label for this cluster and, thus, extend the knowledge graph with this human-in-the-loop approach.
Associated ONE MUNICH PIs Prof. Dr.
Albrecht Schmidt(LMU)
Albrecht Schmidt
6G-life Digital Transformation and Sovereignty of Future Communication Network
Summary
TUM and the Technical University of Dresden have joined forces to form the 6G-life research hub to drive cutting-edge research for future 6G communication networks with a focus on human-machine collaboration. The merher of the teo universities of excellence combines their world leading preliminary work in the field of Tactile Internet in the Cluster of Excellence CeTI, 5G communication networks, quantum communication, Post-Shannon theory, artificial intelligence methods, and adaptive and flexible hardware and software platforms.
Associated ONE MUNICH PIs Prof. Dr.
Holger Boche(TUM)Prof. Dr.
Sandra Hirche(TUM)
Holger Boche
Sandra Hirche
Vision
6G-life will significantly stimulate industry and the startup landscape in Germany through positive showcase projects and thus sustainably strengthen digital sovereignty in Germany. Test fields for two use cases will drive research and economic stimulation. The goal is to create at least 10 new startups through 6G-life in the first four years and to involve at least 30 startups. 6G-life will significantly contribute to the creation of a skilled workforce. In addition, 6G-life has set itself the task of accompanying the population in the digital transformation and thus making a contribution to society.
For more details, visit the project webpage.