AI for Imaging

AI4Imaging aims at enhancing the whole data acquisition and data processing chain for energy-efficient, ultra-fast spatio-temporal tomographic brain imaging and analysis at different scales. New concepts and future research will be focussed on artificial & bio-inspired neural networks and their combination with other methods. Algorithms for sensor-near detection (edge computing), image acquisition (correction methods), and image processing (brain parcellation) can be an enabler for new kinds of personalized tomographic investigations in the living brain (e.g., in-vivo connectivity estimations, structure-function relationships on different scales, inter-individual variability & pathologies) with future high-performance medical detector systems (e.g., TOF-PET, fPET, dPEI, MRI, multimodal).

Contact

Dr.-Ing. Gudrun Wagenknecht

Senior Scientist Neuromorphic Computing - Principal Investigator

  • pgi
  • pgi-4
Building 02.5 /
Room 119
+49 2461/61-3184
E-Mail

AI4Imaging for Spatio-Temporal Brain Imaging and Analysis at Different Scales

Energy-efficient, ultra-fast tomographic imaging (e.g., TOF-PET, fPET, dPEI, MRI, multimodal [1-3]) is a perfect application field for AI and NC research since these new computing paradigms can enhance the whole data acquisition and data processing chain [4-9]. Brain imaging at different scales based on artificial & bio-inspired neural networks (e.g., transformers, GNNs, GANs, U-Nets, physics-inspired NNs, bio-inspired SNNs in CIM hardware) can build a very fruitful combination with emerging ultra-fast detector technologies. A first workshop, PETtech23, was organized, where experts from worldwide exchanged the latest advances on detector electronics and AI for data analysis.

New ultra-fast and energy-efficient algorithms for sensor-near detection (edge computing), image acquisition (correction methods), and image processing (brain parcellation) can be an enabler for new kinds of personalized tomographic investigations in the living brain (e.g., personalized in-vivo connectivity estimations, structure-function relationships on different scales, interindividual variability & pathologies) with these future high-performance medical detector systems providing big spatio-temporal (multi-modality) data. An absolut cruicial application would be direct PEI (dPEI), which means 3D PET imaging without image reconstruction. Neuromorphic computing can pave the way to the required 10ps coincidence timing resolution and enable thereby e.g. ultra-fast dynamic fPET measurements and data analysis for personalized in-vivo connectivity estimations.

First experiences with neural network simulation models in neuroscience research were gained within the project “Advanced Computing Architectures” (ACA, 2018-2022). Our objective was to analyze representative models comprising a variety of spatial scales and connectivity structures, neuron and synapse models with and without plasticity dynamics, and to derive requirements for future NC architectures enabling accelerated simulation of ultra-large-scale biological NN models with natural-density, heterogeneous, and plastic connectivity developed in neuroscience research. A comprehensive requirement database for the different network models and their components (structural and functional features and their classification, typical parameterization values and ranges) were developed with regard to relevant properties for future hard- und software designs (e.g., system models, intra- and inter-chip communication concepts).

New concepts and future research will be focussed on artificial & bio-inspired neural networks and combined methods (e.g., graphs, a-priori knowledge,…) for energy-efficient spatio-temporal tomographic image acquisition and processing, and analysis of personalized in-vivo structure-function relationships (e.g., parcellation & functional connectivity, hierarchies, inter-individual variability, plasticity).

References

Meet the Team

David ArutinovResearcherBuilding 02.5 / Room E1+49 2461/61-9408
Dr. Ilja BekmanResearcherBuilding 02.5 / Room 211+49 2461/61-6603
Christian GrewingScientific CoordinatorBuilding 02.5 / Room R 132+49 2461/61-96430
Dr.-Ing. Markus RobensResearcherBuilding 02.5 / Room 217+49 2461/61-3023
Dr.-Ing. Gudrun WagenknechtSenior Scientist Neuromorphic Computing - Principal InvestigatorBuilding 02.5 / Room 119+49 2461/61-3184

Last Modified: 12.03.2025