Research
I'm interested in medical image analysis, computer vision, 3D deep learning and generative models. My current research is part of the MIRACLE II project and focuses on conditional shape generation and manipulation tasks as well as (un)conditional 3D medical image generation. I'm particularly interested in different types of 3D data representations, including voxel grids, point clouds, meshes, triplanes, or neural implicit representations.
|
|
Deep Generative Models for 3D Medical Image Synthesis
Paul Friedrich, Yannik Frisch, Philippe C. Cattin
arXiv preprint, 2024
arXiv
A review of deep generative models (VAEs, GANs and DDMs) for 3D medical image synthesis. This book chapter covers fundamental principles, recent advaces, as well as strength and weaknesses of different deep generative models for 3D medical image synthesis and examines their application for relevant downstream tasks. The chapter also reviews commonly used evaluation metrics for assessing image fidelity, diversity, utility and privacy.
|
|
Modeling the Neonatal Brain Development Using Implicit Neural Representations
Florentin Bieder, Paul Friedrich, Hélène Corbaz, Alicia Durrer, Julia Wolleb, Philippe C. Cattin
PRIME@MICCAI, 2024
Project page / Code / arXiv / Paper
An implicit neural representation (INR), to predict 2D- and 3D MR images of neonatal brains at varying time points.
|
|
Denoising Diffusion Models for 3D Healthy Brain Tissue Inpainting
Alicia Durrer, Julia Wolleb, Florentin Bieder, Paul Friedrich, Lester Melie-Garcia, Mario Ocampo-Pineda, Cosmin I. Bercea, Ibrahim E. Hamamci, Benedikt Wiestler, Marie Piraud, Özgür Yaldizli, Christina Granziera, Bjoern H. Menze, Philippe C. Cattin, Florian Kofler
DGM4MICCAI, 2024
Code / arXiv / Paper
A review on different diffusion models for 3D healthy brain tissue inpainting.
|
|
Binary Noise for Binary Tasks: Masked Bernoulli Diffusion for Unsupervised Anomaly Detection
Julia Wolleb, Florentin Bieder, Paul Friedrich, Peter Zhang, Alicia Durrer, Philippe C. Cattin
MICCAI, 2024
Code / arXiv / Paper
A Bernoulli Diffusion Model operating on a binary latent representation of the data to effectively solve an unsupervised anomaly detection task.
|
|
WDM: 3D Wavelet Diffusion Models for High-Resolution Medical Image Synthesis
Paul Friedrich, Julia Wolleb, Florentin Bieder, Alicia Durrer, Philippe C. Cattin
DGM4MICCAI, 2024
Project page / Code / Models / arXiv / Paper / YouTube
WDM is a framework for high-resolution medical images synthesis. We propose a simple yet effective way of scaling 3D diffusion models to high resolutions (256 x 256 x 256 on a single 40 GB GPU) by applying Discrete Wavelet Transform for spatial dimensionality reduction.
|
|
MedShapeNet - A Large-Scale Dataset of 3D Medical Shapes for Computer Vision
Jianning Li, Zongwei Zhou, Jiancheng Yang, Antonio Pepe, Christina Gsaxner, Gijs Luijten, Chongyu Qu, Tiezheng Zhang, Xiaoxi Chen, Wenxuan Li, Marek Wodzinski, Paul Friedrich, Kangxian Xie, Yuan Jin, (122 more), Seyed-Ahmad Ahmadi, Ping Luo, Bjoern Menze, Mauricio Reyes, Thomas M. Deserno, Christos Davatzikos, Behrus Puladi, Pascal Fua, Alan L. Yuille, Jens Kleesiek, Jan Egger
arXiv preprint, 2023
Project page / Code / arXiv / Dataset
MedShapeNet contains over 100,000 medical shapes, including bones, organs, vessels, muscles, etc., as well as surgical instruments. You can search, display them in 3D and download the individual shapes by using our shape search engine.
|
|
Point Cloud Diffusion Models for Automatic Implant Generation
Paul Friedrich, Julia Wolleb, Florentin Bieder, Florian M. Thieringer, Philippe C. Cattin
MICCAI, 2023
Project page / Code / arXiv / Paper / YouTube
Following the recent success of diffusion models, we propose a novel approach for automatic implant generation based on a combination of 3D point cloud diffusion models and voxelization networks. Due to the non-deterministic sampling process in our diffusion model, we can propose an ensemble of different implants per defect, from which the physicians can choose the most suitable one.
|
Academic Services
- Conference reviewer: MICCAI, DGM4MICCAI
- Others: Member of the Integrity Comission @ DBE University of Basel
|
|