People who tag with "privacy law" :

azeem

Items tagged "privacy law" :

💭 Thought by azeem about 1 year ago. | Public

AI can be used to recreate visual and sensory data from functional brain imaging techniques such as fmri. This is worrisome for surveillance. We already know about bulk collection. Imagine what white supremacy & GOP will do with thought policing?!


bioRxiv

High-resolution image reconstruction with latent diffusion models from human brain activity

Reconstructing visual experiences from human brain activity offers a unique way to understand how the brain represents the world, and to interpret the connection between computer vision models and our visual system. While deep generative models have recently been employed for this task, reconstructing realistic images with high semantic fidelity is still a challenging problem. Here, we propose a new method based on a diffusion model (DM) to reconstruct images from human brain activity obtained via functional magnetic resonance imaging (fMRI). More specifically, we rely on a latent diffusion model (LDM) termed Stable Diffusion. This model reduces the computational cost of DMs, while preserving their high generative performance. We also characterize the inner mechanisms of the LDM by studying how its different components (such as the latent vector of image Z, conditioning inputs C, and different elements of the denoising U-Net) relate to distinct brain functions. We show that our proposed method can reconstruct high-resolution images with high fidelity in straight-forward fashion, without the need for any additional training and fine-tuning of complex deep-learning models. We also provide a quantitative interpretation of different LDM components from a neuroscientific perspective. Overall, our study proposes a promising method for reconstructing images from human brain activity, and provides a new framework for understanding DMs. Please check out our webpage at this https URL. ### Competing Interest Statement The authors have declared no competing interest.

HTTPS://WWW.BIORXIV.ORG/CONTENT/10.1101/2022.11.18.517004V1


Tags: brain imaging, fmri, stable diffusion, ai, cognitive neuroscience, Freedom of thought, privacy law

Comments

azeem about 1 year ago


Upvote ↑ 0 / 0 Downvote ↓


Share


Comment