Foundation
Models
for future AI
Artificial intelligence today is confined to the representation of the world found in datasets. We're building a new class of AI systems designed to gain a grounded understanding through direct interaction with the physical world.
The Research Project
Fostering a European ecosystem for research and innovation
DVPS is one of the most heavily backed projects in the Horizon Europe program, bringing together 20 leading organizations across 9 countries to advance the science and engineering of multimodal foundation models (MMFMs).
We are developing an open-source toolkit to streamline the design, pre-training, fine-tuning, and modality expansion of MMFMs. It supports the reuse and composition of pre-trained models, reducing development time and cost while enhancing adaptability across modalities.
Application Domains
Language
Enhancing how AI understands and communicates by combining speech, text, video, and gestures into inclusive, multilingual, and adaptive language technologies.
Discover the Use CasesHealth
Overcoming the limitations of traditional models by unifying diverse cardiovascular data into multimodal AI systems that enhance diagnosis, prediction, and treatment planning.
Discover the Use CasesEnvironment
Empowering geo-intelligence by fusing diverse spatial, sensor, and textual data into multimodal AI systems for smarter disaster response, urban planning, and environmental forecasting.
Discover the Use CasesTeam
Coordinator
Partners
Careers
Postdoctoral Research Associate in Multimodal Foundation Models for Healthcare (Two Posts)
If you are an ambitious researcher ready to shape the future of AI for healthcare, Nightingale AI at Imperial College London is seeking two outstanding Postdoctoral Research Associates to help build next-generation multimodal foundation models that can learn from the full richness of health data.
See full job positionSenior Deep Learning Scientist
With a PhD in Deep Learning, join us to define our research directions on DVPS, lead experiments on Europe's largest HPC infrastructure and promote our findings to the scientific community and world at large.
See full job positionSenior Deep Learning Scientist
With a PhD in Deep Learning, join us to define our research directions on DVPS, lead experiments on Europe's largest HPC infrastructure and promote our findings to the scientific community and world at large.
See full job position