Geometric Deep Learning for Neural Artifacts: Symmetry-Aware Learning across Trained Model Weights, Internal Representations, and Gradients
One of 1,906 projects Taiyo tracks in Israel.
Source: EU Funding & Tenders Portal
The explosive growth of deep learning has created fundamentally new data modalities: the mathematical byproducts of neural network development. Practitioners generate daily vast amounts of valuable but underutilized data---trained model weights, internal representations from inference, and network gradients from training. These byproducts, which we term Neural Artifacts, contain crucial informatio
- Status
- Prospective
- Sector
- Power Generation (CCGT), Commercial
- Location
- Israel
- Updated
- 19 Nov 2026
- Source
- EU Funding & Tenders Portal
ConstructChat
Ask ConstructChat about Geometric Deep Learning for Neural Artifacts: Symmetry-Aware Learning across Trained Model Weights, Internal Representations, and Gradients
Pick a question to edit it, or write your own.
First answer free · no account
Project Information FAQ
Project Information
Participants
| Not available for this record. |
Status
Original status | forthcoming |
Taiyo status | Prospective |
Taiyo last update | 2026-11-19 |
Contact
| Not available for this record. |
Description
Description | The explosive growth of deep learning has created fundamentally new data modalities: the mathematical byproducts of neural network development. Practitioners generate daily vast amounts of valuable but underutilized data---trained model weights, internal representations from inference, and network gradients from training. These byproducts, which we term Neural Artifacts, contain crucial information about model behavior, optimization, and internal processing. Learning on neural artifacts holds transformative potential. Learning on Weight Spaces - weights of trained models - could revolutionize model selection, editing and generation. Learning on internal representations enables efficient hallucination detection on Large Language Models and other analyses. Learning on gradient spaces could transform model optimization and analysis. However, existing methods for learning on neural artifacts achieve only a fraction of this potential as they fail to account for fundamental mathematical structure, leaving the field without principled methods to harness the full power of these emerging data types. The key insight is that neural artifacts share deep mathematical structures—symmetries inherited from their underlying architecture. By developing a geometric deep learning framework that respects these symmetries, we can unlock their full potential. Building on our pioneering equivariant architectures for neural artifacts, we propose developing theoretical foundations and practical tools. This includes designing symmetry-aware architectures, establishing theoretical guarantees, developing novel applications, and delivering open-source implementations. Success will provide practitioners with powerful tools for understanding, generating, optimizing, and controlling neural artifacts. This research transforms neural computation byproducts into learnable information— extremely challenging due to their high dimensionality and symmetry structure, but with revolutionary potential. |
Location
Country | Israel |
Source
Source | EU Funding & Tenders Portal |
URL |
More Details
Record type | Project |
Sector | Power Generation (CCGT), Commercial |
Article published date | 2026-11-15 |
Research
Free account
View all details
You are reading the public part. A free account opens the rest:
- Every detail on this project
- News and media coverage
- Technical research
Free account · no card · lands you back on this project
