Ergodicity-aware continual reinforcement learning
Sector: Hospital • Location: Finland
Source: EU Funding & Tenders Portal
Current reinforcement learning (RL) algorithms optimize ensemble averages across episodes — a fundamental mismatch with real-world deployment, where we care about the single trajectory that actually unfolds. Real-world systems are continual: they evolve without reset, with irreversible consequences, and under non-stationary dynamics. This project develops the mathematical foundations and algorithm
- Status
- Prospective
- Sector
- Hospital, Automotive, Manufacturing (Industrial)
- Location
- Finland
- Updated
- 19 Nov 2026
- Source
- EU Funding & Tenders Portal
ConstructChat
Ask ConstructChat about Ergodicity-aware continual reinforcement learning
Pick a question to edit it, or write your own.
First answer free · no account
Project Information FAQ
Project Information
Participants
| Not available for this record. |
Status
Original status | forthcoming |
Taiyo status | Prospective |
Taiyo last update | 2026-11-19 |
Contact
| Not available for this record. |
Description
Description | Current reinforcement learning (RL) algorithms optimize ensemble averages across episodes — a fundamental mismatch with real-world deployment, where we care about the single trajectory that actually unfolds. Real-world systems are continual: they evolve without reset, with irreversible consequences, and under non-stationary dynamics. This project develops the mathematical foundations and algorithms to move beyond expectation-based optimization toward learning systems that optimize what matters: individual trajectory performance in non-resetting, evolving environments. Current RL fails on two fronts: it optimizes expected values that diverge from individual trajectory outcomes when ergodicity breaks, and it learns static policies that cannot adapt to environmental evolution. This project addresses both challenges simultaneously through ergodicity-aware continual RL, combining trajectory-centric objectives with adaptive, context-dependent policies. This enables autonomous vehicles adapting to seasonal changes over years, manufacturing systems evolving with production demands without downtime, and medical monitoring personalizing to patients over decades — applications infeasible with current RL theory. Our contributions are threefold: (i) we clarify, when and why expected values fail, and derive mathematical principles for learning ergodicity transformations that restore meaningful optimization objectives in non-ergodic environments; (ii) we design algorithms that integrate these new criteria with adaptive policies, enabling agents to sustain performance across long horizons without resetting assumptions; (iii) we validate the framework in novel, non-episodic, and non-stationary benchmark environments. Together, these contributions provide the missing foundations for continual RL, replacing expectation-based reasoning with tools that optimize long-term growth and resilience of deployed agents. |
Location
Country | Finland |
Source
Source | EU Funding & Tenders Portal |
URL |
More Details
Record type | Project |
Sector | Hospital, Automotive, Manufacturing (Industrial) |
Article published date | 2026-11-15 |
Research
Free account
View all details
You are reading the public part. A free account opens the rest:
- Every detail on this project
- News and media coverage
- Technical research
Free account · no card · lands you back on this project
