Once you're on Windows 11 25H2, opening Settings > Gaming might show a new, fourth option saying Full screen experience.
Choosing between fullscreen and borderless fullscreen means deciding between better frame rates for gaming and the flexibility of easy multitasking.