Activate Navigation Bar
Bring up the Navigation Bar as needed, let it disappear when finished.
Getting into the flow means stripping down your UI distraction (turn off the Project tool window and Navigation Bar) then going keyboard-centric to avoid the mouse. But you still need to get to your files, and sometimes you'd prefer to browse instead of use Recent Files ⌘E (macOS) / Ctrl+E (Windows/Linux) or the Find File ⌘⇧O (macOS) / Ctrl+Shift+N (Windows/Linux) action.
If you've uncluttered your UI by hiding the Navigation Bar, bring it back on demand. Use Navigate | Jump to Navigation Bar ⌘↑ (macOS) / Alt+Home (Windows/Linux) to temporarily re-active the Navigation Bar, but as a temporary panel. Once you use use it, the window disappears.
If you use this tip and temporarily make it appear, how do you make it disappear? Press Jump to Source ⌘↓ (macOS) / F4 (Windows/Linux) or just hit ␛ (macOS) / Escape (Windows/Linux) to go back to where you were working.
Perhaps you didn't hide the Navigation Bar. I don't, because I like those other toolbar buttons to the right. But still, you'd like to use it without the mouse. Activating the Navigation Bar still helps, as it moves the focus out from the editor and up to the Navigation Bar, where you can then use your cursor keys.
How did we hide it in the Navigation Bar first place, or bring it back if wanted? The View menu's Navigation Bar item is a toggle. Want a faster, keyboard-centric way to toggle? ⌘⇧A (macOS) / Ctrl+Shift+A (Windows/Linux) lets you search for such settings and even toggle inline. Type vi nav
to speed search, make sure the selection is on View: Navigation Bar, then press enter. The setting is toggled...no mouse usage needed.