Usually, yes, if the files are stored normally with no password or encryption. A found USB drive can be plugged into another computer, and visible documents, photos, spreadsheets, PDFs, and folders may open just like they did on your PC.
Normal files copied to the USB drive can usually be opened, previewed, copied, or uploaded from another computer.
Hidden folders are not secure. A finder can reveal hidden items in File Explorer or use search tools to locate them.
Read-only status may reduce editing, but it does not stop viewing or copying.
ZIP or 7z archives can protect files inside the archive, but any file outside the archive is still exposed.
If private files were placed inside a password-protected secure area created by GiliSoft USB Encryption, a finder should not be able to open those protected files without the password.