It appears that I have to proactively select the timezone I'm in to Google Drive so that they display correctly. Is there a way I can push this setting to all users within the organization?
You can change your timezone in the settings for Google Drive. See below screenshots.
As for changing it for all users this is not possible. Each user will have to set their timezone individually.