SSMS 2014 Error opening a 'New Query'

I have a virtual machine running Windows Server 2012 R2 Standard, with SQL Server 2014 on it. When using SSMS on a session on the server, I get the error message shown below when I click on 'New Query'.

Any suggestions on how to correct this will be most welcome. Additional info: I am logged onto the server using an administrator account. When I log onto the server using my own account, which has domain admin rights, I do not get this error. When using SSMS locally on my machine as either myself or the administrator account, I don't get the error. The administrator account IS in the local 'Administrators' group on the server.

I am at a loss what to try next, so any help will be great.

Thanks
Chris

I am having problems uploading the image of the error message. It says:

The system cannot find the path specified. (Exception from HRESULT: 0x80070003)