The issue here is that the user's frontend from isn't showing for guests on the frontend.
Solution:
In a case like this and you have our Access plugin enabled I would suggest that you check the permissions for the form at Toolset -> Access Control-> Forms and then check for your form's permissions.
