When my app is in the gallery (when it becomes public) will the URL I use in the Web_Viewer component be visible/public as well?
Yes. Your API Key will also be visible if you use them in the link. Passwords will also be visible if you use them in block text.