Is there a way to not have Ulysses open the WordPress admin in a browser tab after I publish a post? Because I don’t need it to, and it’s really annoying.

@petebrown when you publish, right at the bottom of that screen there is an action field. Set it to none and you should get what you’re after.