I have a stateful session bean... should I have one Hibernate session living as long as the bean - or - should I open a new session within each call on the bean?

depends upon whether you plan to serialize objects from that session to-and-from the client.

I don't plan to serialize persistent objects. I map them to domain objects which in turn are sent to and from the client.

Then either approach is workable.