I don't know why it is non-obvious, but I finally tracked down to how have mutt use a text web browser (lynx|links) to display email with HTML bodies or attachments.
In your ~/.mailcap, put this:
text/html; lynx %s; nametemplate=%s.html
A cryptic reply here
pointed to the right part in the Mutt manual