In order to be able to send emails to a certain Audience segment, you would need to sync the Audience ID with the ID of the email service provider. This way we would be able to identify users across multiple devices and provide the email service provider with a list of users in an Audience segment.
That being said, you can create segments based on email addresses, just via API though. Once created, the segments will appear as external segments in Audience.