Switch to using farstream for media handling
While it hasn't seen a lot of development recently it already has a number of goodies (ICE transmitter, supports multiple participants, etc) that make it worth switching to.
It currently only supports SRTP and not DTLS-SRTP, but code comments indicate that adding it at some point was taken into consideration when it was designed.