All I can tell you is my own (and my sons) experience of migrating to Linux. To begin with we found difficulties in changing our habits from being Windows users… Drivers, hardware and propriatory software seemed to be issues, but within a few weeks we had adjusted our thinking and realized how easy it all is when sorting out OS issues.
I like to build PC’s, my son is into coding. Within a couple of months we were wondering how we ever got by without Linux, it really is a truly remarkable entity and all the different flavours of it have become a delight for us to play with. I have a science Linux for home educating my son, Ubuntu Studio with KXstudio repos and all the bells and whistles for my music, video and photography, Debian Wheezy for running my CNC, Xubuntu on my ancient laptop (brought it back to life with that) and I use Kubuntu for gaming.
There isnt a piece of hardware that I have not been able to use yet, and I have boxes of bits and pieces, although if I ever have a problem with hardware drivers, I have a PC that runs Manjaro which I think will run just about any hardware out there.
Only issue I ever had was trying to get some software to run on my Ubuntu Studio, so I jumped on a forum, posted my problem and one of the team that produces Ubuntu Studio came on, sorted my problem and incorporated the solution into the next build. Thats how things work with Linux, thousands of (clever) users out there constantly tweaking things and improving them for the rest of us.
Certainly not trying to convert you, just saying that for us, the switch to Linux has been fabulous and we will never go back as the benefits are too valuble to us. I do remember whenever I used to install Windows, I would then go through a checklist of things to set up the system to work the way I wanted, it is the same for Linux, but that list does not now include installing drivers and I find Linux does exactly what I want it to, could not say the same for Windows…
As to my audio, I use a Focurite Scarlett 2i4 usb, which runs perfect out of the box, no drivers needed and my latency is 4ms. My needs are very moderate for an amatuer fun studio, but I have so many Linux tools to play with (all free) I will be years getting round to all of them…
Hope you manage to give it a try, please remember that the best way to check out your hardware compatibilty, is to create a USB live version of Linux that you can run without altering your system, you will get to play around with Linux, check your hardware and if you dont like it, you remove the USB stick and reboot, quite painless…