Welcome! I ride an XR650L for dual sport...Uwharrie is probably your closest opportunity for trail riding the Dizzer but I'll be honest, it can whoop me on my CRF450. The XRL is a handful.
If you are looking for some gravel, I'd head straight up to Pisgah National Forest... Specifically the Globe and Mortimer areas South of Blowing Rock and around Linville Gorge. TONS there to explore. Run Maple Grove Church Road (sometimes referred to as Maple Sally) from south to north, starting around Adako and the entrance to the Brown Mountain OHV area (a good place to explore in itself). We did this one back over Christmas and it was absolutely epic - with the leaves off the trees you could see 3 or 4 corners ahead and could really haul. About an hour of nonstop, pristine gravel fire road. Be sure to stop at Betsey's in Mortimer. You could easily spend a week exploring this area alone.
Some other roads not far from you to explore, most around Asheville:
Heintooga Ridge Rd.
If Charlotte is anything like Raleigh, most of the DS opportunities are either really lame or...well, you just have to know someone. 😁
I usually don't really bother, just head straight to the mountains or maybe Croatan National Forest if I want to get into some dirt on the big red pig.
I haven't been to CAW in 10 years so can't comment if it's any better. It was just ok back then, I've heard it has more of a Busco Beach scene so haven't bothered.
If you really want to get into some good trails, Hatfield-McCoy would be a great place for the DRZ. Endless miles of more or less fire roads.