Why not just get a glock with a gigglestick or two? The only real advantage for an AR pistol in home defense is the magazine capacity, and the whole package is kinda big and unwieldy.
Having worked with guns inside building pretty extensively, I have to disagree. An SBR (because face it, that's what we're talking about here) is one of the best close in weapons around. It is easy to aim and control (especially on follow up shots), an order of magnitude better against people then a pistol, and as compact (when in a firing position/low ready) than a pistol (when also in a firing position/low ready). There's a reason no one slings their rifle and draws a pistol when entering a house.
Perd,
TLDR: 5.56 in the right setup is as good a caliber for indoors as any, and better than most, plus is cheap and has a lot of knowledge about what works and what doesn't. Stick with that.
Longer version:
5.56 needs to be going in excess of 2500FPS (ish) to both be effective on people and fragment in a wall to decrease over penetration. For the M193 and M855/M855a1 loads and clones this is easily obtainable from a 10.5" barrel out to 50(ish)m. (There are a lot of variables) Inside a building is no problem, unless you live in a warehouse. so anywhere from 10.5-14.5" is a good sweet spot for 5.56 and the 10.5" end is pretty good for inside. Under 10" not only does velocity suffer, but the noise and flash start to get really bad. I had a 7.5" 5.56 for a little bit, and while it wasn't that much louder than a rifle, the flash was obnoxious, even with a flash hider. Speaking of which, a can would be the best for this purpose, but lots of folks don't have one, or don't want to run one on a home defense gun. If no can, then you will want a very effective flash hider. Stay away from anything resembling a break or compensator. In a building the concussion of a brake is way worse than the flash of burning powder.
.300 blk subs puts you right back into the over penetration issues of pistol and shotgun projectiles, and IME .300blk supers aren't less concussive or flashy then 5.56. Or at least not enough to be worth the added cost.
I currently run a 10.5" 5.56 with a can as my go to carbine, and have done shoot houses with it. It's very handy, fast on target and easy to make good hits. Anything that is built to the basic Mk18 specs will make a great indoors carbine.
I realized I talked more about rifle setup than caliber, which was the question you asked, but with an AR pistol it's important to make sure the gun works well with the caliber you've chosen.
(edited to fix typo)