Help troubleshooting a mis-shifting RD...

Hello all.

I just finished building my race machine for the season. Super excited about going hydraulic discs and 1x11.  

I am having a REALLY hard time setting up the med-cage Rival RD with the 11x32 PG1170 cassette so the shifts are spot on across all gears. Playing with the barrel adjuster fixes it, say, going up, and then it struggles with some down shifts; if I then adjust the barrel adjuster so it shifts well down, it then struggles going up.

All drivetrain parts are new, and I have changed/checked two different hangers and they are straight, according to my Rear Derailleur Hanger Alignment Park tool. I'm using a KMC 11sl chain. I have tried adding a link, screwing in/out the B screw, checked all housing/ferrules to make sure it is not moving into frame. I'm kinda out of ideas.

I took out for a good practice this morning, and had some ghost shifts and mis-shifts that were driving me crazy.

Any thoughts, greatly appreciated.