I haven’t been to a game at Camden Yards but a guy I work with goes a few times a year (we are in CT) and he echoes what you said about Oriole fans like to mix it up with opposing fans. I’ve been to many Yankee/Red Sox games and fights are common place in the stands, concession lines, bathrooms, press boxes, wherever those two fan bases are congregated in numbers. The AL East has some great rivalries.I don't hate the Yankees, I dislike them.
As an Orioles fan, I HATE the fair weather Yankee fans that show up at Camden Yards only when the stripes are doing well. It's a recipe for fights galore as us Baltimore folk tend to like to muck it up.