I like Queenless middlegames, but not so much as to steer for them if the position doesn't call for it. 

When the Queens come off, many players mistakenly believe they are in an ending and begin playing as if they were.  But if there are Rooks and a couple pair of minor pieces remaining, it's not an endgame yet.  Several of my best games involve Queenless middlegames with strong attacks and sharp tactics.

But chess doesn't permit us to easily turn a game into something we enjoy, the opponent gets an equal vote and usually seeks to disrupt our ambitions.  So we must always just play the position we have reached, even if it isn't our ideal.

It really depends on the position. If it's a closed one where the queen is having little impact anyway I can do without her. If it's an open one then obviously I try not to.