Taking a piece of the board

My opponent was upset because I captured a piece by removing it from the board, but then I hesitated because I wasn't sure if I should have captured it, and then was wondering whether I should capture it with the bishop or knight.

Is there an official rule against this? I could see how there could be an argument that it would be easier to calculate without the piece on the board.

But thinking about it now, at how many seconds would it be an issue.

'

4.3 Except as provided in Article 4.2.1, if the player having the move touches on the chessboard, with the intention of moving or capturing:

4.3.1 one or more of his/her own pieces, he/she must move the first piece touched that can be moved.

4.3.2 one or more of his/her opponent’s pieces, he/she must capture the first piece touched that can be captured.

4.3.3 one or more pieces of each colour, he/she must capture the first touched opponent’s piece with his/her first touched piece or, if this is illegal, move or capture the first piece touched that can be moved or captured. If it is unclear whether the player’s own piece or his/her opponent’s piece was touched first, the player’s own piece shall be considered to have been touched before his/her opponent’s.'
Laws of Chess

But the issue was removing the piece from the board. Anything against the rules of removing a piece that can be captured and not touching any of your own pieces and then just staring at the board for an hour. Do I have the right to do so?

@3

"Anything against the rules of removing a piece that can be captured and not touching any of your own pieces and then just staring at the board for an hour. Do I have the right to do so?"
++ Yes, you can. You must now capture it. You can think about how to do that.