I'm not analyzing deeply or using and engine so I may be making mistakes here, but off the top of my head...
2. d4 is the main move, taking the center right away. The French Defense. Your 2. Nf3 allows Black to transpose to the Sicilian which is what happened here... it doesn't seem like a terrible move, but I do think d4 is stronger.
4. Qxd4 seems very odd. I don't play this line of the Siclian so it might be a thing, but it seems to me your Queen will become a target and 4. Nxd4 which is played in all the Sicilians I'm familiar with would have been stronger. Sure you've moved the piece twice, but it's been moved to a strong position in the center. If Black challenges with Nc6, then you can let Black take the Knight and take back with your Queen, when your Queen will stand well since Black has no more Knight to play to c6 to kick her. If Black on the other hand ever kicks the Knight (or Queen after exchange) with e5 then Black has to deal with a weakness on e6... which Black can sometimes do in the Neighdorf and Sveshnikov which are very sharp... I don't think Black could get away with e5 here, after already playing e6 so wasting a move... I think White would be very good there, so anyway I think 4. Nxd4 is probably the move. I don't know the line; I might be wrong.
7. Nc3 seems probably stronger than Bc3, getting a better hold on the center and not moving the same piece twice before completely development... but Bc3 challenging the fianchetto doesn't look bad either, just a little weird... maybe Nc3 would have been a tiny bit stronger.
Maybe 12. Re1 would have been better than 12. Nb3 which seems to lose you the Bishop pair, although certainly maybe something different somewhere else would have been an even better way to hold onto both Bishops.
I'm not really sure what you're trying to do with 24. e5 besides make your Bishop worse and your opponent's Bishop better.
Now comes the obvious blunder you mentioned 26. Qxb7 seems much stronger than Nxe5. It's not just your play you've got to watch out for. When your opponent blunders you must see it and take advantage of it.
After the exchange of Queens I'm not seeing how you could avoid losing the pawn as happened the game, though maybe there's a way I'm just not seeing and I can't help you there if that's what you're complaining about in the endgame. I'm really not strong in the engames myself... they've just never been terribly interesting to me and I play for fun, not to win, so I don't bother. Hope this helps.
I had lots of tabs open so that's part of it.
My current record is 681 won - 699 lost - so I think I have some idea of my weaknesses. There is a strong pattern that I get clobbered in the end game - because I rarely can figure out the long-term implications of some moves I make in middle game - where I can't figure out whether to move pawn A or B etc. Typically then the other guy runs riot with his rook or knight. Can more experienced players point out obvious blunders in this game? Thanks!