A knife? Maybe.
Now using the rifle butt to konck someone on the head would be nice.
Sure, most of the time you won't get into touching distance, but a melee button would be a godsent during houseclearing and such.
The "oh noes, no physical attack dance" when two people stand next to eachother is a wee bit silly anno 2010.