Strange noise when let off gas but still in gear?

It just started. When I'm in 3rd or 4th gear and I let off the gas, I get a metal grinding/ clicking noise. It stops when in neutral. I'm hoping it's just a bearing and not the transmission. Car is a 97 eclipse spyder with 150k miles