I would get a few rags and cover up the surrounding area, because gunk might drip out. Then spray Contact Cleaner liberally inside the latching mechanism. Then work it – latch and unlatch the seat belt a number of times. If it seems to be helping at all, keep doing it.
Can you take apart a seatbelt buckle?
Pry the buckle open if the foreign object remains inside the buckle. Some buckles can be opened by loosening a couple screws. Otherwise, use a flathead screwdriver to force the buckle open. Exercise caution as you open the buckle, as springs and other buckle parts might fly free when you do this.