There is an obvious answer that one of them is a material, whereas the other one is a tag that you put on an object :-)
But they also have slightly different settings - the compositing tag for example lets you assign object buffer IDs to your objects, which in turn makes this object visible if you render a mask pass with the corresponding object buffer ID in multipass.
