It's unlikely to be noticeable. In reality, the load rating scale is not a linear representation of harshness. No doubt it will affect the ride and a very high rated tyre will be stiffer. However, being one or two points higher than needed won't make a difference.
If you are considering higher profile tyres then you can often run them at lower pressures which would cancel out any perceived decrease in ride quality.