To properly set up load shedding you will need to know the limiting factor of your service. This is essentially the resource that gets exhausted first when it is overloaded. For many systems, it is the CPU but can also be memory, disk I/O, network I/O or something else.
This is a very good point... knowing the limiting factor of a service. But I've never used it for load shedding which makes sense.