feature: Add podgroups statistics

[JesseStutler]

fix #3597, related proposal pr: #3750

Implementation

• In syncQueue of queue controller, concurrently using UpdateStatus will cause conflict, use ApplyStatus instead, and need to add patch permission of vc-controller for patch/status. And we record the statistics of podgroups in each state in queue as metrics to be exported outside, we don't update the statistics of podgroups in queue's status now.
• vcctl get -n [name] and vcctl list display the statistics of podgroups in each state from queue's status directly, instead we do one more step, query the podgroups owend in the queue, stat the counts of podgroups in each state at the vcctl side, and then display them.

Verification

• vcctl list
  • When there are no podgroups in queue, list is normal:
    
  • When there are podgroups in queue, list can also get the statistics of podgroups:
    
• vcctl get
  • get is normal:
    
• metrics
  

[volcano-sh-bot]

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
To complete the pull request process, please assign hzxuzhonghu
You can assign the PR to them by writing /assign @hzxuzhonghu in a comment when ready.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

• OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[Monokaix]

This is duplicated with the func in scheduler.

[Monokaix]

Is update still need?

[hwdef]

Is there something I'm missing? Where is the logic for deleting the update queue status

[hwdef]

Would a different port be better?

1. Make a distinction with the scheduler port.
2. Port 8080 is too common and prone to conflicts.

[JesseStutler]

Is there something I'm missing? Where is the logic for deleting the update queue status

Sorry I don't get the point, you mean that when the queue is deleted, the metrics need also be deleted, right?

[hwdef]

Sorry I didn't express myself clearly.
Our previous discussion was not to update some states of the queue, such as the number of pending and running in the queue.
So should we delete this part of the code?

[JesseStutler]

Oh yes now the pending/running/unknown/inqueue/completed pg statistics won't be persisted into etcd, see here:

queueStatusApply := v1beta1apply.QueueStatus().WithState(queueStatus.State).WithAllocated(queueStatus.Allocated)
	queueApply := v1beta1apply.Queue(queue.Name).WithStatus(queueStatusApply)
	if _, err := c.vcClient.SchedulingV1beta1().Queues().ApplyStatus(context.TODO(), queueApply, metav1.ApplyOptions{FieldManager: controllerName}); err != nil {
		klog.Errorf("Failed to apply status of Queue %s: %v.", queue.Name, err)
		return err
	}

You can see above that the data called queueStatusApply which need to update is only state and allocated resource, won't update those statistics now.