Error when calling push-sum optimizer

[yangxuanfei]

Note that the bottom layer has the definition of DistributedPushSumOptimizer, why call this error：
AttributeErron: module "bluefog.torch’’has no attribute 'DistributedPushSumOntimizer‘

[BichengYing]

Hi yangxuanfei,

It is might because of the typo? DistributedPushSumOntimizer, note you wrote Ontimizer instead of Optimizer?

The definition of this in here:
https://github.com/Bluefog-Lib/bluefog/blob/master/bluefog/torch/optimizers.py#L1180

If it is note the typo, could check the versions?

Thanks

[yangxuanfei]

Thanks for the reply, but I checked and it wasn't a typo. Are you referring to the version problem of bluefog? We are using version 0.3.0, is this a problem?

[BichengYing]

Oh, we didn't expose this optimizer. See the source code here https://github.com/Bluefog-Lib/bluefog/blob/master/bluefog/torch/__init__.py#L21
Because we are not satisfied the current implementation and the performance doesn't seem very good.

However, if you really want to use it, you can try this

from bluefog.torch.optimizers import DistributedPushSumOptimizer

I will encourage you to improve the original source code if you have any idea. Code is here

bluefog/bluefog/torch/optimizers.py

Line 1026 in 8f74265

class _DistributedPushSumOptimizer(torch.optim.Optimizer):