Can we upgrade to higher number of Build Agents on an expired Enterprise Server license?

Yes, however, the license needs to be renewed before it can be upgraded.

If you need an upgrade quote, feel free to contact sales. It will be helpful to provide your current TeamCity license key, license ID, or most recent order information.