Can I upgrade build agent licenses to a TeamCity Enterprise Server license?

No. You can’t upgrade auild agent licenses to a TeamCity Enterprise Server license.

But you can always assign your existing build agents to your new Enterprise Server license and keep using them in the same setup. See Managing TeamCity build agents in your JetBrains Account for details.