TeamCity build fails with PackageReference

Hi

I have an .net 4.7.1 Project which I try to migrate from package.config to package reference. Locally that worked all as expected and I am able to build. But on the Server it seems like some packages are not downloaded correctly. So I do get a lot of those exceptions:

error CS0103: The name 'KcaLibrary' does not exist in the current context [D:\Teamcity\BuildAgent2\work\19e1e046b0c40b07\ASKStatisticPublisherLogic\ASKStatisticPublisherLogic.csproj

But when I check the .nuget\packages folder on the BuildAgent I can see the needed packages there and in the detailed log I can see that the packges for that project where restored.

Also funny enough, other projects with .net 4.6.1 and 4.7.1 work as expected.

I also tried to add the -t:restore parameter to my Visual Studio Build Task, but that seems just the be ignored.

I use Nuget 4.4.1 with the restore mode and Visual Studio 2019 to build with the targets Rebuild.