Great, this really helps. Seems there is quite an oxydation layer on the tracks, even though they are still shiny. The sanding does the trick, the solder bonds well after that. Especially he 12V crossings have issues with conducting as the 4 track pieces are connected by a metal strip that is pressed underneath the rail clamps so was working on soldering those. It has worked, resistance went from 12 Ohm to zero so mission accomplished.
The 12V rails do tend to get rusty when moist so was thinking there must be some iron in there. I used Inox flux but that did not seem to help in getting a good bond to the metal. I used silver solder 3,5% which worked pretty good.
@LEgotux, I would be interested in seeing the points monstrosity you have created, maybe you can post a picture?