We present some ideas and results towards a building-theoretical affine Grassmannian. One of our aims is to substitute many proofs carried out using relations in the Kac-Moody group using certain retractions. This is joint work in progress with Petra Schwer.