Buildings constructed with cross-laminated timber (CLT) are increasing in interest in several countries. Since CLT is a sustainable product, it can help the building industry to reduce greenhouse gas emissions. Furthermore, buildings constructed with CLT are increasing in building height, thereby increasing the load on the junctions and structural building elements further down in the building. Several studies have investigated how the load impacts the sound transmission between apartments. The majority found that an increasing load could have a negative effect on the vertical sound insulation. However, the findings are limited to a few measurements or building elements, and the studies only investigate junctions with resilient interlayers. This article aims to investigate if the building height, and thereby the load, affect the vertical airborne sound insulation between apartments on different stories in different cross-laminated timber buildings, with or without the presence of viscoelastic interlayers, and to quantify the effect. Four CLT buildings with different building systems, building heights, and the presence of viscoelastic interlayers in the junctions were measured. The airborne sound insulation between different apartment rooms was measured vertically for stories on the lower and higher levels. The difference in airborne sound insulation was calculated separately for each building, and the measurements indicate that the vertical airborne sound insulation reduces further down in the buildings. Therefore, results show that increasing load, by an increasing number of stories, has a negative effect on the vertical airborne sound insulation.