Since there is air in milk containers, milk will slosh inside the carton when moved. Frozen milk won’t slosh, which would certainly affect how it feels when the container is handled. Its inertia would be completely different, making it feel “more massive,” which could be described as “heavier.”