It is literally plural. Paul's describing two heavens here. 1. Physical (visible) and 2. Spiritual (invisible).
Many people think he's being melodramatic (exaggerating, so-to-speak) when he says you were circumcised, buried with Him and raised together with Him. I don't. Just because you can't literally see non-physical things, doesn't mean they are not literal.
Colossians 2:11-14 Colossians 1:16-20 in whom also you were circumcised with a circumcision not made by hands, by the removal of the body of the flesh, by the circumcision of Christ, having been buried with him in baptism, in which also you were raised together with him through faith in the working of God, who raised him from the dead. And although you were dead in the trespasses and the uncircumcision of your flesh, he made you alive together with him, having forgiven us all our trespasses, having destroyed the certificate of indebtedness in ordinances against us, which was hostile to us, and removed it out of the way by nailing it to the cross.
...
because all things in the heavens and on the earth were created by him, things visible and things invisible, whether thrones or dominions or rulers or powers, all things were created through him and for him, and he himself is before all things, and in him all things are held together, and he himself is the head of the body, the church, who is the beginning, the firstborn from the dead, so that he himself may become first in everything, because he was well pleased for all the fullness to dwell in him, and through him to reconcile all things to himself, by making peace through the blood of his cross, through him, whether things on earth or things in heaven.
This physical heaven/Earthwill, sure.
But the non-physical Heaven (the one where we have been raised with Him), nope!