Assuming you're not suggesting the other barrel would have no choke tube installed at all, no. (I'm also assuming both the flush choke tube and the extended choke tube are threaded and fitted correctly for the gun.)
It'll look a bit strange and you might get a few questions about it, but no harm can come from it.