look although Super Saiyan 5 was never canon what was said made it even more powerful than ultra instinct. at least True Ultra Instinct which was what we saw in the tournament of power in DBS. we didn't see Mastered Ultra Instinct but rather True/Complete Ultra Instinct being achieved.
In the Dragon Ball AF fan manga, Super saiyan 5 was made to represent the top and last form a saiyan can obtain. In Super Saiyan 5, all of the saiyan's dormant power and potential would awake and become fully available.
reminds you of something? It should ! Seeing what Ultra Instinct was doing to Goku according to whis was gradually unlock his dormant power and potential. But while Ultra Instinct does it slowly and through phases, Super Saiyan 5 was supposed to do it in one move.
That's why when Goku in Dragon Ball AF achieved that form he couldn't stay on earth, because according to elder kai if Goku lost control of his Super Saiyan 5's Transformation power he would destroy the entire universe.
Now imagine that. Destroying the entire universe just by transforming into that form. No need for BS punches to create energy waves that grow stronger the further they spread from their point of origin.
So yes. In Dragon Ball AF Super Saiyan 5 was more powerful than Ultra Instinct really because Goku will only truly unlock all of his dormant power and potential when he masters Ultra instinct, which he hasn't done by the way. But with Super Saiyan 5 Goku would simply get all of that dormant power and potential completely unlocked.
so the reality is this form Super Saiyan 5 completely smashes True/Complete Ultra Instinct
Now, I bet some would even say this ''well Super saiyan 5 didn't grant self movement like Ultra Instinct does''. ''And that makes Goku with True Ultra Instinct more powerful than Super Saiyan 5 Goku''. And I would laugh in anyone's face that said that.
We ALL saw (although many seem to purposely forget) that Jiren who didn't have Ultra Instinct matched and even surpassed even True Ultra Instinct Goku. After I do remember this.
When Jiren completely overwhelmed Goku to the point that he couldn't even stand up. All until Krillin gave a big emotional speech and Goku gained an emotional power boost in order to win.
So for all intended purposes someone that doesn't even have the Ultra Instinct form can beat a character who does have the Ultra Instinct form. That's what DBS showed, no matter how much some Dragon Ball fans may try to deny it. Facts speak louder than FanBoyIsm so blind and deluded that they'll deny any fact that bursts their bubble of what they believed to be true and not what is actually true.
And that is so true that most of the answers we see to this question are people simply saying Super Saiyan 5 is non canon. They knew very well what Super Saiyan 5 represented in terms of power, or at least some of them did, one came up with a total BS power multiplier of x16 really out of his ass. Might as well have also said that Ultra Instinct also granted a x16 boost, when clearly it did way more than that.
The fact that so many so called Dragon Ball fans were so afraid to really address this question really shows that in their subconscious they understood what Toei did with Jiren to Ultra Instinct. They took what was supposed to be this godly outmatched power by those that didn't have it, and showed that even those without it can beat it. But those fans will never admit it.
Hell, they don't even admit that all Goku did was achieve the True form of Ultra Instinct and not what they call Mastered Ultra Instinct ! When Beerus said it was not mastered, Shin said it wasn't mastered, and even Goku said it wasn't mastered.
Canon...Not Canon...It does not matter ! What matters it what those forms offered to the user. And Super Saiyan 5 offered Goku in one transformation something Ultra instinct could not.