LONDON (AP) — Prince Harry’s fight for police protection in the U.K. received another setback on Monday, when a judge rejected his request to appeal an earlier ruling upholding a government panel’s decision to limit his access to publicly funded security after giving up his status as a working member of the royal family.

The long-running legal battle began more than four years ago when Harry challenged the panel’s decision, arguing that he and his family still needed an armed security detail because of hostility directed toward him and his wife Meghan, Duchess of Sussex, on social media and relentless hounding by the news media.

But High Court Judge Peter Lane ruled in February that the panel’s decision, which provides for “bespoke” security on an as-needed basis, wasn’t unlawful, irrational or unjustified.

“Insofar as the case-by-case approach may otherwise have caused difficulties, they have not been shown to be such as to overcome the high hurdle so as to render the decision-making irrational,” Lane wrote in his 51-page ruling.