Is it possible to change the order in which panels are displayed in the configuration overview page?

Yes. This can be done in panel configuration. For this you have to be a Jira administrator or a project administrator with panel editing permission.