Wrong loading order of panels-base.js, layout.js, and display_editor.js

On the responsive builders in the panel layout tab I get
Uncaught TypeError: Cannot set property 'Layout' of undefined
Uncaught TypeError: Cannot set property 'bindClickDelete' of undefined

Turns out panels-base.js gets loaded after display_editor.js and layout.js. It gets even worse in conjunction with the responsive layout plugin if javascript aggregation is activated, as the editor won't even load.