Custom views templates not being used by Panels

I've set up a basic taxonomy view that shows a list of nodes from the selected taxonomy term.

The view works as intended when accessing the page directly (it renders output using the custom template files I've created).

I needed to have the taxonomy term description and some other fields from the taxonomy to show above the listing so I installed Panels.

It works, but Panels output is using the default template for the view instead of any custom templates I've created.

It reads templates:
/sites/all/modules/views/theme/views-fields.tpl.php
/sites/all/themes/mytemplate/templates/views-fields.tpl.php

But ignores templates like:
/sites/all/themes/mytemplate/templates/views-view-fields--page.tpl.php

Althou this template works when accessing the views page directly.

Am I missing some option somewhere, is this an intended behaviour or a bug?

I'm using these settings in views:
Format: Unformatted list
Show: Fields

Views version is 3.7