Match View

I have created a number of views for admins regarding matches. However, I'd like to create a view that I can use in panels that will display a user's challenges both challenged and received.

I can relate to Match participant. And have rows of match id and a single participant. Then a second row with an identical match id with the other participant. That all makes sense. But then when viewing the database, I noticed the field weight. Which seems to be the only way of determining who was the challenger and who the challengee. The weight field doesn't seem to have a handler or be accessible in views. Did I miss something?

The subsequent problem, even if I could get weight out the database, being in separate rows mean i still wouldn't naturally be able to have a row that shows both the challenger and challengee. Instead it would be two different rows, one as challenger and another row as challenge. Which could work, but would be a lot more clunky than the tournament node view, which I'm assuming is done in code.

So...

Am I looking at this all wrong and constructing my view incorrectly? (Or is this just the way it works at the moment?)
Should I just program the block myself? (Or is there a way to get a challenges view out of the module?)