After a lot of effort I found out that my collisions work much more stable if my colliders don't have sharp angles. 

I've updates my crates to have cut off corners, which makes the collisions more stable.

Here's a result of a small test I did. I'm really happy with the result!

My next goal will be to introduce a rope attached to the ship, to carry the crates with.