Product sorting relies on the default menu_order property, which unfortunate can keep only value at a time. Giving that if a product belongs to multiple categories, only the very last sorting order value will be held, everything else will be overwritten. In other words, if you set sorting for the products which belong to a category, going to the next one will remove the order you set previously.