That really sounds like brake contamination. You don't have to actually see any liquid. Even very small amounts will embed into the shoes along with brake dust and ruin the shoes and the drum surface. If the shoes look dark in color at all, then they are likely contaminated. Look at the backing plate carefully for any apparent dark spots to indicate oil residue from either the brake fluid in the wheel cylinders or gear oil from the differential seals.