I think it would be fun to rule that any magic item, attuned or not, counts as a magic weapon for the purposes of attacks. Then cursed items are useful and there’s a reason people keep them lying around, and you have an excuse to have all sorts of joke magic items that are really just used as improvised weapons.