Housing and welfare groups call on Anthony Albanese and Peter Dutton to show leadership amid rise in ‘nonsense’ rhetoric