US House Speaker removes Schiff, Swalwell from intelligence panel